Getting results

Charts Reference

User Rating: / 4  |  Rate this article: PoorBest 

{ArticleIndex}

chart-details


OptionDescription
1_snag_evi
Chart menu button
A drop-down menu which allows you to perform global actions on the chart (see "Chart menu options" below).
2_snag_evi Expander button
Show/hide expanded description about each statistic included in the chart.
3_snag_evi
Chart area The area where graphs are plotted.
4_snag_evi Statistics menu buttons
A drop-down menu which allows you to manipulate each individual statistic.
5_snag_evi
Chart expand button
Toggle viewing statistics for each component in separate charts.
6_snag_evi Agents
Toggle viewing statistics for each agent in separate charts.
7_snag_evi
Zoom A drop-down menu which allows you to select the zoom level for the chart.
8_snag_evi Follow If selected, the chart will "follow" new data points as they become available

Adding statistics

The Add statistic panel is used for adding Statistics to a Chart. See the Statistics Reference for information about each individual Statistic.

To add statistics, simply drag any item from the Components toolbar into the Charts area. This will bring up a panel similar to the one shown below:

add-stats

Only leaf nodes (nodes which do not have any children) may be selected. For example, in the example above, the default statistics for "Runner" components are selected. To select a different item, simply click on it. To select multiple items, keep the Ctrl key pressed while you click.

Chart Menu Options

When clicking on the Chart's menu-button, the following menu is shown:

chart-menu-options

It allows you to delete or rename the chart. It also contains an option to export the raw data contained in the chart, which can be useful if you want to create your own reports with external tools.

Statistics Menu Options

This menu allows you to remove a specific statistic from the chart or modify its scale.

stats-menu-options

To change the scale of a statistic can be useful when different data points have very different values but it is still desirable to see them in the same chart.

When you choose the Scale option for any statistic, you can modify the scale for any statistic in the same chart, as shown in the panel below:

Scale

Use the sliders to modify the scales. The scale value is shown in a popup as you use the slider. Click on "Done" when you are happy with the result.

Zoom

The Zoom menu button is used for setting the zoom level used by the chart.

chart-zoom


 

Comparing Test Runs

User Rating: / 5  |  Rate this article: PoorBest 

LoadUI allows you to compare old Results with each other and with the live statistics generated from the current run. Comparing results is only available in LoadUI Pro, so it is recommended that you download a free 14-day trial of LoadUI Pro before continuing. Before reading this article, we also recommend that you follow our Statistics Basic Tutorial.


Try the full experience of Pro:

How to compare test runs

From the Statistics Tab, click on the Compare button:

compareButton

This will bring up the Test Run Comparison Selector containing all your previous test runs, as shown below:

compare-charts

Comparing two results is now as easy as selecting one test run from the left set (this will be the Primary Test Run) and one from the right set (this will be the Compared Test Run) and then click Load. All charts will now show duplicate lines for each Statistic – lines from the Primary Test Run will show in their original color while the corresponding lines from the Compared Test Run will appear in a darker shade:

chart-with-comparison

Selecting Current run as the Primary Test Run instead of an old test run will allow you to compare live statistics from the current run (if you have a project running) with an old test run.

Clicking Clear will clear any selection made in the right set, so that you can go back to just watching a single test run.

 

Statistics Basic Tutorial

User Rating: / 5  |  Rate this article: PoorBest 

{ArticleIndex}

Preparations

Create a new project with a Fixed Rate Generator connected to a Web Page Runner. Set the Generator's rate to 10/Sec, name the Runner My Runner and point it to some URL. Start the project in by clicking the Play button and let it stay running during the whole tutorial.

If you are new to LoadUI, start with Your first load test tutorial, which shows how to do all of this step-by-step!

Showing Statistics from a component

Switch to the Statistics Tab. Then locate the icon representing My Runner in the left toolbar and drag it into the empty space to the right:

addStatistic

This will create a Chart containing My Runner. A Chart can show all the Statistics of its contained Components.

Before the chart is created, you will be shown the following dialog:

addStatisticTree

LoadUI has default statistics for every component, which are automatically selected in the dialog when you create a new chart.

If you are happy with the default, you can just click on the "Add" button. To change the selections, you can simply select an item (it must be a leave node, ie. you cannot select an item which has children) by clicking on it, or to select multiple items simultaneously, keep the Ctrl key pressed while you click.

You should see a newly created chart which looks like this:

chart1

Playing around

The new Statistic will stay steady at the value 10 since you previously set the Fixed Rate Generator in your project to 10/Sec. Let's lower the rate of the our generator to 1/Sec while keeping the Statistics Window open:

A Fixed Rate Generator with the rate set to 1/Sec.

As expected, the Statistic showing My Runner's Sent Requests per second (blue line) falls to 1 as well:

chart2

Also, use the horizontal scrollbar to go back to the beginning of the test (the X-axis should show 00:00). Notice that when the scrollbar is positioned to the far right, the chart will be always show the most recent datapoints as the test goes on. All other scrollbar positions will fixate the chart at that specific time interval.

Removing Statistics

Now remove the Transactions Per Second Statistic (abbreviated TPS), by clicking its dropdown menu, and then Remove:

removeStatistic

What's next?

There's a lot more to the Analysis view, so take a deep breath and then proceed reading the Statistics in-depth guide.

As always, don't forget to have fun!

 

Managing Test Runs

User Rating: / 2  |  Rate this article: PoorBest 

{ArticleIndex}

For the purpose of this tutorial, the current project has previously been run three times. The individual runs were started 09:43, 11:04 and 11:42 respectively.

View previous test runs

To see previous test runs of a project, click the Previous test runs button in the Statistics Tab. This will open the following window:

manageTestRuns1

Archiving a test run

Having a list of automatically saved recent test runs can be handy, but since LoadUI only saves a limited number of results automatically (before deleting the oldest one) you should know that you can archive test runs. Archiving a test run will not just prevent LoadUI from ever deleting it, but also lets you rename it for easier access.

If you want to archive a test run, simply drag and drop it from the Recent test runs container to the Archived test runs container. You don’t have to rename the test run, but we encourage it since it’ll make it easier to find it later on. Renaming is almost as easy; just click the text on the test run's top border and click Rename:

renameArchivedResultMenu

After archiving and renaming one of the recent Results, the Results view will look something like this:

manageTestRuns2

Change settings

Enter the global settings dialog by clicking the LoadUI logotype in the upper-left corner, and then clicking Settings:

globalMenu

From the Statistics tab of this dialog you can specify where in the file system you want test runs to be saved and how many test runs LoadUI should automatically save per project, before deleting the oldest unarchived test run.

The current test run will however always be be saved to disk regardless of this setting, since the Statistics Tab requires disk data to function . If you are willing to sacrifice the Statistics Tab on the altar of disk space, provide this command line option to LoadUI:

-Dloadui.statistics.disable=true

Moving test runs between computers

Test runs are by default stored in directories in [user home]/.loadui/results. The directory name for a test run consists of the project name and the date of the test run, e.g. Project_1_2013-09-19_181414-802. To share a test run, simply copy this directory (along with the project file found in [user home]/.loadui).

 

In-depth guide

User Rating: / 6  |  Rate this article: PoorBest 

{ArticleIndex}

In this article, we're assuming that you've already read our Statistics Basic Tutorial.

Global Statistics

In the Global menu in the left toolbar of the Statistics Tab, you will find the current Project as well as all your different scenarios. These can be used in Charts in the same way as Components to e.g. show Statistics for the whole Project. Just drag any of these items into the charts area to create a new chart.

global-toolbox

Expand

A Chart (1) expanded by Components. The sub charts are marked with (2) and (3). The sub charts show one Statistic each, while the main Chart shows both of these Statistics.The Expand panel shows the Statistics of the Chart categorised by Component. Each Component is shown in a separate sub chart. All changes made to the sub chart will be reflected in the main chart, and vice versa.

In the image to the right, a Chart 1_snag_evi containing two Components have its Component panel toggled. The two sub charts 2_snag_evi 3_snag_evi show the Statistics from each contained Component.

Agents

The Agents panel shows the Statistics of the Chart categorised by Agent. Each Agent is shown in a separate sub chart, which could be useful to see if any Statistics differs a lot between Agents. Notice that you will see this panel only in LoadUI Pro. Also, you must have agents configured in order to see anything in the Agents panel.

Zoom

Sets the horizontal (time) zoom level. The All level will show a complete view of the test run, from the beginning to the latest data point. How datapoints are aggregated in order to generate a visually reliable chart is documented here.

Follow

Click on this button if you want to "follow" the chart as new data is collected.

Scale

Lets you scale a Statistic to be more comparable with others. If you for example want to see Response time (milliseconds) in the same chart as Bytes throughput (millions of bytes), it might be useful to scale down Bytes throughput by 0.0000000001. Scaling is done by simply multiplying the actual values with the specified scale.

scale1 scale2

Raw data

Clicking Export Raw Data in the chart's drop-down menu will save all the data in the Chart to a CSV-file. This feature is only available in LoadUI Pro.

Exported data has one Statistic per column, like this:

TIMESTAMP, MY_RUNNER~AGENT1~RESPONSE_SIZE~AVERAGE, PROJECT_3~FAILURES~TOTAL
00:00:00, 12076, 0
00:00:01, 12290, 0
00:00:02, 11901, 0
00:00:03, 4088,  1
rawData

Tabs

The Statistics Tab can have several tabs itself, just as your favourite web browser. Tabs are useful if you are short on screen space or want to categorize your charts.

A tab called Untitled Page is created by default when you create a new project. A new tab can be created by clicking the plus button:

tab

...the new tab can then be renamed by right clicking it:

tabRename

Reporting

During or after a run, you can click this button to create a printable report:

report_button

This will bring up a dialog where you can select which pages that you want to include in the report. Reports can be printed or saved as a file (e.g. PDF).

A sample report.

Comparing Results

Test runs can be compared in the same chart. This can be done for old test runs, as well as in realtime for the current run. Read more about this in Comparing Results.