||Chart menu button
||A drop-down menu which allows you to perform global actions on the chart (see "Chart menu options" below).|
||Show/hide expanded description about each statistic included in the chart.
||Chart area||The area where graphs are plotted.|
|Statistics menu buttons
||A drop-down menu which allows you to manipulate each individual statistic.
||Chart expand button
||Toggle viewing statistics for each component in separate charts.
||Toggle viewing statistics for each agent in separate charts.|
||Zoom||A drop-down menu which allows you to select the zoom level for the chart.|
|Follow||If selected, the chart will "follow" new data points as they become available
The Add statistic panel is used for adding Statistics to a Chart. See the Statistics Reference for information about each individual Statistic.
To add statistics, simply drag any item from the Components toolbar into the Charts area. This will bring up a panel similar to the one shown below:
Only leaf nodes (nodes which do not have any children) may be selected. For example, in the example above, the default statistics for "Runner" components are selected. To select a different item, simply click on it. To select multiple items, keep the Ctrl key pressed while you click.
Chart Menu Options
When clicking on the Chart's menu-button, the following menu is shown:
It allows you to delete or rename the chart. It also contains an option to export the raw data contained in the chart, which can be useful if you want to create your own reports with external tools.
Statistics Menu Options
This menu allows you to remove a specific statistic from the chart or modify its scale.
To change the scale of a statistic can be useful when different data points have very different values but it is still desirable to see them in the same chart.
When you choose the Scale option for any statistic, you can modify the scale for any statistic in the same chart, as shown in the panel below:
Use the sliders to modify the scales. The scale value is shown in a popup as you use the slider. Click on "Done" when you are happy with the result.
The Zoom menu button is used for setting the zoom level used by the chart.
Comparing Test Runs
LoadUI allows you to compare old Results with each other and with the live statistics generated from the current run. Comparing results is only available in LoadUI Pro, so it is recommended that you download a free 14-day trial of LoadUI Pro before continuing. Before reading this article, we also recommend that you follow our Statistics Basic Tutorial.
How to compare test runs
From the Statistics Tab, click on the Compare button:
This will bring up the Test Run Comparison Selector containing all your previous test runs, as shown below:
Comparing two results is now as easy as selecting one test run from the left set (this will be the Primary Test Run) and one from the right set (this will be the Compared Test Run) and then click Load. All charts will now show duplicate lines for each Statistic – lines from the Primary Test Run will show in their original color while the corresponding lines from the Compared Test Run will appear in a darker shade:
Selecting Current run as the Primary Test Run instead of an old test run will allow you to compare live statistics from the current run (if you have a project running) with an old test run.
Clicking Clear will clear any selection made in the right set, so that you can go back to just watching a single test run.
Statistics Basic Tutorial
Create a new project with a Fixed Rate Generator connected to a Web Page Runner. Set the Generator's rate to 10/Sec, name the Runner My Runner and point it to some URL. Start the project in by clicking the Play button and let it stay running during the whole tutorial.
If you are new to LoadUI, start with Your first load test tutorial, which shows how to do all of this step-by-step!
Showing Statistics from a component
Switch to the Statistics Tab. Then locate the icon representing My Runner in the left toolbar and drag it into the empty space to the right:
This will create a Chart containing My Runner. A Chart can show all the Statistics of its contained Components.
Before the chart is created, you will be shown the following dialog:
LoadUI has default statistics for every component, which are automatically selected in the dialog when you create a new chart.
If you are happy with the default, you can just click on the "Add" button. To change the selections, you can simply select an item (it must be a leave node, ie. you cannot select an item which has children) by clicking on it, or to select multiple items simultaneously, keep the Ctrl key pressed while you click.
You should see a newly created chart which looks like this:
The new Statistic will stay steady at the value 10 since you previously set the Fixed Rate Generator in your project to 10/Sec. Let's lower the rate of the our generator to 1/Sec while keeping the Statistics Window open:
As expected, the Statistic showing My Runner's Sent Requests per second (blue line) falls to 1 as well:
Also, use the horizontal scrollbar to go back to the beginning of the test (the X-axis should show 00:00). Notice that when the scrollbar is positioned to the far right, the chart will be always show the most recent datapoints as the test goes on. All other scrollbar positions will fixate the chart at that specific time interval.
Now remove the Transactions Per Second Statistic (abbreviated TPS), by clicking its dropdown menu, and then Remove:
There's a lot more to the Analysis view, so take a deep breath and then proceed reading the Statistics in-depth guide.
As always, don't forget to have fun!
Managing Test Runs
For the purpose of this tutorial, the current project has previously been run three times. The individual runs were started 09:43, 11:04 and 11:42 respectively.
View previous test runs
To see previous test runs of a project, click the Previous test runs button in the Statistics Tab. This will open the following window:
Archiving a test run
Having a list of automatically saved recent test runs can be handy, but since LoadUI only saves a limited number of results automatically (before deleting the oldest one) you should know that you can archive test runs. Archiving a test run will not just prevent LoadUI from ever deleting it, but also lets you rename it for easier access.
If you want to archive a test run, simply drag and drop it from the Recent test runs container to the Archived test runs container. You don’t have to rename the test run, but we encourage it since it’ll make it easier to find it later on. Renaming is almost as easy; just click the text on the test run's top border and click Rename:
After archiving and renaming one of the recent Results, the Results view will look something like this:
Enter the global settings dialog by clicking the LoadUI logotype in the upper-left corner, and then clicking Settings:
From the Statistics tab of this dialog you can specify where in the file system you want test runs to be saved and how many test runs LoadUI should automatically save per project, before deleting the oldest unarchived test run.
The current test run will however always be be saved to disk regardless of this setting, since the Statistics Tab requires disk data to function . If you are willing to sacrifice the Statistics Tab on the altar of disk space, provide this command line option to LoadUI:
In this article, we're assuming that you've already read our Statistics Basic Tutorial.
In the Global menu in the left toolbar of the Statistics Tab, you will find the current Project as well as all your different scenarios. These can be used in Charts in the same way as Components to e.g. show Statistics for the whole Project. Just drag any of these items into the charts area to create a new chart.
At the bottom of a Chart, there are a few buttons. These will all toggle panels appearing from the bottom of the Chart. Don't be afraid to explore these, as the actual toggle panel buttons won't perform any action other than showing/hiding information. This chapter will explain the different panels briefly; for a more complete reference, see the Charts Reference page.
The Expand panel shows the Statistics of the Chart categorised by Component. Each Component is shown in a separate sub chart. All changes made to the sub chart will be reflected in the main chart, and vice versa.
In the image to the right, a Chart containing two Components have its Component panel toggled. The two sub charts show the Statistics from each contained Component.
The Agents panel shows the Statistics of the Chart categorised by Agent. Each Agent is shown in a separate sub chart, which could be useful to see if any Statistics differs a lot between Agents. Notice that you will see this panel only in LoadUI Pro. Also, you must have agents configured in order to see anything in the Agents panel.
Sets the horizontal (time) zoom level. The All level will show a complete view of the test run, from the beginning to the latest data point. How datapoints are aggregated in order to generate a visually reliable chart is documented here.
Click on this button if you want to "follow" the chart as new data is collected.
Lets you scale a Statistic to be more comparable with others. If you for example want to see Response time (milliseconds) in the same chart as Bytes throughput (millions of bytes), it might be useful to scale down Bytes throughput by 0.0000000001. Scaling is done by simply multiplying the actual values with the specified scale.
Clicking Export Raw Data in the chart's drop-down menu will save all the data in the Chart to a CSV-file. This feature is only available in LoadUI Pro.
Exported data has one Statistic per column, like this:
TIMESTAMP, MY_RUNNER~AGENT1~RESPONSE_SIZE~AVERAGE, PROJECT_3~FAILURES~TOTAL 00:00:00, 12076, 0 00:00:01, 12290, 0 00:00:02, 11901, 0 00:00:03, 4088, 1
The Statistics Tab can have several tabs itself, just as your favourite web browser. Tabs are useful if you are short on screen space or want to categorize your charts.
A tab called Untitled Page is created by default when you create a new project. A new tab can be created by clicking the plus button:
...the new tab can then be renamed by right clicking it:
During or after a run, you can click this button to create a printable report:
This will bring up a dialog where you can select which pages that you want to include in the report. Reports can be printed or saved as a file (e.g. PDF).
Test runs can be compared in the same chart. This can be done for old test runs, as well as in realtime for the current run. Read more about this in Comparing Results.