Getting results

Charts Reference

User Rating: / 2  |  Rate this article: PoorBest 
Posted Tuesday, 15 March 2011 14:49

chartsReference


OptionDescription
1_snag_evi
Components area
Area where the chart basic information is shown (e.g. the number of components assigned to the chart, icon, chart label).
2_snag_evi Components details
Show/hide detailed components information.
3_snag_evi
Statistics area
Area where all statistics assigned to the chart are shown. Drag statistics to the trash-hole to remove the statistic from the chart.
4_snag_evi Statistics details
Show/hide detailed statistics information.
5_snag_evi
Chart area
The area where graphs are plotted.
6_snag_evi Components
Show/hide separate graphs for each of the components.
7_snag_evi
Agents
Show/hide separate graphs for each of the agents.
8_snag_evi Add statistic
Show/hide panel for adding statistics to the chart.
9_snag_evi
Zoom
Show/hide panel for changing the zoom level of the chart (e.g. seconds, minutes etc.).
10_snag_evi Scale
Show/hide panel for setting the scale for statistics in chart.
11_snag_evi
Style Show/hide panel for setting the line style for statistics in chart (e.g. width, color, stroke).
12_snag_evi Raw data
Show/hide panel for exporting raw data.
13_snag_evi
Follow When set, the chart chart will always show the most recent data points of the current run.
14_snag_evi Sync
Synchronizes the zoom level and position in time of all sub charts belonging to the same Chart.
15_snag_evi
Chart menu A drop-down menu from which you can rename and delete the Chart.

Add statistic

The Add statistic panel is used for adding Statistics to a Chart. See the Statistics Reference for information about each individual Statistic.

charts-reference-add-statistic


OptionDescription
1_snag_evi
Components
Lists all statistic holders (components, project, test cases) that provide statistics data and are assigned to this chart. When one of these is selected, second column is populated.
2_snag_evi Statistic data
Lists all Statistic data provided by statistic holder selected in first column. When one of these is selected the third column is populated.
3_snag_evi
Metrics Lists all Metrics that can be applied to the chose Statistic data.
4_snag_evi Data source
Lists all agents that selected variable is available from. This is where user can choose to see the aggregated value from all available agents by selecting All option or just from one particular agent by selecting it from the list.
5_snag_evi
Add
Adds selected statistic to the chart.

Zoom

The Zoom panel is used for setting the graduation of time range. By increasing the graduation, time range is smaller, but more details can be seen.

charts-reference-zoom


OptionDescription
1_snag_evi
All
Displays all data from the beginning of test.
2_snag_evi Weeks
Sets time scale to weeks.
3_snag_evi
Days
Sets time scale to days.
4_snag_evi Hours
Sets time scale to hours.
5_snag_evi
Minutes
Sets time scale to minutes.
6_snag_evi Seconds
Sets time scale to seconds.

Scale

The Scale panel is used for setting vertical scale of statistics within a chart. Scaling is done by multiplying the actual data values by scale factor and it can be done independently for each statistic.

charts-reference-scale


OptionDescription
1_snag_evi
Scale combo
Sets scale by picking the scale factor from the list.
2_snag_evi Scale slider
Sets scale by moving slider.

Style

The Style panel is used for setting chart lines style (color, stroke, width). Each statistic has its own style.

charts-reference-style


OptionDescription
1_snag_evi
Color
Sets the line color by picking color from the drop down menu.
2_snag_evi Width
Sets the line width by moving slider. Default is 1px.
3_snag_evi
Stroke
Sets the line stroke. Available strokes are: solid, dashed and dotted.

Raw data

The Raw data panel is used for exporting raw chart data in CSV format.

charts-reference-raw-data


OptionDescription
1_snag_evi
Export raw data
Opens the file dialog where user specifies the export location. If specified file already exists user is asked for confirmation to replace it. Complete data, for the entire test, of all statistics assigned to a chart are exported.

 

Comparing Results

User Rating: / 1  |  Rate this article: PoorBest 
Posted Friday, 11 March 2011 16:40

LoadUI allows you to compare old Results with each other and with the live statistics generated from the current run. Before reading this article, we recommend that you know how The Results Window work.

How to compare Results

From the Analysis view, click on the Compare Results button found close to the upper left corner:

compareResultsButton

This will bring up the Result Selector containing all your previous Results, as shown below:

resultSelector

Comparing two results is now as easy as selecting one Result from the left set (this will be the Primary Result) and one from the right set (this will be the Compared Result) and then click Load data. All charts will now show duplicate lines for each Statistic – lines from the Primary Result will show in their original color while the corresponding lines from the Compared Result will appear in a slightly darker shade:

compareChart

Notice that the names of the Primary Result and the Compared Result will always be shown on the left and right side of the Result Selector button respectively:

compareButtonWithLoadedResults

Selecting Current run as the Primary Result instead of an old Result will allow you to compare live statistics from the current run (if you have a project running) with an old Result.

Clicking Clear will clear any selection made in the right set, so that you can go back to just watching a single Result.


As always, don't forget to have fun!

 

The Statistics Workbench

User Rating: / 3  |  Rate this article: PoorBest 
Posted Friday, 11 March 2011 15:33

{ArticleIndex}

Opening the Statistics Workbench

Open the Statistics Workbench by clicking the button that looks like a bar chart in the Project view:

The Statistics Window button.

The Statistics Workbench has two views (or states if you like), which we will now go into with more detail.

The Results view

The Results view lets you manage Results of a project. From here, you can access statistics from stored Results as well as from the current run (by double clicking their icons). For a tutorial on how to use this view, please refer to Managing Stored Results.

manageResults_empty

The Results view without any previous Results.

renameArchivedResult_Big

The Results view with two recent and one archived Result.

The Analysis view

Double clicking a Result or the current run in the Result view will open that Result in the Analysis view. From here you have full access to statistic data from any component and agent at any given point in time!

statView_empty

The Analysis view without any Charts added.

statsWindow

The Analysis view showing one Chart together with a sub chart.

The Analysis view is layered on top of the Results view in the same way that the Project view is layered on top of the Workspace view. Thus, clicking the close button will "go back" to the underlying Results view:

statWindow_top_closeButton_small

The close button of the Results view.

To learn how to use the Analysis view, please refer to the Analysis view.

 

Getting started with the Analysis view

User Rating: / 2  |  Rate this article: PoorBest 
Posted Friday, 11 March 2011 11:44

{ArticleIndex}

Preparations

Before starting this tutorial, you need to know the basics about the Statistics Workbench.

Create a new project with a Fixed Rate Generator connected to a Web Page Runner. Set the Generator's rate to 10/Sec, name the Runner My Runner and point it to some URL. Start the project in by clicking the Play button and let it stay running during the whole tutorial.

Showing Statistics from a component

Open the Statistics Window and enter the Analysis view. Locate the icon representing My Runner in the left toolbar and drag it into the empty space to the right:

dragComponentInStatWorkbench

This will create a Chart containing My Runner. A Chart can show all the Statistics of its contained Components.

A Chart showing one line.

By default a Chart will show the Statistic Average Time Taken of a containing Web Page Runner; this is why there's already a line in the Chart.

Click Add Statistic to add another Statistic from My Runner:

The Add Statistic Panel with no radiobuttons selected.

This will toggle the Add Statistic Panel. Specify which Statistic you want to add by clicking Sent, Per Second and All. You have now specified a Statistic that will show the Sent requests per second for My Runner.

addStat_secondClick

Click Add to add the specified Statistic to the Chart:

The same Chart as in a previous image, but with a second line added.

A new line will appear in the Chart, together with a new legend called Sent/s.

Playing around

The new Statistic will stay steady at the value 10 since you previously set the Fixed Rate Generator in your project to 10/Sec. Let's lower the rate of the our generator to 1/Sec while keeping the Statistics Window open:

A Fixed Rate Generator with the rate set to 1/Sec.

As expected, the Statistic showing My Runner's Sent Requests per second falls to 1 as well:

The same Chart as shown before, with the second line falling.

Also, use the horizontal scrollbar to go back to the beginning of the test (the X-axis should show 00:00). Notice that when the scrollbar is positioned to the far right, the chart will be always show the most recent datapoints as the test goes on. All other scrollbar positions will fixate the chart at that specific time interval.

Removing Statistics

Now remove the Average TimeTaken (abbreviated TimeT Avg) Statistic by dragging it to the black hole in the upper right corner to delete them:

removeStat dropLegendInTrash

What's next?

There's a lot more to the Analysis view, so take a deep breath and then proceed reading The Analysis view, continued.

As always, don't forget to have fun!

 

Managing Stored Results

Posted Friday, 11 March 2011 11:44

{ArticleIndex}

If you are not familiar with the Results Window and its two views, we suggest that you read about the Results Window before starting this tutorial.

For the purpose of this tutorial, the current project has previously been run three times and the Results view has been opened. The individual runs were started 09:43, 11:04 and 11:42 respectively, as reflected in the Result’s names below.

manageResults_3Recent

Archiving a Result

Having a list of automatically saved recent results can be handy, but since loadUI only saves a limited number of results automatically (before deleting the oldest one) you should know that you can archive Results. Archiving a Result will not just prevent loadUI from ever deleting it, but also lets you rename Results for easier access.

If you want to archive a Result, simply drag and drop it from the Recent Result container to the archived Results container. You don’t have to rename the Result, but we encourage it since it’ll make it easier to find it later on. Renaming is almost as easy; just click the text on the Result’s top border and click Rename:

renameArchivedResultMenu

After archiving and renaming one of the recent Results, the Results view will look something like this:

renameArchivedResult_Big

The Manage Results view with two recent and one archived Result.

Change settings

Click the Settings button in the upper right part of the Results view to bring up the settings dialog:

manageResultsSettings

From this dialog you can specify where in the file system you want Results to be saved and how many results loadUI should automatically save per project, before deleting the oldest unarchived Result.

The current result will however always be be saved to disk regardless of this setting, since the Statistics Workbench requires disk data to function . If you are willing to sacrifice the Statistics Workbench on the altar of disk space, provide this command line option to loadUI:

-Dloadui.statistics.disable=true