Chat now with support
Chat with Support

Benchmark Factory for Database 9.0 - User Guide

Welcome to Benchmark Factory What's New in Benchmark Factory Additional Resources Overview of Benchmark Factory Benchmark Factory Components Licensing Getting Started - the Benchmark Factory Workflow Agents Create and Edit Connections Create and Edit Tests and Jobs
Jobs View Pane Job Wizards Quickstart: Create a New Job Edit a Job Industry Standard Benchmark Tests Capture and Replay a Workload Artificial Test for Desired Effect Scalability Tests Custom Tests Create/Delete Benchmark Objects Execute External File Test Options for Create Objects Test Options for Transactions Job Setup Options Use Global Search/Replace Save Job as BMF Script Copy Test to Replay, Mix, Goal, or Scalability Test
Benchmarks How Do I... Settings Test Results and Run Reports BFScripts Repository Troubleshooting The Benchmark Factory REST API Appendix About Us Adding Virtual Users System/Upgrade Requirements/Supported Databases Shortcut Keys

View Test Results - Completed Job

After a job is finished running, you can view a summary of test results in the Results page. Use the Compare Results page to compare different test runs.

See also, View Test Results - Running Job.

To view results after job completion

  1. Select a job in the Jobs View pane.
  2. The Results page displays.
  3. Click to show all test runs.
  4. Select a run to review a summary of test results. Review the following for additional information:

    Click to export test results to Word from one or more selected runs.
    Click to export test results to Excel from one or more selected runs.
    Click to export the selected run's test results as a zip file. The zip file contains an XML file and other files required to reproduce the test results.
    Click to import test results from a zip file exported from Benchmark Factory.
    Click to view one or more selected test run results in Run Reports. Run Reports provides more-detailed test results.
    Sets the selected run as the baseline. This allows you to easily compare other run results against this baseline. Click Reset Baseline to clear baseline selection.

Compare Results

You can use the Compare Results tab to compare test results between selected test runs, or to compare results to the baseline test run.

To compare results

  1. Select a job in the Jobs View pane.
  2. The Results page displays.
  3. Select the Compare Results tab.
  4. In the top grid, use Ctrl+Click to select the test runs to compare. The selected test runs display in the Run Comparison grid.

    You can use the links above the top grid to filter the list of test runs to display.

  5. Select the Automatically compare to baseline checkbox to always compare the selected run to the baseline.

  

Benchmark Factory Run Reports

Overview

Benchmark Factory Run Reports is a separate executable that provides a comprehensive and detailed collection of database load testing results. With Benchmark Factory you can drill down into a database to view a wide array of information and statistics that gives you accurate insight into database performance. Run Reports Viewer allows you to access Benchmark Factory load testing results. See Run Reports Viewer for more information.

Note: Three instances of Run Reports can be viewed at one time.

Cutting and Pasting of Run Reports

From Benchmark Factory run reports you can cut and paste test results into the Clipboard.

Testing Server Throughput

Server throughput is the measurement of database capacity. Benchmark Factory allows you to view a variety of server throughput statistics that include:

  • Transaction/Second (TPS)
  • Transaction Time
  • Bytes/Second (BPS)
  • Rows/Second (RPS)
  • Total Bytes
  • Total Errors
  • Total Rows
  • Response Time

     

Testing SQL Scalability

The Benchmark Factory transaction comparison graph provides users with a comparison of the individual transaction performance as they compare to each other. This is most useful when analyzing a SQL Scalability test.

                

Testing Real Application Clusters

Benchmark Factory allows you to load test Oracle Real Application Clusters (RAC) to determine system capacity. The cluster performance graph allows users to view the performance of individual nodes.

                  

 

Changing Graph View

To modify a graph view, right-click a Benchmark Factory graph to display a drop-down list that allows you to customize graph settings. Whether you are viewing a real-time graph or one in Benchmark Factory Run Reports, Benchmark Factory uses the same graphing tool. In most cases you will find that the graphs are presented in the most meaningful form (Line Graphs or Bar Graphs based on the data being presented.)

Displays Benchmark Factory Run Reports

 

Shows in a data form or graph form

Displays the Graph Legend

Displays the graph toolbar

Prints the graph

Copies Data to Clipboard

Copies Graph to Clipboard

Loads a saved graph configuration

Saves a graph configuration

Sets the current configuration as default

Clears the current chart configuration

Show Data/Show Graph

Toggling to Graph displays the data in graph form.

   

Graph Legend

Toggling to Graph Legend displays a legend on the side of the graph.

Toolbar

Toggling to Toolbar displays the graph toolbar.

Print

Choosing Print displays the Print Dialog.

Copy Data to Clipboard

Copies the data to the clipboard.

Copy Graph to Clipboard

Copies the graph to the clipboard.

Load Configuration

Benchmark factories graphs allows you to save graph configurations.

Save Configuration

Saves a graph configuration.

Set as Default

Sets a configured graph as default.

Clear Configuration

Clears a graph configuration.                              

 

Related Documents

The document was helpful.

Select Rating

I easily found the information I needed.

Select Rating