Chat now with support
Chat with Support

Benchmark Factory for Database 8.4 - User Guide

Welcome to Benchmark Factory What's New in Benchmark Factory Additional Resources Overview of Benchmark Factory Benchmark Factory Components Licensing Getting Started - the Benchmark Factory Workflow Agents Create and Edit Connections Create and Edit Tests and Jobs
Jobs View Pane Job Wizards Quickstart: Create a New Job Edit a Job Industry Standard Benchmark Tests Capture and Replay a Workload Artificial Test for Desired Effect Scalability Tests Custom Tests Create/Delete Benchmark Objects Execute External File Test Options for Create Objects Test Options for Transactions Job Setup Options Use Global Search/Replace Save Job as BMF Script Copy Test to Replay, Mix, Goal, or Scalability Test
Benchmarks How Do I... Settings Test Results and Run Reports BFScripts Repository Troubleshooting The Benchmark Factory REST API Appendix About Us Adding Virtual Users System/Upgrade Requirements/Supported Databases Shortcut Keys

Test Results and Run Reports

Overview

Analysis is the ultimate goal of your load test. When you run a test, you get results both in real-time and in a saved format. Benchmark Factory provides you with testing results that are easy to interpret and allows you to attribute individual results to individual tasks and users.

Graphs

Whether you are viewing a real-time or historical graph, Benchmark Factory uses the same graphing tool.  In most cases you will find that the graphs are presented in the most meaningful form. The Benchmark Factory graphing tool allows you to customize graphs to tailor your load testing viewing requirements.

View Test Results

Benchmark Factory provides the following ways to view test results:

 

View Real-Time Test Results

View Test Results - Running Job

While a job is running, the Results page displays job progress and real-time statistics information. You can monitor the status of the test, see which user load its running, view transactions per second (TPS), and view a variety of other data points that give you insight into the actual performance your database provides under the user load being tested.

You can also view real-time statistics while a job is running. Real-time statistics provide insight into the performance of the database being tested. Numerous data points allow you to examine exactly how your database is performing.

See also, View Test Results - Completed Job.

To view progress and results during job execution

  1. Select a running job in the Jobs View pane.
  2. The Results page displays. This page shows the status of the job, the progress of the current step that is executing (such as loading data or sampling), as well as other data such as which user load is running.

To view real-time statistics during job execution

  1. Select a running job in the Jobs View pane.
  2. The Results page displays. In the lower portion of the Results page, select one of the tabs to view real-time statistics. Review the following for more information:

Iteration Overruns

Iteration overruns occur at the end of an iteration to allow time for all transactions submitted within the test iteration cycle to complete, so that all transaction statistics can be collected. For example, an agent may execute a transaction during the last five seconds of test iteration, if this transaction takes 15 seconds to complete, an iteration overrun of 10 seconds will occur.

 

Related Documents

The document was helpful.

Select Rating

I easily found the information I needed.

Select Rating