Chat now with support

Get Live Help
Complete Registration

Sign In

Request Pricing

Contact Sales

Benchmark Factory for Database 8.4 - User Guide

Table of Contents

Welcome to Benchmark Factory What's New in Benchmark Factory Additional Resources Overview of Benchmark Factory

About Benchmark Factory Benchmark Factory Components Understanding Benchmark Testing Understanding Benchmark Factory Terminology How Benchmark Factory Works Feature/Edition Comparison

Benchmark Factory Components

Benchmark Factory Console Agents Run Reports Repository Manager Jobs View BMFServer.exe

Licensing and Keys Adding Virtual Users

Getting Started - the Benchmark Factory Workflow Agents

About Agents Set Up New User Agent Specify Agent Settings Install Remote Agent on Windows Install Remote Agent on Linux Run Benchmark Factory with Multiple Agents Agents View Use the Agent Component Console BMFAgent.exe Specify Max Virtual Users Configure Firewall - Remote Agent Install

Create and Edit Connections

Connections Overview Create IBM DB2 CLI Connections Create MySQL Connections Create ODBC Connections Create Oracle Connections Create PostgreSQL Connections Create SAP Connections Create SQL Server Connections Edit and Manage Connections Timeout and Reconnect Options Environment Information Performance Counters Oracle Statistics Collection Oracle Clustering Options Configure RAC Load Testing

Create and Edit Tests and Jobs

Jobs View Pane Job Wizards Quickstart: Create a New Job Edit a Job Industry Standard Benchmark Tests

Create Industry Standard Benchmark Test Create Replication Benchmark Test

Capture and Replay a Workload

About Capture/Replay Tests Capture and Replay Oracle Workload Capture and Replay SQL Server Workload Run Capture Scenario Wizard Run Capture Wizard from Cmd Line Replay Load from an Oracle Trace File Replay Load from SQL Server Trace Table Replay Load from ODBC Trace File Import from Delimited Text File Import from Oracle Dynamic Performance View Import from Dell Tools Export File Capture Oracle Workload - Privileges

Artificial Test for Desired Effect

Create Artificial Test for Desired Effects

Scalability Tests

Test SQL for Scalability Test Stored Procedures for Scalability

Create Custom Test Create Mix Test Create Replay Test Create Goal Test Create Scalability Test

Create/Delete Benchmark Objects Execute External File Test Options for Create Objects

Benchmark Scale Factor Options (Create Objects) Create Objects Using Custom SQL Table Options (Create Objects for Replication)

Test Options for Transactions

Transactions User Load Timing Advanced Options (Capture/Replay) Add SQL Transactions Add User Scenario from XML Latency

Specify Latency Interarrival Time Latency Distribution Models Replace Child Latencies

Use BFScript Wizard Run SQL Preview Stagger User Startup

Job Setup Options

Job Setup Schedule Alerts Performance Counters Global Variables

Use Global Search/Replace Save Job as BMF Script Copy Test to Replay, Mix, Goal, or Scalability Test

Overview AS3AP Benchmark Scalable Hardware Benchmark TPC-B Benchmark TPC-C Benchmark TPC-D Benchmark TPC-E Benchmark TPC-H benchmark Replication Benchmark

Import Benchmark Factory Self Signed Certificate Local Access to REST API Allow external host access REST API Create a Connection Use Run Reports Create/Delete Benchmark Objects for Load Testing Change Scaling Factors Specify the User Load Execute a File Use Benchmark Factory Scripting Capabilities Copy a Test to a Replay, Mix, or Scalability Test Run SQL Preview Replace Child Latencies Use Global Search and Replace Create an ODBC Trace File Schedule a Job Set Latency Set the Number of Users on an Agent Stagger User Startup Run Benchmark Factory with Multiple Agents SQL Scalability Testing from Toad Test Database Scalability

About General Settings Benchmarks Settings - General Benchmark Settings - Specific TPC-B Benchmark Settings Replication Benchmark Settings Timing Settings User Load Settings Latency Settings Error Handling Settings Repository Settings Statistics Settings Agent Settings Oracle Settings SQL Server Settings REST API Settings Execute File Settings

Test Results and Run Reports

Overview View Real-Time Test Results

View Test Results - Running Job Realtime Statistics Tab Run vs Userload Tab Transaction vs Load Tab Changing Graph View

View Test Results - Completed Job Benchmark Factory Run Reports

Overview Changing Graph View Run Reports Viewer Using Benchmark Factory Run Reports Viewing Multiple Run Results

Exporting Test Results to Excel Exporting Test Results to Excel Using the Command Line Benchmark Factory Test Results Terminology

About Scripts BFScript Wizard Using Scripts in Username and Password Fields Dates and Numbers

$BFCreditCardExp $BFCurrentDate $BFCurrentDateTime $BFDate

$BFFileArray

Global Variable

$BFGetGlobalVar $BFSetGlobalVar $BFSetGlobalVarRtn

Name and Address

$BFAddress $BFAddress2 $BFCity $BFCompany $BFCountry $BFEmail $BFFirstName $BFFullName $BFLastName $BFMiddleInitial $BFPhone $BFState $BFZipCode

Numerical Manipulation

$BFFormat $BFProd $BFSum

$BFRand $BFRandRange $BFURand $BFURandRange

$BFCreditCard $BFRandList $BFRandMultiList $BFRandStr $BFURandList $BFList

String Manipulation

$BFAsc $BFChr $BFConcat $BFLeft $BFLen $BFLower $BFMid $BFRight $BFTrim $BFTrimLeft $BFTrimRight $BFUpper

$BFGetVar $BFMaxNode $BFNode $BFNumberOfIterations $BFProfile $BFRunID $BFSetVar $BFSetVarRtn $BFUserCounter $BFUserID $BFUserload $BFNextUserload $BFPrevUserload

Repository Settings Repository Manager Data Repository Migration Wizard

Troubleshooting

Support Bundle Agent Connection Standard Benchmark Tests Use Benchmark Factory with SQL Server 2005 MySQL Initialization Settings

The Benchmark Factory REST API

Getting Started Resource Structure and URI Hierarchy REST API Resources

Trace Files or Fine Grained Access Control: Pros and Cons Change Graph Views Customizing List Controls Oracle Instant Client Installation Creating a SQL 2005 Trace Table Using the SQL Server Profiler Creating a SQL 2008_2008 R2 Trace Table Using the SQL Server Profiler Migrating Data Using the Command Line Wizard Store Procedure Examples Oracle Trace File Activation Create an ODBC Trace File Configure Firewall for Remote Agents

About Us User Registration Product Improvement Program Third Party Components Copyright

Adding Virtual Users System/Upgrade Requirements/Supported Databases Shortcut Keys

Realtime Statistics Tab

The Realtime Statistics tab in the Results page provides you with real-time graphs and raw data. This data allows you to spot system-under-test issues that may be affecting server performance. The Realtime Statistics tab displays real-time counter data. Right-clicking inside the graph displays a drop-down that allows you to change graph settings and view.

To view Real-time Statistics

In the Jobs View, click the job running.
Select Click here to Add Data points. The Add Data points dialog displays.
Select the desired data points to view.
Click OK. The graph displays with the selected data points. (To change graph views, right-click. See Change Graph Views for more information.)

Run vs Userload Tab

The Run vs. Userload tab in the Results page compares the user load transaction against the selected data point allowing you to view how the various data points are being affected by the job running.

To view Run Vs. Userload tab testing results:

While the job is running, select the Run vs. Userload tab on the Results page.

Click the data points Vs. Userload drop-down and select the desired data point.

The graph updates with the selected data point.

To change graph views, right-click. See Change Graph Views for more information.

Transaction vs Load Tab

The Transactions vs Load tab in the Results page displays user selected transactions statistics for the job timing period following completion of an iteration.

To view the Real-time statistics

In the Jobs View, click the job that is currently running.

From the data points Vs. Userload drop-down list, select the data points to view.

To change a graph view, right-click a Benchmark Factory graph to display a drop-down list that allows you to customize graph settings. See Change Graph Views for more information.

Changing Graph View

To modify a graph view, right-click a Benchmark Factory graph to display a drop-down list that allows you to customize graph settings. Whether you are viewing a real-time graph or one in Benchmark Factory Run Reports, Benchmark Factory uses the same graphing tool. In most cases you will find that the graphs are presented in the most meaningful form (Line Graphs or Bar Graphs based on the data being presented.)

Displays Benchmark Factory Run Reports

Shows in a data form or graph form

Displays the Graph Legend

Displays the graph toolbar

Prints the graph

Copies Data to Clipboard

Copies Graph to Clipboard

Loads a saved graph configuration

Saves a graph configuration

Sets the current configuration as default

Clears the current chart configuration

Show Data/Show Graph

Toggling to Graph displays the data in graph form.

Graph Legend

Toggling to Graph Legend displays a legend on the side of the graph.

Toolbar

Toggling to Toolbar displays the graph toolbar.

Print

Choosing Print displays the Print Dialog.

Copy Data to Clipboard

Copies the data to the clipboard.

Copy Graph to Clipboard

Copies the graph to the clipboard.

Load Configuration

Benchmark factories graphs allows you to save graph configurations.

Save Configuration

Saves a graph configuration.

Set as Default

Sets a configured graph as default.

Clear Configuration

Clears a graph configuration.

Related Documents

The document was helpful.

Select Rating

I easily found the information I needed.

Select Rating

© ALL RIGHTS RESERVED. Terms of Use Privacy Cookie Preference Center