Chat now with support

Get Live Help
Complete Registration

Sign In

Request Pricing

Contact Sales

Benchmark Factory for Database 8.2.1 - User Guide

Table of Contents

Getting Started

Getting Started With Benchmark Factory What's New in Benchmark Factory Additional Resources

Adding Virtual Users

Overview of Benchmark Factory

About Benchmark Factory Benchmark Factory Components Understanding Benchmark Testing Understanding Benchmark Factory Terminology How Benchmark Factory Works

Benchmark Factory Components

Benchmark Factory Console Agents Run Reports Repository Manager Jobs View BMFServer.exe

About Agents Set Up New User Agent Specify Agent Settings Install Remote Agent on Windows Install Remote Agent on Linux Run Benchmark Factory with Multiple Agents Agents View Use the Agent Component Console BMFAgent.exe Specify Max Virtual Users Configure Firewall - Remote Agent Install

Create and Edit Connections

Connections Overview Create IBM DB2 CLI Connections Create MySQL Connections Create ODBC Connections Create Oracle Connections Create PostgreSQL Connections Create SAP Connections Create SQL Server Connections Edit and Manage Connections Timeout and Reconnect Options Environment Information Performance Counters Oracle Statistics Collection Oracle Clustering Options Configure RAC Load Testing

Create and Edit Tests and Jobs

Jobs View Pane Job Wizards Quickstart: Create a New Job Edit a Job Industry Standard Benchmark Tests Replication Benchmark Test Capture and Replay a Workload

Capture and Replay Oracle Workload Capture and Replay SQL Server Workload Run Capture Scenario Wizard Run Capture Wizard from Cmd Line Replay Load from an Oracle Trace File Replay Load from SQL Server Trace Table Replay Load from ODBC Trace File Import from Delimited Text File Import from Oracle Dynamic Performance View Import from Dell Tools Export File

Create Artificial Test for Desired Effects Test Stored Procedures for Scalability Test SQL for Scalability Custom Tests

Create Mix Test Create Replay Test Create Goal Test Create Scalability Test

Create/Delete Benchmark Objects Execute External File Test Options for Create Objects

Benchmark Scale Factor Options (Create Objects) Create Objects Using Custom SQL Table Options (Create Objects for Replication)

Test Options for Transactions

Transactions User Load Timing Advanced Options (Capture/Replay) Add SQL Transactions Add User Scenario from XML Use BFScript Wizard Run SQL Preview Latency Interarrival Time Latency Distribution Models Replace Child Latencies Stagger User Startup

Job Setup Options

Schedule Alerts Performance Counters Global Variables

Use Global Search/Replace Save Job as BMF Script Copy Test to Replay, Mix, Goal, or Scalability Test

Test Results and Run Reports

Overview View Real-Time Test Results

View Test Results - Running Job Realtime Statistics Tab Run vs Userload Tab Transaction vs Load Tab Changing Graph View

View Test Results - Completed Job Benchmark Factory Run Reports

Overview Changing Graph View Run Reports Viewer Using Benchmark Factory Run Reports Viewing Multiple Run Results

Exporting Test Results to Excel Exporting Test Results to Excel Using the Command Line Benchmark Factory Test Results Terminology

Troubleshooting

Support Bundle Agent Connection

The Benchmark Factory REST API

Resource Structure and URI Hierarchy REST API Resources

TPC-D Benchmark

Overview
Certification of Transaction Processing Council (TPC) Testing Results
Best Practices
Scaling Factor

To learn how to create a TPC-D benchmark test in Benchmark Factory, see Create Industry Standard Benchmark Test.

Overview

The Transaction Processing Council is an organization that establishes transaction processing and database benchmark standards. Find a complete overview and detailed explanation of the TPC-D Benchmark at: http://www.tpc.org/tpcd/default.asp

Certification of Transaction Processing Council (TPC) Testing Results

Transaction Processing Council testing results cannot be published as certified unless the testing procedure is audited and approved by the TPC organization. If not certified, the testing results can be published as a "TPC-D like" test.

Best Practices

The following provides best practices for the TPC-D Benchmark.

Load-testing against production servers

Do not load-test against a production server if possible. Load-testing and benchmarking on a production server significantly degrades performance. In some cases, load-testing can cause a server to fail. However, if testing against a production server, take the following precautions:

Perform the testing when no other users are on the system and no automated processes are running. Users and automated processes can adversely affect testing results
Have a recovery plan and backup all data prior to testing
Determine how long it will take to restore a production server if it went down during load-testing
Perform manual testing. Manual testing ensures that no unexpected outside activity takes place during the testing process

Reinitialize the Database

To reinitialize a testing database, run a job containing a Benchmark Object node.

There are two ways to create a Benchmark Object node:

Run the Benchmark Object Wizard to add the Delete Benchmark objects for TPC-D node to a job as needed.
Run the Load Scenario Wizard to create a new script containing the Create Objects for the Benchmark, Associated Load Scenarios for the Benchmark, and Delete Objects for the Benchmark. Running the delete objects for 'TPC-D' job will clean the environment.

Scaling Factor

The TPC-D benchmark scales by the following factors:

0.10
1.00
10.00
30.00
100.00
300.00

Related Documents

The document was helpful.

Select Rating

I easily found the information I needed.

Select Rating

© ALL RIGHTS RESERVED. Terms of Use Privacy Cookie Preference Center