Chat now with support
Chat with Support

Benchmark Factory for Database 8.4 - User Guide

Welcome to Benchmark Factory What's New in Benchmark Factory Additional Resources Overview of Benchmark Factory Benchmark Factory Components Licensing Getting Started - the Benchmark Factory Workflow Agents Create and Edit Connections Create and Edit Tests and Jobs
Jobs View Pane Job Wizards Quickstart: Create a New Job Edit a Job Industry Standard Benchmark Tests Capture and Replay a Workload Artificial Test for Desired Effect Scalability Tests Custom Tests Create/Delete Benchmark Objects Execute External File Test Options for Create Objects Test Options for Transactions Job Setup Options Use Global Search/Replace Save Job as BMF Script Copy Test to Replay, Mix, Goal, or Scalability Test
Benchmarks How Do I... Settings Test Results and Run Reports BFScripts Repository Troubleshooting The Benchmark Factory REST API Appendix About Us Adding Virtual Users System/Upgrade Requirements/Supported Databases Shortcut Keys

General Settings

Use the General tab of the Settings dialog to specify workplace settings. In addition, you can define the location for error logs and scripts.

To specify General settings

  1. Select Edit | Settings (F8). The Settings dialog opens.

  2. Select General. Review the following for additional information:

    Group Description
    Directories  

    Scripts

    		 The default location used when saving scripts. These files usually reside on a local drive, but may reside on a network file server.

    Error Logs

    		 Location of error log files.

    Data Files

    		 Location of data files.

    Result Logs

    		 Location of result log files.
    Retrieval Options Limit the number of rows retrieved when executing custom SQL transactions—Allows you to limit the number of rows retrieved during SQL transaction execution.
    Logs Cleanup

    Purge Error and Result log directories of files older than N days—Specify the maximum number of days to retain log files. Files older than the time specified are deleted from the Error Logs and Result Logs directories when you click OK or Apply.

    Default = 180

    Purge Now—Click to immediately delete log files older than the time specified.

    Note: .dmp files are not deleted.

    TCP/IP Settings

    Console TCP/IP Port—Specify a port for the Benchmark Factory console if different than the default. The default setting is port 4568.

    Note: Restart Benchmark Factory to apply changes.

  3. Click Apply to apply changes.

    Note: You may need to restart Benchmark Factory to fully implement any changes to directories.

 

Benchmarks Settings - General

Use the Benchmarks page of the Settings dialog to specify some general benchmark testing options.

To specify general Benchmarks settings

  1. Select Edit | Settings. The Settings dialog opens.

  2. Select Benchmarks. Review the following for additional information:

    Refresh statistics after benchmark load

    Select to instruct Benchmark Factory to refresh statistics after loading benchmark data.

    Default = selected

    Check scale factor before running benchmark test

    Instruct Benchmark Factory to check the Benchmark Scale factor of the existing tables against the new Benchmark Scale requirement before executing a test.

    To skip the scale checking process, do not select this checkbox.

    Default = selected

  3. Select a default setting for the Object/Data Retention method. The default setting applies to new Create Objects steps. Review the following for additional information:

    Create/Load objects if objects don't exist (no backup sets created)

    If objects do not exist, Benchmark Factory creates the objects and loads data.

    If you select this option, Benchmark Factory does not create backup tables.

    Delete benchmark objects after completion of job Benchmark Factory deletes objects after a job is finished.
    Refresh data using backup sets

    When backup sets exist, Benchmark Factory reloads data and recreates indexes.

    If backup sets do not exist, Benchmark Factory creates objects and loads data. Then Benchmark Factory creates the backup tables.

    Recreate objects and reload data every execution

    Benchmark Factory always deletes the existing objects and then recreates/reloads for each job execution.

    This allows you to ensure that the dataset is always in initialized status.

    Refresh data using inserts

    If data does not exist, Benchmark Factory uses bulk insert to load data.

    If the following Benchmark Settings are selected,

    and the Benchmark Scale factor of the existing tables does not match the new requirement, the process of inserting additional data or deleting data my run long, depending on the size of the existing data and number of indexes.

    Note: If database does not support bulk insert, insert is used.

  4. Click Apply to apply your changes.

 

Related Topics

Benchmark Settings - Specific Test Types

Benchmark Settings - Specific

For each standard benchmark test type, you can specify some default settings, such as scale factor, in the Settings dialog.

To specify default settings for a specific benchmark test type

  1. Select Edit | Settings | Benchmarks.
  2. Then select the benchmark test type, for example TPC-C.

  3. Specify default settings to be used when a new benchmark test is created. Review the following for additional information:

    Database Size Specify a database size. The Benchmark Scale readjusts according to the database size you specify.
    Benchmark Scale

    Specify a Benchmark Scale factor to be used to scale up table sizes and increase data. See Benchmark Scale Factor for more information.

    The database size readjusts according to the scale factor you specify.

    After adjusting benchmark scale (or database size) review the estimates for individual and total table sizes in the Object Details grid.

    Show Empty Tables Select to display any tables that will be created but not populated with data.
  4. Click Apply to apply your changes.

Note: The database and object sizes displayed are estimates. Actual sizes might vary based on database type and configuration.

  

Related Topics

TPC-B Benchmark Settings

Replication Benchmark Settings

TPC-B Benchmark Settings

Use this page of the Settings dialog to specify default values for creating TPC-B benchmark objects.

To specify TPC-B settings

  1. Select Edit | Settings | Benchmarks | TPC-B obsolete.

  2. Specify values to be used as the default settings when you create a new TPC-B Industry Standard Benchmark Test. Review the following for additional information:

    Database Size Specify a database size. The Benchmark Scale readjusts according to the database size you specify.
    Benchmark Scale

    Specify a Benchmark Scale factor to be used to scale up table sizes and increase data. See Benchmark Scale Factor for more information.

    The database size readjusts according to the scale factor you specify.

    After adjusting benchmark scale (or database size) review the estimates for individual and total table sizes in the Object Details grid.

    Show Empty Tables Select to display any tables that will be created but not populated with data.

TPC-B History Tables

History tables allows you to set the number of history tables to create. The TPC-B benchmark is made up of only one transaction that updates three tables and inserts a record into a history table.  Inserting one record into one history table limits testing performance.

This page of the Settings dialog allows the user to set a default value for the number of history tables to create during a test.  The best ratio of history tables to virtual users is based on database configuration and hardware.  The number of history tables to use is determined by the tester.

To specify the number of History tables to create

  1. Select Edit | Settings | Benchmarks | TPC-B obsolete | History Tables.
  2. In the Number of History Tables field, specify the number of tables you want to create by default.

  

Related Documents

The document was helpful.

Select Rating

I easily found the information I needed.

Select Rating