Chat now with support
Chat with Support

Benchmark Factory for Database 8.4 - User Guide

Welcome to Benchmark Factory What's New in Benchmark Factory Additional Resources Overview of Benchmark Factory Benchmark Factory Components Licensing Getting Started - the Benchmark Factory Workflow Agents Create and Edit Connections Create and Edit Tests and Jobs
Jobs View Pane Job Wizards Quickstart: Create a New Job Edit a Job Industry Standard Benchmark Tests Capture and Replay a Workload Artificial Test for Desired Effect Scalability Tests Custom Tests Create/Delete Benchmark Objects Execute External File Test Options for Create Objects Test Options for Transactions Job Setup Options Use Global Search/Replace Save Job as BMF Script Copy Test to Replay, Mix, Goal, or Scalability Test
Benchmarks How Do I... Settings Test Results and Run Reports BFScripts Repository Troubleshooting The Benchmark Factory REST API Appendix About Us Adding Virtual Users System/Upgrade Requirements/Supported Databases Shortcut Keys

Scalability Tests

Test SQL for Scalability

The SQL Scalability test allows you to execute SQL statements, allowing users to spot potential issues not seen with a single execution. Users can run variations of a SQL statement in order to find the SQL that will perform the best under a load test.

Use this procedure to create a new SQL Scalability test or a Custom Scalability test.

To create a SQL Scalability Test

  1. In the New Job or Edit Job Wizard, click Workload in the left pane.
  2. On the workload page, do one of the following:
    • Select Scalability Test from the drop-down list. Then select the Test SQL for Scalability option.
    • Select Custom Test. Then select the Scalability test compares ... option.
  3. Click the Add Test button. The test is added to the workload and the test Summary page displays.
  4. On the Summary page, click each link to modify the specific test option.
  5. Or you can select the Test Options tab to modify all test options. Review the following for additional information:

    Tab Description
    Transactions tab

    Add transactions for the test.

    See Transactions Tab for more information.

    User Load tab Modify the number of users per test iteration. See Specify User Load for more information.
    Timing tab

    Execute By—Select one of the following options:

    • Number of executions per iteration—Each transaction is executed by each user for a specified number of times (recommended).
    • Execution time per iteration—Executes each transaction for the specified length of time.

    User Startup—Select one of the following options:

    • Start all users as quickly as possible—Starts all users immediately after a test begins.
    • Start all users at even intervals for—Sets the amount of time in which to start all users at even intervals. The interval duration is equal to this value divided by the number of users.
    • Start a new user every [n] seconds—Starts a new user, then waits the [n] number of seconds before starting the next user.
    Advanced tab

    Specify Repository options, error handling, and database checkpoints for the test.

    You can also specify a file to execute at the beginning or end of each iteration. See Advanced Tab for more information.

  6. After specifying options for this test, you can add another test to the job, configure job setup options, save and close the job, run the job, or schedule the job. For more information about each of these steps, see Quickstart: Create a New Job.

 

Test Stored Procedures for Scalability

The Test Stored Procedures for Scalability test enables developers who write stored procedures in Oracle and SQL Server to test performance and scalability of the logic under varying user load levels. Benchmark Factory allows you to import SQL from database stored procedures into a Mix Load Scenario (workload). This gives you the ability to import SQL transactions, from stored procedures, for further testing under load.

To test Stored Procedures for Scalability

  1. In the New Job or Edit Job Wizard, click Workload in the left pane.
  2. On the workload page, select Scalability Test from the drop-down list.
  3. Select the Test Stored Procedures for Scalability option.
  4. Click the Select Test button.
  5. In the Select Stored Procedures dialog, select the procedures from which to import SQL.
  6. Click Next.
  7. In the Bind Parameters page, select a SQL statement and enter a bind variable if necessary.
  8. Click Finish. The SQL is imported and the Summary page displays.
  9. Click the links on the Summary page to modify test and job setup options.
  10. Or you can select the Test Options tab to modify all test options. Review the following for additional information:

    Tab Description
    Transactions tab

    Modify the transactions and the transaction mix for the test.

    See Transactions Tab for more information.

    User Load tab Modify the number of users per test iteration. See Specify User Load for more information.
    Timing tab Specify sampling, pre-sampling, and user start-up times for the test. See Timing Tab for more information.
    Advanced tab

    Specify Repository options, error handling, and database checkpoints for the test.

    You can also specify a file to execute at the beginning or end of each iteration. See Advanced Tab for more information.

  11. After specifying options for this test, you can add another test to the job, configure job setup options, save and close the job, run the job, or schedule the job. For more information about each of these steps, see Quickstart: Create a New Job.

 

Custom Tests

Related Documents

The document was helpful.

Select Rating

I easily found the information I needed.

Select Rating