Benchmark Factory for Database 7.6 - User Guide

Create and Edit Tests and Jobs

Jobs View Pane

The Jobs View displays a list of saved jobs, shows which jobs are currently running, and which jobs are scheduled to run.

From the Jobs View pane, you can run jobs, view job status, and view real-time testing results.

To run a job

• Select the job in the Jobs View pane and click .

To view test results

• To view a job's test results, select a job in the Jobs View pane. Test results display in the right pane. See Benchmark Factory Console for an overview of the Benchmark Factory console.
• To compare two or more run results for a test, select the Compare Results tab. Use Ctrl+click to select multiple test runs. A comparison of the results for the various runs displays.

To edit an existing job

• To edit an existing job (to modify the workload or job setup options), select the job in the Jobs View pane and click .

View Job Status

From the Jobs View pane, you can view job status.

The following job states are identified:

• Scheduled: All jobs currently waiting to run or scheduled to run at a future time.
• Running: Job currently running.
• Completed: All completed jobs.

Jobs View Toolbar

The Jobs View toolbar provides user functionality to save or delete jobs.

	Move the selected test up in the list.
	Move the selected test down in the list.
	Delete the selected item from the Jobs View.
	Toggles tree-view on and off.

Note: To save a job as a Benchmark Factory script, select the job and click Save in the Benchmark Factory toolbar or select File | Save.

Quickstart: Create a New Job

Use the New Job Wizard to create a new job. The New Job Wizard guides you through the process of creating a database load test (workload), as well as selecting a database to test, setting general job options, and specifying agents.

Navigating the New Job Wizard is easy. The three major steps are displayed in the left pane: Database Under Test, Workload, and Agent. The individual tests you add are displayed under the Workload step. Click on a step or test in the left pane to display the available options and properties in the right pane.

To allow the wizard to guide you through each step, after completing a page click the green arrow at the bottom of the page. This will advance you to the next step. For example, after selecting a connection on the first page of the wizard, click .

To create a new job

1. Click in the Benchmark Factory main toolbar. The New Job Wizard opens.
2. Select a connection. Select a connection from the drop-down list in the Database Under Test page.
   • Click New to define a new connection. See About Benchmark Factory Connections.
   • Click Edit to edit the selected connection. See Edit Connections.
   • Click Test to test the selected connection.
3. The Database Under Test page also provides database and host information for the selected connection.
   • To refresh this information, click Detect Environment Information.
   • You can edit this information or add custom properties. This information is also displayed in the Environment tab of the Connection dialog. See Environment Information.
4. Add Workload. After selecting a database connection, click at the bottom of the Database Under Test page, or click Workload in the left pane,.
5. Select a test. On the workload page, select the type of test to perform from the drop-down list. Then select a test to add to the workload. To learn how to create a specific test, select from the following:
   • Industry Standard Benchmark Test—These tests simulate real-world application workloads. Select from a number of standard benchmarks included with Benchmark Factory.
     • For benchmark test descriptions, see Overview of Benchmark Testing.
     • To create a benchmark test, see Create Industry Standard Benchmark Test.
   • Capture / Replay Test—Capture and replay a workload; replay a workload from a trace file; or import a workload for a database repository, text file, or export file from another Quest Software tool.
     • To create a capture/replay test, see Capture and Replay Tests.
   • Artificial Test for Desired Effect—Design a workload using a mix of benchmark tests, transaction types, SQL statement types, or resource loads.
     • To create an artificial test, see Artificial Test for Desired Effect.
   • Scalability Test—Use this type of test to load test and compare the performance of different SQL statement variations.
     • To create a scalability test for SQL, see Create SQL Scalability Test.
   • Custom Test—To create a custom Mix test, Replay test, Goal test, or SQL Scalability test, see Custom Tests.
   • Create/Delete Benchmark Objects Test—To add a step to create or delete benchmark objects, see Add a Create/Delete Benchmark Objects Test.
   • Execute External File—To add a step to execute a file, see Execute External File.
6. Click Add Test or Select Test at the bottom of the page to add the test to the workload.
7. Specify test options. Specify test options for the selected test. Select one of the links above for detailed information about test options for each test type.
8. Job Setup. (Optional) You can specify job-level options. Click Job Setup at the bottom of the Test Options tab, or select the Job Setup tab. See Job Setup Tab to learn more.
9. Agent Setup. After specifying options for the test you selected, set up the agents for this job.
   1. Click the Agent Setup button at the bottom of the page, or click Agent in the left pane.

   2. Click inside the checkbox to the left of the agent name to select it. A checkmark displays for each selected agent. See About Agents for more information.

      Note: When you run a job using one or more local agents, if Agent utilization of resources on the local machine is too high, errors could occur.

10. After specifying the test-level and job-level options, you can save the job, run the job, or schedule the job. Review the following:

    • To run the job immediately, click .
    • To schedule the job, click Workload (left pane) and select the Job Setup tab. Then select the Schedule tab. See Schedule a Job.
    • To save the job without running it immediately, click . Use this option after scheduling a job.
    • To save the job to an existing job, select the Job Setup tab. In the Save Job section, select the name of an existing job. Click .

Notes:

• After creating a job, you can save it as a Benchmark Factory script. Select the job in the Jobs View pane and click Save in the main toolbar or select File | Save.
• To modify an existing job, right-click the job and select Edit Job.
• After creating a job, you can add tests to the workload. Right-click the job and select Edit Job.

Edit a Job

Use the Edit Job Wizard to modify an existing job.

To edit a job

1. Select a job in the Jobs View and click .
2. See the topic on the test type you want to edit for more information on editing test and job setup options. See Quickstart: Create a New Job for more information.