This topic outlines the Benchmark Factory workflow. Click the links in each step to drill down to more-detailed information.
The Benchmark Factory workflow includes the following steps:
Use the Settings dialog to specify default settings for job and workload options, such as benchmark scale, the number of virtual users per iteration, timing, and latency. Changes to these settings affect only new jobs, not existing jobs.
To specify Benchmark Factory settings
Before you can run a job against a database, the database connection must be defined in Benchmark Factory. You can define a new connection from within the New Job Wizard, or you can define the connection using the New Connection dialog or the My Connections tab prior to creating a new job.
To create and save a new connection
Use the New Job Wizard to create a new job. The New Job Wizard guides you through the steps required to create a database load test (workload) and specify general options for the job.
When creating a new job in the wizard, you can specify settings that apply to this job and override the defaults in the Settings dialog. See Quickstart: Create a New Job for more information.
To create a new job
After creating a new job, you can modify the job. For example, you can change the database-under-test, add tests/steps, or change test options.
To modify an existing job
To run a job
Benchmark Factory provides a number of metrics to analyze a system-under-test. These include:
Benchmark Factory provides the following testing results:
The Benchmark Factory Agent is a component used in Benchmark Factory to create virtual users which simulate real-world user activity by placing transactions against the database-under-test. The Benchmark Factory Agent is installed when the Benchmark Factory Console is installed. In addition, you can install additional agents on other remote machines. Each Benchmark Factory agent can spawn multiple virtual-user sessions and Benchmark Factory can control hundreds of Agent machines.
After installing additional agents, use your Benchmark Factory Console to define a connection to each agent machine. When you create a new benchmark test through the Console, you can select which of the defined agents to use to generate the user load.
Each virtual user is a separate thread, acting independently of the other virtual users, with its own connection to the system-under-test. Each virtual user tracks its own statistics, including transaction times and the number of times a transaction executes.
The Benchmark Factory Console allows you to view information about all currently running agents, provides a way to connect to and manage remote agents, and allows you to specify some global agent settings. In addition, the primary Agent, Agent.exe, includes a GUI which displays transaction and virtual user statistics during test execution.
Benchmark Factory provides several types of agent components:
BMFAgent.exe—(Windows or Linux) The non-GUI agent. You can use BMFAgent.exe to integrate Benchmark Factory into your continuous integration or continuous testing process. See BMFAgent.exe for more information.
Review the following topics to learn how to use the Benchmark Factory Agent.
You must define a connection to each agent machine before you can use that agent in a Benchmark Factory test. The local Benchmark Factory Agent is defined by default. After installing a remote agent however, use this procedure to define a connection to the remote agent machine from the console.
For information about installing remote agents, see Install Remote Agent on Windows and Install Remote Agent on Linux
To setup a new user agent
In the Setup Windows/Linux Agent dialog, enter the name or IP address of the computer where the agent is installed.
Tip: If you are using this dialog to install an agent on a Windows or Linux platform, enter the name or IP address of the computer on which you want to install an agent. Then see Install Remote Agent on Windows or Install Remote Agent on Linux for more instructions.
© 2024 Quest Software Inc. ALL RIGHTS RESERVED. Termini di utilizzo Privacy Cookie Preference Center