Benchmark Factory for Database 9.0 - User Guide

Agents View

Select View | Agent to open the Agents pane where you can view information about agents that are currently running. The Agent view displays the status of all connected agents.

Use the Agent Component Console

The primary agent component installed with Benchmark Factory is Agent.exe. On your local machine, the Benchmark Factory console always attempts to use Agent.exe first. If Agent.exe is not found, the console uses BMFAgent.exe.

Agent.exe includes a GUI/console. You can use this console to view transaction and virtual user statistics during test execution.

The Benchmark Factory agent starts automatically when a job using the agent is executed. You can also start/open the agent manually.

To start or open Agent.exe

1. Locate the executable file Agent.exe in the bin sub-directory where Benchmark Factory is installed. The default installation path is

   Program Files\Quest Software\Benchmark Factory <version>\bin

2. Double-click Agent.exe to start/open it.
3. Configure Agent Settings. You can configure settings for the Benchmark Factory Agent from the Agent.exe console.

   • Select Options | Settings. Review the following options.

     Machine Name / IP	This is the name or IP address of the Benchmark Factory Console machine to which this agent connects. For a local agent, this is the local Benchmark Factory Console. For a remote agent, this is the Benchmark Factory Console used to run the benchmark tests. If the agent was installed remotely through the Benchmark Factory console, the agent is automatically configured. If installed manually, you must configure the agent. See Running Benchmark Factory with Multiple Agents for more information.
     Console Port	Enter the port for the Benchmark Factory Console.
     Max Virtual Users	Use this field to specify the maximum number of virtual users that this agent is allowed to spawn.
     Error Logs / Result Files	Use these fields to specify a location for storing error logs and result files generated for this agent.

4. When the agent is open, information about virtual user activity is displayed while a job is executing. Review the following for additional information.

   • Test Status Tab—Displays the current test phase and a summary of test information.

     

   • Virtual Users Tab—Displays the raw data from each virtual user. The grid shows each virtual user and its statistics. Right-click a column header to sort by that column.

     

   • Transactions Tab—Displays status information, including average, minimum, and maximum times on all active transactions.

     

   • Output Tab—Displays the same information as the Messages window, including messages, status, and results.

BMFAgent.exe

BMFAgent.exe is a non-UI agent included with Benchmark Factory. BMFAgent.exe performs the same functionality as Agent.exe, except BMFAgent.exe has no graphic user interface. This allows you to easily integrate BMFAgent.exe into your continuous integration or continuous testing process.

Details

The Windows version of BMFAgent.exe is installed into the bin sub-directory of the installation directory at the time you install Benchmark Factory.

The Linux version of this agent can be installed on a remote Linux machine through the Benchmark Factory Console.

BMFAgent.exe has a smaller footprint (file size) than Agent.exe.

How Benchmark Factory Uses BMFAgent.exe

Because BMFAgent.exe has the same functionality as Agent.exe, Benchmark Factory uses BMFAgent just as it would Agent.exe. Review the following for additional information.

• On your local machine, the Benchmark Factory console attempts to use Agent.exe first. If Agent.exe is not found, the console uses BMFAgent.exe.
• When a job uses a remote agent, if Benchmark Factory cannot find BMFAgent.exe on the remote machine, Agent.exe is used on the remote machine.
• You can run multiple instances of BMFAgent.exe at the same time on the same machine.

Start BMFAgent.exe

To Start BMFAgent.exe (Windows)

1. Open the installation directory. The default installation path is

   C:\Program Files\Quest Software\Benchmark Factory <version>

2. Open the bin sub-directory.
3. Double-click BMFAgent.exe.

Modify Settings

When BMFAgent.exe and Agent.exe are installed, default settings are applied, such as the machine name (IP address) and the port number for the Benchmark Factory console to which the agent connects.

Use one of the following methods to modify the BMFAgent.exe settings:

• Use the BMFAgent.ini file located here: C:\Users\<user>\AppData\Local\Quest Software\BMF\<version>.
• Use the Command Prompt window.
• Open the Agent Settings dialog through the Benchmark Factory console using the following steps:
  1. Start BMFAgent.exe.
  2. In the console, select View | Agent to open the Agents tab.
  3. Right-click the BMFAgent and select Settings.

Command Line Parameters

The following parameters are available from the command line.

Specify Max Virtual Users

Using the maximum number of users on an Agent provides better utilization of machine configuration. For example, you can run one machine with ten users and another with 100 users. This allows light-weight machines to be used with more powerful machines.

To specify Maximum Virtual Users

1. Select View | Agent to open the Agent pane.

2. Right-click the agent in the Agent pane of the Benchmark Factory Console and select Settings.

   

3. In the Agent Settings dialog, use the Max Virtual Users field to specify the maximum number of virtual users that this agent is allowed to spawn.
4. Click OK.