New in This Release
Benchmark Factory 8.1
Tuesday, August 07, 2018
This release of Benchmark Factory includes the following new features and enhancements.
Benchmark Factory Agent for Linux
This release includes an exciting new feature. Benchmark Factory now provides an agent which you can deploy in your Linux environment. After installing the Linux version of Benchmark Factory Agent in your Linux environment, use the Benchmark Factory Console to set up the new agent. After setup, you can select the new agent from the list of agents available for load testing. In addition, the Benchmark Factory REST API supports configuring and modifying the Benchmark Factory Agent for Linux.
Supported Databases. The Benchmark Factory Agent for Linux can be used to test workloads against PostgreSQL databases.
Note: The Benchmark Factory Agent for Linux supports the following platforms only: Red Hat 7.x (64-bit), CentOs 7.x (64-bit), and Oracle Linux 7.x (64-bit).
The Benchmark Factory Agent for Linux is available for download from the Benchmark Factory Community on Toad World.
PostgreSQL Native Connection
This release of Benchmark Factory includes a PostgreSQL Native connection.
- To create a PostgreSQL connection, click New Connection in the main toolbar.
-
Then select PostgreSQL from the Connection Type drop-down list.
-
Enter connection information in this dialog to create a PostgreSQL native connection.
Alternatively, if you want to create a PostgreSQL ODBC connection, select the ODBC tab and enter connection information.
The following PostgreSQL database versions are supported: PostgreSQL 9.4, 9.5, 9.6 and 10, and EnterpriseDB Postgres 10.
Enhanced Licensing Dialog
This release includes an enhanced Licensing dialog which provides a simpler, easier-to-use interface.
- Select Help | Licensing to open the Licensing dialog. The Licensing dialog opens and displays the list of licenses for Benchmark Factory. Benchmark Factory supports multiple licenses. For example, a Toad for Oracle Edition license and a Toad for SQL Server Edition license may be active simultaneously.
- To enter a new license, click Add and enter the license key and the site message included with the license key.
- To modify a license, select the license to update and click Modify. Then update the key and site message.
- If Benchmark Factory was activated by a Toad Edition license, the Toad license is listed. Select the license and click Modify to update it.
-
To delete a license, select the license to delete and click Delete License.
Important: If you delete a license key, any features enabled by that license and not supported by another currently-active license are disabled.
BMFServer.exe Enhancements
- The default REST API port number for BMFServer.exe is now the same as the Benchmark Factory console, port 30100.
- The BMFServer log file (BMFServer.log) is now located in: \My Benchmark Factory\<version>\<bitness>\Error Logs
New Features in 8.0.1
Benchmark Factory 8.0.1 is a maintenance release and includes resolved issues and minor enhancements. See the Benchmark Factory 8.0.1 Release Notes for a complete list.
New Features in 8.0
Benchmark Factory 8.0 includes the following new features and enhancements.
Enhanced REST API
With this release the Benchmark Factory REST API has been enhanced to allow users more control of jobs, tests, test runs, etc. This includes the ability to access the transactions in tests, agents used by jobs, test results of a test run, as well as the Benchmark Factory settings.
Support for JSON format. Responses can now be returned in JSON format. To return data using the JSON format, specify JSON in the request Accept header. Both XML and JSON are supported response or request formats.
Access to Additional REST Resources. Additional resources have been added to the Benchmark Factory REST API. For a complete list of resources, see the Benchmark Factory Help or the BMF REST API on Toad World. The Help also includes a useful description of the REST resource structure and the URI hierarchy.
Integrate Benchmark Factory into Continuous Testing Process
This release includes additional features that allow you to easily integrate Benchmark Factory into your Continuous Integration or Continuous Testing process.
BMFServer.exe
This release includes a non-UI Benchmark Factory application, BMFServer.exe.
- BMFServer.exe is installed into the bin sub-directory of the installation directory when you install Benchmark Factory.
- To start BMFServer.exe, go to the installation directory. The default location is C:\Program Files\Quest Software\Benchmark Factory <version>\bin. Then double-click BMFServer.exe.
- BMFServer.exe performs the same functionality as BFactory.exe, except it has no graphic user interface.
- Use BMFServer.exe when automating your continuous improvement/testing process. You can run BMFServer.exe using a script, a custom application, or the Command Prompt window. BMFServer.exe can be used with the Benchmark Factory REST API.
- You cannot run the Benchmark Factory console and BMFServer.exe at the same time on the same machine.
BMFAgent.exe
Benchmark Factory now includes a non-UI Agent, BMFAgent.exe.
- BMFAgent.exe is installed into the bin sub-directory of the installation directory at the time you install Benchmark Factory.
- BMFAgent.exe has the same functionality as Agent.exe, except BMFAgent.exe has no graphic user interface.
- To modify BMFAgent.exe settings, use the BMFAgent.ini file located in the ProgramData\Quest Software\BMF directory or use the Command Prompt window. Settings you can modify include the console machine name/IP and the console port number.
- You can run multiple instances of BMFAgent.exe at the same time on the same machine.
Standard Benchmark Testing
Clear Cached Data between Iterations
You can now instruct Benchmark Factory to clear cached data between test iterations. Because cached data can improve performance, this new feature can prevent cached data from affecting subsequent iterations.
-
Oracle—For Oracle connections, you can instruct Benchmark Factory to clear data buffer caches or shared pool (or both). To specify these options, select Edit | Connections. Then select a connection and click the Edit button. In the connection properties dialog, select the Miscellaneous tab. Then specify the Database Flush options for this connection.
Tip: You can also specify default values to automatically apply to Oracle connections in Edit | Settings | Oracle.
Note: Specific database privileges are required to perform this action. The privilege required is dependent on the database version and the option selected. See the online Help for more information.
-
SQL Server®—For SQL Server connections, you can instruct Benchmark Factory to clear data buffer caches and procedure caches. To specify this option, select Edit | Connections. Then select a connection and click the Edit button. In the connection properties dialog, select the Miscellaneous tab. Then specify the Database Flush option for this connection.
Tip: You can also specify a default value to apply to SQL Server connections in Edit | Settings | SQL Server.
Note: This option is only applicable to SQL Server 2005 or later. The sysadmin fixed server role is required.
Connections
Microsoft® SQL Server 2017. This release includes support for SQL Server 2017. Benchmark Factory has been tested against SQL Server 2017 running on Windows or Linux.
IBM® DB2®. This release includes support for IBM DB2 11.1 for LUW and for z/OS.
General
Adding Bind Parameters
It is now easier to add a bind parameter/value pair in Test Options | Transactions.
-
When adding a new statement in the Add SQL Transaction dialog or when editing an existing statement, you can now simply double-click within the Bind Parameters tab to add a bind parameter and parameter value.
Installation
Universal C Runtime Component
The Universal C Runtime component for Windows is required. See Universal C Runtime Update or Visual C++ Redistributable for Visual Studio 2015 to download this software.
Note: If you encounter an error when installing this software, install the missing prerequisite software. For Windows 8.1 or Windows Server 2012 R2, install the April 2014 update: https://support.microsoft.com/en-us/kb/2919355. For other operating systems, see the Universal C Runtime Update Prerequisites section.
Learn More
Learn more and connect with the community at the Benchmark Factory Community page on Toad World.
- Find interesting blogs and other useful information.
- Ask questions in the forum.
- Link to Commercial, Trial, and Freeware downloads.
- Find Benchmark Factory documentation.