Benchmark Factory® is a database performance testing tool that allows you to conduct database workload replay, industry-standard benchmark testing, and scalability testing.
Review the following topics for a quick overview of Benchmark Factory.
This release of Benchmark Factory® includes the following new features and enhancements.
With this release the Benchmark Factory REST API has been enhanced to allow users more control of jobs, tests, test runs, etc. This includes the ability to access the transactions in tests, agents used by jobs, test results of a test run, as well as the Benchmark Factory settings.
Support for JSON format. Responses can now be returned in JSON format. To return data using the JSON format, specify JSON in the request Accept header. Both XML and JSON are supported response or request formats.
Access to Additional REST Resources. Additional resources have been added to the Benchmark Factory REST API. For a complete list, see the Benchmark Factory Help. The Help also includes a useful description of the REST resource structure and the URI hierarchy.
This release includes additional features that allow you to easily integrate Benchmark Factory into your Continuous Integration or Continuous Testing process.
This release includes a non-UI Benchmark Factory application, BMFServer.exe.
Benchmark Factory now includes a non-UI Agent, BMFAgent.exe.
Clear Cached Data between Iterations
You can now instruct Benchmark Factory to clear cached data between test iterations. Because cached data can improve performance, this new feature can prevent cached data from affecting subsequent iterations.
Oracle—For Oracle connections, you can instruct Benchmark Factory to clear data buffer caches or shared pool (or both). To specify these options, select Edit | Connections. Then select a connection and click the Edit button. In the connection properties dialog, select the Miscellaneous tab. Then specify the Database Flush options for this connection.
Tip: You can also specify default values to automatically apply to Oracle connections in Edit | Settings | Oracle.
Note: Specific database privileges are required to perform this action. The privilege required is dependent on the database version and the option selected. See the online Help for more information.
SQL Server®—For SQL Server connections, you can instruct Benchmark Factory to clear data buffer caches and procedure caches. To specify this option, select Edit | Connections. Then select a connection and click the Edit button. In the connection properties dialog, select the Miscellaneous tab. Then specify the Database Flush option for this connection.
Tip: You can also specify a default value to apply to SQL Server connections in Edit | Settings | SQL Server.
Note: This option is only applicable to SQL Server 2005 or later. The sysadmin fixed server role is required.
Microsoft® SQL Server 2017. This release includes support for SQL Server 2017. Benchmark Factory has been tested against SQL Server 2017 running on Windows or Linux.
IBM® DB2®. This release includes support for IBM DB2 11.1 for LUW and for z/OS.
Adding Bind Parameters
It is now easier to add a bind parameter/value pair in Test Options | Transactions.
Universal C Runtime Component
Note: If you encounter an error when installing this software, install the missing prerequisite software. For Windows 8.1 or Windows Server 2012 R2, install the April 2014 update: https://support.microsoft.com/en-us/kb/2919355. For other operating systems, see the Universal C Runtime Update Prerequisites section.
Note: The features described in the New in This Release section apply to the commercial version of Benchmark Factory and may not be available in the freeware edition.
Use the following links to videos, blogs, and community resources to learn more about Benchmark Factory, to find answers to questions, and to advance your knowledge through Benchmark Factory tips and tricks.