Release Notes
Monday, March 18, 2019
Quest Software is pleased to make available Benchmark Factory® 8.2 to meet your database workload testing needs. Benchmark Factory is a database performance and code scalability testing tool that simulates users and transactions on the database and replays production workload in non-production environments. With Benchmark Factory developers, DBAs, and QA teams can validate that their databases will scale as user loads increase, application changes are made, and platform changes are implemented.
Benchmark Factory is available for Oracle®, SQL Server®, IBM® DB2®, SAP®, MySQL, PostgreSQL, and other databases via ODBC connectivity. Benchmark Factory:
Upon completion of a test execution, all test results are collected and stored in the repository for data analysis and reporting. Benchmark Factory collects a variety of informative and detailed statistics that include:
This release of Benchmark Factory includes the following new features and enhancements.
MySQL Native Connection. Beginning with this release, Benchmark Factory now provides the ability to create a MySQL connection using Native database connectivity.
Note: The following Benchmark tests are supported: TPC-C, TPC-E, and TPC-H.
This release of Benchmark Factory includes support for the following database versions:
In release 8.1, Benchmark Factory introduced an agent which you can deploy in your Linux environment. Benchmark Factory 8.2 includes several significant enhancements to the Agent for Linux.
You can now install an agent on a remote Linux machine through the Benchmark Factory Console. This provides an easy, UI-based method for installing a remote agent on a Linux platform.
The Benchmark Factory Agent for Linux is now distributed as an RPM package. This provides a number of advantages over the previous archive file (.tar) format. This format allows BMF to provide automatic installation through the Benchmark Factory Console. You can also use YUM to install the Benchmark Factory Agent RPM package on Linux manually.
To download the RPM package for manual installation, go to https://bintray.com/quest/bmfrepo. For additional information, see "Install Remote Agent on Linux" in the Benchmark Factory Help. For best results, install the Agent for Linux automatically through the Benchmark Factory Console.
The Benchmark Factory Agent for Linux can now be used when testing against the following database types (in addition to PostgreSQL):
Oracle. If using the Benchmark Factory Agent for Linux to test against an Oracle database, ensure an Oracle Client is installed on the same Linux machine as the Agent. Review the following details:
See Resolved Issues for more enhancements and resolved issues in this release of Benchmark Factory.
Learn more and connect with the community at the Benchmark Factory Community page on Toad World.
SQL Server Native Client
Beginning with Benchmark Factory 8.1, the Microsoft SQL Server Native Client (11.0) is no longer distributed along with Benchmark Factory.
The following is a list of issues addressed and enhancements implemented in this release of Benchmark Factory.
| Feature | Resolved Issue | Defect ID |
|---|---|---|
| Adding SQL Transactions | Corrected an issue in which the same database was listed twice in the "Database" drop-down list in the "Add Stored Procedures" dialog (Test Options | Transactions | Add Stored Procedures). This issue was discovered when testing against an SAP ASE database. | BMF-3856 |
| Adding SQL Transactions | Corrected an issue in which existing procedures were not listed for the selected database in the "Add Stored Procedures" dialog (Test Options | Transactions | Add Stored Procedures). This issue was discovered when testing against an SAP ASE database. | BMF-3857 |
| Benchmark Factory REST API | Corrected an issue in which Benchmark Factory failed to include the SQL's bind parameter in a Custom test posted using the JSON format. | BMF-5217 |
| Capture and Replay | Corrected an issue which caused Benchmark Factory to unexpectedly stop and close as a result of high memory utilization when importing a very large number of Oracle trace files. | BMF-5013 |
| Capture and Replay | Enhancement: A new Execution Method, "Direct SQL Execute," has been added to the "Add SQL Transactions" dialog. Select this method to execute SQL without preparation. This can be useful when replaying a workload in which temporary tables are used. | BMF-5148 |
| Capture and Replay | When importing a SQL Server trace table, the SQL Server Trace Processing screen now displays statistics for only the imported SQL. | BMF-5248 |
| Capture and Replay | Oracle: Corrected an issue in which executing a SQL statement that included an in/out parameter with a NULL value caused in the following error: ORA-06502: PL/SQL: numeric or value error. | BMF-5253 |
| Capture and Replay | If an error is encountered during replay of an imported SQL Server trace table/file, the error message now includes more-detailed information, such as the name of the transaction that errored and the user scenario containing the transaction. | BMF-5302 |
| Connections - MariaDB ODBC | Corrected an issue that caused a "load_progress" error when loading tables during a Standard Benchmark test (TPC-C and TPC-D) using a MariaDB ODBC connection to a MariaDB database. | BMF-5305 |
| General | Oracle: Resolved an issue which caused Benchmark Factory to unexpectedly close when executing an Oracle SQL statement which returns a LONG data type column in the results. This issue was encountered during test execution, in the Session Editor, and during SQL Preview. | BMF-5142 |
| General | Oracle: Corrected an issue that resulted in the following error when executing a Select statement against an INTERVAL DAY TO SECOND data type column: ORA-24374: define not done before fetch or execute and fetch. | BMF-5163 |
| General | Enhancement: User Startup options have been added to the Timing tab for the "Test SQL for Scalability" test and the capture replay. The User Startup options allow you to specify when to start users. This allows you to adjust startup loads by staggering user startup times. | BMF-5297 |
© ALL RIGHTS RESERVED. Terms of Use Privacy Cookie Preference Center
