Chat now with support
Chat with Support

Welcome, erwin customers to Quest Support Portal click here for for frequently asked questions regarding servicing your supported assets.

Benchmark Factory for Database 8.3 - Release Notes

Release Notes

Benchmark Factory® 8.3

Release Notes

Thursday, August 1, 2019


About Benchmark Factory

Quest Software is pleased to make available Benchmark Factory® 8.3 to meet your database workload testing needs. Benchmark Factory is a database performance and code scalability testing tool that simulates users and transactions on the database and replays production workload in non-production environments. With Benchmark Factory developers, DBAs, and QA teams can validate that their databases will scale as user loads increase, application changes are made, and platform changes are implemented.

Benchmark Factory is available for Oracle®, SQL Server®, IBM® DB2®, SAP®, MySQL, PostgreSQL, and other databases via ODBC connectivity. Benchmark Factory:

  • Simulates thousands of concurrent users with a minimal amount of hardware.
  • Simulates database production workloads.
  • Reports tests results with built-in reporting features.

Upon completion of a test execution, all test results are collected and stored in the repository for data analysis and reporting. Benchmark Factory collects a variety of informative and detailed statistics that include:

  • Overall server throughput (measured in transactions per second/minute or bytes transferred).
  • Detailed transaction executed statistics by individual agent workstations producing a load.

 

New Features

New Features in 8.3

This release of Benchmark Factory includes the following new features and enhancements.

Benchmark Factory 8.3

Microsoft SQL Server Support

The Benchmark Factory Agent for Linux can now be used when testing against the following database types (in addition to PostgreSQL, Oracle and MySQL):

  • Microsoft SQL Server
  • Microsoft SQL Server. If using the Benchmark Factory Agent for Linux to test against a Microsoft SQL Server database, ensure the unixODBC and msodbcsql Client are installed on the same Linux machine as the Agent. Installing the Microsoft SQL Server ODBC Driver, see Installing the Microsoft ODBC Driver for SQL Server on Linux and macOS.

Database Support

This release of Benchmark Factory includes support for the following database versions:

  • Oracle 19c

Enhancements to the Benchmark Factory

  • Benchmark Factory Agent for Linux. You can now gather CPU and Memory from the Benchmark Factory Agent for Linux. This display in Benchmark Factory Main window Bottom Agent panel.
  • REST API. You can now use URL(api/jobs/tests/testindex/currentresult) to get current results of the test results are same as they display in UI.

 

See Resolved Issues for more enhancements and resolved issues in this release of Benchmark Factory.


Learn More

Learn more and connect with the community at the Benchmark Factory Community page on Toad World.

  • Find interesting blogs and other useful information.
  • Ask questions in the forum.
  • Link to Commercial, Trial, and Freeware downloads.
  • Find Benchmark Factory documentation.

Deprecated Features

SQL Server Native Client

Beginning with Benchmark Factory 8.1, the Microsoft SQL Server Native Client (11.0) is no longer distributed along with Benchmark Factory.


Resolved Issues

Resolved Issues and Enhancements

The following is a list of issues addressed and enhancements implemented in this release of Benchmark Factory.

Resolved Issues in 8.3

Feature Resolved Issue Defect ID
Connections - SAP Native Corrected an issue in which getting the same database Environment in Editing Connection. This issue was discovered when editing the created connection then click Environment against an SAP ASE database connection. BMF-4192
Benchmark Factory REST API Resolved an issue in which caused Benchmark Factory to unexpectedly stop as a result of deleting a Job when it is Running or Stopping. BMF-5437
Stored Procedure Corrected an issue in which Benchmark Factory failed to import the Stored Procedure in a MySQL connection. BMF-5237
UI Corrected Uninstall button display issue found in the Windows Settings| Add or Remove programs in Windows 10 environment. BMF-5461
Custom Mix Test Resolved an issue in which caused Benchmark Factory to unexpectedly stop and close as a result of Running a Custom Mix Job with wrong date format in SQL Statement Transaction. BMF-5457
TPC-E Benchmark Test SAP Native: Corrected an issue in which the TPC-E CustomerPosition transaction's SQL missing join condition. This issue was discovered when testing against an SAP ASE database. BMF-5463
Linux Agent Corrected an issue in which the error log of Linux Agent generated in the wrong path. BMF-5386
Run Reports Enhancement: Run Reports Import Test Result button now allow you to specify one or more Run Reports to import at a time. BMF-659

Resolved Issues in 8.2.1

Feature Resolved Issue Defect ID
Benchmark Factory Console Corrected an issue which caused an error when a Standard user attempted to start the Benchmark Factory console under certain conditions. BMF-5377
General Upgraded Third Party component to latest version. BMF-5419

Resolved Issues in 8.2

Feature Resolved Issue Defect ID
Adding SQL Transactions Corrected an issue in which the same database was listed twice in the "Database" drop-down list in the "Add Stored Procedures" dialog (Test Options | Transactions | Add Stored Procedures). This issue was discovered when testing against an SAP ASE database. BMF-3856
Adding SQL Transactions Corrected an issue in which existing procedures were not listed for the selected database in the "Add Stored Procedures" dialog (Test Options | Transactions | Add Stored Procedures). This issue was discovered when testing against an SAP ASE database. BMF-3857
Benchmark Factory REST API Corrected an issue in which Benchmark Factory failed to include the SQL's bind parameter in a Custom test posted using the JSON format. BMF-5217
Capture and Replay Corrected an issue which caused Benchmark Factory to unexpectedly stop and close as a result of high memory utilization when importing a very large number of Oracle trace files. BMF-5013
Capture and Replay Enhancement: A new Execution Method, "Direct SQL Execute," has been added to the "Add SQL Transactions" dialog. Select this method to execute SQL without preparation. This can be useful when replaying a workload in which temporary tables are used. BMF-5148
Capture and Replay When importing a SQL Server trace table, the SQL Server Trace Processing screen now displays statistics for only the imported SQL. BMF-5248
Capture and Replay Oracle: Corrected an issue in which executing a SQL statement that included an in/out parameter with a NULL value caused in the following error: ORA-06502: PL/SQL: numeric or value error. BMF-5253
Capture and Replay If an error is encountered during replay of an imported SQL Server trace table/file, the error message now includes more-detailed information, such as the name of the transaction that errored and the user scenario containing the transaction. BMF-5302
Connections - MariaDB ODBC Corrected an issue that caused a "load_progress" error when loading tables during a Standard Benchmark test (TPC-C and TPC-D) using a MariaDB ODBC connection to a MariaDB database. BMF-5305
General Oracle: Resolved an issue which caused Benchmark Factory to unexpectedly close when executing an Oracle SQL statement which returns a LONG data type column in the results. This issue was encountered during test execution, in the Session Editor, and during SQL Preview. BMF-5142
General Oracle: Corrected an issue that resulted in the following error when executing a Select statement against an INTERVAL DAY TO SECOND data type column: ORA-24374: define not done before fetch or execute and fetch. BMF-5163
General Enhancement: User Startup options have been added to the Timing tab for the "Test SQL for Scalability" test and the capture replay. The User Startup options allow you to specify when to start users. This allows you to adjust startup loads by staggering user startup times. BMF-5297

 


Self Service Tools
Knowledge Base
Notifications & Alerts
Product Support
Software Downloads
Technical Documentation
User Forums
Video Tutorials
RSS Feed
Contact Us
Licensing Assistance
Technical Support
View All
Related Documents

The document was helpful.

Select Rating

I easily found the information I needed.

Select Rating