TPC Benchmark Status May 2013 |
| Overview |
| Published about 4 times per year, the TPC Benchmark Status Report is a digest of the activities of the TPC and its technical subcommittees.
The TPC held a meetings on February 8th in Austin, Texas. The TPC-H specification was updated to Version 2.15.0 following minor corrections and clarifications. The TPC’s fifth Technology Conference, TPCTC 2013, was approved and will be held in conjunction with the annual conference on Very Large Databases (VLDB), in Trento, Italy. The TPC has also made several improvements to the web site and notification services to enhance the user experience.
|
Current Benchmarks |
| TPC-C |
|
The TPC-C Maintenance Subcommittee had no outstanding issues to discuss. The subcommittee continues to monitor the benchmark, along with any TAB interpretations and rulings, for discussion and possible inclusion in future versions of the TPC-C specification.
|
| TPC-DS |
|
The TPC-DS Maintenance Subcommittee had no outstanding issues to discuss. The subcommittee continues to monitor the benchmark, along with any TAB interpretations and rulings, for discussion and possible inclusion in future versions of the TPC-DS specification.
|
| TPC-E |
|
The TPC-E Maintenance Subcommittee has made some minor enhancements to the EGen code to improve platform support, made some editorial changes to the specification, and is reviewing and extending the development of the unit test framework for EGen.
|
| TPC-H |
|
The TPC-H Maintenance Subcommittee released Version 2.15.0 of the TPC-H specification, which corrects a wrong reference, formalizes the term GUI and documentation disclosure in the specification and corrects an error in dbgen.
|
| TPC-VMS |
|
The TPC-VMS Maintenance Subcommittee had no outstanding issues to discuss. TPC-VMS specifies the rules and methodology for measuring and reporting TPC-C, TPC-E, TPC-H and TPC-DS metrics running in a Virtualized Environment.
|
Benchmarks Under Development |
| TPC-DI |
|
Data Integration (DI), also known as ‘ETL’, is the analysis, combination, and transformation of data from a variety of sources and formats into a unified data model representation. Data Integration is a key element of data warehousing, application integration, and business analytics solutions. The variety and volume of data is always increasing and performance of data integration systems is critical. However, there has been no industry standard for measuring and comparing the performance of DI systems.
The TPC-DI benchmark subcommittee is continuing refinement of the specification. Definition of the System Under Test and rules for Pricing have been specified, and progress has been made on the definition of the automated audit. Development of the data generator is ongoing. |
| TPC-V |
|
The TPC-V development subcommittee has been making progress in developing an end-to-end reference benchmarking kit, which can now run transactions on multiple databases in multiple VMs on a virtualized server. A new draft version of the specification has been approved.
|
Specifications Common to All Benchmarks |
| TPC-Energy |
|
The TPC Energy subcommittee updated the EMSC code to version 1.5.0 while the TPC-Energy specification is now revision 1.50.
|
| Pricing Specification |
|
The current TPC Price Specification is Version 1.7.0 which includes minor enhancements to recognize use of storage devices other than rotating disks and to recognize that pricing rules apply to results that are in an active state on the TPC results list. All prior active results are considered to be comparable to those published under revision 1.7.
|
Other TPC Activities |
| TPC Technology Conference |
|
The proceedings from TPCTC 2012 are now available.
The VLDB has approved the 2013 edition in conjunction with VLDB 2013. The TPC has issued a call for papers for the workshop which will be held on August 26, 2013 in Trento, Italy. With this conference, the fifth in the series, the TPC encourages researchers and industry experts to submit novel ideas and methodologies in performance evaluation, measurement, and characterization. Topics of interest include, but are not limited to:
- Big Data Appliances
- Cloud Computing
- In-memory databases
- Social media infrastructure
- Business intelligence
- Complex event processing
- Database optimizations
- Green computing
- Disaster tolerance and recovery
- Energy and space efficiency
- Hardware innovations
- Data Integration
- Hybrid workloads
- Virtualization
- Lessons learned in practice using TPC workloads
- Enhancements to TPC workloads
Abstracts are due on June 8 and papers on June 15, 2013.
|
| TPC Web Site Enhancements |
|
The TPC has made several improvements to the web site to ease navigation and enhance the searching for relevant results. The notification service has also been enhanced.
The advanced sorting feature (see example here) now presents a clearer screen and easier to understand filters. In addition, results are displayed immediately after a filter or parameter has been entered or changed. Another feature is the possibility to download a results spreadsheet for each of the benchmark specifications (see example here).
A new notification service has also been introduced. After signing up and setting a password, a menu will appear where users can choose the types of notifications they wish to receive. These options include:
- Signing up for the Benchmark Status Report
- Selection of the benchmark category of interest. The user will get notifications only on the categories they select
- Selection of the frequency (e.g., daily, weekly, and/or montly digests)
|
| All Benchmark Status Reports |
|
|
