TPC Benchmark Status
May 2011
|
| Overview |
| Published 4 times per year, the TPC Benchmark Status Report is a digest of the activities of the TPC and its technical subcommittees.
The TPC held two General Council meetings on February 11th in Colorado Springs, CO, and on April 7th, in Austin, TX. The TPC-E Maintenance Subcommittee made some editorial changes for a future revision of the TPC-E Specification and a future revision of EGen. The TPC-H Maintenance Subcommittee posted version 2.14.0 and a third level revision 2.14.1 which make all scale factors available for publication. The Energy Subcommittee made some editorial changes for a future revision of the TPC-E Specification. The TPC-Virtualization Development Subcommittee continued its prototyping activities. Finally, the TPC announced its participation at the VLDB conference with the TPCTC2011in Seattle, WA; a call for papers has been circulated.
|
Current Benchmarks
|
| TPC-C |
The TPC-C Maintenance Subcommittee had no outstanding issues to discuss at the meeting. The subcommittee will continue to monitor the benchmark, along with any TAB interpretations and rulings, for discussion and possible inclusion in future versions of the TPC-C specification.
|
| TPC-H |
The TPC-H Maintenance Subcommittee released minor revision 2.14.0 to correct answer sets, include a new tool to automate answer set validation, to match the reference (Data generation no longer varies by DOP for the part table) and to incorporate the reference data in the tools tarball . Revision 2.13.0 became obsolete at 11:59pm on April 5th, 2011. A third level revision 2.14.1 was released with all scale factors available for publication.
In addition work continues on major revision 3.0.
|
| TPC-E |
|
The TPC-E Maintenance Subcommittee made some editorial changes for a future revision of the TPC-E Specification related to the use of the defined terms Measured Throughput, Reported Throughput and tpsE; transaction harness status checks, and data accessibility wording.
Some minor enhancements were also made to the EGen APIs, which are available to assist in developing sample drivers which will be available in a future revision of the benchmark standard.
Version 1.5 was retired January 10, 2011.
|
Benchmarks Under Development
|
| TPC-ETL |
The ETL benchmark subcommittee is not convening at the meetings pending the outcome of work being carried out by member companies.
|
| TPC-V |
|
The TPC-Virtualization Development Subcommittee has been actively working on the benchmark specification. Several member companies have signed up for prototyping tasks and the subcommittee is looking into the feasibility of developing an end-to-end reference benchmarking kit. A coding team has been formed for that purpose and has begun working on the reference kit.
Organizations that are interested in influencing the TPC-V benchmark are encouraged to become members. In particular, database vendors are sought for active participation.
|
Specifications Common to All Benchmarks
|
| TPC-Energy |
|
The TPC Energy Subcommittee has updated the specification to version 1.3.1 which clarifies some clauses and addresses some auditor questions.
The Energy Measurement System (EMS) is at revision 1.3.0 and has changes to implement the requirements in specification version 1.3.0 and incorporates changes to implement the requirements in specification version 1.3.x.
TPC-Energy results continue to be published on all TPC Benchmarks (TPC-C, TPC-H, and TPC-E). The TPC web site has these results posted and the files are available for downloading.
|
| Pricing Specification |
|
The TPC passed Price Specification Version 1.6.0 with minor enhancements to language on maintenance Terms and Conditions. Version 1.6 is available immediately. Version 1.5 will be retired January 10, 2011.
New requests for the Pricing Specification can be generated at FogBugz
|
Other TPC Activities
|
| TPC Technology Conference 2011 |
|
The TPC announced its participation in TPCTC 2011 in conjunction with VLDB2011 in Seattle, WA, and issued a call for papers for the workshop which will be held on August 28, 2011. With this conference, the third in the series, the TPC encourages researchers and industry experts to submit novel ideas and methodologies in performance evaluation, measurement, and characterization. Topics of interest include, but are not limited to
- Business intelligence
- Green computing
- Virtualization
- Social media infrastructure
- Disaster tolerance and recovery
- Lessons learnt in practice using TPC workloads
- Cloud computing
- Energy and space optimizations
- Complex event processing
- Hardware innovations
- Enhancements to TPC standards
- Database optimizations
- Hybrid workloads
Abstracts are due on May 23 and papers on May 30.
|
Public Relations Committee |
|
The TPC conducted a member survey to look into future directions for the organization as well as how to increase member value. The results are being tallied and the PR subcommittee will analyze them to determine further course of action.
We welcome opportunities to present the benefits and status of TPC benchmarks: if you are interested in inviting someone from the TPC for a presentation, please contact Michael Majdalany (majdalany @ tpc.org)
|
| All Benchmark Status Reports |
|
|
