Third TPC Technology Conference on Performance Evaluation & Benchmarking
(TPCTC 2011)
in conjunction with VLDB 2011

Conference Program

August 29, 2011
Opening Remarks and Welcome
08:00 - 08:30 Breakfast
08:30 - 08:50 TPC Technology Conference on Performance Evaluation and Benchmarking:
Raghunath Nambiar, General Chair (Cisco)
Presentation
08:50 - 09:15 TPC Public Relations Presentation
Shaping the Landscape of Industry Standard Benchmarks: Contributing of the TransactionProcessing Performance Council (TPC): Raghunath Nambiar (Cisco); Nicholas Wakou (Dell);Peter Thawley (Sybase); Andrew Masland (NEC); Matthew Lanken (Oracle); Michael Majdalany(LoBue & Majdalany Mgmt Group); Forrest Carman (Owen Media)
Presentation     Paper
Session 1: New Benchmark Ideas
09:15 - 09:40 Metrics for Measuring the Performance of the Mixed Workload CH-benCHmark: Florian Funke, Alfons Kemper , Stefan Krompass, Thomas Neumann, Michael Seibold (Technische Universitaet Muenchen); Harumi Kuno (HP Labs); Anisoara Nica (Sybase); Meikel Poess (Oracle)
Presentation     Paper
09:40 - 10:05 Towards an Enhanced Benchmark Advocating Energy-Effcient Systems: Daniel Schall, Volker Hoefner (University of Kaiserslautern); Manuel Kern (SPH AG)
Presentation     Paper
10:05 - 10:30 Coffee Break
10:30 - 11:10 Keynote
Optimization of Analytic Data Flows for Next Generation Business Intelligence Applications: Umeshwar Dayal (HP Labs)
Presentation     Paper
Session 1: New Benchmark Ideas (Continued)
11:10 - 11:35 Normalization in a Mixed OLTP and OLAP Workload Scenario: Anja Bog, Alexander Zeier (Hasso Plattner Institute); Kai Sachs (SAP AG)
Presentation     Paper
11:35 - 12:00 Performance Metrics for Complex Event Processing Systems: Torsten Grabs, Ming Lu (Microsoft)
Presentation     Paper
12:00 - 13:30 Lunch Break
13:30 - 14:10 Invited Talk
Benchmarking With Your Head in the Cloud: Karl Huppler (IBM)
Presentation     Paper
Session 2: Extending TPC Benchmarks
14:10 - 14:35 Extending TPC-E to Measure Availability in Database Systems: Yantao Li, Charles Levine (Microsoft)
Presentation     Paper
14:35 - 15:00 A PDGF Implementation for TPC-H: Meikel Poess (Oracle); Tilmann Rabl, Manuel Danisch, Michael Frank (Universitaet Passau)
Presentation     Paper
15:00 - 15:30 Coffee Break
15:30 - 15:55 Introducing Skew into the TPC-H Benchmark: Alain Crolotte, Ahmad Ghazal (Teradata)
Presentation     Paper
Session 3: Performance Modeling and Characterization
15:55 - 16:20 Time and Cost-Efficient Modeling and Generation of Large-Scale TPC Workloads: Christina Delimitrou, Christos Kozyrakis (Stanford University); Sriram Sankar, Badriddine Khessib, Kushagra Vaid (Microsoft)
Paper
16:20 - 16:45 When free is not really free: What does it cost to run a database workload in the cloud?: Avrilia Floratou, Willis Lang, Jignesh Patel (University of Wisconsin); Alan Halverson (Microsoft)
Presentation     Paper
16:45 - 17:10 A Fine-grained Performance-based Decision Model for Virtualization Application Solution: Jianhai Chen, Dawei Huang, Bei Wang, Deshi Ye, Qinming He, Wenzhi Chen (Zhejiang University)
Presentation     Paper
17:10 - 17:35 SI-CV: Snapshot Isolation With Co-Located Versions: Robert Gottstein, Ilia Petrov, Alejandro Buchmann (TU-Darmstadt)
Presentation     Paper
17:35 - 18:00 Closing Remarks
Benchmarking for 2012 and Beyond: Meikel Poess, General Chair (Oracle)
Call For Papers

Over the past two decades, the Transaction Processing Performance Council (TPC) has had a significant impact on the computing industry's use of industry-standard benchmarks. For example, vendors and endusers rely on TPC benchmarks to provide real-world data that is backed by a stringent and independent review process. Vendors also use TPC benchmarks to demonstrate performance competitiveness for their existing products, and to improve/monitor the performance of products-under-development. Many buyers often use TPC benchmark results as points of comparison when purchasing new computing systems.

The technology landscape is continually evolving and challenging industry experts and researchers to develop innovative techniques to evaluate and benchmark computing systems. The TPC remains committed to developing highly relevant benchmark standards and will continue to develop new benchmarks to keep pace. With this conference, the TPC encourages researchers and industry experts to submit novel ideas and methodologies in performance evaluation, measurement, and characterization.

Topics of interest include, but are not limited to:

  • Cloud computing
  • Social media infrastructure
  • Business intelligence
  • Complex event processing
  • Database optimizations
  • Green computing
  • Disaster tolerance and recovery
  • Energy and space efficiency
  • Hardware innovations
  • Hybrid workloads
  • Virtualization
  • Lessons learned in practice using TPC workloads
  • Enhancements to TPC workloads

Selected papers may be considered for future TPC benchmark developments.
Submission Guidelines
 Authors are invited to submit original, unpublished papers that are not currently under review for any other conference or journal. We also encourage the submission of extended abstracts, position statement papers and lessons learned in practice. The length of a paper should not exceed 16 pages. Papers should follow the LNCS format. The title page must contain a short abstract. All papers should be submitted electronically in PDF format to the review web site at at: https://cmt.research.microsoft.com/tpctc2011>
.

Important Dates

Abstract due: May 23, 2011
Papers due: May 30, 2011
Notification of acceptance: June 30,2011
Camera-ready copies: July 15, 2011
Conference day: August 29, 2011                


Conference Venue and Registration
 Please visit the VLDB2011 conference web site at http://www.vldb.org/2011/.

Proceedings
Proceedings will be published by Springer-Verlag as Lecture Notes in Computer Science (LNCS). Selected papers may be considered for future TPC benchmark developments.
LNCS logo
TPCTC 2011 Organization
General Chairs
Raghunath Nambiar, Cisco, USA, rnambiar@cisco.com
Meikel Poess, Oracle, USA, meikel.poess@oracle.com Program Committee:
Alain Crolotte, Teradata, USA
Neoklis Polyzotis, University of California, Santa Cruz, USA
Badriddine Khessib, Microsoft, USA
Brian Cooper, Google,USA
Harumi Kuno, HP Labs, USA
Kai Sachs, SAP, Germany
Marco Vieira, University of Coimbra, Portugal
Masaru Kitsuregawa, University of Tokyo, Japan
Mike Brey, Oracle, USA
Mike Molloy, Dell, USA
Patrick O'Neill, University of Massachusetts at Boston, USA
Peter Thawley, Sybase, USA
Alfredo Cuzzocrea, ICAR-CNR and University of Calabria, Italy
Tilmann Rabl, University of Toronto, Canada
Publicity Committee:
Nicholas Wakou, Dell, USA, Chair, nicholas_wakou@dell.com
Andrew Masland, NEC, USA
Matthew Lanken, Oracle, USA
Peter Thawley, Sybase, USA
Michael Majdalany, L&M Management Group, USA
Forrest Carman, Owen Media, USA

Keynote Speaker:
Umesh Dayal, HP Labs, USA

Invited Speaker:
Karl Huppler, IBM, USA