Fifth TPC Technology Conference on Performance Evaluation & Benchmarking
(TPCTC 2013)

in conjunction with VLDB 2013



Conference Program

August 26, 2013


08:30 - 09:00 Opening Remarks and Welcome
Raghunath Nambiar (Cisco)
Presentation
TPC State of the Council 2013
Raghunath Nambiar (Cisco), Meikel Poess (Oracle), Andrew Masland (NEC), H. Reza Taheri (VMware), Andrew Bond (RedHat), Forrest Carman (Owen Media), Michael Majdalany (L&M Mgmt Group)
09:00 - 09:30 TPC-BiH: A Benchmark for Bi-Temporal Databases
Martin Kaufmann (SAP AG, ETH Zurich), Peter Fischer, Norman May (SAP AG), Andreas Tonder (SAP AG), Donald Kossmann (ETH Zurich)
Presentation
09:30 - 10:00 Towards Comprehensive Measurement of Consistency Guarantees for Cloud-Hosted Data Storage Services
David Bermbach (KIT), Liang Zhao (NICTA and University of New South Wales), Sherif Sakr (NICTA and University of New South Wales)
Presentation


10:00 - 10:30 Coffee Break


10:30 - 11:30 Invited Talk
TPC Express – A New Path for TPC Benchmarks
Karl Huppler (IBM)
Presentation
11:30 - 12:00 TPC-H Analyzed: Hidden Messages and Lessons Learned from an Influential Benchmark
Peter Boncz (CWI), Thomas Neumann (Technical University Munich), Orri Erling (Openlink Software)
Presentation


12:00 - 14:00 Lunch Break


14:00 - 15:00 Keynote by Raghu Ramakrishnan (Microsoft)
Benchmarking Challenges in the New World of Big Data and Cloud Services
Presentation


15:00 - 15:30 Architecture and Performance characteristics of a PostgreSQL implementation of TPC-E and TPC-V workloads
Reza Taheri (VMware), Andrew Bond (RedHat), Doug Johnson (InfoSizing), Greg Kopczynski (VMware)
Presentation


15:30 - 16:00 Coffee Break


16:00 - 16:30 A Practice of TPC-DS Multidimensional Implementation in NoSQL Database Systems
Hongwei Zhao (Tsinghua University), Xiaojun YE (Tsinghua University)
Presentation
16:30 - 17:00 PRIMEBALL: Parallel Processing Framework Benchmark, for BigData Applications in the Cloud
Jaume Ferrarons (Universite de Lyon), Mulu Adhana (Universite de Lyon), Carlos Colmenares, (Universite de Lyon) Sandra Pietrowska, Fadila Bentayeb (Universite de Lyon), Jerome Darmont (Universite de Lyon)
Presentation
17:00 - 17:30 CEPBen: A Benchmark for Complex Event Processing Systems
Chunhui Li (Aston University), Robert Berry (Aston University)
Presentation
17:30 - 18:00 Closing Remarks
Meikel Poess (Oracle)



Call For Papers

The TPC has played, and continues to play, a crucial role in providing the computer industry with relevant industry-standard benchmarks. Vendors and endusers rely on TPC benchmarks to provide real-world data that is backed by a stringent and independent review process. Vendors also use TPC benchmarks to demonstrate performance competitiveness for their existing products, and to improve/monitor the performance of products-under-development. Many buyers often use TPC benchmark results as points of comparison when purchasing new computing systems.
The technology landscape is continually evolving and challenging industry experts and researchers to develop innovative techniques to evaluate and benchmark computing systems. The TPC remains committed to developing highly relevant benchmark standards and will continue to develop new benchmarks to keep pace. With this conference, the TPC encourages researchers and industry experts to submit novel ideas and methodologies in performance evaluation, measurement, and characterization.
 

Topics of interest include, but are not limited to:

  • Big Data
  • Appliances
  • Cloud Computing
  • In-memory databases
  • Social media infrastructure
  • Business intelligence
  • Complex event processing
  • Database optimizations
  • Green computing
  • Disaster tolerance and recovery
  • Energy and space efficiency
  • Hardware innovations
  • Data Integration
  • Hybrid workloads
  • Virtualization
  • Lessons learned in practice using TPC workloads
  • Enhancements to TPC workloads

Submission Guidelines

Authors are invited to submit original, unpublished papers that are not currently under review for any other conference or journal. We also encourage the submission of extended abstracts, position statement papers and lessons learned in practice. The length of a paper should not exceed 16 pages. Papers should follow the LNCS format. The title page must contain a short abstract. All papers should be submitted electronically in PDF format to the review web site at: https://cmt.research.microsoft.com/tpctc2013

Important Dates

Abstract due June 8, 2013
Papers due June 15, 2013
Notification of acceptance June 30, 2013
Camera-ready copies July 15, 2013
Workshop session August 26, 2013


Conference Venue and Registration
Please visit the VLDB2013 conference web site at: http://www.vldb.org/2013/

Proceedings
Proceedings will be published by Springer-Verlag as Lecture Notes in Computer Science (LNCS). Selected papers may be considered for future TPC benchmark developments.
LNCS logo


TPCTC 2013 Organization

General Chairs:
Raghunath Nambiar, Cisco, USA, rnambiar@cisco.com
Meikel Poess, Oracle, USA, meikel.poess@oracle.com

Program Committee:
Alain Crolotte, Teradata, USA
Chaitanya Baru, San Diego Supercomputer Center, USA
Daniel Bowers, Ideas International, USA
Marco Vieira, University of Coimbra, Portugal
Masaru Kitsuregawa, University of Tokyo, Japan
Michael Brey, Oracle, USA
Tilmann Rabl, University of Toronto, Canada
Xiaohua Tony Hu, Drexel University, USA
Wen Chen Hu, University of North Dakota, USA
Harumi Kuno, HP Labs, USA

Publicity Committee:
Raghunath Nambiar, Cisco, USA
Andrew Bond, Red Hat, USA
Andrew Masland, NEC, USA
Meikel Poess, Oracle, USA
Reza Taheri, VMware, USA

Michael Majdalany, L&M Management Group, USA
Forrest Carman, Owen Media, USA
Andreas Hotea, Hotea Solutions, USA

Keynote Speaker:
Raghu Ramakrishnan, Microsoft, USA

Invited Speaker:
Karl Huppler, IBM, USA