Ninth TPC Technology Conference on Performance Evaluation & Benchmarking
(TPCTC 2017)

in conjunction with VLDB 2017



Conference Program

August 28th, 2017


08:30 - 09:00 Opening Remarks, Welcome. Industry Standards for the IoT Era
Raghunath Nambiar
09:00 - 09:30 PEEL: A Framework for Benchmarking Distributed Systems and Algorithms
Christoph Boden, Alexander Alexandrov, Andreas Kunft, Tilmann Rabl and Volker Markl
09:30 - 10:00 Senska - Towards an Enterprise Streaming Benchmark
Guenter Hesse, Benjamin Reissaus, Christoph Matthies, Martin Lorenz, Milena Kraus and Matthias Uflacker


10:00 - 10:30 Coffee Break


10:30 - 11:00 Towards a Scalability and Energy Efficiency Benchmark for VNF
Norbert Schmitt, Jóakim von Kistowski and Samuel Kounev
11:00 - 11:30 Characterizing TPCx-BB Queries, Hive, and Spark in Multi-Cloud Environments
Nicolas Poggi, Alejandro Montero and David Carrera


11:30 - 13:30 Lunch Break


13:30 - 14:10 Keynote: A Strong ARM For Distributed Machine Learning Workloads
Hans-Arno Jacobsen
14:10 - 14:35 Performance Comparison between Hadoop MapReduce 1 (MRv1) and MapReduce 2 (MRv2, YARN)
Manankumar Trivedi and Raghunath Nambiar
14:35 - 15:00 Experiences and Lessons in Practice Using TPCx-BB Benchmarks
Kebing Wang, Zhaojuan Bian, Paul Cao and Mike Riess


15:00 - 15:30 Coffee Break


15:30 - 16:00 JCC-H: adding Join Crossing Correlations with Skew to TPC-H
Peter Boncz, Angelos Christos Anadiotis and Steffen Klaebe
16:00 - 16:25 TPCx-HS v2: Transforming with Technology Changes
Tariq Magdon-Ismail, Chinmayi Narasimhadevara, Dave Jaffe and Raghunath Nambiar
16:25 - 16:50 Performance Assurance Model for Applications on SPARK Platforms
Rekha Singhal and Praveen Singh
16:50 - 17:15 Benchmarking and Performance Analysis for Distributed Cache Systems: A Comparative Case Study
Haytham Salhi, Feras Odeh, Rabee Naser and Adel Taweel
17:15 - 17:40 A Benchmark Survey and Comparison for Distributed Machine Learning Workloads
Sebastian Kmiec, Jonathon Wong, Hans-Arno Jacobsen and Da Qi Ren
17:40 - 18:00 The Road Ahead and Closing Remarks
Meikel Poess



Call For Papers

The Transaction Processing Performance Council (TPC) is a non-profit organization established in August 1988. Over the past two decades, the TPC has had a significant impact on the computing industry’s use of industry-standard benchmarks. Vendors use TPC benchmarks to illustrate performance competitiveness for their existing products, and to improve and monitor the performance of their products under development. Many buyers use TPC benchmark results as points of comparison when purchasing new computing systems. The information technology landscape is evolving at a rapid pace, challenging industry experts and researchers to develop innovative techniques for evaluation, measurement and characterization of complex systems. The TPC remains committed to developing new benchmark standards to keep pace, and one vehicle for achieving this objective is the sponsorship of the Technology Conference on Performance Evaluation and Benchmarking (TPCTC). Over the last six years we have held TPCTC successfully in conjunction with VLDB.


With the ninth TPC Technology Conference on Performance Evaluation and Benchmarking (TPCTC 2017) proposal, we strive to excel the success of previous workshops by encouraging researchers and industry experts to present and debate novel ideas and methodologies in performance evaluation and benchmarking for emerging technology areas. Authors are invited to submit original, unpublished papers that are not currently under review for any other conference or journal. We also encourage the submission of extended abstracts, position statement papers and lessons learned in practice. The accepted papers will be published in the workshop proceedings, and selected papers will be considered for future TPC benchmark developments.
 

Topics of interest include, but are not limited to:

  • Big Data and Analytics
  • Complex event processing
  • Database Optimizations
  • Data Integration
  • Disaster tolerance and recovery
  • Emerging storage technologies (NVMe, 3D XPoint Memory etc)
  • Hybrid workloads
  • Energy and space efficiency
  • In-memory databases
  • Internet of Things
  • Virtualization
  • Enhancements to TPC workloads
  • Lessons learned in practice using TPC workloads
  • Collection and interpretation of performance data in public cloud environments

Submission Guidelines

Authors are invited to submit original, unpublished papers that are not currently under review for any other conference or journal. We also encourage the submission of extended abstracts, position statement papers and lessons learned in practice. The length of a paper should not exceed 16 pages. Papers should follow the LNCS format. The title page must contain a short abstract. All papers should be submitted electronically in PDF format to the review web site at: Easychair

Important Dates

Abstract due: June 15, 2017
Papers due: June 22, 2017
Notification of acceptance: July 6, 2017
Camera-ready copies: July 20, 2017
Conference day: August 28, 2017


Conference Venue and Registration
Please visit the VLDB2017 conference web site at: http://www.vldb.org/2017/

Proceedings
Proceedings will be published by Springer-Verlag as Lecture Notes in Computer Science (LNCS). Selected papers may be considered for future TPC benchmark developments.
LNCS logo



TPCTC 2017 Organization (Tentative)

General Chairs and Contacts
Raghunath Nambiar, Cisco, USA, rnambiar@cisco.com
Meikel Poess, Oracle, USA, meikel.poess@oracle.com

Program Committee (Tentative)
Chaitanya Baru, SDSC, USA
Daniel Bowers, Gartner, USA
Michael Brey, Oracle, USA
Alain Crolotte, Teradata, USA
Paul Cao, HPE, USA
Akon Dey, University of Sydney, Australia
Harumi Kuno, HP Labs, USA
Karthik Kulkarni, Cisco, USA
Dhabaleswar Panda, The Ohio State University, USA
Tilmann Rabl, University of Toronto, Canada
Reza Taheri, VMWare, USA

Publicity Committee
Raghunath Nambiar, Cisco, USA
Andrew Bond, Red Hat, USA
Miso Cilimdzic, Microsoft, USA
Meikel Poess, Oracle, USA
Reza Taheri, VMware, USA

Michael Majdalany, L&M Management Group, USA
Forrest Carman, Owen Media, USA
Andreas Hotea, Hotea Solutions, USA



Keynote and invited talks: ytd



About the TPC
The Transaction Processing Performance Council (TPC) is a non-profit organization that defines transaction processing and database benchmarks and distributes vendor-neutral performance data to the industry. Additional information is available at http://www.tpc.org/.