The TPC-W subcommittee continued its development of the
next version of TPC-W. Version 2 is
a transactional web service benchmark consisting of
database interactions displaying ACID properties running
against a commercial
application server. The primary metrics
are SIPS (Service Interactions Per Second), Price Performance
which is $/SIPS, and the system availability date.
The
processing requirements, database schema and population,
test run requirements,
and reporting requirements for the
web service interactions have been defined. The TPC-W
subcommittee is in the prototyping phase of the web services
version
of the benchmark. All of the implementation details have
been reviewed and accepted by the subcommittee. The ACID
tests have been developed and approved. These tests demonstrate
ACID compliance not only for the database system, but
for the distributed transactions and message queues as
well.
The subcommittee has also defined the benchmark pricing
rules.
The requirements for the environment in which the
benchmark is measured have been defined. The environments
must
be either compliant with the Java Runtime Environment
(JRE)
1.3 or greater as published by Sun Microsystems, or
ECMA-335 as published by the European Computer Manufacturers
Association -- the ECMA-335 standard defines the Common
Language Infrastructure (CLI) in which applications written
in multiple
high level languages may be executed in different system
environments without the need to rewrite the application
to take into consideration the unique characteristics of
those environments. Requirements for random number generators
and seeding methods have been defined.
The subcommittee will be
reviewing prototype data to adjust the benchmark profile
through October 2003.
The subcommittee
is adopting additional requirements such as adhering
to the WS-I basic profile (BP1.0) for web service
interoperability.
|