The TPC-W subcommittee continued its development of the
next version of TPC-W. The benchmark is a transactional
web
service benchmark consisting of a commercial application
server and
database interactions displaying ACID properties. The TPC-W subcommittee is in the prototyping phase of the
web services version of the benchmark. The benchmark will
provide for the measurement of the performance and throughput
of a commercially available web/application server that
provides web services to clients. The primary metrics are
SIPS (Service
Interactions Per Second), Price Performance which is $/SIPS,
and the system availability date. An industry standard
database product running on a second server will be used
to provide
data storage and integrity of business information. The
business model addressed by this benchmark is focused on
the business
to business scenario. The SUT will be driven by web service
requests made through the industry standard and vendor
neutral protocols of SOAP and XML. The business logic of
the web
services must be implemented such that it runs in the context
of a managed environment. The benchmark incorporates common
B2B functionality such as distributed transactions and
message queuing utilizing durable queue.
Currently the
benchmark defines the following B2B interactions:
- New
Customer
- Create Order
- Shipping Process
- Stock Management
- Order Status
- New Products List
- Product Detail
- Change Payment Method
- Product Update
The processing requirements
for these operations have been defined. All of
the core implementation requirements
for these interactions have been
reviewed and accepted by the subcommittee. The subcommittee
has
also
defined the majority
of the benchmark requirements
in regards
to the Test Run.
The subcommittee has defined
the requirements for the environment in which the benchmark
is measured. The
environments must
be either compliant with the
Java
Runtime Environment (JRE) 1.3 or greater
as published
by Sun Microsystems,
or ECMA-335
as published by the European
Computer Manufacturers Association.
The subcommittee is
reviewing proposals for additional implementation
requirements such
as adhering
to the WS-I basic profile
for web service interactions and
requiring a standard random number generation
algorithm. The schedule
for submitting
the benchmark for TPC General
Council vote is set for December 2003.
|