System Throughput Benchmarks
Getting a true objective measurement of
throughput can be difficult. Published
specifications that measure only part of the test
throughput equation don’t tell a complete story.
In throughput testing, the speed of the interface
sending a command to the target device is very
often the only consideration. But by merely
testing the throughput of one element of a real
test, false conclusions can result: other elements
of the test that are critical to throughput are often
ignored, and opportunities to improve throughput
are often missed.
In the real world of test and measurement, the
time to send a command to a working device, take
a reading, and return it for display or output is a
more complete test for system throughput. So
while the test of the technology with infinitely fast
instruments is addressed in this document (see
Appendix I and II), the real measure of I/O
throughput is the system throughput benchmark.
The test cases described in the following pages
illustrate the throughput benchmark for actual
test measurements.
HP Innovations to FireWire Technology
FireWire transmits "packets" of data in big blocks,
much like a local area network (LAN). Because of
the serial nature of data transmission, first-byte
latency—or the time it takes to transfer the first
byte after the command to initiate is given—is an
issue relevant to throughput. Each data packet
carries this overhead of latency, contributing to
the total throughput elapsed time. If each packet
contains one read/write instruction like the typical
GPIB controller, the overhead results in slow
throughput.
The unique big-block aspects of FireWire
technology allow multiple transactions per packet.
This reduces the impact of first-byte latency:
more data can be carried by a given packet,
leading to decreased packet count. HP engineers
developed additional, higher level protocols, and
optimized bit- and byte-ordering, data
transmission, and error detection and correction
of the bit stream. These modifications
contributed to dramatic improvements in real
throughput of IEEE-1394 for test and
measurement applications.
Part I: Measuring Real Test I/O Throughput
3
Introduction
IEEE-1394 ("FireWire") technology is an open,
scalable, flexible, plug-and-play, low-cost serial
interface that is being widely adopted in digital
consumer products and personal computers.
This high-speed serial bus has prompted many
test departments to determine how FireWire can
be used to connect instruments to computers for
test control. Test environments are discovering
that FireWire is ideally suited to test and
measurement applications, allowing significant
reductions in the cost of test.
By moving data faster with large data block
transfers, test time—and consequently the cost
of test—is reduced. Other cost reductions are
achieved in part because serial data transfer
allows the use of a simplified cable design: the
IEEE-1394 high-speed serial bus uses a thin,
flexible, inexpensive cable to provide a fast, easy
connection between computers and external
peripherals. Another cost reduction comes from
simplification of the electronics: the transmitters
and receivers in the standard chip set handle
addressing, initialization, arbitration and protocols,
keeping the cost of IEEE-1394 technology low.
The HP E8491B is Hewlett-Packard’s
implementation of FireWire technology for test
and measurement applications. This IEEE-1394
PC-Link to the VXI interface ships as a C-size,
1-slot, message-based VXI module. The HP
implementation introduces a variety of advantages
as a Slot 0 control solution in the VXI market:
• It is capable of handling the Resource Manager
and Slot 0 responsibilities.
• It can transfer data blocks greater than
64 kilobytes at 14 megabytes per second,
five times faster than its predecessor.
• It eases configuration with the automatic
recognition feature called "hot-plugging,"
which allows the host system to automatically
recognize an IEEE-1394-based device without
powering down the PC.
• It’s scalable, supporting up to 16 mainframes
using daisy chain or star configurations.
• Its data block transfer capability increases
throughput performance well beyond that of
GPIB at a much lower price than MXI, with
results that match embedded solutions.
In terms of architecture, price and speed, FireWire
and embedded solutions are quickly becoming the
dominant choices in Slot 0 control.