Integrated Device Technology, Inc. reserves the right to make changes to its products or specifications at any time, without notice, in order to improve design or performance
and to supply the best possible product. IDT does not assume any responsibility for use of any circuitry described other than the circuitry embodied in an IDT product. The
Company makes no representations that circuitry described herein is free from patent infringement or other rights of third parties which may result from its use. No license is
granted by implication or otherwise under any patent, patent rights or other rights, of Integrated Device Technology, Inc.
DISCLAIMER
Boards that fail to function should be returned to IDT for replacement. Credit will not be given for the failed boards nor will a
Failure Analysis be performed.
Integrated Device Technology's products are not authorized for use as critical components in life support devices or systems unless a specific written agreement pertaining to
such intended use is executed between the manufacturer and an officer of IDT.
1. Life support devices or systems are devices or systems which (a) are intended for surgical implant into the body or (b) support or sustain life and whose failure to perform,
when properly used in accordance with instructions for use provided in the labeling, can be reasonably expected to result in a significant injury to the user.
2. A critical component is any components of a life support device or system whose failure to perform can be reasonably expected to cause the failure of the life support device
or system, or to affect its safety or effectiveness.
IDT, the IDT logo, and Integrated Device Technology are trademarks or registered trademarks of Integrated Device Technology, Inc.
In this manual, references to the PES8T5A also apply to the PES6T5 and PES5T5 unless otherwise
indicated.
The 89HPES8T5A switch (also referred to as PES8T5A in this manual) is a member of IDT’s PCI
Express® standard (PCIe®) based line of products. It is an 8-lane, 5-port switch. One upstream port is
provided for connecting to the root complex (RC), and up to four downstream ports are available for
connecting to PCIe endpoints or to another switch. More information on this device can be found in the
appropriate User Manual (89HPES8T5A, 89HPES6T5, or 89HPES5T5).
The 89EBPES8T5A Evaluation Board (also referred to as EB8T5A in this manual) provides an evaluation platform for the PES8T5A switch. It is also a cost effective way to add a PCIe downstream port (x1) to
an existing system with a limited number of PCIe downstream ports. The EB8T5A eval board is designed to
function as an add-on card to be plugged into a x4 PCIe slot available on a motherboard hosting an appropriate root complex, microprocessor(s), and four downstream ports. The EB8T5A is a vehicle to test and
evaluate the functionality of the PES8T5A chip. Customers can use this board to get a headstart on software development prior to the arrival of their own hardware. The EB8T5A is also used by IDT to reproduce
system-level hardware or software issues reported by customers. Figure 1.1 illustrates the functional block
diagram representing the main parts of the EB8T5A board.
JTAG
Header
SSC Clock
Buffer
25 MHz
Clock
Fanout
Main
Reset
x1
I/O Expander
PCA9555
EEPROM
24LC512
SMBus
SMBUS
HEADER
Figure 1.1 Function Block Diagram of the EB8T5A Eval Board
EB8T5A Eval Board Manual 1 - 1July 23, 2009
PCI Express
Switch
PES8T5A
x4 (PES8T5A)
x2 (PES6T5)
x1 (PES5T5)
PCIe x4 Upstream Edge
x1
x1
x1
Power
Module
PTH08T240
PCIe x1 Downstream Slot
PCIe x1 Downstream Slot
PCIe x1 Downstream Slot
PCIe x1 Downstream Slot
External Power
Connector
Voltages on board
+12V, +3.3V, +1.5V, +1.0V
IDT Description of the EB8T5A Eval Board
Notes
Board Features
Hardware
PCIe 5 port switch
– PES8T5A — Five ports (one x4 port and four x1 ports), 8 PCIe lanes
– PES6T5 — Five ports (one x2 port and four x1 ports), 6 PCIe lanes
– PES5T5 — Five ports (five x1 ports), 5 PCIe lanes
– PCIe Base Specification Revision 1.1 compliant
– Integrates eight 2.5 Gbps embedded SerDes
– Up to 256 byte maximum Payload Size
– Automatic lane reversal and polarity inversion supported on all lanes
– Automatic per port link width negotiation to x4, x2, x1
– Load configuration from an optional serial EEPROM via SMBUS
Upstream, Downstream Port
– One edge connector on the upstream port, to be plugged into a slot with at least x4 capable
mechanical slot connector on a host motherboard
– Four slot connectors on the downstream ports, for PCIe endpoint add-on cards to be plugged in.
Numerous user selectable configurations set using onboard jumpers and DIP-switches
– Source of clock - host clock or onboard clock generator
– Two clock rates and spread spectrum settings
– Boot mode selection
Vaux Support
SMBUS Slave Interface (4 pin header)
SMBUS Master Interface connected to the Serial EEPROMs through I/O expander
“Attention” button for each downstream port to initiate a hot swap event on each port
Four pin connector for optional external power supply
Push button for Warm Reset
Several LEDs to display status, reset, power, “Attention”, etc.
One 14-pin JTAG header
Software
There is no software or firmware executed on the board. However, useful software is provided along
with the Evaluation Board to facilitate configuration and evaluation of the PES8T5A within host systems
running popular operating systems.
Installation programs
– Operating Systems Supported: Windows2000, WindowsXP, Linux
GUI based application for Windows and Linux
– Allows users to view and modify registers in the PES8T5A
– Binary file generator for programming the serial EEPROMs attached to the SMBUS.
Other
A metal bracket is required to firmly hold in place the four endpoints plugged into the EB8T5A
board.
An external power supply may be required under some conditions.
SMBUS cable may be required for certain evaluation exercises.
SMA connectors are provided on the EB8T5A board for specific test points.
EB8T5A Eval Board Manual1 - 2July 23, 2009
IDT Description of the EB8T5A Eval Board
Notes
Revision History
September 10, 2007: Initial publication of board manual.
July 23, 2009: Added PES6T5 and PES5T5 devices to eval board manual. Updated Power Sources
section, Table 2.15, and Schematics. Added Note after Table 2.17.
EB8T5A Eval Board Manual1 - 3July 23, 2009
IDT Description of the EB8T5A Eval Board
Notes
EB8T5A Eval Board Manual1 - 4July 23, 2009
Chapter 2
Installation of the EB8T5A
Eval Board
®
Notes
EB8T5A Installation
This chapter discusses the steps required to configure and install the EB8T5A evaluation board. All
available DIP switches and jumper configurations are explained in detail.
The primary installation steps are:
1. Configure jumper/switch options suitable for the evaluation or application requirements.
2. Connect PCI Express endpoint cards to the downstream port PCIe slots on the evaluation board.
3. Insert the evaluation board into the host system (motherboard with root complex chipset).
4. Apply power to the host system.
The EB8T5A board is shipped with all jumpers and switches configured to their default settings. In most
cases, the board does not require further modification or setup.
Hardware Description
The PES8T5 is an 8-lane, 5-port PCI Express® switch. It is a peripheral chip that performs PCI Express
based switching with a feature set optimized for high performance applications such as servers and
storage. It provides fan-out and switching functions between a PCI Express upstream port and 4 downstream ports or peer-to-peer switching between downstream ports.
The EB8T5A has four PCI Express downstream ports, accessible through four x4 open-ended connectors.
Basic requirements for the board to run are:
– Host system with a PCI Express root complex supporting x4 configuration through a PCI Express
– PCI Express Endpoint Cards capable of training x1 link.
x4 slot.
Host System
The evaluation board cannot be operated as a standalone unit. A host system implementing a PCI
Express root complex supporting x4 configuration through a PCI Express x4 slot is required to take full
advantage of the PES8T5’s capabilities.
Reference Clocks
The PES8T5A requires a differential reference clock. The EB8T5A derives this clock from a common
source which is user-selectable. The common source can be either the host system’s reference clock or the
onboard clock generator. Selection is made by resistor switch described in Table 2.1.
Clock Configuration Switch - S3[3]
S3[3]Clock Source
ONOnboard Reference Clock – Use onboard clock generator
OFFUpstream Reference Clock – Host system provides clock (Default)
Table 2.1 Clock Source Selection
EB8T5A Eval Board Manual 2 - 1July 23, 2009
IDT Installation of the EB8T5A Eval Board
Notes
The source for the onboard clock is the ICS9FG104 clock generator device (U8) connected to a 25MHz
oscillator (Y1). When using the onboard clock generator, the EB8T5A allows selection between multiple
clock rates and spread spectrum settings via DIP switches as described in Tables 2.2 and 2.3 respectively.
Spread Spectrum technology reduces peak EMI emissions by modulating the frequency to spread the peak
energy over a wider bandwidth.
Clock Frequency Switch - S3[1]
S3[1]Clock Frequency
OFF125MHz
ON100MHz (Default)
Table 2.2 Clock Frequency Selection
Clock Spread Spectrum Switch - S3[2]
S3[2]Spread Spectrum
OFFEnable Spread Spectrum
ONDisable Spread Spectrum (Default)
Table 2.3 Spread Spectrum Clock Selection
If the Clock Spread Spectrum is used to modulate data rate, then both ports must use same modulated
clock source. Therefore, if your system uses SSC, the on-board clock generator must be disabled and the
upstream reference clock should be used instead.
The output of the onboard clock generator is accessible through two SMA connectors located on the
Evaluation Board. See Table 2.4. This can be used to connect a scope for probing or capturing purposes
and cannot be used to drive the clock from an external source.
Table 2.4 SMA Connectors - Onboard Reference Clock
Figure 2.1 illustrates the clock distribution block diagram for the EB8T5A evaluation board.
EB8T5A Eval Board Manual2 - 2July 23, 2009
IDT Installation of the EB8T5A Eval Board
Notes
Upstream PEREFCLK
25MHz
ISC9FG104
Power Sources
Power for the EB8T5A is generated from the 12.0V PCI Express upstream slot power or optionally from
3.3Vaux. A 12.0V to 3.3V DC-DC converter will be used to provide power to four DC-DC converters to
generate VDDcore, VDDpe, VDDpea, and VTT voltages. The 3.3V from the 12.0V converter is used to
power VDDio. When in power down mode the DC-DC converters is powered directly from 3.3Vaux through
a MOSFET switch.
If add-in cards require more power than the upstream slot can support, an external source is required to
supply this extra power via an auxiliary 4-pin power connector on the board. Header W1, W5, and W11 (see
Table 2.15) are used to select the proper power source for the switch and all downstream ports.
PEREFCLK0
ICS557-06
Figure 2.1 Clock Distribution Block Diagram
SMA - J18,J19
ICS9DB803D
Port2
Port3
Port4
Port5
External Power Source
If necessary, external power is supplied to the EB8T5A board through a 4-pin auxiliary power connector
attached to J4. The external power supply provides +12V to the EB8T5A as described in Table 2.5. The
+5V is unused.
PinSignal
1+12V
2GND
3GND
4+5V
Table 2.5 External Power Connector - J4
EB8T5A Eval Board Manual2 - 3July 23, 2009
IDT Installation of the EB8T5A Eval Board
Notes
Figure 2.2 Power Distribution Block Diagram
Vaux Support
Power supply support will be provided to EB8T5A from 12.0V upstream power to 3.3Vaux upstream
power when in sleep mode. The WAKE# signal direction, both an input and output will be supported by
jumper selection. The APWRDIS# signal for auxiliary power disable requires the following timing on powerup.
EB8T5A Eval Board Manual2 - 4July 23, 2009
IDT Installation of the EB8T5A Eval Board
Notes
Figure 2.3 APWRDIS# Timing
On initial power up APWRDIS# must be held low initially for 8 clocks after PERST# is removed. Then it
must be sampled high 256 clocks after PERSTN# is removed to enable L2 mode. Subsequent PERST# will
not affect the APWRDIS# state. This timing will be provided by the following circuit.
Figure 2.4 APWRDIS# Timing Circuit
EB8T5A Eval Board Manual2 - 5July 23, 2009
IDT Installation of the EB8T5A Eval Board
Notes
PCI Express Serial Data Transmit Termination Voltage Converter
A DC-DC converter (U6) provides a 1.5V PCI Express serial data transmit termination voltage (shown
as VTTPE or VPETVTT) to the PES8T5A.
PCI Express Digital Power Voltage Converter
A separate DC-DC converter (U16) provides a 1.0V PCI Express digital power voltage (VDDPE) to the
PES8T5A.
PCI Express Analog Power Voltage Converter
A separate DC-DC converter (U7) provides a 1.0V PCI Express analog power voltage (shown as
VDDAPE or VDDPEA) to the PES8T5A.
Core Logic Voltage Converter
A separate DC-DC converter (U1) provides the 1.0V core voltage (VDDCORE) to the PES8T5A.
3.3V I/O Power Module
A 12V to 3.3V power module (U5) provides the 3.3V I/O voltage (VDDIO) to the PES8T5A.
Power-up Sequence
The power-up sequence must be as following:
1. VDDIO - 3.3V
2. VDDCORE, VDDAPE, VDDPE - 1.0V
3. VTTPE - 1.5V
When powering up, each voltage level must ramp up and stabilize prior to applying the next voltage in
the sequence to ensure internal latch-up issues are avoided. There are no maximum time limitations
between sequential valid power level requirements. To insure that the sequencing requirements are met, a
0.047µF is used at the SOFTSTART cap on the VTTPE’s voltage converter (U6 pin 36) in the EB8T5A.
Required Jumpers
To deliver power to the PES8T5A switch, the following jumpers must be shunted: W4, W10, W23, W24,
and W25. These jumpers were implemented so that the power consumption of the PES8T5A can be
measured.
Reset
The PES8T5A supports two types of reset mechanisms as described in the PCI Express specification:
– Fundamental Reset: This is a system-generated reset that propagates along the PCI Express
tree through a single side-band signal PERST# which is connected to the Root Complex, the
PES8T5A, and the endpoints.
– Hot Reset: This is an In-band Reset, communicated downstream via a link from one device to
another. Hot Reset may be initiated by software. This is further discussed in the 89HPES8T5A
User Manual. The EB8T5A evaluation board provides seamless support for Hot Reset.
Fundamental Reset
There are two types of Fundamental Resets which may occur on the EB8T5A evaluation board:
– Cold Reset: During initial power-on, the onboard voltage monitor (TLC7733D) will assert the PCI
Express Reset (PERSTN) input pin of the PES8T5A.
– Warm Reset: This is triggered by hardware while the device is powered on. Warm Reset can be
initiated by two methods:
• Pressing a push-button switch (S1) located on EB8T5A board
EB8T5A Eval Board Manual2 - 6July 23, 2009
IDT Installation of the EB8T5A Eval Board
Notes
• The host system board IO Controller Hub asserting PERST# signal, which propagates through
the PCIe upstream edge connector of the EB8T5A. Note that one can bypass the onboard
voltage monitor (TLC7733D) by moving the shunt from pin 1-2 to pin 2-3 (default) on W2.
Both events cause the onboard voltage monitor (TLC7733D) to assert the PCI Express Reset
(PERSTN) input of the PES8T5A while power is on.
Downstream Reset
The PES8T5A provides a a choice of either a software-controlled reset for each downstream port
through GPIO pins or a fundamental reset through PERST#. Selection is made by jumpers described in
Table 2.6.
Port # JumperSelection
5W8[1-2] Software controlled reset through GPIO10
[2-3] Fundamental reset PERST# (default)
4W9[1-2] Software controlled reset through GPIO1
[2-3] Fundamental reset PERST# (default)
3W6[1-2] Software controlled reset through GPIO9
[2-3] Fundamental reset PERST# (default)
2W7[1-2] Software controlled reset through GPIO0
[2-3] Fundamental reset PERST# (default)
Table 2.6 Downstream Reset Selection
Boot Configuration Vector
A boot configuration vector consisting of the signals listed in Table 2.7 is sampled by the PES8T5A
during a fundamental reset (while PERSTN is active). The boot configuration vector defines the essential
parameters for switch operation and is set using DIP switches S3, S4, and S5 as defined in Table 2.8.
SignalDescription
CCLKDSCommon Clock Downstream. When the CCLKDS pin is asserted, it indicates that a com-
mon clock is being used between the downstream device and the downstream port.
Default: 0x1
CCLKUSCommon Clock Upstream. When the CCLKUS pin is asserted, it indicates that a common
clock is being used between the upstream device and the upstream port. Default: 0x1
MSMBSMODEMaster SMBus Slow Mode. The assertion of this pin indicates that the master SMBus
should operate at 100 KHz instead of 400 kHz. Default: 0x0
RSTHALTReset Halt. When this signal is asserted during a PCI Express fundamental reset, the
PES8T5A executes the reset procedure and remains in a reset state with the Master and
Slave SMBuses active. This allows software to read and write registers internal to the
device before normal device operation begins. The device exits the reset state when the
RSTHALT bit is cleared in the P0_SWCTL register through the SMBus.
The value may be overridden by modifying the RSTHALT bit in the P0_SWCTL register.
Default: 0x0
Table 2.7 Boot Configuration Vector Signals (Part 1 of 2)
EB8T5A Eval Board Manual2 - 7July 23, 2009
IDT Installation of the EB8T5A Eval Board
Notes
SignalDescription
SWMODE[2:0]Switch Mode. These configuration pins determine the PES8T5A switch operating mode.
Default: 0x0
0x0 - Normal switch mode
0x1 - Normal switch mode with Serial EEPROM-based initialization
0x2 through 0x8 - Reserved
REFCLKMPCI Express Reference Clock Mode Select. This signal selects the frequency of the ref-
The System Management Bus (SMBus) is a two-wire interface through which various system compo-
2
nent chips can communicate. It is based on the principles of operation of I
signals in the PCI Express connector is optional and may not be present on the host system. The SMBus
interface consist of an SMBus clock pin, an SMBus data pin, and 4 SMBus address pins.
The PES8T5A contains two SMBus interfaces: a slave SMBus interface and a master SMBus interface.
The slave SMBus interface allows a SMBus Master device (such as the Intel E7520) full access to all software-visible registers. The Master SMBus interface provides connection to the external serial EEPROMs
used for initialization and the I/O expander used for hot-plug signals.
C. Implementation of the SMBus
SMBus Slave Interface
On the PES8T5A board, the slave SMBus interface is accessible through the PCI Express edge
connector as well as a 4-pin header as described in Table 2.9.
EB8T5A Eval Board Manual2 - 8July 23, 2009
IDT Installation of the EB8T5A Eval Board
Notes
.
Slave SMBus Interface Connector
J21
PinSignal
1N/C
2SCL
3GND
4SDA
Table 2.9 Slave SMBus Interface Connector
A fixed slave SMBus address specified by the SSMBADDR[5,3:1] pins is used.
For a fixed address, the SMBus address of the PES8T5A slave interface is 0b1110111 by default and is
configurable using DIP switch S4 as described in Tables 2.10 and 2.11.
The slave SMBus interface responds to the following SMBus transactions initiated by an SMBus master.
Initiation of any SMBus transaction other than those listed above produces undefined results. See the
SMBus 2.0 specification for a detailed description of the following transactions:
– Byte and Word Write/Read
– Block Write/Read
SMBus Master Interface
Connected to the master SMBus interface are four 16-bit I/O Expanders (PCA9555) and a serial
EEPROM (24LC512). Four I/O Expanders are used as the interface for the onboard hot-plug controllers
(MIC2591B).
The bus address for the selected EEPROM device is
0b1010000 by default and the lower four bits is
configurable using switch S4 as described in Table 2.12.
S4[8]S4[7]S4[6]S4[5]Bus Address
OFFOFFOFFOFF0b1111
OFFOFFOFFON0b1110
OFFOFFONOFF0b1101
OFFOFFONON01100
OFFONOFFOFF0b1011
OFFONOFFON0b1010
OFFONONOFF0b1001
OFFONONON0b1000
ONONONON0b0000 (Default)
Table 2.12 EEPROM SMBus Address Setting
JTAG Header
The PES8T5A provides a JTAG connector J4 for access to the PES8T5A JTAG interface. The
connector is a 2.54 x 2.54 mm pitch male 10-pin connector. Refer to Table 2.12 for the JTAG Connector J2
pin out.
EB8T5A Eval Board Manual2 - 10July 23, 2009
IDT Installation of the EB8T5A Eval Board
Notes
PinSignalDirectionPinSignalDirection
1/TRST - Test resetInput2GND—
3TDI - Test dataInput4GND—
5TDO - Test dataOutput6GND—
7TMS - Test mode selectInput8GND—
9TCK - Test clockInput10GND—
Attention Buttons
The PES8T5A features four attention buttons, shown in Table 2.13. Each button corresponds to a particular port and is used to initiate hot-swapping events.
17PRSNT2#Hot-Plug presence detectPERn0pair, Lane 0
18GNDGroundGNDGround
Table 2.18 PCI Express x1 Connector Pinout
+3.3V3.3V power
PERST#Fundamental Reset
Note: These x4 and x1 PCI Express connectors comply with the PCIe specification. The
EB8T5A uses x1 (mechanically x4) connector on all downstream ports. According to the PCI
Express specification, the PRSNT1# pin should be wired to the farthest available PRSNT2# pin
on the connector. In the EB8T5A, all PRSNT2# pins are tied together. This allows the board to be
installed in a x1 or a x4 slot. The open-ended x4 slot allows the insertion of physical lane width
greater than x4 to be installed without the need of slot reducer.
EB8T5A Eval Board Manual2 - 15July 23, 2009
IDT Installation of the EB8T5A Eval Board
EB8T5A Board Figure
EB8T5A Eval Board Manual2 - 16July 23, 2009
Chapter 3
Software for the EB8T5A Eval Board
®
Notes
Introduction
This chapter discusses some of the main features of the available software to give users a better understanding of what can be achieved with the EB8T5A evaluation board using the device management software.
Device management software and related user documentation are available on a CD which is included
in the Evaluation Board Kit. This information is also available on IDT’s FTP site. For more information,
contact IDT at ssdhelp@idt.com.
Device Management Software
The primary use of the Device Management Software package is to enable users of the evaluation
board to access all the registers in the PES8T5 device. This access can be achieved using the PCI Express
in-band configuration cycles through the upstream port on the PES8T5.
This software also enables users to save a snapshot of the current register set into a dump file which
can be used for debugging purposes. An export/import facility is also available to create and use “Configuration” files which can be used to initialize the switch device with specific values in specific registers.
A conversion utility is also provided to translate a configuration file into an EEPROM programmable data
structure. This enables the user to program an appropriate serial EEPROM with desirable register settings
for the PES8T5, and then to populate that EEPROM onto the Evaluation Board. It is also possible to
program the EEPROM directly on the Evaluation Board using a feature provided by the software package.
The front end of the Device Management Software is a user-friendly Graphical User Interface which
allows the user to quickly read or write the registers of interest. The GUI also permits the user to run the
software in “simulation” mode with no real hardware attached, allowing the creation of configuration files for
the PES8T5 in the absence of the actual device.
Much of the Device Management Software is written with device-independent and OS-independent
code. The software will be guaranteed to work on Linux (/sys interface) and MS Windows XP. It may function flawlessly on various flavors of MS Windows, but may not be validated on all. The fact that the software
is device-independent assures its scalability to future PCIe parts from IDT. Once users are familiar with the
GUI, they will be able to use the same GUI on all PCIe parts from IDT. This software is customized for each
device through an XML device description file which includes information on the number of ports, registers,
types of registers, information on bit-fields within each register, etc.