Issue 1March 1998Creation of Document
Issue 2October 1998This data sheet includes: regi sters added in B
version of devi ce:
RX_QUEUE_ENGINE_TEST - bits 26:16
TX_QUEUE_ENGINE_TEST - bits 22:15
QUEUE_ENGINE_CONDITION_PRES_BIT
S
QUEUE_ENGINE_CONDITION_LATCH_B
ITS
QUEUE_ENGINE_INT_MASK
RX_LOWER16_SCG_CONFIG
RX_LOWER16_SCG_STATE
RX_LOWER32_SCG_CONFIG
RX_LOWER32_SCG_STATE
RX_LOWER48_SCG_CONFIG
RX_LOWER48_SCG_STATE
TX_LOWER4_SCG_CONFIG
TX_LOWER4_SCG_STATE
TX_LOWER8_SCG_CONFIG
TX_LOWER8_SCG_STATE
TX_LOWER12_SCG_CONFIG
TX_LOWER12_SCG_STATE
Updated RX_SERV IC E_ T AB LE
The PM73487 622 Mbps ATM Traffic Management Device (QRT) is an advanced communications device capable of supporting very large, high-performance ATM switching systems. The
rich feature set of the QRT enables systems to offer many sophisticated network services. The
QRT provides 622 Mbps UTOPIA (Level 1 or Level 2) access to switch fabrics composed of
PM73488 5 Gbps ATM Switch Fabric Elements (QSEs). Together, these device s can be used to
build architectures with capacities from 622 Mbps to 160 Gbps. The QRT can also act as a standalone 622 Mbps switch.
The QRT/QSE architecture virtually eliminates hea d-of-line blocking by m eans of the QRT’s perVirtual Channel (VC) receive queues and congestion feedback from the QSE switch fabric. The
distributed architecture acts as an output-buffered switch by incorporating Evil Twin Switching
(a congestion-reducing routing algorithm in the switch fabric) and a speed-up factor in the switch
fabric (running the fabric faster than the line rate).
The QRT uses per-VC receive queues, 64 receive Service Classes (SCs), and 16 transmit SCs per
each of the 31 Virtual Outputs (VOs) to enable flexible multi-priority scheduling algorithms. The
scheduler can be used to ensure Quality-of-Service (QoS) guarantees for Constant Bit Rate
(CBR), Variable Bit Rate (VBR), and Unspecified Bit Rate (UBR) VCs. The QRT also provides
five separate congestion thresholds, each with hysteresis, that selectively control AAL5 Early
Packet Discard (EPD) and/or Cell Loss Priority (CLP)-based cell dropping for UBR support.
Additional highlights of the QRT include full Virtual Path Indicator (VPI)/Virtual Channel Indicator (VCI) header translation, separate input and output ce ll buffers (up to 64K each), Virtual
Path (VP)/VC switching, and support for up to 16K VCs on both the receive and transmit sides.
PMC-Sierra also offers the QRT Device Control Package, which is a software package that harnesses the QRT’s rich feature set and shortens system development times.
FEATURES
QUEUING ALGO R ITHMS
Receive
•Maintains 64 weighted, bandwidth-controlled SCs with per-VC queues.
•Provides round-robin servicing of queues within each SC.
•Provides per-channel (VP or VC), per-SC, and per-direction congested and maximum
queue depth limits.
•Provides up to 64K cell buffers.
Transmit
•Provides 31 VOs.
•Maintains 16 SCs for each VO with per-VC accounting.
•Supports three congestion limits (as well as EPD, CLP, and EFCI, and/or backpressure)
for logical multicast on the transmit side.
SWITCHING
•Supports VC and VP switching.
•Supports up to 16K VCs.
ADDRESS MAPPING
•Supports all 12 VP and 16 VC bits through use of a double, indirect lookup table.
•Performs header translation at both the input (receive) and output (transmit) directions.
Input header translation is used to pass the output queue channel number through the
switch.
MULTICAST
•Supports logical multicast with a superior queue-clearing algorithm.
DIAGNOSTIC/ROBUSTNESS FEATURES
•Checks the header parity.
•Counts tagged cells.
•Runs error checks continually on all fabric lines.
•Checks liveness of control signal lines at both switch fabric and UTOPIA interfaces,
working around partial fabric failures.
•Checks Static Random Access Memory (SRAM) and Dynamic Random Access Memory
(DRAM) parity.
STATISTICS FEATURES
•In the receive direction, counts cells transmitted and dropped.
•In the transmit direction, counts cells transmitted and dropped on a per-VC basis.
I/O FEATURES
•Provides four switch element interfaces with phase aligners. The phase aligners allow for
external serialization of the data stream enabling systems to be built that support device
separation of up to 10 meters.
The QRT, together with the QSE, support a wide range of high-performance ATM switching systems. These systems range in size from 622 Mbps to 160 Gbps. The systems can be developed
such that this scalability is provided with linear cost. Another key feature of the QRT/QSE architecture is that it is exceptionally fault-tolerant, both in the switch fabric and the UTOPIA interface.
This section contains a quick overview of the QRT and several example applications:
•a stand-alone 622 Mbps switch using a single QRT,
•a 5 Gbps switch using QRTs and a QSE,
•a 10 Gbps switch using QRTs and QSEs,
•a switch architecture using QRTs and QSEs that scales from 5 Gbps to 20 Gbps,
•a switch architecture using QRTs and QSEs that scales from 5Gbps to 160 Gbps
1.1QRT System Overview
The QRT provides 622 Mbps of input and output buffered a ccess to switch fabrics composed of
QSEs (32 x 32 PM73488s). In addition, the QRT supports a stand-alone, purely output-buffered
622 Mbps switch mode. Head-of-line blocking, commonly associated with input buffers, is virtually eliminated via per-VC receive queues, three types of per-cell switch fabric feedback, and perVC cell selection algorithms. The QRT also provides eight separate congestion thresholds, each
with hysteresis, that selectively control AAL5 Early Packet Discard (EPD)/Packet Tail Discard
(PTD), CLP-based cell dropping, and/or EFCI marking. Eight separate maximum thresholds are
also supported. Additional highlights of the QRT include full VPI/VCI header translation, separate input and output cell buffers (up to 64K each), Virtual Path Connection (VPC)/Virtual Channel Connection (VCC) connections, and up to 16K VCs. The QRT provides a bidirectional
connection between a UTOPIA Level 2 interface and 4-nibble wide, 66 MHz switch fabric interfaces, as shown in Figure 2 on page 5. A significant switch speed-up factor, up to 1.6 times the
line rate, is used to support full throughput for many switch fabric configurations.
The QRT can be used in a stand-alone application that supports ATM switching up to 622 Mbps,
as shown in Figure 3. The four switch fabric interfaces are looped back to the QRT, allowing the
UTOPIA interface to be fully used. In this application, the QRT operates as an output buffered
switch..
Figure 4 shows a basic 32 × 32 switch application (5 Gbps) using eight QRTs and one QSE.
622 Mbps
Aggregate
Receive UTOPIA
Level 2
622 Mbps
Aggregate
QRT #1
(PM73487)
Receive Input
QRT #8
(PM73487)
Receive Input
QRT #1
(PM73487)
×
4
QSE
4
×
(PM73488)
4
Transmit Output
×
×
4
QRT #8
(PM73487)
Transmit Output
622 Mbps
Aggregate
Transmit UTOPIA
Level 2
622 Mbps
Aggregate
Figure 4. 32 x 32 Swit ch App lic atio n (5 Gbps )
1.464 x 64 Switch Application (10 Gbps)
Figure 5 shows a 64 × 64 switch application (10 Gbps) using 16 QRTs and 6 QSEs. This applica-
tion uses QSEs in a 3-stage fabric. This sized system can be implemented in a single 19-inch rack.
1.55 Gbps to 20 Gbps Application Example - Seamless Growth
This section illustrates the modularity of the QRT (PM73487) and QSE (PM73488) architecture.
A 5 Gbps system can immediately be created (as shown in Figure 6 on page 7), and then be
upgraded to 10 Gbps (as shown in Figure 7 on page 7), or 20 Gbps (as shown in Figure 8 on page
8). Since all these systems are based on a single-stage switch fabric, the per-port cost for each sys-
tem will remain the same.
Eight
155 Mbps
Interfaces
Eight
155 Mbps
Interfaces
Eight
155 Mbps
Interfaces
Eight
155 Mbps
Interfaces
• Two QRTs (PM73487s)
• Two QRTs (PM73487s)
• Two QRTs (PM73487s)
• Two QRTs (PM73487s)
Port Card
Port Card
Switch Card
• One QSE (PM73488)
Port Card
Port Card
Figure 6. 5 Gbps ATM Switch Using 16 Dual S/UN Is, 8 QR Ts, and 1 QSE
Eight
155 Mbps
Interfaces
• Two QRTs (PM73487s)
Port Card 1
•
Switch Card
• One QSE (PM73488)
•
•
Eight
155 Mbps
Interfaces
• Two QRTs (PM73487s)
Figure 7. 10 Gbps ATM Switch Using 32 Dual S /UNIs , 16 QRTs, an d 2 QSEs
1.65 Gbps to 160 Gbps Application Example – LAN-to-WAN
A powerful application of the QRT and the QSE devices is the creation of modules that can be
used in a range of switches with only the interconnection changing between different sizes. ATM
switches from 5 Gbps to 160 Gbps can be realized with only two unique cards. A port card has
one QRT, and a switch card has two QSEs. The switch fabric consists of three stages, each with
32 QSEs (or 16 switch cards). To plan for future scalability, the middle stage must be built-in
upfront. This is a one-time cost. Then, in order to scale in 5 Gbps increments, one switch card and
its accompanying eight port cards should be added. Finer bandwidth scaling is possible by populating the additional switch card with port cards as needed (in increments of 622 Mbps). With this
switch fabric topology, scaling is possible up to 160 Gbps. Once the initial middle stage cost has
been incurred, the per-port cost for 5 Gbps through 160 Gbps systems remains almost constant
Port Card - One QRT
One UTOPIA
Level 2 Interface
QRT
(PM73487
Figure 9. 5 Gbps to 160 Gbp s Swi tches Mod eled Using On ly Two Cards
Figure 10 shows a 5 Gbps ATM switch using 8 port cards (8 QRTs) and 17 switch cards (34
QSEs). The middle stage is composed of 16 switch cards. The 5 Gbps bandwith is achieved by
adding switch card #17 (which is depicted using two boxes: one stage 1 Q SE and one stage 3
QSE), and eight port cards (each of which is depicted using two boxes: one for the Rx input side,
and one for the Tx output side). Lines between stage 1 and stage 2, and stage 2 and stage 3 switch
cards represent two sets of wires, one to each of the QSEs in the middle stage switch cards.
.Figure 11 shows a 10 Gbps ATM switch using 16 port cards (16 QRTs) and 18 switch cards (36
QSEs). Here, another switch card and eight port cards have been added to the 5 Gbps switch
depicted in Figure 10.
Figure 12 shows a 15 Gbps ATM switch using 24 port cards (24 QRTs) and 19 switch cards (38
QSEs).Here, once again, another switch card and eight port cards have been added
Figure 13 shows a 20 Gbps ATM switch composed of 32 port cards (32 QRTs) and 20 switch
cards (40 QSEs). By adding additional sets of a switch card and eight port cards in the same manner, this system can scale up to 160 Gbps. .
The QRT is a 622 Mbps, full duplex, intelligent routing table which, when used with a switch fabric composed of either SE or QSE devices, can implement ATM switches from 622 Mbps to 160
Gbps. The QRT supports a 16-bit UTOPIA Level 2 interface for ease of connection to PHY or
AAL layer devices. Four nibble-wide data interfaces connect the QRT to the switch interface.
External DRAM memory devices provide receive and transmit cell buffering, and external SRAM
devices provide control data for the QRT. This section explains the algorithms for the data flow.
Figure 14 shows an overview of the QRT system.
Receive Cell
SDRAM
Receive UTOPIA
Level 2 Interface
Transmit UTOPIA
Level 2 Interface
Control SSRAM
QRT
(PM73487)
Transmit Cell
SDRAM
Figure 14. QRT Sys tem Overview
To QSE
Host Interface
From QSE
2.2Interface Descriptions
2.2.1Switch Fabric Interface
The QRT switch fabric interface consists of four groups of signals from both the ingress (receive
side) and the egress (transmit side). Each group consists of a Start-Of-Cell (SE_SOC_OUT) signal, a nibble-wide data bus, and a backpressure acknowledgment (BP_ACK_IN) signal. The
Start-Of-Cell (SE_SOC_OUT) signal is transmitted at the ingress at the same time as the beginning of a cell. SE_SOC_OUT on the ingress is common to all four groups. The BP_ACK_OUT
signal flows from the egress through the switch fabric, in the direction opposite the data, and indicates whether a cell has successfully passed through the switch fabric. Other signals associated
with the switch fabric interface are the switch element clock (SE_CLK) and RX_CELL_START.
To support the highest possible throughput for various switch fabric configurations, a clock
speed-up factor of 1.6 is used. That is, the switch fabric is run at a rate that is effectively 1.6 times
faster than the line rate.
Phase aligners are used to allow for extended device separation. The technique used is a clock
recovery mechanism that requires only the switch fabric to be frequency synchronous. A master
clock is distributed to all devices associated with the switch fabric, and the phase of the clock at
each interface is dynamically adjusted to account for skew introduced to the signals. The phase
aligner circuitry for each interface responds to the cell start and feedback signals, which contain a
high number of transitions to ensure accurate phase adjustment of the clock for data and signal
sampling.
2.2.3UT OPIA Interface
The QRT’s UTOPIA interface implements the ATM Forum standardized 16-bit, Level 2 configuration, which supports up to 31 Virtual Outputs (VOs) via five address bits. Up to 31 PHY or
AAL layer devices with 16-bit UTOPIA Level 2 functionality can be connected to this interface,
providing full duplex throughputs of 675 Mbps.
2.2.4Cell Buffer SDRAM Interface
The QRT supports two Synchronous DRAM (SDRAM or SGRAM) interfaces providing up to
64K of cell buffering in both the receive and transmit directions. Each interface consists of a 32bit data bus, a 9-bit address bus, two chip select signals, and associated control signals. The frequency of these interfaces is 100 MHz. Both Synchronous Graphic RAM (SGRAM) and SDRAM
devices are supported. Clocking for these two interfaces is provided through the device.
2.2.5Channel RAM (CH_RAM) Interface
The QRT supports up to 16K channels through a Synchronous SRAM (SSRAM) interfac e. The
interface consists of a 32-bit data bus, a 16-bit address bus, and associated control signals. The
frequency of this interface is 100 MHz. Clocking for this interface is provided through the device.
2.2.6Address Lookup RAM (AL_RAM) Interface
The QRT has data structures in the AL_RAM, including VPI/VCI address translation. The interface consists of a 6-bit data bus, a 17-bit address bus, and associated control signals. The frequency of this interface is 100 MHz. Clocking for this interface is provided through the device.
2.2.7AB_RAM Interface
The QRT stores the per VC head / tail pointers and sent / dropped counters for the receive direction in the AB_RAM. Each interface consists of a 17-bit multiplexed address/data bus and associated control signals. The frequency of this interface is 100 MHz.
2.2.8Host Processor Interface
The QRT host processor interface allows connection of a microprocessor through a multiplexed
32-bit address/data bus. The suggested microprocessor for this interface is the Intel i960®. The
microprocessor has direct access to all of the QRT control registers.
The SE_SOC and BP_ACK signals have guaranteed transitions and special encodings, whic h ar e
defined in this section and in “BP_ACK Encodings” which follows. The SE_SOC_IN and
SE_SOC_OUT signals have guaranteed transitions and SOC encodings as shown in Figure 15.
The SE_SOC signals carry a repeating pattern of four zeros and four ones to guarantee transitions
required by the phase aligner. The “Start-Of-Cell” on the data line s associated with an SE_SOC
line is indicated by a change in this pattern. For a valid SE_SOC, the change in pattern is followed
by reset of the background pattern such that it is followed by four zeros and four ones. The first
nibble (PRES) of the header is coincident with SE_SOC (change in pattern).
The BP_ACK_IN and BP_ACK_OUT signals have guaranteed transitions, and BP and ACK
encodings. The BP_ACK signal is used to signal backpressure/cell acknowledgment to the fabric
(QSE) at the egress and receive backpressure/cell acknowledgment at the ingress from the fabric
(QSE).
To ensure the transitions required by the phase aligner, the BP_ACK signal carries a repeating
four zeros, four ones pattern. The actual information is transferred through encoded 7-bit packets
that start with a change in this background pattern. The change (an inversion) on the line is followed by a mode bit, followed by two bits of coded message, and a second inversion (inverse of
the first inversion). If it is an acknowledgment packet, this is followed by two bits of code exten-
sion (these bits are for future use and currently are required to be “00”). In the case of a backpressure packet, the next bit is the backpressure bit on for low priority multicast cells, followed by one
code extension bit.
The background is reset to four zeros and four ones after transmission of each packet.
The QRT and QSE allow back-to-back acknowledgment and backpressure packets. In the case of
back-to-back acknowledgment and backpressure packets, the receiving device may see an
inverted bit (a “1”) followed by the rest of the packet instead of a reset background pattern.
One backpressure packet and either one or none acknowledgment packet are expected to be
received during a cell time. The receipt of multiple acknowledgment or backpressure packet s is a
failure condition.
Table 1 describes the backpressure and acknowledgment encodings.
Ta ble 1. Backpressure and Acknowledgment Encodings
ModeData 2Data 1Data 0
01 = Backpressure
on high priority
multicast cell.
10000Signals no response. Treated as acknowl-
10100Signals Mid-switch Negative ACKnowl-
11000Signals Output Negative ACKnowledg-
11100Signals ACKnowledgment (ACK).
1 = Backpressure
on medium priority multicast cell.
1 = Backpressure
on low priority
multicast cell.
Code
Ext 0
0Backpressure information.
This signal is present each cell time,
regardless of whether a cell was transmitted or not (on that link).
This signal is withheld if any problem is
detected on the input port.
edgment.
edgment (MNACK).
ment (ONACK).
Description
2.2.11Relation Between External CELL_START and Local CELL_START
Figure 17 shows the relationship between external RX_CELL_START and local CELL_START
signals.
Delay between the external RX_CELL_START and local CELL_START is programmable
through the RX_CELL_START_ALIGN register (refer to “RX_CELL_START_ALIGN (Inter-
nal Structure)” on page 122).
The local CELL_START impacts the start of cell transmission to the fabric. It also determines the
period within a cell time during which the BP_ACK_IN(3:0) at ingress is valid. As such, the programmable CELL_START delay allows the flexibility to synchronize the QRTs and QSEs in a
system.
2.3Cell Flow Overview
The QRT functions as a 622 Mbps port for an ATM switch fabric composed of either the SE or
QSE devices. The QRT transfers cells between a UTOPIA Level 2 interface and a switch fa bric
interface. The device supports header tra nslation and congestion management. The basic flow of
cells through the QRT is as follows (see Figure 18 on page 19):
1.A cell enters the QRT on the receive side from the UTOPIA interface and the channel number is looked
up.
2.The cell is then either dropped or transferred to the receive cell buffer DRAM and queued in the r eceive
queue controller depending on six congestion management checks (both maximum and congested
thresholds for the device, Service Class Group (SCG), SC, and connection).
3.When an available cell time occurs, four cells are selected by the receive-side scheduler, which reads
the cells from the receive cell buffer DRAM and transmits them from the QRT into the switch fabric.
4.Once a cell is received from the switch fabric on the transmit side, it is again either dropped or transferred to the transmit cell buffer DRAM and queued in the transmit queue controller, depending on ten
congestion management checks (both maximum and congested thresholds for the device, VO, SC, Service Class Group (SCG),Service Class Queue (SCQ), and connection).
5.When the cell is selected for transmission by the transmit-side scheduler, it is removed from the transmit cell buffer DRAM and processed by the transmit multicast/header mapper fo r corresponding header
translation and distribution.
18
Loading...
+ 221 hidden pages
You need points to download manuals.
1 point = 1 manual.
You can buy points or you can get point for every manual you upload.