User’s Manual
from Emerson Network Power
Embedded Computing
™
ATCA-9305: ATCA® Blade with Dual Cavium Processors
April 2009
Page 2
The information in this manual has been checked and is believed to be accurate and reliable.
HOWEVER, NO RESPONSIBILITY IS ASSUMED BY EMERSON NETWORK POWER, EMBEDDED
COMPUTING FOR ITS USE OR FOR ANY INACCURACIES. Specifications are subject to change
without notice. EMERSON DOES NOT ASSUME ANY LIABILITY ARISING OUT OF USE OR
OTHER APPLICATION OF ANY PRODUCT, CIRCUIT, OR PROGRAM DESCRIBED HEREIN. This
document does not convey any license under Emerson patents or the rights of others.
The Emerson ATCA-9305 meets the requirements set forth by the Federal Communications
Commission (FCC) in Title 47 of the Code of Federal Regulations. The following information
is provided as required by this agency.
This device complies with part 15 of the FCC Rules. Operation is subject to the following two
conditions: (1) This device may not cause harmful interference, and (2) this device must
accept any interference received, including interference that may cause undesired operation.
FCC RULES AND REGULATIONS — PART 15
This equipment has been tested and found to comply with the limits for a Class A digital
device, pursuant to part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses and can radiate radio frequency energy
and, if not installed and used in accordance with the instructions, may cause harmful interference to radio communications. Operation of this equipment in a residential area is likely
to cause harmful interference, in which case the user will be required to correct the interference at his own expense.
Caution: Making changes or modifications to the ATCA-9305 hardware without the explicit consent
of Emerson Network Power could invalidate the user’s authority to operate this equipment.
EMC COMPLIANCE
The electromagnetic compatibility (EMC) tests used an ATCA-9305 model that includes a
front panel assembly from Emerson Network Power.
Caution: For applications where the ATCA-9305 is provided without a front panel, or where the front
panel has been removed, your system chassis/enclosure must provide the required
electromagnetic interference (EMI) shielding to maintain EMC compliance.
GR-1089-CORE STANDARD
Caution: WARNING: The intra-building port(s) of the equipment or subassembly is suitable for
connection to intrabuilding or unexposed wiring or cabling only. The intra-building port(s)
of the equipment or subassembly MUST NOT be metallically connected to interfaces that
connect to the OSP or its wiring. These interfaces are designed for use as intra-building
interfaces only (Type 2 or Type 4 ports as described in GR-1089-CORE, Issue 4) and require
isolation from the exposed OSP cabling. The addition of Primary Protectors is not sufficient
protection in order to connect these interfaces metallically to OSP wiring.
10009109-01ATCA- 9305 User’s Manual
i
Page 4
Regulatory Agency Warnings & Notices (continued)
EC Declaration of Conformity
According to EN 45014:1998
Manufacturer’s Name:Emerson Network Power
Embedded Computing
Manufacturer’s Address:8310 Excelsior Drive
Madison, Wisconsin 53717
Declares that the following product, in accordance with the requirements of 2004/108/EEC, EMC
Directive and 1999/5/EC, RTTE Directive and their amending directives,
Product: ATCA Blade
Model Name/Number:ATCA-9305/10009986-xx
has been designed and manufactured to the following specifications:
EN55022:1998 Information Technology Equipment, Radio disturbance characteristics, Limits and
methods of measurement
EN55024:1998 Information Technology Equipment, Immunity characteristics, Limits and methods
of measurement
EN300386 V.1.3.2:2003-5 Electromagnetic compatibility and radio spectrum matters (ERM);
Telecommunication network equipment; EMC requirements
As manufacturer we hereby declare that the product named above has been designed to comply
with the relevant sections of the above referenced specifications. This product complies with the
essential health and safety requirements of the EMC Directive and RTTE Directive. We have an internal production control system that ensures compliance between the manufactured products and
the technical documentation.
The ATCA-9305 is an Advanced Telecom Computing Architecture (AdvancedTCA®, ATCA®)
blade based on dual Cavium OCTEON™ CN5860 processors and the Freescale™ Semiconductor MPC8548 management processor. This blade is targeted at security and packet-processing applications in the wireless and transport market segments. These markets include
data-plane packet-processor, security co-processor, video compression, and pattern matching.
The ATCA-9305 complies with the SCOPE recommended profile for central office ATCA systems, PICMG® 3.0 ATCA mechanical specifications, E-keying, and Hot Swap.
COMPONENTS AND FEATURES
The following is a brief summary of the ATCA-9305 hardware components and features:
Cavium Processor : The Cavium CN5860 processor is a highly programmable, high-performance 16-core archi-
tecture operating up to 800 MHz.
Section 1
Management Processor:
The Freescale PowerQUICC™ III MPC8548 processor is a 32-bit enhanced e500 core operating at 1 GHz.
Ethernet Switch: The Broadcom® BCM56802 is a sixteen-port, 10 GbE switch which interconnects the pro-
cessors using SPI to XAUI™ bridges. The functionality includes both 10-Gbps XAUI and 1Gbps SGMII PHY interfaces.
Stratix™ GX Bridge: There are two packet routing Altera® SPI-4.2 high-speed interconnect to XAUI bridges per
CN5860 processor.
Ethernet: 10/100/1000BASE-T Ethernet ports are accessible via the front panel RJ45 connectors and
through the base channel on the back panel. The 10 GbE ports route to the back panel
through the fabric and RTM connectors.
Serial Port: The front panel serial port (MGT CSL) connects to the MPC8548 management processor.
System Management: This product supports an Intelligent Platform Management Controller (IPMC) based on a
proprietary BMR-H8S-AMCc® reference design from Pigeon Point Systems. The IPMC has
an inter-integrated circuit (I2C) controller to support an Intelligent Management Platform
Bus (IPMB) that routes to the AdvancedTCA connector. The IPMB allows for features such as
remote shutdown, remote reset, payload voltage monitoring, temperature monitoring,
and access to Field Replaceable Unit (FRU) data.
PCI/PCIe: The PCI bus allows for read/write memory access between the MPC8548 processor, Ether-
net switch, and Cavium processors. The four lane PCI Express® (PCIe) routes between the
MPC8548 and the optional RTM.
10009109-01ATCA- 9305 User’s Manual
1-1
Page 20
Overview: Components and Features
Real-time Clock: The STMicroelectronics M41T00S RTC provides counters for seconds, minutes, hours, day,
date, month, years, and century. The M41T00S serial interface supports I
super-cap backup capable of maintaining the clock for a minimum of two hours.
Software: The Cavium CN5860 processor provides a GNU compiler that implements the MIPS64 Rel 2
instruction set in addition to the specialized instructions and a Linux® Board Specific Package (BSP) including the IP-stack optimization. The CN5860 also provides libraries that take
advantage of the chip’s hardware acceleration for certain security protocols.
RTM (optional): This blade supports a custom Rear Transition Module (RTM) with the following I/O:
• Either two or six 10GbE connections
• One x4 PCI Express port from the MPC8548
• Connections for an MMC to control Hot Swap
• MPC8548 console port
For more detailed information, see the ATCA-9305 Rear Transition Module User’s Manual.
2
C bus and has a
1-2
ATCA-9305 User’s Manual10009109-01
Page 21
Overview: Functional Overview
Console
(ENG use only)
PCI Bus
10G - 4 PORTS
RJ45RJ45
BCM5482
1 2
Base
3 2 1 0 3 2 1 0
FC2 FC1
10G Fabric
J23
I2C
EEPROM
COP/
JTAG
NAND
Flash
1GB
x 16
BCM56802
XAUI 10 Gb
Switch
5 XAUI
SGMII2SGMII1XAUI
8 7
XAUI 13
XAUI 14
3
SGMII
4
SGMII
PCI Bus
IDSEL13
6 XAUI
Mag
KSL
CPLD
Latched Adrs
A/D
IPMB
P10
Console
(ENG use only)
Cavium
Octeon
CN5860
Processor 1
SPI-1
PCI
Bus
IDSEL11
Serial 0D1_DDR2
I2C
Serial 1
SPI-0
Adrs/Data
Console
BCM5461S
Stratix II GX
#2
I2C
EEPROM
RTC
MPC8548
Management
Processor
RLDRAM
64MB
Local Bus
Addr/Data
J31
10G - 2 PORTS
J30
Socketed
ROM
512KB
x 8
COP/
JTAG
To R TM
XAUI
11-12 15 -18
J33
RTM RST
12V Hot Swap
RTM Console
PQ I2C
Serial CFG
EEPROM
RLDRAM
64MB
PQ DDR2
SDRAM
NOR
Flash
4M
x 16
P1 DDR
SDRAM
P2 DDR2
SDRAM
RLDRAM
64MB
RLDRAM
64MB
I2C
EEPROM
RLDRAM
64MB
RLDRAM
64MB
RLDRAM
64MB
RLDRAM
64MB
Stratix II GX
#1
Stratix II GX
#4
BCM5461S BCM5461S
Mag
MagMag
I2C
EEPROM
COP/JTAG
PCIe x4
I2CI2C
Stratix II GX
#3
Cavium
Octeon
CN5860
Processor 2
Serial 0
Serial 1
D1_DDR2
I2C
SPI-1
SPI-0
Local Bus
Addr/Data
PCI
Bus
IDSEL12
NOR
Flash
512Mb or
64MB x 16
Socketed
ROM
512K
x 8
NOR
Flash
4M
x 8
Socketed
ROM
512K
x 8
NOR
Flash
4M
x 8
FUNCTIONAL OVERVIEW
The following block diagram provides a functional overview for the ATCA-9305:
Figure 1-1: General System Block Diagram
10009109-01ATCA- 9305 User’s Manual
1-3
Page 22
Overview: Additional Information
ADDITIONAL INFORMATION
This section lists the ATCA-9305 hardware’s regulatory certifications and briefly discusses
the terminology and notation conventions used in this manual. It also lists general technical
references.
Mean time between failures (MTBF) has been calculated at 439,924 hours using the Telcordia SR-332, Issue 1 (Reliability Prediction for Electronic Equipment), method 2 at 30
Product Certification
The ATCA-9305 hardware has been tested to comply with various safety, immunity, and
emissions requirements as specified by the Federal Communications Commission (FCC),
Underwriters Laboratories (UL), and others. The following table summarizes this compliance:
Table 1-1: Regulatory Agency Compliance
Type:Specification:
SafetyIEC60950/EN60950 – Safety of Information Technology Equipment
(Western Europe)
UL60950, CSA C22.2 No. 60950 – Safety of Information Technology
Equipment, including Electrical Business Equipment (BI-National)
GR1089-CORE
Global IEC – CB Scheme Report IEC 60950, all country deviations
EnvironmentalNEBS: Telecordia GR-63 –
Section 4.1.1 Transportation and Storage Environmental Criteria;
Section 4.1.2 Operating Temperature and Humidit y;
Section 4.1.3 Altitude;
Section 4.1 4 Temperature Margins;
Section 4.4.1 Earthquake Environment;
Section 4.4.4 Office Vibration:
Section 4.4.5 Transportation Vibration
° C.
1-4
ATCA-9305 User’s Manual10009109-01
Page 23
Overview: Additional Information
Type:Specification: (continued)
EMCFCC Part 15, Class A– Title 47, Code of Federal Regulations, Radio
Emerson maintains test reports that provide specific information regarding the methods
and equipment used in compliance testing. Unshielded external I/O cables, loose screws, or
a poorly grounded chassis may adversely affect the ATCA-9305 hardware’s ability to comply
with any of the stated specifications.
Frequency Devices
ICES 003, Class A – Radiated and Conducted Emissions, Canada
EN55022 – Information Technology Equipment, Radio Disturbance
Characteristics, Limits and Methods of Measurement
EN55024 – Information Technology Equipment, Immunity
Characteristics, Limits and Methods of Measurement
ETSI EN300386 – Electromagnetic Compatibility and Radio Spectrum
Matters (ERM), Telecommunication Network Equipment,
Electromagnetic Compatibility (EMC) Requirements
AS/NZS 3548 003, Class A – Standard for radiated and conducted
emissions for Australia and New Zealand
The UL web site at ul.com has a list of Emerson’s UL certifications. To find the list, search in
the online certifications directory using Emerson’s UL file number, E190079. There is a list
for products distributed in the United States, as well as a list for products shipped to Canada. To find the ATCA-9305, search in the list for 10009986-xx, where xx changes with each
revision of the printed circuit board.
The Ethernet connection of the equipment or subassembly must be connected with
shielded cables that are grounded at both ends.
RoHS Compliance
The ATCA-9305 is compliant with the European Union’s RoHS (Restriction of use of Hazardous Substances) directive created to limit harm to the environment and human health by
restricting the use of harmful substances in electrical and electronic equipment. Effective
July 1, 2006, RoHS restricts the use of six substances: cadmium (Cd), mercury (Hg), hexavalent chromium (Cr (VI)), polybrominated biphenyls (PBBs), polybrominated diphenyl ethers
(PBDEs) and lead (Pb). Configurations that are RoHS compliant are built with lead-free solder.
To obtain a certificate of conformity (CoC) for the ATCA-9305, send an e-mail to
sales@artesyncp.com or call 1-800-356-9602. Have the part number(s)
(e.g., C000####-##) for your configuration(s) available when contacting Emerson.
10009109-01ATCA- 9305 User’s Manual
1-5
Page 24
Overview: Additional Information
Terminology and Notation
Active low signals: An active low signal is indicated with an asterisk * after the signal name.
Byte, word: Throughout this manual byte refers to 8 bits, word refers to 16 bits, and long word refers to
32 bits, double long word refers to 64 bits.
PLD: This manual uses the acronym, PLD, as a generic term for programmable logic device (also
known as FPGA, CPLD, EPLD, etc.).
Radix 2 and 16: Hexadecimal numbers end with a subscript 16. Binary numbers are shown with a
subscript 2.
Technical References
Further information on basic operation and programming of the ATCA-9305 components
can be found in documents listed in
Table 1-2: Technical References
Device /
Interface:Document: 1
ATC AAdvancedTCA® Base Specification
(PICMG
Engineering Change Notice 3.0-1.0-001
(PICMG
Ethernet/Fibre Channel for AdvancedTCA™ Systems
(PICMG
http://www.picmg.org
CPU
CN5860
MPC8548
DRAM576Mb: x9, x18, x36 2.5V V
EEPROMAtmel® 2-Wire Serial EEPROM 64K (8192 x 8) Preliminary Data Sheet
This chapter describes the physical layout of the boards, the setup process, and how to
check for proper operation once the boards have been installed. This chapter also includes
troubleshooting, service, and warranty information.
ELECTROSTATIC DISCHARGE
Before you begin the setup process, please remember that electrostatic discharge (ESD) can
easily damage the components on the ATCA-9305 hardware. Electronic devices, especially
those with programmable parts, are susceptible to ESD, which can result in operational failure. Unless you ground yourself properly, static charges can accumulate in your body and
cause ESD damage when you touch the board.
Caution: Use proper static protection and handle ATCA-9305 boards only when absolutely
necessary. Always wear a wriststrap to ground your body before touching a board. Keep
your body grounded while handling the board. Hold the board by its edges–do not touch
any components or circuits. When the board is not in an enclosure, store it in a staticshielding bag.
To ground yourself, wear a grounding wriststrap. Simply placing the board on top of a staticshielding bag does not provide any protection–place it on a grounded dissipative mat. Do
not place the board on metal or other conductive surfaces.
ATCA-9305 CIRCUIT BOARD
The ATCA-9305 circuit board is an ATCA blade assembly and complies with the PICMG 3.0
ATCA mechanical specification. It uses a 16-layer printed circuit board with the following
dimensions:
Table 2-1: Circuit Board Dimensions
Width:Depth:Height:Weight (typical):
12.687 in.
(322.25 mm)
1. This is the typical weight for the ATCA-9305. Board weight varies slightly per configuration; contact
Technical Support if you require a specific configuration weight.
The following figures show the front panel, component maps, and LED locations for the
ATCA-9305 circuit board.
11.024 in.
(280.01 mm)
< .84 in.
(<21.33 mm)
4.2 lb.
(1.91 kg)
1
10009109-01ATCA- 9305 User’s Manual
2-1
Page 28
Setup: ATCA-9305 Circuit Board
ATCA-9035
O
O
S
Blue Hot Swap
2
3
MGT ETH
SWITCH
ETH
SPD
LINK
ACT
SPD
LINK
ACT
MGT CSL
RST
H/S
Reset
Red/Amber = Out of Service (OOS)
Green = In Service (2)
Amber = User Defined (3)
Off = 10 Mbps
Yellow = 100 Mbps
Green = 1000Mbps
Off = No Link
On= Link, No Activity
Blink = Link/Activity
Ethernet Speed (top LED)
Ethernet Link/Activity (bottom LED)
Port 1
Port 2
Management Console
!
Figure 2-1: ATCA-9305 Front Panel
2-2
Note: The electromagnetic compatibility (EMC) tests used an ATCA-9305 model that includes a front panel assem-
bly from Emerson Network Power, Embedded Computing.
Caution: For applications where the ATCA-9305 is provided without a front panel, or where the front
ATCA-9305 User’s Manual10009109-01
panel has been removed, your system chassis/enclosure must provide the required
electromagnetic interference (EMI) shielding to maintain CE compliance.
The ATCA-9305 circuit board has various connectors and headers (see the figures beginning
on page 2-3), summarized as follows:
J1: This 14-pin JTAG header is used for debugging CN5860 processor 2. See
Ta bl e 3- 7 .
J3-J6: These 240-pin sockets are installed for the CN5860 processor 1 DDR2 SDRAM memory.
J9: This 14-pin configuration header allows selection of boot device, and MPC8548 configura-
tion for the configuration SROM. See
Fig. 2-6.
J11-J14: These 240-pin sockets are installed for the CN5860 processor 2 DDR2 SDRAM memory.
J15: This 14-pin JTAG header is used for debugging CN5860 processor 1. See
Ta bl e 3- 7 .
J23: The 80-pin Zone 2 connector provides 1 GB and 10 GB Ethernet access to the backplane, see
Ta bl e 8- 2 .
J30-J31: The 80-pin Zone 3 connectors route PCIe and XAUI (10G) to the optional RTM. See
and
Ta bl e 8- 4 for pin assignments.
Ta bl e 8- 3
J33: The 24-pin Zone 3 connector routes the reset, Hot Swap, MPC8548 console, power, and
2
IPMC I
C to the optional RTM, see Ta bl e 8 -5 .
JP1: This is the 10-pin programming header for the IPMP, CPLD, and SPI 10G (1-4) devices, see
Ta bl e 7- 5 1 .
P1: This 14-pin RJ45 connector with LEDs routes the Three-speed Ethernet Controller (TSEC1)
between the MPC8548 and the front panel. See
P2: This 16-pin JTAG debug header accesses the MPC8548 processor, see
Ta bl e 6- 4 for pin assignments.
Ta bl e 4- 7 .
P3: This 14-pin RJ45 connector with LEDs routes Ethernet (FP1) between the switch and the
front panel, see
Ta bl e 6- 4 for pin assignments.
P4: The 5-pin vertical mini-B USB provides the IPMP EIA-232 console debug, see
Ta bl e 7- 5 2 .
P5, P6: These 5-pin vertical mini-B USBs are the CN5860 console and for factory debug use only.
P7: This 5-pin mini-B USB is the console serial port for the MPC8548 management processor,
see
Ta bl e 4- 8 .
P10: The 30-pin Zone 1 connector routes IPMB to the backplane, see
10009109-01ATCA- 9305 User’s Manual
Ta bl e 8- 1 .
2-7
Page 34
Setup: ATCA-9305 Setup
Configuration Header
There are a total of seven jumper pairs on J9 (pins 11-14 are spare posts). See figure Fig. 2-2
for the jumper location on the ATCA-9305. Also reference the “Jumper Settings (0x18)” register.
Figure 2-6: Configuration Header, J9
13 11 9 7 5 3 1
14 12 10 8 6 4 2
PROG
BOOT
STAND
IG ROM
BT FLASH
BT SKT: A shunt on pins 1-2 selects the 512 KB socketed ROM as the boot device for the MPC8548.
IG SROM: If the serial ROM configuration jumper is installed (pins 3-4), the ATCA-9305 will not try to
configure (IGNORE_SROM*) from the MPC8548 serial ROM.
REDIR EN: A shunt installed on pins 5-6 disables the boot redirection, see page 7-41 for more informa-
tion.
REDIR EN
BT SKT
BOOT: A shunt on pins 7-8 causes both Cavium CN5860s to boot from their local bus and not boot
over PCI.
STAND: A shunt on pins 9-10, IPMC stand alone mode, allows the board to boot without manage-
ment control.
PROG: Installing a shunt on pins 11-12 puts the IPMC controller into programming mode. This is
only used in the factory to configure the IPMC.
BT FLASH: If BOOT shunt is installed (booting from local bus), this shunt determines whether the boot
is from local flash or socket. When this BT FLASH shunt is installed, the ATCA-9305 boots
from flash. Otherwise, it boots from the socket.
ATCA-9305 SETUP
You need the following items to set up and check the operation of the Emerson ATCA-9305:
ATCA chassis and power supply
MPC8548 Console cable for EIA-232 port, Emerson part # C0007662-00
Computer terminal
Save the antistatic bag and box for future shipping or storage.
2-8
ATCA-9305 User’s Manual10009109-01
Page 35
Setup: ATCA-9305 Setup
Power Requirements
The ATCA-9305 circuit board uses —48 volts from the backplane to derive 3.3 volts for the
IPMC and 12 volts for payload power.
Table 2-2: Typical Power Requirements
Configuration:Power:
1.0 GHz MPC8548 and 800 MHz Cavium processors,
board running at room temperature with all
processors at U-Boot prompt
The exact power requirements for the ATCA-9305 circuit board depend upon the specific
configuration of the board, including the CPU frequency and amount of memory installed
on the board. Please contact Emerson Technical Support at 1-800-327-1251 if you have
specific questions regarding the board’s power requirements.
Environmental Considerations
As with any printed circuit board, be sure that air flow to the board is adequate. Chassis constraints and other factors greatly affect the air flow rate. The environmental requirements
are as follows:
Table 2-3: Environmental Requirements
135 watts
Environment:Range:Relative Humidity:
Operating Temperature0° to +55° Centigrade, ambient
(at board)
Storage Temperature—40° to 85° CentigradeNot to exceed 95%
Altitude0 to 4,000 meters above sea
level
Air FlowRequires 30 CFM at 55° Centigrade at sea level. Meets thermal
performance requirements of CP-TA ATCA ICD Book 1.1Class B-2
10009109-01ATCA- 9305 User’s Manual
Not to exceed 85% (noncondensing)
(non-condensing)
—
2-9
Page 36
Setup: ATCA-9305 Setup
Figure 2-7: Air Flow Graph
2-10
Hot Swap
The ATCA-9305 can be Hot Swapped, as defined in the AdvancedTCA specification (see reference in
in a typical AdvancedTCA system. (These procedures assume the system is using a shelf
manager.)
Note: The ATCA-9305 Rear Transistion Module (RTM) has its own Hot Swap LED and switch, and it can be Hot
Swapped in/out independently of the front board. If the front board is not present, then the RTM will not be
powered. If the front board is Hot Swapped out, the RTM’s blue LED will illuminate. In either case, the RTM can
be safely removed.
ATCA-9305 User’s Manual10009109-01
Ta bl e 1 - 2 ). This section describes how to insert and extract an ATCA-9305 module
Page 37
Setup: Troubleshooting
!
Insert a board:
1 Insert the ATCA-9305 into an available slot.
2 Push in the front panel handle (tab).
The blue Hot Swap LED on the front panel (see
board insertion is in progress and system management software is activating the slot. Then
the blue LED turns off, indicating the insertion process is complete, and payload power is
present.
Remove a board:
1 Pull out the handle (tab) on the ATCA-9305 front panel one click.
A short blink indicates the board is requesting permission for extraction.
2 Remove the board when the blue LED on the front panel is on (no payload power).
Caution: Do not remove the ATCA-9305 while the blue LED is blinking.
Fig. 2-1) flashes a long blink to indicate that
TRO UB LESHOO TI NG
In case of difficulty, use the following checklist:
Be sure the ATCA-9305 circuit board is seated firmly in the carrier.
Be sure the system is not overheating.
Check the cables and connectors to be certain they are secure.
Check that your terminal is connected to a console port.
Technical Support
If you need help resolving a problem with your ATCA-9305, visit
http://www.emersonembeddedcomputing.com/ on the internet or send E-mail to support@artesyncp.com. Please have the following information handy:
• ATCA-9305 serial number and product identification (see
• MPC8548 monitor version number (see
• Cavium monitor version number (see
• version and part number of the operating system (if applicable)
10009109-01ATCA- 9305 User’s Manual
Fig. 9-1)
Fig. 3-3)
Fig. 2-8)
2-11
Page 38
Setup: Troubleshooting
Product ID
Serial Number
• whether your board has been customized for options such as a higher processor speed or
additional memory
• license agreements (if applicable)
If you do not have internet access, please call Emerson for further assistance:
Figure 2-8: Serial Number and Product ID on Top Side
(800) 327-1251 or (608) 826-8006 (US)
44-131-475-7070 (UK)
2-12
Product Repair
If you plan to return the board to Emerson Network Power for service, visit
http://www.emersonembeddedcomputing.com/ on the internet or send E-mail to serviceinfo@artesyncp.com to obtain a Return Merchandise Authorization (RMA) number. We
will ask you to list which items you are returning and the board serial number, plus your purchase order number and billing information if your ATCA-9305 hardware is out of warranty.
Contact our Test and Repair Services Department for any warranty questions. If you return
the board, be sure to enclose it in an antistatic bag, such as the one in which it was originally
shipped. Send it prepaid to:
Emerson Network Power, Embedded Computing
Test and Repair Services Department
8310 Excelsior Drive
Madison, WI 53717
ATCA-9305 User’s Manual10009109-01
RMA #____________
Page 39
Setup: Troubleshooting
Please put the RMA number on the outside of the package so we can handle your problem
efficiently. Our service department cannot accept material received without an RMA number.
Comments and Suggestions
We welcome and appreciate your comments on our documentation. We want to know
what you think about our manuals and how we can make them better.
Mail comments to us by filling out the following online form:
http://www.emersonnetworkpowerembeddedcomputing.com/ Contact Us > Online Form
In “Area of Interest” select “Technical Documentation”. Be sure to include the title, part
number, and revision of the manual and tell us how you used it.
The ATCA-9305 provides two Cavium processor complexes. The major devices on each
complex consist of the Cavium CN5860 processor, two StratixGX bridges, SDRAM,
RLDRAM®, an I
C EEPROM, socketed ROM, Flash, and the PCI bus interface.
Section 3
CAVIUM CN5860 PROCESSOR
The main features of the CN5860 include:
Table 3-1: CN5860 Features
Feature:Description:
Processor CoreUp to 16 cnMIPS™ cores
Core Speed
Network Services Processor (NSP)
System Packet InterfaceTwo SPI-4.2 ports
L2 Cache2 MB, eight-way set associative
DRAM144-bit DDR2 DRAM interface
RLDRAM18-bit RLDRAM, low-latency memory direct access
PCI64-bit, PCI 2.3 compatible
up to 800 MHz, processing up to 30 million packets per second
10009109-01ATCA- 9305 User’s Manual
3-1
Page 42
Cavium Processor Complex: PCI
The CN5860 and switch route packets using SPI-4.2 and control information flow using PCI.
The CN5860 has two SPI-4.2 interfaces with each one supporting up to 16 ports. Two highspeed SPI-4.2 Altera (Stratix™ GX) FPGAs function as the SPI-to-XAUI bridge for each processor to switch complex. The PCI interface supports up to four ports, consequently a total
of 36 ports can be supported internally by each CN5860.
Cavium Memory Map
Although the Cavium processors are 64-bit, the ATCA-9305 uses a 49-bit implementation.
Refer to the Cavium Networks OCTEON Plus CN58xx Hardware Reference Manual for more
detailed information on the memory map.
Table 3-2: Cavium Address Summary
Hex Physical
Address:Register Description:
1,2000,0000,0000reserved
1,1F00,0000,0000Cavium Hardware registers
1,1E00,0000,0000PCI Memory Space (6)
1,1D00,0000,0000PCI Memory Space (5)
1,1C00,0000,0000PCI Memory Space (4)
1,1B00,0000,0000PCI Memory Space (3)
1,1A00,0000,0000PCI I/O Space
1,1910,0000,0000reserved
1,1900,0000,0000PCI Special Space
1,0700,0000,0000CN58xx Registers
1,0001,0000,0000reserved
1,0000,0000,0000Local Boot Bus
0,0004,1000,0000DDR2 SDRAM, middle block (256-512 MB)
0,0004,0000,0000reserved
0,0000,2000,0000DDR2 SDRAM, upper block (512 MB-2 GB)
0,0000,1000,0000reserved
0,0000,0000,0000DDR2 SDRAM, bottom block (256 MB)
1. This depends on how much memory is installed.
1
PCI
The Cavium is a slave device on the PCI bus. The Cavium U-boot monitor image is provided
by the MPC8548 management processor via PCI. The MPC8548 monitors the Cavium boot
status and has the ability to try alternate boot images if the current one fails.
3-2
ATCA-9305 User’s Manual10009109-01
Page 43
Cavium Processor Complex: PCI
The CN5860 processor is designed such that another PCI device can initialize its memory
interface, copy code over PCI into its local memory space, and then write a boot release register.
CN5860 Boot Over PCI
The PCI bus is configured to run at 66 MHz in 64-bit conventional PCI mode. On power-up,
the CN5860 processor’s 16 internal cores are held in reset. The MPC8548 management processor performs the following steps:
1 Initialize the CN5860 RAM.
2 Copy the CN5860 U-boot to the CN5860 RAM.
3 Copy boot code to the reset vector to jump to the U-boot code in RAM.
4 Release the CN5860 processor cores from reset.
5 Receive return codes from the CN5860 that indicate any boot or POST errors and take the
appropriate action.
The management processor (MPC8548) monitor implements a utility to load non-volatile
memory redundant U-boot images for the CN5860 processors. The utility tags each copy as
primary or secondary.
Each CN5860 can be reset independently of the other processor without affecting its operation. This task is performed by the MPC8548 management processor.
Figure 3-2: CN5860 Reset Diagram
3-4
ATCA-9305 User’s Manual10009109-01
Page 45
Cavium Processor Complex: Cavium Ethernet
CAVIUM ETHERNET
The Ethernet address for your board is a unique identifier on a network. The address consists of 48 bits (MAC [47:0]) divided into two equal parts. The upper 24 bits define a unique
identifier that has been assigned to Emerson Network Power, Embedded Computing by
IEEE. The lower 24 bits are defined by Emerson for identification of each of our products.
The Ethernet address for the ATCA-9305 is a binary number referenced as 12 hexadecimal
digits separated into pairs, with each pair representing eight bits. The address assigned to
the ATCA-9305 has the following form:
00 80 F9 xx yy zz
00 80 F9 is Emerson’s identifier. The last three bytes of the Ethernet address consist of the
port (one byte); 0x99(SPI 1), 0x9A (SPI 2), 0x9B (SPI 3), or 0x9C (SPI 4), followed by the serial
number (two byte hexadecimal). The ATCA-9305 Cavium has been assigned the Ethernet
address range 00:80:F9:99:00:00 to 00:80:F9:9C:FF:FF. The format is shown in
Table 3-3: Ethernet Port Address
Offset:MAC:Description:Ethernet Identifier (hex):
Byte 515:0LSB of (serial number in hex)—
Byte 4MSB of (serial number in hex)—
Byte 323:16SPI 1
SPI 2
SPI 3
SPI 4
Byte 247:24Assigned to Emerson by IEEE0xF9
Byte 10x80
Byte 00x00
0x99
0x9A
0x9B
0x9C
Ta bl e 3- 3 .
The last two bytes, MAC[15:0], are calculated from the serial number stored in the Cavium
EEPROM. This corresponds to the following formula: n —1000, where n is the unique serial
number assigned to each board. So if an ATCA-9305 serial number is 1032, the calculated
value is 32 (20
), and the default Ethernet port addresses are:
16
• Cavium 1 SPI 1 MAC address is: 0x00 0x80 0xF9 0x99 0x00 0x20
• Cavium 1 SPI 2 MAC address is: 0x00 0x80 0xF9 0x9A 0x00 0x20
• Cavium 2 SPI 1 MAC address is: 0x00 0x80 0xF9 0x9B 0x00 0x20
• Cavium 2 SPI 2 MAC address is: 0x00 0x80 0xF9 0x9C 0x00 0x20
PCI console init succeeded, 1 consoles, 1024 bytes each
Net: octspi0, octspi1
RLDRAM not present
Octeon BIST Passed
POST i2c PASSED
POST memory PASSED
2 ATCA-9305 (Mon 0.9)=>
CAVIUM MONITOR
The primary function of the monitor software is to transfer control of the hardware to the
user’s application. Secondary responsibilities include:
• low-level initialization of the hardware
•diagnostic tests
• low-level monitor commands/functions to aid in debug
Start-up Display
At power-up or after a reset, the Cavium monitor runs diagnostics and reports the results in
the start-up display, see an example in
configures the board according to the environment variables (see “MPC8548 Environment
Variables” on page 9-26). If the configuration indicates that autoboot is enabled, the monitor attempts to load the application from the specified device. If the monitor is not configured for autoboot or a failure occurs during power-up, the monitor enters normal
command-line mode. The monitor command prompt in
hardware boot of the ATCA-9305.
Figure 3-3: Example Cavium CN5860 Monitor Start-up Display
Fig. 3-3. During the power-up sequence, the monitor
Fig. 3-3 is the result of a successful
3-6
ATCA-9305 User’s Manual10009109-01
Note: There will be either a 1 or 2 in front of the monitor prompt indicating which Cavium processor is prompting.
Power-up/Reset Sequence
The Cavium CN5860 processor follows the boot sequence in Fig. 3-4 before auto-booting
the operating system or application software. At power-up or board reset, the monitor performs hardware initialization, diagnostic routines, autoboot procedures, and if necessary,
invokes the command line. See
Ta bl e 3- 5 for default Cavium environment variables settings.
The Cavium monitor diagnostic tests can be executed during power-up or invoked from the
monitor’s command prompt. This is accomplished by changing the state of the monitor
configuration parameters that define power-up and reset diagnostics mode. If the poweron-diags parameter is set to “on”, the monitor invokes the diagnostic tests after a reset of the
hardware. Results are displayed to the console including whether the test passed or failed.
POST Diagnostic Results
The ATCA-9305 Power-On Self-Test (POST) diagnostic results are stored as a 32-bit value in
memor y acces sible by the management console at locatio n 0x80 080A6C. E ach bit indicates
the result of a specific test, so this field can store the results of up to 32 diagnostic tests.
Ta bl e 3- 4 assigns the bits to specific tests.
10009109-01ATCA- 9305 User’s Manual
3-7
Page 48
Cavium Processor Complex: Cavium Monitor
Table 3-4: POST Diagnostic Results–Bit Assignments
Diagnostic
Bit:
0-1Reser ved
2DRAMVerify address and data lines are intact
3Cavium BIST4I
5-31Reser ved
Cavium Environment Variables
The following table lists the standard Cavium environment variables:
Table 3-5: Standard Cavium Environment Variables
Var iabl e:
baudrate115200Console port baud rate
bootcmd" "Command to execute when auto-booting or executing
bootdelay0Choose the number of seconds the Monitor counts down
bootfile" "Path to boot file on server (used with TFTP)—set this to
ethaddrundefinedSPI 1 MAC address
eth1addrundefinedSPI 2 MAC address
ethactoctspi0Specifies Ethernet port to use
gatewayip0.0.0.0Select the network gateway machine IP address
hostnamenoneTarget hostname
ipaddr0.0.0.0Board IP address
loadaddr0x20000000Define the address to download user application code
netmask0.0.0.0Board sub-network mask
powerondiagsoffTurns POST diagnostics on or off after power-on/reset
rootpatheng/Path name of the NFS’ server root file system
serial#xxxxxBoard serial number
serverip0.0.0.0Boot server IP address
stderrserialSets the standard destination for console error reporting
before booting user application code
Valid options: time in seconds, -1 to disable autoboot
“path/file.bin” to specify filename and location of the file
to load.
(used with TFTP)
Valid options: on, off
Valid options: serial, pci
0 Passed the test
1 Failure detected
3-8
ATCA-9305 User’s Manual10009109-01
Page 49
Cavium Processor Complex: Memory
Default
Var iabl e:
stdinserialSets the standard source for console input
stdoutserialSets the standard destination for console output
MEMORY
The processor complex supports DDR2 Synchronous DRAM (SDRAM) and Reduced Latency
DRAM (RLDRAM) memory devices.
DDR2 SDRAM
The ATCA-9305 supports up to 16 gigabytes of 144-bit wide DDR2 SDRAM per processor
complex. The SDRAM interface clock speed frequency is 400 MHz. The four low-profile,
dual-inline memory modules (buffered DIMM) are installed in 240-pin very low profile (VLP)
sockets to reduce board density and routing constraints. A 2 KB EEPROM on the DIMM provides the serial presence detection (SPD). On-card SDRAM occupies physical addresses
from 0,0000,0000,0000
Each processor memory bus is operating in 144-bit mode. Error-correcting Code (ECC) is
performed on the memory bus so that the CN5860 detects all double-bit errors, multi-bit
errors within a nibble, and corrects all single-bit errors.
Value:Description: (continued)
Valid options: serial, pci
Valid options: serial, pci
to 0,0003,FFFF,FFFF16.
16
RLDRAM
Each CN5860 supports 256 MB Common I/O (CIO) RLDRAM operating up to 400 MHz
(depends on the processor speed). The Micron RLDRAM II is organized as 32Mx18x8 internal
banks. The DDR I/O interface transfers two data words per clock cycle. Output data is referenced to the free-running output data clock. Read and write accesses to the RLDRAM are
burst-oriented. RLDRAM is accessed by using Cavium-specific instructions which operate on
MIPS Coprocessor 2.
I2C EEPROM
Each Cavium processor complex has one user EEPROM device for parameter storage located
2
on the I
from the other CN5860 processor and MPC8548 processor I
serial EEPROM on each CN5860 processor I
input and the Serial Data (SDA) bidirectional lines.
C bus, address 0xA8. The I2C bus for each processor is completely independent
The 512 KB of 32-pin PLCC socketed flash starts at physical address1D46,0000
for Engineering code.
The StrataFlash features high-performance fast asynchronous access
times, low power, and flexible security options.
and is used
16
Flash, 4 MB x 16
The 4 MB soldered NOR flash starts at physical address 1D05,0000
provides CN5860 code storage and non-volatile memory.
The 32-Mbit device
16.
STRATIXGX INTERCONNECT
The Altera StratixGX FPGA provides the high-speed SPI-4.2 interconnect. Each complex has
dual SPI-to-XAUI bridges connected to the XAUI Ethernet switch ports.
PLD Registers
The FPGA bridge is located at address 0x1D030000. Use the following registers to access
the XAUI to SPI bridge configuration registers. See the “Read Example” and “Write Example.”
The write only Control register performs two functions:
• Writing a value of 0x01 causes the contents of the Data registers to be written to the
FPGA bridge at the location specified by the Address registers.
• Writing a value of 0x02 causes the contents of the Data registers to be overwritten by the
contents of the FPGA bridge at the location specified by the Address registers.
Note: Writing any other value to the Control register will be ignored.
Register 3-7: Control (0x6)
Bits:R/W:Function:
7—Reserved
6—
5—
4—
3—
2—
ATCA-9305 User’s Manual10009109-01
Page 53
Cavium Processor Complex: StratixGX Interconnect
Bits:R/W:Function:
1W Read
0W Write
Version Register
This read-only register tracks the PLD versions. The version is hard coded in the PLD and
changes with every released code change. Version starts at 01
Register 3-8: Vers ion (0x7)
Bits:R/W:Function:
7R 0x01
6R
5R
4R
3R
2R
1R
0R
.
16
Scratch Register
All registers in this range act as the same register.
Register 3-9: Scratch (0x8-0x3F)
Bits:R/W:Function:
7R/W
6R/W
5R/W
4R/W
3R/W
2R/W
1R/W
0R/W
Read Example: To read the FPGA bridge SPI_COMMAND register at 0x204, use the following commands.
Set address bits 9:8.
=>write64b 1d030004 02
Set address bits 7:0.
=>write64b 1d030005 04
10009109-01ATCA- 9305 User’s Manual
3-13
Page 54
Cavium Processor Complex: Headers and Connectors
Perform a read.
=>write64b 1d030006 02
Display the results.
=>read64l 1d030000
Write Example: To write to the FPGA bridge MAC_CMD_CFG register at 0x00C, use the following com-
mands.
Set data bits 31:24.
=>write64b 1d030000 a9
Set data bits 23:16.
=>write64b 1d030001 b8
Set data bits 15:8.
=>write64b 1d030002 c7
Set data bits 7:0.
=>write64b 1d030003 d6
Set address bits 9:8.
=>write64b 1d030004 00
Set address bits 7:0.
=>write64b 1d030005 0c
Perform a write.
=>write64b 1d030006 01
HEADERS AND CONNECTORS
COP/JTAG Headers
The CN5860 processor complex uses headers J1 and J15 for debug.
5P2_ETDOP1_ETDO
6groundground
7P2_TMSP1_TMS
8groundground
9P2_ TCKP 1_TC K
10groundground
11P2_EJTAG_RSTP1_EJTAG_RST
12key (pin not installed)key (pin not installed)
13P2_EJTAG_DINTP1_EJTAG_DINT
14P2_COP_PWR (3.3V)P1_COP_PWR (3.3V)
Console Serial Ports (optional)
Connectors P6 (processor P1) and P5 (processor P2) access the CN5860 processors for Engineering debug use only. The supported baud rates for these ports operate at 9600, 14400,
19200, 38400, 57600, and 115200 bps. (The default rate is 115200 bps.)
The ATCA-9305 management complex is comprised of the Freescale MPC8548 processor,
CPLD, SDRAM, flash, I
2
C EEPROM, Real-time Clock, and PCI bus interface. Board power-up,
booting and monitoring the Cavium processors, PCI bus arbitration, interrupt servicing,
memory persistence functionality, and other board level management tasks are implemented using the MPC8548 processor. The MPC8548 stores the Cavium operating system
and monitor code in its local memory and then uses the boot over PCI functionality to bring
up the Cavium processor complexes. The CPLD registers are described in Chapter 5. See
Chapter 9 for the Management Processor Monitor.
The management complex connects to the Broadcom Ethernet switch via a 1000BASE-T
Ethernet port. This connection uses the TSEC2 interface operating in SGMII mode. See
Chapter 6, “Ethernet Interface.”
L1 Cache32-kilobyte data and instruction caches with parity protection, 32-
byte line, eight-way set associative
L2 Cache512 kilobytes, eight-way set associative
CPU Core Speed1 GHz with a 400 MHz DDR2 bus
DDR2 Memory Controller64-bit data interface, four banks of memory supported (each up to 4
GB), full ECC support
Dual I2C ControllersTwo-wire interface, master or slave I
Boot SequencerLoads configuration data from serial ROM at reset via the I
EthernetFour 10/100/1000 enhanced three-speed controllers (eTSECs), full-
/half-duplex support, MAC address recognition
Local Bus Controller (LBC)DDR2 SDRAM memory controller, General Purpose Chip Select
Machine (GPCM), three User-Programmable Machines (UPM), eight
chip selects support eight external slaves
PCI64-bit, PCI 2.2 compatible
PCI ExpressSingle x4 PCIe high-speed interconnect, complies with PCI Express™
Base Specification Revision 1.0a
JTAGComplies with IEEE Std. 1149.1
2
C support
2
C interface
For more detailed information, reference the Freescale MPC8548E PowerQUICC™ III Inte-
grated Processor Family Reference Manual.
MPC8548 Memory Map
The monitor can boot from either the soldered flash (Bank 1, default) or the socketed PLCC
device. Based on the configuration header (see page 2-8) either the socketed device or soldered flash is mapped to the boot bank at FFF8,0000
lar portions of the memory map can be found in later sections of this manual, see
F800,0000—reserved (64 MB)
F600,0000R/WSoldered flash bank 4 (32 MB)4-7
F400,0000R/WSoldered flash bank 3 (32 MB)4-7
F080,0000—reserved (56 MB)
F3C0,0000R/WSoldered flash bank 2 (4 MB)4-7
F380,0000R/WSoldered flash bank 1 (4 MB)4-7
F000,0000R/WPCI Express I/O space (16 MB)4-8
E000,0000R/WPCI Express (256 MB)4-8
8000,0000R/WPCI (1.5 GB)4-8
0000,0000R/WSDRAM DDR2 (2 GB)4-7
Chip Selects
The MPC8548 memory controller functions as a chip select (CS) generator to access onboard memory devices. In order to select one device over another, the following chip
selects have been established.
Table 4-3: Device Chip Selects
Pin:Signal:
0Boot bank
1Soldered flash boot bank 1 (default)
2Soldered flash boot bank 2
3Socketed flash (optional)
4KSL CPLD registers
5NAND flash
6Soldered NOR flash boot banks 3 and 4
7LPC interface
1. Boot bank can be either socketed flash, flash 1, or flash 2;
The memory devices in the management complex consist of:
• 1 GB DDR2 SDRAM
• 512 KB socketed flash
• 8 MB soldered NOR flash (two redundant banks of 4 MB each)
• 1 GB soldered NAND flash
• 512 Mb or 64 MB soldered NOR flash
SDRAM
This is a specialized, socketed, 200-pin, small outline, clocked, dual in- line, memory module (SO-CDIMM). It provides Error-correcting Code (ECC) on the SDRAM memory bus operating at 200 MHz. The MPC8548 detects all double-bit errors, multi-bit errors within a
nibble and corrects all single-bit errors.
The 128M X 72 DDR2 SDRAM is a high-density, un-buffered SO-CDIMM. This module consists of nine 128x8-bit with eight banks DDR2 SDRAMs, a zero delay phase-lock loop (PLL)
clock, and a 2 KB serial presence detect (SPD) EEPROM. The SDRAM starts at physical
address 0000,0000
16
.
Flash
There are several flash devices on the local bus interfacing the CPLD and MPC8548 processor. The four soldered flash banks are labeled 1 through 4:
• Banks 1 and 2 are the MPC8548 U-boot banks (see “4M x 16”). These boot banks are
used in the boot redirection scheme, see “Boot Device Redirection (BDR).”
• Banks 3 and 4 are physically one device, but appear in the software as two banks of 32
MB (see “64 MB x 16”). These are for general purpose storage.
512 KB x 8 (optional)
The 512 KB of 32-pin PLCC socketed flash starts at physical address FC80,0000
for Engineering code.
access times, low power, and flexible security options.
4M x 16
The two 4 MB soldered flash devices are used for MPC8548 boot code. This redundant bank
configuration allows booting from either bank in case of corruption in one bank. See “Boot
Device Redirection (BDR)” on page 7-41. The SST NOR flash devices are organized as 4Mx8
The StrataFlash (P33) features high-performance fast asynchronous
10009109-01ATCA- 9305 User’s Manual
and is used
16
4-7
Page 64
Management Complex: PCI
in a dual-bank architecture for concurrent read/write operation with hardware and soft ware
data protection schemes. These devices start at physical addresses F000,0000
1) and F040,0000
1 GB x 16
The ATCA-9305 uses 1 GB of M-Systems DiskOnChip (mDOC H3) NAND flash starting at
physical address FC00,0000
(TFFS). This memory incorporates an embedded flash controller and memory, and includes
hardware protection and security-enabling features, an enhanced programmable boot
block enabling eXecution In Place (XIP) functionality using 16-bit access, user-controlled
One Time Programmable (OTP) partitions, and 6-bit Error Detection Code/Error Correction
Code (EDC/ECC).
64 MB x 16
The 64 MB soldered NOR flash starts at physical address F400,0000
P33 device provides CN5860 code storage and non-volatile memory.
(boot bank 2).
16
16
(boot bank
16
for non-volatile RAM storage and True Flash File System
(bank 3). The 64-Mbit
16
PCI
The MPC8548 performs all the functions of a PCI host and monarch, and handles all arbitration and enumeration functions. PCI starts at physical address 8000,0000
The PCI bus connects to both Cavium processors, the MPC8548 processor and the Broadcom Ethernet switch, see
Ta bl e 4- 4 . All of the devices on the PCI bus can operate at 66 MHz
and perform 64-bit transactions in conventional PCI mode except for the Broadcom switch.
The switch has a 32-bit PCI bus.
The MPC8548 stores the Cavium CN5860 operating system and monitor code in local
memory and then uses the boot over PCI functionality to bring up the CN5860 processor
complexes.
Table 4-4: PCI Device Interrupts and ID Assignments
The four lane PCIe routes between the MPC8548 and the optional rear transition module
(zone 3 connector). PCIe starts at physical address E000,000016.
16
.
4-8
ATCA-9305 User’s Manual10009109-01
Page 65
Management Complex: I2C Interface
I2C INTERFACE
The I2C interface consists of the MPC8548 initialization EEPROM, user (storage) NVRAM,
SO-CDIMM, and the Real-time Clock (RTC). The two Atmel two-wire serial EEPROMs on the
2
I
C interface consist of the Serial Clock (SCL) input and the Serial Data (SDA) bidirectional
The two EEPROMs store non-volatile information such as board, monitor, and operating system configurations as well as customer specific items.
Table 4-6: MPC8548 NVRAM Memory Map
Address Offset
EEPROM:
EEPROM-1
0xA2
(write
protected)
EEPROM-2
0xA0
(write
protected)
Note: Both EEPROMs are write-protected.
(hex):Description:
0x1FF0-0x1FFFBoot verify secondary area (monitor)16
0x1FE0-0x1FEFBoot verify primary area (monitor)16
0x1EE0-0x1FDFOperating system parameters (monitor)256
0x0000-x1EDFUser defined7903
0x0900-0x1FFFEmerson reserved area5887
0x0800-0x08FFMiscellaneous256
0x07F0-0x07FFPower-on Self-test (POST)16
0x0000-0x07EFUser defined2032
MANAGEMENT PROCESSOR HEADER AND SERIAL PORT
JTAG/COP Interface (optional)
The management complex uses header P2 for debug purposes.
Table 4-7: Serial Debug Connector, P2
Pin:Signal:Description:
1PQ_TDOTest Data Output is the serial data output as well as test and
2no connect—
Window
Size (bytes)
programming data.
10009109-01ATCA- 9305 User’s Manual
4-9
Page 66
Management Complex: Management Processor Header and Serial
Pin:Signal:Description: (continued)
3PQ_TDITest Data Input is the serial input pin for instructions as well as test and
4DEBUG_TRST*Test Reset input signal resets the test access port.
5no connect—
6PQ_JTAG_PWR3.3 volt power
7PQ_TCK_RTest Clock Input is the clock input to the boundary scan test (BST)
8no connect—
9PQ_TMSTest Mode Select input pin provides the control signal to determine
10no connect—
11DEBUG_SRESET*Soft Reset input signal indicates that the MPC8548 must initiate a
12ground—
13DEBUG_HRESET*Hard Reset input signal indicates that a complete Power-on Reset must
14no connect—
15PQ_CKSTP_OUT*Checkstop Out indicates the MPC8548 has detected a checkstop
16ground—
programming data.
circuitr y.
the transitions of the TAP controller state machine.
System Reset interrupt.
be initiated by the MPC8548.
condition and has ceased operation.
4-10
Serial Debug Port
The console port for the management processor is accessible via the front panel mini-B USB
connector P7. The supported baud rates for these ports operate at 9600, 14400, 19200,
38400, 57600, and 115200 bps.
The ATCA-9305 uses a Programmable Logic Device (PLD) to provide control logic for the
local bus. The PLD implements various registers for reset, hardware, and LPC bus communication between the processors.
MPC8548 PLD REGISTER SUMMARY
The PLD registers start at address FC40,000016. As a rule, registers retain their values
through all resets except for power-on and front panel reset.
isters followed by the register bit descriptions.
Table 5-1: PLD Register Summary
Address
Offset (hex):Mnemonic:Register Name: See Page:
0x84CGDOCavium GPIO Data Out5-13
0x88CGDICavium GPIO Data In5-13
0x8CIGCRIPMP/IPMC GPIO Control5-14
0xD0LPC1Low Pin Count (LPC) Bus Control5-14
0xD4LPCDLPC Data5-15
0xD8SIRQI1Serial IRQ Interrupt 1 [15:8]5-15
0xDCSIRQI2Serial IRQ Interrupt 2 [7:0]5-15
1. Scratch 1 (0x40) is a read/write register for storage only.
Product ID
This read-only register identifies the board as ATCA-9305, and is used for PLD coding.
Register 5-1: Product ID (0x00)
Bits:Function:Description:
7CAVF1Cavium Frequency 1
6CAVF0Cavium Frequency 0
50Product ID
40
30
20
1HC1Hardware Configuration 1
0HC0Hardware Configuration 0
Hardware Version
This read-only register tracks hardware revisions.
Register 5-2: Hardware Version (0x04)
Bits:Function:Description:
70
60
50
40
3HVN (3)Hardware Version Number is hard coded in the PLD and changes
2HVN (2)
1HVN (1)
0HVN (0)
5-2
ATCA-9305 User’s Manual10009109-01
with every major PCB artwork version.
Version star ts at 00
.
16
Page 69
Management Processor CPLD: MPC8548 PLD Register
PLD Version
This read-only register tracks PLD revisions.
Register 5-3: PLD Version (0x08)
Bits:Function:Description:
70This is hard coded in the PLD and changes with every released code
60
50
40
30
20
10
00
PLL Reset Configuration
Write to this register to reconfigure the SYSCLK to CCB clock ratio and the CCB to CORE
clock ratio using valid values from the MPC8548E PowerQUICC™ III Integrated Processor Family Reference Manual. The changes take affect when the processor is reset (for example, the
software hard reset command or watchdog timer expires). Default values are restored
when the board is power-cycled, front panel reset is pressed, or receives a PCI reset that was
not the result of the MPC8548 software initiating a PCI RSTOUT command.
Register 5-4: PLL Reset Configuration (0x0C)
change. Version starts at 00
.
16
Bits:Function:Description:
7reserved
6CCCB2CCB2 to CORE clock ratio
5CCCB1CCB1 to CORE clock ratio
4CCCB0CCB0 to CORE clock ratio
3CCBSYS3SYSCLOCK3 to CCB clock ratio
2CCBSYS2SYSCLOCK2 to CCB clock ratio
1CCBSYS1SYSCLOCK1 to CCB clock ratio
0CCBSYS0SYSCLOCK0 to CCB clock ratio
Hardware Configuration 0
The read-only HCR0 allows the MPC8548 monitor software to easily determine specific
hardware configurations, such as the processor clock and MPC8548 DDR memory.
10009109-01ATCA- 9305 User’s Manual
5-3
Page 70
Management Processor CPLD: MPC8548 PLD Register
Register 5-5: Hardware Configuration 0 (0x10)
Bits:Function:Description:
70
6P33PP33 (StrataFlash) is Present
5RST_IND_CLRClear the Reset Indication to the IPMC controller
4CAVF1Cavium Frequency 1
3CAVF0Cavium Frequency 0
2PQCF1MPC8548 Core Frequency 1
1PQCF0MPC8548 Core Frequency 0
0PQDDRFMPC8548 DDR SDRAM Fast
Jumper Settings
These read-only bits may be read by software to determine the current jumper settings. See
the jumper descriptions on page 2-8.
Register 5-6: Jumper Settings (0x18)
Bits:Function:Description:
70
60
50
4SJCavium Boot Flash Jumper
0 Installed, Cavium processors boot from soldered flash
1 Not installed, Cavium processors boot from socket
3BOOTBoot PCI Jumper
0 Installed, boot from flash (socket or soldered per bit 4)
1 Not installed, boot over PCI from the MPC8548
0 Not installed, SROM is used for initialization (default)
1 Installed, disables SROM, uses default values in monitor
code
0 Not installed, enables MPC8548 to boot from soldered
flash (default)
1 Installed, enables MPC8548 to boot from socketed flash
LED
Writing a one to an LED bit lights that LED. During monitor power-up, the debug LEDs are
used to display the software progress.
5-4
ATCA-9305 User’s Manual10009109-01
Page 71
Management Processor CPLD: MPC8548 PLD Register
Register 5-7: LED (0x1C)
Bits:Function:Description:
7PQREDMPC8548 red LED
Lit on power-up and turned off when the monitor finishes boot
up and Power-on Self Testing (POST)
6PQGREENMPC8548 green LED
5SWLEDCLKEthernet Switch LED Clock
4SWLEDDATEthernet Switch LED Data
3DEBUGLED3LED CR22
2DEBUGLED2LED CR21
1DEBUGLED1LED CR19
0DEBUGLED0LED CR18
Reset Event
This read-only register contains the bit corresponding to the most recent event which
caused a reset. When power is first applied, the FP_PSH_BUTTN reset event is not latched
into the Reset Event register, this is the Power-on Reset (POR) event. Front panel reset
events which occur after power-up will be latched.
Note: At power-up, the FRST_PWR_UP defaults to 1.
Register 5-8: Reset Event (0x20)
Bits:Function:Description:
7RTMPBRTM push button
6SHRSoftware Hard Reset Set to 1 when the last reset was caused
by a write to the Reset Command register
5CPUHRRCPU Hard Reset Request
4COPSRSet to 1 when a COP header or software-issued Soft Reset
(SRESET) has occurred
3COPHRSet to 1 when a COP header Hard Reset (HRESET) has occurred
2PAYRSet to 1 when a Payload Reset from the IPMC has occurred
1SBRSoftware Board Reset
Set to 1 when the IPMC software issued the board (payload)
reset
0FPPB Front Panel Push Button (FP_PSH_BUTTN, POR_RST)
Reset Command 1
The write-only Reset Command 1 register forces one of several types of resets, as shown
below. A reset sequence is first initiated by writing a one to a single valid bit, then the PLD
performs that particular reset, and the bit is automatically cleared.
10009109-01ATCA- 9305 User’s Manual
5-5
Page 72
Management Processor CPLD: MPC8548 PLD Register
Register 5-9: Reset Command 1 (0x24)
Bits:Function:Description:
7WBRReset the Whole Board
6PQCRReset the MPC8548 Complex
5CAV1CRReset the Cavium CN5860 1 Complex
4CAV2CRReset the Cavium CN5860 2 Complex
3SWICRReset the switch BCM5680x Complex
2I2C RReset the I2C on the MPC8548
1RTMRReset the (optional) RTM
0reserved
Reset Command 2
The write-only Reset Command 2 register forces one of several types of MPC8548 resets, as
shown below. A reset sequence is first initiated by writing a one to a single valid bit, then the
PLD performs that particular reset, and the bit is automatically cleared.
The write-only Reset Command 3 register forces one of several types of Cavium 1 resets, as
shown below. A reset sequence is first initiated by writing a one to a single valid bit, then the
PLD performs that particular reset, and the bit is automatically cleared.
The write-only Reset Command 4 register forces one of several types of Cavium 2 resets, as
shown below. A reset sequence is first initiated by writing a one to a single valid bit, then the
PLD performs that particular reset, and the bit is automatically cleared.
The write-only Reset Command 5 register forces one of several types of BCM5680x Ethernet
switch resets, as shown below. A reset sequence is first initiated by writing a one to a single
valid bit, then the PLD performs that particular reset, and the bit is automatically cleared.
Register 5-13: Reset Command 5 (0x34)
Bits:Function:Description:
7SWIRSwitch Reset
6TSEC1RTSEC1 Ethernet to front panel PHY Reset
5TSEC2RTSEC2 Ethernet to switch PHY Reset
4FPIRFPI Ethernet to front panel PHY Reset
3BCREthernet dual PHY to backplane Base Channel reset
2reserved
1reserved
0reserved
Reset Command Sticky #1
The read/write Reset Command Sticky #1 register forces one of several types of the groupcomplex resets, as shown below. A reset sequence is first initiated by writing a one to one or
more bits, then the PLD performs that particular reset. The bit will persist until cleared.
10009109-01ATCA- 9305 User’s Manual
5-7
Page 74
Management Processor CPLD: MPC8548 PLD Register
Note: The board powers down and powers back up when the Cavium processors power is back up (bits 0 or 1 are
cleared).
Register 5-14: Reset Command Sticky #1 (0x38)
Bits:Function:Description:
7
6
5
4
3
2
1
0
Reset Command Sticky #2
The read/write Reset Command Sticky #2 register forces one of several types of the PHY
reset command, as shown below. A reset sequence is first initiated by writing a one to one
or more bits, then the PLD performs that particular reset. The bit will persist until cleared.
Register 5-15: Reset Command Sticky #2 (0x3C)
CAV1CCavium 1 Complex reset
CAV2CCavium 2 Complex reset
SWICSwitch Complex reset
CAV1CFCavium 1 Complex 4MB Flash reset
CAV2CFCavium 2 Complex 4MB Flash reset
NANDFNAND Flash reset
CAV2RPDReset and power down the Cavium 2 core
CAV1RPDReset and power down the Cavium 1 core
Bits:Function:Description:
7TSEC1RTSEC1 Ethernet to front panel PHY Reset
6TSEC2RTSEC2 Ethernet to switch PHY Reset
5FPIRFPI Ethernet from switch to front panel PHY Reset
4BCREthernet dual PHY to backplane Base Channel Reset
3MIP1SPI to XAUI bridge #1 on Cavium 1
2MIP2SPI to XAUI bridge #2 on Cavium 1
1MIP3SPI to XAUI bridge #3 on Cavium 2
0MIP4SPI to XAUI bridge #4 on Cavium 2
Boot Device Redirection
The read/write Boot Device Redirection register (BDRR) allows the user to determine which
of three boot devices the MPC8548 CPU is using as the boot device. Several bits also indicate which device was set as the initial boot device. The Boot Redirected bit is set to a 1
when the current boot device does not match the initial default boot device. This indicates
to the user that the image in the default device was bad, the MPC8548 watch dog timer
expired, and the next device was tried. The boot device redirection order is determined by
IPMC. Reference the “Boot Device Diagram”.
5-8
ATCA-9305 User’s Manual10009109-01
Page 75
Management Processor CPLD: MPC8548 PLD Register
Register 5-16: Boot Device Redirection (0x50)
Bits:Function:Description:
7SELFRSSelf Refresh Started
6BOOTSEL1 IPMC successful boot indication (BOARD_BOOTED)
5reserved
4BSJBoot from Socket Jumper A shunt on J9 [1:2] selects the
512KB socketed ROM as the boot device, see Fig. 2-6.
3NFBSNand Flash Busy Signal
2BDSActive boot device is socket
1BDF1Active boot device is flash 2
0BDF0Active boot device is flash 1
Miscellaneous Control
This register includes two bits for manually toggling the MPC8548 I2C bus.
Register 5-17: Miscellaneous Control (0x54)
Bits:Function:Description:
7P33WP0 Write Protect disabled (default until the monitor boots)
6SROM1WP0 Write Protect disabled
5SROM0WP0 Write Protect disabled
4FLASH1WP0 Write Protect disabled (default until the monitor boots)
3FLASH0WP0 Write Protect disabled (default until the monitor boots)
2NANDWP0 Write Protect disabled
1I2CSDAI
0I2CSCL
1Write Protect enabled
1 Write Protect enabled (default)
1 Write Protect enabled (default)
1Write Protect enabled
1Write Protect enabled
1 Write Protect enabled (default)
2
C Data line
0 Drive a 0 onto the I2C SDA line
1 Drive a 1 onto the I2C SDA line
2
I
C Clock line
0Drive a 0 onto the I2C SCL line
1Drive a 1 onto the I2C SCL line
Low Frequency Timer 1 and 2
Registers LFTR1 (0x58) and LFTR2 (0x5C) are timers. They determine how many 50 μs intervals you want before the next interrupt on Cavium GPIO5.
Note: Unless the frequency is set to 0, there is always one 50 μs interval. This is the reason for the register setting
being 1 less than an even hundred, for example 199 rather than 200.
10009109-01ATCA- 9305 User’s Manual
5-9
Page 76
Management Processor CPLD: MPC8548 PLD Register
Table 5-2: Low Frequency Timer Settings
Frequency:Set Register:Comments:
0OffNever interrupts
1 Hz19999 (0x4E1F)These frequencies require the use of both registers
10 Hz1999 (0x7CF)
100 Hz199 (0xC7)
1 KHz19 (0x13)
10 KHz1This equals two 50 μs time units (default)
RTM GPIO State
This read-only register reads the current state of the GPIO pins.
Use the C_MUL1 register to reduce the speed of the Cavium CN5860 processor 1 core.
Caution: Do not over-clock the Cavium frequency (bits 6:7 hard strapped).
0000 = Test RTM (factor y only)
1000 = 20GbE I/O RTM
1100 = 18GbE and 2x10GbE I/O RTM
1010 = Storage RTM
Register 5-21: Cavium 1 C_MULL Clock Divisor Control (0x70)
Bits:Function:Description:
7CAVFCavium Frequency resistor set bit (read-only)
6
5CMULOEC_MUL Output Enable
4P1CMUL4These bits drive directly to the Cavium 1. The core clock speed
3P1CMUL3
2P1CMUL2
1P1CMUL1
0P1CMUL0
00 600
01 750
10 800
11 reserved
is the number multiplied by 50 MHz. For example, the 800 MHz
core is set to 16(0x10).
Cavium 2 C_MUL Clock Divisor Control
Use the C_MUL2 register to reduce the speed of the Cavium CN5860 processor 2 core.
Caution: Do not over-clock the Cavium frequency (bits 6:7 hard strapped).
10009109-01ATCA- 9305 User’s Manual
5-11
Page 78
Management Processor CPLD: MPC8548 PLD Register
Register 5-22: Cavium 2 C_MULL Clock Divisor Control (0x74)
Bits:Function:Description:
7CAVF1Cavium 1 Frequency resistor set bit (read-only, see Register
Map 5-21)
6CAVF0Cavium 0 Frequency resistor set bit (read-only)
5CMULOEC_MUL Output Enable
4P1CMUL4These bits drive directly to the Cavium 2. The core clock speed
3P1CMUL3
2P1CMUL2
1P1CMUL1
0P1CMUL0
JTAG
This register allows for manual reprogramming of the PLDs on the board. Changes to this
register do not take effect until after a full board reset.
Register 5-23: JTAG (0x78)
Bits:Function:Description:
7reserved
6reserved
5JTAGOENJTAG Output Enable
4JTAGTCKSELJTAG Test Clock Select changes from header to PLD as the TCK
3JTAGTCKJTAG Test Clock
2JTAGTMSJTAG Test Mode Select
1JTAGTDOJTAG Test Data Output
0JTAGTDIJTAG Test Data Input (read only)
is the number multiplied by 50 MHz. For example, the 800 MHz
core is set to 16(0x10).
source
5-12
Cavium GPIO Control
Each Cavium processor has three GPIO control bits connected to the PLD. This register
determines whether the PLD is driving or receiving on these lines. Setting a bit to 1 causes
the PLD to drive the corresponding line.
Register 5-24: Cavium GPIO Control (0x80)
Bits:Function:Description:
7reserved
6reserved
5P2GPIO5OEProcessor 2 GPIO5 Output Enable (enabled is the default)
Output enable is set for the TIC timer output to the Cavium
4P2GPIO4OEProcessor 2 GPIO4 Output Enable
This is an input from the Cavium to reset the MIP4
ATCA-9305 User’s Manual10009109-01
Page 79
Management Processor CPLD: MPC8548 PLD Register
Bits:Function:Description: (continued)
3P2GPIO3OEProcessor 2 GPIO3 Output Enable
2P1GPIO5OEProcessor 1 GPIO5 Output Enable (enabled is the default)
1P1GPIO4OEProcessor 1 GPIO4 Output Enable
0P1GPIO3OEProcessor 1 GPIO3 Output Enable
Cavium GPIO Data Out
This register is the data that will be driven on the GPIO line when the Output enable is set.
Register 5-25: Cavium GPIO Data Out (0x84)
Bits:Function:Description:
7reserved
6reserved
5reserved
4P2GPIO4Set the value of the Cavium 2 GPIO bit 4
3P2GPIO3Set the value of the Cavium 2 GPIO bit 3
2reserved
1P1GPIO4Set the value of the Cavium 1 GPIO bit 4
0P1GPIO3Set the value of the Cavium 1 GPIO bit 3
This is an input from the Cavium to reset the MIP3
Output enable is set for the TIC timer output to the Cavium
This is an input from the Cavium to reset the MIP2
This is an input from the Cavium to reset the MIP1
Cavium GPIO Data In
This register reads the value on the GPIO lines connected to each Cavium.
Register 5-26: Cavium GPIO Data In (0x88)
Bits:Function:Description:
7reserved
6reserved
5reserved
4P2GPIO4Read the value of the Cavium 2 GPIO bit 4
3P2GPIO3Read the value of the Cavium 2 GPIO bit 3
2reserved
1P1GPIO4Read the value of the Cavium 1 GPIO bit 4
0P1GPIO3Read the value of the Cavium 1 GPIO bit 3
10009109-01ATCA- 9305 User’s Manual
5-13
Page 80
Management Processor CPLD: MPC8548 PLD Register
IPMP/IPMC GPIO Control
This register provides access (if required) to signals between the KSL CPLD and the IPMP, as
well as to signals between the KSL CPLD and the IPMC. The lower two bits can request
request the power down of a Cavium core from the sticky reset register.
Register 5-27: IPMP/IPMC GPIO Control (0x8C)
Bits:Function:Description:
7IPMC2KSL4Input only
6IPMC2KSL3
5IPMC2KSL2
4IPMC2KSL1
3IPMP2KSL4Output only
2IPMP2KSL3Output only
1IPMP2KSL2Power-down signal for Cavium 2 (output)
Ass ert hig h to shut dow n the cor e. The stick y Cavi um reset also
causes this to be asserted.
0IPMP2KSL1Power-down signal for Cavium 1 (output)
Ass ert hig h to shut dow n the cor e. The stick y Cavi um reset also
causes this to be asserted.
5-14
LPC Bus Control
This is the control register for the 4-bit LPC bus. It allows for communication with the IPMC
controller from the management CPU.
Register 5-28: LPC Bus (0xD0)
Bits:Function:Description:
7LPCIELPC Interrupt Enable
6LPCSLPC State (internal use only)
5
4
3
2LPCIOELPC I/O Error
1SYNCESYNC Error
0SYNCTSYNC Time-out
LPC Data
This is the data register for the 4-bit LPC bus. It allows for communication with the IPMC
controller from the management CPU. This register provides the data to be sent or received,
depending upon the commands given in the control register.
ATCA-9305 User’s Manual10009109-01
Page 81
Management Processor CPLD: MPC8548 PLD Register
Register 5-29: LPC Data (0xD4)
Bits:Function:Description:
7:0-LPC Data
Serial IRQ Interrupt 1
This is interrupt register1 for the LPC bus.
Register 5-30: Serial IRQ Interrupts 1 (0xD8)
Bits:Function:Description:
7:0-Interrupts
Serial IRQ Interrupt 2
This is interrupt register2 for the LPC bus.
Register 5-31: Serial IRQ Interrupts 2 (0xDC)
Bits:Function:Description:
7:0-Interrupts
10009109-01ATCA- 9305 User’s Manual
5-15
Page 82
(blank page)
5-16
ATCA-9305 User’s Manual10009109-01
Page 83
Ethernet Interface
The ATCA-9305 supports multiple Ethernet interfaces. This chapter describes the Broadcom
BCM56802 switch, PHYS BCM5482 and BCM5461S, Ethernet address, LEDs and connectors.
BROADCOM BCM56802 SWITCH
The BCM56802 is a 16-port, 10-GbE multi-layer switch based on the StrataXGS® architecture. The switch operates at 66 MHz with a 32-bit PCI bus for processor communication.
SERDES functionality includes 10-Gbps XAUI and 1-Gbps SGMII PHY interfaces.
One 10/100/1000BASE-T Ethernet (SGMII) port is routed to a front panel RJ45 connector
(see
Fig. 6-1), one is routed to the MPC8548 management processor TSEC2 port, and two
are routed to the base channel backplane (see
the back panel via the fabric channel (see
Two XAUI ports process packets to and from each CN5860 processor. Six 10 GbE XAUI ports
route to the optional rear transition module (RTM). See
ments.
Note: Proprietary information on the Broadcom switch is not available in this user’s manual. Refer to their web site
for available documentation.
Section 6
Fig. 8-2). Two 10 GbE XAUI ports connect to
Fig. 8-2).
Ta bl e 8- 3 and Ta bl e 8 -4 for pin assign-
ETHERNET SWITCHING
The base interface Ethernet ports are provided by the Broadcom BCM56802 16-port, 10
gigabit (GbE) switch. The SerDes functionality includes 10-Gbps XAUI and 1-Gbps SGMII
PHY interfaces. The integrated SerDes complies with the CX-4 standard and PICMG 3.1
standard. The Fabric interface is compliant with PICMG 3.1 Revision 1.0, specifically link
option 9 (one 10GBASE-BX4). Switch connectivity consists of the following devices:
• Two 10GbE ports to CN5860 processor complex 1
• Two 10GbE ports to CN5860 processor complex 2
• One GbE port to the front panel (RJ45 connector)
• One GbE port to the MPC8548 management processor complex, then out the front
panel (RJ45 connector)
• Two 10 GbE ports to the fabric interface
• Two 1 GbE ports to the base interface
• Two or six 10 GbE ports to the Zone 3 connector (optional RTM)
10009109-01ATCA- 9305 User’s Manual
6-1
Page 84
Ethernet Interface: Ethernet Switching
10G - 4 PORTS
RJ45RJ45
BCM5482
Base10G Fabric
J23
P1 DDR2
SDRAM
BCM56802
XAUI 10 Gb
Switch Ports
5 XAUI
SGMII2SGMII1XAUI
8 7
XAUI 13
XAUI 14
3
SGMII
4
SGMII
6 XAUI
Cavium
Octeon
CN5860
Processor 2
SPI-1
SPI-0
Cavium
Octeon
CN5860
Processor 1
SPI-1
SPI-0
BCM5461S
Stratix II GX
#2
MPC8548
Management
Processor
J31
10G - 2 PORTS
J30
XAUI
11-12 15 -18
Stratix II GX
#1
Stratix II GX
#3
Stratix II GX
#4
BCM5461S BCM5461S
To Optional RTM
Figure 6-1: Ethernet Switching Interface Diagram
star ts at 0. Ther efore, t o issue a command to a por t, you mus t subtra ct 1 fro m the port n umbers shown in the
figure.
Ethernet Transceivers
The BCM5461S is a 10/100/1000BASE-T GbE Ethernet transceiver using the SGMII interface.
The BCM5482 consists of two complete 10/100/1000BASE-T GbE transceivers supporting
both voice and data simultaneously.
Ethernet Switch Ports
Port:Interface:Connection:
Note: The phyiscal port numbering starts at 1, as indicated in the figure. However, the software port numbering
Table 6-1: Ethernet Switch Ports
1SGMII 1 GBPHY to backplane BASE
2SGMII 1 GBPHY to backplane BASE
3SGMII 1 GBSwitch PHY to front panel RJ45 connector
4SGMII 1 GBManagement processor PHYs to front panel RJ45 connector
5XAUI 10 GBStratix II GX bridge 2
6XAUI 10 GBStratix II GX bridge 1
7XAUI 10 GBBack plane Fabric
8XAUI 10 GBBack plane Fabric
9—not used
10—not used
11XAUI 10 GBBCM56802 to J30 to optional RTM
12
13XAUI 10 GBStratix II GX bridge 3
14XAUI 10 GBStratix II GX bridge 4
15XAUI 10 GBBCM56802 to J31 to optional RTM
16
17
18
VLAN Setup
The default VLAN configuration is defined in Tab l e 6 - 2 . See page 9-25 for the monitor vlan
command.
Table 6-2: VLAN Configuration
VLAN:Ports:
11, 3, 4
26, 7
38, 13
45, 11
512, 14
MPC8548 MANAGEMENT PROCESSOR ETHERNET ADDRESS
The Ethernet address for your board is a unique identifier on a network. The address consists of 48 bits (MAC [47:0]) divided into two equal parts. The upper 24 bits define a unique
identifier that has been assigned to Emerson Network Power, Embedded Computing by
IEEE. The lower 24 bits are defined by Emerson for identification of each of our products.
The Ethernet address for the ATCA-9305 is a binary number referenced as 12 hexadecimal
digits separated into pairs, with each pair representing eight bits. The address assigned to
the ATCA-9305 has the following form:
00 80 F9 is Emerson’s identifier. The last three bytes of the Ethernet address consist of the
port (one byte), 0x97(port 1) or 0x98 (port 2), followed by the serial number (two byte
hexadecimal). The ATCA-9305 has been assigned the Ethernet address range
00:80:F9:97:00:00 to 00:80:F9:98:FF:FF. The format is shown in
Table 6-3: Ethernet Port Address
Offset:MAC:Description:Ethernet Identifier (hex):
Byte 515:0LSB of (serial number in hex)—
Byte 4MSB of (serial number in hex)—
Byte 323:16Port 1 (TSEC_1)
Byte 247:24Assigned to Emerson by IEEE0xF9
Byte 10x80
Byte 00x00
The last two bytes, MAC[15:0], correspond to the following formula: n —1000, where n is
the unique serial number assigned to each board. So if an ATCA-9305 serial number is 1032,
the calculated value is 32 (20
• TSEC_1 MAC address is: 0x00 0x80 0xF9 0x97 0x00 0x20
Port 2 (TSEC_2)
), and the default Ethernet port addresses are:
16
Tab l e 6- 3 .
0x97
0x98
• TSEC_2 MAC address is: 0x00 0x80 0xF9 0x98 0x00 0x20
Front Panel Ethernet Ports
One MPC8548 PHY (TSEC1) routes to front panel RJ45 connector, P1. The BCM56802 switch
PHY (port 3) routes to front panel RJ45 connector, P3. The Ethernet port LEDs (green or yellow) indicate link and activity status, see front panel
Table 6-4: Front Panel Ethernet Ports
Pin:P1 Signal:P3 Signal:
1TSEC1_TRD0_PFP1_TRD0_P
2TSEC1_TRD0_NFP1_TRD0_N
3TSEC1_TRD1_PFP1_TRD1_P
4TSEC1_TRD2_PFP1_TRD2_P
5TSEC1_TRD2_NFP1_TRD2_N
6TSE1C_TRD1_NFP1_TRD1_N
7TSEC1_TRD3_PFP1_TRD3_P
8TSEC1_TRD3_NFP1_TRD3_N
9TSEC1_ACTIVITY (green LED 1)FP1_ACTIVITY (green LED1)
102_5V (yellow LED 1)2_5V (yellow LED 1)
11TSEC1_LINKSPD1 (green LED 2)FP1_LINKSPD1 (green LED 2)
12TSEC1_LINKSPD2 (yellow LED 2)FP1_LINKSPD2 (yellow LED 2)
13TSEC1_CHSGNDFP1_CHSGND
14TSEC1_CHSGNDFP1_CHSGND
10009109-01ATCA- 9305 User’s Manual
6-5
Page 88
(blank page)
6-6
ATCA-9305 User’s Manual10009109-01
Page 89
System Management
The ATCA-9305 provides an intelligent hardware management system, as defined in the
AdvancedTCA Base Specification (PICMG® 3.0). This system implements an Intelligent Platform Management Controller (IPMC) based on the BMR-H8S-AMCc® reference design from
Pigeon Point Systems. It also has an inter-integrated circuit (I
Intelligent Platform Management Bus (IPMB) that routes to the ATCA backplane.
The IPMC implements all the standard Intelligent Platform Management Interface (IPMI)
commands and provides hardware interfaces for other system management features such
as Hot Swap control, LED control, power negotiation, and temperature and voltage monitoring. The IPMC also supports an EIA-232 interface for serial communications via the Serial
Interface Protocol Lite (SIPL) IPMI commands.
IPMC OVERVIEW
The basic features for the IPMC implementation include:
• Conformance with AdvancedTCA Base Specification (PICMG® 3.0)
2
C) controller to support an
Section 7
• Geographical addressing according to PICMG® 3.0
• Ability to read and write Field Replaceable Unit (FRU) data
• Ability to reset IPMC from IPMB
• Ability to read inlet and outlet airflow temperature sensors
• Ability to read payload voltage/current levels
• Ability to send event messages to a specified receiver
• All sensors generate assertion and/or de-assertion event messages
• Support for fault tolerant HPM.1 firmware upgrades
• Support for field updates of firmware via IPMB-0 or the payload interface
• Redundant boot bank capability
10009109-01ATCA- 9305 User’s Manual
7-1
Page 90
System Management: IPMI Messaging
UART
& LPC
Figure 7-1: IPMC Connections Block Diagram
IPMI MESSAGING
All IPMI messages contain a Network Function Code field, which defines the category for a
particular command. Each category has two codes assigned to it–one for requests and one
for responses. The code for a request has the least significant bit of the field set to zero,
while the code for a response has the least significant bit of the field set to one.
the network function codes (as defined in the IPMI specification) used by the IPMC.
00 = command/request, 01 = response:
common chassis control and status functions
02 = request, 03 = response:
message contains data for bridging to the next
bus. Typically, the data is another message,
which also may be a bridging message. This
function is only present on bridge nodes.
04 = command/request, 05 = response:
for configuration and transmission of Event
Messages and system Sensors. This function
may be present on any node.
06 = command/request, 07 = response:
message is implementation-specific for a
particular device, as defined by the IPMI
specification
08 = command/request, 09 = response:
firmware transfer messages match the format
of application messages, as determined by the
particular device
0A = command/request, 0B = response:
may be present on any node that provides
nonvolatile storage and retrieval services
vendor specific: 16 network functions (8 pairs).
The vendor defines functional semantics for
cmd and data fields. The cmd field must hold the
same value in requests and responses for a
given operation to support IPMI message
handling and transport mechanisms. The
controller’s Manufacturer ID value identifies the
vendor or group.
10009109-01ATCA- 9305 User’s Manual
7-3
Page 92
System Management: IPMI Messaging
IPMI Completion Codes
All IPMI response messages contain a hexadecimal Completion Code field that indicates the
status of the operation.
Table 7-2: Completion Codes
Code:Description:
Generic Completion Codes 00, C0-FF
00Command completed normally
C0Node busy–command could not be processed because command-processing resources
are temporarily unavailable
C1Invalid command–indicates an unrecognized or unsupported command
C2Command invalid for given LUN
C3Time-out while processing command, response unavailable
C4Out of space–command could not be completed because of a lack of storage space
required to execute the given command operation
C5Reservation canceled or invalid Reservation ID
C6Request data truncated
C7Request data length invalid
C8Request data field length limit exceeded
C9Parameter out of range–one or more parameters in the data field of the Request are out
CACannot return number of requested data bytes
CBRequested sensor, data, or record not present
CCInvalid data field in Request
CDCommand illegal for specified sensor or record type
CECommand response could not be provided
CFCannot execute duplicated request–for devices that cannot return the response returned
D0Command response could not be provided, SDR Repository in update mode
D1Command response could not be provided, device in firmware update mode
D2Command response could not be provided, Baseboard Management Controller (BMC)
D3Destination unavailable–cannot deliver request to selected destination. (This code can be
D4Cannot execute command, insufficient privilege level
D5Cannot execute command, parameter(s) not supported in present state
FFUnspecified error
of range. This is different from Invalid data field code (CC) because it indicates that the
erroneous field(s) has a contiguous range of possible values.
for the original instance of the request. These devices should provide separate commands
that allow the completion status of the original request to be determined. An Event
Receiver does not use this completion code, but returns the 00 completion code in the
response to (valid) duplicated requests.
initialization or initialization agent in progress
returned if a request message is targeted to SMS, but receive message queue reception is
disabled for the particular channel.)
7-4
ATCA-9305 User’s Manual10009109-01
Page 93
System Management: IPMB Protocol
Code:Description: (continued)
Device-Specific (OEM) Codes 01-7E
01-7EDevice specific (OEM) completion codes–command-specific codes (also specific for a
particular device and version). Interpretation of these codes requires prior knowledge of
the device command set.
Command-Specific Codes 80-BE
80-BEStandard command-specific codes–reserved for command-specific completion codes
(described in this chapter)
IPMB PROTOCOL
The IPMB message protocol is designed to be robust and support many different physical
interfaces. The IPMC supports messages over the IPMB interface. Messages are defined as
either a request or a response, as indicated by the least significant bit in the Network Function Code of the message.
Table 7-3: Format for IPMI Request Message
Byte:Bits:
76543210
1rsSA
2Network Function (netFn)
3Checksum
4
5rqSeq
6Command
7:NData
N+1Checksum
rsLUN
rqSA
rqLUN
• The first byte contains the responder’s Slave Address, rsSA.
• The second byte contains the Network Function Code, netFn, and the responder’s
Logical Unit Number, rsLUN.
• The third byte contains the two’s-complement checksum for the first two bytes.
• The fourth byte contains the requester’s Slave Address, rqSA.
• The fifth byte contains the requester’s Sequence Number, rqSeq, and requester’s Logical
Unit Number, rqLUN. The Sequence number may be used to associate a specific response
to a specific request.
• The sixth byte contains the Command Number.
10009109-01ATCA- 9305 User’s Manual
7-5
Page 94
System Management: SIPL Protocol
• The seventh byte and beyond contain parameters for specific commands (if required).
• The final byte is the two’s-complement checksum of all of the message data after the
first checksum.
An IPMI response message (see
difference is that the seventh byte contains the Completion Code, and the eighth byte and
beyond hold data received from the controller (rather than data to send to the controller).
Also, the Slave Address and Logical Unit Number for the requester and responder are
swapped.
The IPMC supports the Serial Interface Protocol Lite (SIPL) protocol. It supports raw IPMI
messages in SIPL and handles these messages the same way as it handles IPMI messages
from the IPMB-0 bus, except that the replies route to either the payload or serial debug
interface. Messages are entered as case-insensitive hex-ASCII pairs, separated optionally by
a space, as shown in the following examples:
[18 00 22]<newline>
[180022]<newline>
The IPMC does not, however, support SIPL ASCII text commands, as defined by the IPMI
specification.
Tab l e 7- 4 ) is similar to an IPMI request message. The main
rqLUN
rsSA
rsLUN
The IPMC does support Pigeon Point Systems extension commands, implemented as OEM
IPMI commands. These commands use Network Function Codes 2E/2F (hex), and the message body is transferred similarly to raw IPMI messages, as described previously.
The following figures show an example of an extension command request and response,
respectively.
7-6
ATCA-9305 User’s Manual10009109-01
Page 95
System Management: Message Bridging
[B8 00 01 0A 40 00 12]
Command Code
rqSeq (00
16
) / Bridge (002)
NetFn Code (2E
16
) / LUN (002)
Pigeon Point IANA
Data
[B8 00 01 0A 40 00 12]
Command Code
rqSeq (00
16
) / Bridge (002)
NetFn Code (2E
16
) / LUN (002)
Pigeon Point IANA
Data
[BC 00 01 00 0A 40 00 34]
Command Code
rqSeq (00
16
) / Bridge (002)
NetFn Code (2F
16
) / LUN (002)
Pigeon Point IANA
Dat
a
Completion Code
Figure 7-2: Extension Command Request Example
Figure 7-3: Extension Command Response Example
MESSAGE BRIDGING
The Message Bridging facility is responsible for bridging messages between various interfaces of the ATCA-9305 IPMI. The message bridging is implemented via the standard Send
Message command.
The ATCA-9305 IPMC also supports message bridging between the Payload Interface and
IPMB-0, which allows the payload to send custom messages to and receive them from other
shelf entities, such as the shelf manager. Message bridging is implemented using the
Send/Get Message commands and also via LUN 10 of the ATCA-9305 IPMC.
10009109-01ATCA- 9305 User’s Manual
7-7
Page 96
System Management: Message Bridging
The following example illustrates how the Send/Get Message and Get Address Info commands can be used by the payload software to get the physical location of the board in the
shelf:
1 The payload software sends the Get Address Info command to the BMR-H8S-AMCc,
requesting address information for FRU device 0. Using the SIPL protocol:
[B0 xx 01 00]
2 The BMR-H8S-AMCc returns its IPMB address in the Get Address Info reply. In this example,
72
is the IPMB-0 address of the IPMC.
16
{B4 00 01 00 00 FF 72 FF 00 01 07]
3 The payload software composes a Get Address Info command requesting the responder to
provide its addressing information for FRU device 0. The request is composed in the IPMB
format. The responder address is set to 20
is set to the value obtained in the previous step.
{20 B0 30 72 00 01 00 8D]
4 The payload software forwards the command composed in the previous step to the shelf
manager using the Send Message command. The Send/Get Message in SIPL format is:
[18 xx 34 40 20 B0 30 72 00 01 00 8D]
5 The BMR-H8S-AMCc firmware sends the Get Address Info request to the shelf manager,
waits for a reply to this request, and sends this reply to the payload soft ware in the Send/Get
Message response.
6 The payload software extracts the Get Address info reply from the Send/Get Message
response and retrieves the physical address of the board from it.
(for the shelf manager). The requester address
16
The second message bridging implementation, bridging via LUN 10, allows the payload to
receive responses to requests sent to IPMB-0 via the Send Message command with request
tracking disabled, as well as receive requests from IPMB-0. To provide this functionality, the
ATCA-9305 IPMC places all messages coming to LUN 10 from IPMB-0 in a dedicated Receive
Message Queue, and those messages are processed by the payload instead of the IPMC
firmware. To read messages from the Receive Message Queue, the payload software uses
the standard Get Message command. The payload software is notified about messages
coming to LUN 10 via the Get Status command of the SIPL protocol and the payload notification mechanism, or, if the LPC/KCS-based Payload Interface is used, using the KCS interrupt. The Receive Message Queue of the ATCA-9305 IPMC is limited to 128 bytes, which is
sufficient for storing at least three IPMB messages, but may be not enough for a larger number of messages. Taking this into account, the payload software must read messages from
the queue as fast as possible, caching them on the on-carrier payload side for further han-
7-8
ATCA-9305 User’s Manual10009109-01
Page 97
System Management: Standard Commands
dling, if it is necessary. If the Receive Message Queue is full, the ATCA-9305 IPMC rejects all
requests coming to LUN 10 with the C0h (Node Busy) completion code and discards all
responses coming to this LUN.
STANDARD COMMANDS
The Intelligent Peripheral Management Controller (IPMC) supports standard IPMI commands to query board information and to control the behavior of the board. These commands provide a means to:
• identify the controller
• reset the controller
• return the controller’s self-test results
• read and write the controller’s SROMs
• read the temperature, voltage, and watchdog sensors
• get specific information, such as thresholds, for each sensor
• read and write the Field Replaceable Unit (FRU) data
• reserve and read the Sensor Data Record (SDR) repository
• configure event broadcasts
• bridge an IPMI request to the public IPMB and return the response
Ta bl e 7- 5 lists the IPMI commands supported by the IPMC along with the hexadecimal values
for each command’s Network Function Code (netFn), Logical Unit Number (LUN), and Command Code (Cmd):
Table 7-5: IPMC IPMI Commands
Command:netFn:LUN:Cmd:
Set System Boot OptionsChassis01, 0107
Get System Boot OptionsChassis01, 0108
Set Event ReceiverSensor/Event04, 0500
Get Event ReceiverSensor/Event04, 0501
Platform Event (Event Message)Sensor/Event04, 0502
Get Device SDR InformationSensor/Event04, 0520
Get Device SDRSensor/Event04, 0521
Reserve Device SDR RepositorySensor/Event04, 0522
Get Sensor Reading FactorsSensor/Event04, 0523
Set Sensor HysteresisSensor/Event04, 0524
Get Sensor HysteresisSensor/Event04, 0525
10009109-01ATCA- 9305 User’s Manual
7-9
Page 98
System Management: Standard Commands
Command: (continued)netFn:LUN:Cmd:
Set Sensor ThresholdsSensor/Event04, 0526
Get Sensor ThresholdsSensor/Event04, 0527
Set Sensor Event EnableSensor/Event04, 0528
Get Sensor Event EnableSensor/Event04, 0529
Rearm Sensor EventsSensor/Event04, 052A
Get Sensor Event StatusSensor/Event04, 052B
Get Sensor ReadingSensor/Event04, 052D
Set Sensor TypeSensor/Event04, 052E
Get Sensor TypeSensor/Event04, 052F
Get Device IDApplication06, 0701
Broadcast 'Get Device ID'Application06, 0701
Cold ResetApplication06, 0702
Warm ResetApplication06, 0703
Get Self Test ResultsApplication06, 0704
Get Device GUIDApplication06, 0708
Reset Watchdog TimerApplication06, 0722
Set Watchdog TimerApplication06, 0724
Get Watchdog TimerApplication06, 0725
Send MessageApplication06, 0734
Get FRU Inventory Area InfoStorage0A, 0B10
Read FRU DataStorage0A, 0B11
Write FRU DataStorage0A, 0B12
Get PICMG Properties PICMG2C, 2D00
Get Address InfoPICMG2C, 2D01
FRU ControlPICMG2C, 2D04
Get FRU LED PropertiesPICMG2C, 2D05
Get LED Color CapabilitiesPICMG2C, 2D06
Set FRU LED StatePICMG2C, 2D07
Get FRU LED StatePICMG2C, 2D08
Set IPMB State PICMG2C, 2D09
Set FRU Activation PolicyPICMG2C, 2D0A
Get FRU Activation PolicyPICMG2C, 2D0B
Set FRU ActivationPICMG2C, 2D0C
Get Device Locator Record IDPICMG2C, 2D0D
Set Port StatePICMG2C, 2D0E
Get Port StatePICMG2C, 2D0F
Compute Power PropertiesPICMG2C, 2D10
Set Power LevelPICMG2C, 2D11
7-10
ATCA-9305 User’s Manual10009109-01
Page 99
System Management: OEM Boot Options
Command: (continued)netFn:LUN:Cmd:
Get Power LevelPICMG2C, 2D12
Bused Resource
(Release, Quer y, Force, Bus Free)
The IPMC implements many standard IPMI commands. For example, software can use the
watchdog timer commands to monitor the system’s health. Normally, the software resets
the watchdog timer periodically to prevent it from expiring. The IPMI specification allows
for different actions such as reset, power off, and power cycle, to occur if the timer expires.
The watchdog’s ‘timer use’ fields can keep track of which software (Operating System, System Management, etc.) started the timer. Also, the time-out action and ‘timer use’ information can be logged automatically to the System Event Log (SEL) when the time-out
occurs. Refer to the IPMI specification (listed in
request and response data. The IPMC also implements ATCA commands, see the ATCA Base
Specification (PICMG 3.0).
OEM BOOT OPTIONS
PICMG2C, 2D17
Ta bl e 1- 2 ) for details about each command’s
The Set System Boot Options and Get System Boot Options commands provide a means to
set/retrieve the boot options. The IPMI specification defines a set of standard boot option
parameters. In addition, the specification includes a range of numbers (96-127) for OEM
extensions. Emerson utilizes this area for OEM function extensions, such as boot bank selection and POST configuration. The following table describes these extensions:
Table 7-6: Emerson Boot Option Parameters
Parameter:#Parameter Data:
Boot Bank
(non-volatile)
POST Type
(non-volatile)
96data 1 — Set Selector. This is the processor ID for which the
boot option is to be set.
data 2 — Boot Bank Selector. This parameter is used to
indicate the boot bank from which the payload will boot.
00h = Primary (i.e., default) Boot Bank is selected.
01h = Secondary Boot Bank is selected.
02h-FFh = unused
97data 1 — Set Selector. This is the processor ID for which the
boot option is to be set.
data 2 — PSOT Type Selector. This parameter is used to
specify the POST type that the payload boot firmware will
execute.
00h = Short POST
01h = Long POST
02h-FFh = unused
10009109-01ATCA- 9305 User’s Manual
7-11
Page 100
System Management: IPMC Watchdog Timer Commands
IPMC WATCHDOG TIMER COMMANDS
The IPMC implements a standardized ‘Watchdog Timer’ that can be used for a number of
system time-out functions by System Management Software (SMS) or by the monitor. Setting a time-out value of zero allows the selected time-out action to occur immediately. This
provides a standardized means for devices on the IPMB to perform emergency recovery
actions.
Table 7-7: IPMC Watchdog Timer Commands
Command:See Page:Optional/Mandatory:
Reset Watchd og Timer7-14M
Set Watchdog Timer7-14M
Get Watchdog Timer7-16M
Watchdog Timer Actions
The following actions are available on expiration of the Watchdog Timer:
•System Reset
Monitor FRB-2 Time-out:
•System Power Off
The System Reset and System Power Off on time-out selections are mutually exclusive. The
watchdog timer is stopped whenever the system is powered down. A command must be
sent to start the timer after the system powers up.
Watchdog Timer Use Field and Expiration Flags
The watchdog timer provides a ‘timer use’ field that indicates the current use assigned to
the watchdog timer. The watchdog timer provides a corresponding set of ‘timer use expiration’ flags that are used to track the type of time-out(s) that had occurred.
The time-out use expiration flags retain their state across system resets and power cycles, as
long as the IPMC remains powered. The flags are normally cleared solely by the Set Watchdog Timer command; with the exception of the “don’t log” flag, which is cleared after every
system hard reset or timer time-out.
The Timer Use fields indicate:
A Fault-resilient Booting, level 2 (FRB-2) time-out has occurred. This indicates that the last
system reset or power cycle was due to the system time-out during POST, presumed to be
caused by a failure or hang related to the bootstrap processor.
7-12
ATCA-9305 User’s Manual10009109-01
Loading...
+ hidden pages
You need points to download manuals.
1 point = 1 manual.
You can buy points or you can get point for every manual you upload.