Oracle SPARC Enterprise M4000, SPARC Enterprise M5000, SPARC Enterprise M8000, SPARC Enterprise M9000 Service Manual

External I/O Expansion Unit

for SPARC Enterprise

M4000/M5000/M8000/M9000 Servers

Installation and Service Manual

Part No.: E22742-01,
Manual Code: C120-E329-07EN
April 2011

Copyright ©2007, 2011, Oracle and/orits affiliates.All rightsreserved.
FUJITSU LIMITEDprovided technicalinput andreview on portions of this material.
Oracle and/orits affiliatesand FujitsuLimited eachown orcontrol intellectual propertyrights relatingto productsand technologydescribed inthis

document, andsuch products,technology andthis documentare protected bycopyright laws,patents, andother intellectualproperty lawsand
international treaties.

This documentand theproduct andtechnology towhich itpertains are distributed underlicenses restrictingtheir use,copying, distribution,and
decompilation. Nopart ofsuch productor technology, orof thisdocument, maybe reproduced in anyform byany meanswithout priorwritten
authorization ofOracle and/orits affiliatesand FujitsuLimited, andtheir applicablelicensors, ifany. The furnishingsof thisdocument toyou doesnot
give youany rightsor licenses,express orimplied, withrespect to the product ortechnology towhich itpertains, andthis documentdoes notcontain or
represent any commitment of any kind on the part of Oracle or Fujitsu Limited, or any affiliateof eitherof them.

This documentand theproduct andtechnology describedin thisdocument mayincorporate third-party intellectual propertycopyrighted byand/or
licensed fromthe suppliersto Oracleand/or itsaffiliates and Fujitsu Limited, including software andfont technology.

Per theterms ofthe GPLor LGPL,a copyof thesource codegoverned bythe GPLor LGPL,as applicable,is availableupon request by theEnd User. Please
contact Oracleand/or itsaffiliates orFujitsu Limited.

This distributionmay includematerials developedby thirdparties.
Parts ofthe productmay be derivedfrom BerkeleyBSD systems,licensed from the Universityof California.UNIX isa registered trademark inthe U.S.and

in othercountries, exclusivelylicensed throughX/Open Company, Ltd.
Oracle andJava areregisteredtrademarks ofOracle and/orits affiliates.Fujitsu andthe Fujitsulogo areregisteredtrademarks ofFujitsu Limited.
All SPARC trademarksare usedunder licenseand are registeredtrademarks ofSPARCInternational, Inc. inthe U.S.and othercountries. Productsbearing

SPARCtrademarks are based uponarchitectures developedby Oracle and/or itsaffiliates. SPARC64is atrademark ofSPARC International, Inc.,used
under licenseby FujitsuMicroelectronics, Inc. and Fujitsu Limited. Other names may be trademarks of their respectiveowners.

United StatesGovernment Rights- Commercialuse. U.S.Government usersare subject to the standardgovernment userlicense agreementsof Oracle
and/or itsaffiliates andFujitsu Limitedand theapplicable provisions of theFARand itssupplements.

Disclaimer: Theonly warrantiesgranted byOracle andFujitsu Limited,and/or anyaffiliate ofeither ofthem inconnection withthis documentor any
product ortechnology describedherein are thoseexpressly setforth inthe licenseagreement pursuantto whichthe product or technologyis provided.
EXCEPT ASEXPRESSLYSET FORTH IN SUCHAGREEMENT,ORACLE ORFUJITSU LIMITED,AND/OR THEIRAFFILIATES MAKE NO
REPRESENTATIONS OR WARRANTIES OFANY KIND(EXPRESS ORIMPLIED) REGARDINGSUCH PRODUCTOR TECHNOLOGYOR THIS
DOCUMENT,WHICH AREALL PROVIDEDAS IS,AND ALLEXPRESS ORIMPLIED CONDITIONS,REPRESENTATIONS ANDWARRANTIES,
INCLUDING WITHOUTLIMITATION ANY IMPLIED WARRANTY OF MERCHANTABILITY,FITNESS FORA PARTICULAR PURPOSEOR NON­INFRINGEMENT,ARE DISCLAIMED,EXCEPT TOTHE EXTENT THAT SUCH DISCLAIMERSARE HELDTO BELEGALLY INVALID.Unless
otherwise expresslyset forthin suchagreement, to the extent allowed by applicable law,in noevent shallOracle orFujitsu Limited,and/or anyof their
affiliates haveany liabilityto anythird party under any legal theory for any loss of revenuesor profits,loss ofuse ordata, orbusiness interruptions,or for
any indirect,special, incidentalor consequentialdamages, evenif advisedof thepossibility ofsuch damages.

DOCUMENTATION IS PROVIDED“AS IS” AND ALLEXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS ANDWARRANTIES,
INCLUDING ANYIMPLIED WARRANTY OF MERCHANTABILITY, FITNESSFOR APARTICULAR PURPOSE ORNON-INFRINGEMENT,ARE
DISCLAIMED, EXCEPTTO THEEXTENT THAT SUCHDISCLAIMERS AREHELD TOBE LEGALLY INVALID.

Please

Recycle

Copyright ©2007, 2011, Oracle et/ouses sociétésaffiliées. Tous droitsréservés.
FUJITSU LIMITEDa fourniet vérifiédes donnéestechniques decertaines partiesde cecomposant.
Oracle et/ouses sociétésaffiliées etFujitsu Limiteddétiennent etcontrôlent chacunedes droits de propriétéintellectuelle relatifsaux produitset

technologies décritsdans cedocument. Demême, cesproduits, technologieset cedocument sontprotégés par des lois sur le copyright, des brevets,
d’autres loissur lapropriété intellectuelle et des traités internationaux.

Ce document,le produitet lestechnologies afférents sont exclusivementdistribués avecdes licencesqui enrestreignent l’utilisation, la copie, la
distribution etla décompilation.Aucune partiede ceproduit, deces technologiesou dece documentne peutêtre reproduite sousquelque formeque ce
soit, parquelque moyenque cesoit, sansl’autorisation écritepréalable d’Oracleet/ou sessociétés affiliéeset deFujitsu Limited,et deleurs éventuels
bailleurs delicence. Cedocument, bienqu’il vousait étéfourni, nevous confèreaucun droit et aucunelicence, expressesou tacites,concernant leproduit
ou latechnologie auxquelsil serapporte. Parailleurs, ilne contientni nereprésente aucunengagement, dequelque typeque cesoit, dela partd’Oracle ou
de FujitsuLimited, oudes sociétésaffiliées del’une oul’autre entité.

Ce document,ainsi queles produitset technologiesqu’il décrit,peuvent inclure des droitsde propriétéintellectuelle departies tierces protégés par
copyright et/oucédés souslicence pardes fournisseursà Oracleet/ou sessociétés affiliéeset FujitsuLimited, ycompris deslogiciels etdes technologies
relatives auxpolices decaractères.

Conformément auxconditions dela licenceGPL ouLGPL, unecopie ducode sourcerégi parla licenceGPL ouLGPL, selonle cas,est disponiblesur
demande parl’Utilisateur final.Veuillez contacter Oracleet/ou sessociétés affiliéesou FujitsuLimited.

Cette distributionpeut comprendre des composantsdéveloppés pardes partiestierces.
Des partiesde ceproduit peuventêtre dérivées des systèmes Berkeley BSD, distribués sous licence par l’Université de Californie. UNIX est une marque

déposée auxÉtats-Unis etdans d’autrespays, distribuéeexclusivement souslicence parX/Open Company, Ltd.
Oracle etJava sontdes marquesdéposées d’OracleCorporation et/oude sessociétés affiliées. Fujitsu etle logoFujitsu sontdes marquesdéposées de

Fujitsu Limited.
Toutesles marques SPARC sont utiliséessous licence et sont des marques déposéesde SPARC International, Inc., auxÉtats-Unis etdans d’autrespays. Les

produits portantla marque SPARCreposent surdes architectures développées parOracle et/ouses sociétésaffiliées. SPARC64 estune marquede SPARC
International, Inc.,utilisée souslicence parFujitsu Microelectronics, Inc. etFujitsu Limited.Toutautre nom mentionné peut correspondreà desmarques
appartenant àd’autres propriétaires.

United StatesGovernment Rights- Commercialuse. U.S. Governmentusers are subject tothe standardgovernment userlicense agreementsof Oracle
and/or itsaffiliates andFujitsu Limitedand theapplicable provisions of theFARand itssupplements.

Avisde non-responsabilité : les seulesgaranties octroyéespar Oracleet FujitsuLimited et/outoute sociétéaffiliée de l’une ou l’autreentité enrapport
avec cedocument outout produitou toutetechnologie décritsdans lesprésentes correspondent aux garantiesexpressément stipuléesdans lecontrat de
licence régissantle produitou latechnologie fournis.SAUF MENTIONCONTRAIRE EXPRESSÉMENTSTIPULÉE DANSCE CONTRAT,ORACLE OU
FUJITSU LIMITEDET LESSOCIÉTÉS AFFILIÉESÀ L’UNE OU L’AUTRE ENTITÉREJETTENT TOUTEREPRÉSENTATION OU TOUTE GARANTIE,
QUELLE QU’ENSOIT LANATURE(EXPRESSE OUIMPLICITE) CONCERNANTCE PRODUIT, CETTE TECHNOLOGIE OU CE DOCUMENT,
LESQUELS SONTFOURNIS ENL’ÉTAT. EN OUTRE,TOUTES LESCONDITIONS, REPRÉSENTATIONSET GARANTIESEXPRESSES OUTACITES,Y
COMPRIS NOTAMMENT TOUTE GARANTIE IMPLICITE RELATIVEÀ LAQUALITÉ MARCHANDE,À L’APTITUDE À UNEUTILISATION
PARTICULIÈRE OU ÀL’ABSENCEDE CONTREFAÇON, SONTEXCLUES, DANSLA MESUREAUTORISÉE PAR LALOI APPLICABLE.Sauf mention
contraire expressément stipulée dansce contrat,dans lamesure autoriséepar laloi applicable,en aucuncas Oracleou FujitsuLimited et/oul’une ou
l’autre deleurs sociétésaffiliées ne sauraient être tenuesresponsables enversune quelconquepartie tierce,sous quelquethéorie juridiqueque cesoit, de
tout manqueà gagnerou deperte deprofit, deproblèmes d’utilisation ou de perte de données, ou d’interruptionsd’activités, oude toutdommage
indirect, spécial,secondaire ou consécutif, même si ces entités ont été préalablement informéesd’une telleéventualité.

LA DOCUMENTATIONEST FOURNIE« EN L’ÉTAT »ET TOUTE AUTRECONDITION, DÉCLARATION ET GARANTIE,EXPRESSE OU TACITE, EST
FORMELLEMENT EXCLUE,DANS LAMESURE AUTORISÉEPAR LA LOIEN VIGUEUR,Y COMPRISNOTAMMENTTOUTE GARANTIE
IMPLICITE RELATIVE À LAQUALITÉ MARCHANDE,À L’APTITUDE ÀUNE UTILISATION PARTICULIÈRE OU ÀL’ABSENCEDE
CONTREFAÇON.

Contents

Preface xi

1. Overview 1–1

1.1 General Description 1–2

1.1.1 Chassis 1–4

1.1.2 Power Supply Units 1–5

1.1.2.1 AC Power 1–6

1.1.2.2 Fans 1–6

1.1.3 I/O Boats 1–7

1.2 Card Slots 1–9

1.2.1 Carriers 1–9

1.2.1.1 Carrier Slots 1–10

1.2.1.2 Dummy Cards 1–11

1.2.2 Link Kits 1–12

1.2.3 Cable Management 1–13

1.2.3.1 Minimum Bend Radius for Link Cables 1–15

1.2.3.2 Cable Management Unit 1–16

1.3 Carriers 1–17

1.3.1 Carrier Removal and Insertion 1–18

1.3.2 Card Locks 1–20

v

1.3.3 Tightening Sequence for Card Locks 1–21

1.3.3.1 Tightening Sequence for Wide Cards 1–22

1.3.3.2 Tightening Sequence for Narrow Cards 1–22

1.3.4 Examples of PCI Card Installation 1–23

1.3.4.1 Using Card Locks With Tall PCI Cards 1–25

1.3.4.2 Using Card Locks With Low and Very Low Height PCI
Cards 1–26

1.3.4.3 Using Card Locks With Unusual PCI Card Shapes 1–27

1.3.5 PCI Card Mounting Problems 1–27

1.3.5.1 Tilted Cards 1–27

1.3.5.2 Hidden Problems 1–29

1.3.6 Carrier Keys 1–33

1.4 External I/O Expansion Unit Configurations 1–34

1.4.1 Single Boat Configuration 1–34

1.4.2 Dual Boat Configuration 1–35

1.5 LEDs 1–36

1.6 System Management 1–38

1.6.1 Maximum Temperatures in the External I/O Expansion Unit 1–39

1.7 Site Preparation 1–39

1.7.1 Physical Requirements 1–39

1.7.2 Electrical Requirements 1–40

1.8 Service Information 1–41

1.9 Electrostatic Discharge Precautions 1–43

2. Installing the External I/O Expansion Unit in a Rack 2–1

2.1 Tools 2–1

2.2 Installing the Mounting Brackets in a Rack 2–2

2.3 Installing the External I/O Expansion Unit in the Rack 2–7

2.4 Installing the Cable Management Unit 2–9

vi External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

2.5 Installing the AC Cords 2–13

2.6 Installing the Link Kit 2–16

2.6.1 Installing the Optical Link Kit 2–17

2.6.2 Installing the Copper Link Kit 2–18

3. Working With PCI Cards 3–1

3.1 Installing a PCI Card 3–1

3.2 Replacing a PCI Card 3–9

3.3 Installing Cables for PCI Cards 3–16

4. Servicing and Replacing Components 4–1

4.1 Service Procedures Task Map 4–2

4.2 Identifying Firmware Versions 4–3

4.3 Replacing a Power Supply Unit 4–4

4.4 Powering Down a Link Before Service 4–6

4.4.1 The cfgadm -c disconnect Command 4–6

4.4.2 Example of the cfgadm -c disconnect Command 4–6

4.5 Preparing the Cable Plate for Service 4–7

4.6 Replacing a Carrier 4–9

4.7 Replacing a Link Cable 4–13

4.8 Replacing a Link Card in the Host Server 4–13

4.9 Replacing a Link Card in an I/O Boat 4–14

4.10 Installing a Second I/O Boat 4–16

4.11 Replacing an I/O Boat 4–19

4.11.1 Replacing a Boat in a Single Boat Configuration 4–19

4.11.2 Replacing a Boat in a Dual Boat Configuration 4–21

4.12 Replacing the External I/O Expansion Unit Chassis 4–24

4.12.1 Locating the New System Serial Number Label 4–24

4.12.2 Preparing the External I/O Expansion Unit 4–24

Contents vii

4.12.3 Moving the Bezel to the New Chassis 4–26

4.12.4 Installing the External I/O Expansion Unit in the Rack 4–30

4.13 Powering Up a Link After Service 4–33

4.13.1 The cfgadm -c configure Command 4–33

4.13.2 Example of the cfgadm -c configure Command 4–34

A. Specifications A–1

A.1 Physical Specifications A–2

A.2 Clearance for Service Access A–2

A.3 Environmental Specifications A–3

A.4 Power Source Requirements A–4

A.5 Acoustic Noise Emissions A–4

A.6 Agency Compliance Specifications A–5

B. External I/O Expansion Unit LED Status Indicators B–1

B.1 LED Locations B–2

B.2 LED States B–4

C. PCI Cards and Device Mapping C–1

C.1 Device Mapping C–1

C.2 Device Map Examples C–3

C.2.1 Device Map for PCI Express Cards C–3

C.2.2 Device Map for PCI-X Cards C–4

C.3 Software Commands for the External I/O Expansion Unit C–6

C.3.1 The ioxadm Command C–7

C.3.2 The show-devs Command C–8

C.3.3 The cfgadm Command C–11

C.3.4 The prtdiag Command C–12

D. Troubleshooting D–1

viii External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

D.1 Using Hardware Symptoms to Troubleshoot Problems D–2

D.2 Using Manual Techniques of Fault Isolation to Diagnose Error Messages

D–4

D.2.1 Error Messages and Fault Managed Resource Identifiers D–4

D.2.2 I2C Failures D–6

2

D.2.2.1 I

D.2.2.2 I

C Fault Isolated to a Single FRU D–7

2

C Fault Spanning Multiple FRUs D–7

D.2.2.3 I2C Fault When Accessing the Link Card Installed in the

Host D–11

D.2.3 Management Bus Failures D–12

D.2.4 Cable Removed or Power Loss D–13

D.2.5 Interrupt Signal Failures D–14

D.2.6 FRU Discovery Failures D–15

D.2.6.1 Signal Failure D–15

D.2.6.2 Boat Not Monitored D–16

D.2.6.3 Link Card Mode Failure D–17

D.2.6.4 Boat Location Failure D–17

D.2.7 Reported Failures on the Microcontroller D–19

Index Index–1

D.2.7.1 Fan Controller Reset D–19

D.2.7.2 Fan Controller Timeout D–20

D.2.7.3 Bridge Controller Reset D–20

D.2.7.4 Bridge Controller Timeout D–21

Contents ix

x External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

Preface

This manual provides installation and service procedures for the External I/O
Expansion Unit from Oracle and Fujitsu.

This document is written for technicians, system administrators, authorized service
providers, and users who have advanced experience troubleshooting and replacing
hardware.

This chapter includes the following sections:

■ “External I/O Expansion Unit Documents” on page xi

■ “Text Conventions” on page xii

■ “Notes on Safety” on page xiii

■ “Documentation Feedback” on page xiii

External I/O Expansion Unit Documents

All documents for your External I/O Expansion Unit are available online at the
following locations:

■ Oracle documents:

http://download.oracle.com/docs/cd/E19322-01/index.html

■ Fujitsu documents:

http://www.fujitsu.com/sparcenterprise/manual/

■ Sun Oracle software-related manuals (Oracle Solaris OS, and so on):

http://www.oracle.com/technetwork/documentation/index.html

xi

External I/O Expansion Unit Documents

External I/O Expansion Unit Installation and Service Manual

External I/O Expansion Unit Product Notes

External I/O Expansion Unit Safety and Compliance Guide

Text Conventions

This manual uses the following fonts and symbols to express specific types of
information.

Fonts/symbols Meaning Example

AaBbCc123 What you type, when contrasted

with on-screen computer output.
This font represents the example of

command input in the frame.

AaBbCc123 The names of commands, files, and

directories; on-screen computer
output.

This font represents the example of
command input in the frame.

Italic Indicates the name of a reference

manual

" " Indicates names of chapters,

sections, items, buttons, or menus

XSCF> adduser jsmith

XSCF> showuser -P
User Name: jsmith
Privileges: useradm

auditadm

See the SPARC Enterprise
M3000/M4000/M5000/M8000/M90
00 Servers XSCF User’s Guide.

See Chapter 2, "System Features."

xii External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

Notes on Safety

Read the following documents thoroughly before using or handling any External I/O
Expansion Unit.

■ External I/O Expansion Unit Safety and Compliance Guide.

■ SPARC Enterprise M3000/M4000/M5000/M8000/M9000 Servers Important Legal and

Safety Information

Documentation Feedback

If you have any comments or requests regarding this document, go to the following
web sites.

■ For Oracle users:

http://www.oraclesurveys.com/se.ashx?s=25113745587BE578

■ For Fujitsu users:

http://www.fujitsu.com/global/contact/computing/sparce_index.html

Preface xiii

xiv External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

CHAPTER

1

Overview

The External I/O Expansion Unit provides a host server with additional slots for PCI
cards.

■ The single I/O boat configuration provides six slots for I/O cards.

■ The optional two I/O boat configuration (FIGURE 1-1) provides twelve slots.

This chapter contains the following topics:

■ Section 1.1, “General Description” on page 1-2

■ Section 1.2, “Card Slots” on page 1-9

■ Section 1.3, “Carriers” on page 1-17

■ Section 1.4, “External I/O Expansion Unit Configurations” on page 1-34

■ Section 1.5, “LEDs” on page 1-36

■ Section 1.6, “System Management” on page 1-38

■ Section 1.7, “Site Preparation” on page 1-39

■ Section 1.8, “Service Information” on page 1-41

■ Section 1.9, “Electrostatic Discharge Precautions” on page 1-43

1-1

FIGURE 1-1 External I/O Expansion Unit, Front and Rear Views

1

2

Figure Legend

Front view

1

2 Rear view

1.1 General Description

FIGURE 1-2 shows the major units for the External I/O Expansion Unit, which are

described separately in this chapter.

Note – All slot numbers run from left to right, regardless of whether you are

viewing the front or the back of the External I/O Expansion Unit. At the front of the
External I/O Expansion Unit, the power supplies are numbered from left to right.
I/O boats at the rear of the External I/O Expansion Unit are also numbered from left
to right.

1-2 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

FIGURE 1-2 Major Units for the External I/O Expansion Unit, Top View

1

4

7

Figure Legend

2

3

9a

6

5

9b

8a

8b

Chassis

1

2 Power Supply Unit 1 7 Internal AC cable

3 Power Supply Unit 0 8 Cable management unit (One of two types is included. Type

4 Centerplane 9 Link kit (One of two types is included. 9a is the copper link

I/O boat 0

5

I/O boat 1

6

8a routes cables to both sides of a rack. Type 8b routes
cables only the right side of a rack.)

kit. 9b is the optical link kit.)

Chapter 1 Overview 1-3

1.1.1 Chassis

The External I/O Expansion Unit chassis includes the centerplane (item 4 in

FIGURE 1-2) and two non-removable internal AC cables (item 7 in FIGURE 1-2).

There are no serviceable components inside the chassis. If the centerplane or the
internal AC cables are damaged, the chassis must be replaced.

Note – A replacement chassis does not include power supply units (PSUs) or I/O

boats. Transfer the PSUs and I/O boats from the damaged chassis to the replacement
chassis.

Each internal AC cable supplies only one PSU. To ensure redundant power, use the
two AC cords supplied with the External I/O Expansion Unit to connect the internal
AC cables to separate AC sources.

Caution – Do not connect the internal AC cables directly to a power strip. Use the

the AC power cords supplied with the External I/O Expansion Unit to connect the
internal AC cables to electrical power.

Caution – Do not substitute other AC power cords for the AC power cords supplied

with the External I/O Expansion Unit. The substitute AC power cords might not
have the same power rating.

1-4 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

1.1.2 Power Supply Units

The External I/O Expansion Unit has two power supply units (PSUs) for
redundancy. See

Each PSU includes an integral fan.

FIGURE 1-3 Power Supply Unit

FIGURE 1-3.

7

8

1

6

5

Figure Legend

1 PSU 5 Fan

2 Handle locking screw 6 Caution labels

3 Handle 7 PSU slot 0

4 AC switch 8 PSU slot 1

4

3

2

Chapter 1 Overview 1-5

1.1.2.1 AC Power

The PSU slots are powered through internal AC cables that extend out of the rear of
the chassis (item 7 in

The PSUs do not share AC current. Connect both internal AC cables to AC power.

The internal AC cable for a PSU is the cable terminating nearest that PSU slot.

The PSUs should be connected to two independent external AC power sources so
that service will not be interrupted if one AC power source fails.

1.1.2.2 Fans

A fan is located in the front of each PSU. If one fan fails, the remaining fan supplies
enough air to cool two I/O boats.

Note – The fan might turn on when you insert a PSU into the External I/O

Expansion Unit. This is normal behavior if you are installing a second PSU while the
first PSU is powered on. The fan receives DC power through the centerplane.

FIGURE 1-2).

1-6 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

1.1.3 I/O Boats

The External I/O Expansion Unit can contain up to two I/O boats (FIGURE 1-4).

FIGURE 1-4 I/O Boat

5

1

2

6

3

4

Figure Legend

1 I/O boat 5 Boat slot 0

2 Captive screws 6 Boat slot 1

3 Link card carrier (slot 0) 7 Caution labels

4 PCI card carriers (slots 1-6)

7

There are two types of I/O boat, PCI-X and PCI Express. PCI cards are not
interchangeable between the two types of boats.

■ The PCI-X I/O boat accepts PCI-X cards and some older types of PCI cards.

■ The PCI Express I/O boat accepts PCI Express cards up to x8 lanes wide. PCI

Express x16 cards do not fit in this boat.

Chapter 1 Overview 1-7

FIGURE 1-5 PCI-X and PCI Express I/O Boat Layouts, Compared

PCI-X I/O boat

32 lane switch

Bridge Bridge Bridge

Slot 1

Slot 2

Slot 3

Link 0

6 PCI-X slots

Slot 4

Slot 5

Slot 6

PCI Express I/O boat

PCI-E I/O boat

32 lane switch

32 lane

switch

Slot 1

Link 0

Slot 2

6 PCI Express slots

6 PCI-E slots

Slot 3

32 lane

switch

Slot 4

Slot 5

Slot 6

A PCI-X I/O boat is shown on the left side of FIGURE 1-5. This boat has six PCI-X
sockets and one link socket.

A PCI Express I/O boat is shown on the right side. There are six PCI Express sockets
and one link socket.

All PCI card data passes through the link card in the I/O boat.

A boat slot accepts either type of I/O boat.

When you run system diagnostics, the switches and bridges are displayed in the
output of OpenBoot PROM probing. However, the link cards themselves never
appear during OpenBoot PROM probing. For examples of OpenBoot PROM output,
see Appendix C.

Note – A bridge is a device that converts PCI Express and PCI-X signal formats and

connects multiple busses to a single bus. A switch is a device that connects multiple
busses to a single bus, without converting the signals to another format.

1-8 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

1.2 Card Slots

The card slots have the following characteristics:

■ An I/O boat has seven card slots. Slot numbers 0 through 6 are counted from left

to right.

■ Slot 0 is reserved for the link card. Slot 0 is the first slot in the left side of the I/O

boat. For information about link cards, see Section 1.2.2, “Link Kits” on page 1-12.

■ Slots 1-6 are for PCI cards. (PCI cards are sometimes known as host adapters or

host bus adapters.)

■ PCI card slots are hot-pluggable.

■ PCI-X and PCI Express sockets (FIGURE 1-5) are incompatible in length and height.

Installing a PCI-X or PCI Express card in the wrong type of I/O boat will damage
the card and the connector in the carrier slot.

■ The PCI Express I/O boat supports up to x8 card sockets. PCI Express x16 cards

are not supported in the PCI Express I/O boat.

Note – Graphics cards are not supported.

Caution – Do not insert a x16 PCI Express card in an I/O boat. The x16 card

connector is too large for the x8 card socket and will damage the socket.

1.2.1 Carriers

All PCI cards in the External I/O Expansion Unit are mounted on carriers
(

FIGURE 1-25). Carriers control RFI emissions and maintain the proper flow of air

through the External I/O Expansion Unit.

The front of each carrier is labelled with its slot number (PCIX 1 or PCIE 1, and so
forth).

Note – Slot 0 is reserved for the link card. This slot is marked LINK 0.

There is only one type of carrier design used in the External I/O Expansion Unit. The
same carrier fits all slots in both types of PCI-X and PCI Express boats. Carriers are
physically keyed to fit only specific slot numbers. The keys can be adjusted for other
slots as needed.

Chapter 1 Overview 1-9

Caution – If you install a PCI card when the External I/O Expansion Unit is

running, be prepared to complete the installation within two minutes or so. If you
leave a carrier slot empty, the External I/O Expansion Unit might overheat.

New carriers include dummy cards. The dummy cards help the carriers to stay in
place and to control the passage of air through the I/O boat. For information about
dummy cards, see Section 1.2.1.2, “Dummy Cards” on page 1-11.

1.2.1.1 Carrier Slots

There are seven carriers in each I/O boat (FIGURE 1-6). Carriers can be adjusted to fit
various sizes and shapes of PCI cards. Link cards use the same type of carrier.

■ Carrier slot 0 is always used for the link card.

■ Carrier slots 1 through 6 are used for PCI cards.

FIGURE 1-6 PCI Carrier

Figure Legend

1 Carrier handle

2 Carrier locking screw

1-10 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

1.2.1.2 Dummy Cards

New carriers are shipped with dummy cards (FIGURE 1-7).

There are two types of dummy card, PCI-X and PCI Express. (The PCI Express card
might be labelled “PCI-E”.) Note that there are differences in their edge connectors.

FIGURE 1-7 Dummy Cards

PCI-E

PCI-X

Figure Legend

1

PCI Express version

2

PCI-X version

Note – Be certain that the dummy cards are fully seated. This action minimizes the

vibration of unused carriers in the I/O boat slots.

The service labels (not shown in

FIGURE 1-7) on the dummy cards include simplified

instructions for removing and installing PCI cards.

Chapter 1 Overview 1-11

Caution – The two types of dummy cards are not interchangeable. If you replace a

PCI card with a dummy card, be sure that you use the right type of dummy card. The
differences in edge connectors on the dummy cards (
damage the PCI card socket on the I/O boat.

1.2.2 Link Kits

One link kit is required for each I/O boat.

A link kit includes two link cards. One link card goes into the host server. The other
link card goes into the I/O boat. The link cards are physically identical.

FIGURE 1-7) are enough to

Two link options are available, a copper link kit and an optical link kit (

■ The copper link kit has one bidirectional cable. A low-profile bracket is included

FIGURE 1-8).

so a link card can be used in a host that has low-profile I/O card slots.

■ The optical link kit has two unidirectional cables.

FIGURE 1-8 Link Kits

Figure Legend

1

Copper link kit

2

Optical link kit

1-12 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

Slot 0 in each I/O boat is the dedicated link card slot. Use slot 0 only for the link
card.

1.2.3 Cable Management

A cable management unit attaches to the rear of the system rack. There are two types
of cable management units.

■ Some racks allow the routing of cables along both sides of the rack. The type A

cable plate (
of the rack.

■ Some racks allow routing of cables only along the right side of the rack. The type

B cable plate (
rack.

FIGURE 1-9) supports cable routing along both the left and right sides

FIGURE 1-10) is optimized for cable routing along the right side of the

Chapter 1 Overview 1-13

FIGURE 1-9 Cable Management Unit (Type A) for Routing Cables to Both Sides of the

Rack

3

2

1

3

2

Figure Legend

1 Type A cable plate

2 Support brackets

3 Cable plate locking screws

1-14 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

FIGURE 1-10 Cable Management Unit (Type B) for Routing Cables Only to the Right Side of

a Rack

3

2

1

Figure Legend

1 Type B cable plate

2 Support brackets

3 Cable plate locking screws

3

2

Note – If the PSU1 power cable does not reach the rack power distribution unit,

route the cable on the left side of the rack.

1.2.3.1 Minimum Bend Radius for Link Cables

The link cables might be damaged if they are coiled too tightly.

■ The minimum bend radius for the copper link cable is 1.85 in./47 mm.

■ The minimum bend radius for optical link cables is 1.8 in./46 mm.

Chapter 1 Overview 1-15

Caution – Coiling the link cables with a smaller bend radius than listed above will

break the cables.

1.2.3.2 Cable Management Unit

The cable management unit contains two support brackets and a cable plate.

The support brackets attach with screws to the rear of the system rack. The cable
plate rests on the support brackets.

The cable plate has two positions (

■ In the normal position, the cable plate rests on the support brackets.

■ In the raised position, the cable plate rests slightly above the support brackets.

FIGURE 1-11).

This position provides clearance for you to remove and replace an I/O boat.

FIGURE 1-11 Cable Plate (Side Views of Normal and Service Positions)

2

1

3

Figure Legend

1 Cable plate in the normal position (lowered)

2 Cable plate in the service position (raised)

3 Cable plate locking screw

1.3 Carriers

In the I/O boat, all PCI cards are mounted on carriers. When you insert the carrier
and card into the boat and push the carrier handle into the closed position, the
carrier mechanism automatically seats the PCI card.

FIGURE 1-12 shows a carrier with an attached PCI card.

1-16 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

FIGURE 1-12 Carrier

2

3

Note – The service life of a carrier is at least 100 PCI card insertions. To avoid

premature failure of the carrier, do not repeatedly open and close the carrier more
than is necessary to familiarize yourself with its operation.

1

Figure Legend

1 PCI card

2 Carrier

3 Carrier handle in unlocked position

FIGURE 1-13 shows the details of a typical carrier.

Chapter 1 Overview 1-17

FIGURE 1-13 Carrier Features

2

3

4

1

5

6

5

5

Figure Legend

1 Carrier main body (metal) 4 Carrier handle
2 Carrier plate (plastic) 5 Card locks (see Section 1.3.2, “Card Locks” on page 1-20)

3 Carrier slot keyholes 6 Turnaround area for card lock

1.3.1 Carrier Removal and Insertion

A carrier operates by raising or lowering a PCI card into or out of a card socket. The
vertical movement is approximately 0.4 in./10 mm.

A small metal latch (item 3 in
latch locks the carrier handle in the extended position. This action prevents the
carrier plate and PCI card from falling and damaging the PCI slot connector as you
pull the carrier unit out of the carrier slot.

1-18 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

FIGURE 1-14) is located at the front of the carrier. The

After the carrier is out of the I/O boat, you can unlock the carrier handle by pushing
in the metal latch while pushing the carrier handle into its closed position. Note that
the closed position provides more vertical clearance for a PCI card when you install
or remove the PCI card.

When you insert the carrier into the I/O boat, the latch automatically unlocks itself.

FIGURE 1-14 Carriers

Figure Legend

1 Pull carrier handle to raise PCI card out of PCI slot socket

2 Push carrier handle and latch (3) to lower PCI card into socket

3 Latch

Caution – All carriers must contain either a PCI card or a dummy card to avoid loss

of cooling air.

Chapter 1 Overview 1-19

1.3.2 Card Locks

A PCI card is attached to the carrier with screw-mounted locks or retainers
(

FIGURE 1-15). Card locks hold a PCI card to its carrier and prevent the PCI card from

shifting or tilting. The PCI card must be securely mounted in order for the carrier to
correctly seat the PCI card in the card socket in the I/O boat.

FIGURE 1-15 Card Locks

1

2

Figure Legend

1 Type A (Square). There are three of these.

2 Type B (S-shaped)

3 Type C (Small)

3

There are three types of locks:

■ Type A is a square-shaped lock. Three of these are supplied with each carrier.

■ Type B is an oblong lock that has an S-shaped profile. It provides a longer

extension (0.75 in./19 mm) than type A. Type B can be used as a top or side
mount, wherever a longer reach is needed. One of this type is included with each
carrier.

1-20 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

■ Type C is a small quarter-round lock. It can support the bottom edge of a wide PCI

card, but only when the lock is at the far right side of its slot (the side farthest
from the front of the carrier). For a narrow width card, use this lock only to
support the side of the card. Do not use this lock to support the bottom edge of a
narrow width card because the lock might interfere with the card socket in the I/O
boat. This lock fits only the bottom slot on the carrier. One of this type is supplied
with each carrier.

One function of the locks is to secure the PCI card to the carrier. Another is to apply
a downward force to the top of the card to seat the card in the card socket when the
carrier is inserted into the I/O boat. In addition, the locks help prevent the card from
tilting so that card edge pins line up properly with the pins in the socket.

Because PCI card types are available in various sizes and shapes, you should choose
a combination of card locks that is best suited to the size and shape of the PCI card.

1.3.3 Tightening Sequence for Card Locks

To fasten a PCI card to a carrier so that the card will seat reliably, tighten the card
locks in the sequence shown in

PCI card shapes and sizes can vary, so use the following instructions as suggestions,
not as strict requirements.

■ If the PCI card is wide, use the tightening sequence shown in FIGURE 1-16. A wide

card is one that can rest on the type C card lock (item 1 in
card lock is in its extreme right position.

■ If the PCI card is narrow, use the tightening sequence shown in FIGURE 1-17.A

narrow card is one that is too short to rest on the type C card lock when the card
lock is in its extreme right position.

FIGURE 1-16 or FIGURE 1-17.

FIGURE 1-16) when the

Caution – If you move the type C card lock out of the extreme right position while

the plastic part of the card lock is facing down, the PCI card will not seat properly,
and the bottom of the card lock can damage the PCI card socket in the I/O boat. If
you move the type C card lock to the left at any time, always rotate the card lock so
that the plastic part faces either left or right.

Chapter 1 Overview 1-21

1.3.3.1 Tightening Sequence for Wide Cards

FIGURE 1-16 Card Lock Sequence for Wide Cards

2 3

1

● Rest the bottom edge of the PCI card on the type C card lock (number 1 in

FIGURE 1-16) to ensure that the bottom of the PCI card is perfectly horizontal,

then tighten the remaining card locks in the sequence shown.

1.3.3.2 Tightening Sequence for Narrow Cards

FIGURE 1-17 Card Lock Sequence for Narrow Cards

4

1

● Tighten the upper left card lock (number 1 in FIGURE 1-17), while ensuring that

4

2

3

the card is perfectly horizontal. Then tighten the remaining card locks in the
sequence shown, as applicable.

1-22 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

1.3.4 Examples of PCI Card Installation

FIGURE 1-15 shows the locks for a typical PCI card.

However, cards can be much wider or narrower, or taller or shorter.

FIGURE 1-19, and FIGURE 1-20 show how cards can vary in height, width, and shape.

FIGURE 1-18,

Note – The lock arrangements shown in these figures are suggestions and are not

intended as requirements.

When installing a card, it might be necessary to swap locks from slot to slot in order
to find the best way to secure a PCI card to its carrier. Use

TABLE 1-1 to select locks

that are best suited to your PCI card.

TABLE 1-1 Card and Lock Styles

Suggested Lock Type

PCI Card Shape Top Lock/Card Height Side Lock/Card Width Bottom Lock Example

*

Wide Type A (x2) Type A

12 in./304 mm
maximum card width

Average width Type A (x2) Type A

5.75 in./146 mm
minimum card width

Type B

5.0 in./127 mm
minimum card width

Narrow width Type A (1 or 2) Type A

5.75 in./146 mm
minimum card width

Type B

5.0 in./127 mm
minimum card width

Type C

3.0 in./76 mm
minimum card width

Very narrow
width

Type A (1 or 2) Type B

5.0 in./127 mm
minimum card width

Type C

3.0 in./76 mm
minimum card width

Tall Type A Type A or B Type C

Type C

Type C

FIGURE 1-18

†

‡

FIGURE 1-18

FIGURE 1-18

FIGURE 1-18

FIGURE 1-18

Chapter 1 Overview 1-23

TABLE 1-1

PCI Card Shape Top Lock/Card Height Side Lock/Card Width Bottom Lock Example

Low height Type A

Card and Lock Styles (Continued)

2.0 in./51 mm
minimum card height

or
Type B

1.25 in./31 mm
minimum card height

Suggested Lock Type

Type A

5.75 in./146 mm
minimum card width

Type B

5.0 in./127 mm
minimum card width

Type C

FIGURE 1-19

3.0 in./76 mm
minimum card width

Very low height
and narrow

Irregular shape As needed As needed As needed

* Do not use the type C lock to support the bottom of a card if the lock will be in a location that causes the lock to interfere with the

PCI card connector in the I/O boat.

† Do not use the type C lock to support the bottom of a card if the lock will be in a location that causes the lock to interfere with the

PCI card connector in the I/O boat.

‡ Do not use the type C lock to support the bottom of a card if the lock will be in a location that causes the lock to interfere with the

PCI card connector in the I/O boat.

** Do not use the type C lock to support the bottom of a card if the lock will be in a location that causes the lock to interfere with the

card connector.

Type B

1.25 in./31 mm minimum

Type C

3.0 in./76 mm minimum

**

FIGURE 1-20

FIGURE 1-20

1-24 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

1.3.4.1 Using Card Locks With Tall PCI Cards

FIGURE 1-18 Lock Arrangements for Wide and Narrow PCI cards

1

2

3

4

Figure Legend

1 Tall and wide card 2 type A on top, 1 type A on right, 1 type C on bottom of the PCI card

2 Tall and average width card 2 type A on top, 1 type A on right, 1 type C on bottom of the PCI card

3 Tall and narrow card 1 type A on top, 1 type A on right, 1 type C on lower right side of the PCI card

4 Tall and very narrow card 1 type A on top, 1 type B on right, 1 type C on lower right side of the PCI card

Chapter 1 Overview 1-25

1.3.4.2 Using Card Locks With Low and Very Low Height PCI Cards

FIGURE 1-19 Lock Arrangements for Low and Very Low Height PCI cards

1

2

Figure Legend

1 Low height card 2 type A on top, 1 type A on right side, 1 type C on lower right side of the PCI card

2 Very low height card 1 type B on top, 1 type A on right edge, 1 type C on lower right side of the PCI card

1-26 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

1.3.4.3 Using Card Locks With Unusual PCI Card Shapes

FIGURE 1-20 Lock Arrangements for Unusually-Shaped Cards

1

2

Figure Legend

1 Very low height and narrow width card 1 type B on top, 1 type C on right side of the PCI card

2 Irregularly-shaped card 1 type A and 1 type B on top, 1 type A on right side, 1 type C on lower right

side of the PCI card

1.3.5 PCI Card Mounting Problems

1.3.5.1 Tilted Cards

There are two common problems that involve PCI cards that turn at an angle when
mounted in PCI carriers.

■ The most common problem is that a PCI card can slip and tilt during seating when

you do not apply enough pressure on a PCI carrier card lock when mounting the
card on the carrier.

■ A less common problem is that the bracket of a PCI card will bend when you

apply too much pressure on a PCI carrier card lock when mounting the card on a
carrier.

Chapter 1 Overview 1-27

FIGURE 1-21 Excessive Force on a Lock Can Bend or Break the PCI Card

Figure Legend

1 Correct

2 Incorrect

Here are some rules to avoid the tilting of PCI cards:

1. You must have at least one lock on top of the card. If the top of the card is too low
to accept a lock, the card cannot be used.

2. Find a lock to fit the top of the card and provide side support to prevent the card
from tilting. A tilted card (

FIGURE 1-21) will not seat properly.

3. Support of the bottom of the card is not a major priority because the carrier plate
itself provides some support for the bottom of the card.

4. Use only enough pressure to hold the lock against the PCI card. The bottom of the
PCI card should stay parallel with the bottom of the carrier.

1-28 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

1.3.5.2 Hidden Problems

The following features are located inside the front housing of the carrier. Because
they are difficult to see, they can complicate the mounting of cards on carriers.

■ Card alignment post (FIGURE 1-22 and FIGURE 1-23)

■ Card alignment tab (FIGURE 1-22)

■ Internal RFI gasket (FIGURE 1-24)

Alignment Post and Alignment Tab

The card alignment post and the card alignment tab help to keep the front of the PCI
card in the correct vertical orientation, with support from properly-installed card
locks.

FIGURE 1-22 Card Alignment Post and Card Alignment Tab

1

Figure Legend

1 Card alignment post

2 Card alignment tab

2

Chapter 1 Overview 1-29

The post fits in a notch in the metal bracket of the PCI card (item 1 in FIGURE 1-22). If
you do not position the post in the notch, the card mounting bracket might bend, so
that the card lies at an angle on the carrier. The angle prevents the card from making
proper electrical contact with the socket in the I/O boat.

The tab (item 2 in

FIGURE 1-22) fits in a notch at the bottom of the PCI card. The tab

helps to align the card when you install it in the carrier. (Note that some card types
might not have the notch).

Note – The tab lifts the front of the card out of the card connector when you remove

the carrier from the I/O boat. If you cannot use a type C lock (

FIGURE 1-15) to support

the bottom of the PCI card, the card alignment tab is the only point that can provide
support to lift the card out of the socket.

FIGURE 1-23 shows how the bracket fits over the card alignment post.

1-30 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

FIGURE 1-23 Card Alignment Post (Detail)

2

Figure Legend

1

3

1 Carrier front housing

2 Card alignment post

3 PCI card bracket

Chapter 1 Overview 1-31

Internal RFI Gasket

An RFI gasket is located inside the carrier housing, next to the card alignment post.
(A smaller RFI gasket is located on the outside of the carrier housing.) When you
insert the PCI card into the carrier, be sure that the bottom of the metal card bracket
does not scrape or loosen the bottom of the gasket (

The gasket material is flexible enough that you might not notice that the bracket has
dislodged the gasket. Remember to inspect the condition of this gasket before you
install the carrier in the I/O boat.

FIGURE 1-24 Internal RFI Gasket

3

FIGURE 1-24).

1

2

4

Figure Legend

1 PCI card

2 RFI gasket (extends to the bottom front of the PCI carrier)

3 Correct example: the RFI gasket lies flat

4 Incorrect example: the card bracket has hooked behind the RFI gasket

1-32 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

1.3.6 Carrier Keys

Each carrier is keyed to a specific slot (FIGURE 1-25) in the I/O boat. The key is an M2
screw on the top of each carrier. Each carrier slot (0 through 6) will accept only a
carrier that has a key in the hole location for that slot.

FIGURE 1-25 Screw Hole Locations for the Carrier Slot Key

1

2

Figure Legend

1 Key (M2 screw)

2 Hole locations for carrier slots 0, 1, 2, 3 (front row)

Hole locations for carrier slots 4, 5, 6, 7 (rear row)

* Hole 0 and slot 0 are for the link card only.

† Hole 7 is reserved for future configurations.

*

†

If you replace a carrier, install the key in the keyhole that corresponds to the slot that
you use. A replacement carrier includes one key. It also includes an assortment of
labels. Affix the appropriate label (LINK 0, PCIE n, or PCIX n) to the front of the
replacement carrier for easy identification.

Chapter 1 Overview 1-33

1.4 External I/O Expansion Unit Configurations

The External I/O Expansion Unit is available with one or two I/O boats. Two types
of link kits (copper and optical) are also available.

1.4.1 Single Boat Configuration

The base configuration for an External I/O Expansion Unit has a single boat, with a
filler panel in the second boat bay.
External I/O Expansion Unit in the same rack.

A link card in the host server connects to a link card in the External I/O Expansion
Unit. One or two link cables connect the two link cards. (The cables are not shown to
scale.)

The copper link kit includes a single 13 ft/4 m link cable.

The optical link kit includes two link cables. The link cables are either 33 ft/10 m or
80 ft/25 m cables. Note that in
Transmit port (TX) of one link card connects to the Receive port (RX) of the other link
card.

FIGURE 1-26 shows a host server and a base

FIGURE 1-26, the link cables are crossed so that the

1-34 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

FIGURE 1-26 Optical Cables Connect TX Sockets to RX Sockets

1

2

Figure Legend

1

External I/O Expansion Unit

2

Host server

1.4.2 Dual Boat Configuration

The dual boat configuration provides twelve I/O slots. Each of the I/O boats requires
its own link kit, so the host server must have two I/O slots available for this purpose.

Chapter 1 Overview 1-35

Note – If you are installing a second boat in the External I/O Expansion Unit, both

boats must be connected to the same host server. Do not connect the second boat to a
different server. The second boat can be connected to a different domain on the same
server, but not to a domain on a different server.

Note – Do not daisy-chain two boats (connect a boat to another boat through link

cards). Daisy-chain configurations are not allowed.

1.5 LEDs

LEDs are located on the front (FIGURE 1-27) and rear (FIGURE 1-28) of the chassis and
on individual PSUs.

See Appendix B for information about interpreting LED states.

FIGURE 1-27 LEDs on the Front of the Chassis

1 2 3 4

5

6

7

8

Figure Legend

1 Chassis locate (LED and switch) 7 PSU0 DC power

2 Chassis fault/service required 8 PSU0 AC power

3 Chassis power 9 PSU1 ready to remove

1-36 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

9 10 11 12

Figure Legend

4 Chassis overtemp 10 PSU1 fault/locate

5 PSU0 ready to remove 11 PSU1 DC power

6 PSU0 fault/locate 12 PSU1 AC power

Note – The Locate LED is a lighted push-button switch. When the flashing of its

LED has helped you to locate the External I/O Expansion Unit, turn off the LED by
pressing the switch. Note that the LED does not turn off if you press less than 0.5
seconds. You can also manually turn on the LED by pressing the button.

FIGURE 1-28 LEDs on the Rear of the Chassis

5 6 7

1 2 3 4

8 9 10

11

12

13

11 12

14

Figure Legend

1 Chassis locate (LED and switch) 8 I/O boat 1 ready to remove

2 Chassis fault/service required 9 I/O boat 1 fault/locate

3 Chassis power 10 I/O boat 1 DC power

4 Chassis overtemp 11 Link card data

Chapter 1 Overview 1-37

Figure Legend

5 I/O boat 0 ready to remove 12 Link card management

6 I/O boat 0 fault/locate 13 Slot attention/locate (all PCI carriers)

7 I/O boat 0 DC power 14 Slot power (all PCI carriers)

Note – On the optical link card, the LEDs for link card data and link card

management are located next to the optical cable sockets. Although the LEDs are
near the sockets, they do not have any direct relationship to the sockets and are not
intended to indicate the activity of the optical cable sockets.

1.6 System Management

The PSUs contain temperature sensors. The PSUs can shut down automatically if
they detect an extreme temperature. The PSUs also have sensors for voltage and
current levels.

Temperature sensors are also located inside the I/O boats. FRU ID circuits are located
on the link cards, the PSUs, the I/O boats, and on the chassis centerplane.
Temperature data and FRU ID information is available on an I2C bus (Inter-IC bus)
in the External I/O Expansion Unit and the link cards.

The service processor in the host system can monitor the I2C bus in the External I/O
Expansion Unit. The service processor can power down the External I/O Expansion
Unit if parameters exceed maximum limits.

There is no service processor in the External I/O Expansion Unit itself.

The ioxadm command is available on the host system to display External I/O
Expansion Unit sensor information and LED states. You can also use ioxadm to
control the Locate LEDs in the External I/O Expansion Unit and to power on or off
FRUs in the External I/O Expansion Unit. Refer to the ioxadm (8) man page for more
information.

For examples of software commands, see Appendix C.

1-38 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

1.6.1 Maximum Temperatures in the External I/O Expansion Unit

TABLE 1-1 summarizes the maximum temperatures for the External I/O Expansion

Unit. The table also includes error messages that the host might display if these
temperatures exceed the maximum values. Two types of error messages might be
displayed on the host console, Ereport (error report) and FMA (Fault Management
Architecture) messages.

TABLE 1-2 Maximum Temperatures

Temperature Where Measured Comments

38˚C (100˚F) At the intake of the PSU Ereport: ereport.chassis.env.temp.otw

FMA: fault.chassis.iox.env.temp.over-warn

54˚C (130˚F) Inside the PSU Ereport: ereport.chassis.env.temp.otf

FMA: fault.chassis.iox.power.fail
Note: The PSU can turn itself off if its internal temperature

exceeds this value.

60˚C (140˚F) Inside the I/O boat Ereport: ereport.chassis.env.temp.otw

FMA: fault.chassis.iox.env.temp.over-warn

65˚C (150˚F) Inside the I/O boat Ereport: ereport.chassis.env.temp.otf

FMA: fault.chassis.iox.power.fail

1.7 Site Preparation

The following information summarizes installation requirements for the External I/O
Expansion Unit.

For additional specifications and compliance information, see Appendix A.

1.7.1 Physical Requirements

■ The External I/O Expansion Unit with the cable management unit attached is 17.3

in./440 mm wide and 39.4 in./1000 mm deep.

■ The movement of air through the External I/O Expansion Unit chassis is from

front to back.

■ The External I/O Expansion Unit is four rack units tall (6.9 in./175 mm).

Chapter 1 Overview 1-39

■ Service access to the External I/O Expansion Unit is from the front or rear. The

mounting rails do not slide.

■ The choice of mounting location in a rack can be limited by the length of the link

cable:

■ The optical link kit includes either 33 ft/10 m or 80 ft/25 m cables. The External

I/O Expansion Unit can be located some distance from the host server rack.

■ The copper link kit includes a 13 ft/4 m cable.

■ The maximum weight of the External I/O Expansion Unit is approximately 81

pounds (36.8 kg).

Caution – Mount the heaviest subassemblies at the lowest available opening in a

rack to minimize the precarious effects of a top-heavy system.

Note – Do not install another product between two External I/O Expansion Units if

the product is short in height and shorter in depth than the External I/O Expansion
Units. If there is little space between the upper and lower External I/O Expansion
Units, there might not be enough space for your hands and arms to connect cables on
the rear of the product.

1.7.2 Electrical Requirements

■ The maximum wattage per PCI card is 25 watts.

■ Two AC cords (supplied) must be used with the internal AC cables (FIGURE 1-2).

■ The supply voltage is 100 VAC to 240 VAC, 50-60 Hz.

■ The maximum power rating of External I/O Expansion Unit is 600 watts.

1-40 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

1.8 Service Information

Service and installation information is also available on service labels that are located
on the External I/O Expansion Unit top cover and on the dummy cards that are
shipped with new carriers.

TABLE 1-3 Service Information Summary

Topic Comments

Access • Service access to the External I/O Expansion Unit is from the

front or rear of the unit.

• The top cover is removable.

Air flow • Air flow in the External I/O Expansion Unit is from front to

back.

• Fans are located in the power supply units. There are no
separate fans or fan trays.

• The PSU and I/O boat slots have pivoting metal flaps that drop
down to close the slots when a PSU or I/O boat is removed.
This prevents the loss of cooling air.

Mounting brackets The External I/O Expansion Unit is mounted on fixed brackets.

Sliding brackets are not available for this product.

PCI card installation • To avoid overheating of the External I/O Expansion Unit, cards

should be installed as quickly as possible.

• To prepare yourself to install a card within one or two minutes,
see Section 1.3, “Carriers” on page 1-17.

PCI cable removal • When removing cables such as LAN cables, if you have

difficulty unlatching the connector, press the latch with a
flathead screwdriver to remove the cable.

AC cables and cords • The internal AC cables (

are damaged, replace the chassis.

• Each internal AC cable connects to only one PSU. Connect both
AC cables to AC power to ensure that both PSUs are
operational.

• The internal AC cables are not connected directly to AC voltage.
Use the AC power cords to connect the internal AC cables to AC
voltage.

• Do not use AC cables designed for other products with the
External I/O Expansion Unit.

FIGURE 1-2) are not removable. If they

Chapter 1 Overview 1-41

TABLE 1-3 Service Information Summary (Continued)

Topic Comments

Link cables • The optical version of the link kit includes two unidirectional

cables. The ends of the cables are marked TX and RX (transmit
and receive, respectively).

• The copper link kit has one cable. The connector is designed in a
way such that it cannot be connected upside down.

Jumpers • The External I/O Expansion Unit does not have jumper pins.

• For information about any jumper pins that might be present on
a specific PCI card, see the instructions that came with the card.

System serial number • For a new system, the system serial number is located on labels

on the chassis bezel and inside the right I/O boat bay.

• For a FRU chassis, the system serial number is located inside the
left I/O boat bay. Two additional serial number labels are
included to be placed on the chassis bezel.

1-42 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

1.9 Electrostatic Discharge Precautions

Caution – Circuit board components are vulnerable to damage by electrostatic

discharge (ESD). An electrostatic charge can build up on the human body and then
discharge when you touch a board. Such discharge can be produced by walking
across a carpet and touching a board, or by other similar cause. Before handling any
board, ensure that you dissipate your body’s charge. Touch a conductive surface of
the chassis or other element connected to common earth ground to discharge the
static electricity present in your body.

To minimize risk of ESD damage:

■ Handle the board by the edges only.

■ Store the board in an antistatic bag.

■ Use a grounding strap and an ESD mat whenever you work on a board.

Chapter 1 Overview 1-43

1-44 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

CHAPTER

2

Installing the External I/O Expansion Unit in a Rack

The following topics are in this chapter:

■ Section 2.1, “Tools” on page 2-1

■ Section 2.2, “Installing the Mounting Brackets in a Rack” on page 2-2

■ Section 2.3, “Installing the External I/O Expansion Unit in the Rack” on page 2-7

■ Section 2.4, “Installing the Cable Management Unit” on page 2-9

■ Section 2.5, “Installing the AC Cords” on page 2-13

■ Section 2.6, “Installing the Link Kit” on page 2-16

2.1 Tools

You need the following tools for this installation:

■ Phillips No. 1 screwdriver

■ Phillips No. 2 screwdriver

■ ESD-protected mat and a grounding strap

■ (Suggested) digital voltmeter to verify correct grounding

2-1

2.2 Installing the Mounting Brackets in a Rack

The External I/O Expansion Unit can be installed in either an equipment rack or the
rack space in the SPARC Enterprise M8000 server.

The External I/O Expansion Unit mounting kit (
mounting bracket and a left-side mounting bracket. The mounting brackets are
adjustable for length and are shipped unassembled. The mounting kit includes two
chassis lock brackets.

FIGURE 2-1 Mounting Kit

1

2

FIGURE 2-1) includes a right-side

3

4

Figure Legend

1 Left mounting bracket

2 Right mounting bracket

3 Left chassis lock bracket

4 Right chassis lock bracket

1. Use an antistatic strap for this procedure.

2. Locate a suitable mounting location in the rack.

2-2 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

■ The External I/O Expansion Unit occupies a height of four rack units (6.9 in./175

mm).

■ Mount the heaviest subassemblies at the lowest available opening to minimize the

precarious effects of a top-heavy system.

■ If you are installing more than one External I/O Expansion Unit, install them

together. Do not install a shorter subassembly between External I/O Expansion
Unit where the rear of the shorter subassembly might difficult to reach.

■ If the rack is marked with rack units, place the mounting bracket so that the lower

screw hole on the bracket is one hole above an RU mark (

FIGURE 2-2). This aligns

the mounting bracket with the lower RU mark.

FIGURE 2-2 Typical Rack Unit Marks

3. Using No. 2 Phillips screws, attach the chassis lock brackets to the sides of the

External I/O Expansion Unit (

Chapter 2 Installing the External I/O Expansion Unit in a Rack 2-3

FIGURE 2-3).

FIGURE 2-3 Installing the Chassis Lock Brackets

4. Loosen the screws (FIGURE 2-4) that hold the sliding flanges to the mounting

brackets.

This action allows the rear flanges to adjust to fit different rack depths.

2-4 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

FIGURE 2-4 Sliding Flange

Figure Legend

1 Sliding flange

2 Flange crews

1

2

5. If your rack has threaded holes, continue at Step 7.

6. If your rack has square holes, install cage nuts in the rack pillars.

TABLE 2-1 lists the locations for the cage nuts. Note that these are relative locations.

Adjust the actual hole locations as needed to leave space for a power distribution
unit, additional External I/O Expansion Units, or other rack-mounted equipment.

Chapter 2 Installing the External I/O Expansion Unit in a Rack 2-5

TABLE 2-1 Cage Nut Locations

Rack Unit Hole No. Front Rear

412

11

10 cage nut cage nut

39

8

7

2 6 cage nut cage nut

5 cage nut cage nut

4

13

2 cage nut cage nut

1

7. Attach the mounting brackets to the rack (FIGURE 2-5):

a. At the front of the rack, orient the hooked portion of the mounting bracket

away from you.

b. Loosely attach the front of the mounting bracket to the rack.

Install and tighten the screws, then loosen each screw approximately one-half
turn.

c. Repeat Step a and Step b for the second mounting bracket.

d. At the rear of the rack, slide the end of each mounting bracket to fit the depth

of the rack.

e. Loosely attach the rear ends of the mounting brackets to the rack.

f. Narrow the space between the rear ends of the mounting brackets by sliding

the ends of the brackets toward each other.

Note – At the front of the rack, the space between the brackets should be equal to or

slightly wider than the width of the External I/O Expansion Unit chassis. At the rear
of the rack, the space between the brackets should be slightly narrower than the
width of the External I/O Expansion Unit chassis. This arrangement allows the
correct fitting of the brackets to the sides of the External I/O Expansion Unit. See

Section 2.3, “Installing the External I/O Expansion Unit in the Rack” on page 2-7.

2-6 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

FIGURE 2-5 Installing the Mounting Brackets in a Rack

8. Tighten the screws at the front of the rack.

9. Verify that the brackets at the rear of the rack can still slide slightly to the left

and right.

2.3 Installing the External I/O Expansion Unit in the Rack

The External I/O Expansion Unit can be installed in either an expansion rack or the
19-inch rack space in the SPARC Enterprise M8000 server.

1. Use an antistatic strap for this procedure.

Chapter 2 Installing the External I/O Expansion Unit in a Rack 2-7

2. Place the External I/O Expansion Unit on the front of the mounting brackets and

slide the External I/O Expansion Unit into the rack.

As you slide the External I/O Expansion Unit into the rack, the sides of the
External I/O Expansion Unit chassis push the ends of the brackets apart from each
other. When the chassis is almost completely in the rack, bulges on the underside
of the chassis contact hooks that are located on the mounting brackets, wedging
the mounting brackets tightly against the sides of the chassis. This wedging action
stabilizes the External I/O Expansion Unit and is necessary to reduce the amount
of vibration that occurs when the system is running.

3. Tighten the screws at the rear of the mounting brackets.

4. Lock the front of the External I/O Expansion Unit in place with two screws on

each side (

FIGURE 2-6 Installing the External I/O Expansion Unit in the Rack

FIGURE 2-6).

2-8 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

2.4 Installing the Cable Management Unit

At the rear of the rack, install the cable management support brackets:

1. Use an antistatic strap for this procedure.

2. Place the support brackets just above the chassis mounting brackets (

and loosely attach the support brackets to the rack with two screws each.

Do not tighten the screws yet.

FIGURE 2-7)

Note – The cable management unit includes one cable plate, either type A

(FIGURE 2-8)ortype B (FIGURE 2-9).

■ Use the type A cable plate in racks that allow the routing of cables along both

sides of the rack.

■ Use the type B cable plate in racks that allow the routing of cables only along the

right side of the rack.

Chapter 2 Installing the External I/O Expansion Unit in a Rack 2-9

FIGURE 2-7 Installing the Support Brackets

2-10 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

FIGURE 2-8 Type A Cable Plate

FIGURE 2-9 Type B Cable Plate

Chapter 2 Installing the External I/O Expansion Unit in a Rack 2-11

3. Place the cable plate between the support brackets (FIGURE 2-10).

On each side of the cable plate, the forward tab rests on the bottom of the large
cutout in the support bracket. The rear tab rests in a small depression in the top of
the support bracket. This is the normal operating position for the cable plate.

FIGURE 2-10 Cable Plate and Support Bracket, Side View

1

2

3

Figure Legend

1 Cable plate

2 Support bracket

3 Supporting tabs on the cable plate

4. Tighten the green cable plate locking screws at each side of the cable plate.

5. Tighten the mounting screws on the support brackets.

2-12 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

2.5 Installing the AC Cords

1. Use an antistatic strap for this procedure.

2. Attach an AC cord to an internal AC cable at the rear of the External I/O

Expansion Unit, then connect the AC cord to an AC outlet.

■ The PSUs should be connected to two independent external AC power sources so

that service will not be interrupted if one AC power source fails.

■ For the type A cable plate (FIGURE 2-8), route each AC cord along the nearest side

of the rack.

■ For the type B cable plate (FIGURE 2-9), route the left AC cord over the top of the

cable plate to the right side of the rack. Place the connector of the left AC internal
cable in the rectangular opening in the top of the type B cable plate to save space.
See

FIGURE 2-12.

Note – If the PSU1 power cable does not reach the rack power distribution unit,

route the cable on left side of the rack.

Note – Do not connect the internal AC cable directly to an AC socket (power

distribution unit or power strip). You must use the AC cords supplied with the
External I/O Expansion Unit.

3. Attach an AC cord to the remaining internal AC cable as in Step 2.

Note – The fan might turn on when you insert a power supply into the External I/O

Expansion Unit. This is normal behavior if you are replacing a PSU while the other
PSU is powered up.

Chapter 2 Installing the External I/O Expansion Unit in a Rack 2-13

FIGURE 2-11 AC Cables for Type A Cable Management Plate

1

2

Figure Legend

1 Internal AC cable, left

2 Internal AC cable, right

2-14 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

FIGURE 2-12 AC Cables and Cords for Type B Cable Management Plate

1

2

3

Figure Legend

1 Internal AC cable, left

2 AC cord (connectors are placed in rectangular opening to reduce height)

3 Internal AC cable, right

Chapter 2 Installing the External I/O Expansion Unit in a Rack 2-15

4. If you wish to test the External I/O Expansion Unit for basic electrical

functionality, do the following:

a. Turn on the PSU AC switches.

The switches are located on the front of the power supplies.
The LEDs on the power supplies should display the following indications after

a short initialization period.

TABLE 2-2 Normal PSU Indications

LED Indication

AC Power On (green LED)

DC Power On (green LED)

For other LED combinations, see

b. Turn off the PSU AC switches.

The LEDs on the PSUs continue glowing until DC current in the PSUs is
depleted. This can take approximately five to ten seconds.

TABLE B-4.

2.6 Installing the Link Kit

A link kit includes two identical link cards, one for the host server and one for the
I/O boat. You can install either card in either location.

The link card in the I/O boat is always installed in boat slot 0. If your External I/O
Expansion Unit has two I/O boats, then link cards must be located in slot 0 of both
boats.

Note – If you are installing a second boat in the External I/O Expansion Unit, both

boats must be connected to the same host server. Do not connect the second boat to a
different server. The second boat can be connected to a different domain on the same
server, but not to a domain on a different server.

Note – Do not daisy-chain two boats (connect a boat to another boat through link

cards). Daisy-chain configurations are not allowed.

Your link kit is one of two types:

2-16 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

■ Optical interface and two cables — see Section 2.6.1, “Installing the Optical Link

Kit” on page 2-17

■ Copper interface and one cable — see Section 2.6.2, “Installing the Copper Link

Kit” on page 2-18

2.6.1 Installing the Optical Link Kit

Note – The minimum bend radius for optical link cables is 1.8 in./46 mm.

1. Use an antistatic strap for this procedure.

2. Install a link card in the host server.

See the service manual for your host server for instructions for installing an PCI
card.

3. If a link card is not already installed in the I/O boat, install it now.

Slot 0 is used for the link card. It is the leftmost slot in the boat. For details about
card removal and replacement, see Section 3.1, “Installing a PCI Card” on

page 3-1.

Caution – The carrier can be damaged during removal and during insertion. For

safe handling of the carrier, read the cautions in Section 3.1, “Installing a PCI Card”

on page 3-1.

4. Install the link cables.

Note – The two optical link cables are identical. One end of a cable is marked TX.

The other end is marked RX (

FIGURE 2-13). When you route the cables, ensure that the

TX plug of one cable is paired with the RX plug of the other cable.

a. At the I/O boat, connect a plug marked TX into the TX port on the link card.

Connect the RX plug of the second cable into the RX port.

b. At the host server, connect a plug marked TX to the TX port on the link card.

Connect the RX plug of the remaining cable into the RX port.

Chapter 2 Installing the External I/O Expansion Unit in a Rack 2-17

FIGURE 2-13 TX and RX Labels on the Optical Link Cable

1

2

Figure Legend

1 TX label

2 RX label

Note – Check the labels to verify that each plug is connected to the correct port. The

TX and RX plugs are identically shaped, so it is easy to incorrectly connect a plug to
the wrong port.

2.6.2 Installing the Copper Link Kit

Note – The minimum bend radius for the copper link cable is 1.85 in./47 mm.

1. Use an antistatic strap for this procedure.

2. Install a link card in the host server.

See the service manual for your host server for instructions for installing a PCI
card in a host slot.

Note – Low profile brackets that are included in some copper link kits are not used

for SPARC Enterprise M4000/M5000/M8000/M9000 servers.

3. If a link card is not already installed in the I/O boat, install it now.

Slot 0 is used for the link card. It is the leftmost slot in the boat. For details about
card removal and replacement, see Section 3.1, “Installing a PCI Card” on

page 3-1.

2-18 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

Caution – The carrier can be damaged during removal and during insertion. For

safe handling of the carrier, read the cautions in Section 3.1, “Installing a PCI Card”

on page 3-1.

4. Connect the link cable to both link cards.

FIGURE 2-14 Copper Link Cable Plug

Note – If it is necessary to disconnect a link cable, pull the ring-shaped tab

approximately 0.15 in./2 mm in the direction shown by the arrow in FIGURE 2-15.

Caution – Do not pull the ring tab more than 0.15 in./2 mm, or it will break. When

disconnecting the cable from a link card, pull the cable plug while pulling carefully
on the ring tab.

FIGURE 2-15 Copper Link Cable Ring Tab

Chapter 2 Installing the External I/O Expansion Unit in a Rack 2-19

2-20 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

CHAPTER

3

Working With PCI Cards

This chapter gives procedures for installing PCI and link cards, and related cables.

■ Section 3.1, “Installing a PCI Card” on page 3-1

■ Section 3.2, “Replacing a PCI Card” on page 3-9

■ Section 3.3, “Installing Cables for PCI Cards” on page 3-16

3.1 Installing a PCI Card

1. Determine which card locks you will use to mount your PCI card on a carrier.

The size and shape of the PCI card affect the quantity and type of card locks you
use. Before you start this procedure, you must decide which locks you will use for
the PCI card. See Section 1.3.2, “Card Locks” on page 1-20

Caution – If you install a PCI card when the External I/O Expansion Unit is

running, be prepared to complete the installation within two minutes or so. If you
leave a carrier slot empty, the External I/O Expansion Unit might overheat.

2. Use an antistatic strap for this procedure.

3. Unscrew the carrier locking screw (item 2 in

FIGURE 3-1) on the carrier handle.

3-1

FIGURE 3-1 Unlocking and Removing a Carrier

Figure Legend

1 Carrier handle

2 Carrier locking screw

4. Press lightly on the front of the carrier, and pull out the carrier handle until it

clicks into the open position (approximately 1.5 in./38 mm).

Pressing the front of the carrier prevents movement of the carrier when you pull
the carrier handle.

Caution – Pulling the carrier handle raises the carrier plate. If the carrier moves

forward before the carrier plate is completely raised, the plastic locator bar
(FIGURE 3-2) might be damaged by hitting the lower front edge of the I/O boat.

3-2 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

FIGURE 3-2 Locator Bar on Carrier

5. Pull the carrier out of the slot and place it on an antistatic work surface.

6. Press the locking latch (

FIGURE 3-3) while you push the carrier handle into the

closed position.

This action lowers the carrier plate, giving you more room to move the PCI card
into place on the carrier.

FIGURE 3-3 Closing the Carrier Handle

1

2

Figure Legend

1 Push carrier handle to the right

2 Push locking latch to the left

7. Place the carrier on a padded static-safe surface and loosen the card lock screws.

The screws are on the back of the carrier (

FIGURE 3-4).

Chapter 3 Working With PCI Cards 3-3

FIGURE 3-4 Screws for Card Locks

1

Figure Legend

1 Card lock screws

8. Turn the carrier over and remove the dummy card or PCI card.

9. For very small PCI cards (1.25 in./31 mm tall or 3.0 in./76 mm wide), it is

necessary to do one or both of the following:

■ Move the long card lock (type B lock) from the horizontal slider slot to the front

vertical slider slot, then slide it down to reach the top of the PCI card. See

■ Rotate the small card lock (type C lock) and slide it to the rear edge of the PCI

card.
See

FIGURE 1-19 and FIGURE 1-20 for examples.

10. Place the PCI card on the carrier.

a. Place the front of the card inside the housing (

3-4 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

FIGURE 3-5).

FIGURE 3-5 Inserting the PCI Card

1

Figure Legend

1 See the following caution.

Caution – Do not allow the bottom edge of the PCI card bracket to tear the RFI

gasket in the front of the carrier (FIGURE 3-5).

b. A rectangular notch is located on the bottom front of the PCI card. Fit the

notch over the card alignment tab (item 1 in
card bracket over the card alignment post (item 2 in

FIGURE 3-6), then fit the top of the

FIGURE 3-6).

Chapter 3 Working With PCI Cards 3-5

FIGURE 3-6 Placing the PCI Card on the Carrier

2

1

Figure Legend

1 Card alignment tab

2 Card alignment post

11. Attach the PCI card to the carrier with one card lock:

a. Slide a card lock to the right edge of the PCI card.

b. Hold the card in place and partially tighten the card lock screw.

Push the card lock against the card with sufficient pressure to slightly compress
the RFI gasket.

c. Verify that the PCI card is not tilted, then tighten the card lock screw.

3-6 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

FIGURE 3-7 Using Card Lock to Hold the PCI Card

1

Figure Legend

1 Card lock

12. Slide the remaining card locks to the edges of the PCI card and tighten the
screws.

The shape of a PCI card might prevent the use of some card locks. The minimum
requirement is one card lock on the side of the PCI card and one card lock on the
top.

Note – If the card lock screws are loose, the card locks will slip. The PCI card will

not seat properly.

Caution – If the bottom card lock (Type C) is not used, leave it at the far right side

of the slot (

FIGURE 3-8). The PCI card will not seat properly if the bottom of the card

lock touches the card socket.

FIGURE 3-8 Correct Location for an Unused Type C Card Lock

1

Figure Legend

1 Location of type C card lock when not in use

Chapter 3 Working With PCI Cards 3-7

Caution – Do not apply excessive pressure on the upper card locks. Too much

pressure will bend the PCI card bracket. See FIGURE 3-9.

FIGURE 3-9 Excessive Pressure Bends the PCI Card Bracket

Figure Legend

1 Moderate pressure on an upper card lock holds the PCI card in a horizontal position.

2 Excessive pressure bends the PCI card bracket.

13. Pull the carrier handle into the fully open position to raise the carrier plate.

If the carrier plate is not completely raised, the bottom edge will hit the card socket
in the I/O boat in Step 14 and Step 15.

14. Carefully place the replacement carrier in the card guides at the top and bottom
of the carrier slot in the I/O boat.

15. Push the carrier into the carrier slot.

Caution – Do not press the carrier handle while you push the carrier into the slot.

Push only the front of the carrier when seating the carrier in the slot. Pushing the
carrier handle might damage the carrier plate by causing it to drop down before the
carrier is fully seated in the slot.

16. Push the carrier handle into the closed position (

FIGURE 3-10).

This action seats the PCI card in the card socket.

3-8 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

Caution – If the carrier handle does not close easily, the PCI card might not be

seating properly in the card socket in the I/O boat. Remove the carrier and inspect
the PCI card. If the bottom of the PCI card is not perfectly horizontal, loosen the card
locks and realign the card on the carrier. For troubleshooting information, see

Appendix D.

FIGURE 3-10 PCI Card and Carrier

Figure Legend

1 Carrier handle (in closed position)

2 Carrier locking screw

17. Use the carrier locking screw located on the top of the handle to lock the carrier
handle in place.

18. Add the PCI card to an Oracle Solaris domain.

For details, refer to the service manual for your host server.

3.2 Replacing a PCI Card

Caution – If you install a PCI card while the External I/O Expansion Unit is

running, be prepared to complete the installation in approximately two minutes. If
you leave a carrier slot empty, the External I/O Expansion Unit might overheat.

1. Use an antistatic strap for this procedure.

2. Remove the PCI card from the Oracle Solaris domain.

For details, refer to the service manual for your host server.

Chapter 3 Working With PCI Cards 3-9

3. Remove the carrier from the carrier slot in the I/O boat.

a. Loosen the carrier locking screw on the carrier handle.

b. Press lightly on the front of the carrier, and pull the carrier handle out fully.

Caution – Pulling the carrier handle raises the carrier plate. If the carrier moves

forward before the carrier plate is completely raised, the plastic locator bar
(FIGURE 3-2) might be damaged by hitting the lower front edge of the I/O boat.

c. Pull the carrier out of the carrier slot and place on an antistatic surface.

4. Press the locking latch (

FIGURE 3-11) while you push the carrier handle into the

closed position.

This action lowers the PCI card, facilitating the replacement of the card.

FIGURE 3-11 Closing the Carrier Handle

1

2

Figure Legend

1 Push carrier handle to the right

2 Push locking latch to the left

5. Remove the existing card from the carrier.

6. If you are installing an exact replacement, go to Step 8.

7. For very small PCI cards (1.25 in./31 mm tall or 3.0 in./76 mm wide), it is
necessary to do one or both of the following:

■ Move the long card lock (type B lock) from the horizontal slider slot to the front

vertical slider slot, then slide it down to reach the top of the PCI card.

■ Rotate the small card lock (type C lock) and slide it to the rear edge of the PCI

card.
See

FIGURE 1-19 and FIGURE 1-20 for examples.

3-10 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

8. Place the PCI card on the carrier.

a. Place the front of the card inside the housing (

FIGURE 3-12 Inserting the PCI Card

FIGURE 3-12).

1

Figure Legend

1 See the following caution.

Caution – Do not allow the bottom edge of the PCI card bracket to tear the RFI

gasket in the front of the carrier (FIGURE 3-5).

b. A rectangular notch is located on the bottom front of the PCI card. Fit the

notch over the card alignment tab (item 1 in
card bracket over the card alignment post (item 2 in

FIGURE 3-6), then fit the top of the

FIGURE 3-6).

Chapter 3 Working With PCI Cards 3-11

FIGURE 3-13 Placing the PCI Card on the Carrier

2

1

Figure Legend

1 Card alignment tab

2 Card alignment post

9. Attach the PCI card to the carrier with one card lock:

a. Slide a card lock to the right edge of the PCI card.

b. Hold the card in place and partially tighten the card lock screw.

c. Verify that the PCI card is not tilted, then tighten the card lock screw.

3-12 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

FIGURE 3-14 Using Card Lock to Hold the PCI Card

1

Figure Legend

1 Card lock

10. Slide the remaining card locks to the edges of the PCI card and tighten the
screws.

The shape of a PCI card might prevent the use of some card locks. The minimum
requirement is one card lock on the side of the PCI card and one card lock on the
top.

Note – If the card lock screws are loose, the card locks will slip and the PCI card will

not seat properly.

Caution – If the bottom card lock (type C) is not used, leave it at the far right side of

the slot (

FIGURE 3-15). The PCI card will not seat properly if the bottom of the card

lock touches the card socket.

FIGURE 3-15 Location for an Unused Type C Card Lock

1

Figure Legend

1

Correct location and orientation for an unused type C card lock

Chapter 3 Working With PCI Cards 3-13

Caution – Do not apply excessive pressure on the upper card locks. Too much

vertical pressure will bend the PCI card bracket. See FIGURE 3-16.

FIGURE 3-16 Excessive Pressure Bends the PCI Card Bracket

Figure Legend

1 Moderate pressure on an upper card lock holds the PCI card in a horizontal position.

2 Excessive pressure on an upper card lock can bend the PCI card bracket.

11. Pull the carrier handle into the fully open position to raise the carrier plate.

Caution – If the carrier plate is not completely raised when you insert the carrier in

Step 13, the plastic locator bar (

FIGURE 3-17) might break by hitting the lower front

edge of the I/O boat.

3-14 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

FIGURE 3-17 Locator Bar on Carrier (Carrier Handle Shown in the Closed Position)

12. Carefully place the carrier in the card guides at the top and bottom of the carrier
slot in the I/O boat.

13. Press on the metal front panel of the carrier to push the carrier fully into the
carrier slot.

Caution – Do not press the plastic carrier handle during Step 13. If you press the

handle, the PCI card and the sliding carrier plate might suddenly fall, breaking the
plastic locator bar (FIGURE 3-17) by hitting it against the lower edge of the I/O boat.

14. Push the carrier handle into the closed position.

This action seats the PCI card in the card socket.

Caution – If the carrier handle does not close easily, the PCI card might not be

seating properly in the card socket in the I/O boat. Remove the carrier and inspect
the PCI card. If the bottom of the PCI card is not perfectly horizontal, loosen the card
locks and realign the card on the carrier. For troubleshooting information, see

Appendix D.

Chapter 3 Working With PCI Cards 3-15

FIGURE 3-18 PCI Card and Carrier

Figure Legend

1 Carrier handle (in closed position)

2 Carrier locking screw

15. Use the carrier locking screw located on the top of the handle to lock the carrier
handle in place.

16. Add the PCI card to an Oracle Solaris domain.

For details, refer to the service manual for your host server.

3.3 Installing Cables for PCI Cards

1. Use an antistatic strap for this procedure.

2. Route the cables across the top of the cable management unit as shown in

FIGURE 3-19 or FIGURE 3-20.

a. Route the cables in the rack:

■ For the type A cable plate, route the cables along the both sides of the rack.

■ For the type B cable plate, route the cables along the right side of the rack.

b. Place the ends of the cables on the top of the cable plate, then curve the

cables down to the corresponding PCI cards.

c. Use cable ties to hold the cables in place on the top of the cable management

unit.

3-16 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

Note – Before tightening the cable ties, ensure that each cable has a service loop

(freedom of movement) of at least 2 in./50 mm. This allows the cable plate and
cables to be moved from the normal position (

FIGURE 4-4) to the service position

without the need to untie the cables.

FIGURE 3-19 Example of Cable Management for the Type A Cable Plate

Chapter 3 Working With PCI Cards 3-17

FIGURE 3-20 Example of Cable Management for the Type B Cable Plate

3. Attach I/O cables from the PCI cards and their respective devices or network
ports.

3-18 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

CHAPTER

4

Servicing and Replacing Components

This chapter includes the service procedures for replacing field-replaceable units and
installing optional assemblies.

This chapter includes the following topics:

■ Section 4.1, “Service Procedures Task Map” on page 4-2

■ Section 4.2, “Identifying Firmware Versions” on page 4-3

■ Section 4.3, “Replacing a Power Supply Unit” on page 4-4

■ Section 4.4, “Powering Down a Link Before Service” on page 4-6

■ Section 4.5, “Preparing the Cable Plate for Service” on page 4-7

■ Section 4.6, “Replacing a Carrier” on page 4-9

■ Section 4.7, “Replacing a Link Cable” on page 4-13

■ Section 4.8, “Replacing a Link Card in the Host Server” on page 4-13

■ Section 4.9, “Replacing a Link Card in an I/O Boat” on page 4-14

■ Section 4.10, “Installing a Second I/O Boat” on page 4-16

■ Section 4.11, “Replacing an I/O Boat” on page 4-19

■ Section 4.12, “Replacing the External I/O Expansion Unit Chassis” on page 4-24

■ Section 4.13, “Powering Up a Link After Service” on page 4-33

4-1

4.1 Service Procedures Task Map

TABLE 4-1 Service Task Map

FRU Task Comments

PCI card

PSU

Cable
Management

Carrier

Link

I/O boat

Chassis

• Install a new PCI card Section 3.1, “Installing a PCI Card” on page 3-1

• Replace an existing PCI card Section 3.2, “Replacing a PCI Card” on page 3-9

• Replace a PSU Section 4.3, “Replacing a Power Supply Unit” on page 4-4

• Prepare the cable plate for I/O boat
service

Section 4.5, “Preparing the Cable Plate for Service” on
page 4-7

• Replace a carrier Section 4.6, “Replacing a Carrier” on page 4-9

• Replace a link cable Section 4.7, “Replacing a Link Cable” on page 4-13

• Replace a link card • Section 4.4, “Powering Down a Link Before Service” on

page 4-6

• Section 4.8, “Replacing a Link Card in the Host Server”

on page 4-13

• Section 4.9, “Replacing a Link Card in an I/O Boat” on

page 4-14

• Section 4.13, “Powering Up a Link After Service” on

page 4-33

• Install a second I/O boat Section 4.10, “Installing a Second I/O Boat” on page 4-16

• Replace an I/O boat • Section 4.11.1, “Replacing a Boat in a Single Boat

Configuration” on page 4-19

• Section 4.11.2, “Replacing a Boat in a Dual Boat

Configuration” on page 4-21

Replace the External I/O Expansion
Unit chassis

Section 4.12, “Replacing the External I/O Expansion Unit
Chassis” on page 4-24.

4-2 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011

4.2 Identifying Firmware Versions

It might be helpful to identify firmware versions in the External I/O Expansion Unit
when troubleshooting problems. Firmware is located on the motherboard and on
each link card.

To identify versions of firmware, use the ioxadm -v list command. In the output,
firmware versions are listed in the column marked “FW Ver”.

XSCF> ioxadm -v list
Location Type FW Ver Serial Num Part Num State
IOX@X04E IOX 2.4 XCX04E 5016937-03 On
IOX@X04E/PS0 A195 - T01180 3001701-03 On
IOX@X04E/PS1 A195 - T01097 3001701-03 On
IOX@X04E/IOB0 PCIX - XX00EL CF005016938/5016938-05 On
IOX@X04E/IOB0/LINK OP 2.4 XF01D3 CF005017040/5017040-03 On
IOU#0-PCI#3 OP 2.4 XF014C 5017040-03 On
IOX@X04E/IOB1 PCIE - XE00C1 CF005016939/5016939-04 On
IOX@X04E/IOB1/LINK OP 2.4 XF00W2 5017040-03 On
IOU#0-PCI#1 OP 2.4 XF01AX CF005017040/5017040-03 On
XSCF>

This example shows five instances of firmware in an External I/O Expansion Unit
that is configured with two I/O boats:

■ IOX in the Type column identifies the chassis, where the fan controller firmware is

located.

■ OP in the Type column identifies the link cards, where the bridge controller

firmware is located. A link consists of two link cards, and there are two links in
this example (one link for each I/O boat), for a total of four link cards:

■ LINK in the Location column identifies a link card in an I/O boat.

■ IOU#n-PCI#n in the Location column identifies a link card in a server.

Refer to the ioxadm(8) man page for more information.

Chapter 4 Servicing and Replacing Components 4-3

4.3 Replacing a Power Supply Unit

This is a hot replacement procedure, meaning that the PSU can be replaced while the
system is still running, provided that a second PSU is working properly.

1. Use an antistatic strap for this procedure.

2. Unpack the new power supply unit and set it flat on an antistatic surface.

Caution – Do not rest a PSU vertically. The plastic electrical connector on the back is

breakable.

3. If the system is running, power down the PSU with the ioxadm command:

XSCF> ioxadm poweroff target

Refer to the ioxadm (8) man page for more information.

4. At the front of the defective PSU, turn off the PSU AC switch and verify that the
DC Power LED ( ) turns off.

5. Loosen the handle locking screw on the PSU handle.

6. Unlock the PSU by swinging the handle out 90 degrees into the fully open
position. (

FIGURE 4-1).

7. Place a hand under the PSU to prevent it from falling, then pull the PSU out of
the External I/O Expansion Unit.

Caution – The PSU is heavy (7.5 lb/3.4 kg).

When you can see the warning label on the top of the PSU, the PSU is almost fully
out of the PSU slot.

Caution – Do not allow the rear of the PSU to drop. The connector at the rear of the

PSU can be damaged if it strikes the edge of the slot.

A pivoting flap behind the PSU drops down to prevent loss of cooling air.

4-4 External I/O Expansion Unit for SPARC Enterprise Mx000 Servers Installation and Service Manual • April 2011