Sun Microsystems Sun Enterprise 10000 Service Manual

Download

Sun Enterprise™10000 System

Service Manual

Sun Microsystems, Inc. 4150 Network Circle Santa Clara, CA 95054 U.S.A. 650-960-1300

Part No. 805-2917-16 March 2002, Revision A

Send comments about this document to: docfeedback@sun.com

This productor document is distributed underlicenses restrictingits use, copying, distribution, anddecompilation. No part of thisproduct or document maybe reproducedin any form by anymeans without prior written authorizationof Sun and its licensors,if any. Third-party software, includingfont technology, is copyrighted and licensed from Sunsuppliers.

Parts ofthe product may be derivedfrom BerkeleyBSD systems, licensed from the University ofCalifornia. UNIX is a registered trademark in the U.S.and other countries, exclusively licensedthrough X/Open Company,Ltd.

Sun™, SunMicrosystems, the Sun logo, AnswerBook2,docs.sun.com, and Solaris are trademarks, registered trademarks, or servicemarks of Sun Microsystems,Inc. in the U.S. andother countries. All SPARC trademarks are used under license and are trademarks orregistered trademarks ofSPARCInternational, Inc. in the U.S.and other countries. Products bearing SPARC trademarks arebased upon an architecture developed bySun Microsystems, Inc. The Energy Star logois a registered trademark of EPA.

The OPENLOOK and Sun Graphical UserInterface was developed by SunMicrosystems, Inc. for its users and licensees.Sun acknowledges the pioneering effortsof Xeroxin researching and developingthe concept of visual or graphical userinterfaces forthe computer industry.Sun holds a non-exclusivelicense from Xerox to the Xerox Graphical User Interface,which license also covers Sun’slicensees who implement OPEN LOOK GUIsand otherwise comply with Sun’swritten license agreements.

Federal Acquisitions:Commercial Software—GovernmentUsers Subject to Standard License Terms and Conditions.

DOCUMENTATION IS PROVIDED “AS IS” AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES, INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.

Ce produitou document est distribué avecdes licences qui en restreignent l’utilisation, la copie, ladistribution, et la décompilation. Aucune partie dece produit ou document nepeut êtrereproduite sousaucune forme, par quelque moyenque ce soit, sans l’autorisation préalable et écrite deSun et de ses bailleursde licence, s’il y ena. Le logiciel détenu pardes tiers, et qui comprend la technologie relative aux polices de caractères, estprotégé parun copyright et licencié pardes fournisseurs de Sun.

Des partiesde ce produit pourront être dérivées des systèmes BerkeleyBSD licenciés par l’Université deCalifornie. UNIX est une marque déposée auxEtats-Unis et dans d’autres payset licenciée exclusivement par X/Open Company, Ltd.

Sun, SunMicrosystems, le logo Sun, AnswerBook2,docs.sun.com, et Solaris sont des marques defabrique ou des marques déposées, ou marques deservice, de Sun Microsystems, Inc. aux Etats-Uniset dans d’autres pays. Toutes les marques SPARC sontutilisées sous licence et sont desmarques de fabrique ou desmarques déposéesde SPARC International, Inc. aux Etats-Uniset dans d’autres pays. Les produits portant les marquesSPARCsont basés sur une architecture développée parSun Microsystems,Inc.

L’interfaced’utilisation graphique OPEN LOOK etSun™ a été développée parSun Microsystems,Inc. pour ses utilisateurs etlicenciés. Sun reconnaît lesefforts depionniers de Xerox pour la recherche et le développementdu concept des interfaces d’utilisationvisuelle ou graphique pour l’industriede l’informatique. Sun détient unelicence non exclusive de Xerox sur l’interface d’utilisation graphique Xerox, cette licence couvrant égalementles licenciés de Sun quimettent en place l’interface d’utilisationgraphique OPEN LOOK et quien outrese conforment aux licences écritesde Sun.

LA DOCUMENTATION EST FOURNIE “EN L’ETAT” ET TOUTES AUTRES CONDITIONS, DECLARATIONS ET GARANTIES EXPRESSES

OU TACITES SONT FORMELLEMENT EXCLUES, DANSLA MESURE AUTORISEE PAR LA LOI APPLICABLE, YCOMPRIS NOTAMMENT

TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE, A L’APTITUDE A UNE UTILISATION PARTICULIERE OU A

L’ABSENCE DE CONTREFAÇON.

Please

Recycle

Contents

Preface xv

1. Component Replacement Guidelines, Indicators, and Nomenclatures 1-1

1.1 Configuration Rules 1-3

1.2 Testing the System 1-4

1.3 Reviewing System Temperatures 1-4

1.4 Hardware Indicators 1-5

1.4.1 Fans 1-6

1.4.2 Centerplane Support Boards 1-7

1.4.3 Control Board 1-8

1.4.4 System Board 1-9

1.5 Inserting a Board 1-10

1.6 Standard Torque Settings 1-11

1.7 Field Replaceable Units 1-13

1.8 Component Numbering 1-14

1.9 System Block Diagrams 1-24

2. Power and Cooling Component Replacement Procedures 2-1

2.1 SSP Replacement 2-1

2.2 Disk Replacement 2-1

2.3 AC Input Module Replacement 2-2

Contents iii

2.3.1 Isolating a Failed AC Input Module 2-2

2.3.2 Powering Off an AC Input Module 2-2

2.3.3 Removing an AC Input Module 2-4

2.3.4 Installing an AC Input Module 2-4

2.3.5 Powering On an AC Input Module 2-4

2.3.6 Verifying an AC Input Module 2-4

2.4 48-Volt Power Supply Replacement 2-5

2.4.1 Isolating a Failed Power Supply 2-5

2.4.2 Powering Off a 48-Volt Power Supply 2-5

2.4.3 Removing a 48-Volt Power Supply 2-5

2.4.4 Installing a 48-Volt Power Supply 2-5

2.4.5 Powering On a 48-Volt Power Supply 2-6

2.4.6 Verifying a Power Supply 2-6

2.5 Power Shelf Replacement 2-6

2.5.1 Removing a Power Shelf 2-6

2.5.2 Installing a Power Shelf 2-8

2.6 DC Breaker Module Replacement 2-9

2.6.1 Isolating a Failed DC Breaker 2-9

2.6.2 Removing a Circuit Breaker 2-9

2.6.3 Installing a Circuit Breaker 2-10

2.6.4 Verifying a DC Breaker 2-11

2.7 Universal AC Sequencer Replacement 2-11

2.7.1 Isolating a Failed AC Sequencer 2-11

2.7.2 Powering Off a Remotely Controlled AC Sequencer 2-12

2.7.3 Removing an AC Sequencer 2-12

2.7.4 Installing an AC Sequencer 2-12

2.7.5 Configuring an AC Sequencer 2-13

2.7.6 Powering On a Remotely Controlled AC Sequencer 2-18

2.7.7 Verifying an AC Sequencer 2-18

2.8 Fan Tray Replacement 2-18

iv Sun Enterprise 10000 System Service Manual • March 2002

2.8.1 Isolating a Failed Fan Tray 2-18

2.8.2 Powering Off a Single Fan Tray or a Group of Fan Trays 2-18

2.8.3 Removing a Fan Tray 2-19

2.8.4 Installing a Fan Tray 2-19

2.8.5 Powering On a Fan Tray or a Group of Fan Trays Using SSP Version

3.0 2-20

2.8.6 Powering On the Fan Trays Using SSP Version 3.1 or Subsequent Compatible Version 2-20

2.8.7 Verifying a Fan Tray 2-20

2.9 Replacing an Air Filter 2-21

3. Control and System Board Replacement Procedures 3-1

3.1 Control Board Replacement 3-1

3.1.1 Isolating a Failed Control Board 3-1

3.1.2 Setting Up the Network for a Replacement Control Board 3-2

3.1.3 Powering Off a Control Board 3-5

3.1.4 Removing a Control Board 3-6

3.1.5 Installing a Control Board 3-7

3.1.6 Powering On a Control Board 3-7

3.1.7 Configuring a Newly Installed Control Board as the Primary Control Board 3-8

3.1.8 Verifying a Control Board 3-8

3.2 System Board Replacement 3-9

3.2.1 Isolating a Failed System Board or Mezzanine Board 3-9

3.2.2 Powering Off a System Board 3-9

3.2.3 Removing a System Board 3-10

3.2.4 Installing a System Board 3-10

3.2.5 Powering On a System Board 3-11

3.2.6 Configuring a System Board 3-12

3.2.7 Verifying a System Board or Mezzanine Board 3-12

3.3 System Board Component Replacement 3-13

Contents v

4. System Board I/O Component Replacement Procedures 4-1

4.1 SBus Component Replacement 4-1

4.1.1 Removing an SBus Card 4-1

4.1.2 Installing an SBus Card 4-2

4.1.3 Removing an SBus I/O Module 4-4

4.1.4 Installing an SBus I/O Module 4-5

4.2 PCI Component Replacement 4-7

4.2.1 Accessing PCI Components 4-8

4.2.2 Removing a PCI Card 4-9

4.2.3 Installing a PCI Card 4-10

4.2.4 Removing a PCI I/O Module 4-12

4.2.5 Installing a PCI I/O Module 4-13

4.2.6 Removing a PCI Riser Card 4-15

4.2.7 Installing a PCI Riser Card 4-16

4.2.8 Completing a PCI Component Replacement Procedure 4-16

4.3 Personality Plate Replacement 4-17

4.3.1 Removing a Personality Plate 4-17

4.3.2 Installing a Personality Plate 4-20

5. System Board Memory and CPU Module Replacement Procedures 5-1

5.1 Memory Component Replacement 5-1

5.1.1 Isolating a Failed DIMM 5-1

5.2 Removing a System Board DIMM 5-3

5.2.1 Configuring Memory on a System Board 5-3

5.3 Installing a System Board DIMM 5-4

5.3.1 Removing a Memory Module 5-4

5.3.2 Installing a Memory Module 5-6

5.4 Processor Component Replacement 5-7

5.4.1 Removing a Processor Module 5-7

5.4.2 Installing a Processor Module 5-8

vi Sun Enterprise 10000 System Service Manual • March 2002

6. Centerplane Support Board and Fan Centerplane Replacement Procedures 6-1

6.1 Centerplane Support Board Replacement 6-1

6.1.1 Isolating a Failed Centerplane Support Board 6-1

6.1.2 Powering Off a Centerplane Support Board 6-2

6.1.3 Removing a Centerplane Support Board 6-2

6.1.4 Installing a Centerplane Support Board 6-2

6.1.5 Powering On a Centerplane Support Board 6-3

6.1.6 Verifying a Centerplane Support Board 6-3

6.2 Fan Centerplane Replacement 6-4

6.2.1 Removing a Fan Centerplane 6-4

6.2.2 Installing a Fan Centerplane 6-4

7. Centerplane Replacement Procedures 7-1

7.1 Centerplane Replacement 7-1

7.1.1 Isolating a Failed Centerplane 7-1

7.1.2 Setting Up the System Prior to Replacing the Centerplane 7-2

7.1.3 Powering Off the System 7-4

7.1.4 Removing the Centerplane Assembly From the Card Cage 7-5

7.1.5 Installing the Centerplane Assembly Into the Card Cage 7-8

7.1.6 Powering on the System 7-10

7.1.7 Verifying a Centerplane 7-10

8. Mechanical Component and Cable Replacement Procedures 8-1

8.1 Mechanical Component Replacement 8-1

8.1.1 Replacing a Styling Panel and End Panel 8-1

8.1.2 Replacing an Access Door 8-1

8.1.2.1 Removing an Access Door 8-1

8.1.2.2 Replacing an Access Door 8-2

8.2 Cable Replacement 8-3

8.2.1 Replacing Remote Power Control Cables 8-6

8.2.2 Replacing an AC Power Cord 8-6

Contents vii

8.2.3 Replacing an Internal Cabinet Cable 8-6

8.2.4 Replacing an Internal Card Cage Cable 8-7

9. Software Procedures 9-1

9.1 Restoring the Thermal Calibration Information Using SSP Version 3.0 9-1

9.2 Configuring a Control Board Using SSP Version 3.0 9-3

9.3 Configuring a Control Board Using SSP Version 3.1 and Subsequent Compatible Versions 9-6

9.4 Recovering From a Hung Domain 9-8

9.4.1 Determining If a Domain Is Hung 9-8

9.4.1.1 Restoring a Hung Domain 9-8

9.5 Upgrading the CBE Flash PROM on the Control Board Using SSP Version

3.1 and Subsequent Compatible Versions 9-10

9.6 Changing the Clock Multiplier 9-13

Glossary Glossary-1

Index Index-1

viii Sun Enterprise 10000 System Service Manual • March 2002

Figures

FIGURE 1-1 Caution Graphic on Critical System Components 1-2

FIGURE 1-2 Compression Connector 1-11

FIGURE 1-3 Component Numbering—Front 1-20

FIGURE 1-4 Component Numbering—Back 1-21

FIGURE 1-5 System Board Component Numbering 1-22

FIGURE 1-6 Memory Bank Locations 1-23

FIGURE 1-7 Memory DIMM Locations 1-23

FIGURE 1-8 SBus Slot and Remote Power Control Numbering 1-24

FIGURE 1-9 Fan, Power, and Control Block Diagram I 1-25

FIGURE 1-10 Fan, Power, and Control Block Diagram II 1-26

FIGURE 1-11 System Board Block Diagram 1-27

FIGURE 1-12 Sun Enterprise 10000 System Interconnect Diagram 1-28

FIGURE 2-1 Circuit Breaker Labels 2-9

FIGURE 2-2 Remote Power Control 2-14

FIGURE 2-3 Remote Power Control Addressing 2-15

FIGURE 2-4 Basic Remote Power Connection 2-17

FIGURE 2-5 Air Filter Replacement 2-22

FIGURE 4-1 Replacing System Board SBus Card 4-2

FIGURE 4-2 Replacing the SBus I/O Module 4-5

FIGURE 4-3 Tightening Pattern for the SBus I/O Module 4-6

FIGURE 4-4 Cone Washer and Standoff 4-6

FIGURE 4-5 PCI Components 4-8

FIGURE 4-6 PCI Front Cover Removal 4-9

FIGURE 4-7 PCI Card Removal 4-9

FIGURE 4-8 Installing a PCI Filler Panel 4-10

FIGURE 4-9 PCI Slot Numbering 4-11

FIGURE 4-10 Inserting a PCI Card 4-12

FIGURE 4-11 Replacing the PCI I/O Module 4-13

FIGURE 4-12 Tightening Pattern for the PCI I/O Module 4-14

FIGURE 4-13 Cone Washer and Standoff 4-14

FIGURE 4-14 Removing a PCI Riser Card 4-15

FIGURE 4-15 PCI Front Cover Removal 4-17

FIGURE 4-16 PCI Front Bracket Removal 4-18

FIGURE 4-17 Installing a Personality Plate 4-19

FIGURE 4-18 Installing a Personality Plate—Top View 4-19

FIGURE 4-19 Personality Plate Identification 4-20

FIGURE 4-20 Installing a Personality Plate—Top View 4-21

FIGURE 4-21 Installing a Personality Plate 4-22

FIGURE 5-1 Memory Bank Locations 5-3

FIGURE 5-2 Memory DIMM Locations 5-4

FIGURE 5-3 Replacing the System Board Memory Module 5-5

FIGURE 5-4 Tightening Pattern for the Memory Module 5-6

FIGURE 5-5 Cone Washer and Standoff 5-7

FIGURE 5-6 Replacing System Board Processor Module 5-8

FIGURE 5-7 Tightening Pattern for the Processor Module 5-10

FIGURE 7-1 Cable Labeling 7-2

FIGURE 7-2 Centerplane Test Points 7-4

x Sun Enterprise 10000 System Service Manual • March 2002

FIGURE 7-3 Carrier Plate Alignment Pin and Centerplane Connectors 7-6

FIGURE 8-1 Internal Cabinet Cable Connections 8-3

FIGURE 8-2 Power Shelf Cable Connections 8-4

Figures xi

xii Sun Enterprise 10000 System Service Manual • March 2002

Tables

TABLE 1-1 Temperature Levels 1-5

TABLE 1-2 LED Categories 1-5

TABLE 1-3 Fan Components 1-6

TABLE 1-4 Fan Tray LEDs 1-6

TABLE 1-5 Centerplane Support Board 1-7

TABLE 1-6 Centerplane Support Board LEDs 1-7

TABLE 1-7 Control Board 1-8

TABLE 1-8 Control Board LEDs 1-8

TABLE 1-9 System Boards 1-9

TABLE 1-10 System Board LEDs 1-9

TABLE 1-11 Torque Specifications 1-12

TABLE 1-12 Customer Availability and MTTR Objectives 1-13

TABLE 1-13 Processor Numbering 1-15

TABLE 1-14 I/O Numbering 1-17

TABLE 2-1 Power Redundancy 2-3

TABLE 2-2 AC Input Module Control of Power Supplies 2-3

TABLE 2-3 Circuit Breaker Wiring 2-10

TABLE 3-1 Power Redundancy 3-11

TABLE 3-2 When to Run autoconfig(1M) 3-13

xiii

TABLE 5-1 DIMM and MM Conversion 5-2

TABLE 5-2 Bank Conversion 5-2

TABLE 7-1 Component Serial Numbers 7-3

TABLE 8-1 System Interconnect Cable Chart 8-5

TABLE 8-2 Component Serial Numbers 8-8

xiv Sun Enterprise 10000 System Service Manual • March 2002

Preface

The Sun Enterprise 10000 System Service Manual provides detailed instructions for replacing field replaceable components on the Sun Enterprise™ 10000 system.

Using UNIX Commands

This document may not contain information on basic UNIX®commands and procedures such as shutting down the system, booting the system, and configuring devices.

See one or more of the following for this information:

■ Solaris Handbook for Sun Peripherals

■ AnswerBook™ online documentation for the Solaris™ software environment

■ Other software documentation that you received with your system

Typographic Conventions

Typeface Meaning Examples

AaBbCc123 The names of commands, files,

and directories; on-screen computer output

AaBbCc123

AaBbCc123 Book titles, new words or

What you type, when contrasted with on-screen computer output

terms, words to be emphasized

Command-line variable; replace with a real name or value

Edit your .login file. Use ls -a to list all files.

% You have mail.

% su Password:

Read Chapter 6 in the User’s Guide. These are called class options. Yo u must be superuser to do this.

To delete a file, type rm filename.

Shell Prompts

Shell Prompt

C shell machine-name%

C shell superuser machine-name#

Bourne shell and Korn shell $

Bourne shell and Korn shell superuser #

xvi Sun Enterprise 10000 System Service Manual • March 2002

Component Replacement Guidelines, Indicators, and Nomenclatures

In the Sun Enterprise 10000 system, hot-swapping a component refers to physically removing a component while the remaining system components are operational. However, prior to hot-swapping, the component must be removed as a resource for the operating system.

The basic procedures for hot-swapping a component include:

1. Using dr(1M) or hostview(1M) on components that can be hot-swapped to

remove the component as a resource for the system.

Caution – Do not turn off power to a system board with the system board circuit

breaker. It is possible to arbstop the entire platform when the board is powered on again.

2. Removing power from the component using either the power(1M) or fan(1M)

command or hostview(1M).

Caution – If the possibility exists for tools or people to come in contact with power

connectors, remove power from the component through the AC input module breakers.

3. Removing and replacing the component.

1-1

Caution – Do not remove any component that has a yellow LED lit. These critical

components also contain the “hand” graphic shown in

FIGURE 1-1. Prior to removal,

extinguish the yellow LEDs by using either hostview(1M) or the power(1M) command.

IF THE YELLOW LEDS ARE LIT —

DO NOT REMOVE THE COMPONENT!

FIGURE 1-1 Caution Graphic on Critical System Components

4. Applying power to the component or to the cabinet in cases where power does

not automatically resume.

5. Using dr(1M) or hostview(1M) to re-introduce the hot-swapped component as a

resource for the system.

Allocating components as resources is covered in the following documents:

■ Sun Enterprise 10000 Dynamic Reconfiguration User Guide

■ Sun Enterprise 10000 Dynamic Reconfiguration Reference Manual

■ Sun Enterprise 10000 DR Configuration Guide

■ Sun Enterprise Server Alternate Pathing 2.3.1 User Guide

■ Sun Enterprise Server Alternate Pathing 2.3.1 Reference Manual

■ Sun Enterprise Server Alternate Pathing 2.3.1 Installation Guide and Release Notes

1-2 Sun Enterprise 10000 System Service Manual • March 2002

1.1 Configuration Rules

The following rules apply when configuring components on the Sun Enterprise 10000 system:

■ When installing peripherals into the Sun Enterprise 10000 cabinet:

■ RSM trays are the only peripherals used in the Sun Enterprise 10000 cabinet.

■ Only three RSM trays can be used in the Sun Enterprise 10000 cabinet.

■ All supported peripherals are listed in the Computer Systems price list and

International Configuration Guide.

■ A second control board is optional.

■ Two centerplane support boards are required to utilize a 144-bit data bus and four

address buses.

■ The system is shipped with two centerplane support boards. Should one fail, the

system will function with only a 72-bit data bus and two address buses.

■ Systems ordered with eight or less system boards are configured with fans, power

supplies, AC input modules, and with all boards on the same side (back), plus a centerplane support board, AC input module, power supply, and two fans on the front.

The following rules apply when configuring components on the system board:

■ All processor modules in the system must be the same speed.

■ All processor modules on a system board must have the same cache size.

■ For increased processor performance, avoid populating processors 0 and 1

together and processors 2 and 3 together.

■ For increased I/O performance, avoid populating SBus 00 and 01 together and

SBus 10 and 11 together.

■ When configuring memory on a system board:

■ All sockets within a bank must be fully populated.

■ All DIMM sizes must be equal.

■ For increased performance on partially populated memory boards, do not use

banks 0 and 2 together or banks 1 and 3 together.

■ It is necessary to run autoconfig(1M) on the SSP when any system board or

system board module (processor, memory, I/O) is installed for the first time.

■ It is necessary to run autoconfig(1M) on the SSP when any replacement system

board or system board module (processor, memory, I/O) with a different part number than the original is installed.

Chapter 1 Component Replacement Guidelines, Indicators, and Nomenclatures 1-3

1.2 Testing the System

It might be necessary to run autoconfig(1M) after the Sun Enterprise 10000 system is powered on and before performing diagnostic testing of the system. Information about autoconfig(1M) is located in

/opt/share/man/autoconfig1m.

The Sun Enterprise 10000 uses hpost(1M) to diagnose system problems. To use hpost(1M), you must be logged in the SSP as ssp. Information on hpost(1M) is

located in /opt/share/man/hpost1m.

Sun’s sunvts(1M) diagnostic can be used as a verification of the system. To use

sunvts(1M), you must be logged into the host as superuser. Information on sunvts(1M) is located in /opt/share/man/man1m.

1.3 Reviewing System Temperatures

Use the hostinfo -t command to examine the temperature data being reported. The output should be similar to the following sample:

Starfire MIBs

=============

Ambient temperature readings(C): Sen0 Sen1 Sen2 Average

-----------------------------------------------------------------

19.336 20.654 19.971 19.987

System Brd CIC0 CIC1 MC XDB2 XDB3 PROC0 PROC1 PROC2 PROC3 3p3VDC VDCCore 5VDC

--------------------------------------------------------------------------------------------------------- 0 29.203 29.72 30.306 25.905 27.41 44.747 47.566 45.919 49.049 47.435 43.65 39.134 2 25.672 24.733 25.836 23.407 22.716 39.227 41.796 40.566 44.984 41.087 41.575 31.077 13 29.092 29.461 29.448 24.463 26.644 42.177 44.925 42.051 46.264 42.918 42.918 29.734

Control Brd 5VDC 5VDCPer 5VDCFan Sen0 Sen1 Sen2

---------------------------------------------------------- 0 32.664 27.049 31.443 19.336 20.654 19.971 1 33.274 21.312 27.293 19.141 8.105 18.897

Centerplane TMP0 TMP1 TMP2 TMP3 TMP4 TMP5 TMP6 TMP7 TMP8 TMP9

------------------------------------------------------------------------------------------ 0 25.997 25.886 24.522 22.582 26.258 25.722 23.448 23.098 23.502 23.358 1 25.002 24.261 21.924 21.671 24.724 24.07 21.737 21.322 21.768 21.656

Support Brd 3p3VDC1 3p3VDC2

--------------------------- 0 24.852 27.415 1 26.683 34.251

1-4 Sun Enterprise 10000 System Service Manual • March 2002

The following temperature specifications (TABLE 1-1) must not be exceeded:

TABLE 1-1 Temperature Levels

Warning Level Maximum Level Fatal Level

ASIC

Processors

Power Supply

Ambient Temperature

1. This includes CICs, MC, XDBs, and all centerplane entries.

2. This includes all PROC entries.

3. This includes all VDC entries.

4. This includes all SEN entries.

80˚ C 85˚ C 90˚ C

30˚ C 35˚ C 38˚ C

1.4 Hardware Indicators

The purpose of the LED indicators is to provide a method of isolating errors should the SSP or the SSP’s communication path be faulty. The purpose of the LEDs is limited to four primary categories as listed in

TABLE 1-2.

TABLE 1-2 LED Categories

LED Color Purpose

Yellow Each hot-swappable device has at least two yellow LEDs. If any yellow

LED is on, then it is NOT safe to be removed or serviced. Two LEDs are used for redundancy. On each applicable component, all yellow LEDs will be enclosed in a rectangle on the silkscreen. In addition to the functional identification of each yellow LED, a silkscreen legend will be placed near the LEDs (refer to left). These yellow LEDs are, in many cases, indicators of the state of the software-controlled power supplies.

Green Indicates the status of housekeeping power supplies.

Green Provides status indications valuable to determine the state of the boards or

interfaces prior to having full communication with the SSP.

Green Displays the state of generally programmable registers useful for debug.

Chapter 1 Component Replacement Guidelines, Indicators, and Nomenclatures 1-5

1.4.1 Fans

Fan components and LEDs are listed in TABLE 1-3 and TABLE 1-4.

TABLE 1-3 Fan Components

Total maximum # of fan shelves per system

# of fan trays per fan shelf

# of yellow LEDs per fan tray # of fans per fan tray

4442

TABLE 1-4 Fan Tray LEDs

LED Name Color Purpose

PWR1 Yellow When lit, 24 VDC is present

and this fan tray is NOT safe to service.

1-6 Sun Enterprise 10000 System Service Manual • March 2002

1.4.2 Centerplane Support Boards

Centerplane support board components and LEDs are listed in TABLE 1-5 and

TABLE 1-6.

TABLE 1-5 Centerplane Support Board

Total maximum # per system Total # per side

# of green LEDs per board

# of yellow LEDs per board

2142

TABLE 1-6 Centerplane Support Board LEDs

LED Name Color Purpose

5VDC HK Green 5.0 VDC housekeeping

3.3VDC HK Green 3.3 VDC housekeeping

3.3VDC Yellow VDD signal on the control board

is on indicating 3.3 volts DC is present and the control board is NOT safe to service.

HK S/W Green Displays the state of a designated

bit position on the power control JTAG ring of this board.

Chapter 1 Component Replacement Guidelines, Indicators, and Nomenclatures 1-7

1.4.3 Control Board

Control board components and LEDs are listed in TABLE 1-7 and TABLE 1-8.

TABLE 1-7 Control Board

Total maximum # per system Total # per side

# of green LEDs per board

# of yellow LEDs per board

21172

TABLE 1-8 Control Board LEDs

LED Name Color Purpose

5VDC HK Green 5.0 VDC housekeeping

3.3VDC HK Green 3.3 VDC housekeeping

5VDC Yellow VDC on the control board is present

5VDC Yellow

and the control board is NOT safe to service.

5VDC FAN Green 5.0 VDC fan control power is present

5VDC PER Yellow 5.0 VDC peripheral cabinet power

control voltage is present

HK S/W Green Displays the state of bit 8 on the

power control JTAG ring of this board.

S/W 7- S/W 0 Green Programmable bits that indicate the

state of an 8-bit read/write register located in the SPARClite’s address space. When the Control Board Executive is operating correctly, a marching 1s pattern can be seen on S/W0-S/W6. S/W7 indicates the network is operational.

XMIT Green Ethernet interface transmit status

REC Green Ethernet interface receive status

LINK Green Ethernet interface link status

COLL Green Ethernet interface collision status

JTAG MASTER Green Indicates that this control board is the

system JTAG Master

1-8 Sun Enterprise 10000 System Service Manual • March 2002

1.4.4 System Board

System board components and LEDs are listed in TABLE 1-9 and TABLE 1-10.

TABLE 1-9 System Boards

Total maximum # per system Total # per side

# of green LEDs per board

# of yellow LEDs per board

16 8 11 3

HK S/W was used for hardware debug and was not programmed for use by the software. S/W 7- S/W 0 indicate the state of an 8-bit read/write register located in the SPARClite’s address space. When the Control Board Executive is operating correctly, a marching 1s pattern can be seen on S/W0-S/W6. S/W7 indicates the network is operational.

TABLE 1-10 System Board LEDs

LED Name Color Purpose

5VDC HK Green Indicates that 5.0 VDC

housekeeping power is present.

3.3VDC HK Green Indicates that 3.3 VDC

housekeeping power is present.

3.3VDC Yellow VCC on the system board is present

and the system board is NOT safe to service.

5VDC Yellow VDD signal on the system board is

on, indicating 5 volts DC is present, and the system board is NOT safe to service.

VDD_Core Yellow VDD_Core on the system board is

present and that the system board is NOT safe to service.

HKS/W Green Displays the state of a designated

bit position on the power control JTAG ring of this board.

S/W 7- S/W 0 Green Eight LEDs that are programmable

through a register in the bootbus space of the PC ASIC connected to the I?O module, which can be read and written either by JTAG or by resident software.

Chapter 1 Component Replacement Guidelines, Indicators, and Nomenclatures 1-9

1.5 Inserting a Board

These are general guidelines for inserting boards into the Sun Enterprise 10000 system. To reduce the risk of damage to the centerplane connector, take the following precautions:

■ Thoroughly inspect (visually) both the centerplane connector and the daughter

board connector before insertion.

■ Look for damage to either the male or female connector plastic housing.

■ Look for foreign material in both the male and female connector plastic

housing.

■ Look for bent or damaged pins on all mating connectors.

Note – If any of these conditions exist, do not try to repair or replace parts unless

you have been trained to do so.

■ Never set or bump a connector against another surface.

■ Never touch or probe the centerplane connector pins.

■ When inserting a board into a centerplane slot:

■ Firmly press the board in by hand with evenly distributed pressure across the

front panel until the resistance is too high for manual insertion.

■ Use the insertion/ejection handles to evenly apply pressure until the connector

is fully seated.

■ Always use the ejection handles when removing boards from the centerplane.

■ Never try to force the connector using the insertion/ejection handles if the board

becomes cocked or jammed.

■ Never use damaged components.

1-10 Sun Enterprise 10000 System Service Manual • March 2002

1.6 Standard Torque Settings

Components requiring specific torque settings when being secured, such as the processor module in

FIGURE 1-2 Compression Connector

Always follow the standard torquing procedures listed in the processor, I/O, and memory mezzanine replacement procedures. When retorquing a part, remember to loosen or back out the screw before retightening it. This will assure the proper torque is applied and will also reduce the chances of breaking a screw.

FIGURE 1-2, are listed in TABLE 1-11.

Compression connector

Note – A torque wrench has been included with the system in the document pouch.

Chapter 1 Component Replacement Guidelines, Indicators, and Nomenclatures 1-11

TABLE 1-11 Torque Specifications

Torque Specification for Manufacturing Use of 6.0 in/lbs Permitted In the Field

Tolerance range:

Relative to spec +/- 0.06 Nm

N/A

Unless range stated +/- 0.5 in/lbs N/A

Non-specified component screws:

M3 7.0 in/lbs (0.8 Nm) Yes

M5 33.3 in/lbs (3.76 Nm) Yes

Specific Components:

Captive compression connections, #4-40 hex

Low torque (approx.) 3.0 in/lbs (0.34 Nm) No, tighten less than 6.0 in/lbs

Final torque 6.0 in/lbs (0.68 Nm) Yes

I/O, processor, and memory module #4-40 hex

Captive, low torque (approx.) 3.0 in/lbs (0.34 Nm) No, tighten less than 6.0 in/lbs

Captive, final torque 6.0 in/lbs (0.68 Nm) Yes

Circuit breaker

M3 screw 5 in/lbs (0.6 Nm) Yes

System board cover

M3 screw 7.0 - 8.8 in/lbs (0.798 - 0.998 Nm) Yes

I/O memory module

M3 screw 7.0 in/lbs (0.8 Nm) Yes

Fan centerplane

M3 screw 5.3 in/lbs (0.6 Nm) Yes

Centerplane

M5 screw 33.3 in/lbs (3.76 Nm) No, hand tighten

1. Newton meters

1-12 Sun Enterprise 10000 System Service Manual • March 2002

1.7 Field Replaceable Units

TABLE 1-12 lists the estimated time required for replacement of the field-replaceable

units (FRUs) in the Sun Enterprise 10000 system, provided the new component is onsite and properly configured. The estimates do not include any time required by software for system reconfiguration (power cycling, autoconfig) or the shutdown and bring up required for the nonconcurrent service items.

Caution – The control board and centerplane support board are different from other

hot-swappable items in that the others can be dynamically reconfigured out of the system without rebooting. However, if a control board or a centerplane support board is in use by a running domain, you must halt the domain to hot-swap it.

TABLE 1-12 Customer Availability and MTTR Objectives

Field Replaceable Unit Mean time to repair Online Service

Control board 10 min. Yes, if two configured and

Centerplane support board 5 min. Yes, if not in use by system

Centerplane 1 hour No

System board 30 min. Yes

UltraSPARC module 20 min. Yes

Dual in-line memory module (DIMM) 10 min. Yes

Memory module 30 min. Yes

I/O module 20 min. Yes

SBus cards 10 min. Yes

I/O cables 15 min. Yes

Fan tray 5 min. Yes

System Service Processor (SSP) 30 min. Yes

SSP keyboard 5 min. Yes

SSP monitor 10 min. Yes

SSP peripheral 30 min. Yes

SSP modem 10 min. Yes

48-volt power supply 5 min. Yes, if not in use by system

not in use by system

Chapter 1 Component Replacement Guidelines, Indicators, and Nomenclatures 1-13

TABLE 1-12 Customer Availability and MTTR Objectives (Continued)

Field Replaceable Unit Mean time to repair Online Service

AC input unit 5 min. Yes, if not in use by system

Exterior cosmetic panel 5 min. Yes

Power control module 5 min. Yes

DC breaker 15 min. Yes, if not in use by system

AC sequencer 15 min. Yes, if not in use by system

Power shelf 60 min. No

Fan centerplane 20 min. No

Air filter 5 min. Yes

I/O power cord 5 min. Yes

RSM tray 30 min. Yes

1.8 Component Numbering

All addressable components are identified by a standard set of numbering as listed in

TABLE 1-13 and TABLE 1-14. Locations of all the components are shown in FIGURE 1-3

and FIGURE 1-4 .

1-14 Sun Enterprise 10000 System Service Manual • March 2002

TABLE 1-13 Processor Numbering

Component Solaris ID Hostview ID POST ID

System Board 0

Proc. Mod. 0 Proc. Mod. 1 Proc. Mod. 2 Proc. Mod. 3

System Board 1

Proc. Mod. 0 Proc. Mod. 1 Proc. Mod. 2 Proc. Mod. 3

System Board 2

Proc. Mod. 0 Proc. Mod. 1 Proc. Mod. 2 Proc. Mod. 3

System Board 3

Proc. Mod. 0 Proc. Mod. 1 Proc. Mod. 2 Proc. Mod. 3

System Board 4

Proc. Mod. 0 Proc. Mod. 1 Proc. Mod. 2 Proc. Mod. 3

System Board 5

Proc. Mod. 0 Proc. Mod. 1 Proc. Mod. 2 Proc. Mod. 3

System Board 6

Proc. Mod. 0 Proc. Mod. 1 Proc. Mod. 2 Proc. Mod. 3

System Board 7

Proc. Mod. 0 Proc. Mod. 1 Proc. Mod. 2 Proc. Mod. 3

/SUNW,UltraSPARC@0,0 /SUNW,UltraSPARC@1,0 /SUNW,UltraSPARC@2,0 /SUNW,UltraSPARC@3,0

/SUNW,UltraSPARC@4,0 /SUNW,UltraSPARC@5,0 /SUNW,UltraSPARC@6,0 /SUNW,UltraSPARC@7,0

/SUNW,UltraSPARC@8,0 /SUNW,UltraSPARC@9,0 /SUNW,UltraSPARC@a,0 /SUNW,UltraSPARC@b,0

/SUNW,UltraSPARC@c,0 /SUNW,UltraSPARC@d,0 /SUNW,UltraSPARC@e,0 /SUNW,UltraSPARC@f,0

/SUNW,UltraSPARC@10,0 /SUNW,UltraSPARC@11,0 /SUNW,UltraSPARC@12,0 /SUNW,UltraSPARC@13,0

/SUNW,UltraSPARC@14,0 /SUNW,UltraSPARC@15,0 /SUNW,UltraSPARC@16,0 /SUNW,UltraSPARC@17,0

/SUNW,UltraSPARC@18,0 /SUNW,UltraSPARC@19,0 /SUNW,UltraSPARC@1a,0 /SUNW,UltraSPARC@1b,0

/SUNW,UltraSPARC@1c,0 /SUNW,UltraSPARC@1d,0 /SUNW,UltraSPARC@1e,0 /SUNW,UltraSPARC@1f,0

SB0 00 01 02 03

SB1 04 05 06 07

SB2 08 09 10 11

SB3 12 13 14 15

SB4 16 17 18 19

SB5 20 21 22 23

SB6 24 25 26 27

SB7 28 29 30 31

sysbd 0 proc 0.0 proc 0.1 proc 0.2 proc 0.3

sysbd 1 proc 1.0 proc 1.1 proc 1.2 proc 1.3

sysbd 2 proc 2.0 proc 2.1 proc 2.2 proc 2.3

sysbd 3 proc 3.0 proc 3.1 proc 3.2 proc 3.3

sysbd 4 proc 4.0 proc 4.1 proc 4.2 proc 4.3

sysbd 5 proc 5.0 proc 5.1 proc 5.2 proc 5.3

sysbd 6 proc 6.0 proc 6.1 proc 6.2 proc 6.3

sysbd 7 proc 7.0 proc 7.1 proc 7.2 proc 7.3

Chapter 1 Component Replacement Guidelines, Indicators, and Nomenclatures 1-15

TABLE 1-13 Processor Numbering (Continued)

Component Solaris ID Hostview ID POST ID

System Board 8

Proc. Mod. 0 Proc. Mod. 1 Proc. Mod. 2 Proc. Mod. 3

System Board 9

Proc. Mod. 0 Proc. Mod. 1 Proc. Mod. 2 Proc. Mod. 3

System Board 10

Proc. Mod. 0 Proc. Mod. 1 Proc. Mod. 2 Proc. Mod. 3

System Board 11

Proc. Mod. 0 Proc. Mod. 1 Proc. Mod. 2 Proc. Mod. 3

System Board 12

Proc. Mod. 0 Proc. Mod. 1 Proc. Mod. 2 Proc. Mod. 3

System Board 13

Proc. Mod. 0 Proc. Mod. 1 Proc. Mod. 2 Proc. Mod. 3

System Board 14

Proc. Mod. 0 Proc. Mod. 1 Proc. Mod. 2 Proc. Mod. 3

System Board 15

Proc. Mod. 0 Proc. Mod. 1 Proc. Mod. 2 Proc. Mod. 3

/SUNW,UltraSPARC@20,0 /SUNW,UltraSPARC@21,0 /SUNW,UltraSPARC@22,0 /SUNW,UltraSPARC@23,0

/SUNW,UltraSPARC@24,0 /SUNW,UltraSPARC@25,0 /SUNW,UltraSPARC@26,0 /SUNW,UltraSPARC@27,0

/SUNW,UltraSPARC@28,0 /SUNW,UltraSPARC@29,0 /SUNW,UltraSPARC@2a,0 /SUNW,UltraSPARC@2b,0

/SUNW,UltraSPARC@2c,0 /SUNW,UltraSPARC@2d,0 /SUNW,UltraSPARC@2e,0 /SUNW,UltraSPARC@2f,0

/SUNW,UltraSPARC@30,0 /SUNW,UltraSPARC@31,0 /SUNW,UltraSPARC@32,0 /SUNW,UltraSPARC@33,0

/SUNW,UltraSPARC@34,0 /SUNW,UltraSPARC@35,0 /SUNW,UltraSPARC@36,0 /SUNW,UltraSPARC@37,0

/SUNW,UltraSPARC@38,0 /SUNW,UltraSPARC@39,0 /SUNW,UltraSPARC@3a,0 /SUNW,UltraSPARC@3b,0

/SUNW,UltraSPARC@3c,0 /SUNW,UltraSPARC@3d,0 /SUNW,UltraSPARC@3e,0 /SUNW,UltraSPARC@3f,0

SB8 32 33 34 35

SB9 36 37 38 39

SB10 40 41 42 43

SB11 44 45 46 47

SB12 48 49 50 51

SB13 52 53 54 55

SB14 56 57 58 59

SB15 60 61 62 63

sysbd 8 proc 8.0 proc 8.1 proc 8.2 proc 8.3

sysbd 9 proc 9.0 proc 9.1 proc 9.2 proc 9.3

sysbd 10 proc 10.0 proc 10.1 proc 10.2 proc 10.3

sysbd 11 proc 11.0 proc 11.1 proc 11.2 proc 11.3

sysbd 12 proc 12.0 proc 12.1 proc 12.2 proc 12.3

sysbd 13 proc 13.0 proc 13.1 proc 13.2 proc 13.3

sysbd 14 proc 14.0 proc 14.1 proc 14.2 proc 14.3

sysbd 15 proc 15.0 proc 15.1 proc 15.2 proc 15.3

1-16 Sun Enterprise 10000 System Service Manual • March 2002

TABLE 1-14 I/O Numbering

Component POST Solaris ID

SBus PCI

Front Panel Label

Cable Label Solaris ID

Front Panel Label

Cable Label

System Board 0

I/O Port 0 I/O Port 1 I/O Port 2 I/O Port 3

System Board 1

I/O Port 0 I/O Port 1 I/O Port 2 I/O Port 3

System Board 2

I/O Port 0 I/O Port 1 I/O Port 2 I/O Port 3

System Board 3

I/O Port 0 I/O Port 1 I/O Port 2 I/O Port 3

System Board 4

I/O Port 0 I/O Port 1 I/O Port 2 I/O Port 3

System Board 5

I/O Port 0 I/O Port 1 I/O Port 2 I/O Port 3

System Board 6

I/O Port 0 I/O Port 1 I/O Port 2 I/O Port 3

sysbd 0 scard 0.0.0 scard 0.0.1 scard 0.1.0 scard 0.1.1

sysbd 1 scard 1.0.0 scard 1.0.1 scard 1.1.0 scard 1.1.1

sysbd 2 scard 2.0.0 scard 2.0.1 scard 2.1.0 scard 2.1.1

sysbd 3 scard 3.0.0 scard 3.0.1 scard 3.1.0 scard 3.1.1

sysbd 4 scard 4.0.0 scard 4.0.1 scard 4.1.0 scard 4.1.1

sysbd 5 scard 5.0.0 scard 5.0.1 scard 5.1.0 scard 5.1.1

sysbd 6 scard 6.0.0 scard 6.0.1 scard 6.1.0 scard 6.1.1

/sbus@40 /sbus@40 /sbus@41 /sbus@41

/sbus@44 /sbus@44 /sbus@45 /sbus@45

/sbus@48 /sbus@48 /sbus@49 /sbus@49

/sbus@4c /sbus@4c /sbus@4d /sbus@4d

/sbus@50 /sbus@50 /sbus@51 /sbus@51

/sbus@54 /sbus@54 /sbus@55 /sbus@55

/sbus@58 /sbus@58 /sbus@59 /sbus@59

SB0 SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1

SB1 SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1

SB2 SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1

SB3 SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1

SB4 SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1

SB5 SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1

SB6 SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1

SB0 SB0.0.0 SB0.0.1 SB0.1.0 SB0.1.1

SB1 SB1.0.0 SB1.0.1 SB1.1.0 SB1.1.1

SB2 SB2.0.0 SB2.0.1 SB2.1.0 SB2.1.1

SB3 SB3.0.0 SB3.0.1 SB3.1.0 SB3.1.1

SB4 SB4.0.0 SB4.0.1 SB4.1.0 SB4.1.1

SB5 SB5.0.0 SB5.0.1 SB5.1.0 SB5.1.1

SB6 SB6.0.0 SB6.0.1 SB6.1.0 SB6.1.1

/pci@40

/pci@41

/pci@44

/pci@45

/pci@48

/pci@49

/pci@4c

/pci@4d

/pci@50

/pci@51

/pci@54

/pci@55

/pci@58

/pci@59

SB0 PCI 0.0

PCI 1.0

SB1 PCI 0.0

PCI 1.0

SB2 PCI 0.0

PCI 1.0

SB3 PCI 0.0

PCI 1.0

SB4 PCI 0.0

PCI 1.0

SB5 PCI 0.0

PCI 1.0

SB6 PCI 0.0

PCI 1.0

SB0 PCI0.0.0

PCI0.1.0

SB1 PCI1.0.0

PCI1.1.0

SB2 PCI2.0.0

PCI2.1.0

SB3 PCI3.0.0

PCI3.1.0

SB4 PCI4.0.0

PCI4.1.0

SB5 PCI5.0.0

PCI5.1.0

SB6 PCI6.0.0

PCI6.1.0

Chapter 1 Component Replacement Guidelines, Indicators, and Nomenclatures 1-17

TABLE 1-14 I/O Numbering (Continued)

Component POST Solaris ID

SBus PCI

Front Panel Label

Cable Label Solaris ID

Front Panel Label

Cable Label

System Board 7

I/O Port 0 I/O Port 1 I/O Port 2 I/O Port 3

System Board 8

I/O Port 0 I/O Port 1 I/O Port 2 I/O Port 3

System Board 9

I/O Port 0 I/O Port 1 I/O Port 2 I/O Port 3

System Board 10

I/O Port 0 I/O Port 1 I/O Port 2 I/O Port 3

System Board 11

I/O Port 0 I/O Port 1 I/O Port 2 I/O Port 3

System Board 12

I/O Port 0 I/O Port 1 I/O Port 2 I/O Port 3

sysbd 7 scard 7.0.0 scard 7.0.1 scard 7.1.0 scard 7.1.1

sysbd 8 scard 8.0.0 scard 8.0.1 scard 8.1.0 scard 8.1.1

sysbd 9 scard 9.0.0 scard 9.0.1 scard 9.1.0 scard 9.1.1

sysbd 10 scard 10.0.0 scard 10.0.1 scard 10.1.0 scard 10.1.1

sysbd 11 scard 11.0.0 scard 11.0.1 scard 11.1.0 scard 11.1.1

sysbd 12 scard 12.0.0 scard 12.0.1 scard 12.1.0 scard 12.1.1

/sbus@5c /sbus@5c /sbus@5d /sbus@5d

/sbus@60 /sbus@60 /sbus@61 /sbus@61

/sbus@64 /sbus@64 /sbus@65 /sbus@65

/sbus@68 /sbus@68 /sbus@69 /sbus@69

/sbus@6c /sbus@6c /sbus@6d /sbus@6d

/sbus@70 /sbus@70 /sbus@71 /sbus@71

SB7 SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1

SB8 SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1

SB9 SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1

SB10 SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1

SB11 SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1

SB12 SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1

SB7 SB7.0.0 SB7.0.1 SB7.1.0 SB7.1.1

SB8 SB8.0.0 SB8.0.1 SB8.1.0 SB8.1.1

SB9 SB9.0.0 SB9.0.1 SB9.1.0 SB9.1.1

SB10 SB10.0.0 SB10.0.1 SB10.1.0 SB10.1.1

SB11 SB11.0.0 SB11.0.1 SB11.1.0 SB11.1.1

SB12 SB12.0.0 SB12.0.1 SB12.1.0 SB12.1.1

/pci@5c

/pci@5d

/pci@60

/pci@61

/pci@64

/pci@65

/pci@68

/pci@69

/pci@6c

/pci@6d

/pci@70

/pci@71

SB7 PCI 0.0

PCI 1.0

SB8 PCI 0.0

PCI 1.0

SB9 PCI 0.0

PCI 1.0

SB10 PCI 0.0

PCI 1.0

SB11 PCI 0.0

PCI 1.0

SB12 PCI 0.0

PCI 1.0

SB7 PCI7.0.0

PCI7.1.0

SB8 PCI8.0.0

PCI8.1.0

SB9 PCI9.0.0

PCI9.1.0

SB10 PCI10.0.0

PCI10.1.0

SB11 PCI11.0.0

PCI11.1.0

SB12 PCI12.0.0

PCI12.1.0

1-18 Sun Enterprise 10000 System Service Manual • March 2002

TABLE 1-14 I/O Numbering (Continued)

Component POST Solaris ID

SBus PCI

Front Panel Label

Cable Label Solaris ID

Front Panel Label

Cable Label

System Board 13

I/O Port 0 I/O Port 1 I/O Port 2 I/O Port 3

System Board 14

I/O Port 0 I/O Port 1 I/O Port 2 I/O Port 3

System Board 15

I/O Port 0 I/O Port 1 I/O Port 2 I/O Port 3

sysbd 13 scard 13.0.0 scard 13.0.1 scard 13.1.0 scard 13.1.1

sysbd 14 scard 14.0.0 scard 14.0.1 scard 14.1.0 scard 14.1.1

sysbd 15 scard 15.0.0 scard 15.0.1 scard 15.1.0 scard 15.1.1

/sbus@74 /sbus@74 /sbus@75 /sbus@75

/sbus@78 /sbus@78 /sbus@79 /sbus@79

/sbus@7c /sbus@7c /sbus@7d /sbus@7d

SB13 SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1

SB14 SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1

SB15 SBUS 0 SLOT 0 SBUS 0 SLOT 1 SBUS 1 SLOT 0 SBUS 1 SLOT 1

SB13 SB13.0.0 SB13.0.1 SB13.1.0 SB13.1.1

SB14 SB14.0.0 SB14.0.1 SB14.1.0 SB14.1.1

SB15 SB15.0.0 SB15.0.1 SB15.1.0 SB15.1.1

/pci@74

/pci@75

/pci@78

/pci@79

/pci@7c

/pci@7d

SB13 PCI 0.0

PCI 1.0

SB14 PCI 0.0

PCI 1.0

SB15 PCI 0.0

PCI 1.0

SB13 PCI13.0.0

PCI13.1.0

SB14 PCI14.0.0

PCI14.1.0

SB15 PCI15.0.0

PCI15.1.0

Chapter 1 Component Replacement Guidelines, Indicators, and Nomenclatures 1-19

PS4

PS5

AC2

PS6

PS7

AC3

FT8

FT9

FT10

FT11

CSB1

SB8

SB9

SB10

SB11

SB12

SB13

SB14

SB15

CB1

FT12

FT13

FT14

FT15

FIGURE 1-3 Component Numbering—Front

1-20 Sun Enterprise 10000 System Service Manual • March 2002

AC0

PS0

PS1

AC1

PS2

PS3

AC sequencer (no number)

RPC0

RPC1

RPC2

RPC3

RPC4

FT0

FT1

FT2

FT3

CSB0

CB0

SB0

SB1

SB2

SB3

SB4

SB5

SB6

SB7

FT4

FT5

FT6

FT7

FIGURE 1-4 Component Numbering—Back

Chapter 1 Component Replacement Guidelines, Indicators, and Nomenclatures 1-21

MM2.7 MM0.7 MM2.6 MM0.6 MM2.5 MM0.5 MM2.4 MM0.4 MM3.7 MM1.7 MM3.6 MM1.6 MM3.5 MM1.5 MM3.4 MM1.4 MM2.3 MM0.3 MM2.2 MM0.2 MM2.1 MM0.1 MM2.0 MM0.0 MM3.3 MM1.3 MM3.2 MM1.2 MM3.1 MM1.1 MM3.0 MM1.0

Proc 3 Proc 2 Proc 1 Proc 0

SBus 0 Slot 0 SBus 0 Slot 1 SBus 1 Slot 0 SBus 1 Slot 1

FIGURE 1-5 System Board Component Numbering

1-22 Sun Enterprise 10000 System Service Manual • March 2002

Bank 3

Bank 1

Bank 0

FIGURE 1-6 Memory Bank Locations

MM3.7 - P32 MM1.7 - P30 MM3.6 - P28 MM1.6 - P26 MM3.5 - P24 MM1.5 - P22 MM3.4 - P20 MM1.4 - P18

MM2.7 - P16 MM0.7 - P14 MM2.6 - P12 MM0.6 - P10

MM2.5 - P8 MM0.5 - P6 MM2.4 - P4 MM0.4 - P2

Centerplane side

Bank 2

MM3.3 - P31 MM1.3 - P29 MM3.2 - P27 MM1.2 - P25 MM3.1 - P23 MM1.1 - P21 MM3.0 - P19 MM1.0 - P17

MM2.3 - P15 MM0.3 - P13 MM2.2 - P11

MM0.2 - P9 MM2.1 - P7 MM0.1 - P5 MM2.0 - P3 MM0.0 - P1

FIGURE 1-7 Memory DIMM Locations

Chapter 1 Component Replacement Guidelines, Indicators, and Nomenclatures 1-23

SBUS 0 SLOT 0

RPC0

RPC1

RPC2

RPC3

RPC4

SBUS 0 SLOT 1

SBUS 1 SLOT 0

RPC0

SBUS 1 SLOT 1

FIGURE 1-8 SBus Slot and Remote Power Control Numbering

RPC1

RPC2

RPC3

RPC4

CB0 CB1 REMOTE

ON/OFF

PCI 0.0

PCI 1.0

1.9 System Block Diagrams

Use FIGURE 1-9, FIGURE 1-10, FIGURE 1-11, and FIGURE 1-12 when diagnosing failed components.

1-24 Sun Enterprise 10000 System Service Manual • March 2002

Cooling subsystem

Fan tray 8

Fan tray 9

Fan tray 10

Fan tray 11

48 Volt power subsystem

Fan tray 0

Fan tray 1

Fan tray 2

Fan tray 3

Clk/cntl Status (1)

Top fan centerplane

Bottom fan centerplane

Clk/cntl Status (1) Clk/cntl Status (1)

Centerplane

Clk/Cntl

Status (5)

Clk/Cntl Status (5)

JTAG+

TA S TMS TDO TCK

TDI

Control board CB0

Power shelfPower shelf

power

cont.

power

cont.

AC In

AC0

AC1

Power supply PS0 &

PS1

Powe r supply PS2 &

PS3

power

AC In

cont.

AC3

cont.

AC4

Peripheral power subsystem

Peripheral power dist. unit

Peripheral power dist. unit*

*located in peripheral expansion cabinets

FIGURE 1-9 Fan, Power, and Control Block Diagram I

Powe r supply PS4 &

PS5

Power supply PS6 &

PS7

Powe r centerplane

AC In

Clk/cntl Status (5) Clk/cntl Status (5) Clk/cntl Status (5) Clk/cntl Status (5)

Remote power

Clk/cntl

control module

Status (5)

TA S TMS TDO TCK

TDI

Control board CB1

Chapter 1 Component Replacement Guidelines, Indicators, and Nomenclatures 1-25

Control board CB0

JTAG+

TAS TMS TDO TCK

TDI

Interconnect Phase Processor

JTAG board

controller

Clocks

System boards 1-16

Serial

interface

System

clocks &

resets

JTAG board

controller

Sys_Reset

DC pwr src

JTAG+

TAS TMS TDO TCK

TDI

Interconnect Phase

Sys_Reset

DC pwr Src

JTAG+

TAS TMS TDO TCK

TDI

Reset

JTAG

board

controller

Clocks

Centerplane

Reset

support bd CP0

Housekeeping power

JTAG

board

controller

Centerplane ASIC

Power

scan ring

A to D A to D

CB_Clk_Inter_Out (17)

Centerplane ASIC

Power

scan ring

A to D A to D

3.3 V pwr

+3.3

CB_Phase (2)

Resets

+3.3

3.3 V pwr

+3.3

Interconnect Phase

Clocks

Sys_Reset

DC pwr src

Reset

Housekeeping power

Control board CB1

FIGURE 1-10 Fan, Power, and Control Block Diagram II

1-26 Sun Enterprise 10000 System Service Manual • March 2002

Centerplane support bd CP1

Centerplane

CB_Clk_Inter_Out (17)

CB_Phase (2)

Resets

+3.3

Global address arbiter (GAARB) Global address router (GAMUX)

Global address arbiter

Global address router

Global address arbiter

Global address router

Global address arbiter

Global address router

Coherency

interface

cntrl (CIC)

Local address

arbiter (LAARB)

Memory

controller

Memory

Local data

arbiter (LDARB)

(MC)

Pack/

unpack

Data

buffer

(XDB)

Coherency

interface

cntrl (CIC)

Por t

controller

Coherency

interface

cntrl (CIC)

Por t

controller

Coherency

interface

cntrl (CIC)

Por t

controller

(PC)(PC)(PC)

UPA address buses

I/O bridge

UltraSPARC

UPA data buses

Data

buffer

(XDB)

Data

buffer

(XDB)

Data

buffer

(XDB)

Local data router (LDMUX)

UltraSPARC

Global data

arbiter (GDARB)

FIGURE 1-11 System Board Block Diagram

Global data

router (GDMUX)

Chapter 1 Component Replacement Guidelines, Indicators, and Nomenclatures 1-27

Global address arbiter (4)

Global address router (4)

System boards (up to 16)

Global data interconnect (16 x 16)

FIGURE 1-12 Sun Enterprise 10000 System Interconnect Diagram

1-28 Sun Enterprise 10000 System Service Manual • March 2002

Global data arbiter (1/2)

All global devices are

located on the centerplane

CHAPTER

Power and Cooling Component Replacement Procedures

Note – All commands performed through the Hostview GUI (hostview(1M)) can

also be performed by other SSP user commands such as the power(1M) command or the fan(1M) command.

2.1 SSP Replacement

Procedures for replacing the SSP are covered in the Sun Enterprise 10000 Hardware Installation and De-Installation Guide, part number 805-4651.

2.2 Disk Replacement

Refer to the most recent version of the Hardware Configuration Guide for a listing of supported devices. Procedures for replacing supported devices are listed in the service manuals that accompany those devices.

2-1

2.3 AC Input Module Replacement

2.3.1 Isolating a Failed AC Input Module

Use the following checklist to assist with fault isolation.

■ Verify that the system has sufficient power by typing:

ssp# power

Number of Good 48V Power Supplies : 8 Required Number of 48V Power Supplies : 8 . . .

■ Check that the breakers are on.

■ Check that the LEDs on the AC input module are on.

■ Verify that the cables in the back and front of the AC input module are inserted

properly.

■ Verify that the AC input module is firmly seated.

■ Check for error messages in /var/opt/SUNWssp/adm/domainname/messages.

If all else is all right, but the LEDs are not on, this is a failed item.

2.3.2 Powering Off an AC Input Module

1. Verify that the system has sufficient power, even with two power supplies powered off, by using hostview(1M) or by typing:

ssp# power

2-2 Sun Enterprise 10000 System Service Manual • March 2002

2. Using TABLE 2-1, determine if additional system boards must be powered off prior to powering off two 48-volt power supplies.

Use

TABLE 2-1 to confirm that the amount of available power is sufficient for the

number of system boards installed. If additional system boards must be powered off, see Section 3.2.2, “Powering Off a System Board” on page 3-9.

TABLE 2-1 Power Redundancy

Number of System Boards

Required Power Supplies for N+2 Power Supply or N+1 AC Input Unit Redundancy

Required 200V, 30A single-phase circuits

1—2 4 2

3—5 5 3

6—8 6 3

9—12 7 4

13—16 8

1. If two supplies are failing, no AC module may be removed unless the two failed supplies are under the same

AC module control.

3. Power off both power supplies controlled by the AC input module to be changed by using hostview(1M) or by typing:

ssp# power -off -ps x ssp# power -off -ps y

Where x and y are the pairs of power supplies 0/1, 2/3, 4/5, and 6/7 that are controlled by an AC input module (

TABLE 2-2 AC Input Module Control of Power Supplies

AC Input Module Top 48-Volt Power Supply Bottom 48-Volt Power Supply

AC0 controls: PS0 PS1

AC1 controls: PS2 PS3

AC2 controls: PS4 PS5

AC3 controls: PS6 PS7

TABLE 2-2).

Refer to power(1M) for additional information.

Chapter 2 Power and Cooling Component Replacement Procedures 2-3

2.3.3 Removing an AC Input Module

Caution – If the yellow LEDs are lit, do not remove the component. See

Section 2.3.2, “Powering Off an AC Input Module” on page 2-2.

1. Open the access door.

2. Open the door to the power shelf.

3. Disconnect the power cord from the AC input module and the wall receptacle.

4. Loosen the captive one-half-turn screw latch until it releases.

5. Pull out the AC input module and place on a flat, sturdy, ESD-protected surface.

2.3.4 Installing an AC Input Module

1. Insert the AC input module into the power shelf.

2. Tighten the captive one-half-turn screw latch.

3. Connect the power cord to the AC input module and the AC wall receptacle.

2.3.5 Powering On an AC Input Module

1. Power on the two breakers located on the AC input module.

2. Close the door to the power shelf.

3. Close the access door.

2.3.6 Verifying an AC Input Module

Use the following checklist to confirm that a component is operational.

■ Confirm that the fans on the adjacent power supplies are on.

■ Use hostview or the power command to check the power status.

■ Verify that the power supply on status was detected by

/var/opt/SUNWssp/adm/domain-name/messages.

2-4 Sun Enterprise 10000 System Service Manual • March 2002

2.4 48-Volt Power Supply Replacement

2.4.1 Isolating a Failed Power Supply

Use the following checklist to assist with fault isolation.

■ Check that the power supply fans are on.

■ Confirm that the power supply is properly seated.

■ Check the power status on hostview.

■ Check for error messages in /var/opt/SUNWssp/adm/domain-name/messages.

2.4.2 Powering Off a 48-Volt Power Supply

● Power off the 48-volt power supply by using hostview(1M) or by typing:

ssp# power -off -ps x

Where x = 0–7. Refer to power(1M) for additional information.

2.4.3 Removing a 48-Volt Power Supply

Caution – If the yellow LEDs are lit on the power supply, do not remove the

component. See Section 2.4.2, “Powering Off a 48-Volt Power Supply” on page 2-5.

1. Open the access door.

2. Open the door to the power shelf.

3. Pull out the 48-volt power supply and place on a flat, sturdy, ESD-protected surface.

2.4.4 Installing a 48-Volt Power Supply

1. Insert the 48-volt power supply into the power shelf.

Chapter 2 Power and Cooling Component Replacement Procedures 2-5

2. Push firmly to engage the rear connectors.

2.4.5 Powering On a 48-Volt Power Supply

1. Locate the AC input module for the power supply that is off (see TABLE 2-2).

2. On the AC input module, power both breakers on.

3. Close the door to the power shelf.

4. Close the access door.

2.4.6 Verifying a Power Supply

Use the following checklist to confirm that a component is operational.

■ Check that the power supply fans are on.

■ Check the power status using hostview or the power command.

■ Check for error messages in /var/opt/SUNWssp/adm/domain-name/messages.

2.5 Power Shelf Replacement

2.5.1 Removing a Power Shelf

Caution – The power shelves are NOT considered hot-swappable. This procedure

requires powering off the AC power to the system and disconnecting the AC power cords. Also, the side panel nearest the power shelves must be removed. Therefore, it might be necessary to move the cabinet to provide work space in this area.

Since the system must be powered off, the operating system and all of the domains must be systematically brought down and then halted.

1. Power off the system by typing:

ssp# power -off -all

2-6 Sun Enterprise 10000 System Service Manual • March 2002

2. Power off the AC circuit breakers at the AC input modules in the power shelf to be removed.

3. Disconnect the AC power cords from the AC input modules and allow them to hang loose.

4. Remove the AC input modules and DC power supplies from the power shelf.

5. Remove the access door by retracting the hinge pins located at the top and bottom of the front (or rear) access door, enabling it to be removed from the cabinet.

Remove the door and set aside.

6. Remove the three M4 flat-head Phillips screws securing the vertical trim strip to the frame.

Pull the trim strip off its brackets and set it aside.

7. Remove the AC power cords from in front of the side mounting flange for the power shelf.

8. Remove the two M4 panhead Phillips screws securing the door catch bracket to the frame.

Remove the door catch and set aside.

9. Remove the two screws attaching the power shelf to the frame.

10. Remove the door assembly from the power shelf by opening the door for the power shelf and removing the four M4 panhead Phillips screws securing the door to the frame.

Set the door assembly aside and retain the screws and washers.

11. Remove the side panel on the cabinet.

a. Disengag the magnets securing the side panel to the cabinet.

b. Pull the panel out from the cabinet at the bottom.

c. Lift the side panel up and off its support brackets.

Set the side panel aside.

12. Verify that the cables at the rear of the power shelf are properly identified.

See Section 8.2, “Cable Replacement” on page 8-3 for proper connection of cables.

13. Disconnect the power cables from the rear of the power shelf.

The #4-40 panhead Phillips screws and washers securing connectors to the power shelf are not captive to the connectors. Be careful not to lose this hardware.

14. Disconnect the rear support brackets by removing the two M4 panhead Phillips screws securing the two support brackets to the cabinet at the rear of the power shelf.

Chapter 2 Power and Cooling Component Replacement Procedures 2-7

15. Slide the power shelf out of the cabinet.

16. Once free from the cabinet, remove the two rear support brackets from the old power shelf and install the two rear support brackets on the new power shelf.

2.5.2 Installing a Power Shelf

1. Slide the power shelf into the cabinet.

2. Secure the rear support brackets with the two M4 panhead Phillips screws secure to the cabinet at the rear of the power shelf.

3. Connect the power cables to the power shelf. Tighten the thumbscrews or the #4-40 panhead Phillips screws and washers as necessary.

If necessary see Section 8.2, “Cable Replacement” on page 8-3 for proper connection of cables.

4. Secure the power shelf to the cabinet.

5. Connect the door assembly to the power shelf using the four M4 panhead Phillips screws.

6. Install the vertical trim strip.

7. Install the AC input modules and DC power supplies.

8. Connect the AC power cords to the AC input modules.

9. Route the power cords through the vertical trim strip.

10. Using the breakers on the AC input module, power on the AC input modules.

11. Power on the system by typing:

ssp# power -on -all

12. Replace the access and side doors.

13. Move the cabinet to its original position.

14. Run diagnostics to verify the operation of the system.

2-8 Sun Enterprise 10000 System Service Manual • March 2002

2.6 DC Breaker Module Replacement

2.6.1 Isolating a Failed DC Breaker

Use the following checklist to assist with fault isolation.

■ Referring to the circuit breaker labels (FIGURE 2-1) determine which component or

components remained off, following a power-on command.

■ If a group of four fan trays are off, suspect the associated circuit breaker.

■ If a control board and centerplane support board are off, suspect the associated

circuit breaker.

■ If a single system board is off, suspect the associated circuit breaker.

FIGURE 2-1 Circuit Breaker Labels

2.6.2 Removing a Circuit Breaker

1. Open the access door.

2. Remove the two M4 panhead Phillips screws securing the circuit breaker panel to the power shelf.

Retain the screws.

Caution – When the system is powered on, there is 48VDC available at the circuit

breakers. This does not create an electric shock hazard, however, there is considerable energy in these circuits.

Use caution to prevent any bare circuit breaker terminals or exposed wire terminals from coming in contact with the frame.

Chapter 2 Power and Cooling Component Replacement Procedures 2-9

3. Remove the circuit breaker panel by gently working it toward you.

Once loose, pull it out with the cable assemblies attached.

4. Power off the circuit breaker(s) to be removed.

5. Remove the two M3 flat-head Phillips screws that attach the circuit breaker to the panel.

Retain the screws.

6. Loosen and remove the circuit breaker from the panel by gently pushing it back and through the panel.

Cut and remove the tie-wraps as needed.

7. Remove the circuit breaker(s).

The wire attached to the upper terminal of the circuit breakers is connected to the 48 VDC power bus. This wire should be removed first, followed by the remaining wires.

2.6.3 Installing a Circuit Breaker

1. Use TABLE 2-3 to connect the wires to the breaker in their respective positions.

TABLE 2-3 Circuit Breaker Wiring

Primary Power Shelf: Secondary Power Shelf:

Slot# Wire label#

FT4-7

FT0-3

CSB0/CB0

SB0

SB1

SB2

SB3

SB4

SB5

SB6

SB7

1. The source wires are all common, and therefore unlabeled, and can be connected to any circuit breaker.

2-10 Sun Enterprise 10000 System Service Manual • March 2002

W11

W10

Slot# Wire label#

SB8

SB9

SB10

SB11

SB12

SB13

SB14

SB15

CSB1/CB1

FT8-11

FT12-15

W12

W11

Caution – Verify breaker alignment prior to insertion to prevent possible damage of

the breaker mating slot.

2. Insert the circuit breaker into the available circuit breaker slot.

3. Install the two M3 flat-head Phillips screws to attach the breaker to the panel.

4. Torque the M3 flat-head Phillips screws to 0.6 Nm (5 inch pounds).

5. Bundle the wires neatly using tie-wraps as needed.

6. Insert the cable bundle into the power shelf and push the circuit breaker panel back into place on the power shelf.

7. Replace the two M4 panhead Phillips screws to fasten the panel to the power shelf.

8. Torque the M4 panhead Phillips screws to 1.0 Nm (9 inch pounds).

9. Close the access door.

2.6.4 Verifying a DC Breaker

Use the following checklist to verify that a DC breaker(s) are operational.

■ Check that the component or components powered on.

■ Check the power status using hostview or the power command.

■ Check for error messages in /var/opt/SUNWssp/adm/domain-name/messages.

2.7 Universal AC Sequencer Replacement

2.7.1 Isolating a Failed AC Sequencer

Use the following checklist to assist with fault isolation.

■ Verify that the LEDs are on.

■ Confirm that the components powered by the AC sequencer are on.

■ Check cables.

■ Check the REMOTE/LOCAL switch.

■ For remotely controlled AC sequencers, issue a power -P command.

Chapter 2 Power and Cooling Component Replacement Procedures 2-11

■ If the AC sequencer still is not on, switch to LOCAL to determine if it will

power on. If it powers on in LOCAL, suspect the configuration, the control board, the cables, or the remote power control module.

■ On remotely controlled I/O cabinets, check that the keyswitch is in the OFF

position.

2.7.2 Powering Off a Remotely Controlled AC Sequencer

● Type:

ssp# power -off -p x

Where x = 0-4. This command powers off the AC sequencers that are controlled by the remote power control module indicated by x, and all peripherals powered by this AC sequencer will power off. Refer to power(1M) for more information.

2.7.3 Removing an AC Sequencer

Caution – If the switched outlet green lights are lit, do not remove the component.

See Section 2.7.2, “Powering Off a Remotely Controlled AC Sequencer” on page 2-12.

1. Open the access door.

2. Note the origination of all power cords connected to the AC sequencer.

3. Power off the AC circuit breaker on the AC sequencer.

4. Disconnect all cables from the AC sequencer and the remote power control modules.

5. Remove the four Phillips screws that secure the AC sequencer.

6. Remove and place the unit on a flat, sturdy, ESD-protected surface.

2.7.4 Installing an AC Sequencer

1. Place the AC sequencer into the cabinet and align the attachment slots to the holes on the RETMA rails.

2-12 Sun Enterprise 10000 System Service Manual • March 2002

2. Use the four Phillips screws to secure the AC sequencer to the RETMA rails.

3. Connect the power cord to the AC sequencer and to the wall receptacle.

4. Connect the cables from the peripherals to the AC sequencer and the remote power control modules.

5. Power on the AC circuit breaker on the AC sequencer.

6. Close the access door.

2.7.5 Configuring an AC Sequencer

I/O cabinets can be controlled remotely from the control board using the power(1M) command. To do this, the control board must be connected to the AC sequencer. To facilitate multiple control boards, this connection is done with remote power cables and a remote power control module.

The control board has five remote power control connections, RPC0-RPC4. These are connected from both control board 0 (CB0) and control board 1 (CB1) to the remote power control modules located in the processor cabinet I/O space. The output of a remote power control module is then connected to an AC sequencer located either in the processor cabinet I/O space or an I/O expansion cabinet (see

FIGURE 2-2).

Chapter 2 Power and Cooling Component Replacement Procedures 2-13

Control board 0 (CB0)

Control board 1 (CB1)

RPC0 RPC1 RPC2 RPC3 RPC4

Remote power

control modules

CB0 CB1 Remote

AC sequencer

FIGURE 2-2 Remote Power Control

ON/OFF

Remote power control modules can be programmed to addresses 0–5. When the control board issues a command and address, each remote power control module programmed for that address will respond.

You can connect a remote power control module address to a single AC power sequencer or to a string of AC power sequencers. When the command power -p 3 -off is issued, the remote power control module or modules that are programmed for address 3 will power off (see

FIGURE 2-3). Subsequently, all AC

power sequencers attached to those remote power control modules and their associated peripherals will also power off.

2-14 Sun Enterprise 10000 System Service Manual • March 2002

Control board issues a command to RPC 3

All remote power control modules programmed to address 3 respond to control board command

Address=3 Address=3Address=0

All AC sequencers attached to remote power control modules programmed to address 3 also respond to control board commands for that address

FIGURE 2-3 Remote Power Control Addressing

Chapter 2 Power and Cooling Component Replacement Procedures 2-15

Note the following rules when configuring the AC sequencers (see FIGURE 2-4):

■ To remotely control an AC sequencer in the Sun Enterprise 10000 system cabinet,

set the REMOTE switch to the REMOTE position.

■ To remotely control AC sequencers in the I/O expansion cabinet that have system

interface cables connecting them, set all the REMOTE switches to the REMOTE position and turn the key switch in the front of the I/O expansion cabinet to the OFF position.

■ To remotely control AC sequencers in the I/O expansion cabinet that do not have

system interface cables connecting them, set all REMOTE switches to the REMOTE position, daisy-chain the AC sequencers, and turn the key switch in the front of the I/O expansion cabinet to the OFF position.

2-16 Sun Enterprise 10000 System Service Manual • March 2002

Located In the Processor Cabinet

Back of AC sequencer

Universal AC sequencer

Located In the I/O Expansion Cabinet

Peripheral tray

Universal AC sequencer

For remote control, only one

of these cables are connected.

Universal AC sequencer

Control board 0 (CB0)

FIGURE 2-4 Basic Remote Power Connection

RPC0 RPC1 RPC2 RPC3 RPC4

Remote power

control modules

Control board 1 (CB1)

Chapter 2 Power and Cooling Component Replacement Procedures 2-17

2.7.6 Powering On a Remotely Controlled AC Sequencer

● Type:

ssp# power -on -p x

Where x = 0-4. This command powers on the AC sequencers that are controlled by the remote power control module indicated by x. All peripherals powered by this AC sequencer will power on. Refer to power(1M) for more information.

2.7.7 Verifying an AC Sequencer

Use the following checklist to confirm that a component is operational.

■ Confirm that components powered by sequencer are on.

2.8 Fan Tray Replacement

2.8.1 Isolating a Failed Fan Tray

Use the following checklist to assist with fault isolation.

■ Check that the LEDs are on.

■ Check the fan status using hostview or execute a hostinfo -F command.

■ Check the /var/opt/SUNWssp/adm/domain-name/messages file for fan error

messages.

2.8.2 Powering Off a Single Fan Tray or a Group of Fan Trays

Note – SSP version 3.0 does not properly detect power when an SSP command

restores power. Therefore, remove and reinsert the fan with power on.

2-18 Sun Enterprise 10000 System Service Manual • March 2002

● Power off a fan tray by using hostview(1M) or by typing:

■ For a single fan tray, where x = 0-15:

ssp# fan -t x -p off

■ For a group of trays, where x = front (ft8-15), rear (ft0-7):

ssp# fan -1 x -p off

Refer to fan(1M) for more information.

Caution – To maintain adequate system cooling, limit the amount of time a fan is

off to less than 10 minutes.

2.8.3 Removing a Fan Tray

Caution – If the yellow LEDs are lit, do not remove the component. See

Section 2.8.2, “Powering Off a Single Fan Tray or a Group of Fan Trays” on page 2-18.

1. Open the access door.

2. Grasp the handle and pull the fan tray straight out.

Initially, you will encounter higher resistance due to the retention mechanism; this is normal.

3. Set the fan tray aside.

2.8.4 Installing a Fan Tray

1. Place the bottom surface of the fan tray onto the top of the support of the fan shelf angle bracket.

2. Slide the fan tray in until initial engagement begins with the mating connector.

3. Using firm, steady pressure, fully insert the fan tray into the fan tray slot.

4. Close the access door.

Chapter 2 Power and Cooling Component Replacement Procedures 2-19

2.8.5 Powering On a Fan Tray or a Group of Fan Trays Using SSP Version 3.0

Note – SSP version 3.0 does not properly detect power when an SSP command

restores power. Therefore, remove and reinsert the fan with power on.

● Power on a fan tray by using hostview(1M) or by typing:

■ For a single fan tray, where x = 0-15:

ssp# fan -t x -p on

■ For a group of trays, where x = front (ft8-15), rear (ft0-7):

ssp# fan -l x -p on

In future releases of the software, power will be reinstated to a fan tray upon insertion. Refer to fan(1M) for more information.

2.8.6 Powering On the Fan Trays Using SSP Version 3.1 or Subsequent Compatible Version

● Power on all of the fan trays by using hostview(1M) or by typing:

ssp# fan -p on

Power will be reinstated to a fan tray upon insertion. Refer to fan(1M) for more information.

2.8.7 Verifying a Fan Tray

Use the following checklist to confirm that a component is operational.

■ Check that the LEDs are on.

■ Check the fan status using hostview or execute a hostinfo -F command.

2-20 Sun Enterprise 10000 System Service Manual • March 2002

2.9 Replacing an Air Filter

The Sun Enterprise 10000 system has four front and four rear air filters which provide approximately 150 CFMs per system board. These air filters require periodic replacing. To prevent restricted air flow and possible equipment failure, perform this procedure when the filters contain trapped particles, or every three months.

Note – Do not try to clean the air filters. They deteriorate over time and are easily

damaged. Replace dirty air filters with new ones.

Note – The air filters can be changed without powering off the Sun Enterprise 10000

system. However, the integrity of the I/O cable connections is put at risk when the I/O cables are moved to change the air filters. This must be considered if the Sun Enterprise 10000 system is not powered off to change the air filters.

1. Open the front and rear cabinet doors to get access to the filters shown in

FIGURE 2-5.

2. Look at the underside of the filters with an inspection mirror and flashlight to determine if they are dirty.

Look at the surrounding area for evidence of excessive amounts of dirt and dust. Large amounts of dirt and dust might indicate that the filters are loading up quickly and require more frequent inspections and changes.

Caution – Large amounts of dirt and dust might indicate that the Sun Enterprise

10000 system must be powered off to change the filters. Dust and dirt can be drawn into the Sun Enterprise 10000 system cabinet when the filters are removed and the cooling fans are running.

3. Remove the faceplate by removing four screws.

4. With one hand, reach under the cabinet and slide the filter toward you.

Chapter 2 Power and Cooling Component Replacement Procedures 2-21

FIGURE 2-5 Air Filter Replacement

5. Remove the filter and discard.

6. Insert a clean air filter into the air filter slot, pushing toward the center of the cabinet until it stops.

7. Reinstall the faceplate with the four screws.

8. Close the access door.

2-22 Sun Enterprise 10000 System Service Manual • March 2002

CHAPTER

Control and System Board Replacement Procedures

Note – All commands performed through the Hostview GUI (hostview(1M)) can

also be performed by other SSP user commands such as the power(1M) command or the fan(1M) command.

3.1 Control Board Replacement

3.1.1 Isolating a Failed Control Board

Use the following checklist to assist with fault isolation.

■ Check for any error messages during post.

■ On the SSP, check for any error messages in

/var/opt/SUNWssp/adm/messages.

■ On the SSP, if available, use redx to examine any arbstop dump files or record

stop dump files located in /var/opt/SUNWssp/adm/domain-name.

■ On specific domains, if system call dump files are available, use ADB to examine

/var/crash/domain-name.

3-1

3.1.2 Setting Up the Network for a Replacement Control Board

Modify the host SSP network files with the Ethernet address of the replacement control board. To verify that the host SSP network files are correctly set up, view the /etc/ethers, /etc/hosts, and /etc/nsswitch.conf files for the appropriate entries.

■ /etc/hosts requires IP address and hostname of control boards.

■ /etc/ethers requires MAC address of control boards.

■ /etc/nsswitch.conf must point to files for all entries.

1. Log in to the SSP as root.

3-2 Sun Enterprise 10000 System Service Manual • March 2002

2. Manually edit the /etc/hosts file with the domain(s) and control board(s) IP address if this information is not already in an NIS database.

This procedure is dependent on whether local files or NIS are used. The control board(s) IP address is customer-supplied. Correct entries should look similar to the following /etc/hosts sample. Differences due to the spare SSP are commented.

Note – SSP software only supports standard class C addresses for the control board

subnet.

CODE EXAMPLE 3-1 Sample /etc/hosts File

# Entries for

dom_subnet. xxx.xxx.xx.xxx domain1_hostname xxx.xxx.xx.xxx domain2_hostname

...

xxx.xxx.xx.xxx domainn_hostnname

(n is the number of domains) # # Entries on both ssp’s. # NOTE : On the spare SSP,make sure “loghost” # belongs to the spare. #

xxx.xxx.xx.xxx main_ssp_hostname loghost xxx.xxx.xx.xxx spare_ssp_hostname

# # The next three entries need to be on cb0_subnet. #

xxx.xxx.xx.xxx main_ssp_hostname-le0 xxx.xxx.xx.xxx spare_ssp_hostname-le0 xxx.xxx.xx.xxx cb0_hostname

# # The next three entries need to be on

cb1_subnet.

xxx.xxx.xx.xxx main_ssp_hostname-hme1 xxx.xxx.xx.xxx spare_ssp_hostname-hme1 xxx.xxx.xx.xxx cb1_hostname

CODE EXAMPLE 3-2 shows an example of a main SSP /etc/hosts file is given

assuming:

■ xf4 and xf4-b3 are host domains.

■ xf4-ssp is the main SSP and xf4-ssp1 is the spare SSP.

■ xf4-cb0 and xf4-cb1 are the hostnames for the two control boards.

Chapter 3 Control and System Board Replacement Procedures 3-3

CODE EXAMPLE 3-2 Sample Main SSP /etc/hosts File

#/etc/hosts # #

dom_subnet (xxx.yyy.49.zzz). The 49 subnet

129.153.49.8 xf4

129.153.49.9 xf4-b3

127.0.0.1 localhost

129.153.49.113 xf4-ssp loghost

129.153.49.114 xf4-ssp1 # #

cb0_subnet (xxx.yyy.151.zzz). The 151 subnet

129.153.151.113 xf4-ssp-le0

129.153.151.114 xf4-ssp1-le0

129.153.151.123 xf4-cb0 # #

cb0_subnet (xxx.yyy.152.zzz). The 152 subnet

129.153.152.113 xf4-ssp-hme1

129.153.152.114 xf4-ssp1-hme1

129.153.152.127 xf4-cb1

Note – The /etc/hosts file is actually a link to ./inet/hosts.

3. Manually edit the /etc/ethers file with the domain(s), control board(s), and SSP(s) Ethernet address if this information is not already in the NIS database. Correct entries should look similar to the following /etc/ethers sample:

8:0:20:87:58:a5 xf4-ssp 0:0:be:01:00:1e xf4-cb0 0:0:be:01:00:57 xf4-cb1 0:0:be:a6:50:2f xf4-b3 8:0:20:87:58:aa xf4-ssp1

Note – The control board(s) Ethernet address is located on the front of each control

board.

3-4 Sun Enterprise 10000 System Service Manual • March 2002

4. Edit the /etc/nsswitch.conf file on both the main and the spare SSP.

■ If using local configuration files, the files should appear as in the following

example:

hosts: files ethers: files netmasks: files bootparams: files

■ If using NIS, the files should appear as in the following example:

hosts: nis [NOTFOUND=return] files ethers: nis [NOTFOUND=return] files netmasks: nis [NOTFOUND=return] files bootparams: nis files

Note – The name information server (nis) is customer-network configuration

dependent.

3.1.3 Powering Off a Control Board

1. Use hostview(1M) to confirm that the control board is not the clock or JTAG master.

If the control board to be changed has a “J” and a “C” in its hostview icon, you must switch the primary control board to the alternate control board. See either Section 9.2 “Configuring a Control Board Using SSP Version 3.0” on page 9-3 or Section 9.3 “Configuring a Control Board Using SSP Version 3.1 and Subsequent Compatible Versions” on page 9-6.

2. Power off the control board either by using hostview(1M) or by typing:

ssp% power -off -cb x

Where x = 0-1, the alternate control board. Refer to power(1M) for more information.

Caution – Do not turn off a primary control board or system problems will occur.

Chapter 3 Control and System Board Replacement Procedures 3-5

Note – A warning message queries the user to continue to power off or not. This

warning message ensures that the user is physically present to power “on” or “off” the control board. A remote power-on command does not exist.

3.1.4 Removing a Control Board

Caution – If the yellow LEDs are lit, do not remove the component. See

Section 3.1.3, “Powering Off a Control Board” on page 3-5.

1. Open the Sun Enterprise 10000 system cabinet access door that is enclosing the control board to be replaced.

Note – The control board to be removed will have its yellow LEDs off. If the yellow

power LEDs are on, do not remove the board. Check the other control board to see if its yellow LEDs are off. If they are off, then that is the control board that has been powered off for replacement.

2. Note the location of all cables connected to the control board to be replaced.

3. Attach a wrist strap.

4. Disconnect the cables from the control board.

5. Unlock the control board handle by placing one hand on the handle to hold it in place while using the other hand to pull down on the locking lever that rests on the handle.

6. Pull down on the handle carefully and remove the board.

7. Place the removed control board on a flat, sturdy, ESD-protected surface.

3-6 Sun Enterprise 10000 System Service Manual • March 2002

3.1.5 Installing a Control Board

1. Confirm that the event monitoring daemon is running by typing:

ssp% edd_cmd

The returned message should show State = started-monitoring. If not, you must restart the event monitoring daemon by typing:

ssp% edd_cmd -x start

Refer to edd(1M) and edd_cmd(1M) for additional information.

2. Reinstall the control board:

Caution – Do not install the control board completely until Step a—Step g have

been performed and all cables are attached.

a. Firmly grasp the board by the handle and position it into the appropriate

control board slot.

b. Insert the control board part way to ensure it will not fall.

c. Reconnect all cables that were removed in Step 2 of Section 3.1.4, “Removing a

Control Board” on page 3-6.

d. With the handle extended, slide the board into the slot until it begins to mate

with the centerplane connector.

e. Apply firm pressure to the faceplate to engage the board with the centerplane

connector.

f. Use the insertion handle to fully seat the board.

g. Lock the handle by pulling up the locking lever into position until it is fully

nested with the handle.

3.1.6 Powering On a Control Board

Control boards are powered on upon insertion. When power is on, the yellow LEDs are lit. No power-on commands are necessary for the control board.

Chapter 3 Control and System Board Replacement Procedures 3-7

3.1.7 Configuring a Newly Installed Control Board as the Primary Control Board

Once a failed primary control board has been designated as an alternate and replaced, it is the system administrator’s option to reinstate it as the primary control board. To reinstate the original primary control board, see Section 9.2 “Configuring a Control Board Using SSP Version 3.0” on page 9-3 or Section 9.3 “Configuring a Control Board Using SSP Version 3.1 and Subsequent Compatible Versions” on page 9-6.

3.1.8 Verifying a Control Board

All domains must be off before testing a control board.

1. Log in to the SSP as ssp.

When prompted for the SUNW_HOSTNAME, use the name of the domain to be tested.

2. Prepare the domains for testing by typing:

ssp% power -off -all ssp% power -on -all

3. From the same SSP window, run POST by typing:

ssp% bringup -A off -l64

Answer take up to 90–180 minutes depending on system configuration. Refer to the bringup(1M) or hpost(1M) man page for more detail.

3-8 Sun Enterprise 10000 System Service Manual • March 2002

y when prompted to configure the centerplane. The bringup process can

3.2 System Board Replacement

3.2.1 Isolating a Failed System Board or Mezzanine Board

Use the following checklist to assist with fault isolation.

■ Check for any error messages during post.

■ On the SSP, check for any error messages in

/var/opt/SUNWssp/adm/messages.

■ On the SSP, if available, use redx to examine any arbstop dump files or record

stop dump files located in /var/opt/SUNWssp/adm/domain_name.

■ On specific domains, if system call dump files are available, use ADB to examine

/var/crash/domain_name.

3.2.2 Powering Off a System Board

1. Use hostview(1M) to verify that the system board is not part of a running domain.

Caution – Do not turn off power to a system board with the system board circuit

breaker. It is possible to arbstop the entire platform when the board is powered on again.

2. Power off a system board by using hostview(1M) or by typing:

ssp# power -off -sb x

Where x = 0-15. Refer to power(1M) for more information.

Chapter 3 Control and System Board Replacement Procedures 3-9

3.2.3 Removing a System Board

1. Open the access door.

Caution – If the yellow LEDs are lit, do not remove the component. See

Section 3.2.2, “Powering Off a System Board” on page 3-9.

2. Disconnect all cables from the system board.

3. Attach a wrist strap and unlock the handles by lifting the locking levers that reside on each of the handles.

4. Use the handles to extract the system board and place it on a flat, sturdy, ESDprotected surface with the components side up.

3.2.4 Installing a System Board

These procedures are designed to prevent the weight of the system boards from resting on the plastic power connectors. Follow these procedures carefully so that the plastic power connectors are not loosened or damaged.

Caution – Do not attempt to connect a system board to a centerplane that has a

damaged plastic power connector. A bad connection can result in fire.

1. Confirm that the event monitoring daemon is running by typing:

ssp% edd_cmd

The returned message should show State = started-monitoring. If not, you must restart the event monitoring daemon by typing:

ssp% edd_cmd -x start

Refer to edd(1M) and edd_cmd(1M) for additional information.

2. Attach a wrist strap and install a system board by firmly grasping the board by the handles and positioning it onto the card cage rail.

3. Slide the system board in carefully until the guide pins at the centerplane connector begin to engage the system board.

3-10 Sun Enterprise 10000 System Service Manual • March 2002

4. Gently press on the bottom of the system board face just below the I/O panel so that the rear of the system board is tilted upwards.

This action prevents or minimizes force on the power module housings.

Caution – If you feel any abnormal resistance during installation, remove the

system board and examine the connector for damage. A bad connection can result in fire.

5. While keeping the rear of the system board tilted upwards, press firmly on the face of the system board to seat it as far as possible without using the insertion handles.

The system board should now be approximately a quarter inch from the fully seated position.

6. Fully seat the system board using the insertion handles and latch them.

If you feel any abnormal resistance, remove the system board and examine the connector carefully for damage.

7. Lock the insertion handles by sliding the locking levers into position until they are fully nested with the handles.

3.2.5 Powering On a System Board

1. Determine the amount of system power available by typing power.

TABLE 3-1 to confirm that the amount of available power is sufficient for the

See number of system boards to be installed.

TABLE 3-1 Power Redundancy

Number of System Boards

1–2 4 2

3–5 5 3

7–8 6 3

9–12 7 4

13–16 8

1. If two supplies are failing, no AC module may be removed unless the two failed supplies are under the same

AC module control.

Required Power Supplies for N+ 2 Power Supply or N+1 AC Input Unit Redundancy

Chapter 3 Control and System Board Replacement Procedures 3-11

Required 200V, 30 A single phase circuits

2. Power on a system board by using hostview(1M) or by typing:

ssp# power -on -sb x

Where x = 0-15. Refer to power(1M) for more information.

3. If using SSP version 3.0, restore the system board’s thermal calibration data.

See Section 9.1 “Restoring the Thermal Calibration Information Using SSP Version

3.0” on page 9-1.

3.2.6 Configuring a System Board

After a system board is powered on:

■ It is necessary to run autoconfig(1M) on the SSP when a system board is

installed for the first time in a previously unused slot.

■ It is necessary to run autoconfig(1M) on the SSP when a replacement system

board with a different part number is installed.

3.2.7 Verifying a System Board or Mezzanine Board

1. Log in to the SSP as ssp.

When prompted for the SUNW_HOSTNAME, use the name of the domain to be tested.

2. From the same SSP window, run POST by typing:

ssp% bringup -A off -l64

Answer y when prompted to configure the centerplane. The bringup process can take up to 90–180 minutes depending on system configuration. Refer to the bringup(1M) or hpost(1M) man page for more detail.

3-12 Sun Enterprise 10000 System Service Manual • March 2002

3.3 System Board Component Replacement

Mezzanine board or personality plate replacement requires the system board to be removed and then re-installed. See Section 3.2.3, “Removing a System Board” on page 3-10 and Section 3.2.4, “Installing a System Board” on page 3-10 for assistance.

For unpopulated system boards, install multiple mezzanine modules in the following sequence and see

1. I/O modules

See Section 4.1.4, “Installing an SBus I/O Module” on page 4-5 or Section 4.2.5, “Installing a PCI I/O Module” on page 4-13.

2. Memory module

See Section 5.3.2, “Installing a Memory Module” on page 5-6.

3. Processor module

See Section 5.4.2, “Installing a Processor Module” on page 5-8.

4. SBus cards or PCI Cards

See Section 4.1.2, “Installing an SBus Card” on page 4-2 or Section 4.2.7, “Installing a PCI Riser Card” on page 4-16 and Section 4.2.3, “Installing a PCI Card” on page 4-10.

5. DIMMs

See Section 5.2.1, “Configuring Memory on a System Board” on page 5-3, and Section 5.3.2, “Installing a Memory Module” on page 5-6.

TABLE 3-2 for instructions to run autoconfig(1M):

TABLE 3-2 When to Run autoconfig(1M)

Sun Enterprise 10000 system Component Run autoconfig

I/O modules Yes*

Memory module Yes*

Processor module Yes*

SBus cards or PCI cards No

DIMMs No

*It is necessary to run autoconfig(1M) only when a replacement module has a different Sun part number.

Chapter 3 Control and System Board Replacement Procedures 3-13

3-14 Sun Enterprise 10000 System Service Manual • March 2002

CHAPTER

System Board I/O Component Replacement Procedures

Note – All commands performed through the Hostview GUI (hostview(1M)) can

also be performed by other SSP user commands such as the power(1M) command or the fan(1M) command.

4.1 SBus Component Replacement

4.1.1 Removing an SBus Card

1. Attach a wrist strap.

2. See Section 3.2.3, “Removing a System Board” on page 3-10.

After removal, place the system board on a flat, sturdy, ESD-protected surface with the FRU side up.

3. Remove the four Phillips screws from the system board cover and remove the cover.

4. Disengage the SBus card by pulling up on the handle.

Caution – The connector housing can break if the SBus card is tilted too far.

5. Lift the SBus card from the socket at an angle while guiding the faceplate out from the back panel opening (

FIGURE 4-1).

4-1

6. Place the SBus card in an antistatic bag.

7. If the SBus card is not immediately replaced, install a filler panel (part number 340-2305) in the system board faceplate opening.

Caution – Be sure to install the filler panel in each vacant slot opening. A missing

filler panel can impair system cooling and FCC regulatory compliance.

SBUS 0 SLOT 0

SBUS 0 SLOT 1

SBUS 1 SLOT 0

SBUS 1 SLOT 1

Personality plate with EMI gasket

FIGURE 4-1 Replacing System Board SBus Card

4.1.2 Installing an SBus Card

If converting from PCI to SBus, the personality plate must be removed and replaced prior to installing any SBus electrical components.

Note – SBus cards require that the black handles be installed on the cards in order

to be installed into the Sun Enterprise 10000 system.

4-2 Sun Enterprise 10000 System Service Manual • March 2002

1. Determine the slot for installing the SBus card.

For maximum I/O performance, avoid populating SBus 0 Slot 0 and SBus 0 Slot 1 together and SBus 1 Slot 0 and SBus 1 Slot 1 together.

2. If a filler panel covers the desired SBus slot, lift the two tabs and detach the filler panel.

3. Attach a wrist strap and take the SBus card out of the protective packaging. Inspect the pins in the connector to make sure they are not bent.

4. Guide the SBus card faceplate under the springfingers and against the rear face of the personality plate.

The I/O connectors of the SBus card should be accessible through the opening in the personality plate.

5. To align the connector and socket, push the card toward the personality plate against the compliant EMI gasket.

6. Hold the SBus card by the edges near the connector and firmly but gently press the card down until the connector is fully seated.

Caution – Do not rock the card onto the socket; the plastic connector housing can

break.

7. Replace the system board cover and secure with four Phillips screws, tightening to a torque of 0.8 Nm (7.1 inch pounds).

8. See Section 3.2.4, “Installing a System Board” on page 3-10 to confirm that the event monitoring daemon is running prior to installing the system board.

9. Check for blacklisted components.

If SBus cards have been newly added to a system board, confirm that the PCs on those system boards are not blacklisted. PCs are blacklisted at the factory when a system board does not have any SBus cards installed.

During the bringup process, observe the list of blacklisted components. Alternatively, to retrieve the blacklist file, refer to the blacklist(1M) man page.

Blacklisted PCs will need to be unblacklisted prior to creating a domain that would include those PCs.

In the following example, a domain will be created using system boards 14 and 15 and the blacklist file is located at $SSPVAR/etc/starfire1. Each board in this domain will have an SBus SOC (disk) and HME (network) controller.

Chapter 4 System Board I/O Component Replacement Procedures 4-3

a. See if the PCs have been blacklisted by typing:

ssp% more $SSPVAR/etc/starfire1/blacklist pc 2.2 3.2 5.2 6.2 7.2 10.2 11.2 12.2 13.2 14.2 15.2

b. Unblacklist the PCs on system boards 14 and 15 by editing the

$SSPVAR/etc/starﬁre1/blacklist file and remove 14.2 and 15.2 from the pc line.

4.1.3 Removing an SBus I/O Module

1. See Section 3.2.3, “Removing a System Board” on page 3-10.

After removal, place the system board on a flat, sturdy, ESD-protected surface with the FRU side up.

2. Remove the four Phillips screws from the system board cover and remove the cover.

3. Note the locations of each SBus card and remove all SBus cards as described in Section 4.1.1, “Removing an SBus Card” on page 4-1.

4. Loosen and remove the five Phillips screws from the I/O module.

5. Unscrew the six 3/32-inch hex-head screws located on the compression connectors.

6. Remove the SBus I/O module (

After removal, place the SBus I/O module on a flat, ESD-protected surface or into an antistatic bag.

4-4 Sun Enterprise 10000 System Service Manual • March 2002

FIGURE 4-2).

FIGURE 4-2 Replacing the SBus I/O Module

4.1.4 Installing an SBus I/O Module

If converting from PCI to SBus, the personality plate must be removed and replaced prior to installing any SBus electrical components. See Section 4.3, “Personality Plate Replacement” on page 4-17.

1. Attach a wrist strap.

2. Prior to installing the module, wipe the gold pads of the system board and the exposed contacts of the compression connector with a lint-free, nonabrasive cloth or alcohol wipe.

3. Align the SBus I/O module compression connectors to the system board compression connector locations.

4. Tighten the six captive connector screws clockwise with a 3/32-inch hex driver.

a. Tighten the captive connector screws in the sequence shown in

FIGURE 4-3 until

they touch the metal plate.

b. Tighten each captive connector screw in the sequence shown in

FIGURE 4-3 an

additional 1/2 turn.

c. Tighten the captive connector screws to a final torque of 0.68 Nm (6.0 inch

pounds) in the pattern shown in

Chapter 4 System Board I/O Component Replacement Procedures 4-5

FIGURE 4-3.

15 3

26 4

FIGURE 4-3 Tightening Pattern for the SBus I/O Module

5. Install discrete attachment hardware through the board and into the threaded standoff of the system board.

Later versions of the system board include discrete hardware with a captive washer. If a separate washer is used, see

FIGURE 4-4 for proper orientation of cone washer.

FIGURE 4-4 Cone Washer and Standoff

6. Tighten discrete attachment hardware to a torque setting of 0.7–0.8 Nm (6.0–7.0 inch pounds).

7. Install SBus cards, if necessary. See Section 4.1.2, “Installing an SBus Card” on page 4-2.

8. Replace the system board cover and secure with Phillips screws tightening to a torque of 0.8 Nm (7.1 inch pounds).

4-6 Sun Enterprise 10000 System Service Manual • March 2002

Cone washer

9. See Section 3.2.4, “Installing a System Board” on page 3-10 to confirm that the event monitoring daemon is running prior to installing the system board.

10. Run autoconfig(1M) if you:

■ Replace an SBus I/O module with an SBus I/O module that has a different Sun

part number.

■ Replace a PCI I/O module with an SBus I/O module.

■ Install an SBus I/O module in a previously unused slot.

4.2 PCI Component Replacement

Before you can install PCI components onto a system board, that board must belong to a domain that has Solaris 2.6 operating environment or subsequent compatible versions installed. The SSP must be running version 3.1 or subsequent compatible versions. For information about installing Solaris operating environment, refer to documentation that shipped with the Solaris CD, which contains procedures for installing Solaris 2.6 operating environment on a new domain or upgrading a domain to Solaris 2.6 operating environment.

The board on which you wish to install the PCI components must also be physically removed from the system. If the system is up, and the domain to which the board belongs is running, you must remove the board logically before you do so physically. The Dynamic Reconfiguration User's Guide tells how to do so with the DR Detach feature.

Chapter 4 System Board I/O Component Replacement Procedures 4-7

PCI card

PCI I/O module

Top PCI riser card

Bottom PCI riser card

FIGURE 4-5 PCI Components

4.2.1 Accessing PCI Components

1. Attach a wrist strap.

System board

Personality plate

PCI filler panel

PCI front bracket

PCI front cover

2. See Section 3.2.3, “Removing a System Board” on page 3-10.

After removal, place the system board on a flat, sturdy, ESD-protected surface with the FRU side up.

3. Remove the four Phillips screws from the system board cover and remove the cover.

4. Loosen the four captive screws on the PCI front cover and remove from the system board front cover (

4-8 Sun Enterprise 10000 System Service Manual • March 2002

FIGURE 4-6).

FIGURE 4-6 PCI Front Cover Removal

4.2.2 Removing a PCI Card

1. Attach a wrist strap.

2. Remove the PCI retention screw from the top flange of the PCI card.

3. Disengage the card from the riser card and remove it from the system board assembly (

FIGURE 4-7).

PCI front cover

PCI retention screw

FIGURE 4-7 PCI Card Removal

Chapter 4 System Board I/O Component Replacement Procedures 4-9

4. Place the PCI card in an antistatic bag.

5. If the PCI card is not immediately replaced, install a filler panel (part number 240-2391-01) onto the PCI front bracket using the PCI retention screw (

PCI front bracket

PCI retention screw

PCI filler panel

FIGURE 4-8 Installing a PCI Filler Panel

FIGURE 4-8).

4.2.3 Installing a PCI Card

If converting from SBus to PCI, the personality plate and I/O module must be removed and replaced prior to installing any PCI electrical components. See Section 4.3, “Personality Plate Replacement” on page 4-17 and Section 4.1.3, “Removing an SBus I/O Module” on page 4-4

1. Determine the slot for installing the PCI card (

4-10 Sun Enterprise 10000 System Service Manual • March 2002

FIGURE 4-9).

PCI 0.0

PCI 1.0

FIGURE 4-9 PCI Slot Numbering

2. If a filler panel covers the PCI slot, remove the PCI retention screw on the top flange to remove the filler panel (

FIGURE 4-8).

Retain the screw to attach the PCI card.

3. Attach a wrist strap and take the PCI card out of the protective packaging. Inspect the connector to make sure it is not damaged.

4. Confirm that the installed riser card is the correct voltage for the PCI card to be installed.

PCI cards and risers cards are available in multiple voltages. Inspect the keyed connector on the PCI card to confirm that it will properly mate with the riser connector. If not, obtain and install the correct riser card (Section 4.2.6, “Removing a PCI Riser Card” on page 4-15 and Section 4.2.7, “Installing a PCI Riser Card” on page 4-16).

5. Guide the PCI card from behind the system board faceplate, through the opening, and place the PCI card edge into the mating connector (

Chapter 4 System Board I/O Component Replacement Procedures 4-11

FIGURE 4-10).

PCI retention screw

PCI card edge

FIGURE 4-10 Inserting a PCI Card

6. Confirm alignment of the PCI card, then firmly push the card into the connector until fully seated.

7. Install the PCI retention screw into the mating flange and tighten to a torque of

0.8 Nm (7.1 inch pounds).

4.2.4 Removing a PCI I/O Module

1. Note the location of each PCI card.

2. Attach a wrist strap and remove all PCI cards.

SeeSection 4.2.2, “Removing a PCI Card” on page 4-9.

3. Remove the five Phillips screws from the I/O module.

4. Loosen the six captive 3/32-inch hex screws located on the compression connectors.

5. Remove the I/O module (

After removal, place it on a flat, sturdy ESD-protected surface.

4-12 Sun Enterprise 10000 System Service Manual • March 2002

FIGURE 4-11).

PCI I/O module

FIGURE 4-11 Replacing the PCI I/O Module

4.2.5 Installing a PCI I/O Module

If converting from SBus to PCI, the personality plate must be removed and replaced prior to installing any PCI electrical components. See Section 4.3, “Personality Plate Replacement” on page 4-17.

1. Attach a wrist strap.

2. Prior to installing the module, wipe the gold pads of the system board and the exposed contacts of the compression connector with a lint-free, nonabrasive cloth or alcohol wipe.

3. Align the PCI I/O module compression connectors to the system board compression connector locations.

4. Align the standoffs on the system board with the I/O module.

5. Tighten the six captive connector screws clockwise with a 3/32-inch hex driver.

a. Tighten the captive connector screws in the sequence shown in

FIGURE 4-12 until

they touch the metal plate.

b. Tighten each captive connector screw in the sequence shown in

FIGURE 4-12 an

additional 1/2 turn.

c. Tighten the captive connector screws to a final torque of 0.68 Nm (6.0 inch

pounds) in the pattern shown in

Chapter 4 System Board I/O Component Replacement Procedures 4-13

FIGURE 4-12.

15 3

26 4

FIGURE 4-12 Tightening Pattern for the PCI I/O Module

6. Install discrete attachment hardware through the board and into the threaded standoff of the system board.

See

FIGURE 4-13 for proper orientation of separate cone washer.

Cone washer

FIGURE 4-13 Cone Washer and Standoff

7. Tighten discrete attachment hardware to a torque setting of 0.7–0.8 Nm (6.0–7.0 inch pounds).

8. Install PCI cards, if necessary. SeeSection 4.2.3, “Installing a PCI Card” on page 4-10.

4-14 Sun Enterprise 10000 System Service Manual • March 2002

4.2.6 Removing a PCI Riser Card

The PCI I/O module must be removed to remove or install a riser card. See Section 4.2.4 “Removing a PCI I/O Module” on page 2-11.

1. Attach a wrist strap.

2. Remove any PCI cards according to Section 4.2.2, “Removing a PCI Card” on page 4-9.

Top PCI riser card

Bottom PCI riser card

Fastening hardware

(bottom riser card only)

FIGURE 4-14 Removing a PCI Riser Card

3. To remove the bottom PCI riser card, remove the fastening hardware shown in

FIGURE 4-14.

Countersink screw

Cone washer

Nut

Chapter 4 System Board I/O Component Replacement Procedures 4-15

Fastening hardware for bottom riser only

4. Pull the riser card straight out from the PCI I/O module mating connector.

5. Place the riser card in an antistatic bag.

4.2.7 Installing a PCI Riser Card

1. Confirm that the riser card is the correct voltage for the PCI card to be installed.

2. Attach a wrist strap and insert the riser card into the mating connector on the PCI I/O module.

Press firmly to seat completely into the connector.

3. If installing the bottom riser, use the fastening hardware as shown in torque to a setting of 0.6 Nm (5.3 inch pounds).

4. Install any PCI cards according to Section 4.2.3, “Installing a PCI Card” on page 4-10.

4.2.8 Completing a PCI Component Replacement Procedure

1. Install the PCI front cover onto the front of the system board tightening to a torque setting of 0.8 Nm (7.1 inch pounds).

2. Replace the system board cover and secure with screws tightening to a torque setting of 0.8 Nm (7.1 inch pounds).

3. See Section 3.2.4, “Installing a System Board” on page 3-10 to confirm that the event monitoring daemon is running prior to installing the system board.

4. Run autoconfig(1M) if you:

■ Replace a PCI I/O module with a PCI I/O module that has a different Sun part

number.

■ Replace an SBus I/O module with a PCI I/O module.

■ Install a PCI I/O module in a previously unused slot.

FIGURE 4-14,

4-16 Sun Enterprise 10000 System Service Manual • March 2002

4.3 Personality Plate Replacement

Personality plates are located behind the system board faceplate. Therefore, all of the following components must be removed for access to the personality plate:

■ PCI front covers (if used)

■ PCI front brackets (if used)

■ PCI risers (if used)

■ I/O modules

■ I/O cards

4.3.1 Removing a Personality Plate

1. Attach a wrist strap.

2. See Section 3.2.3, “Removing a System Board” on page 3-10.

After removal, place the system board on a flat, sturdy, ESD-protected surface with the FRU side up.

3. Remove the four Phillips screws from the system board cover and remove the cover.

4. Remove the PCI front cover, if necessary, as shown in

FIGURE 4-15 PCI Front Cover Removal

FIGURE 4-15.

PCI front cover

5. Remove the I/O cards, if necessary. See Section 4.1.1, “Removing an SBus Card” on page 4-1 or Section 4.2.2, “Removing a PCI Card” on page 4-9.

Chapter 4 System Board I/O Component Replacement Procedures 4-17

6. Remove the I/O module, if necessary. See Section 4.1.3, “Removing an SBus I/O Module” on page 4-4 or Section 4.2.4, “Removing a PCI I/O Module” on page 4-12.

7. Remove the PCI front brackets, if necessary, by removing the four screws shown in

FIGURE 4-16.

FIGURE 4-16 PCI Front Bracket Removal

8. Compress the personality plate to the backside of the system board faceplate to relieve the stress on the screws. Sustain this force while removing the three screws securing the personality plate (

FIGURE 4-17).

Caution – The compliant EMI gasket puts force on the three attachment screws.

This force needs to be relieved while removing each screw to prevent the threads from becoming damaged and rendering the personality plate useless.

4-18 Sun Enterprise 10000 System Service Manual • March 2002

Sun Microsystems Sun Enterprise 10000 Service Manual

Specifications and Main Features

Frequently Asked Questions

User Manual

Preface

Component Replacement Guidelines, Indicators, and Nomenclatures

1.1 Configuration Rules

1.2 Testing the System

1.3 Reviewing System Temperatures

1.4 Hardware Indicators

1.4.1 Fans

1.4.2 Centerplane Support Boards

1.4.3 Control Board

1.4.4 System Board

1.5 Inserting a Board

1.6 Standard Torque Settings

1.7 Field Replaceable Units

1.8 Component Numbering

1.9 System Block Diagrams

Power and Cooling Component Replacement Procedures

2.1 SSP Replacement

2.2 Disk Replacement

2.3 AC Input Module Replacement

2.3.1 Isolating a Failed AC Input Module

2.3.2 Powering Off an AC Input Module

2.3.3 Removing an AC Input Module

2.3.4 Installing an AC Input Module

2.3.5 Powering On an AC Input Module

2.3.6 Verifying an AC Input Module

2.4 48-Volt Power Supply Replacement

2.4.1 Isolating a Failed Power Supply

2.4.2 Powering Off a 48-Volt Power Supply

2.4.3 Removing a 48-Volt Power Supply

2.4.4 Installing a 48-Volt Power Supply

2.4.5 Powering On a 48-Volt Power Supply

2.4.6 Verifying a Power Supply

2.5 Power Shelf Replacement

2.5.1 Removing a Power Shelf

2.5.2 Installing a Power Shelf

2.6 DC Breaker Module Replacement

2.6.1 Isolating a Failed DC Breaker

2.6.2 Removing a Circuit Breaker

2.6.3 Installing a Circuit Breaker

2.6.4 Verifying a DC Breaker

2.7 Universal AC Sequencer Replacement

2.7.1 Isolating a Failed AC Sequencer

2.7.2 Powering Off a Remotely Controlled AC Sequencer

2.7.3 Removing an AC Sequencer

2.7.4 Installing an AC Sequencer

2.7.5 Configuring an AC Sequencer

2.7.6 Powering On a Remotely Controlled AC Sequencer

2.7.7 Verifying an AC Sequencer

2.8 Fan Tray Replacement

2.8.1 Isolating a Failed Fan Tray

2.8.2 Powering Off a Single Fan Tray or a Group of Fan Trays

2.8.3 Removing a Fan Tray

2.8.4 Installing a Fan Tray

2.8.5 Powering On a Fan Tray or a Group of Fan Trays Using SSP Version 3.0

2.8.6 Powering On the Fan Trays Using SSP Version 3.1 or Subsequent Compatible Version

2.8.7 Verifying a Fan Tray

2.9 Replacing an Air Filter

Control and System Board Replacement Procedures

3.1 Control Board Replacement

3.1.1 Isolating a Failed Control Board

3.1.2 Setting Up the Network for a Replacement Control Board

3.1.3 Powering Off a Control Board

3.1.4 Removing a Control Board

3.1.5 Installing a Control Board

3.1.6 Powering On a Control Board

3.1.7 Configuring a Newly Installed Control Board as the Primary Control Board

3.1.8 Verifying a Control Board

3.2 System Board Replacement

3.2.1 Isolating a Failed System Board or Mezzanine Board

3.2.2 Powering Off a System Board

3.2.3 Removing a System Board

3.2.4 Installing a System Board

3.2.5 Powering On a System Board

3.2.6 Configuring a System Board

3.2.7 Verifying a System Board or Mezzanine Board

3.3 System Board Component Replacement