2550 Garcia Avenue
Mountain View, CA 94043 USA
415 960-1300fax 415 969-9131
Part No.: 802-3845-11
Revision A, November 1996
™
Copyright 1996 Sun Microsystems,Inc.2550GarciaAvenue,MountainView, California 94043-1100U.S.A.
All rights reserved.Thisproductordocumentisprotectedbycopyrightanddistributedunderlicensesrestrictingitsuse,copying,distribution,
and decompilation. No part of this productordocumentmaybereproducedinanyformbyanymeanswithoutpriorwrittenauthorizationof
Sun and its licensors, if any.
Portions of this productmaybederivedfromtheUNIX®system and fromtheBerkeley4.3BSDsystem,licensedfromtheUniversityof
California. UNIX is a registeredtrademarkintheUnitedStatesandinothercountriesandisexclusivelylicensedbyX/OpenCompanyLtd.
Third-partysoftware,includingfonttechnologyinthisproduct,isprotectedbycopyrightandlicensedfrom Sun’s suppliers.
RESTRICTED RIGHTS LEGEND: Use, duplication, or disclosurebytheU.S.GovernmentissubjecttorestrictionsofFAR52.227-14(g)(2)(6/87)
and FAR52.227-19(6/87),orDFAR252.227-7015(b)(6/95)andDFAR227.7202-3(a).
Sun, Sun Microsystems,theSunlogo,Solaris,Enterprise,Ultra,UltraComputing,UltraServer, and UltraSPARC aretrademarksorregistered
trademarks of Sun Microsystems,Inc.intheUnitedStatesandinothercountries.AllSPARCtrademarksareusedunderlicenseandare
trademarks or registeredtrademarksofSPARCInternational,Inc.intheUnitedStatesandinothercountries.ProductsbearingSPARC
trademarks arebaseduponanarchitecturedevelopedbySunMicrosystems,Inc.
The OPEN LOOK®and Sun™ Graphical User Interfaces weredevelopedbySunMicrosystems,Inc.foritsusersandlicensees.Sun
acknowledges thepioneeringeffortsofXeroxCorporationinresearchinganddevelopingtheconceptofvisualorgraphicaluserinterfacesforthe
computer industry.SunholdsanonexclusivelicensefromXeroxtotheXeroxGraphicalUserInterface,whichlicensealsocoversSun’slicensees
who implement OPEN LOOK GUIs and otherwise comply with Sun’s written license agreements.
THIS PUBLICATION IS PROVIDED “AS IS” WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING,
BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR
NON-INFRINGEMENT.
Copyright 1996 Sun Microsystems,Inc.,2550GarciaAvenue,MountainView, Californie 94043-1100U.S.A.
Tous droitsréservés.Ceproduitoudocumentestprotégéparun copyright et distribué avec des licences qui en restreignentl’utilisation,lacopie
et ladécompilation.Aucunepartiedeceproduitoudesadocumentationassociéenepeutêtrereproduite sous aucune forme, par quelque moyen
que ce soit, sans l’autorisation préalable et écrite de Sun et de ses bailleurs de licence, s’il y en a.
Des parties de ce produitpourront être derivées du système UNIX®et du système Berkeley 4.3 BSD licencié par l’Université de Californie. UNIX
est une marque enregistrée aux Etats-Unis et dans d’autres pays, et licenciée exclusivement par X/Open Company Ltd. Le logiciel détenu par des
tiers, et qui comprendla technologie relative aux polices de caractères, est protégé par un copyright et licencié par des fournisseurs de Sun.
Sun, Sun Microsystems,le logo Sun, Solaris, Enterprise, Ultra, UltraComputing, UltraServer,et UltraSPARCsont des marques déposées ou
enregistréesde Sun Microsystems, Inc. aux Etats-Unis et dans d’autres pays. Toutesles marques SPARC, utilisées sous licence, sont des marques
déposées ou enregistréesde SPARCInternational, Inc. aux Etats-Unis et dans d’autres pays. Les produits portant les marques SPARC sont basés
sur une architecturedéveloppée par Sun Microsystems, Inc.
Les utilisateurs d’interfaces graphiques OPEN LOOK®et Sun™ ont été développés de Sun Microsystems, Inc. pour ses utilisateurs et licenciés.
Sun reconnaîtles efforts de pionniers de Xerox Corporation pour la rechercheet le développement du concept des interfaces d’utilisation visuelle
ou graphique pour l’industrie de l’informatique. Sun détient une licence non exclusive de Xerox sur l’interface d’utilisation graphique, cette
licence couvrant aussi les licenciés de Sun qui mettent en place les utilisateurs d’interfaces graphiques OPEN LOOK et qui en outre se
conforment aux licences écrites de Sun.
CETTE PUBLICATION EST FOURNIE "EN L’ETAT" SANS GARANTIE D’AUCUNE SORTE, NI EXPRESSE NI IMPLICITE, Y COMPRIS, ET
SANS QUE CETTE LISTE NE SOIT LIMITATIVE, DES GARANTIES CONCERNANT LA VALEUR MARCHANDE, L’APTITUDE DES
PRODUITS A REPONDRE A UNE UTILISATIONPARTICULIERE OU LE FAIT QU’ILS NE SOIENT PAS CONTREFAISANTS DE PRODUITS
DE TIERS.
xxivUltra Enterprise 6000/5000/4000 Systems Manual—November 1996
Preface
The Ultra™ Enterprise™ 6000/5000/4000 Systems Manual is for the qualified
service-trained maintenance provider.
How This Book IsOrganized
Information in this manual is organized in five parts:
Part 1 - ”Product Description,” provides an overview of the Enterprise
6000/5000/4000 server systems, safety precautions, and tools information.
Part 2 - “System Components,” provides descriptions and installation and
removal instructions for boards and components, power supplies, and internal
storage devices.
Part3-“Troubleshooting,” contains fault isolation information and flow
charts to help locate system hardware problems.
Part 4 - “Service Information,” explains how to prepare the system for service
and how to access subassemblies.
Part 5 - “Appendixes,” provides additional reference information such as
product specifications, illustrated parts breakdown, connector pinouts, and
other material of interest to qualified service-trained maintenance providers.
xxv
UNIX Commands
This document may not include specific software commands or procedures.
Instead, it may name software tasks and refer you to operating system
documentation or the handbook that was shipped with your new hardware.
The type of information that you might need to use references for includes:
• Shutting down the system
• Booting the system
• Configuring devices
• Other basic software procedures
See one or more of the following:
• Solaris 2.x Handbook for SMCC Peripherals contains Solaris™ 2.x software
commands.
• On-line AnswerBook™ for the complete set of documentation supporting
the Solaris 2.x software environment.
• Other software documentation and Platform Notes that you received with
The SunDocs Order Desk is a distribution center for Sun Microsystems
technical documents. You can use major credit cards and company purchase
orders. You can order documents in the following ways:
CountryTelephoneFax
United States1-800-873-78691-800-944-0661
United Kingdom0-800-89-88-880-800-89-88-87
France05-90-61-5705-90-61-58
Belgium02-720-09-0902-725-88-50
Luxembourg32-2-720-09-0932-2-725-88-50
Germany01-30-81-61-9101-30-81-61-92
The Netherlands06-022-34-4506-022-34-46
Sweden020-79-57-26020-79-57-27
Switzerland155-19-26155-19-27
Japan0120-33-90960120-33-9097
World Wide Web: http://www.sun.com/sunexpress/
Sun Welcomes Your Comments
Please use the Reader Comment Card that accompanies this document. We are
interested in improving our documentation and welcome your comments and
suggestions.
If a card is not available, you can email or fax your comments to us. Please
include the part number of your document in the subject line of your email or
fax message.
Warning – This equipment contains lethal voltage. Accidental contact with
centerplane, card cage, and drive areas can result in serious injury or death.
Caution – Improper handling by unqualified personnel can cause serious
!
damage to this equipment. Unqualified personnel who tamper with this
equipment may be held liable for any resultant damage to the equipment.
Individuals who remove any outer panels or open covers to access this
equipment must observe all safety precautions and ensure compliance with
skill level requirements, certification, and all applicable local and national
laws.
Procedures contained in this document must be performed by qualified
service-trained maintenance providers.
Note – Before you begin, carefully read each of the procedures in this manual.
If you have not performed similar operations on comparable equipment, donot attempt to perform these procedures.
The Ultra Enterprise 6000/5000/4000 systems are available in two enclosures:
• Enterprise 6000/5000Data center system cabinet containing either a
• Enterprise 4000Standalone enclosure containing an 8-slot card cage
1
16-slot or 8-slot card cage
Figure 1-1Ultra Enterprise Data Center System Cabinet and Standalone Enclosure
1-1
1
The same CPU/Memory board, I/O boards, Disk board, processor modules,
memory modules, power supplies, fans, and internal disks are used in both
enclosures.
The minimum configuration for the Enterprise 6000/5000 systems is:
• Data center system cabinet (system cabinet)
• 16-slot or 8-slot card cage
• Power/cooling modules (2)
• Quad fan tray
• Clock board
• CPU/Memory board
• UltraSPARC™ module
• Main memory
• I/O board
• Peripheral power supply
• AC power sequencer
• SCSI receptacle for removable media, including the SunCD™ 4 drive
The minimum configuration for the Enterprise 4000 system is:
• 8-slot card cage
• Power/cooling modules (2)
• Fan box
• Clock board
• CPU/Memory board
• UltraSPARC module
• Main memory
• I/O board
• Peripheral power supply
• AC power sequencer
• SCSI receptacle for removable media, including the SunCD 4 drive
Ultra Enterprise server systems use a centerplane. Electrical traces embedded
in the centerplane serve both the front and rear sides of the centerplane;
therefore, the orientation of the sockets on the rear of the centerplane is
opposite the orientation of sockets on the front of the centerplane.
Boards in the front of the card cage are installed component side down, and
boards in the rear of the card cage are installed component side up. Similarly,
the orientation of the power/cooling modules installed in the rear of the
system chassis is opposite the orientation of power/cooling modules in the
front of the system chassis.
Since boards, modules, and power/cooling modules may be located on either
side of the Enterprise server chassis centerplane, the terms “front,” “rear,”
“right,” and “left” are defined in Table 1-1.
ProductOverview1-5
1
Table 1-1 Definitions of Terms
Server Orientation
FrontKeyswitch location
RearAC power switch and cable location
Power/Cooling Module, Board, and UltraSPARC Module Orientation
FrontEdge nearest you as you face the unit installed in a system
RightSide to your right as you face the front of the installed unit
LeftSide to your left as you face the front of the installed unit
CPU/Memory
boards, SBus
I/O boards,
and Graphics
I/O boards
Disk boards2 per system (must
UltraSPARC
modules
Memory
modules
SBus cards15 per system7 per system0-3 cards per SBus I/O board, 0-2 cards per Graphics I/O
Graphics (UPA)
cards
16 total per system8 total per systemEach slot can accept any of these three types of boards:
CPU/Memory board, SBus I/O board, and Graphics I/O
board. Combinations can vary. One CPU/Memory board
becomes the system master automatically. Jumper changes
are not needed. For easier I/O boards cabling,
CPU/Memory boards can be installed in the front and I/O
boards in the rear of the Enterprise system.
4 per systemCan be installed only in slot 14 and slot 15 in the
use slot 15 if only 1
is installed)
30140-2 modules on each CPU/Memory board.
0, 8, or 16 SIMMs
per CPU/Memory
board
4 per system4 per system0-1 card per Graphics I/O board.
0, 8, or 16 SIMMs
per CPU/Memory
board
Enterprise 6000 system.
For easier Disk boards cabling, CPU/Memory boards can
be installed in the front and Disk boards in the rear of the
Enterprise system.
SIMM sizes are 8, 32, or 128 Mbyte DRAM. Do not mix
sizes within the same bank.
Add 8 SIMMs at a time. Install SIMMs in all bank 0 sockets
first on each CPU/Memory board, from the lowest slot to
the highest. Once bank 0 is full, install remaining SIMMs in
bank 1 sockets in the same order.
board.
SCSI trayCD-ROM and tape
drive
Disk trayThe Enterprise 6000 system cabinet can hold 0-3 trays; the Enterprise 5000 system cabinet can hold 0-4.
The expansion cabinet can hold 1-8 trays; each disk tray holds up to six 5 1/4-inch form factor disk
drives. Refer to documentation that comes with the disk trays and expansion cabinet.
Multi-tape tray
or tape library
The Enterprise 6000/5000 system cabinet can hold 1 multi-tape backup tray or tape library.
The expansion cabinet can hold 1 or 2 multi-tape trays or tape libraries. Tape trays hold up to four
8 mm tape drives. Refer to documentation that comes with the tape trays and expansion cabinet.
CD-ROM and tape
drive
ProductOverview1-7
SCSI tray takes removable-media drives only. One SunCD 4
is standard equipment per system. One optional tape drive
is supported in the SCSI tray.
For your protection, observe the following safety precautions when setting up
your equipment:
• Follow all cautions, warnings, and instructions marked on the equipment.
• Never push objects of any kind through openings in the equipment as they
may touch dangerous voltage points or short out components that could
result in fire or electric shock.
• Refer servicing of equipment to qualified personnel.
To protect both yourself and the equipment, observe the following precautions:
Table 2-1 Safety Precautions
ItemProblemPrecaution
Wrist or
foot strap
ESDWear a conductive wrist strap or foot strap when handling printed
circuit boards.
2
2-1
2
Table 2-1 Safety Precautions (Continued)
ItemProblemPrecaution
ESD matESDAn approved ESD mat provides protection from static damage when
used with a wrist strap or foot strap. The mat also cushions and protects
small parts that are attached to printed circuit boards.
Cover panelsSystem damage
and overheating
Card cage slot filler
panels and load boards
System damage
and overheating
2.2Symbols
The following symbols mean:
!
!
Re-install all cabinet cover panels after performing any service work on
the system.
Make sure all empty board slots have a filler panel installed.
NOTE: You must use load boards instead of filler panels in the 16-slot
Enterprise 6000 system card cage.
WARNINGHazardous voltages are present. To
reduce the risk of electrical shock and
danger to personal health, follow the
instructions.
WARNINGRisk of personal injury. To reduce the
risk, follow the instructions.
CAUTIONRisk of equipment damage.To reduce
the risk, follow the instructions.
SURFACECAUTION: Hot surfaces. Avoid
contact. Surfaces are hot and may
cause personal injury if touched.
the operating system is halted. The
circuit breaker can be turned off.
DIAGNOSTICSSystem is powered on. If system is
rebooted, POST will display extended
diagnostic messages.
CYCLINGSystem or board is operating
normally.
LOCKEDBoard: 1/4-turn access slot is locked.
System: running in secure mode and
will not respond to commands from
the console. The key can be removed.
UNLOCKEDBoard 1/4-turn access slot is
unlocked.
POWERBoard is receiving DC power.
SERVICESystem has detected a hardware
failure.
PROTECTIVE EARTHEarth ground.
CHASSISFrame or chassis ground.
Safety Precautions and ToolsRequirements2-3
2
FUSE REPLACEMENTFor continued protection against risk
MARKINGof fire and electric shock, replace
!
Ensure that the voltage and frequency of the power outlet to be used matches
the electrical rating labels on the equipment.
Wear antistatic wrist straps when handling any magnetic storage devices,
CPU/Memory boards, or other printed circuit boards.
Use only properly grounded power outlets as described in Section 1.3,
“Preparing the Electrical Circuits,” in the Ultra Enterprise 6000/5000/4000Systems Installation Guide, part number 802-3844.
Caution – DO NOT make mechanical or electrical modifications to the cabinet.
!
Sun Microsystems™ is not responsible for regulatory compliance of modified
cabinets.
ONLY with fuse of the same type and
rating.
Caution – The chassis AC power cord must remain plugged in to ensure a
!
proper ground.
2.3Tools Required
This list represents the minimum of tools and test equipment you will need:
Do not touch the heatsinks while installing or removing the board. Hold the
board only by the edges. If a heatsink is loose or broken, obtain a replacement
board.
Caution – When inserting a board into slot 4 or slot 10 of a 16-slot card cage,
lift the board slightly to avoid damage to the centerplane connectors.
Caution – The heatsinks on the board can be damaged by improper packaging.
When storing or shipping the board, ensure that the heatsinks have sufficient
protection.
3.2Filler Panels and Load Boards
All empty board slots in Enterprise systems must have either a filler panel or a
load board installed.
• Empty slots in Enterprise 5000 and 4000 systems must have a filler panel
installed. See Figure 3-1.
• Empty slots in Enterprise 6000 systems must have a load board installed.
See Figure 3-2.
Load boards and filler panels are inserted into a board slot with the
springfingers facing down if inserted in the front of the system; the
springfingers face up if inserted in the rear of the system.
Figure 3-2Load Board (Enterprise 6000 Systems Only)
3.3Hot-Plug Feature
Enterprise systems have extensive error detection mechanisms, and an
Automatic System Reconfiguration (ASR) feature that enables the system to be
rebooted with failed components (such as CPUs, memory, or I/O) disabled.
When an error is detected, the system can be reconfigured so that the board
containing the failed components is placed in low power mode and is no
longer accessible.
Caution – The peripheral power supply provides the precharge voltages
required for hot-plug. Do not attempt hot-plug of a system component if the
power supply is missing or inoperative. Use prtdiag(1M)to determine the
status of the peripheral power supply.
Caution – If the message: NOTICE: Hot Plug not supported in this
system is displayed during boot, do NOT attempt hot-plug in this system or
damage to the hardware will occur.
The hot-plug feature enables you to insert a new board into a powered on
system, despite the system being “live,” or being supplied with electrical
power. When the hot-plug feature is used to add a board to a powered on
system, the system will not use the new board until the system is rebooted.
3.4CPU/Memory Boards
Each CPU/Memory board supports up to two UltraSPARC modules and 16
SIMM slots for memory.
Figure 3-3 is a simplified block diagram of the CPU/Memory board. It includes
an Address Controller, 8 bit-sliced Data Controllers, a Bootbus Controller, onboard devices (including a Flash PROM, and SRAM), two CPU processor slots,
and slots for two memory banks of 8 SIMMs each.
software has disabled the board. If a board has not been disabled by the ASR
software, then the operating system should be halted and the system powered
off prior to board removal. See Chapter 12, “Powering Off and On” and then
see Section 3.4.1.2, “Removing a Board from a Nonpowered On System.”
3
1. Ensure that the board has been disabled by the ASR software. See
Section 3.3, “Hot-Plug Feature.”
Once disabled by ASR, one of two results occurs:
• The three LEDs on the board are not lit (board has no power).
• The outer two green LEDs are not lit and the middle yellow LED is lit
(board in low power mode).
Note – System software operates such that the LED pattern described is the
same for a board that is component side down (installed in front of card cage)
or component side up (installed in rear of card cage).
2. Use a Phillips #1 screwdriver to mechanically release the board from the
system card cage.
Insert the screwdriver into each quarter-turn access slot (the slots are located
on the left and right sides of the board front panel) and then turn a quarter
turn so that the arrow points to the unlocked position. See Figure 3-4.
Unlocked
Figure 3-4Unlocking and Locking Quarter-Turn Access Slots
CPU/Memory Boards and Components3-7
Locked
3
3. Pull the ends of both extraction levers outward simultaneously to unseat
the board centerplane connector from the centerplane receptacles.
See Figure 3-5 for the positioning of the levers.
Extraction lever
in extract/insert
position
Figure 3-5CPU/Memory Board
4. If a board is not immediately replaced, a load board (Enterprise 6000
systems only) or a filler panel (Enterprise 4000 and 5000 systems only)
must be installed in its place.
See Section 3.2, “Filler Panels and Load Boards.”
3.4.1.2 Removing a Board from a NonpoweredOnSystem
1. Use a Phillips #1 screwdriver to mechanically release the board from the
system card cage.
Insert the screwdriver into each quarter-turn access slot (the slots are located
on the left and right sides of the board front panel) and then turn a quarter
turn so that the arrow points to the unlocked position. See Figure 3-4.
2. Pull the ends of both extraction levers outward simultaneously to release
the board from the centerplane receptacles.
See Figure 3-5 for the positioning of the levers.
3. If a board is not immediately replaced, a load board (Enterprise 6000
systems only) or a filler panel (Enterprise 4000 and 5000 systems only)
must be installed in its place.
See Section 3.2, “Filler Panels and Load Boards.”
3.4.2 Installing a Board
3.4.2.1 Board Slot Selection
Note – Logically there is no difference between the board slots in the front or
rear of the card cage, and each slot can accept any board type. It is suggested
that CPU/Memory boards be installed in the front slots, and I/O and disk
boards be installed in the rear slots because of cabling. Should the need arise,
however, any of these three board types can be placed in any of the numbered
board slots, with the exception of slot 1. Slot 1 should be used by the first I/O
board because it is the only slot connected to the onboard SCSI devices.
3
The first CPU/Memory board is placed in slot 0, followed sequentially by all
remaining even numbered slots. If there are boards remaining, they can be
installed sequentially in odd numbered slots, if available, in the system rear
(with the exception of slot 1 as noted above). See Figure 3-6 and Figure 3-7 for
board slot locations.
For CPU/Memory boards being placed in the rear of the system, ensure that
the component side is up. If the boards are placed in the front of the system,
ensure that the component side is down. See Figure 3-8.
CPU/Memory Boards and Components3-9
3
.
Slot #
10
12
14
Slot #
0
2
4
6
8
FrontView
Rear View
1
3
5
7
9
11
13
15
Figure 3-6Enterprise 6000 Board Locations
3-10Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
3
Slot #
Slot #
0
2
4
6
Front View
PCM
Rear View
1
3
5
7
Figure 3-7Enterprise 5000/4000 Board Locations
3.4.2.2 Cooling and Power Issues
There should be one power/cooling module (PCM) for every two boards to
adhere to cooling and power requirements. The PCMs must be installed
adjacent to populated board slots to ensure the fan in the PCM can cool the
respective boards.
CPU/Memory Boards and Components3-11
3
Note – All empty board slots in Enterprise 4000 or 5000 systems must have a
filler panel installed to ensure proper cooling. All empty slots in Enterprise
6000 systems must have load boards installed.
3.4.2.3 PoweredorNonPoweredOn System
1. Carefully insert the board (component side down if in front; component
side up if in the rear) in the proper slot in the card cage, ensuring that the
board does not slip out of the left and right card guides.
See Figure 3-8.
Board orientation for insertion
in the cabinet rear (component
side up)
Figure 3-8Board Replacement
3-12Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
Board orientation for insertion
in the cabinet front (component
side down)
3
2. Ensure that both extraction levers are in the insert position (arrow
pointing outward), and that the quarter-turn access slots are unlocked
(arrow indicates unlocked position) as you slide the board toward the
centerplane receptacles.
See Figure 3-4 and Figure 3-5. The board will not seat fully unless the levers
are in this starting position and both quarter-turn access slots are unlocked.
Caution – DO NOT FORCE any board into a slot; it can cause damage to the
!
board and system. The board should insert and seat smoothly. If it binds,
remove the board and inspect the card cage slot for any obvious obstructions.
Also inspect both the board and the centerplane for bent pins or other damage.
3. Push the board into the card cage, then simultaneously press both
extraction levers to seat the board on the centerplane.
Pushing both levers simultaneously avoids twisting the board and bending
the connector pins, and mates the board centerplane connector to the
matching receptacle on the centerplane. Do not press on board front panel to
seat it—doing so will damage the connector pins.
4. Mechanically lock the board to the system chassis by inserting a Phillips
#1 screwdriver into each quarter-turn access slot and then turning to the
locked position.
See Figure 3-4.
5. Once the board has been installed, a message similar to the following will
be displayed on the monitor (if the system is powered on):
Example depicts screen output when a new CPU/Memory board has been
hot-plugged into slot 6 of an operating Enterprise system:
NOTICE: CPU Board Hotplugged into Slot 6
NOTICE: Board 6 is ready to remove
This screen output indicates that the board has been detected by the system
and is in the low power mode. Additionally, any subsequent prtdiag(1M)
output would include information for board slot 6. Again, note that the
system will not use the new board until the system is rebooted.
6. Reboot the system now or schedule a later time to reboot when system
disruption will be minimized.
CPU/Memory Boards and Components3-13
3
3.4.3 UltraSPARC Modules
Each CPU/Memory board has four connectors for UltraSPARC modules (up to
two modules per board, two connectors per module). For each module, there is
a connector with 144 pins and a connector with 288 pins. See Figure 3-9.
3.4.4 Handling Precautions
The following precautions should be exercised when handling UltraSPARC
modules:
• UltraSPARC modules are static-sensitive and a grounding wrist strap field
kit must be used when handling the modules.
• Always handle the modules by the edges and not by the smaller black heat
sinks that break easily if handled improperly.
• Do not handle the modules by touching the gold pins on the compression
connectors. Natural oils on the hands cause these connectors to oxidize and
corrode over a period of time, resulting in the need for module cleaning or
replacement.
288 pin connector
144 pin connector
Screws
(3 places)
Figure 3-9UltraSPARC Module Connector Detail
3-14Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
Screws
(2 places)
3.4.4.1 Removing a Module
Each module is locked to the main board with a single standoff and is
connected to the main board by two connectors. The pins within the connectors
are compressed to the corresponding board mating surfaces by a metal
compression bar which, when secured with screws, compresses the module
connector pins to the board mating surfaces. See Figure 3-10.
3
Figure 3-10 Ultra SPARC Module Connector Detail
1. Use the procedures in Section 3.4.1, “Removing a Board,” to remove the
applicable CPU/Memory board.
Warning – The heatsinks on the UltraSPARC modules may be hot. Use caution
when removing or installing UltraSPARC modules and avoid contact.
CPU/Memory Boards and Components3-15
3
2. Use a 3/32 Hex driver to loosen all screws on each of the compression
connectors on the module to be removed (three screws for the 288 pin
connector, two screws for the 144 pin connector).
See Figure 3-9.
3. Lift the module straight up, off the board mating surface and the single
standoff that locks the module to the board.
Use pressure applied with fingers to assist in removing module from
standoff. See Figure 3-11.
Standoff,
1 per module
Figure 3-11 UltraSPARC Module Removal and Replacement
4. Place the module in an antistatic bag.
3-16Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
3.4.4.2 Installing a Module
To maximize performance when installing UltraSPARC modules on a
CPU/Memory board, use all CPU 0 connectors on the lowest numbered slot to
the highest numbered slot. After this, if there are modules remaining, use the
CPU 1 connectors in the same order.
1. Take the UltraSPARC module out of the protective packaging and inspect
for dust on the connectors.
If necessary, clean the connectors with a dry, stiff toothbrush.
2. Remove the applicable CPU/Memory board as indicated in Section 3.4.1,
“Removing a Board.”
3. Inspect the board module mating surface. If the surface requires cleaning,
use a dry, stiff toothbrush to clean debris from the mating surfaces.
Note – There are miniature silver alignment pins on the compression
connectors which, when the module is properly seated, align with related
receptacles on the mating surfaces of the CPU/Memory board. In addition,
there is a gold standoff mounted on the CPU/Memory board opposite the
module’s smaller board connector. This acts as a standoff for the module as
well as an alignment pin.
3
4. Align the module over the two board receptacles using the single standoff
as well as the alignment pins located on the module compression
connector as a guide.
See Figure 3-10 and Figure 3-11.
5. Holding the module by the edges, rest it on the board standoff, aligning
the compression connectors with the screws.
Firmly but gently press the module straight down until the standoff post
snaps into place and the module connectors are fully seated.
6. Tighten the 3/32 hex screws of the module in two stages:
a. Tighten to 3 inch-pounds in the tightening sequence as follows:
CPU/Memory Boards and Components3-17
3
Tightening sequence
413
2
5
b. Tighten to 6 inch-pounds in the same tightening sequence.
Caution – Do not over-torque or under-torque the screws. Excessive force can
!
warp the connector. Insufficient force can cause an incomplete electrical
connection.
7. Use the procedures in Section 3.4.2, “Installing a Board,” to replace the
applicable CPU/Memory board.
3-18Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
3.4.5 Memory Modules (SIMMs)
The CPU/Memory board has 16 SIMM sockets, which are divided into two
banks of 8 SIMMs each, Bank 0 and Bank 1. Bank 0 and Bank 1 SIMMs occupy
alternate slot locations; Bank 0 SIMMs are in the even numbered slots, and
Bank 1 SIMMs are in odd numbered slots. See Figure 3-13.
3
Bank 0
FHC
B0-J3100
B0-J3200
B0-J3300
B0-J3400
B0-J3500
B0-J3600
B0-J3700
B0-J3800
SRAM
B1-J3101
B1-J3201
B1-J3301
B1-J3401
B1-J3501
B1-J3601
B1-J3701
B1-J3801
SRAM
Bank 1
35W DC2DC
CPU1
288 connector
144 connector
CPU0
288 connector
144 connector
35W DC2DC
DC
DC
AC
720 centerplane connector
Figure 3-13 Layout of CPU/Memory Board
CPU/Memory Boards and Components3-19
DC
DC
DC
DCDC
DC
3
There are three types of SIMMs that can be used in both Bank 0 and Bank 1.
Each type is listed together with the DRAMs used in Table 3-1.
Table 3-1 SIMM vs. DRAM
SIMMDRAM
8 Mbyte1 Mbyte x4
32 Mbyte4 Mbyte x4
128 Mbyte16 Mbyte x4
3.4.5.1 Removing a Memory Module
1. Remove the CPU/Memory board from which the SIMM is to be removed.
See Section 3.4.1, “Removing a Board.”
2. Attach a wrist strap and place an antistatic surface next to the system.
3. Locate the slot for the SIMM you need to replace.
See Figure 3-13.
3-20Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
3
4. Eject the faulty SIMM by pressing down on the ejection levers on both
sides of the SIMM connector.
See Figure 3-14.
Figure 3-14 Ejecting a SIMM
5. Holding the SIMM by its edges, remove it from the slot and place it on an
antistatic surface.
3.4.5.2 Installing a Memory Module
Requirements
All banks must have the same size SIMMs, however, SIMMs from different
manufactures are interchangeable in a single bank if the SIMMs all have the
same capacity and speed. Sort the SIMMs into banks of 8 using the same size
SIMMs.
CPU/Memory Boards and Components3-21
3
Maximizing Performance
The following guidelines will result in optimal memory interleaving across
boards for performance. These guidelines are for optimal performance and are
not requirements for a functional system. The guidelines apply to systems with
no SIMMS installed and when adding SIMMs to a system; if you are adding
SIMMs, you may need to move some SIMMs to meet the guidelines.
1. Install one bank on each board before installing the second bank on any
board.
It does not matter whether the first bank is bank 0 or bank 1.
2. Begin with the largest density banks first (128 Mbyte SIMMs), continue
with medium sized banks (32 Mbyte SIMMs), and finish with the smallest
banks (8 Mbyte SIMMs).
3. If there is remaining memory, start filling the second banks on the boards
in the same order as the first banks.
Installation
1. Place the CPU/Memory board on which the SIMM is to be installed on an
antistatic mat.
2. Carefully remove the new SIMM from its protective packaging and place
it on an antistatic surface.
The bag that the SIMM is packed in makes a good antistatic surface.
3. Press down on the ejector levers at both ends of the SIMM connector slot
that will receive the new SIMM.
The connector slot will not accept the SIMM unless the levers are in the
insert position. See Figure 3-15.
4. Align the SIMM with the slot.
Hold the SIMM by its edges and orient it so that the two notches at the
bottom of the SIMM line up with the two tabs in the SIMM connector. See
Figure 3-15.
5. Place your thumbs on the top edge of the SIMM and push the SIMM
firmly into its connector.
See Figure 3-16.
3-22Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
3
6. Lock the SIMM in place by pushing both ejector levers into the upright
position.
See Figure 3-16.
7. Install the CPU/Memory board and detach the wrist strap.
See Section 3.4.2, “Installing a Board.”
8. As you reboot the system, watch for the system banner to verify that the
new memory is recognized by the system.
Notch alignment
Figure 3-15 Orienting a SIMM
CPU/Memory Boards and Components3-23
3
Figure 3-16 Installing a SIMM
3-24Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
I/OBoardsandComponents
To protect both yourself and the equipment, make sure you follow precautions
in Chapter 2, “Safety Precautions and Tools Requirements.”
Do not touch the heatsinks while installing or removing the board. Hold the
board only by the edges. If a heatsink is loose or broken, obtain a replacement
board.
Caution – When inserting the board into slot 4 or slot 10 of a 16-slot card cage,
lift the board slightly to avoid damage to the centerplane connectors.
Caution – The heatsinks on the board can be damaged by improper packaging.
When storing or shipping the board, ensure that the heatsinks have sufficient
protection.
3.2Filler Panels and Load Boards
All empty board slots in Enterprise systems must have either a filler panel or a
load board installed.
• Empty slots in Enterprise 5000 and 4000 systems must have a filler panel
installed.See Figure 3-1.
• Empty slots in Enterprise 6000 systems must have a load board installed.
See Figure 3-2.
Load boards and filler panels are inserted into a board slot with the
springfingers facing down if inserted in the front of the system; the
springfingers face up if inserted in the rear of the system.
Figure 3-2Load Board (Enterprise 6000 System Only)
3.3SCSI Termination
The I/O board in slot 1 controls the internal SCSI tray devices. Therefore, the
external SCSI connector on the I/O board in slot 1 of a system must be
terminated with a SCSI terminator. See Figure 3-3.
Enterprise systems have extensive error detection mechanisms, and an
Automatic System Reconfiguration (ASR) feature that enables the system to be
rebooted with failed components (such as CPUs, memory, or I/O) disabled.
When an error is detected, the system can be reconfigured so that the board
containing the failed components is placed in low power mode and is no
longer accessible.
Caution – The peripheral power supply provides the precharge voltages
required for hot-plug. Do not attempt hot-plug of a system component if the
power supply is missing or inoperative. Use prtdiag(1M) to determine the
status of the peripheral power supply.
Caution – If the message: NOTICE: Hot Plug not supported in this
system is displayed during boot, do NOT attempt hot-plug in this system or
damage to the hardware will occur.
The hot-plug feature enables you to insert a new board into a powered on
system, despite the system being “live,” or being supplied with electrical
power. When the hot-plug feature is used to add a board to a powered on
system, the system will not use the new board until the system is rebooted.
3.5I/O Boards
Enterprise systems support two types of I/O boards: SBus and Graphics. See
Figure 3-4 through Figure 3-7.
The SBus I/O board includes two SYSIO ASICs that provide two SBuses:
• One for two plug-in SBus cards and two fiber interfaces
• One for one plug-in SBus card and the on-board devices (10/100Mbyte TPE
and Single-ended Fast/Wide SCSI)
Note – SBus connector slots 1 and 2 on the SBus I/O board can accommodate a
double-wide SBus card.
I/O Boards and Components3-5
3
The Graphics I/O board includes one SYSIO ASIC that provides a single SBus
for two plug-in SBus cards, two fiber interfaces, and the on-board devices
(10/100Mbyte TPE and Single-ended Fast/Wide SCSI).
3.5.1 tpe-link-test? Variable
If the system cannot communicate with a network, the tpe-link-test?
settings for the on-board Ethernet ports may be incompatible with the setting
at the network hub. The tpe-link-test? variable is set separately for the onboard Ethernet port on each I/O board. The variable is also set for any SBus
Ethernet cards in the system.
If you have problems verifying connection between Sun equipment and your
hub, verify that your hub also has the link test function enabled.
See Section 8.5.3.2, “printenv Command,” for information about displaying
configuration variables and Section 8.6.1, “Failure of Network
Communications,” for additional tpe-link-test? information. Also, refer to
the manual provided with your hub.
3-10Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
3.5.2 Removing a Board
3.5.2.1 Removing a Board from a PoweredOnSystem
Caution – Remove a board from a powered on system only after the ASR
software has disabled the board. If a board has not been disabled by the ASR
software, then the operating system should be halted and the system powered
off prior to board removal. See Chapter 12, “Powering Off and On” and then
Section 3.5.2.2, “Removing a Board from a Nonpowered On System.”
1. Ensure that the board has been disabled by the ASR software. See
Section 3.4, “Hot-Plug Feature.”
Once disabled by ASR, one of two results occurs:
• The three LEDs on the board are not lit (board has no power).
• The outer two green LEDs are not lit and the middle yellow LED is lit
(board in low power mode).
Note – System software operates such that the LED pattern described is the
same for a board that is component side down (installed in front of card cage)
or component side up (installed in rear of card cage).
3
2. Unfasten any cable connectors from the front panel and set them aside.
Label cables to identify them for reconnection later.
3. Use a Phillips #1 screwdriver to mechanically release the board from the
system card cage.
Insert the screwdriver into each quarter-turn access slot (the slots are located
on the left and right sides of the board‘s front panel) and then turn a quarter
turn so that the arrow points to the unlocked position. See Figure 3-8.
I/O Boards and Components3-11
3
UnlockedLocked
Figure 3-8Unlocking and Locking Quarter-Turn Access Slots
4. Pull the ends of both extraction levers outward simultaneously to unseat
the board centerplane connector from the centerplane receptacles.
See Figure 3-9 for positioning of extraction levers.
3-12Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
SBus I/O board
3
Extraction levers in
extract/insert position
Graphics I/O board
Figure 3-9I/O Boards
I/O Boards and Components3-13
3
5. If a board is not immediately replaced, a load board (Enterprise 6000
systems only) or a filler panel (Enterprise 4000 and 5000 systems only)
must be installed in its place.
See Section 3.2, “Filler Panels and Load Boards.”
3.5.2.2 Removing a Board from a NonpoweredOnSystem
1. Use a Phillips #1 screwdriver to mechanically release the board from the
system card cage.
Insert the screwdriver into each quarter-turn access slot (the slots are located
on the left and right sides of the board front panel) and then turn a quarter
turn so that the arrow points to the unlocked position. See Figure 3-8.
2. Unfasten any cable connectors from the front panel and set them aside.
Label cables to identify them for reconnection later.
3. Pull the ends of both extraction levers outward simultaneously to unseat
the board from the centerplane receptacles.
See Figure 3-9 for positioning of extraction levers.
3.5.3 Installing a Board
3.5.3.1 Board Slot Selection
Note – Logically there is no difference between the board slots in the front or
rear of the card cage, and each slot can accept any board type. It is suggested
that CPU/Memory boards be installed in the front slots, and I/O and disk
boards be installed in the rear slots because of cabling. Should the need arise,
however, any of these three board types can be placed in any of the numbered
board slots, with the exception of slot 1. Slot 1 should be used by the first I/O
board because it is the only slot connected to the onboard SCSI devices.
The first CPU/Memory board is placed in slot 0, followed sequentially by all
remaining even numbered slots. If there are boards remaining, they can be
installed sequentially in odd numbered slots, if available, in the system rear
(with the exception of slot 1 as noted above). See Figure 3-10 and Figure 3-11.
3-14Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
For I/O boards being placed in the rear of the system, ensure that the
component side is up. If the boards are placed in the front of the system,
ensure that the component side is down. See Figure 3-12.
.
3
Slot #
10
12
14
Slot #
0
2
4
6
8
Front View
Rear View
1
3
5
7
9
11
13
15
Figure 3-10 Enterprise 6000 Board Locations
I/O Boards and Components3-15
3
Slot #
Slot #
0
2
4
6
PCM
Front View
Rear View
1
3
5
7
Figure 3-11 Enterprise 5000/4000 Board Locations
3.5.3.2 Cooling and Power Issues
There should be one power/cooling module (PCM) for every two boards to
adhere to cooling and power requirements. The PCMs must be installed
adjacent to populated board slots to ensure the fan in the PCM can cool the
respective boards.
3-16Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
Note – All empty board slots in Enterprise 4000 or 5000 systems must have a
filler panel installed to ensure proper cooling. All empty slots in Enterprise
6000 systems must have load boards installed.
3.5.3.3 PoweredorNonpoweredOn System
1. Carefully insert the board (component side down if in front; component
side up if in the rear) in the proper slot in the card cage, ensuring that the
board does not slip out of the left and right card guides.
See Figure 3-12
3
Board orientation for insertion
in the cabinet rear (component
side up)
Figure 3-12 Board Replacement
I/O Boards and Components3-17
Board orientation for insertion
in the cabinet front (component
side down)
3
2. Ensure that both extraction levers are in the insert position (arrow
pointing outward), and that the quarter-turn access slots are unlocked
(arrow indicates unlocked position) as you slide the board toward the
centerplane receptacles.
See Figure 3-8 and Figure 3-9. The board will not seat fully unless the levers
are in this starting position and the access slots are unlocked.
Caution – DO NOT FORCE any board into a slot; this can cause damage to the
!
board and system. The board should insert and seat smoothly. If it binds,
remove the board and inspect the card cage slot for any obvious obstructions.
Also inspect both the board and the centerplane for bent pins or other damage.
3. Push the board into the card cage, then simultaneously press both
extraction levers to seat the board on the centerplane.
Pushing both levers simultaneously avoids twisting the board and bending
the connector pins, and mates the board centerplane connector to the
matching receptacle on the centerplane. Do not press on board front panel to
seat it—doing so will damage the connector pins.
4. Mechanically lock the board to the system chassis by inserting a Phillips
#1 screwdriver into each quarter-turn access slot and then turning to the
locked position.
See Figure 3-8.
5. Replace or connect all necessary cables to the front of the board.
Note – The I/O board in slot 1 controls the internal SCSI tray devices.
Therefore, the external SCSI connector on the I/O board in slot 1 of a system
must be terminated with a SCSI terminator. See Figure 3-3.
6. Terminate the board SCSI connector if required, see above note.
7. Once the board has been installed, a message similar to the following will
be displayed on the monitor (if the system is powered on):
Example depicts screen output when a new I/O board has been hot-plugged
into slot 6 of an operating Enterprise system:
NOTICE: I/O Board Hotplugged into Slot 6
NOTICE: Board 6 is ready to remove
3-18Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
This screen output indicates that the board has been detected by the system
and is in the low power mode. Additionally, any subsequent prtdiag(1M)
output would include information for board slot 6. Again, note that the
system will not use the new board until the system is rebooted.
8. Reboot the system now or schedule a later time to reboot when system
disruption will be minimized.
3.5.4 SBus Cards
There are three SBus card locations on the SBus I/O board; the Graphics I/O
board has two. Figure 3-13 shows the SBus card locations for both types of
boards.
3
I/O Boards and Components3-19
3
SBus 1
SBus 2
SBus I/O board
SBus 0
SBus 2
SBus 0
Figure 3-13 I/O Board SBus Card Locations
3-20Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
Graphics I/O board
3.5.4.1 Plastic Standoffs
Plastic standoffs lock the SBus and graphics (UPA) cards to the I/O boards. See
Figure 3-14.
• To unlock a standoff, pull up the tip insert.
• To lock a standoff, first ensure that the module or card rests on the standoff
flange, then press down the tip insert.
3
Standoff
UnlockedLocked
Figure 3-14 Locking and Unlocking Standoffs
SBus/graphics (UPA) cards
Standoff
Tip insert
Flange
3.5.4.2 Removing an SBus Card
1. Use the procedures in Section 3.5.2, “Removing a Board,” to
remove the applicable I/O board.
2. Use Figure 3-13 to locate the card to be removed.
I/O Boards and Components3-21
3
3. Remove the two screws that secure the SBus card to the back panel.
Save the screws for installation of a replacement SBus card or a filler panel.
4. Unlock the SBus card by pulling up the tips of the two standoffs.
See Figure 3-14.
5. Hold the card by the edges near the connector and gently rock the card
back and forth to loosen it from the socket.
You may have to remove the SBus cards or the FFB card next to this card in
order to have enough room to hold onto the SBus card being removed.
Caution – The connector housing may break if the SBus card is tilted too far.
!
6. Lift the SBus card from the socket at an angle while guiding the face plate
out from the back panel opening.
See Figure 3-15.
Figure 3-15 Removing or Installing an SBus Card
3-22Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
7. Place the SBus card in an antistatic bag.
8. If the SBus card is not immediately replaced, install a filler panel (part
number 340-2305) on the I/O board back panel opening. To secure the
filler panel, use the screws that were removed in Step 3.
Caution – Be sure to install the filler panel right-side up. Installing it upside
!
down creates a gap at the top edge of the SBus slot opening that can impair
system cooling and FCC regulatory compliance.
9. Replace the I/O board. Use the procedures in Section 3.5.3, “Installing a
Board.”
3.5.4.3 PreparingtoInstall an SBus Card
Note – If the new SBus card does not have an adapter plate or the Link
Integrity Test feature, proceed to “Installing an SBus Card” on page 3-26.
1. Attach a wrist strap and take the SBus card out of the protective
packaging and place the SBus card on an antistatic mat.
3
2. Remove the adapter bracket from the SBus card rear panel.
See Figure 3-16. Remove the two screws securing the adapter to the card
rear panel (the adapter bracket and the screws are not needed for this
installation).
Remove adapter
Remove screws
Figure 3-16 SBus Card Rear Panel with Adapter
I/O Boards and Components3-23
3
3. Remove the black plastic card retainer shipped with the card.
See Figure 3-17. Spread the ends of the retainer apart to remove it from the
card (the retainer is not needed for this installation).
Card retainer
Figure 3-17 Card Retainer
Link Integrity Test
1. Ensure that the SBus card is on an antistatic mat.
2. For DSBE/S and FSBE/S cards: remove the two outer retaining screws (see
Figure 3-18), but do NOT remove the middle screw or the springfinger.
Use a #0 Phillips screwdriver and a 3/16 nut driver or socket wrench.
3. For DSBE/S and FSBE/S cards, configure jumper J0302 for Link Integrity
Test functionality. See Figure 3-18 (DSBE/S) or Figure 3-19 (FSBE/S).
a. Put the shunt over both pins to disable the Link Integrity Test. See
Figure 3-20 “Disabled.”
b. Put the shunt in one pin to enable the Link Integrity Test. See
Figure 3-20 “Enabled.”
Caution – If you choose to disable the test, it must be disabled both at the hub
!
3-24Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
and at the SBus card. In the event of “loss of carrier” or “not responding”
problems, check the status of the link enable on both the SBus card and the
hub.
Jumper J0302
3
Springfinger
Back panel
Figure 3-18 DSBE/S SBus Card
J0302
Figure 3-19 FSBE/S SBus Card
I/O Boards and Components3-25
Phillips screw
Jackscrews
3
2
Disabled
Figure 3-20 Disabling and Enabling the Link Integrity Test
1
3.5.4.4 Installing an SBus Card
1. Use the procedures in Section 3.5.2, “Removing a Board,” to
remove the applicable I/O board.
2. Use Figure 3-13 to locate the SBus connector for the card that is to be
installed.
3. If a filler panel covers the back panel SBus slot, remove the two screws
and detach the filler panel.
Retain the screws to attach the SBus card to the back panel, unless the card
has a wide connector, or set of connectors.
4. Unlock the tip insert of the two standoffs for the SBus slot.
See Figure 3-14.
5. Attach a wrist strap and take the SBus card out of the protective
packaging. Inspect the pins in the connector to make sure they are not
bent.
6. Hold the SBus card at an angle and guide the SBus card face plate under
the springfingers and against the rear face of the I/O board front panel.
See Figure 3-15 on page 3-22. The I/O connectors of the SBus card should be
visible through the opening in the back panel.
2
Enabled
1
7. Hold the card by the edges nearest the SBus connector and place the card
over the two standoffs.
8. Hold the SBus card by the edges near the connector and firmly but gently
press the card down until the connector is fully seated.
To align the connector and socket, push the card toward the I/O board back
panel.
3-26Ultra Enterprise6000/5000/4000 Systems Manual—November 1996
Caution – Do not rock the card onto the socket; the plastic connector housing
!
may break.
9. Press each corner of the SBus card to ensure that it rests on the collar of
the standoff.
10. Press down on the tip insert of each standoff to lock the card in place.
11. Replace and tighten the back panel screws to secure the SBus card to the
I/O board back panel.
12. Replace the I/O board using the procedures described in Section 3.5.3,
“Installing a Board.”
3.5.5 Graphics (UPA) Cards
The Graphics I/O board contains a single connector that accommodates
graphics (UPA) cards. See Figure 3-21.