The electronic (software) version of this document was developed at private expense; if acquired under an agreement with the USA government or any
contractor thereto, it is acquired as "commercial computer software" subject to the provisions of its applicable license agreement, as specified in (a) 48 CFR
12.212 of the FAR; or, if acquired for Department of Defense units, (b) 48 CFR 227-7202 of the DoD FAR Supplement; or sections succeeding thereto.
Contractor/manufacturer is Silicon Graphics, International, Inc., 46600 Landing Parkway, Freemont, CA 94538.
TRADEMARKS AND ATTRIBUTIONS
Silicon Graphics, SGI, the SGI logo, Rackable, and Supportfolio are trademarks or registered trademarks of Silicon Graphics International Corp. or its
subsidiaries in the United States and other countries.
Intel, Intel QuickPath Interconnect (QPI) and Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and
other countries.
Infiniband is a trademark of the InfiniBand Trade Association.
Linux is a registered trademark of Linus Torvalds.
Novell is a registered trademark of Novell Inc., in the United States and other countries.
PCIe and PCI-X are registered trademarks of PCI SIG.
Red Hat and Red Hat Enterprise LINUX are registered trademarks of Red Hat Inc.
TYAN is a registered trademark of MiTAC International Corporation.
UNIX is a registered trademark in the United States and other countries, licensed exclusively through X/Open Company, Ltd.
All other trademarks mentioned herein are the property of their respective owners.
Record of Revision
VersionDescription
001October 2012
Original publication
002September 2013
Added support for Intel
miscellaneous front matter changes.
®
Xeon® E5-2600 and E5-2600v2 Series processors plus
:
007-5843-002iii
Contents
Record of Revision . . . . . . . . . . . . . . . . . . . . . . . iii
About This Guide . . . . . . . . . . . . . . . . . . . . . . . ix
This guide provides an overview of the SGI® Rackable™ C1110-RP6 servers along with
instructions for system installation and general operation. The appendices include technical
specifications and safety practices.
This guide is written for owners, installers, system administrators, and users of C1110-RP6
servers. It is written with the assumption that the reader has a good working knowledge of
computers and computer systems.
007-5843-002ix
About This Guide
Related Publications
Depending on your choice of system components and operating system, the following SGI
documents may be relevant to your server:
•SGI Foundation Software release notes
•SGI Performance Suite release notes
•SGI InfiniteStorage series documentation
•Man pages
You can obtain SGI documentation, release notes, or man pages in the following ways:
•Refer to the SGI Technical Publications Library at http://docs.sgi.com. Various formats are
•Refer to the SGI Supportfolio™ webpage for release notes and other documents whose
Note: For information on your motherboard and related system components, see the
documentation provided by the manufacturer/supplier.
available. This library contains the most recent set of books and man pages.
access require a support contract. See “Product Support” on page xi.
x007-5843-002
Product Support
About This Guide
SGI provides a comprehensive product support and maintenance program for its products. SGI
also offers services to implement and integrate Linux applications in your environment.
•Refer to http://www.sgi.com/support/
•If you are in North America, contact the Technical Assistance Center at
+1 800 800 4SGI or contact your authorized service provider.
•If you are outside North America, contact the SGI subsidiary or authorized distributor in
your country.
Be sure to have the following information before you call Technical Support:
•Product serial number
•Product model name and number
•Applicable error messages
•Add-on boards or hardware
•Third-party hardware or software
•Operating system type and revision level
•Motherboard BIOS revision
Reader Comments
If you have comments about the technical accuracy, content, or organization of this document,
contact SGI. Be sure to include the title and document number of the manual with your comments.
(Online, the document number is located in the front matter of the manual. In printed manuals, the
document number is located at the bottom of each page.)
You can contact SGI in any of the following ways:
•Send e-mail to the following address: techpubs@sgi.com
•Contact your customer service representative and ask that an incident be filed in the SGI
incident tracking system:
http://www.sgi.com/support/supportcenters.html
SGI values your comments and will respond to them promptly.
007-5843-002xi
Chapter 1
1.Introduction and Overview
This chapter provides an overview of your server’s main features.
Operating precautions are provided in this chapter, followed by a general overview of the product.
Before operating your system, familiarize yourself with the safety information that follow s:
ESD and Safety Precautions
Caution: Observe all ESD precautions. Failure to do so can result in damage to the equipment.
W ear an approved grounding wrist strap when you handle any ESD-sensitive device to eliminate
possible ESD damage to equipment. Connect the wrist strap cord directly to earth ground.
Warning: Before operating or servicing any part of this product, read the safety
precautions.
Danger: Keep fingers and conductive tools away from high-voltage areas. Failure to
follow these precautions will result in serious injury or death. The high-voltage areas of the
system are indicated with high-voltage warning labels.
Caution: Power off the system only after the system software has been shut down in an orderly
!
007-5843-0021
manner. If you power off the system before you halt the operating system, data may be corrupted.
1: Introduction and Overview
System Overview
Warning: If a lithium battery is installed in your system as a soldered part, only qualified
SGI service personnel should replace this lithium battery. For a battery of another type,
replace it only with the same type or an equivalent type recommended by the battery
manufacturer, or an explosion could occur. Discard used batteries according to the
manufacturer’s instructions.
The SGI® Rackable™ C11 10-RP6 system is a compute-optimized server comprised of two main
subsystems: the 1U chassis and a serverboard (motherboard). Check with your sales or service
representative before loading any operating system on your server not provided by the SGI factory
or service organization.
Various hardware components may be included as part of your SGI Rackable C1110-RP6 system
configuration as listed below:
•Serverboard with:
–Two Intel
®
Xeon® E5-2600 or E5-2600v2 Series processors in LGA2011 sockets
–Intel C602 chipset and Quick Path Interconnect system bus support the processors
–Sixteen DDR3 memory DIMM slots
–T wo external Gen3 x16 PCIe slots (one full-height and one low-profile)
•Two disk drive configurations include:
–Four 3.5-inch hard disk drives plus DVD option drive
–Ten 2.5-inch hard disk drives (no DVD option available)
•Seven 4-cm counter-rotating cooling fans for the serverboard
•One 450 Watt auto-ranging power supply (with single power connector)
•Optional 650 Watt redundant auto-ranging power supply (with dual power connectors)
Note: The TYAN S7056 serverboard is the standard C1110-RP6 motherboard offering.
Other customized offerings may be available for specific system or clustering needs. Check
with your SGI sales or service representative for additional information.
2007-5843-002
Serverboard Features
System Overview
Figure 1-1Four-Drive C1110-RP6 System Chassis Front View Example
Figure 1-2Ten-Drive C1110-RP6 System Chassis Front View Example
The SGI Rackable C1110-RP6 system has a dual processor serverboard based on the Intel C602
chipset. The following subsections describe the main features of the serverboard. See Figure 1-3
on page 6 for a functional block diagram of the serverboard.
Processors
Each serverboard supports two Intel Xeon series processors. Each processor sits in an LGA2011
socket and is interconnected via Intel QPI link support, see the next subsection for more
information on the QPI bus. Four-core, six-core and eight-core processors are available.
The exact type of processors provided with your system depends on the specific configuration you
ordered. Check with your SGI sales or service representative for information on processor
upgrades.
Quick Path Interconnect (QPI)
Separate QPI link pairs connect the two processors in an 8.0-GT/s network on the serverboard.
Each QPI comprises two 20-lane point-to-point data links, one in each direction (full duplex), with
a separate clock pair in each direction, for a total of 42 signals. Each signal is a differential pair,
so the total number of pins is 84. The 20 data lanes are divided onto four “quadrants” of 5 lanes
each. The basic unit of transfer is the 80-bit “flit”, which is transferred in two clock cycles (four
007-5843-0023
1: Introduction and Overview
Memory
Serial ATA/SAS
20 bit transfers, two per clock.) The 80-bit “flit” has 8 bits for error detection, 8 bits for “link-layer
header” and 64 bits for “data”. QPI bandwidths are advertised by computing the transfer of 64 bits
(8 bytes) of data every two clock cycles in each direction
The SGI Rackable C1110-RP6 system has 16 DIMM slots that support registered ECC
DDR3-1600/1333/1066/800 SDRAM. Memory DIMMs of the same size and speed are highly
recommended for best overall system performance. A minimum of two DIMMs are required for
the server to be functional. For best memory performance, install DIMMs in multiples of eight.
See “Installing System DIMM Memory” in Chapter 4, for more details on installing memory.
A Serial ATA controller is integrated into the system serverboard to provide a SATA subsystem
with transfer rates up to 6 Gb/second. The optionally hot-swappable SATA drives are connected
to a backplane that provides power, bus termination and configuration settings. Optional SAS or
SAT A RAID 0, 1, 5, 6 and 10 are supported (RAID 5 and 6 require optional hardware). Note that
RAID functionality is required for hot-swap capability.
Note: Your operating system must support RAID functionality in order to use RAIDed drives.
The Intel C600 chipset provides BIOS-assisted software RAID only, not hardware RAID.
Hardware RAID support is available as an optional configuration.
Contact your SGI sales or service provider to order a specific RAID upgrade if your system was
not ordered with that option.
PCI Expansion Slots
The serverboard has two external PCI-Express Gen3 x16 slots.One slot is a low-profile form
factor, the other is a (half-length) full-height PCIe slot.
On-board Controllers/Ports
The rear-mounted I/O ports include one COM port, a VGA (monitor) port, two USB 2.0 ports, and
three Gigabit Ethernet ports (LAN3 is a shared IPMI port). A special serial port is included for
system management.
4007-5843-002
IPMI
Other Features
BMC Features
System Overview
The IPMI (Intelligent Platform Management Interface) is a hardware-level interface specification
that provides remote access, monitoring and administration for the SGI Rackable C1110-RP6
system. IPMI allows server administrators to view a server’s hardware status remotely , receive an
alarm automatically if a failure occurs, and power cycle a system that is non-responsive.
Other on-board features that promote system health include voltage monitors, auto-switching
voltage regulators, chassis and CPU overheat sensors, virus protection and BIOS rescue.
The baseboard management controller (BMC) has the following features:
•The platform management subsystem uses the BMC to communicate with buses, sensors,
system BIOS, and server management firmware via the Server Management Bus (SMBUS)
•Enables serial-over-LAN (SOL) functionality via serial port B only
•Supports serial-console redirection in BIOS
•The BMC LAN may be configured in BIOS or via ipmitool.
•The ipmitool command is used to communicate with the BMC via an SOL session or by
using the web-based BMC interface.
007-5843-0025
1: Introduction and Overview
Figure 1-3Functional Block Diagram of SGI Rackable C1110-RP6 System Server Board
PCIe Sub-system
The primary I/O bus for the serverboard is PCI Express.
6007-5843-002
Server Chassis Features
The following sections provide a general outline of the main features of the 1U system chassis.
Figure 1-4 shows an example of the rear panel features of the SGI Rackable C1110-RP6 system.
VGA Port
IPMI
LAN/LAN3
Server Chassis Features
Low-profile x16 PCIe Slot
Full-height x16 PCIe slot
System Power
Disk Drive Subsystem
USB
Ports
COM
Figure 1-4SGI Rackable C1110-RP6 System Rear Panel and I/O Ports
LAN2
LAN1
Port
UID LED
button
Power
Serial Port
HDD
activity
Your SGI Rackable C1110-RP6 system uses a single-cord high-efficiency 450-Watt cold-swap
power supply (shown on the left side of Figure 1-4). Optionally, a dual-cord 650-Watt redundant
power supply is available. Both types of supply are 80+ Gold rated.
The AC power supply cord(s) should always be removed from the system before servicing or
replacing the power supply.
The SGI Rackable C1110-RP6 system chassis includes four 3.5-inch drive bays or ten 2.5-inch
drive bays. These drives can be JBOD disks, or software RAID, or BIOS-assisted software RAID,
or optional hardware RAID disks. An optional SAS disk controller is also supported.
RAID support levels are as follows:
007-5843-0027
1: Introduction and Overview
Control Panel
•Hardware RAID 0, 1, 10, 5 and 6 (with optional SAS HBA or Megaraid card)
•BIOS-assisted softwa re RAID 0, 1 and 10 when configured as a standalone server
•Linux software RAID 0 and 1 when configured as a compute node
Note: A cluster head node will only support hardware RAID options.
The SGI Rackable C1110-RP6 system control panel provides a system m onitoring and control
interface. The main power button included on the control panel will boot-up or shut down the
system when pressed - it does not remove all power inputs to the system. Remove the power
cord(s) from the system power supply if you need to remove power completely. LEDs on the
control panel (from top to bottom) indicate HDD activity, system power status and system UID.
Figure 1-5SGI Rackable C110-RP6 Control Panel Example
Cooling System
The server chassis has an innovative cooling design that includes seven 4-cm counter-rotating
pulse width modulated (PWM) fans located in the middle section of the chassis. Additi onal
cooling fans are incorporated into each power supply module. All chassis and power supply fans
operate continuously while the system is on to efficiently cool the processors, memory and other
system components.
8007-5843-002
Chapter 2
2.System Operation
This chapter describes the basic steps needed to get your SGI Rackable C1 110-RP6 system up and
running. Following these steps in the order given should enable you to have the system operational
within a minimum amount of time.
Unpacking the System and Choosing an Operating Location
You should inspect the box the system was shipped in and note if it was damaged in any way. If
the server itself shows damage you should file a damage claim with the carrier who delivered it.
When you decide on a suitable location for the rack unit that will hold the system, it should be
situated in a clean, dust-free area that is well ventilated. Avoid areas where heat, electrical noise
and electromagnetic fields are generated. You will also need it placed near a grounded power
outlet. Be sure to read the Rack and Server Precautions in the next section.
Preparing for Setup
The box the system was shipped in should include two sets of rail assemblies, two rail mounting
brackets and the mounting screws you will need to install the system into the rack. Follow the steps
in the order given to complete the installation process in a minimum amount of time. Please read
this section in its entirety before you begin the installation procedure outlined in the sections that
follow.
Choosing a Setup Location
Leave enough clearance in front of the rack to enable you to open the front door completely;
approximately 25 inches (63.5 cm) should be sufficient.
Leave approximately 30 inches (76.2 cm) of clearance in the back of the rack to allow for
sufficient airflow and ease in servicing.
007-5843-0029
2: System Operation
Rack Precautions
This product is for installation only in a Restricted Access Location (dedicated equipment rooms,
service closets and the like).
This product is not suitable for use with visual display work place devices according to the
German Ordinance for Work with Visual Display Units.
The following guidelines help insure your rack systems proper operation:
•Ensure that the leveling jacks on the bottom of the rack are fully extended to the floor with
the full weight of the rack resting on them.
•In single rack installation, stabilizers should be attached to the rack.
•In multiple rack installations, the racks should be coupled together.
•Always make sure the rack is stable before extending a component from the rack.
•You should extend only one component at a time - extending two or more simultaneously
may cause the rack to become unstable.
•Always keep the rack's front door and all panels and components on the servers closed when
not servicing to maintain proper cooling.
Server Precautions
Review the electrical and general safety precautions in Chapter 1.
Determine the placement of each component in the rack before you install the rails.
Install the heaviest server components on the bottom of the rack first, and then work up.
For extra protection, use a regulating uninterruptible power supply (UPS) to protect the server
from power surges, voltage spikes and to keep your system operating in case of a power failure.
This is an optional device not provided by SGI with your system.
Allow the hot plug disk drives and power supply modules to cool before touching them. Always
keep the server closed when not servicing to maintain proper cooling.
Make sure all power and data cables are properly connected and not blocking the chassis airflow.
10007-5843-002
Rack Mounting Considerations
Use the guidelines in the following subsections to properly install, use and maintain a server in a
rack.
Ambient Operating Temperature
If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack
environment may be greater than the ambient temperature of the room. Therefore, consideration
should be given to installing the equipment in an environment compatible with the manufacturer’s
maximum rated ambient temperature (Tmra).
Reduced Airflow
Equipment should be mounted into a rack so that the amount of airflow required for safe operation
is not compromised.
Mechanical Loading
Equipment should be mounted into a rack so that a hazardous condition does not arise due to
uneven mechanical loading.
Unpacking the System and Choosing an Operating Location
Circuit Overloading
Consideration should be given to the connection of the equipment to the power supply circuitry
and the effect that any possible overloading of circuits might have on over-current protection and
power supply wiring. Appropriate consideration of equipment nameplate ratings should be used
when addressing this concern.
Reliable Ground
A reliable ground must be maintained at all times. To ensure this, the rack itself should be
grounded. Particular attention should be given to power supply connections other than the direct
connections to the branch circuit (i.e. the use of power strips, etc.).
007-5843-00211
2: System Operation
System Warnings and Precautions
!
!
!
!
!
Warning: The SGI Rackable C1110-RP6 server weighs up to ~30 lbs (~13.6 kg). Always
use proper lifting techniques when you move the server. Always get the assistance of another
qualified person when you install the sever in a location above your shoulders. Failure to do
so may result in serious personal injury or damage to the equipment.
Warning: Extend the leveling jacks on the bottom of the rack to the floor with the full
weight of the rack resting on them. Failure to do so can result in serious injury or death.
Warning: Attach stabilizers to the rack in single rack installations. Failure to do so can
result in serious injury or death. Couple racks together in multiple rack installations.
Failure to do so can result in serious injury or death.
Warning: Be s ure the rack is stable befor e extending a component fr om the rack. Failur e
to do so can result in serious injury or death.
Warning: Extend only one rack component at a time. Extending tw o or more component s
simultaneously may cause the rack to tip over and result in serious injury or death.
Slide/Rail Equipment Usage Caution
12007-5843-002
Installing the System into a Rack
This section provides information on installing the SGI Rackable C1110-RP6 system into a rack
unit with the rack rails provided. If the system has already been mounted into a rack, you can skip
ahead to the next section. There are a variety of rack units on the market, which may mean the
assembly procedure will differ slightly. You should also refer to the installation instructions that
came with the rack unit you are using.
Identifying the Sections of the Rack Rails
You should have received two rack rail assemblies in the rack mounting kit. Each assembly
consists of two sections: an inner fixed chassis rail that secures directly to the server chassis and
an outer fixed rack rail that secures directly to the rack itself (see Figure 2-1). Two pairs of short
brackets to be used on the front side of the outer rails are also included.
Installing the System into a Rack
Figure 2-1SGI Rackable C1110-RP6 System Rack Rails Example
007-5843-00213
2: System Operation
Installing the Inner Rails
Both the left and right side inner rails should have been pre-attached to the chassis as shown in the
example in Figure 2-2. Proceed to the next subsection for information on installing the outer rails
into a rack.
Figure 2-2Chassis Attachment to Inner Rack Rails Example
Installing the Outer Rails
Begin by measuring the distance from the front rail to the rear rail of the rack. Attach a short
bracket to the front side of the right outer rail and a long bracket to the rear side of the right outer
rail. Adjust both the short and long brackets to the proper distance so that the rail can fit snugly
into the rack.
Secure the short bracket to the front side of the outer rail with two M4 screws and the long bracket
to the rear side of the outer rail with three M4 screws. Repeat these steps for the left outer rail, see
Figure 2-3 on page 15 for an example.
14007-5843-002
Installing the System into a Rack
Figure 2-3Outer Rail Attachment to Rack Example
Locking Tabs
Both chassis rails have a locking tab, which serves two functions. The first is to lock the server
into place when installed and pushed fully into the rack, which is its normal position. Secondly,
these tabs also lock the server in place when fully extended from the rack. This prevents the server
from coming completely out of the rack when you pull it out for servicing.
007-5843-00215
2: System Operation
Installing the Server into the Rac k
Y ou should now have rails attached to both the chassis and the rack unit. The next step is to install
the server into the rack. Do this by lining up the rear of the chassis rails with the front of the rack
rails. Slide the chassis rails into the rack rails, keeping the pressure even on both sides (you may
have to depress the locking tabs when inserting the unit). See Figure 2-4 for an example. When
the server has been pushed completely into the rack, you should hear the locking tabs "click" into
place.
Figure 2-4Sliding the System into a Rack
16007-5843-002
Installing the Server into a Telco Rack
T o install the server into a T elc o type rack, use two L-shaped brackets on either side of the chassis
(four total). First, determine how far the server will extend out the front of the rack. Larger chassis
should be positioned to balance the weight between front and back. If a bezel is included on your
server, remove it. Then attach the two front brackets to each side of the chassis, then the two rear
brackets positioned with just enough space to accommodate the width of the rack. Finish by
sliding the chassis into the rack and tightening the brackets to the rack.
Server Access After Rack Installation
After you install the unit in the rack, you may need to open the top cover (see Figure 2-5 on
page 18) to access the serverboard or confirm that all components are properly installed and all
the connections have been made.
Grasp the two handles on either side and pull the system straight out until it locks (you should hear
a "click"). If you need to remove the server completely: disconnect all cables at the rear, depress
the locking rail-tabs on either side of the server and slide it completely off the outer rack rail
assembly. The server is heavy when fully loaded, use two people for this process if possible.
Installing the System into a Rack
007-5843-00217
2: System Operation
Figure 2-5Top View of Server
Remove/Replace the Chassis Top Covers
Use the following information to remove the chassis top cover over the serverboard:
1.Using a Phillips-head screwdriver, remove the two screws that secure the motherboard top
covers to the chassis.
2. Place your thumbs in the top-cover recess “button” and push the rear section of the top cover
away from you (toward the rear of the chassis) and lift it upward, see Figure 2-6 on page 19.
3. Lift the top cover from the chassis to gain full access to the serverboard, DIMMs, fans,
power supply and PCIe cards.
4. Reverse the process to reinstall the rear top cover section.
18007-5843-002
Installing the System into a Rack
Figure 2-6Server T op Covers Removal Example
Use the following steps to remove the (front) chassis top cover over the system drives:
1.Use your thumbs in the top-cover recess “button” to push the front section of the top cover
towards the front of the system and lift upward.
2. Lift the front cover section up and away from the server chassis to access the drive assembly
and backplane interconnects.
3. Reverse the process steps to reinstall the front section of the chassis top cover.
Important: Always replace both top covers when operating the server to ensure thermal
stability.
007-5843-00219
2: System Operation
Checking the Components and Setup Before Power On
If any internal modifications have been made to the server prior to installation in the rack, you may
wish to recheck the server’s interior.
You should have two processors already installed on the serverboard. Each processor needs its
own heatsink.
Your server comes with system memory already installed. Make sure all DIMMs are fully seated
in their slots. For details on adding system memory, see “Installing System DIMM Memory” on
page 27.
Make sure all power and data cables are properly connected and not blocking the chassis airflow.
Checking the Hard Disk Drives
The system disk drives are accessible from the front of the server and can be installed and removed
from the front of the chassis without removing the top chassis cover.
Depending upon your system's configuration, your system will have one or more drives already
installed.
Checking the Airflow
Airflow through the server is provided by an air shroud and seven 4-cm counter-rotating cooling
fans for the node board and other internal components of the chassis. The system component
layout was carefully designed to direct sufficient cooling airflow to the components that generate
the most heat. Each power supply has it’s own built-in cooling fan assembly.
Note that all power and data cables should be routed in such a way that they do not block the
airflow generated by the fans.
Providing Power
Plug the power cord(s) from the server power supply unit into a rack power distribution unit
(PDU) or high-quality power strip that offers protection from electrical noise and power surges.
20007-5843-002
Installing the System into a Rack
For higher availability it is recommended that you use an optional uninterruptible power supply
(UPS) with the server.
Note: The blue LED indicates unit identification (UID) when activated by an IPMI tool command
or using the button on the rear of the chassis.
See Chapter 3 for a complete overview of the front control panel LED and button functions.
Figure 2-7Server Front Control Panel Example
007-5843-00221
Chapter 3
3.System Interfaces Overview
This chapter provides an overview of the standard and optional interfaces available on your SGI
Rackable C11 10-RP6 system. The major components of the system are described and illustrated.
System Interface Overview
Figure 3-1 shows an example of the system rear interconnects. Each system can be configured
slightly differently in regards to PCIe options, drives and power supplies. Note that the example
shown uses the 650-Watt redundant power supply.
System Interface Overview
VGA Port
IPMI
LAN/LAN3
USB
Ports
COM
Port
UID LED
Low-profile x16 PCIe Slot
LAN2
LAN1
button
Full-height x16 PCIe slot
Serial Port
HDD
activity
Power
Figure 3-1Server Rear Connectors Example
007-5843-002 23
3: System Interfaces Overview
Control Panel Buttons
Control Panel LEDs
There are several LEDs on the front control panel as well as others on the disk drive carriers to
keep you constantly informed of the overall status of the system as well as the activity and health
of specific components. There is also a system power button on each control panel. This chapter
explains the meanings of all LED indicators and the appropriate response you may need to take.
There is only one push-button located on the front control panel of the C1110-RP6 server:
Power - This is the main power button, which is used to apply or turn off the main system power
supply. Pressing this button removes the main power but keeps standby power supplied to the
serverboard, see Figure 3 -2 on page 24.
The control panel located on the front of the server chassis has three LEDs. Each LED provides
you with critical information related to the serverboard. This section explains what each LED
indicates when illuminated and any corrective action you may need to take.
Figure 3-2Serverboard Control Panel Example
The ten-drive version of the server has its control panel on the left-front section of the chassis front
panel. The four-drive version of the server has the control panel in the upper right front area.
24007-5843-002
HDD
Power
Universal Information LED
System Interface Overview
Channel activity for the hard disk drive array. This light indicates disk drive activity on the server
when flashing.
The LED indicates power is being supplied to the system's power supply unit. This LED should
normally be illuminated when the system is operating.
This LED will light blue when used for Unit Identifier (UID), see Figure 3-2 on page 24.
This LED will remain flashing or on until manually deactivated via the rear button or software
command.
Note: Deactivating the UID (blue indicator) LED must be performed in the same way it was
activated. If the UID LED was activated via IPMI, you can only turn the LED off via IPMI and
not with the UID button on the rear of the system.
Disk Drive Carrier LEDs
Each disk drive carrier has two LEDs.
•Green: Each drive carrier has a green LED. When illuminated, this green LED (on the front
of the drive carrier) indicates drive activity . A connection to the drive backplane enables this
LED to blink on and off when that particular drive is being accessed. See Chapter 4 for
instructions on replacing hard disk drives.
007-5843-002 25
3: System Interfaces Overview
•Red: The red LED lights to indicate a disk drive failure. If one of the drives fails, you should
also be notified by your system management software. Please refer to Chapter 4 for
instructions on replacing failed internal disk drives.
26007-5843-002
Chapter 4
4.Internal Component Replacement and Upgrades
This chapter describes basic component replacement and upgrades for the SGI Rackable
C1110-RP6 system.
General Precautions
Care must be taken to assure that the chassis cover is in place when the server is operating to assure
proper cooling. Out of warranty damage to the system can occur if this practice is not strictly
followed.
Caution: Electrostatic Discharge (ESD) can damage electronic components. To prevent damage
to any printed circuit boards (PCBs), it is important to handle them very carefully. The following
measures are generally sufficient to protect your equipment from ESD discharge.
•Use a grounded wrist strap designed to prevent static discharge.
•Touch a grounded metal object before removing any board from its antistatic bag.
•Handle a board by its edges only; do not touch its components, peripheral chips, memory
modules or gold contacts.
•When handling chips or modules, avoid touching their pins.
Installing System DIMM Memory
Exercise extreme care when installing or removing DIMM modules to prevent electrostatic or any
other possible damage. Figure 4-1 on page 28 shows the CPU and DIMM locations.
The serverboard has sixteen 240-pin DIMM slots that can support up to 256 GB of registered ECC
DDR3-1600/1333/1066 SDRAM.
007-5843-00227
4: Internal Component Replacement and Upgrades
Each processor on the serverboard has a memory controller that supports four DDR3 memory
channels (two DIMMs per channel). For best memory performance, install DIMMs in multiples
of eight.
Figure 4-1Serverboard DIMM Slot Locations and Designations Example
28007-5843-002
Note: Check with your SGI sales or service representative for approved replacement or upgrade
DIMM memory modules.
Installing Memory DIMMs
Insert each memory DIMM vertically into a slot using the information and illustrations in this
section. Pay attention to the notch along the bottom of the DIMM to prevent inserting it
incorrectly.
To install a DIMM: Insert the DIMM vertically and gently press down until it snaps into place.
Pay attention to the alignment notch at the bottom.
Repeat for all DIMMs.
To remove a DIMM: Use your thumbs to gently push the release tabs near both ends of the
memory module. This should release it from the slot.
Installing System DIMM Memory
Figure 4-2DIMM Installation Example
Note the following operational points regarding DIMM usage in the C1110-RP6 server:
•Each processor supports four DDR3 memory channels.
•Each memory channel can support two maximum speed (1600 MT/s) DIMMs per channel.
•Mixing DIMMs with different speeds on a channel causes a default to the lowest speed.
•A 32 GB DIMM is the maximum approved DIMM capacity for the C1110-RP6.
007-5843-002 29
4: Internal Component Replacement and Upgrades
Adding PCIe Cards
The server includes two pre-installed riser cards designed specifically for use in the 1U rackmount
server chassis. One riser card supports a full-height half-depth PCI Express (PCIe) x16 card and
the other supports a low-profile x16 card inside the chassis.
A riser card has already been pre-installed into each serverboard.
Important: The PCIe cards cannot be “hot installed”.
Perform the following steps to add or replace a PCIe add-on card:
1.Power down the server.
2. Grasp the two handles on either side and pull the unit straight out of the rack until it locks
(you will hear a "click").
3. The top cover of the chassis is secured with two screws: remove them with a Phillips type
screwdriver, then place both thumbs in the indentation and push the cover back until it slides
off.
4. Lift the rear section of the top cover from the chassis to gain full access to the inside of the
server.
5. Remove the two PCIe carrier retention screws from the rear of the chassis.
6. Carefully unseat and remove the carrier and set it on a static-free surface.
7. Install the PCIe add-on (or replacement) card in the carrier.
8. Reinstall the PCIe carrier, replace the cover and return the server to operation.
30007-5843-002
System Fans
The main serverboard is cooled by a set of seven 4-cm high-performance PWM fans. Fan speed
is constant unless modified via a setting in BIOS. Each power supply also has its own dedicated
cooling fan (one or two depending on supply type).
System Fan Failure
Replace any failed fan at your earliest convenience with the same type and model (the system can
continue to run with a failed fan). Remove the top chassis cover while the system is still running
to determine which of the fans has failed. Power down the system before replacing a fan.
Removing the power cord is also recommended as a safety precaution.
Drive Bay Installation/Removal
Hard Disk Drives: Because of their hot-swap capability, you do not need to access the inside of
the chassis or power down the system to install or replace disk drives. Proceed to the next step for
instructions.
Disk Drive Removal and Installation
Note: The operating system you use must have RAID support to enable the optional hot-swap
capability of the SATA/SAS drives.
Use caution when working around the disk drive backplane. Do not touch the backplane with any
metal objects and make sure no cables touch the backplane. Also, regardless of how many drives
are installed, all drive carriers must remain in the chassis to maintain proper airflow.
Disk Drive Removal and Installation
The system disk drives are mounted in drive carriers to simplify their instal lat ion and removal
from the chassis. These carriers also help promote proper airflow for the system. For this reason,
even empty carriers without drives installed must remain in the chassis.
007-5843-002 31
4: Internal Component Replacement and Upgrades
Mounting a Drive in a Carrier
Check with your SGI sales or service representative to obtain new or replacement hard disk drives
for the server.
Install the drive into the carrier with the printed circuit board side facing down so that the
mounting holes align with those in the carrier.
Secure the drive to the carrier with the side screws, similar to the example in Figure 4-3.
Figure 4-3Drive Carrier Mounting Example
Installing/Removing Hot-swap Drives
To remove a carrier, push the release button located beside the drive LEDs.
Swing the handle fully out and use it to pull the disk assembly straight out of the chassis (see
Figure 4-4 on page 33).
32007-5843-002
Disk Drive Removal and Installation
Figure 4-4Server Disk Drive Remove Example
007-5843-002 33
4: Internal Component Replacement and Upgrades
Figure 4-5Replacing the Drive and Carrier Example
Power Supply
The SGI Rackable C1110-RP6 server power supply is installed at the rear of the system and is
“auto-ranging” (has the capability of operating at 100 - 240 inpu t volts). To shut down the system,
press the main power button on the front of the chassis and then unplug the AC power cord(s).
Note that there are two versions of power supply used with the server as follows:
•A 450-Watt “non-redundant” single-cord power supply
•A 650-Watt redundant dual-cord power supply assembl y
The LED located directly on the front of the power supply has three states:
•Dark - no AC power is available to the supply
•Yellow - AC power available to the supply but the server is not powered on
•Green - AC power is applied and the system is on (front panel power button pushed to On)
34007-5843-002
Power Supply Failure
If the power supply unit experiences a failure, the system will shut down if it is a 450-Watt
“non-redundant” supply and you will need to replace the power supply unit to return the
C1110-RP6 to operating status. Note that the 450-Watt unit has an On/Off rocker switch; make
sure the switch has not accidentally been turned off before replacing it.
If the power supply is 650-Watt redundant supply that experiences a failure - the server can
continue to operate until a replacement is available. Shutting down the server during replacement
of the “redundant” unit is optional.
Replacement power supply units can be obtained directly from your SGI sales or service
representative or third-party support provider.
If the power supply has failed, the LED located on the front of the power supply should be off
(unlit). Be sure the system power cord is fully plugged in to a power distribution unit that is turned
on before replacing the supply.
Removing the 650-Watt Redundant Power Supply
Power Supply
Use the following steps to remove a failed 650-Watt power supply from the system:
1.Unplug the AC power cord from the failed side of the redundant power supply system.
Caution: The power supply may be hot if the system has been running - make sure the supply
has at least 5 minutes to cool down.
2. Push the release tab on the front of the power supply inward. See Figure 4-6 on page 36.
3. Pull outward on the power supply handle and the unit should disengage from the internal
connector.
4. Extract the supply from the chassis by pulling it outward. Handle it with caution as the unit
may still be hot.
5. Follow the instructions in “Installing a New 650-Watt Redundant Power Supply” on
page 37.
007-5843-002 35
4: Internal Component Replacement and Upgrades
Figure 4-6650-Watt Redundant Power Supply Removal Example
Figure 4-7Individual 650-Watt Power Supply
36007-5843-002
Installing a New 650-Watt Redundant Power Supply
Use the following steps to replace a failed power supply in the server:
1.Replace the failed power supply with the exact same model from SGI or another approved
vendor, contact your SGI sales or service representative for more information.
2. Insert the new unit into the chassis and push it in until seated. This may require some
moderate force but you should hear an audible “click” as the power supply is seated.
3. Reconnect the AC power cord to the supply and press the power button on the front of the
chassis to resupply power to the system if you had shut down the server.
Power Supply
Figure 4-8650-Watt Redundant Power Supply Replacement Example
007-5843-002 37
4: Internal Component Replacement and Upgrades
Removing the 450-Watt Non-Redundant Power Supply
If the 450-Watt “non-redundant” power supply fails, you will need to replace it as soon as possible
to restore the server to operational status. See Figure 4-9 for an example view that also shows the
two rear screw locations on the supply.
Figure 4-9450-Watt (Non-redundant) Power Supply Example
Use the following steps to remove the failed supply:
1.Remove the rear cover portion from the server chassis; see “Remove/Replace the Chassis
Top Covers” on page 18 if you are unfamiliar with the procedure.
2. Verify the power cord is disconnected from the unit, then confirm that the supply is cool
enough to touch.
3. Reach in and undo the small, medium and large power connector cables on the outer side of
the power supply, see Figure 4-10 on page 39. Note their locations for re-installation
purposes.
4. Undo the two Phillips-head screws on the rear of the chassis that hold the 450-Watt supply
rear case in place (shown in Figure 4-9).
5. Undo the single bracket screw near the fan at the “front” of the supply, shown in
Figure 4 -10. Set all screws carefully aside for use during the re-installation process.
6. Lift the failed unit up and out of the server chassis. See the next subsection for installation of
a new power supply unit.
38007-5843-002
Power Supply
Figure 4-10Removing the 450-Watt Non-Redundant Power Supply
007-5843-002 39
4: Internal Component Replacement and Upgrades
Installing the 450-Watt Non-Redundant Power Supply
Use the following steps to install a new 450-Watt power supply into the server:
1.Position the new supply in the chassis so that the rear screw holes are aligned with the holes
in the rear sheetmetal and the front chassis retention bracket.
2. Use the three screws you removed in step 4 of the instructions “Removing the 450-Watt
Non-Redundant Power Supply” on page 38 to secure the unit inside the server. See
Figure 4-11.
3. Reconnect the small, medium and large power cable connectors to the outer side of the
power supply, see Figure 4-10 on page 39.
4. Attach the rear system power cord to the supply and ensure the rocker switch is set to the (|)
on position. The system fans should start up and pushing the power button on the front of the
chassis should boot the system.
5. Replace the top cover and secure it with the two top cover-retention screws. Slide the system
back into the rack as applicable.
Figure 4-11450-Watt Power Supply Replacement Example
40007-5843-002
Processors
I/O Chipset
Appendix A
A.System Specifications
This appendix contains technical specification information about your SGI Rackable C1110-RP6
system.
T wo Intel Xeon E5-2600 or E5-2600v2 Series processors
Intel C602 chipset series with IPMI 2.0 compliant BMC