IBM 71455RU, x3850 X5, x3950 X5, 7145, 7146 Installation And User Manual

IBM System x3850 X5 and x3950 X5 Types7145and7146
Installation and User’s Guide

IBM System x3850 X5 and x3950 X5 Types7145and7146
Installation and User’s Guide

Note: Before using this information and the product it supports, read the general information in Appendix B, “Notices,” on page 103, the IBM Safety Information and Environmental Notices and User Guide documents on the IBM Documentation CD, and the Warranty Information.
© Copyright IBM Corporation 2010.
US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
Contents
Safety ............................vii
Chapter 1. The System x3850 X5 and x3950 X5 server .........1
The IBM Documentation CD ....................2
Hardware and software requirements ................2
Using the Documentation Browser .................3
Related documentation ......................3
Notices and statements in this document ................5
Features and specifications.....................5
What your server offers ......................7
Reliability, availability, and serviceability ................9
IBM Systems Director ......................10
The UpdateXpress System Pack Installer (UXSPI) ............11
Server controls, LEDs, and power ..................11
Front view..........................11
Rear view ..........................15
Rear view LEDs .......................15
Server power features .....................17
IBM MAX5 for System x memory expansion module ...........18
MAX5 features and specifications .................19
What the MAX5 offers .....................21
MAX5 reliability, availability, and serviceability features .........22
MAX5 indicators, LEDs, and power ................22
Turning the MAX5 on and off...................24
Chapter 2. Installing optional devices................25
Server components .......................26
Memory-card DIMM connectors ..................27
Memory-card LEDs ......................27
SAS-backplane connectors ...................28
eXFlash backplane connectors ..................28
Microprocessor-board connectors .................29
Microprocessor-board LEDs ...................30
I/O-board connectors......................31
I/O-board jumpers .......................31
I/O-board LEDs........................32
Installation guidelines ......................32
A single-power-supply server operating at 208 V ac ..........34
System reliability guidelines ...................34
Working inside the server with the power on .............34
Handling static-sensitive devices .................35
Internal cable routing and connectors ................36
Removing the top cover .....................37
Removing the top-cover bracket ..................38
Installing the top-cover bracket ...................40
Removing the bezel .......................41
Installing a PCI Express adapter ..................41
Installing a ServeRAID adapter for use with eXFlash drives ........43
Installing a hot-swap power supply .................46
Installing a hot-swap hard disk drive .................47
Installing a DVD (optical) drive ...................49
Installing a 2.5-inch hard disk drive backplane .............49
Installing an eXFlash 1.8-inch drive cage and backplane .........52
© Copyright IBM Corp. 2010 iii
Installing a solid state drive ....................54
Installing a QPI wrap card .....................56
Installing an internal removable flash drive ...............57
Memory modules ........................58
Installing a memory card ....................63
Installing DIMMs .......................64
Installing a microprocessor ....................67
Completing the installation.....................71
Connecting the cables .....................71
Updating the server configuration .................72
Installing hardware devices in the MAX5 expansion module ........72
MAX5 components ......................72
Removing the MAX5 bezel ...................73
Removing the MAX5 system-board tray ...............74
Installing a MAX5 memory module.................75
Installing a MAX5 hot-swap power supply ..............79
Completing the MAX5 installation .................81
Chapter 3. Configuring the server .................85
Using the Setup utility ......................87
Starting the Setup utility ....................87
Setup utility menu choices....................87
Passwords .........................91
Using the Boot Selection Menu program ...............92
Starting the backup server firmware .................92
Using the ServerGuide Setup and Installation CD ............93
ServerGuide features .....................93
Setup and configuration overview .................94
Typical operating-system installation ................94
Installing your operating system without using ServerGuide .......94
Using the integrated management module ...............95
Using the embedded hypervisor ..................96
Obtaining the IP address for the Web interface access ..........97
Logging on to the Web interface ..................97
Using the remote presence and blue-screen capture features........98
Enabling the Broadcom Gigabit Ethernet Utility program ..........98
Configuring the Broadcom Gigabit Ethernet controller...........98
Configuring RAID arrays .....................99
IBM Advanced Settings Utility program ................99
Updating IBM Systems Director ..................100
Appendix A. Getting help and technical assistance ..........101
Before you call ........................101
Using the documentation.....................101
Getting help and information from the World Wide Web .........101
Software service and support ...................102
Hardware service and support ...................102
IBM Taiwan product service ....................102
Appendix B. Notices ......................103
Trademarks..........................103
Important notes ........................104
Particulate contamination.....................105
German Ordinance for Work gloss statement .............105
Documentation format ......................106
Electronic emission notices ....................106
iv IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Federal Communications Commission (FCC) statement ........106
Industry Canada Class A emission compliance statement ........106
Avis de conformité à la réglementation d'Industrie Canada .......106
Australia and New Zealand Class A statement ............107
European Union EMC Directive conformance statement ........107
Germany Class A statement ..................107
Japan VCCI Class A statement .................108
Japan Electronics and Information Technology Industries Association (JEITA)
statement ........................108
Korea Communications Commission (KCC) statement .........108
Russia Electromagnetic Interference (EMI) Class A statement ......109
People's Republic of China Class A electronic emission statement ....109
Taiwan Class A compliance statement ...............109
Index ............................111
Contents v
vi IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Safety
Before installing this product, read the Safety Information.
Antes de instalar este produto, leia as Informações de Segurança.
Pred instalací tohoto produktu si prectete prírucku bezpecnostních instrukcí.
Læs sikkerhedsforskrifterne, før du installerer dette produkt.
Lees voordat u dit product installeert eerst de veiligheidsvoorschriften.
Ennen kuin asennat tämän tuotteen, lue turvaohjeet kohdasta Safety Information.
Avant d'installer ce produit, lisez les consignes de sécurité.
Vor der Installation dieses Produkts die Sicherheitshinweise lesen.
Prima di installare questo prodotto, leggere le Informazioni sulla Sicurezza.
Les sikkerhetsinformasjonen (Safety Information) før du installerer dette produktet.
Antes de instalar este produto, leia as Informações sobre Segurança.
© Copyright IBM Corp. 2010 vii
Antes de instalar este producto, lea la información de seguridad.
Läs säkerhetsinformationen innan du installerar den här produkten.
Important:
Each caution and danger statement in this document is labeled with a number. This number is used to cross reference an English-language caution or danger statement with translated versions of the caution or danger statement in the Safety Information document.
For example, if a caution statement is labeled “Statement 1,” translations for that caution statement are in the Safety Information document under “Statement 1.”
Be sure to read all caution and danger statements in this document before you perform the procedures. Read any additional safety information that comes with the server or optional device before you install the device.
viii IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Statement 1:
DANGER
Electrical current from power, telephone, and communication cables is hazardous.
To avoid a shock hazard: v Do not connect or disconnect any cables or perform installation,
maintenance, or reconfiguration of this product during an electrical storm.
v Connect all power cords to a properly wired and grounded electrical
outlet.
v Connect to properly wired outlets any equipment that will be attached to
this product.
v When possible, use one hand only to connect or disconnect signal
cables.
v Never turn on any equipment when there is evidence of fire, water, or
structural damage.
v Disconnect the attached power cords, telecommunications systems,
networks, and modems before you open the device covers, unless instructed otherwise in the installation and configuration procedures.
v Connect and disconnect cables as described in the following table when
installing, moving, or opening covers on this product or attached devices.
To Connect: To Disconnect:
1. Turn everything OFF.
2. First, attach all cables to devices.
3. Attach signal cables to connectors.
4. Attach power cords to outlet.
5. Turn device ON.
1. Turn everything OFF.
2. First, remove power cords from outlet.
3. Remove signal cables from connectors.
4. Remove all cables from devices.
Safety ix
Statement 2:
CAUTION: When replacing the lithium battery, use only IBM Part Number 33F8354 or an equivalent type battery recommended by the manufacturer. If your system has a module containing a lithium battery, replace it only with the same module type made by the same manufacturer. The battery contains lithium and can explode if not properly used, handled, or disposed of.
Do not:
v Throw or immerse into water v Heat to more than 100°C (212°F) v Repair or disassemble
Dispose of the battery as required by local ordinances or regulations.
x IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Statement 3:
CAUTION: When laser products (such as CD-ROMs, DVD drives, fiber optic devices, or transmitters) are installed, note the following:
v Do not remove the covers. Removing the covers of the laser product could
result in exposure to hazardous laser radiation. There are no serviceable parts inside the device.
v Use of controls or adjustments or performance of procedures other than
those specified herein might result in hazardous radiation exposure.
DANGER
Some laser products contain an embedded Class 3A or Class 3B laser diode. Note the following.
Laser radiation when open. Do not stare into the beam, do not view directly with optical instruments, and avoid direct exposure to the beam.
Class 1 Laser Product Laser Klasse 1 Laser Klass 1 Luokan 1 Laserlaite Appareil A Laser de Classe 1
`
Safety xi
Statement 4:
18 kg (39.7 lb) 32 kg (70.5 lb) 55 kg (121.2 lb)
CAUTION: Use safe practices when lifting.
Statement 5:
CAUTION: The power control button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device. The device also might have more than one power cord. To remove all electrical current from the device, ensure that all power cords are disconnected from the power source.
2
1
xii IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Statement 8:
CAUTION: Never remove the cover on a power supply or any part that has the following label attached.
Hazardous voltage, current, and energy levels are present inside any component that has this label attached. There are no serviceable parts inside these components. If you suspect a problem with one of these parts, contact a service technician.
Statement 11:
CAUTION: The following label indicates sharp edges, corners, or joints nearby.
Statement 12:
CAUTION: The following label indicates a hot surface nearby.
Safety xiii
Statement 13:
DANGER
Overloading a branch circuit is potentially a fire hazard and a shock hazard under certain conditions. To avoid these hazards, ensure that your system electrical requirements do not exceed branch circuit protection requirements. Refer to the information that is provided with your device for electrical specifications.
Statement 15:
CAUTION: Make sure that the rack is secured properly to avoid tipping when the server unit is extended.
Statement 17:
CAUTION: The following label indicates moving parts nearby.
Statement 26:
CAUTION: Do not place any object on top of rack-mounted devices.
xiv IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Statement 37:
DANGER
When you populate a rack cabinet, adhere to the following guidelines:
v Always lower the leveling pads on the rack cabinet. v Always install the stabilizer brackets on the rack cabinet. v Always install the heaviest devices in the bottom of the rack cabinet. v Do not extend multiple devices from the rack cabinet simultaneously,
unless the rack-mounting instructions direct you to do so. Multiple devices extended into the service position can cause your rack cabinet to tip.
v If you are not using the IBM 9308 rack cabinet, securely anchor the rack
cabinet to ensure its stability.
Attention: This product is suitable for use on an IT power distribution system
whose maximum phase to phase voltage is 240 V under any distribution fault condition.
Safety xv
xvi IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Chapter 1. The System x3850 X5 and x3950 X5 server
This Installation and User's Guide contains instructions for setting up your IBM System x3850 X5 and x3950 X5 Types 7145 and 7146 server, installing optional devices, and for starting and configuring the server. This document also contains information and instructions for installing options in the optional IBM MAX5 for System x (MAX5) memory expansion module (see “IBM MAX5 for System x memory expansion module” on page 18 for more information about the optional MAX5). For diagnostic and troubleshooting information and instructions for removing and installing server components, see the Problem Determination and Service Guide that is on the IBM Documentation CD.
Important: The IBM MAX5 for System x is a Listed Accessory for use with the IBM System x3850 X5 and x3950 X5 only.
1
The IBM System x3850 X5 and x3950 X5 server is a 4U server. It can be upgraded to a symmetric multiprocessing (SMP) server through a microprocessor upgrade. It is ideally suited for networking environments that require superior microprocessor performance, efficient memory management, flexibility, and large amounts of reliable data storage.
Performance, ease of use, reliability, and expansion capabilities were key considerations in the design of the server. These design features make it possible for you to customize the system hardware to meet your needs today and provide flexible expansion capabilities for the future.
-high, high-performance
The server comes with a limited warranty. For information about the terms of the warranty and getting service and assistance, see the Warranty Information document that comes with the server.
The server contains IBM Enterprise X-Architecture technologies, which help increase performance, reliability, and availability. For more information, see “What your server offers” on page 7 and “Reliability, availability, and serviceability” on page
9.
®
You can obtain up-to-date information about the server and other IBM
server products at http://www.ibm.com/systems/x/. At http://www.ibm.com/support/ mysupport/, you can create a personalized support page by identifying IBM products that are of interest to you. From this personalized page, you can subscribe to weekly e-mail notifications about new technical documents, search for information and downloads, and access various administrative services.
If you participate in the IBM client reference program, you can share information about your use of technology, best practices, and innovative solutions; build a professional network; and gain visibility for your business. For more information about the IBM client reference program, see http://www.ibm.com/ibm/ clientreference/.
If firmware and documentation updates are available, you can download them from the IBM Web site. The server might have features that are not described in the documentation that comes with the server, and the documentation might be updated
1. Racks are measured in vertical increments of 4.45 cm (1.75 inches) each. Each increment is called a "U." A 1-U-high device is
1.75 inches tall.
© Copyright IBM Corp. 2010
1
occasionally to include information about those features, or technical updates might be available to provide additional information that is not included in the server documentation. To check for updates, complete the following steps.
Note: Changes are made periodically to the IBM Web site. Procedures for locating firmware and documentation might vary slightly from what is described in this document.
1. Go to http://www.ibm.com/systems/support/.
2. Under Product support, click System x.
3. Under Popular links, click Software and device drivers for firmware updates, or click Publications lookup for documentation updates.
Record information about the server in the following table.
Product name IBM System x3850 X5 or x3950 X5 Machine type 7145 or 7146 Model number _____________________________________________ Serial number _____________________________________________
The model number and serial number are on labels on the right side of the server and on the front, visible through the bezel, as shown in the following illustration.
ID labels
For a list of supported optional devices for the server, see http://www.ibm.com/ servers/eserver/serverproven/compat/us/.
The IBM Documentation CD
The IBM Documentation CD contains documentation for your server in Portable Document Format (PDF) and includes the IBM Documentation Browser to help you find information quickly.
Hardware and software requirements
The IBM Documentation CD requires the following minimum hardware and software:
2 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
v Microsoft®Windows®XP, Windows 2000, or Red Hat Linux v 100 MHz microprocessor v 32 MB of RAM
®
v Adobe
Acrobat Reader 3.0 (or later) or xpdf, which comes with Linux operating
systems
Using the Documentation Browser
Use the Documentation Browser to browse the contents of the CD, read brief descriptions of the documents, and view documents, using Adobe Acrobat Reader or xpdf. The Documentation Browser automatically detects the regional settings in your server and displays the documents in the language for that region (if available). If a document is not available in the language for that region, the English-language version is displayed.
Use one of the following procedures to start the Documentation Browser: v If Autostart is enabled, insert the CD into the CD or DVD drive. The
Documentation Browser starts automatically.
v If Autostart is disabled or is not enabled for all users, use one of the following
procedures: – If you are using a Windows operating system, insert the CD into the CD or
DVD drive and click Start --> Run.IntheOpen field, type
e:\win32.bat
®
where e is the drive letter of the CD or DVD drive, and click OK.
– If you are using Red Hat Linux, insert the CD into the CD or DVD drive; then,
run the following command from the /mnt/cdrom directory:
sh runlinux.sh
Select your server from the Product menu. The Available Topics list displays all the documents for your server. Some documents might be in folders. A plus sign (+) indicates each folder or document that has additional documents under it. Click the plus sign to display the additional documents.
When you select a document, a description of the document appears under Topic Description. To select more than one document, press and hold the Ctrl key while you select the documents. Click View Book to view the selected document or documents in Acrobat Reader or xpdf. If you selected more than one document, all the selected documents are opened in Acrobat Reader or xpdf.
To search all the documents, type a word or word string in the Search field and click Search. The documents in which the word or word string appears are listed in order of the most occurrences. Click a document to view it, and press Ctrl+F to use the Acrobat search function, or press Alt+F to use the xpdf search function within the document.
Click Help for detailed information about using the Documentation Browser.
Related documentation
This Installation and User’s Guide contains general information about the server, including how to set up, install supported optional devices, and how to configure the server. The following documentation also comes with the server:
v IBM Warranty Information
Chapter 1. The System x3850 X5 and x3950 X5 server 3
This printed document contains the warranty terms and a pointer to the IBM Statement of Limited Warranty on the IBM Web site.
v Safety Information
This document is in PDF on the IBM Documentation CD. It contains translated caution and danger statements. Each caution and danger statement that appears in the documentation has a number that you can use to locate the corresponding statement in your language in the Safety Information document.
v Problem Determination and Service Guide
This document is in PDF on the IBM Documentation CD. It contains information to help you solve problems yourself, and it contains information for service technicians.
v Rack Installation Instructions
This printed document contains detailed instructions for installing your server in a rack.
If you are adding an optional MAX5 or scaling to another server, see the rack installation instructions that comes with the cable option kit.
v Environmental Notices and User's Guide
This document is in PDF on the IBM Documentation CD. It contains translated environmental notices.
v IBM License Agreement for Machine Code
This document is in PDF on the IBM Documentation CD. It provides translated versions of the IBM License Agreement for Machine Code for your product.
v IBM MCP Linux License Information and Attributions
This document is in PDF on the IBM Documentation CD. It provides the open-source notices.
Depending on the server model, additional documentation might be included on the IBM Documentation CD.
The ToolsCenter for System x and BladeCenter is an online information center that contains information about tools for updating, managing, and deploying firmware, device drivers, and operating systems. The ToolsCenter for System x and BladeCenter is at http://publib.boulder.ibm.com/infocenter/toolsctr/v1r0/index.jsp.
The server might have features that are not described in the documentation that comes with the server. The documentation might be updated occasionally to include information about those features, or technical updates might be available to provide additional information that is not included in the server documentation. These updates are available from the IBM Web site. To check for updated documentation and technical updates, complete the following steps.
Note: Changes are made periodically to the IBM Web site. The actual procedure might vary slightly from what is described in this document.
1. Go to http://www.ibm.com/systems/support/.
2. Under IBM System support, click System x.
3. Under Popular links, click Publications lookup.
4. From the Product family menu, select System x3850 X5 and x3950 X5 and click Continue.
4 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Notices and statements in this document
The caution and danger statements in this document are also in the multilingual Safety Information document, which is on the IBM Documentation CD. Each statement is numbered for reference to the corresponding statement in your language in the Safety Information document.
The following notices and statements are used in this document:
v Note: These notices provide important tips, guidance, or advice. v Important: These notices provide information or advice that might help you avoid
inconvenient or problem situations.
v Attention: These notices indicate potential damage to programs, devices, or
data. An attention notice is placed just before the instruction or situation in which damage might occur.
v Caution: These statements indicate situations that can be potentially hazardous
to you. A caution statement is placed just before the description of a potentially hazardous procedure step or situation.
v Danger: These statements indicate situations that can be potentially lethal or
extremely hazardous to you. A danger statement is placed just before the description of a potentially lethal or extremely hazardous procedure step or situation.
Features and specifications
The following information is a summary of the features and specifications of the server. Depending on the server model, some features might not be available, or some specifications might not apply.
Notes:
1. Racks are marked in vertical increments of 4.45 cm (1.75 inches). Each increment is referred to as a unit, or “U.” A 1-U-high device is 4.45 cm (1.75 inches) tall.
2. Power consumption and heat output vary depending on the number and type of optional features that are installed and the power-management optional features that are in use.
3. The sound levels were measured in controlled acoustical environments according to the procedures specified by the American National Standards Institute (ANSI) S12.10 and ISO 7779 and are reported in accordance with ISO
9296. Actual sound-pressure levels in a given location might exceed the average values stated because of room reflections and other nearby noise sources. The declared sound-power levels indicate an upper limit, below which a large number of computers will operate.
Chapter 1. The System x3850 X5 and x3950 X5 server 5
Table 1. Features and specifications
Microprocessor:
®
v Intel
v 1066 MHz front-side bus (FSB) v Support for up to four microprocessors,
Note: Use the Setup utility to determine the type and speed of the microprocessors.
Memory:
v Type: Registered, ECC, PC3-10600
v Sizes: 1 GB and 2 GB (PC3-10600
v Minimum: 4 GB (two DIMMs per
v Maximum: 1 TB (eight memory cards,
v Connectors: Two-way interleaved, eight
Drives:
v Slim CD/DVD-ROM: SATA (optional) v Serial Attached SCSI (SAS) 2.5-inch
v Solid state 1.8-inch drives (optional)
Expansion bays:
v Eight SAS, 2.5-inch bays or sixteen solid
v One 12.7 mm removable-media drive
Expansion slots:
v Six non-hot-swap PCI Express x8 (three
v One non-hot-swap PCI Express x16
v Emulex 10 GbE Custom Adapter for IBM
Scalability and memory expansion:
v Eight-socket scalability option uses 4
v MAX5 memory expansion option uses
v Multi-node configurations require 4
Xeon®EX multi-core microprocessor with up to 24 MB last level cache.
– Four Quick Path Interconnect (QPI)
links per microprocessor at up to 6.4 GT/s (gigatransfers per second)
– Four Scalable Memory Interconnect
(SMI) links per microprocessor at up to 6.4 GT/s
double data rate (DDR) III, SDRAM
running at 1066 Mb/sec), 4 GB, 8 GB, and 16 GB (PC3-8500 running at 1066 Mb/sec) in pairs
memory card minimum)
each card containing 8 DIMM connectors for a total of 64 DIMMs)
dual inline memory module (DIMM) connectors per memory card
hard disk drives (optional)
state 1.8-inch bays
bay (CD/DVD drive optional)
full-length and three half-length) slots
(full-length) slot
System x in slot 7 (optional in some models)
QPI external cables
four QPI ports
microprocessors in each node
Upgradeable microcode:
System UEFI, FPGA, diagnostics, service processor, IMM, and SAS microcode
Power supply:
v Standard: One or two dual-rated power
supplies (depending on the model). – 1975 watts at 220 V ac input – 875 watts at 110 V ac input
v Hot-swappable and redundant at 220 V
ac, only with two power supplies
v If the server is operating at 110 V ac, a
second power supply must be installed.
Size:
v 4U v Height: 172.8 mm (6.81 in.) v Depth: 712.13 mm (28.04 in.) v Width: (without rack EIA brackets) 440
mm (17.32 in.)
v Width: (with rack EIA brackets) 482.6
mm (19 in.)
v Weight: approximately 49.90 kg (110
lb) when fully configured
Integrated functions:
v Integrated management module (IMM),
which provides service processor control and monitoring functions, video controller, and remote keyboard, video, mouse, and remote hard disk drive capabilities
v Light path diagnostics v Eight Universal Serial Bus (USB) ports
(2.0) – Four on rear of server – Two on front of server – Two internal
v Broadcom 5709 dual 10/100/1000 MB
Ethernet controller
v Matrox video
– 16 MB video memory – SVGA compatible
v Serial-attached SCSI (SAS) controller
with RAID capabilities
v Support for ServeRAID-BR10i
SAS/SATA and ServeRAID-M5015 SAS/SATA controllers
v Serial connector v QPI Expansion Ports
Acoustical noise emissions:
v Sound power, idle: 5.8 bel declared v Sound power, operating: 6.3 bel
declared
Airflow:
v Nominal airflow: 67 cubic feet per
minute (CFM)
v Typical airflow: 100 CFM v Maximum airflow: 241 CFM
Environment:
v Air temperature:
– Server on:
- 10°C to 35°C (50°F to 95°F); altitude: 0 to 914 m (3000 ft).
- 10°C to 32°C (50°F to 90°F); altitude: 914 to 2133 m (7000 ft).
– Server off: 10°C to 43°C (50.0°F to
109.4°F); maximum altitude: 2133 m
(6998.0 ft)
v Humidity:
– Server on: 8% to 80% – Server off: 8% to 80%
v Particulate contamination:
Attention: Airborne particulates and reactive gases acting alone or in combination with other environmental factors such as humidity or temperature might pose a risk to the server. For information about the limits for particulates and gases, see “Particulate contamination” on page 105.
Heat output:
Approximate heat output: v Minimum configuration: 648 Btu per hour
(190 watts)
v Typical configuration: 3753 Btu per hour
(1100 watts)
v Design maximum configuration:
– 5971 Btu per hour (1930 watts) at 110
Vac
– 6739 Btu per hour (2150 watts) at 220
Vac
Electrical input:
v Sine-wave input (50 - 60 Hz) required v Input voltage low range:
– Minimum: 100 V ac – Maximum: 127 V ac
v Input voltage high range:
– Minimum: 200 V ac – Maximum: 240 V ac
v Approximate input kilovolt-amperes (kVA):
– Minimum: 0.20 kVA – Typical: 1.12 kVA – Maximum: 1.95 kVA (110 V ac) – Maximum: 2.17 kVA (220 V ac)
6 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
What your server offers
The server uses the following features and technologies:
v UEFI-compliant server firmware
IBM System x including Unified Extensible Firmware Interface (UEFI) 2.1 compliance; Active Energy Manager technology; enhanced reliability, availability, and serviceability (RAS) capabilities; and basic input/output system (BIOS) compatibility support. UEFI replaces the BIOS and defines a standard interface between the operating system, platform firmware, and external devices. UEFI-compliant System x servers are capable of booting UEFI-compliant operating systems, BIOS-based operating systems, and BIOS-based adapters as well as UEFI-compliant adapters.
Note: The server does not support DOS. For more information about UEFI, go to http://www-947.ibm.com/systems/support/
supportsite.wss/docdisplay?lndocid=MIGR-5083207&brandind=5000008
v Integrated management module
The integrated management module (IMM) combines service processor functions, video controller, and remote presence and blue-screen capture features in a single chip. The IMM provides advanced service processor control, monitoring, and alerting function. If an environmental condition exceeds a threshold or if a system component fails, the IMM lights LEDs to help you diagnose the problem, records the error in the IMM event log, and alerts you to the problem. Optionally, the IMM also provides a virtual presence capability for remote server management capabilities. The IMM provides remote server management through industry-standard interfaces:
– Intelligent Platform Management Interface (IPMI) version 2.0 – Simple Network Management Protocol (SNMP) version 3 – Common Information Model (CIM) – Web browser (For more information, see “Using the integrated management
module” on page 95.)
v IBM Systems Director
IBM Systems Director is a platform-management foundation that streamlines the way you manage physical and virtual systems in a heterogeneous environment. By using industry standards, IBM Systems Director supports multiple operating systems and virtualization technologies for IBM and non-IBM x86 platforms. For more information, see the documentation on the IBM Systems Director DVD and “IBM Systems Director” on page 10.
v IBM Electronic Service Agent
IBM Electronic Service Agent is a software tool that monitors the server for hardware error events and automatically submits electronic service requests to IBM service and support. Also, it can collect and transmit system configuration information on a scheduled basis so that the information is available to you and your support representative. It uses minimal system resources, is available free of charge, and can be downloaded from the Web. For more information and to download Electronic Service Agent, go to http://www.ibm.com/support/electronic/.
v IBM X-Architecture
IBM X-Architecture technology combines proven, innovative IBM designs to make your x86-processor-based server powerful, scalable, and reliable. For more information, see http://www.ibm.com/servers/eserver/xseries/xarchitecture/ enterprise/index.html
®
Server Firmware (server firmware) offers several features,
®
technology
Chapter 1. The System x3850 X5 and x3950 X5 server 7
v Large system-memory capacity
The server supports up to 1 TB of system memory. The memory controller supports error correcting code (ECC) for up to 64 industry-standard PC3-10600, 240-pin, registered, double-data-rate (DDR) III, synchronous dynamic random access memory (SDRAM) dual inline memory modules (DIMMs). The optional 32-DIMM IBM MAX5 for System x memory expansion module is available for purchase and provides up to 512 GB of additional memory. For more information about the MAX5 expansion module, see “IBM MAX5 for System x memory expansion module” on page 18
v Memory ProteXion
The Memory ProteXion feature provides the equivalent of a hot-spare drive in a RAID array. It is based in the memory controller, and it enables the server to sense when a chip on a DIMM has failed and to route the data around the failed chip.
v IBM ServerGuide Setup and Installation CD
The ServerGuide Setup and Installation CD, which you can download from the Web, provides programs to help you set up the server and install a Windows operating system. The ServerGuide program detects installed optional hardware devices and provides the correct configuration programs and device drivers. For more information about the ServerGuide Setup and Installation CD, see “Using the ServerGuide Setup and Installation CD” on page 93.
v Integrated network support
The server comes with an integrated Broadcom 5709 dual Gigabit Ethernet controller, which supports connection to a 10 Mbps, 100 Mbps, or 1000 Mbps network. For more information, see “Configuring the Broadcom Gigabit Ethernet controller” on page 98.
v Integrated Trusted Platform Module (TPM)
This integrated security chip performs cryptographic functions and stores private and public secure keys. It provides the hardware support for the Trusted Computing Group (TCG) specification. You can download the software to support the TCG specification, when the software is available.
v Large data-storage capacity and hot-swap capability
The server supports up to eight 1-inch (26 mm) slim-high, 2.5-inch hot-swap hard disk drives that are connected to two SAS backplanes. With the hot-swap feature, you can add, remove, and replace hard disk drives without turning off the server. For more information, see “Installing a hot-swap hard disk drive” on page
47.
v Light path diagnostics
Light path diagnostics provides LEDs to help you diagnose problems. For more information, see the section about light path diagnostics in the Problem Determination and Service Guide.
v PCI Express 2.0 adapter capabilities
The server has six slots for PCI Express 2.0 x8 adapters and one slot for PCI Express x16 adapters. For more information, see “Installing a PCI Express adapter” on page 41.
v Active Energy Manager
The Active Energy Manager solution is an IBM Systems Director extension that measures and reports server power consumption as it occurs. This enables you to monitor power consumption in correlation to specific software applications programs and hardware configurations. You can obtain the measurement values through the systems-management interface and view them, using IBM Systems
8 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Director. For more information, see the documentation on the IBM Systems Director DVD, or see http://www.ibm.com/systems/management/director/ extensions/actengmgr.html.
v Dynamic System Analysis (DSA) Preboot diagnostic programs
The DSA Preboot diagnostic programs are stored in integrated USB memory and collect and analyze system information to aid in diagnosing server problems. The diagnostic programs collect the following information about the server: – Event logs for ServeRAID controllers and service processors – Hard disk drive health – Installed hardware – Light path diagnostics status – Network interfaces and settings – RAID controller configuration – Service processor status and configuration – System configuration – Vital product data, firmware, and UEFI configuration
For additional information about DSA, see the Problem Determination and Service Guide on the IBM Documentation CD.
v Redundant connection
The addition of an optional network interface card (NIC) provides a failover capability to a redundant Ethernet connection. If a problem occurs with the primary Ethernet connection, all Ethernet traffic that is associated with the primary connection is automatically switched to the redundant NIC. If the applicable device drivers are installed, this switching occurs without data loss and without user intervention.
v Redundant cooling and power capabilities
The redundant cooling of the fans in the server enables continued operation if one of the fans fails. The server supports up to two hot-swap power supplies, which provide redundant power for many server configurations.
v ServeRAID support
The server supports ServeRAID controllers to create redundant array of independent disks (RAID) configurations.
v Symmetric multiprocessing (SMP)
The server supports up to four multi-core Intel Xeon microprocessors. One or more multi-core microprocessors provides SMP capability.
Reliability, availability, and serviceability
Three important server design features are reliability, availability, and serviceability (RAS). The RAS features help to ensure the integrity of the data that is stored in the server, the availability of the server when you need it, and the ease with which you can diagnose and correct problems.
The server has the following RAS features: v Advanced memory features:
– Single-bit memory error detection – Single-bit memory error hardware correction – Multi single-bit memory error recovery and corrections – Uncorrectable error (UE) detection – Full array memory mirroring (FAMM) redundancy – Automatic failover recovery for UEs when FAMM is configured – Automated logical removal of failed DIMMs on reboots prior to replacement – Automatic address parity checking during writes and reads
Chapter 1. The System x3850 X5 and x3950 X5 server 9
v Automatic BIOS recovery (ABR) for UEFI v Automatic error retry and recovery v Automatic restart after a power failure v Availability of microcode and diagnostic levels v Integrated management module (service processor) v Built-in, menu-driven electrically erasable programmable ROM (EEPROM) based
setup, system configuration, and diagnostic programs
v Built-in monitoring for fan, power, temperature, voltage, and power-supply
redundancy
v Error codes and messages v Error correcting code (ECC) L2 cache and system memory v Fault-resistant startup v Hot-swap hard disk drives v IBM Systems Director workgroup-hardware-management tool v Information and light path diagnostics LED panels v Integrated management module v Service processor adapter for remote systems management v Parity checking on the SAS bus and PCI Express buses v Power managed and Advanced Configuration and Power Interface (ACPI)
compliant
v Power-on self-test (POST) v Predictive Failure Analysis (PFA) alerts v Redundant Ethernet capabilities (requires optional Ethernet adapter) with failover
support
v Redundant hot-swap capability
– Cooling fans with speed-sensing capability – Power supplies
v Remind button to temporarily flash the system-error LED v Remote system problem-determination support v ROM-based diagnostic programs v Standby voltage for systems-management features and monitoring v Startup (boot) from LAN using Preboot Execution Environment (PXE) protocol v System auto-configuring from the configuration menu v System error logging v Upgradeable microcode for POST, IMM, diagnostics, service processor, and
read-only memory (ROM) resident code, locally or over the LAN
v Vital product data (VPD) on microprocessors, system boards, power supplies,
and SAS (hot-swap-drive) backplane
v Wake on LAN capability
IBM Systems Director
IBM Systems Director is a platform-management foundation that streamlines the way you manage physical and virtual systems in a heterogeneous environment. By using industry standards, IBM Systems Director supports multiple operating systems and virtualization technologies in IBM and non-IBM x86 platforms.
Through a single user interface, IBM Systems Director provides consistent views for viewing managed systems, determining how these systems relate to one another, and identifying their statuses, helping to correlate technical resources with business needs. A set of common tasks that are included with IBM Systems Director provides many of the core capabilities that are required for basic management, which means instant out-of-the-box business value. These common tasks include discovery, inventory, configuration, system health, monitoring, updates, event notification, and automation for managed systems.
10 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
The IBM Systems Director Web and command-line interfaces provide a consistent interface that is focused on driving these common tasks and capabilities:
v Discovering, navigating, and visualizing systems on the network with the detailed
inventory and relationships to the other network resources
v Notifying users of problems that occur on systems and the ability to isolate the
sources of the problems
v Notifying users when systems need updates and distributing and installing
updates on a schedule
v Analyzing real-time data for systems and setting critical thresholds that notify the
administrator of emerging problems
v Configuring settings of a single system and creating a configuration plan that can
apply those setting to multiple systems
v Updating installed plug-ins to add new features and functions to the base
capabilities
v Managing the life cycles of virtual resources
For more information about IBM Systems Director, see the documentation on the IBM Systems Director DVD that comes with the server, the IBM Systems Director Information Center at http://publib.boulder.ibm.com/infocenter/director/v6r1x/ index.jsp?topic=/director_6.1/fqm0_main.html and the Systems Management Web page at http://www.ibm.com/systems/management/, which presents an overview of IBM Systems Management and IBM Systems Director.
The UpdateXpress System Pack Installer (UXSPI)
The UpdateXpress System Pack Installer detects supported and installed device drivers and firmware in the server and installs available updates. For additional information and to download the UpdateXpress System Pack Installer, go to the ToolsCenter for System x and BladeCenter at http://publib.boulder.ibm.com/ infocenter/toolsctr/v1r0/index.jsp and click UpdateXpress System Pack Installer.
Server controls, LEDs, and power
This section describes the controls, light-emitting diodes (LEDs), connectors on the front and rear of the server, and how to turn the server on and off.
Note: The illustrations in this document might differ slightly from your server.
Front view
The following illustration shows the controls, LEDs, and connectors on the front of the server. (See “Operator information panel” on page 12 for information about the operator information panel.) The DVD drive is optional in some models.
Chapter 1. The System x3850 X5 and x3950 X5 server 11
Electrostatic-discharge connector
DVD-eject button
DVD drive activity LED
USB connectors
Scalability LED
Operator information panel
Hard disk drive status LED
Hard disk drive activity LED
Electrostatic-discharge connector: Connect a electrostatic-discharge wrist strap to this connector when you work with static-sensitive devices.
DVD-eject button: Press this button to release a CD or DVD from the DVD drive.
DVD drive activity LED: When this LED is lit, it indicates that the DVD drive is in
use.
USB 1 and 2 connectors: Connect USB devices to these connectors.
Scalability LED: This LED is lit and remains on during POST on the primary server
when the UEFI and the IMM detect more than four microprocessors. This LED is lit and remains on after POST on the secondary server.
Hard disk drive activity LED: When this LED is flashing, it indicates that the drive is in use.
Hard disk drive status LED: On some server models, each hot-swap hard disk drive has a status LED. When this LED is lit, it indicates that the drive has failed. If an optional IBM ServeRAID controller is installed in the server, when this LED is flashing slowly (one flash per second), it indicates that the drive is being rebuilt. When the LED is flashing rapidly (three flashes per second), it indicates that the controller is identifying the drive.
Operator information panel
The following illustration shows the controls and LEDs on the operator information panel.
Power-control button cover
The following controls and LEDs are on the operator information panel: v Power-control button and power-on LED: Press this button to turn the server
on and off manually or to wake the server from a reduced-power state. The states of the power-on LED are as follows:
12 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Power-control button/power-on LED
Ethernet icon LED
1
Ethernet port activity LEDs
2
Information LED
System-error LED
Locator button/locator LED
Off: AC power is not present, or the power supply or the LED itself has failed. Flashing rapidly (4 times per second): The server is turned off and is not
ready to be turned on. The power-control button is disabled. In a fully configured server, it could take up to 8 minutes after the server is connected to ac power, before the power-control button becomes active.
Flashing slowly (once per second): The server is turned off and is ready to be turned on. You can press the power-control button to turn on the server.
Lit: The server is turned on. Fading on and off: The server is in a reduced-power state. To wake the
server, press the power-control button or use the IMM Web interface. For information about logging on to the IMM Web interface, see “Logging on to the Web interface” on page 97.
v Ethernet icon LED: This LED lights the Ethernet icon. v Information LED: When this LED is lit, it indicates that a noncritical event has
occurred. An LED on the light path diagnostics panel is also lit to help isolate the error.
v System-error LED: When this LED is lit, it indicates that a system error has
occurred. An LED on the light path diagnostics panel is also lit to help isolate the error.
v Locator button and locator LED: Use this LED to visually locate the server
among other servers. It is also used as the physical presence for trusted Platform Module (TPM). Press this button to turn on or turn off this LED locally. You can use IBM Systems Director to light this LED remotely.
In a two-node configuration, this LED is lit on the primary server and flashes on the secondary server during POST.
You can press this button or use an IPMI command to turn this LED on or off.
v Ethernet port activity LEDs: When either of these LEDs is lit, it indicates that
the server is transmitting to or receiving signals from the Ethernet LAN that is connected to the Ethernet port that corresponds to that LED.
Light path diagnostics panel
The light path diagnostics panel is on the top of the operator information panel.
To access the light path diagnostics panel, slide the blue release button on the operator information panel to the left. Pull forward on the operator information panel until the hinge of the panel is free of the server chassis. Then pull down on the operator information panel, so that you can view the light path diagnostics panel information.
Chapter 1. The System x3850 X5 and x3950 X5 server 13
Operator information panel
Light path diagnostics LEDs
Release latch
The following illustration shows the controls and LEDs on the light path diagnostics panel.
Notes:
1. Do not run the server for an extended period of time while the light path diagnostics panel is pulled out of the server.
2. Light path diagnostics LEDs remain lit only while the server is connected to power.
Remind button
NMI button
Check point code display
OVER SPEC
CNFG
LOG
FAN
CPU
LINK
TEMP
VRM
MEM
DASD
PCIPS SP
NMI
RAID
REMIND
BRD
Light Path Diagnostics
Reset button
v Remind button: This button places the system-error LED on the front panel into
Remind mode. In Remind mode, the system-error LED flashes once every 2 seconds until the problem is corrected, the server is restarted, or a new problem occurs.
By placing the system-error LED indicator in Remind mode, you acknowledge that you are aware of the last failure but will not take immediate action to correct the problem. The remind function is controlled by the IMM.
v NMI button: Press this button to force a nonmaskable interrupt to the
microprocessor, if you are directed to do so by IBM service.
v Reset button: Press this button to reset the server and run the power-on
self-test (POST). You might have to use a pen or the end of a straightened paper clip to press the button. The reset button is in the lower-right corner of the light path diagnostics panel.
For more information about light path diagnostics, see the Problem Determination and Service Guide on the IBM Documentation CD.
14 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Rear view
The following illustration shows the connectors on the rear of the server.
System management Ethernet
AC
DC
!
System serial
Video USB
AC
DC
!
QPI ports 3 - 4
QPI ports 1 - 2
Power connector
Gigabit Ethernet 1 - 2
Power-cord connector: Connect the power cord to this connector.
System-management connector: Use this connector to connect the server to a
network for systems-management information control. This connector is used only by the IMM.
USB connectors: Connect USB devices, such as a USB mouse or keyboard, to these connectors.
Video connector: Connect a monitor to this connector. In a two-node configuration, connect the monitor to the primary server to see standard system output.
Rear view LEDs
Serial connector: Connect a 9-pin serial device to this connector. The serial port is
shared with the integrated management module (IMM). The IMM can take control of the shared serial port to perform text console redirection and to redirect serial traffic, using Serial over LAN (SOL).
QPI ports1-4:In a single-node configuration, use these connectors to insert either a QPI wrap card or a filler panel. The QPI wrap cards enable increased performance in certain models. In a two-node configuration, insert the QPI cables in these ports to connect another server or a MAX5 memory expansion module to your server. See the documentation that came with your QPI cable kit for detailed cabling instructions.
Gigabit Ethernet 1 and 2 connectors: Use these connectors to connect the server to a network.
The following illustration shows the LEDs on the rear of the server. For more information about solving power-supply problems, see the Problem Determination and Service Guide.
Chapter 1. The System x3850 X5 and x3950 X5 server 15
AC power LED: Each hot-swap power supply has an ac power LED and a dc power LED. When the ac power LED is lit, it indicates that sufficient power is coming into the power supply through the power cord. During typical operation, both the ac and dc power LEDs are lit. For any other combination of LEDs, see the Problem Determination and Service Guide.
DC power LED: Each hot-swap power supply has a dc power LED and an ac power LED. When the dc power LED is lit, it indicates that the power supply is supplying sufficient dc power to the system. During typical operation, both the ac and dc power LEDs are lit. For any other combination of LEDs, see the Problem Determination and Service Guide.
Error LED: When the power-supply error LED is lit, it indicates that the power supply has failed. See the Problem Determination and Service Guide for detailed information about power-supply errors.
QPI link LEDs1-4:When the QuickPath Interconnect (QPI) link LEDs are lit, they indicate that the QPI links are fully established.
Power-on LED: See “Operator information panel” on page 12 for the various states of the power-on LED.
System-error LED: When this LED is lit, it indicates that a system error has occurred. An LED on the light path diagnostics panel is also lit to help isolate the error.
16 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Locator LED: Use this LED to visually locate the server among other servers. You can use IBM Systems Director to light this LED remotely.
In a two-node configuration, this LED is lit on the primary server and flashes on the secondary server during POST.
You can press this button or use an IPMI command to turn this LED on or off.
Server power features
When the server is connected to an ac power source but is not turned on, the operating system does not run, and all core logic except for the integrated management module (IMM) is shut down; however, the server can respond to requests from the IMM, such as a remote request to turn on the server. The power-on LED flashes to indicate that the server is connected to ac power but not turned on.
In a two-node configuration, connect both servers to an ac power source as close to the same time as possible to ensure optimum operation.
Turning on the server
Approximately 5 minutes, or up to 8 minutes in a 2-node configuration, after the server is connected to ac power, the power-control button becomes active, and one or more fans might start running to provide cooling while the server is connected to power. You can turn on the server and all nodes in the partition and start the operating system by pressing the power-control button.
If you are restarting a two-node server after it has been turned off, you must allow extra time for the hardware to synchronize before you turn on the server again.
The server can also be turned on in any of the following ways: v If a power failure occurs while the server is turned on, the server will restart
automatically when power is restored.
v The systems-management software can turn on the server remotely. v If your operating system supports the Wake on LAN feature, the Wake on LAN
feature can turn on the server.
Note: Some memory is reserved for various system resources and is unavailable to the operating system. The amount of memory that is reserved for system resources depends on the operating system, the configuration of the server, and the configured PCI options.
Turning off the server
When you turn off the server and leave it connected to ac power, the server can respond to requests from the IMM, such as a remote request to turn on the server. While the server remains connected to ac power, one or more fans might continue to run. To remove all power from the server, you must disconnect it from the power source.
Important: To view the error LEDs on the system board, leave the server connected to a power source.
Some operating systems require an orderly shutdown before you turn off the server. See your operating-system documentation for information about shutting down the operating system.
Chapter 1. The System x3850 X5 and x3950 X5 server 17
Statement 5:
CAUTION: The power control button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device. The device also might have more than one power cord. To remove all electrical current from the device, ensure that all power cords are disconnected from the power source.
2
1
The server can be turned off in any of the following ways: v You can turn off the server from the operating system, if your operating system
supports this feature. After an orderly shutdown of the operating system, the server will be turned off automatically.
v You can press the power-control button to start an orderly shutdown of the
operating system and turn off the server, if your operating system supports this feature.
v If the operating system stops functioning, you can press and hold the
power-control button for more than 4 seconds to turn off the server.
v If the Wake on LAN feature turned on the server, the Wake on LAN feature can
turn off the server.
v The IMM can turn off the server as an automatic response to a critical system
failure.
v You can turn off the server through a request from the IMM.
IBM MAX5 for System x memory expansion module
If you purchased an optional IBM MAX5 for System x (MAX5) memory expansion module, it supports up to 32 DDR3 DIMMs, two 675-watt power supplies, and five 40 mm hot-swap speed-controlled fans. It provides added memory and multi-node scaling support for host servers. The MAX5 expansion module is based on eX5, the next generation of Enterprise X-Architecture. The MAX5 expansion module is designed for performance, expandability, and scalability; the fans and power supplies use hot-swap technology for easy replacement without requiring that the expansion module be turned off.
If you are adding an optional MAX5 or scaling to another server, see the rack installation instructions that comes with the cable option kit.
The following illustration shows the MAX5 memory expansion module. The illustrations in this document might differ slightly from your hardware.
18 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
See http://www.ibm.com/servers/eserver/serverproven/compat/us/ for a list of supported optional devices for the MAX5 memory expansion module.
For information about the terms of the warranty for the MAX5 expansion module, see the documentation that comes with the expansion module.
Before you start the host server to power on the MAX5, make sure that the server has the latest level of code or firmware installed. To obtain the latest code or firmware and update instructions, go to http://www.ibm.com/systems/support/. In addition, check the IBM Web site to make sure that you have the latest version of the documentation for your server. To check for updates, complete the following steps.
Note: Changes are made periodically to the IBM Web site. Procedures for locating firmware and documentation might vary slightly from what is described in this document.
1. Go to http://www.ibm.com/systems/support/.
2. Under Product support, click System x.
3. Under Popular links, click Software and device drivers for firmware updates, or click Publications lookup for documentation updates.
MAX5 features and specifications
The following table contains a summary of the features and specifications of the MAX5 memory expansion module.
Chapter 1. The System x3850 X5 and x3950 X5 server 19
Table 2. MAX5 expansion module features and operating specifications
v Intel memory controller with eight
memory ports (four DIMMs on each port)
v Xcellerated Memory Technology v EXA5 chip set v QuickPath Interconnect (QPI)
architecture technology: – Four 6.4 Giga Transfers (GT)
per second QuickPath Interconnect links (for up to 2 microprocessors)
– Three 10.0 GT per second
EXA5 scalability links
v Scalability:
– Connects to the x3850 X5 and
x3950 X5 (4U) rack servers using QPI cables
– Connects to other MAX5
expansion modules, using EXA5 link cables
– Scales up to 2 nodes (two
MAX5 expansion modules + two servers)
DIMMs:
v Minimum: 2 DIMMs, 4 GB v Maximum: 32 DIMM connectors
(up to 512 GB of memory, depending on the DIMM size)
v Type of DIMMs: PC3-10600R-999,
1067 MHz, ECC, DDR3 registered SDRAM dual inline memory modules (DIMMs)
v Supports 2 GB, 4 GB, 8 GB, and
16 GB DIMMs
Fans:
v Five hot-swap 40 mm fans
Power supply:
v One 675-watt (110 - 220 V ac
auto-sensing) standard
v Supports up to two 675-watt (110 -
220 V ac auto-sensing) hot-swap power supplies with built-in fans for redundancy support
Light path diagnostics LEDs:
v Board LED v Configuration LED v Fan LEDs v Link LED (for QPI and EXA5 links) v Locate LED v Memory LEDs v Power-on LED v Power supply LEDs
20 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Table 2. MAX5 expansion module features and operating specifications (continued)
Acoustical noise emissions:
For maximum system configurations (32 DIMMs installed)
v Sound power (idling): 6.2 bels v Sound power (operating): 6.2 bels v Sound pressure (idling): 48 dBA v Sound pressure (operating): 48
dBA
Size:
v Height: 4.4 cm (1.73 in.) v Depth: 72.4 cm (28.5 in.) v Width: 48.3 cm (19.0 in.) v Weight: approximately 12.8 kg
(28.2 lb) for a standard unit; when fully configured, 15.4 kg (33.9 lb)
Environment:
v Air temperature:
– Enclosure on: 10° to 35°C (50°
to 95°F); altitude: 0 to 914.4 m (3000 ft). Decreased system temperature by 0.75° for every 1000 ft. increase in altitude.
– Enclosure off: 5° to 45°C (41° to
113`°F)
– Shipment: -40°C to +60°C
(-40°F to 140°F
v Humidity:
– Enclosure on: 20% to 80%;
maximum dew point: 21°C (70°F)
– Enclosure off: 8% to 80%;
maximum dew point: 27°C (80°F)
– Shipment: 5% to 100%
v Particulate contamination:
Attention: Airborne particulates and reactive gases acting alone or in combination with other environmental factors such as humidity or temperature might pose a risk to the server. For information about the limits for particulates and gases, see “Particulate contamination” on page 105.
Heat output
Approximate heat:
v Minimum configuration: 314 Btu
v Maximum configuration 2048 Btu
Electrical input:
v Sine-wave input (50 - 60 Hz)
v Input voltage low range:
v Input voltage high range:
v Approximate input kilovolt-amperes
Notes:
1. Power consumption and heat
2. These levels were measured in
per hour (92 watts)
per hour (600 watts)
required
– Minimum: 90 V ac – Maximum: 136 V ac
– Minimum: 198 V ac – Maximum: 264 V ac
(kVA): – Minimum: 0.1 kVA – Maximum: 0.6 kVA
output vary depending on the number and type of optional features that are installed and the power-management optional features that are in use.
controlled acoustical environments according to the procedures specified by the American National Standards Institute (ANSI) S12.10 and ISO 7779 and are reported in accordance with ISO 9296. Actual sound-pressure levels in a given location might exceed the average stated values because of room reflections and other nearby noise sources. The declared sound-power levels indicate an upper limit, below which a large number of computers will operate.
What the MAX5 offers
The IBM MAX5 for System x (MAX5) memory expansion module provides several features for easy operation, including the following features:
v Customer replaceable units (CRUs)
The major CRUs in the MAX5 expansion module are memory modules, fans, and power supplies. See “MAX5 components” on page 72 for the supported MAX5 components.
v Light path diagnostics LEDs
The MAX5 expansion module has light path LEDs (front and rear) to indicate hardware, scaling, and power problems.
Chapter 1. The System x3850 X5 and x3950 X5 server 21
v Redundant cooling and power capabilities
The MAX5 expansion module supports a maximum of two 675-watt hot-swap power supplies and five single-motor hot-swap fans, which provides redundancy and hot-swap capability. The redundant cooling by the fans enables continued operation if one fan fails. The MAX5 comes with one 675-watt hot-swap power supply and five fans. If a problem occurs with one of the power supplies, the other power supply can meet the power requirements.
v Large memory capacity
The memory bus supports up to 512 GB of memory. The memory controller supports error correcting code (ECC) for up to 32 industry-standard 1066 MHz PC3-10600R-999 or 1333 MHz PC3-8500, DDR3 (third-generation double-data-rate), registered, synchronous dynamic random access memory (SDRAM) dual inline memory modules (DIMMs).
MAX5 reliability, availability, and serviceability features
Three of the most important features in product design are reliability, availability, and serviceability (RAS). These factors help to ensure that the integrity of the data processed in your MAX5 memory expansion module is preserved, that the expansion module is available when you want to use it, and should a failure occur, you can easily diagnose and repair the failure with minimal inconvenience.
The following is an abbreviated list of the RAS features that the expansion module supports:
v 1-year parts and 1-year labor limited warranty or it assumes the warranty of the
x3850 X5 or x3950 X5 server when attached, whichever is longer.
v Chipkill memory protection v Hot-swap and redundant cooling with fan-speed-sensing capability (front
serviceability)
v Hot-swap and redundant power supplies (rear serviceability) v Information LED panel v In-rack serviceability v Memory redundant bit steering (RBS) and error correcting code (ECC) v Memory mirroring support (mirrored DIMMs are mutually exclusive of each other) v QuickPath Interconnect (QPI) fail down v Rear serviceability power supplies
MAX5 indicators, LEDs, and power
This section describes the indicators and light-emitting diodes (LEDs) on the front and rear of the IBM MAX5 for System x (MAX5) memory expansion module.
Front view
The following illustration shows the indicators on the front of the MAX5 expansion module. All of the LEDs are controlled by the host server integrated management module (IMM).
Note: The MAX5 memory expansion module does not have a power-on switch or button. The MAX5 and all other functions are controlled by the host server to which it is connected.
22 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Power-on LED
Power supply error LED
Link LED
error
System board
LEDerror
Locator button/LED
Memory
Fan
error
LEDerror
LED
Configuration
LEDerror
v Information panel: This panel contains the indicators for the MAX5 expansion
module. – Power-on LED: When this green LED is lit, it indicates that the MAX5 is
powered on.
Locate LED: Use this blue LED to locate the MAX5 expansion module. The
locate LED also has a button that you can press to light up other servers or other MAX5 expansion modules to which the MAX5 expansion module is connected.
Power supply fault (error) LED: When this amber LED is lit, it indicates a
faulty hot-swap power-supply. – Memory error LED: When this amber LED is lit, it indicates a DIMM problem. – Link error LED: When this amber LED is lit, indicates that a QPI link fault or
a EXA link fault has occurred. The port LED for the link that has been
disconnected will not be lit on the rear of the MAX5. EXA link LEDs are on the
rear of the MAX5 expansion module, and the QPI link LEDs are on the server
to which the MAX5 is connected. – Fan error LED: When this amber LED is lit, it indicates a fan error. – System board error LED: When this amber LED is lit, it indicates a MAX5
system-board tray error. – Configuration error LED: When this amber LED is lit, it indicates a
configuration error. The memory LED might be lit to indicate a memory
configuration error.
Rear view
The following illustration shows the indicators on the rear of the IBM MAX5 for System x (MAX5) memory expansion module.
EXA
EXA
Power-on LED
Locate LED
System error LED
port 1
port 2
EXA port 3
QPI port 1
EXA port 1
LEDlink
EXA port 2
LEDlink
EXA port 3
LEDlink
QPI port 2
QPI port 3
QPI port 4
v Power-on LED: When this green LED is lit, it indicates that the MAX5 is
powered on. This LED is functionally equivalent to the power-on LED on the front of the MAX5.
Chapter 1. The System x3850 X5 and x3950 X5 server 23
Power connectors
AC LED (green)
DC LED (green)
Power supply fault (error) LED
v Locate LED: When this blue LED is lit, it indicates that the command from the
server IMM to the MAX5 expansion module is complete. Use this blue LED to locate the MAX5 expansion module. The front locate LED also has a button that you can press to light up other servers or other MAX5 expansion modules to which the MAX5 is connected. This LED is functionally equivalent to the Locate LED on the front of the MAX5.
v Power connector: Connect the power cord to this connector. v AC power LED: Each hot-swap power supply has an ac power LED and a dc
power LED. When the ac power LED is lit, it indicates that sufficient power is being supplied to the power supply through the power cord. During normal operation, both the ac and dc power LEDs are lit.
v DC power LED: Each hot-swap power supply has a dc power LED and an ac
power LED. When the dc power LED is lit, it indicates that power supply is supplying adequate dc power to the MAX5 expansion module. During normal operation, both the ac and dc power LEDs are lit.
v Power supply fault (error) LED: When this amber LED is lit, it indicates a faulty
hot-swap power supply.
v EXA link LED: When this green LED is lit, it indicates that an EXA link is
functioning.
Turning the MAX5 on and off
Because the MAX5 expansion module is controlled by the server, turning on the MAX5 refers to connecting the MAX5 power cord to the power source and pressing the power-control button on the host server that is connected to the MAX5 expansion module and is configured to identify the expansion module. Normally, the operating system on the server starts, and the server issues a power-on request to the MAX5. The IBM MAX5 for System x (MAX5) memory expansion module is turned off only if the connected server issues a power-off request and you disconnect the MAX5 power cord from the power source. You cannot turn off the MAX5 expansion module manually.
Statement 5:
CAUTION: The power control button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device. The device also might have more than one power cord. To remove all electrical current from the device, ensure that all power cords are disconnected from the power source.
2
1
You can disconnect the MAX5 expansion module power cords from the power source to shut off all power immediately without damaging the MAX5, but it might cause an unrecoverable error and loss of data on the connected server.
24 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Chapter 2. Installing optional devices
Note: Before you install optional hardware devices, make sure that the server is
working correctly. Start the server, and make sure that the operating system starts, if an operating system is installed, or that a 19990305 error code is displayed, indicating that an operating system was not found but the server is otherwise working correctly. If the server is not working correctly, see the Problem Determination and Service Guide on the IBM Documentation CD for information about how to run diagnostics.
This chapter provides detailed instructions for installing optional hardware devices in the server.
© Copyright IBM Corp. 2010 25
Server components
The following illustration shows the major components in the server. The illustrations in this document might differ slightly from your hardware.
Blue on a component indicates touch points, where you can grip the component to remove it from or install it in the server, open or close a latch, and so on.
Orange on a component or an orange label on or near a component indicates that the component can be hot-swapped, which means that if the server and operating system support hot-swap capability, you can remove or install the component while the server is running. (Orange can also indicate touch points on hot-swap components.) See the instructions for removing or installing a specific hot-swap component for any additional procedures that you might have to perform before you remove or install the component.
26 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Memory-card DIMM connectors
The following illustration shows the DIMM connectors on a memory card.
Memory-card LEDs
The following illustration shows the LEDs on a memory card.
DIMM 1 DIMM 2 DIMM 3 DIMM 4
DIMM 5 DIMM 6 DIMM 7 DIMM 8
Light path diagnostics button
Light path diagnostics button power LED
DIMM 1 DIMM 2 DIMM 3 DIMM 4
DIMM 5 DIMM 6 DIMM 7 DIMM 8
Memory card/DIMM error LED
Memory card only error LED
DIMM 1 error LED DIMM 2 error LED DIMM 3 error LED DIMM 4 error LED
DIMM 5 error LED DIMM 6 error LED DIMM 7 error LED DIMM 8 error LED
Chapter 2. Installing optional devices 27
SAS-backplane connectors
The following illustration shows the hard disk drive connectors on the SAS backplane.
Cofiguration
connector Backplane 2 (for HDD 4-7)
Backplane 1 (for HDD 0-3)
SAS signal connector
SAS power connector
Cofiguration
connector
SAS signal connector
SAS power connector
FrontRear
SAS hard disk drive connectors
eXFlash backplane connectors
The following illustration shows the cable connectors on the eXFlash backplane.
Cofiguration connector
SAS power connector
SAS signal connector
SAS signal connector
28 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Microprocessor-board connectors
The following illustration shows the connectors on the microprocessor board.
Scalability link Scalability link
I/O board power
123 4
Microprocessor 1 - 4 connector
Memory card 1
Memory card 2
Memory card 3
Memory card 4
CD/DVD power
I/O board
Scalability LED
Front panel
I/O board power
Fan 2Fan 1
I/O board
Memory card 5
Memory card 6
Memory card 7
Memory card 8
PCIe 2 x 8 connector for SAS RAID card
Fan 3
SAS backplane power
SAS backplane data
Chapter 2. Installing optional devices 29
Microprocessor-board LEDs
The following illustration shows the LEDs on the microprocessor board.
Microprocessor 1 error LED
Microprocessor 2 error LED
Microprocessor 3 error LED
Microprocessor 4 error LED
board error LED
H8 heartbeat LEDMicroprocessor
30 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
I/O-board connectors
The following illustration shows the connectors on the I/O board.
Power supply 1
Power supply 2
USB 4 - 5
6 - 7
Internal USB
VideoSerialUSB
System management Ethernet
Internal USB
Ethernet 2
Ethernet 1
PCIe2 x8 slot 7 slot 6
S ATA
Front
DVD
USB
PCIe2 x8
PCIe2 x8 slot 5
PCIe auxiliary power
PCIe2 x8 slot 4
PCIe2 x8 slot 3
PCIe2 x8 (x4 electrically) slot 2
PCIe2 x16 slot 1
I/O-board jumpers
The following illustration shows the jumpers on the I/O board.
Wake on LAN bypass (J31)
1 2 3
Password override (J29)
1
Boot
2
recovery
3
(J22)
1 2 3
Chapter 2. Installing optional devices 31
I/O-board LEDs
Table 3. I/O-board jumpers
Jumper number
J31 Wake on
J29 Password
J22 Boot
Note: If no jumper is present, the server responds as if the jumper is on pins 1 and 2.
Jumper name Jumper setting
LAN bypass
override
recovery
v Pins 1 and 2: Normal operation (default). v Pins 2 and 3: Clears Wake on LAN bypass.
v Pins 1 and 2: Normal operation (default). v Pins 2 and 3: Clears Password override.
v Pins 1 and 2: Normal operation (default). v Pins 2 and 3: Enable the UEFI recovery mode.
The following illustration shows the LEDs on the I/O board.
I/O
Slot 7 error LED
Slot 6 error LED
board error LED
Slot 5 error LED
Slot 4 error LED
Slot 3 error LED
Slot 2 error LED
Slot 1 error LED
Power fault LED
Installation guidelines
Before you install optional devices, read the following information: v Read the safety information that begins on page vii, “Working inside the server
with the power on” on page 34, and “Handling static-sensitive devices” on page
35. This information will help you work safely.
v When you install your new server, take the opportunity to download and apply
the most recent firmware updates. This step will help to ensure that any known issues are addressed and that your server is ready to function at maximum levels of performance. To download firmware updates for your server, complete the following steps.
Note: Changes are made periodically to the IBM Web site. The actual procedure might vary slightly from what is described in this document.
32 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
1. Go to http://www.ibm.com/systems/support/.
2. Under IBM System support, click System x.
3. Under Popular links, click Software and device drivers.
4. Click System x3850 X5 and x3950 X5 to display the matrix of downloadable files for the server.
For additional information about tools for updating, managing, and deploying firmware, see the ToolsCenter for System x and BladeCenter at http://publib.boulder.imm.com/infocenter/toolstr/v1r0/index.jsp.
In a two-node configuration, make sure that the IBM System x Server Firmware, FPGA, and IMM code are at the same levels on all nodes.
v Before you install optional hardware devices, make sure that the server is
working correctly. Start the server, and make sure that the operating system starts, if an operating system is installed, or that a 19990305 error code is displayed, indicating that an operating system was not found but the server is otherwise working correctly. If the server is not working correctly, see the Problem Determination and Service Guide on the IBM Documentation CD for information about how to run diagnostics.
v Observe good housekeeping in the area where you are working. Place removed
covers and other parts in a safe place.
v If you must start the server while the cover is removed, make sure that no one is
near the server and that no tools or other objects have been left inside the server.
v Do not attempt to lift an object that you think is too heavy for you. If you have to
lift a heavy object, observe the following precautions: – Make sure that you can stand safely without slipping. – Distribute the weight of the object equally between your feet. – Use a slow lifting force. Never move suddenly or twist when you lift a heavy
object.
– To avoid straining the muscles in your back, lift by standing or by pushing up
with your leg muscles.
v Make sure that you have an adequate number of properly grounded electrical
outlets for the server, monitor, and other devices.
v Back up all important data before you make changes to disk drives. v Have a small flat-blade screwdriver available. v To view the error LEDs on the system board and internal components, leave the
server connected to power.
v You do not have to turn off the server to install or replace hot-swap power
supplies, hot-swap hard disk drives, hot-swap fans, or hot-plug Universal Serial Bus (USB) devices. However, you must turn off the server before you perform any steps that involve removing or installing adapter cables.
v Blue on a component indicates touch points, where you can grip the component
to remove it from or install it in the server, open or close a latch, and so on.
v Orange on a component or an orange label on or near a component indicates
that the component can be hot-swapped, which means that if the server and operating system support hot-swap capability, you can remove or install the component while the server is running. (Orange can also indicate touch points on hot-swap components.) See the instructions for removing or installing a specific hot-swap component for any additional procedures that you might have to perform before you remove or install the component.
v When you are finished working on the server, reinstall all safety shields, guards,
labels, and ground wires.
Chapter 2. Installing optional devices 33
v For a list of supported optional devices for the server, see http://www.ibm.com/
servers/eserver/serverproven/compat/us/.
A single-power-supply server operating at 208 V ac
One power supply operating at 208 V ac supports a fully populated server, but it does not support power or cooling redundancy.
System reliability guidelines
To help ensure proper cooling and system reliability, make sure that the following requirements are met:
v Each of the drive bays has a drive or an electromagnetic compatibility (EMC)
shield installed in it.
v If the server has redundant power, each of the power-supply bays has a power
supply installed in it.
v There is adequate space around the server to allow the server cooling system to
work properly. Leave approximately 50 mm (2.0 in.) of open space around the front and rear of the server. Do not place objects in front of the fans. For proper cooling and airflow, replace the top cover before you turn on the server. Operating the server for extended periods of time (more than 30 minutes) with the top cover removed might damage server components.
v You have followed the cabling instructions that come with optional adapters. v You have replaced a failed fan within 48 hours. v You have replaced a hot-swap drive within 2 minutes of removal. v For redundant and hot-swappable power supply operation, the power supplies
are connected to 200-240 V ac.
v Microprocessor sockets1-4each always contain either a heat-sink blank or a
microprocessor and heat sink.
Working inside the server with the power on
Attention: Static electricity that is released to internal server components when
the server is powered on might cause the server to halt, which might result in the loss of data. To avoid this potential problem, always use an electrostatic-discharge wrist strap or other grounding system when you work inside the server with the power on.
The server supports hot-swap devices and is designed to operate safely while it is turned on and the cover is removed. Follow these guidelines when you work inside a server that is turned on:
v Avoid wearing loose-fitting clothing on your forearms. Button long-sleeved shirts
before you work inside the server; do not wear cuff links while you are working inside the server.
v Do not allow your necktie or scarf to hang inside the server. v Remove jewelry, such as bracelets, necklaces, rings, and loose-fitting wrist
watches.
v Remove items from your shirt pocket, such as pens and pencils, that might fall
into the server as you lean over it.
v Avoid dropping any metallic objects, such as paper clips, hairpins, and screws,
into the server.
34 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Handling static-sensitive devices
Attention: Static electricity can damage the server and other electronic devices.
To avoid damage, keep static-sensitive devices in their static-protective packages until you are ready to install them.
To reduce the possibility of damage from electrostatic discharge, observe the following precautions:
v Limit your movement. Movement can cause static electricity to build up around
you.
v Wear an electrostatic-discharge wrist strap, if one is available. v Handle the device carefully, holding it by its edges or its frame. v Do not touch solder joints, pins, or exposed circuitry. v Do not leave the device where others can handle and damage it. v While the device is still in its static-protective package, touch it to an unpainted
metal surface on the outside of the server for at least 2 seconds. This drains static electricity from the package and from your body.
v Remove the device from its package and install it directly into the server without
setting down the device. If it is necessary to set down the device, put it back into its static-protective package. Do not place the device on the server cover or on a metal surface.
v Take additional care when you handle devices during cold weather. Heating
reduces indoor humidity and increases static electricity.
Chapter 2. Installing optional devices 35
Internal cable routing and connectors
The following illustration shows the routing of the DVD power, fans 1 and 2, scalability LED, and operator information cables.
DVD power cable connector
36 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Fan 1 cable connector
Scalability LED cable
Operator information cable
Fan 2 cable connector
The following illustration shows the routing of the USB and DVD signal cables.
Removing the top cover
Note: Before you install optional hardware devices, make sure that the server is
working correctly. Start the server, and make sure that the operating system starts, if an operating system is installed, or that a 19990305 error code is displayed, indicating that an operating system was not found but the server is otherwise working correctly. If the server is not working correctly, see the Problem Determination and Service Guide on the IBM Documentation CD for information about how to run diagnostics.
To remove the top cover, complete the following steps:
1. Read the safety information that begins on page vii and “Working inside the server with the power on” on page 34.
DVD signal cable
USB cable
Chapter 2. Installing optional devices 37
2. If you are installing or replacing a non-hot-swap component, turn off the server and all attached peripheral devices. Disconnect all power cords; then, disconnect all external signal cables from the server.
3. Slide the server out of the rack until the slide rails lock into place.
Cover release latch
Top cover
4. Lift the cover-release latch. The cover slides to the rear approximately 13 mm (0.5 inch). Lift the cover off the server.
Attention: For proper cooling and airflow, replace the top cover before you turn on the server. Operating the server for more than 2 minutes with the top cover removed might damage server components.
Removing the top-cover bracket
To remove the top-cover bracket, complete the following steps:
1. Read the safety information that begins on page vii and “Working inside the server with the power on” on page 34.
2. If you are installing or replacing a non-hot-swap component, turn off the server and all peripheral devices, and disconnect the power cords and all external cables.
3. Slide the server out of the rack until the slide rails lock into place.
4. Remove the top cover (see “Removing the top cover” on page 37).
5. Slide the blue latches on the top-cover bracket toward the center of the server.
38 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Latch
Latch
6. Tilt and lift the top-cover bracket out of the server.
7. If you are instructed to return the top-cover bracket, follow all packaging instructions, and use any packaging materials for shipping that are supplied to you.
Chapter 2. Installing optional devices 39
Installing the top-cover bracket
Latch
Latch
To replace the top-cover bracket, complete the following steps:
1. Make sure that all internal cables are correctly routed.
2. Align the top-cover bracket on top of the server so that the metal tabs line up correctly on the chassis, and then rotate it into place.
3. Slide the blue latches on the top cover bracket toward the outside of the server to lock it in place.
40 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Removing the bezel
Note: You do not have to remove the top cover before you remove the bezel.
To remove the bezel, complete the following steps:
1. Read the safety information that begins on page vii and “Working inside the server with the power on” on page 34.
2. Press on the bezel retention tabs on the sides of the bezel and pull the bezel away from the server.
Installing a PCI Express adapter
The following notes describe the types of adapters that the server supports and other information that you must consider when you install an adapter:
v An Emulex 10 GbE Custom Adapter for System x comes installed in PCI Express
slot 7 in some models.
v Locate the documentation that comes with the adapter and follow those
instructions in addition to the instructions in this section. If you must change the switch setting or jumper settings on the adapter, follow the instructions that come with the adapter.
v Avoid touching the components and gold-edge connectors on the adapter. v If you are installing a ServeRAID adapter with a battery installed on the adapter,
you must install the adapter in a full length expansion slot and you must leave an empty expansion slot next to the slot in which you install the ServeRAID adapter.
v The server scans devices and PCI Express slots to assign system resources in
the following order: ICH10 RAID, DVD, USB, I/O Hub 1, integrated Ethernet controller, integrated SAS controller, PCI Express slots 5 through 7, I/O Hub 2, and then PCI Express slots 1 through 4. If you have not changed the default startup sequence, the server starts the devices in the following order: DVD drive, USB-attached diskette drive, hard disk drive 0, and network devices.
Note: To change the startup sequence, start the Setup utility and select Start Options from the main menu. See “Using the Setup utility” on page 87 for details
about using the Setup utility.
v The PCI Express 2.0 bus configuration is as follows:
Chapter 2. Installing optional devices 41
– Expansion slot 1 is x16, slot 2 is x8 (x4 lanes), and slots 3 through 6 are x8. – Expansion slot 7 is a non-standard, 106-pin connector but accepts PCI
Express x8, x4, and x1 standard adapters.
– Expansion slots 1 through 4 are non-hot-plug, full-length PCI Express 2.0 and
can accept adapters up to 312.00 mm (12.28 inches) long.
– Expansion slots 5 through 7 are non-hot-plug, half-length PCI Express 2.0 and
can accept adapters up to 167.65 mm (6.6 inches) long.
Attention: Static electricity that is released to internal server components when the server is powered on might cause the server to halt, which might result in the loss of data. To avoid this potential problem, always use an electrostatic-discharge wrist strap or other grounding system when you work inside the server with the power on.
To install a PCI Express adapter, complete the following steps.
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. Turn off the server and peripheral devices, and disconnect the power cords and all external cables.
3. Remove the server cover (see “Removing the top cover” on page 37) and determine which PCI Express expansion slot you will use for the adapter.
4. See the documentation that comes with the adapter for instructions for setting jumpers or switches and for cabling.
Note: Route adapter cables before you install the adapter.
Adapter
Adapter
Pin
Pin hole
retention latch
Expansion slot cover
5. Push the adapter retention latch toward the rear of the server and open the tab.
6. Remove the expansion-slot cover. Attention: When you install an adapter, avoid touching the components and
gold-edge connectors on the adapter. Make sure that the adapter is correctly seated in the connector. Incorrectly seated adapters might cause damage to the I/O board or to the adapter.
7. Touch the static-protective package that contains the adapter to any unpainted surface on the outside of the server; then, grasp the adapter by the top edge or upper corners of the adapter and remove it from the package.
42 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
8. Carefully grasp the adapter by its top edge or upper corners, and align it with the connector on the I/O board.
9. Press the adapter firmly into the adapter connector.
10. Push down on the blue adapter retention latch until it clicks into place, securing the adapter.
11. Connect any required cables to the adapter.
If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 71.
Installing a ServeRAID adapter for use with eXFlash drives
The following notes describe the ServeRAID adapters that the server supports and other information that you must consider when you install an adapter:
v Locate the documentation that comes with the adapter and follow those
instructions in addition to the instructions in this section. If you must change the switch setting or jumper settings on the adapter, follow the instructions that come with the adapter.
v Avoid touching the components and gold-edge connectors on the adapter. v The server scans devices and PCI Express slots to assign system resources in
the following order: ICH10 RAID, DVD, USB, I/O Hub 1, integrated Ethernet controller, integrated SAS controller, PCI Express slots 5 through 7, I/O Hub 2, and then PCI Express slots 1 through 4. If you have not changed the default startup sequence, the server starts the devices in the following order: DVD drive, USB-attached diskette drive, hard disk drive 0, and network devices.
Note: To change the startup sequence, start the Setup utility and select Start Options from the main menu. See “Using the Setup utility” on page 87 for details
about using the Setup utility.
v The PCI Express 2.0 bus configuration is as follows:
– Expansion slot 1 is x16, slot 2 is x8 (x4 lanes), and slots 3 through 6 are x8. – Expansion slot 7 is a non-standard, 106-pin connector but accepts PCI
Express x8, x4, and x1 standard adapters.
– Expansion slots 1 through 4 are non-hot-plug, full-length PCI Express 2.0 and
can accept adapters up to 312.00 mm (12.28 inches) long.
– Expansion slots 5 through 7 are non-hot-plug, half-length PCI Express 2.0 and
can accept adapters up to 167.65 mm (6.6 inches) long.
Attention: Static electricity that is released to internal server components when the server is powered on might cause the server to halt, which might result in the loss of data. To avoid this potential problem, always use an electrostatic-discharge wrist strap or other grounding system when you work inside the server with the power on.
To install a ServeRAID adapter, for use with eXFlash drives, in a rear PCI connector, complete the following steps.
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. Turn off the server and peripheral devices, and disconnect the power cords and all external cables.
3. Remove the server cover (see “Removing the top cover” on page 37) and determine which PCI Express expansion slot you will use for the adapter.
Chapter 2. Installing optional devices 43
4. Remove the top cover bracket.
5. Push the adapter retention latch toward the rear of the server and open the tab.
Adapter
Adapter
Pin
Pin hole
retention latch
Expansion slot cover
6. Remove the expansion-slot cover. Attention: When you install an adapter, avoid touching the components and
gold-edge connectors on the adapter. Make sure that the adapter is correctly seated in the connector. Incorrectly seated adapters might cause damage to the I/O board or to the adapter.
7. Touch the static-protective package that contains the adapter to any unpainted surface on the outside of the server; then, grasp the adapter by the top edge or upper corners of the adapter and remove it from the package.
8. Carefully grasp the adapter by its top edge or upper corners, and align it with the connector on the I/O board.
9. Press the adapter firmly into the adapter connector.
10. Push down on the blue adapter retention latch until it clicks into place, securing the adapter.
11. Route the SAS cables under the bottom of the I/O shuttle.
44 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
12. Connect one end of each SAS signal cable that came with the eXFlash drive cage and backplane option to the backplane and the other end to the ServeRAID adapter.
v Connect one end of the first cable to Port 0 on the ServeRAID adapter and
v Connect one end of the second cable to Port 1 on the ServeRAID adapter
13. Reinstall the top cover bracket.
If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 71.
SAS signal cables (2)
the other end to connector J39 on the backplane.
and the other end to connector J40 on the backplane.
Chapter 2. Installing optional devices 45
Installing a hot-swap power supply
Statement 5:
CAUTION: The power control button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device. The device also might have more than one power cord. To remove all electrical current from the device, ensure that all power cords are disconnected from the power source.
2
1
Power-supply handle release latch
46 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Power-supply handle
Power-supply filler
Power supply
Release latch
To install an additional hot-swap power supply, complete the following steps:
1. Read the safety information that begins on page vii and “Installation guidelines”
on page 32.
2. Press the blue release latch on the power-supply filler and pull the handle to the
open position. Then, remove the filler from power-supply bay 2.
3. If the handle is not already in the open position, press the orange release latch
on the power-supply handle to the right and lift the handle up to the open position.
4. Slide the power supply into the bay and fully close the locking handle by sliding
it down to the locked position.
5. Connect one end of the power cord for the new power supply into the ac
connector on the back of the power supply, and connect the other end of the power cord into a properly grounded electrical outlet.
6. Make sure that the ac power LED on the power supply is lit, indicating that the
power supply is operating correctly. If the server is turned on, make sure that the dc power LED on the top of the power supply is lit also.
Installing a hot-swap hard disk drive
The following notes describe the types of hard disk drives that the server supports and other information that you must consider when you install a hard disk drive:
v The server supports up to eight 1-inch (26 mm) slim-high, 2.5-inch, hot-swap
hard disk drives in the standard hot-swap bays.
v Start installing the hard disk drives from the bottom bay (bay 0). v For a list of supported optional devices for the server, see http://www.ibm.com/
servers/eserver/serverproven/compat/us/.
v If the server will be configured for RAID operation, see the documentation that
comes with the controller for instructions for installing a hard disk drive.
v All hot-swap drives in the server should have the same throughput speed rating;
using drives with different speed ratings might cause all drives to operate at the lowest throughput speed.
v To minimize the possibility of damage to the hard disk drives when you install the
server in a rack configuration, install the server in the rack before you install the hard disk drives.
v You do not have to turn off the server to install hot-swap drives in the hot-swap
drive bays. However, you must turn off the server when you perform any steps that involve installing or removing cables.
Chapter 2. Installing optional devices 47
The following illustration shows how to install a hot-swap hard disk drive.
Activity LED
Status LED
Drive handle (in open position)
Hard disk drive assembly
Filler panel
To install a hot-swap hard disk drive, complete the following steps:
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. Remove the filler panel from one of the empty hot-swap bays.
Note: When you install a drive in bays 4 through 7, you must first install a hard disk drive backplane.
3. Touch the static-protective package that contains the hard disk drive to any unpainted surface on the outside of the server; then, remove the hard disk drive from the package.
4. Make sure that the drive handle is open; then, install the hard disk drive into the hot-swap bay.
Note: When you turn on the server, check the hard disk drive status LEDs to make sure that the hard disk drive is operating correctly. If the amber hard disk drive status LED for a drive is lit continuously, that drive is faulty and must be replaced. If the green hard disk drive activity LED is flashing, the drive is being accessed.
If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 71.
48 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Installing a DVD (optical) drive
DVD bracket
Release button
To install a DVD drive, compete the following steps:
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. Turn off the server and peripheral devices, and disconnect the power cord and all external cables.
3. Remove the front bezel.
4. Push the blue release button above the DVD drive bay to remove the filler panel.
5. Pull the bracket off the filler panel.
6. Install the bracket on the side of the DVD drive.
7. Slide the DVD drive into the server until it engages the SATA cable.
8. Reinstall the front bezel.
If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 71.
Installing a 2.5-inch hard disk drive backplane
To install a 2.5-inch hard disk drive backplane, complete the following steps:
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. Turn off the server and peripheral devices, and disconnect the power cord and all external cables.
3. Remove the server cover (see “Removing the top cover” on page 37).
4. Remove the top cover bracket (see “Removing the top-cover bracket” on page
38).
5. Pull out the hard disk drives and hard disk drive fillers just enough to disconnect them from the backplane.
6. Remove the ServeRAID adapter from behind the hard disk drive backplane.
7. Disconnect the SAS signal cables from the ServeRAID adapter.
8. Lift the SAS power and configuration cable handle up to disconnect the cables from the microprocessor board.
9. Slide the backplane carrier release tab forward and slightly lift the carrier.
10. Remove the backplane carrier and SAS power cable handle from the server together.
Chapter 2. Installing optional devices 49
SAS power and configuration cables
Backplane carrier
Alignment pins
Release tab
11. Remove the backplane filler from the backplane carrier.
a. Push the tabs on the backplane outward. b. Pull the filler out of the backplane carrier.
12. Orient and install the new backplane into the backplane carrier.
50 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
a. Position the notch in the backplane over the bottom right of the carrier. b. Position the holes in the backplane over the pins in the carrier. c. Push the backplane into the carrier.
13. Connect the new SAS signal cable that came with the backplane to the new backplane.
14. Connect the two unconnected power cables from the SAS power cable handle to the new backplane. (Look at the cabling of the first backplane to make sure that you cable the new backplane correctly.)
15. Slide the backplane carrier into place until it latches while you hold the SAS power cable handle out of the way.
16. Install the SAS power cable handle into place straight down onto the microprocessor board.
17. Connect the two SAS signal cables to the ServeRAID adapter. Connect the cable from the bottom backplane to port 0 and the cable from the new top backplane to port 1. The following graphics show the port numbers on the ServeRAID adapters.
ServeRAID M5015 controller
Port 1 Port 0
Chapter 2. Installing optional devices 51
18. Install the ServeRAID adapter onto the RAID adapter carrier, and then install the carrier into the server.
Post
Tabs
Release latch
19. Install the top cover bracket (see “Installing the top-cover bracket” on page 40).
20. Push the hard disk drives and hard disk drive fillers back into place so that they connect to the backplane.
21. Install the top cover.
22. Connect the cables and power cords (see “Connecting the cables” on page
71).
23. Turn on all attached devices and the server.
Installing an eXFlash 1.8-inch drive cage and backplane
Use the following instructions to install an eXFlash 1.9-inch drive cage when a
2.5-inch SAS hard disk drive backplane is also installed in the server.
To install an eXFlash 1.8-inch drive cage and backplane, complete the following steps:
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. Turn off the server and peripheral devices, and disconnect the power cord and all external cables.
3. Remove the server cover (see “Removing the top cover” on page 37).
52 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
4. If any hard disk drives or fillers are installed in the server, pull out the bottom four just enough to disconnect them from the backplane, and completely remove any fillers from the top four bays.
5. Remove the backplane carrier and the SAS power cable handle: a. Lift the SAS power and configuration cable handle up to disconnect the
cables from the microprocessor board. b. Slide the backplane carrier release tab forward and slightly lift the carrier. c. Remove the backplane carrier and SAS power cable handle from the
server together.
SAS power and configuration cables
Backplane carrier
Alignment pins
Release tab
6. Disconnect the power and configuration cables from the backplane. Do not disconnect the SAS signal cable from the backplane.
7. Remove the backplane filler from the backplane carrier.
a. Push the tabs on the backplane outward.
Chapter 2. Installing optional devices 53
b. Pull the filler out of the backplane carrier.
8. Check the label on the cable handle to make sure you use the correct power and configuration cable handle from the option kit. Connect the new power and configuration cables from the power cable handle to the backplane in the carrier. Use the shorter cables when connecting to the backplane in the bottom position of the carrier.
9. Slide the backplane carrier into the server while lowering the power and configuration cable handle into place.
10. Seat the power and configuration handle into the connector on microprocessor board. Do not latch the backplane carrier fully into place yet.
11. Slide the eXFlash backplane assembly into the hard disk drive cage. Make sure that the LEDs are on the left side.
Filler panel
12. Connect the power and configuration cables into the back of the eXFlash backplane assembly.
13. Seat the backplane carrier into the fully latched position. If there are hard disk drives in the bottom four bays, slide them back into place.
14. Connect the two SAS signal cables to the ServeRAID adapter (such as a ServeRAID B5015 SSD Controller or a 6Gb SSD HBA). Connect the cable from the bottom backplane to port 0 and the cable from the new top backplane to port 1.
15. To install a ServeRAID adapter in one of the PCI connectors, see “Installing a ServeRAID adapter for use with eXFlash drives” on page 43 for installation and cabling information.
16. Install the top cover.
17. To install the solid state drives, see “Installing a solid state drive.”
18. Connect the cables and power cords (see “Connecting the cables” on page
71).
19. Turn on all attached devices and the server.
Installing a solid state drive
To install a solid state drive, complete the following steps:
54 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. Remove the drive cage filler panel.
3. Slide the drive release latch to the right and rotate the handle to the open position.
4. Pull the lever to slide the drive filler out of the server.
5. Push the solid state drive in all the way until it clicks in the backplane.
Release latch
Filler panel
6. Rotate the handle until the latch clicks closed.
7. Reinstall the drive cage filler panel.
8. Install the drive ID label on the server front bezel.
Chapter 2. Installing optional devices 55
Installing a QPI wrap card
Wrap card
Release latch
In a one node server only, if your server has more than two microprocessors installed, you must install two QPI wrap cards in the server.
To install a QPI wrap card, complete the following steps:
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. Turn off the server and peripheral devices, and disconnect the power cord and all external cables.
3. Rotate the blue release latch on the QPI wrap card handle and pull the handle to the open position.
4. Push the wrap card into the bay, and slide the handle to the locked position.
5. Reconnect the cables and power cords (see “Connecting the cables” on page
71).
6. Turn on all attached devices and the server.
56 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Installing an internal removable flash drive
The server supports two internal removable flash drives that are installed in the USB connectors on the I/O board. You do not have to turn off the server to install an internal removable flash drive.
Locking collar
To install an internal removable flash drive, complete the following steps:
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. Disconnect the power cable and remove the power supply that is closest to the USB connector that you plan to use.
3. Reach through the empty power-supply bay and make sure that the locking collar on the connector is pushed down to the unlocked position.
4. Insert the internal flash memory drive into the connector.
5. Pull up on the locking collar to lock the internal flash memory drive in place.
Note: To remove an internal removable flash memory drive, push down on the locking collar to unlock the drive before you remove the drive.
6. Reinstall the power supply (see Installing a hot-swap power supply) and reconnect the power cable.
Chapter 2. Installing optional devices 57
If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 71.
Memory modules
The following notes describe the types of dual inline memory modules (DIMMs) that the server supports and other information that you must consider when you install DIMMs:
v The server supports 1.5 V, 240-pin, 1 GB and 2 GB PC3-10600 or 4 GB, 8 GB,
v The server supports up to eight memory cards. Each memory card holds up to
v At least one memory card with one pair of DIMMs must be installed for the
v When you install additional DIMMs on a memory card, be sure to install them in
v You do not have to save new configuration information to the IMM when you
v When you restart the server after you add or remove a DIMM, the server
v Memory cards in connectors 1 and 2 support microprocessor 1, memory cards in
v There are four memory power buses, which are split among the eight memory
v Populate the memory-card connectors to match the microprocessor installation,
and 16 GB PC3-8500 double data-rate (DDR) III, registered synchronous dynamic random-access memory (SDRAM) with error correcting code (ECC) DIMMs. These DIMMs must be compatible with the latest PC3-10600 or PC3-8500 SDRAM Registered DIMM specifications. For a list of the supported optional devices for the server, see http://www.ibm.com/servers/eserver/ serverproven/compat/us/.
eight DIMMs.
server to operate.
pairs. The DIMMs in each pair must match each other.
install or remove DIMMs. The only exception is if you replace a DIMM that was designated as disabled in the Setup utility Memory Settings menu. In this case, you must re-enable the row in the Setup utility or reload the default memory settings.
displays a message that the memory configuration has changed.
connectors 3 and 4 support microprocessor 2, memory cards in connectors 5 and 6 support microprocessor 3, and memory cards in connectors 7 and 8 support microprocessor 4.
cards.
in the following order: 1, 7, 3, 5, 2, 8, 4, 6. (Microprocessors must be installed in the following order: 1, 4, 2, and 3. See “Installing a microprocessor” on page 67 for more information.)
58 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
The following illustration shows the locations of the memory-card connectors.
Microprocessor 3 connector
Microprocessor 2 connector
Microprocessor 1 connector
Microprocessor 4 connector
Memory card 1
Memory card 2
Memory card 3
Memory card 4
Memory card 5
Memory card 6
Memory card 7
v The following illustration shows the DIMM connectors on a memory card.
DIMM 1 DIMM 2 DIMM 3 DIMM 4
DIMM 5 DIMM 6 DIMM 7 DIMM 8
Memory card 8
Chapter 2. Installing optional devices 59
v In a low-cost and low-power DIMM installation, install the DIMMs on each
memory card in the order shown in the following tables. The goal in a low-cost and low-power configuration is to completely fill each memory card before you install the next memory card.
Table 4. Low-cost and low-power DIMM installation sequence
DIMM pair installation order
First 1 1 and 8 1 and 4 Second 7 1 and 8 Third 1 3 and 6 Fourth 7 3 and 6 Fifth 1 2 and 7 Sixth 7 2 and 7 Seventh 1 4 and 5 Eighth 7 4 and 5
Memory-card connector number
DIMM-connector numbers
Installed microprocessors
If you plan to install additional memory cards in the low-cost and low-power installation sequence, follow the DIMM installation sequence in Table 4 for each memory card. Install the memory cards in the installation sequence shown in Table 5.
Table 5. Low-cost and low-power memory-card installation sequence
Memory-card connector
Memory card pairs
First 1 and 7 1 and 4 Second 2 and 8 Third 3 and 5 2 and 3 Fourth 4 and 6
number Installed microprocessors
In a high-performance DIMM installation, install the DIMMs on each memory card in the order shown in the following table. You must install at least one pair of DIMMs on each memory card.
Table 6. High-performance memory-card installation sequence
DIMM pair installation order
First 1 1 and 8 Second 7 1 and 8 Third 3 1 and 8 Fourth 5 1 and 8 Fifth 2 1 and 8 Sixth 8 1 and 8 Seventh 4 1 and 8 Eighth 6 1 and 8 Ninth 1 3 and 6 Tenth 7 3 and 6 Eleventh 3 3 and 6
Memory-card connector number DIMM connector numbers
60 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Table 6. High-performance memory-card installation sequence (continued)
DIMM pair installation order
Twelfth 5 3 and 6 Thirteenth 2 3 and 6 Fourteenth 8 3 and 6 Fifteenth 8 3 and 6 Sixteenth 6 3 and 6 Seventeenth 1 2 and 7 Eighteenth 7 2 and 7 Nineteenth 3 2 and 7 Twentieth 5 2 and 7 Twenty-first 2 2 and 7 Twenty-second 8 2 and 7 Twenty-third 4 2 and 7 Twenty-fourth 6 2 and 7 Twenty-fifth 1 4 and 5 Twenty-sixth 7 4 and 5 Twenty-seventh 3 4 and 5 Twenty-eighth 5 4 and 5 Twenty-ninth 2 4 and 5 Thirtieth 8 4 and 5 Thirty-first 4 4 and 5 Thirty-second 6 4 and 5
Memory-card connector number DIMM connector numbers
To enable memory mirroring, you must install DIMMs in sets of four, one pair in each memory card. All DIMMs in each set must be the same size and type. Memory cards 1 and 2 mirror each other, cards 3 and 4 mirror each other, memory cards 5 and 6 mirror each other, and cards 7 and 8 mirror each other. Install DIMMs in the sequence shown in the following table.
Table 7. Memory-card installation sequence for memory-mirroring configuration
DIMM quad installation order Memory card Connector numbers
First 1 1 and 8
2 1 and 8
Second 7 1 and 8
8 1 and 8
Third 3 1 and 8
4 1 and 8
Fourth 5 1 and 8
6 1 and 8
Fifth 1 3 and 6
2 3 and 6
Chapter 2. Installing optional devices 61
Table 7. Memory-card installation sequence for memory-mirroring configuration (continued)
DIMM quad installation order Memory card Connector numbers
Sixth 7 3 and 6
8 3 and 6
Seventh 3 3 and 6
4 3 and 6
Eighth 5 3 and 6
6 3 and 6
Ninth 1 2 and 7
2 2 and 7
Tenth 7 2 and 7
8 2 and 7
Eleventh 3 2 and 7
4 2 and 7
Twelfth 5 2 and 7
6 2 and 7
Thirteenth 1 4 and 5
2 4 and 5
Fourteenth 7 4 and 5
8 4 and 5
Fifteenth 3 4 and 5
4 4 and 5
Sixteenth 5 4 and 5
6 4 and 5
v If a problem with a DIMM is detected, light path diagnostics lights the
system-error LED on the front of the server, indicating that there is a problem and guiding you to the defective DIMM. When this occurs, first identify the defective DIMM; then, remove and replace the DIMM.
62 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
The following illustration shows the LEDs on the memory card.
Memory card/DIMM error LED
Memory card only error LED
Light path diagnostics button
Light path diagnostics button power LED
DIMM 1 DIMM 2 DIMM 3 DIMM 4
DIMM 5 DIMM 6 DIMM 7 DIMM 8
DIMM 1 error LED DIMM 2 error LED DIMM 3 error LED DIMM 4 error LED
DIMM 5 error LED DIMM 6 error LED DIMM 7 error LED DIMM 8 error LED
Memory card/DIMM error LED: When this LED is lit, it indicates that the memory card or a DIMM has failed.
Memory card only error LED: When this LED is lit, it indicates that the memory card has failed.
DIMM1-8error LED: When one of these LEDs is lit, it indicates that a DIMM has failed.
Light path diagnostics button power LED: When this LED is lit, it indicates that the capacitor has power and error LEDs can be lit as necessary.
Light path diagnostics button: Press this button to relight the error LED that had previously been lit.
Installing a memory card
At least one memory card with one pair of DIMMs must be installed for the server to operate correctly.
To install a memory card, complete the following steps:
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. Turn off the server and peripheral devices, and disconnect the power cords and all external cables as necessary to replace the device.
3. Remove the server cover (see “Removing the top cover” on page 37).
4. Remove the memory card filler.
5. Prepare the memory card:
Chapter 2. Installing optional devices 63
6. Add the memory card.
If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 71.
Installing DIMMs
DIMMs must be installed in pairs of the same type and speed. For you to use the memory mirroring feature, all the DIMMs that are installed in the server must be the same type and speed, and the operating system must support memory mirroring. The following instructions are for installing one pair of DIMMs. To install DIMM pairs on more than one memory card, repeat steps 3 though 7 for each memory card.
a. Touch the static-protective package that contains the memory card to any
unpainted surface on the outside of the server; then, remove the memory
card from the package. b. Open the levers on the top of the memory card. c. Place the memory card on a flat, static-protective surface, with the DIMM
connectors facing up.
d. Install DIMMs in the memory card (see “Installing DIMMs”).
Attention: When you move the memory card, do not allow it to touch any components or structures inside the server.
a. Grasp the memory card by the retention levers and turn the memory card so
that the connector aligns with the connector on the microprocessor board
and the guides on the chassis. b. Insert the memory card into the memory-card connector. c. Press the memory card into the connector and close the retention levers. d. Slide the blue release latch to the locked position.
To install a DIMM, complete the following steps:
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. Turn off the server and peripheral devices, and disconnect the power cords and all external cables as necessary to replace the device.
3. Remove the server top cover (see “Removing the top cover” on page 37).
64 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Release lever
Error LED
4. If you are installing DIMMs in a memory card that is already installed in the server, remove the memory card:
a. Slide the blue release latch to the unlocked position. b. Open the release levers on the top of the memory card. c. While you hold the release levers open, lift the memory card out of the
server.
5. Place a memory card on a flat, static-protective surface, with the DIMM connectors facing up.
Attention: To avoid breaking the DIMM retaining clips or damaging the DIMM connectors, open and close the clips gently.
6. Open the retaining clips 1 on each end of the DIMM connector.
7. Touch the static-protective package that contains the DIMM to any unpainted metal surface on the outside of the server; then, remove the DIMM from the package.
8. Turn the DIMM so that the DIMM keys align correctly with the slot.
Chapter 2. Installing optional devices 65
DIMM
Retaining clip
9. Insert the DIMM into the connector by aligning the edges of the DIMM with the slots at the ends of the DIMM connector. Firmly press the DIMM straight down into the connector 2 by applying pressure on both ends of the DIMM simultaneously. The retaining clips snap into the locked position when the DIMM is seated in the connector.
Note: If there is a gap between the DIMM and the retaining clips, the DIMM has not been correctly inserted; open the retaining clips, remove the DIMM, and then reinsert it.
66 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
10. Install the memory card.
Memory card filler
Release lever
a. If this is a new memory card, remove the memory card filler from the
server. b. Insert the memory card into the memory-card connector. c. Press the memory card into the connector and close the release levers. d. Slide the blue release latch to the locked position.
If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 71.
Installing a microprocessor
The following notes describe the type of microprocessor that the server supports and other information that you must consider when you install a microprocessor:
v The optional microprocessors that IBM supports are limited by the capacity and
capability of the server. Any microprocessors that you install must have the same specifications as the microprocessors that came with the server.
v For a list of supported optional devices for the server, see http://www.ibm.com/
servers/eserver/serverproven/compat/us/.
v The server supports up to four Intel Xeon microprocessors. If you are installing
two or more microprocessors, they must be the same cache size and type, and the same clock speed.
v The server can operate as a symmetric multiprocessing (SMP) server. With SMP,
certain operating systems and application programs can distribute the processing
Chapter 2. Installing optional devices 67
load among the microprocessors. This enhances performance for database and point-of-sale applications, integrated manufacturing solutions, and other applications.
v Due to space limitations, you must use the microprocessor tool that comes with
the microprocessor, when you install the microprocessor.
v Read the documentation that comes with the microprocessor to determine
whether you have to update the IBM System x Server Firmware (server firmware). To download the most current level of server firmware, complete the following steps.
Note: Changes are made periodically to the IBM Web site. The actual procedure might vary slightly from what is described in this document.
1. Go to http://www.ibm.com/systems/support/.
2. Under Product support, click System x.
3. Under Popular links, click Software and device drivers.
4. Click IBM System x3850 X5 and x3950 X5 to display the matrix of downloadable files for the server.
v Obtain an SMP-capable operating system. For a list of supported operating
systems, see http://www.ibm.com/servers/eserver/serverproven/compat/us/.
v You can use the Setup utility to determine the specific type of microprocessor in
the server.
v Microprocessor sockets must always contain either a heat-sink blank or a
microprocessor and heat sink.
v Populate the microprocessor sockets in the following order: 1, 4, 2, and 3. The
following illustration shows the locations of the microprocessor sockets on the microprocessor board.
Microprocessor 1
Microprocessor 2
Microprocessor 3
Microprocessor 4
Note: If your server has more than two microprocessors installed, you must install two QPI wrap cards in the server.
To install a microprocessor, complete the following steps:
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
68 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
2. Turn off the server and peripheral devices, and disconnect the power cords and all external cables as necessary to replace the device.
3. Remove the server top cover (see “Removing the top cover” on page 37). Attention: When you handle static-sensitive devices, take precautions to
avoid damage from static electricity. For details about handling these devices, see “Handling static-sensitive devices” on page 35.
4. Slide the blue latches on the top cover bracket toward the center of the server.
Latch
Latch
5. Lift the top cover bracket out of the server.
6. Remove the heat-sink blank and store it for future use.
7. Open the release socket lever and rotate the load plate.
Release socket lever
8. Remove the microprocessor socket dust cover from the surface of the microprocessor socket, if one is present. Store the dust cover in a safe place.
9. Install the microprocessor in the microprocessor installation tool. a. Touch the static-protective package that contains the new microprocessor
to any unpainted metal surface on the outside of the server.
b. Twist the handle of the installation tool counterclockwise so that it is in the
open position.
c. Using the triangle on the microprocessor to align it with the installation tool,
place the microprocessor on the underside of the tool.
d. Twist the handle of the installation tool clockwise to secure the
microprocessor in the tool.
Chapter 2. Installing optional devices 69
Note: You can pick up or release the microprocessor by twisting the microprocessor installation tool handle.
Handle
Installation tool
Microprocessor
10. Carefully position the microprocessor with the microprocessor tool over the microprocessor socket. Twist the microprocessor tool counterclockwise to insert the microprocessor into the socket.
11. Close the load plate and then rotate the microprocessor-release lever to secure the microprocessor.
70 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Heat sink
Clips
Clips
Tabs
Tabs
12. Remove the heat sink from its package and rotate the heat-sink handle to the fully open position.
13. Remove the cover from the bottom of the heat sink.
14. Position the heat sink above the microprocessor and align the clips of the heat sink with the tabs next to the microprocessor socket.
15. Press on the top of the heat sink and rotate the lever to the closed position.
If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation.”
Completing the installation
To complete the installation, complete the following steps:
1. If you removed the front bezel, slide the bezel onto the front of the server
chassis.
2. If you removed the top-cover bracket, reinstall it. Slide the blue latches into the
locked position.
3. Place the top cover over the top of the server.
4. Slide the top cover forward; then, press down on the cover handle until it clicks
into place.
5. Connect the cables and power cords to the rear of the server. For more
information, see “Connecting the cables.”
Connecting the cables
Notes:
1. Be sure to turn off the server before you connect any cables to or disconnect
any cables from the server.
2. Detailed cabling information is available in the Rack Installation Instructions that
came with your server or the Installation Instructions that came with any cable kits.
Chapter 2. Installing optional devices 71
3. For additional cabling instructions, see the documentation that comes with the optional devices. It might be easier for you to route any cables before you install certain optional devices.
The following illustration shows the locations of the input and output connectors on the rear of the server.
Power connector
QPI ports 1 - 2
Gigabit Ethernet 1 - 2
Updating the server configuration
When you start the server for the first time after you add or remove a device, you might receive a message that the configuration has changed. The Setup utility starts automatically so that you can save the new configuration settings. For more information, see Chapter 3, “Configuring the server,” on page 85.
Some optional devices have device drivers that you must install. For information about installing device drivers, see the documentation that comes with each device.
System management Ethernet
AC
DC
!
System serial
Video USB
AC
DC
!
QPI ports 3 - 4
The server comes with at least one microprocessor. If more than one microprocessor is installed, the server can operate as a symmetric multiprocessing (SMP) server. You might have to upgrade the operating system to support SMP. For more information, see “Typical operating-system installation” on page 94 and the operating-system documentation.
If the server has an optional RAID adapter and you have installed or removed a hard disk drive, see the documentation that comes with the RAID adapter for information about reconfiguring the disk arrays.
For information about configuring the integrated Gigabit Ethernet controller, see “Configuring the Broadcom Gigabit Ethernet controller” on page 98.
Installing hardware devices in the MAX5 expansion module
The following sections provide detailed instructions for installing optional hardware devices in the optional IBM MAX5 for System x memory expansion module.
MAX5 components
The following illustration shows the major components in the MAX5 memory expansion module. The illustrations in this document might differ slightly from your hardware.
72 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Removing the MAX5 bezel
To remove the MAX5 expansion module bezel, complete the following steps:
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. Press in on the release tabs on both ends of the bezel and pull it off the chassis.
Chapter 2. Installing optional devices 73
Alignment tab
Release tab
Alignment tab
Removing the MAX5 system-board tray
To remove the MAX5 system-board tray, complete the following steps:
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. Turn off the host server (see “Turning off the server” on page 17) and all attached peripheral devices. Disconnect all power cords from the MAX5; then, disconnect all external cables from the MAX5.
3. Remove the bezel (see “Removing the MAX5 bezel” on page 73).
4. Grasp the blue release latches on the system-board tray handles and press the release latches in opposite directions and rotate the handles to the fully open position.
Bezel
Release tab
Stop-tab
5. Grasp the handles and pull the system-board tray out until it stops; then, press in the blue stop-tabs on both sides of the system-board tray and pull the tray out of the chassis.
74 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Handle
Release latch
Stop-tab
Handle
Release latch
If you have other devices to install or remove, do so now. Otherwise, go to “Completing the MAX5 installation” on page 81.
Installing a MAX5 memory module
The following notes describe the types of DIMMs that the MAX5 memory expansion module supports and other information that you must consider when you install DIMMs.
v The MAX5 supports a maximum of 32 DIMMs (single-rank, dual-rank, or
quad-rank).
Note: To determine the type of a DIMM, see the label on the DIMM. The information on the label is in the format xxxxx nRxxx PC3-xxxxx-xx-xx-xxx. The numeral in the sixth numerical position indicates whether the DIMM is single-rank (n=1) or dual-rank (n=2).
v The DIMM options that are available for the MAX5 are 2 GB, 4 GB, 8 GB, and
16 GB (when available).
v The MAX5 supports a minimum of 4 GB and a maximum of 512 GB of system
memory.
v When you populate DIMMs in the MAX5, populate the larger capacity DIMMs
first; then the smaller capacity DIMMs. See Table 10 on page 76 for non-mirroring mode DIMM population sequence and Table 11 on page 77 for memory-mirroring mode DIMM population sequence.
v The MAX5 provides eight memory ports (memory channels) and each memory
port supports up to four DIMMs. Do not mix DIMMs with x4 technology (DIMMs with DRAMs that are organized with 4 data lanes) and x8 technology (DIMMs with DRAMs that are organized with 8 data lanes) in the same memory port.
Table 8. Memory ports and DIMM connectors
Memory ports DIMM connectors
1 1,2,7,and8 2 3,4,5,and6 3 9, 10, 15, and 16 4 11, 12, 13, and 14 5 17, 18, 23, and 24 6 19, 20, 21, and 22 7 25, 26, 31, and 32 8 27, 28, 29, and 30 Note: 2 GB, 4 GB, and 8 GB DIMMs are x4 technology DIMMs. 16 GB and 32 GB DIMMs
are x8 technology DIMMs.
v Do not mix DIMMs with 1 Gb (gigabit) technology, 2 Gb DRAM technology, or
other gigabit DRAM technologies in banks of eight DIMMs on memory ports that are on the same memory controller. This is not supported on the MAX5. The following table lists the DIMM connectors for each bank of eight DIMMs that are on the memory ports within the same memory controller.
Table 9. DIMM banks and connectors
Bank of DIMMs DIMM connectors
1st bank of DIMMs 1, 2, 3, 4, 5, 6, 7, and 8 2nd bank of DIMMs 9, 10, 11, 12, 13, 14, 15, and 16
Chapter 2. Installing optional devices 75
Table 9. DIMM banks and connectors (continued)
Bank of DIMMs DIMM connectors
3rd bank of DIMMs 17, 18, 19, 20, 21, 22, 23, and 24 4th bank of DIMMs 25, 26, 27, 28, 29, 30, 31, and 32
v DIMMs must be installed in pairs for non-mirroring mode and in sets of four for
memory-mirroring mode.
v A minimum of two DIMMs must be installed in the MAX5 for each microprocessor
in the host server.
v The maximum operating speed of the MAX5 is determined by the slowest DIMM
installed in the MAX5.
v The MAX5 does not come with any DIMMs installed when you purchase it as a
option. When you install DIMMs, install them in the order shown in the following tables to optimize system performance.
v The server supports non-mirroring mode and memory-mirroring mode.
Non-mirroring mode. When you use the non-mirroring mode, install DIMMs
as indicated in the following table:
Table 10. Non-mirroring mode DIMM population sequence for the MAX5 memory expansion module
Pairs of DIMMs DIMM connector population sequence
Pair 1 28, 29 Pair 2 9, 16 Pair 3 1, 8 Pair 4 20, 21 Pair 5 26, 31 Pair 6 11, 14 Pair 7 3, 6 Pair 8 18, 23 Pair 9 27, 30 Pair 10 10, 15 Pair 11 2, 7 Pair 12 19, 22 Pair 13 25, 32 Pair 14 12, 13 Pair 15 4, 5 Pair 16 17, 24
Note: When you populate DIMMs in the MAX5, populate the larger capacity DIMMs first; then the smaller capacity DIMMs.
Memory-mirroring mode. When you use the mirroring mode feature,
consider the following information:
- Memory-mirroring mode replicates and stores data on sets of DIMMs simultaneously. If a failure occurs, the memory controller switches from the primary set of DIMMs to the backup set of DIMMs. To enable memory mirroring through the Setup utility, select System Settings Memory. For more information, see “Using the Setup utility” on page 87.
76 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
- DIMMs must be installed in sets of four. The DIMMs in each set must be
the same size and type. This is applicable also when the MAX5 expansion module is attached to a host server and the host server has an optional memory tray installed in the server. You must install DIMMs in sets of four DIMMs for memory-mirroring mode in each (server, memory tray, and the MAX5).
- The maximum available memory is reduced to half of the installed memory
when memory mirroring is enabled. For example, if the MAX5 expansion module has 64 GB of memory installed, only 32 GB of addressable memory is available when you use memory mirroring.
- The following table lists the DIMM installation sequence for
memory-mirroring mode.
Table 11. Memory-mirroring mode DIMM population sequence for the MAX5 memory expansion module
Sets of 4 DIMMs DIMM connector population sequence
Set 1 9, 16, 28, 29 Set 2 1, 8, 20, 21 Set 3 11, 14, 26, 31 Set 4 3, 6, 18, 23 Set 5 10, 15, 27, 30 Set 6 2, 7, 19, 22 Set 7 12, 13, 25, 32 Set 8 4, 5, 17, 24
Note: When you populate DIMMs in the MAX5, populate the larger capacity DIMMs first; then the smaller capacity DIMMs.
The following illustration shows the location of the DIMMs connectors on the system-board tray.
Chapter 2. Installing optional devices 77
To install a memory module in the MAX5 expansion module, complete the following steps.
Note: The MAX5 might come with DIMM fillers on DIMM connectors that are not populated. Remove them before you install DIMMs in those connectors.
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. Turn off the host server (see “Turning off the server” on page 17) and all attached peripheral devices. Disconnect all power cords from the MAX5; then, disconnect all external cables from the MAX5.
3. Remove the bezel (see “Removing the MAX5 bezel” on page 73).
4. Remove the system-board tray (see “Removing the MAX5 system-board tray” on page 74).
5. Remove any DIMM fillers from the DIMM slots that you want to populate.
6. Touch the static-protective package that contains the new DIMM to any unpainted metal surface on the outside of the MAX5; then, remove the DIMM from the package.
7. Carefully open both retaining clips on each end of the DIMM connector. Attention: To avoid breaking the retaining clips or damaging the DIMM
connectors, open and close the clips gently.
8. Turn the DIMM so that the DIMM keys align correctly with the connector.
78 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
9. Insert the DIMM into the connector by aligning the edges of the DIMM with the slots at the ends of the DIMM connector.
10. Firmly press the DIMM straight down into the connector by applying pressure on both ends of the DIMM simultaneously. The retaining clips snap into the locked position when the DIMM is firmly seated in the connector.
Note: If there is a gap between the DIMM and the retaining clips, the DIMM has not been correctly inserted; open the retaining clips, remove the DIMM, and then reinsert it.
11. Replace the system-board tray (see “Replacing the MAX5 system-board tray” on page 81). Grasp the system-board tray on both sides (near the stop-tabs) and align the system-board tray with the chassis.
12. Slide the system-board tray forward until the tabs on the bottom of the handles touch the chassis; then, close the handles and press firmly on the release latches to snap them into the locked position.
If you have other devices to install or remove, do so now. Otherwise, go to “Completing the MAX5 installation” on page 81.
Installing a MAX5 hot-swap power supply
The following notes describe the type of power supply that the MAX5 expansion module supports and other information that you must consider when you install a power supply:
v The IBM MAX5 for System x memory expansion module comes with one
675-watt hot-swap 12-volt output power supply. The input voltage is 110 V ac or 220 V ac auto-sensing. Two power supplies must be installed for redundancy support.
Note: You cannot mix 110 V ac and 220 V ac power supplies in the MAX5, it is not supported.
v These power supplies are designed for parallel operation. In the event of a
power-supply failure, the redundant power supply continues to power the system. The memory expansion module supports a maximum of two power supplies.
Statement 5:
Chapter 2. Installing optional devices 79
CAUTION: The power control button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device. The device also might have more than one power cord. To remove all electrical current from the device, ensure that all power cords are disconnected from the power source.
2
1
Statement 8
CAUTION: Never remove the cover on a power supply or any part that has the following label attached.
Hazardous voltage, current, and energy levels are present inside any component that has this label attached. There are no serviceable parts inside these components. If you suspect a with one of these parts, contact a service technician.
To install a hot-swap power supply in the MAX5 memory expansion module, complete the following steps:
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. If the server is in a rack, at the back of the server, pull back the cable-management arm to gain access to the rear of the server and the power supply.
3. If you are installing a hot-swap power supply into an empty bay, remove the power-supply filler panel from the power-supply bay.
4. Touch the static-protective package that contains the hot-swap power supply to any unpainted metal surface on the server; then, remove the power supply from the package and place it on a static-protective surface.
5. Grasp the handle on the rear of the power supply and slide the power supply forward into the power-supply bay until it clicks. Make sure that the power supply connects firmly into the power-supply connector.
80 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
6. Route the power cord through the power cord retention clip so that it does not accidentally become disconnected.
7. Connect the power cord for the new power supply to the power-cord connector on the power supply.
8. Connect the other end of the power cord to a properly grounded electrical outlet.
9. Make sure that the ac power LED and the dc power LED on the power supply are lit, indicating that the power supply is operating correctly. The two green LEDs are to the right of the power-cord connector.
If you have other devices to install or remove, do so now. Otherwise, go to “Completing the MAX5 installation.”
Completing the MAX5 installation
To complete the MAX5 expansion module installation, complete the following steps:
1. Reinstall the system-board tray (see “Replacing the MAX5 system-board tray.”).
2. Reinstall the MAX5 bezel (see “Replacing the MAX5 bezel” on page 82).
3. Reconnect the cables and power cords (see “Connecting the MAX5 cables” on page 82).
4. Slide the MAX5 and the server back into the rack, if necessary.
5. Turn on the peripheral devices and the host server
Replacing the MAX5 system-board tray
To replace the system-board tray, complete the following step:
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. Grasp the system-board tray on both sides (near the stop-tabs) and align the system-board tray with the chassis.
Chapter 2. Installing optional devices 81
Stop-tab
Handle
Release latch
Stop-tab
Handle
Release latch
3. Slide the system-board tray forward until the tabs at the bottom of the handles touch the chassis; then, close the handles and press firmly on the release latches to snap them into the locked position.
4. Replace the bezel (see “Replacing the MAX5 bezel”).
Replacing the MAX5 bezel
To replace the MAX5 bezel, complete the following steps:
1. Read the safety information that begins on page vii and “Installation guidelines” on page 32.
2. Align the bezel alignment tabs with the chassis and press the bezel onto the chassis until it snaps into place.
Connecting the MAX5 cables
To cable the MAX5 to the host server, see the QPI cable option documentation and the EXA cable option documentation. Be sure to turn off the host server before you connect any cables to or disconnect any cables from the MAX5 memory expansion module.
82 IBM System x3850 X5 and x3950 X5 Types 7145 and 7146: Installation and User’s Guide
Alignment tab
Alignment tab
Release tab
Bezel
Release tab
Loading...