IBM System x3650 M4 BD Type 5466 Installation And Service Manual

Download



System x3650 M4 BD Type 5466

Installation and Service Guide



System x3650 M4 BD Type 5466

Installation and Service Guide

Note

Before using this information and the product it supports, read the general information in Appendix D, “Getting help and technical assistance,” on page 747, “Notices” on page 751, the Warranty Information document, and the Safety Information and Environmental Notices and User Guide documents on the IBM Documentation CD.

Fifth Edition (August 2014)

US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

Safety ...............vii

Safety statements ............ix

Chapter 1. The IBM System x3650 M4

BD Type 5466 server .........1

The IBM Documentation CD .........3

Hardware and software requirements .....3

Using the Documentation Browser ......4

Safety

Before installing this product, read the Safety Information.

Antes de instalar este produto, leia as Informações de Segurança.

Læs sikkerhedsforskrifterne, før du installerer dette produkt.

Lees voordat u dit product installeert eerst de veiligheidsvoorschriften.

Ennen kuin asennat tämän tuotteen, lue turvaohjeet kohdasta Safety Information.

Avant d'installer ce produit, lisez les consignes de sécurité.

Vor der Installation dieses Produkts die Sicherheitshinweise lesen.

Prima di installare questo prodotto, leggere le Informazioni sulla Sicurezza.

Les sikkerhetsinformasjonen (Safety Information) før du installerer dette produktet.

Antes de instalar este produto, leia as Informações sobre Segurança.

Antes de instalar este producto, lea la información de seguridad.

Läs säkerhetsinformationen innan du installerar den här produkten.

viii System x3650 M4 BD Type 5466: Installation and Service Guide

Safety statements

These statements provide the caution and danger information that is used in this documentation.

Important:

Each caution and danger statement in this documentation is labeled with a number. This number is used to cross reference an English-language caution or danger statement with translated versions of the caution or danger statement in the Safety Information document.

For example, if a caution statement is labeled Statement 1, translations for that caution statement are in the Safety Information document under Statement 1.

Be sure to read all caution and danger statements in this documentation before you perform the procedures. Read any additional safety information that comes with your system or optional device before you install the device.

Statement 1

DANGER

Electrical current from power, telephone, and communication cables is hazardous.

To avoid a shock hazard:

v Do not connect or disconnect any cables or perform installation,

maintenance, or reconfiguration of this product during an electrical storm.

v Connect all power cords to a properly wired and grounded electrical outlet.

v Connect to properly wired outlets any equipment that will be attached to

this product.

v When possible, use one hand only to connect or disconnect signal cables.

v Never turn on any equipment when there is evidence of fire, water, or

structural damage.

v Disconnect the attached power cords, telecommunications systems,

networks, and modems before you open the device covers, unless instructed otherwise in the installation and configuration procedures.

v Connect and disconnect cables as described in the following table when

installing, moving, or opening covers on this product or attached devices.

To Connect: To Disconnect:

1. Turn everything OFF.

2. First, attach all cables to devices.

3. Attach signal cables to connectors.

4. Attach power cords to outlet.

5. Turn device ON.

1. Turn everything OFF.

2. First, remove power cords from outlet.

3. Remove signal cables from connectors.

4. Remove all cables from devices.

Safety ix

Statement 2

CAUTION: When replacing the lithium battery, use only IBM®Part Number 33F8354 or an equivalent type battery recommended by the manufacturer. If your system has a module containing a lithium battery, replace it only with the same module type made by the same manufacturer. The battery contains lithium and can explode if not properly used, handled, or disposed of.

Do not:

v Throw or immerse into water

v Heat to more than 100°C (212°F)

v Repair or disassemble

Dispose of the battery as required by local ordinances or regulations.

Statement 3

CAUTION: When laser products (such as CD-ROMs, DVD drives, fiber optic devices, or transmitters) are installed, note the following:

v Do not remove the covers. Removing the covers of the laser product could

result in exposure to hazardous laser radiation. There are no serviceable parts inside the device.

v Use of controls or adjustments or performance of procedures other than those

specified herein might result in hazardous radiation exposure.

x System x3650 M4 BD Type 5466: Installation and Service Guide

DANGER

Some laser products contain an embedded Class 3A or Class 3B laser diode. Note the following.

Laser radiation when open. Do not stare into the beam, do not view directly with optical instruments, and avoid direct exposure to the beam.

Statement 4

CAUTION: Use safe practices when lifting.

≥ 18 kg (39.7 lb) ≥ 32 kg (70.5 lb) ≥ 55 kg (121.2 lb)

Statement 5

CAUTION: The power control button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device. The device also might have more than one power cord. To remove all electrical current from the device, ensure that all power cords are disconnected from the power source.

Safety xi

Statement 6

CAUTION: If you install a strain-relief bracket option over the end of the power cord that is connected to the device, you must connect the other end of the power cord to an easily accessible power source.

Statement 8

CAUTION: Never remove the cover on a power supply or any part that has the following label attached.

Hazardous voltage, current, and energy levels are present inside any component that has this label attached. There are no serviceable parts inside these components. If you suspect a problem with one of these parts, contact a service technician.

Statement 11

CAUTION: The following label indicates sharp edges, corners, or joints nearby.

Statement 12

xii System x3650 M4 BD Type 5466: Installation and Service Guide

CAUTION: The following label indicates a hot surface nearby.

Statement 13

DANGER

Overloading a branch circuit is potentially a fire hazard and a shock hazard under certain conditions. To avoid these hazards, ensure that your system electrical requirements do not exceed branch circuit protection requirements. Refer to the information that is provided with your device for electrical specifications.

Statement 15

CAUTION: Make sure that the rack is secured properly to avoid tipping when the server unit is extended.

Statement 17

CAUTION: The following label indicates moving parts nearby.

Statement 26

Safety xiii

CAUTION: Do not place any object on top of rack-mounted devices.

Statement 27

CAUTION: Hazardous moving parts are nearby.

xiv System x3650 M4 BD Type 5466: Installation and Service Guide

Chapter 1. The IBM System x3650 M4 BD Type 5466 server

This Installation and Service Guide contains information and instructions for setting up yourIBM System x3650 M4 BD Type 5466 server, instructions for installing some optional devices, cabling and configuring the server, removing and replacing devices, and diagnostics and troubleshooting information.

In addition to the instructions in Chapter 2, “Installing optional devices,” on page 23 for installing optional hardware devices, updating firmware and device drivers, and completing the installation, IBM Business Partners must also complete the steps in “Instructions for IBM Business Partners” on page 24.

The IBM System x3650 M4 BD Type 5466 is a 2-U-high rack model, two-socket server for virtualization, database, and computational intensive computing. This high-performance, multi-core server is ideally suited for enterprise environments that require superior input/output (I/O) flexibility, scalability, and high manageability.

Performance, ease of use, reliability, and expansion capabilities were key considerations in the design of the server. These design features make it possible for you to customize the system hardware to meet your needs today and provide flexible expansion capabilities for the future.

The server comes with a limited warranty. For information about the terms of the warranty and getting service and assistance, see the IBM Warranty Information document that comes with the server.

The server contains IBM next generation technologies, which help increase performance and reliability. For more information, see “What your server offers” on page 11 and “Reliability, availability, and serviceability” on page 14.

You can obtain up-to-date information about the server and other IBM server products at http://www.ibm.com/systems/x/. At http://www-947.ibm.com/ support/entry/portal/overview, you can create a personalized support page by identifying IBM products that are of interest to you. From this personalized page, you can subscribe to weekly e-mail notifications about new technical documents, search for information and downloads, and access various administrative services.

If you participate in the IBM client reference program, you can share information about your use of technology, best practices, and innovative solutions; build a professional network; and gain visibility for your business. For more information about the IBM client reference program, see http://www.ibm.com/ibm/ clientreference/.

The server supports up to fourteen 3.5-inch hot-swap drives (two of the 3.5-inch hot-swap hard disk drives are located at the rear of the server) using the supported drive backplane configurations. It supports 3.5-inch hot-swap Serial Attached SCSI (SAS) or SATA hard disk drives. The illustrations in this document might differ slightly from your hardware.

Note: Hard disk drive status reporting can be managed by ServeRAID software. See the RAID documentation on the IBM ServeRAID Support CD for information about RAID controllers.

The following illustrations show the controls, connectors, and hard disk drive bays on the front of the server.

12 hot-swap hard-disk drive configuration:

Figure 1. 12 hot-swap hard-disk drive configuration

If firmware and documentation updates are available, you can download them from the IBM website. The server might have features that are not described in the documentation that comes with the server, and the documentation might be updated occasionally to include information about those features, or technical updates might be available to provide additional information that is not included in the server documentation. To check for updates, go to http://www-

947.ibm.com/support/entry/portal/overview.

Record information about the server in the following table.

Table 1. . Record of the system information

Product name Machine Type (s) Model number Serial number

IBM System x3650 M4 BD

Type 5466

The model number and serial number can be found on the front of the server. Depending on your server model, their respective locations can be found either in the following two illustrations.

Note: The illustrations in this document might differ slightly from your hardware.

Figure 2. The model number and serial number

In addition, the system service label, which is on the cover of the server, provides a QR code for mobile access to service information. You can scan the QR code using

2 System x3650 M4 BD Type 5466: Installation and Service Guide

a QR code reader and scanner with a mobile device and get quick access to the IBM Service Information website. The IBM Service Information website provides additional information for parts installation and replacement videos, and error codes for server support.

The following illustration shows the QR code (http://ibm.co/18gSeXv):

Figure 3. QR code

You can download an IBM ServerGuide Setup and Installation CD to help you configure the hardware, install device drivers, and install the operating system.

For a list of supported optional devices for the server, see http://www.ibm.com/ systems/info/x86servers/serverproven/compat/us/.

See the Rack Installation Instructions document on the IBM Documentation CD for complete rack installation and removal instructions.

The IBM Documentation CD

The IBM Documentation CD contains documentation for the server in Portable Document Format (PDF) and includes the IBM Documentation Browser to help you find information quickly.

Hardware and software requirements

The IBM Documentation CD requires the following minimum hardware and software:

v Microsoft Windows XP, Windows 2000, or Red Hat Linux v 100 MHz microprocessor v 32 MB of RAM v Adobe Acrobat Reader 3.0 (or later) or xpdf, which comes with Linux operating

systems

Chapter 1. The IBM System x3650 M4 BD Type 5466 server 3

Using the Documentation Browser

Use the Documentation Browser to browse the contents of the CD, read brief descriptions of the documents, and view documents, using Adobe Acrobat Reader or xpdf. The Documentation Browser automatically detects the regional settings in use in your server and displays the documents in the language for that region (if available). If a document is not available in the language for that region, the English-language version is displayed.

Use one of the following procedures to start the Documentation Browser: v If Autostart is enabled, insert the CD into the CD or DVD drive. The

Documentation Browser starts automatically.

v If Autostart is disabled or is not enabled for all users, use one of the following

procedures: – If you are using a Windows operating system, insert the CD into the CD or

DVD drive and click Start -> Run.IntheOpen field, type

e:\win32.bat

where e is the drive letter of the CD or DVD drive, and click OK.

– If you are using Red Hat Linux, insert the CD into the CD or DVD drive;

then, run the following command from the /mnt/cdrom directory:

sh runlinux.sh

Select the server from the Product menu. The Available Topics list displays all the documents for the server. Some documents might be in folders. A plus sign (+) indicates each folder or document that has additional documents under it. Click the plus sign to display the additional documents.

When you select a document, a description of the document is displayed under Topic Description. To select more than one document, press and hold the Ctrl key while you select the documents. Click View Book to view the selected document or documents in Acrobat Reader or xpdf. If you selected more than one document, all the selected documents are opened in Acrobat Reader or xpdf.

To search all the documents, type a word or word string in the Search field and click Search. The documents in which the word or word string appears are listed in order of the most occurrences. Click a document to view it, and press Crtl+F to use the Acrobat search function, or press Alt+F to use the xpdf search function within the document.

Click Help for detailed information about using the Documentation Browser.

4 System x3650 M4 BD Type 5466: Installation and Service Guide

Notices and statements in this document

The caution and danger statements in this document are also in the multilingual Safety Information document, which is on the IBM Documentation CD. Each statement is numbered for reference to the corresponding statement in your language in the Safety Information document.

The following notices and statements are used in this document:

v Note: These notices provide important tips, guidance, or advice. v Important: These notices provide information or advice that might help you

avoid inconvenient or problem situations.

v Attention: These notices indicate potential damage to programs, devices, or data.

An attention notice is placed just before the instruction or situation in which damage might occur.

v Caution: These statements indicate situations that can be potentially hazardous

to you. A caution statement is placed just before the description of a potentially hazardous procedure step or situation.

v Danger: These statements indicate situations that can be potentially lethal or

extremely hazardous to you. A danger statement is placed just before the description of a potentially lethal or extremely hazardous procedure step or situation.

Server features and specifications

The following information is a summary of the features and specifications of the server. Depending on the model, some features might not be available, or some specifications might not apply.

Racks are marked in vertical increments of 4.45 cm (1.75 inches). Each increment is referred to as a unit, or “U.” A 1-U-high device is 1.75 inches tall.

Microprocessor (depending on the model):

v Supports up to two multi-core microprocessors (one installed) v Two QuickPath Interconnect (QPI) links speed up to 8.0 GT per second v Designed for LGA 2011 socket v Scalable up to twelve cores v 32 KB instruction cache, 32 KB data cache, and up to 30 MB L3 cache

that is shared among the cores

Note:

v Use the Setup utility to determine the type and speed of the

microprocessors.

v For a list of supported microprocessors, see http://www.ibm.com/

systems/info/x86servers/serverproven/compat/us/

Memory (depending on the model):

v Minimum: 4 GB v Maximum: 512 GB v Type: 1600 MHz or 1866 MHz (Depending on the configuration)

– UDIMM: 4 GB or 8GB – RDIMM: 4 GB, 8 GB, or 16 GB – LRDIMM: 32 GB

v Single-rank or dual-rank v Slots: 16

6 System x3650 M4 BD Type 5466: Installation and Service Guide

Drive expansion bays:

v Twelve front 3.5-inch SAS/SATA hot-swap hard disk drive bays v Two rear 3.5-inch SAS/SATA hot-swap hard disk drive bays v Twelve front 2.5-inch hot-swap solid state drive bays (through converter

trays)

v Two rear 2.5-inch hot-swap solid state drive bays (through converter

trays)

PCI expansion slots:

Supports three different PCI adapters and up to 3 PCI expansion slots depending on server model.

v Riser 1

– Type 1

- Slot 1: PCI Express full-height-half-length)

- Slot 2: PCI Express*3.0 x8 (low-profile)

– Type 2

- Slot 1: PCI Express*3.0 x16 (full-height-half-length)

v Riser 2

– Slot 3 (internal slot): PCI Express

Integrated functions:

v Integrated Management Module II (IMM2), which provides service

processor control and monitoring functions, video controller, and remote keyboard, video, mouse, and remote hard disk drive capabilities

v Onboard Intel Powerville 3-port Gigabit Ethernet controller with Wake

on LAN support

v Seven Universal Serial Bus (USB) 2.0 ports (two on front and four on

rear of the server, one for Hypervisor USB key)

v One serial port v One video port on rear of server

3.0 x8 (full-height-half-length,

3.0 x8 (low-profile)

Note:

1. Maximum video resolution is 1600 x 1200 at 75 Hz.

2. In messages and documentation, the term service processor refers to

the integrated management module II (IMM2).

Integrated Video controller:

v Matrox G200eR2

Note: The maximum video resolution is 1600 x 1200 at 75 Hz. – SVGA compatible video controller – DDR2-250MHz SDRAM video memory controller – No DVI connector – Avocent Digital Video Compression – 16 MB of video memory (not expandable)

ServeRAID controllers:

v ServeRAID M1115 SAS/SATA Controller for IBM System x v ServeRAID M5110 SAS/SATA Controller for IBM System x v ServeRAID M5120 SAS/SATA Controller for IBM System x v ServeRAID H1110 SAS/SATA Controller for IBM System x v ServeRAID M5100 Series Battery Kit for IBM System X

Chapter 1. The IBM System x3650 M4 BD Type 5466 server 7

v M5210 SAS/SATA Controller for IBM System x v N2115 SAS/SATA HBA for IBM System x v IBM 6Gb Performance Optimized HBA

ServeRAID controller upgrade:

v ServeRAID M5100 Series 512MB Cache/RAID 5 Upgrade for IBM

System x

v ServeRAID M5100 Series 512MB Flash/RAID 5 Upgrade for IBM System

v ServeRAID M1100 Series Zero Cache/RAID 5 Upgrade for IBM System x v ServeRAID M5100 Series Zero Cache/RAID 5 Upgrade for IBM System x v ServeRAID M5100 Series RAID 6 Upgrade for IBM System x v ServeRAID M5100 Series 1GB Flash/RAID Upgrade for IBM System x v ServeRAID M5100 Series 2GB Cache/RAID 5 Upgrade for IBM System x

For more information on Features on Demand (FoD), including instructions for automating the activation and installation of the activation key by using IBM ToolsCenter or IBM Director, see the IBM System x Features on Demand User's Guide at under the Help section.

Environment:

v Air temperature:

– Server on: 5°C to 40°C (41°F to 104°F); altitude: 0 to 915 m (3000 ft). – Server on: 5°C to 32°C (41°F to 89.6°F); altitude: 915 m (3000 ft) to

2134 m (7000 ft).

– Server on: 5°C to 28°C (41°F to 82.4°F); altitude: 2134 m (7000 ft) to

3050 m (10000 ft). – Server off: 5°C to 45°C (41°F to 113°F) – Shipping: -40°C to 60°C (-40°F to 140°F)

v Humidity:

– Server on: 8% to 80%; maximum dew point: 21°C; maximum rate of

change: 5 °C/hr – Server off: 8% to 80%; maximum dew point: 27°C

v Design to ASHRAE Class A3, ambient of 35°C to 40°C, with relaxed

support: – Support cloud like workload with no performance degradation

acceptable (Turbo-Off) – Under no circumstance, can any combination of worst case workload

and configuration result in system shutdown or design exposure at

40°C

v Particulate contamination:

Attention: Airborne particulates and reactive gases acting alone or in combination with other environmental factors such as humidity or temperature might pose a risk to the server. For information about the limits for particulates and gases, see “Particulate contamination” on page

753.

Electrical input with hot-swap ac power supplies:

v Input voltage low range:

– Minimum: 100 V ac – Maximum: 127 V ac

v Input voltage high range:

– Minimum: 200 V ac – Maximum: 240 V ac

v Sine-wave input (50 ~ 60 Hz) required v Input voltage range automatically selected v Input kilovolt-amperes (kVA) approximately:

8 System x3650 M4 BD Type 5466: Installation and Service Guide

– Minimum: 0.11 kVA

– Maximum: 0.9 kVA

Size:

v 2U v Height: 86.5 mm (3.406 in.) v Depth:

– EIA flange to rear: 720.2 mm (28.35 in.)

– Overall: 748.8 mm (29.5 in.)

v Width:

– With top cover: 447 mm (17.6 in.)

v Weight: approximately 16.4 kg (Min.) and up to 29.8 kg (Max.)

depending on your configuration

System fans:

Front side: three Rear side: two

Hot-swap power supplies (depending on the model):

v Up to two hot-swap power supplies for redundancy support

– 750-watt ac

– 900-watt ac

Note: You cannot mix high-efficiency and non-high-efficiency power supplies in the server.

Acoustical noise emissions:

v Sound power, idle: 6.5 bel v Sound power, operating: 6.5 bel

Notes:

1. Power consumption and heat output vary depending on the number and type of optional features installed and the power-management optional features in use.

2. The noise emission level stated is the declared (upper limit) sound power level, in bels, for a random sample of machines. All measurements made in accordance with ISO 7779 and renorted in conformance with ISO 9296.

EU Regulation 617/2013 Technical Documentation:

International Business Machines Corporation New Orchard Road Armonk, New York 10504 http://www.ibm.com/customersupport/

For more information on the energy efficiency program, go to http://www.ibm.com/systems/x/hardware/energy-star/index.html

Product Type:

Computer Server

Year first manufactured:

2014

Internal/external power supply efficiency:

v http://www.plugloadsolutions.com/psu_reports/

IBM_FSA011_550W_SO-301_Report.pdf

Chapter 1. The IBM System x3650 M4 BD Type 5466 server 9

v http://www.plugloadsolutions.com/psu_reports/IBM_7001676-

XXXX_550W_SO-458_Report.pdf

v http://www.plugloadsolutions.com/psu_reports/IBM_7001605-

XXXX_750W_SO-258_Report.pdf

v http://www.plugloadsolutions.com/psu_reports/SO-299_IBM_DPS-

750AB-1_750W_Report.pdf

v http://www.plugloadsolutions.com/psu_reports/IBM_7001606-

XXXX_900W_SO-273_Report.pdf

v http://www.plugloadsolutions.com/psu_reports/IBM_DPS-900CB

%20A_900W_SO-440_Report.pdf

Maximum power (watts):

See Power supply.

Idle state power (watts):

411

Sleep mode power (watts):

N/A for servers

Off mode power (watts):

Noise levels (the declared A-weighed sound power level of the computer):

See Acoustical noise emissions.

Test voltage and frequency:

230V/50Hzor60Hz

Total harmonic distortion of the electricity supply system:

The maximum harmonic content of the input voltage waveform will be equal or less than 2%. The qualification is compliant with EN 61000-3-2.

Information and documentation on the instrumentation set-up and circuits used for electrical testing:

ENERGY STAR Test Method for Computer Servers; ECOVA Generalized Test Protocol for Calculating the Energy Efficiency of Internal Ac-Dc and Dc-Dc Power Supplies.

Measurement methodology used to determine information in this document:

ENERGY STAR Servers Version 2.0 Program Requirements; ECOVA Generalized Test Protocol for Calculating the Energy Efficiency of Internal Ac-Dc and Dc-Dc Power Supplies.

10 System x3650 M4 BD Type 5466: Installation and Service Guide

What your server offers

The server uses the following features and technologies.

v Features on Demand

If a Features on Demand feature is integrated in the server or in an optional device that is installed in the server, you can purchase an activation key to activate the feature. For information about Features on Demand, see /http://www.ibm.com/systems/x/fod/.

v Integrated Management Module II The integrated management module II

(IMM2) is the second generation of the IMM. The IMM2 is the common management controller for IBM System x hardware. The IMM2 consolidates multiple management functions in a single chip on the server system board.

Some of the features that are unique to the IMM2 are enhanced performance, expanded compatibility with blade servers, higher-resolution remote video, expanded security options, and Feature on Demand enablement for hardware and firmware options.

For additional information, see “Using the integrated management module II” on page 99.

v UEFI-compliant server firmware IBM System x Server Firmware (server

firmware) offers several features, including Unified Extensible Firmware Interface (UEFI) 2.1 compliance; Active Energy Manager technology; enhanced reliability, availability, and serviceability (RAS) capabilities; and basic input/output system (BIOS) compatibility support. UEFI replaces the BIOS and defines a standard interface between the operating system, platform firmware, and external devices. UEFI-compliant System x servers are capable of booting UEFI-compliant operating systems, BIOS-based operating systems, and BIOS-based adapters as well as UEFI-compliant adapters.

Note: The server does not support DOS (Disk Operating System).

v IBM Dynamic System Analysis Preboot diagnostics programs The Dynamic

System Analysis (DSA) Preboot diagnostics programs are stored on the integrated USB memory. It collects and analyzes system information to aid in diagnosing server problems. The diagnostic programs collect the following information about the server:

– System configuration – Network interfaces and settings – Installed hardware – Light path diagnostics status – Service processor status and configuration – Vital product data, firmware, and UEFI (formerly BIOS) configuration – Hard disk drive health – RAID controller configuration – Event logs for ServeRAID controllers and service processors The diagnostic programs create a merged log that includes events from all

collected logs. The information is collected into a file that you can send to IBM service and support. Additionally, you can view the information locally through a generated text report file. You can also copy the log to a removable media and view the log from a web browser.

For additional information about DSA Preboot diagnostics, see the Problem Determination and Service Guide on the IBM System x Documentation CD

v Multi-core processing

Chapter 1. The IBM System x3650 M4 BD Type 5466 server 11

The server supports up to two Intel Xeon™E5-2600v2 series multi-core microprocessors. The server comes with only one microprocessor installed.

v Mobile access to IBM Service Information website

The server provides a QR code on the system service label, which is on the cover of the server, that you can scan using a QR code reader and scanner with a mobile device to get quick access to the IBM Service Information website. The IBM Service Information website provides additional information for parts installation and replacement videos, and error codes for server support. For the QR code, see QR code information on page Chapter 1, “The IBM System x3650 M4 BD Type 5466 server,” on page 1.

v IBM Systems Director CD

IBM Systems Director is a workgroup-hardware-management tool that you can use to centrally manage System x and xSeries servers. For more information, see the IBM Systems Director documentation on the IBM Systems Director CD and “IBM Systems Director” on page 15

v IBM X-Architecture

technology

IBM X-Architecture technology combines proven, innovative IBM designs to make your Intel-processor-based server powerful, scalable, and reliable. For more information, see .

™

– Active

Memory active memorymemory

The Active Memory feature improves the reliability of memory through memory mirroring. Memory mirroring mode replicates and stores data on two pairs of DIMMs within two channels simultaneously. If a failure occurs, the memory controller switches from the primary pair of memory DIMMs to the backup pair of DIMMs. For more information about installing DIMMs for memory mirroring, see “Memory module installation” on page 60.

– Large system-memory capacity

The server supports up to a maximum of 512 GB of system memory. The server supports only industry-standard double-data-rate 3 (DDR3) - 1600 MHz or 1866 MHz (depending on the configuration), synchronous dynamic random-access memory (SDRAM) registered dual inline memory modules (DIMMs) with error correcting code (ECC). For further details, see Problem Determination and Service Guide on the IBM System x Documentation CD.

v IBM ServerGuide Setup and Installation CD

The ServerGuide Setup and Installation CD, which you can download from the web, provides programs to help you set up the server and install a Windows operating system. The ServerGuide program detects installed optional hardware devices and provides the correct configuration programs and device drivers. For more information about the ServerGuide Setup and Installation CD, see “Using the ServerGuide Setup and Installation CD” on page 90.

v Integrated network support

The server comes with an integrated 3-port Gigabit Ethernet controller, which supports connection to a 10 Mbps, 100 Mbps, or 1000 Mbps network. For more information, see “Configuring the Gigabit Ethernet controller” on page 104.

v Integrated Trusted Platform Module (TPM)

This integrated security chip performs cryptographic functions and stores private and public secure keys. It provides the hardware support for the Trusted Computing Group (TCG) specification. You can download the software to support the TCG specification, when the software is available. See http://www.ibm.com/servers/eserver/xseries/scalable_family.html for details about the TPM implementation. You can enable TPM support through the Setup utility under the System Security menu option.

12 System x3650 M4 BD Type 5466: Installation and Service Guide

v Large data-storage capacity and hot-swap capability

The hot-swap server models support a maximum of fourteen 3.5-inch hot-swap Serial Attached SCSI (SAS) hard disk drives or hot-swap Serial ATA (SATA) hard disk drives.

With the hot-swap feature, you can add, remove, or replace hard disk drives without turning off the server.

v Light path diagnostics

Light path diagnostics provides LEDs to help you diagnose problems. For more information about the light path diagnostics, see “Light path diagnostics” on page 122

v PCI adapter capabilities

Based on the server configuration, the server may possibly support up to three PCI expansion slots. See “Installing an adapter on the PCI riser-card assembly” on page 46 for detailed information.

v Active Energy Manager

The IBM Active Energy Manager solution is an IBM Systems Director extension that measures and reports server power consumption as it occurs. This enables you to monitor power consumption in correlation to specific software application programs and hardware configurations. You can obtain the measurement values through the systems-management interface and view them, using IBM Systems Director. For more information, including the required levels of IBM Systems Director and Active Energy Manager, see the IBM Systems Director Information Center at http://publib.boulder.ibm.com/infocenter/ director/v6r1x/index.jsp?topic=/director_6.1/fqm0_main.html, or see http://www-03.ibm.com/systems/software/director/resources.html.

v Redundant connection

The IMM2 provides failover capability to a redundant Ethernet connection with the applicable application installed. If a problem occurs with the primary Ethernet connection, all Ethernet traffic that is associated with the primary connection is automatically switched to the optional redundant Ethernet connection. If the applicable device drivers are installed, this switching occurs without data loss and without user intervention.

v Redundant cooling and optional power capabilities

The server supports a maximum of two 750-watt or 900-watt hot-swap power supplies and three dual-motor non hot-swap fans, which provide redundancy for a typical configuration. The redundant cooling by the fans in the server enables continued operation if one of the fans fails. The server comes with one 750-watt or 900-watt hot-swap power supply and three non hot-swap fans.

Note: You cannot mix 750-watt and 900-watt power supplies in the server.

v ServeRAID support

The ServeRAID adapter provides hardware redundant array of independent disks (RAID) support to create configurations. The standard RAID adapter provides RAID levels 0 and 1. An optional RAID adapter is available for purchase.

v Systems-management capabilities

The server comes with an integrated management module II (IMM2). When the IMM2 is used with the systems-management software that comes with the server, you can manage the functions of the server locally and remotely. The IMM2 also provides system monitoring, event recording, and network alert capability. The system-management connector on the rear of the server is dedicated to the IMM2. The dedicated system-management connector provides

Chapter 1. The IBM System x3650 M4 BD Type 5466 server 13

additional security by separating the management network traffic from the production network. You can use the Setup utility to configure the server to use a dedicated systems-management network or a shared network.

Reliability, availability, and serviceability

Three important computer design features are reliability, availability, and serviceability (RAS). The RAS features help to ensure the integrity of the data that is stored in the server, the availability of the server when you need it, and the ease with which you can diagnose and correct problems.

The server has the following RAS features:

v Automatic error retry and recovery v Automatic restart after a power failure v Built-in monitoring for fan, power, temperature, voltage, and power-supply

redundancy

v Cable-presence detection on most connectors v Chipkill memory protection v Dual redundant UEFI server firmware images v Error codes and messages v Error correcting code (ECC) L2 cache and system memory v Cooling fans with speed-sensing capability v Hot-swap hard disk drives (for servers that support such drives) v Information and light path diagnostics LED panels v Integrated management module (service processor) v Memory mirroring v Menu-driven setup, system configuration, and redundant array of independent

disks (RAID) configuration programs

v Parity checking or CRC checking on the serially-attached SCSI (SAS) bus and

PCI buses

v Power management: compliance with Advanced Configuration and Power

Interface (ACPI)

v Power-on self-test (POST) v Predictive Failure Analysis (PFA) alerts on memory, SAS/SATA hard disk drives

and fans

v Redundant Ethernet capabilities with failover support v Redundant hot-swap power supplies v Remote system problem-determination support v Standby voltage for systems-management features and monitoring v Startup (boot) from LAN through Preboot Execution Environment (PXE) boot

agent utility or Dynamic Host Configuration Protocol/Boot Protocol (DHCP/BOOTP)

v System auto-configuring from the configuration menu v System error logging (POST and service processor) v Systems-management monitoring through the Inter-Integrated Circuit (I v Upgradeable POST, UEFI, diagnostics, service processor microcode, and

read-only memory (ROM) resident code, locally or over the LAN

v Vital product data (VPD) on microprocessors, system board, power supplies, and

SAS (hot-swap-drive) backplane

v Wake on LAN capability for remote power up

C) bus

14 System x3650 M4 BD Type 5466: Installation and Service Guide

IBM Systems Director

IBM Systems Director is a platform-management foundation that streamlines the way you manage physical and virtual systems in a heterogeneous environment. By using industry standards, IBM Systems Director supports multiple operating systems and virtualization technologies in IBM and non-IBM x86 platforms.

Through a single user interface, IBM Systems Director provides consistent views for viewing managed systems, determining how these systems relate to one other, and identifying their statuses, helping to correlate technical resources with business needs. A set of common tasks that are included with IBM Systems Director provides many of the core capabilities that are required for basic management, which means instant out-of-the-box business value. The common tasks are listed below:

v Discovery v Inventory v Configuration v System health v Monitoring v Updates v Event notification v Automation for managed systems

The IBM Systems Director Web and command-line interfaces provide a consistent interface that is focused on driving these common tasks and capabilities:

v Discovering, navigating, and visualizing systems on the network with the

detailed inventory and relationships to the other network resources

v Notifying users of problems that occur on systems and the ability to isolate the

sources of the problems

v Notifying users when systems need updates and distributing and installing

updates on a schedule

v Analyzing real-time data for systems and setting critical thresholds that notify

the administrator of emerging problems

v Configuring settings of a single system and creating a configuration plan that

can apply those settings to multiple systems

v Updating installed plug-ins to add new features and functions to the base

capabilities

v Managing the life cycles of virtual resources

For more information about IBM Systems Director, see the IBM Systems Director Information Center at http://publib.boulder.ibm.com/infocenter/director/v6r1x/ index.jsp?topic=/director_6.1/fqm0_main.html, and the Systems Management web page at http://www.ibm.com/systems/management/, which presents an overview of IBM Systems Management and IBM Systems Director.

Chapter 1. The IBM System x3650 M4 BD Type 5466 server 15

Server controls, LEDs, and power

This section describes the controls and light-emitting diodes (LEDs) and how to turn the server on and off.

For the locations of other LEDs on the system board, see “System-board LEDs” on page 29.

Front view

The following illustration shows the controls, connectors, and hard disk drive bays on the front of the server.

12 hot-swap hard-disk drive configuration:

Figure 4. 12 hot-swap hard-disk drive configuration

v USB connectors: Connect a USB device, such as USB mouse or keyboard to

either of these connectors.

v Hard disk drive activity LEDs (green):This green LED is used on hot-swap SAS

or SATA hard disk drives. Each hot-swap hard disk drive has an activity LED, and when this LED is flashing, it indicates that the drive is in use.

v Hard disk drive status LEDs (yellow):This yellow LED is used on hot-swap

SAS/SATA hard disk drives. Each hot-swap hard disk drive has a status LED. When this LED is lit, it indicates that the drive has failed. When this LED is flashing slowly (one flash per second), it indicates that the drive is being rebuilt as part of a RAID configuration. When the LED is flashing rapidly (three flashes per second), it indicates that the controller is identifying the drive.

v Operator information panel: This panel contains the power control button and

light-emitting diodes (LEDs).

16 System x3650 M4 BD Type 5466: Installation and Service Guide

Operator information panel

The section shows the controls and LEDs on the operator information panel.

The operator information panel is located on the side of the server.

Figure 5. Operator information panel

v Power-control button and power-on LED: Press this button to turn the server

on and off manually. The states of the power-on LED are as follows: – Off: Power is not present or the power supply, or the LED itself has failed. – Flashing rapidly (4 times per second): The server is turned off and is not

ready to be turned on. The power-control button is disabled. This will last approximately 5 to 10 seconds.

– Flashing slowly (once per second): The server is turned off and is ready to

be turned on. You can press the power-control button to turn on the server.

– Lit: The server is turned on.

v System-locator button/LED: Use this blue LED to visually locate the server

among other servers. A system-locator LED is also on the rear of the server. This LED is used as a presence detection button as well. You can use IBM Systems Director or IMM2 web interface to light this LED remotely. This LED is controlled by the IMM2. The locator button is pressed to visually locate the server among the others servers.

v Check log LED: When this yellow LED is lit, it indicates that a system error has

occurred. Check the error log for additional information. See the“Error messages” on page 131 for more information about event logs.

v System-error LED: When this yellow LED is lit, it indicates that a system error

has occurred. A system-error LED is also on the rear of the server. An LED on the light path diagnostics panel on the operator information panel is also lit to help isolate the error. This LED is controlled by the IMM2.

v Reset button: Press this button to reset the server and run the power-on self-test

(POST). You might have to use a pen or the end of a straightened paper clip to press the button.

Note: Depending on the type of operator information panel installed in your server, the Reset button is on the operator information panel or the light path diagnostics panel.

Chapter 1. The IBM System x3650 M4 BD Type 5466 server 17

Rear view

The following illustration shows the connectors on the rear of the server.

Figure 6. IMM network interface port

v Systems-management Ethernet connector:Use this connector to connect the

server to a network for full systems-management information control. This connector is used only by the integrated management module (IMM2). A dedicated management network provides additional security by physically separating the management network traffic from the production network. You can use the Setup utility to configure the server to use a dedicated systems management network or a shared network.

v Ethernet connectors:Use either of these connectors to connect the server to a

network. When you enable shared Ethernet for IMM2 in the Setup utility, you can access the IMM2 using either the Ethernet 1 or the system-management Ethernet (default - Ethernet 4) connector. See Using the Setup utility for more information.

v PCI slot connectors:

– PCI slot 1: Insert a full-height, half-length PCI Express – PCI slot 2: Insert a low-profile PCI Express*adapter into this slot. – PCI slot 3: Insert a low-profile PCI Express*adapter into this slot.

adapter into this slot.

Connect the power cord to this connector.

v Power-cord connector: Connect the power cord to this connector. v USB connectors: Each power supply has a dc power LED and an ac power LED.

When the dc power LED is lit, it indicates that the power supply is supplying adequate dc power to the system. During normal operation, both the ac and dc power LEDs are lit. For any other combination of LEDs, see “Power-supply LEDs” on page 20.

v NMI button: Press this button to force a nonmaskable interrupt to the

microprocessor. It allows you to blue screen the server and take a memory dump (use this button only when directed by the IBM service support). You might have to use a pen or the end of a straightened paper clip to press the button.

18 System x3650 M4 BD Type 5466: Installation and Service Guide

v Serial connector: Connect a 9-pin serial device to this connector. The serial port

is shared with the integrated management module II (IMM2). The IMM2 can take control of the shared serial port to perform text console redirection and to redirect serial traffic.

v Video connector: Connect a monitor to this connector.

Note: The maximum video resolution is 1600 x 1200 at 75 Hz.

The following illustration shows the LEDs on the rear of the server.

Figure 7. LEDs rear view

v Ethernet activity LEDs: When these LEDs are lit, they indicate that the server is

transmitting to or receiving signals from the Ethernet LAN that is connected to the Ethernet port.

v Ethernet link LEDs: When these LEDs are lit, they indicate that there is an

active link connection on the 10BASE-T, 100BASE-TX, or 1000BASE-TX interface for the Ethernet port.

v AC power LED: Each hot-swap power supply has an AC power LED and a DC

power LED. When the AC power LED is lit, it indicates that sufficient power is coming into the power supply through the power cord. During typical operation, both the AC and DC power LEDs are lit. For any other combination of LEDs, see “Power-supply LEDs” on page 20.

v DC power LED: Each hot-swap power supply has a DC power LED and an AC

power LED. When the DC power LED is lit, it indicates that the power supply is supplying adequate DC power to the system. During typical operation, both the AC and DC power LEDs are lit. For any other combination of LEDs, see “Power-supply LEDs” on page 20.

v Power-supply error LED: When the power-supply error LED is lit, it indicates

that the power supply has failed.

v System-locator LED: Use this LED to visually locate the server among other

servers. You can use IBM Systems Director or IMM2 web interface to light this LED remotely.

v System-error LED: When this LED is lit, it indicates that a system error has

occurred. An LED on the light path diagnostics panel is also lit to help isolate the error.

Chapter 1. The IBM System x3650 M4 BD Type 5466 server 19

PCI riser-card adapter expansion slot locations

The section shows the PCI expansion slot connector locations on the server.

Figure 8. PCI expansion slot connector locations

Power-supply LEDs

This section shows the power-supply LEDs on the server.

The following illustration shows the power-supply LEDs on the rear of the server.

Figure 9. Power-supply LEDs

The following table describes the problems that are indicated by various combinations of the power-supply LEDs and suggested actions to correct the detected problems.

Table 2. Power-supply LEDs status and required action

Power-supply LEDs

(green) DC (green)

On On Off Normal operation Off Off Off No ac power to the

Error

(yellow)

Description Action Notes

server or a problem with the ac power source

1. Check the ac power to the server.

2. Make sure that the power cord is connected to a functioning power source.

3. Turn the server off and then turn the server back on.

4. If the problem remains, replace the power supply.

This is a normal condition when no ac power is present.

20 System x3650 M4 BD Type 5466: Installation and Service Guide

Table 2. Power-supply LEDs status and required action (continued)

Power-supply LEDs

(green) DC (green)

Off Off On No ac power to the

Off On Off Faulty

Off On On Faulty

On Off Off Power supply not

On Off or

Flashing

On On On Power supply is

Error

(yellow)

On Faulty power

Description Action Notes

server or a problem with the ac power source and the power supply had detected an internal problem

power-supply

fully seated, faulty system board, faulty power supply, or system not power-on

supply

faulty but still operational

1. Replace the power supply.

2. Make sure that the power

cord is connected to a functioning power source.

Replace the power supply.

1. Reseat the power supply.

2. Replace the power supply.

3. (Trained service technician

only) Replace the system board.

Replace the power supply.

This happens only when a second power supply is providing power to the server.

Typically indicates that a power supply is not fully seated.

Server power features

When the server is connected to a power source but is not turned on, the operating system does not run, and all core logic except for the integrated management module II (IMM2) is shut down.

However, the server can respond to requests from the IMM2, such as a remote request to turn on the server. The power-on LED flashes to indicate that the server is connected to power but is not turned on.

Turning on the server

Use this information to turn on the server.

Approximately 40 seconds after the server is connected to power, the power-control button becomes active, and one or more fans might start running to provide cooling while the server is connected to power. You can turn on the server and start the operating system by pressing the power-control button.

The server can also be turned on in any of the following ways: v If a power failure occurs while the server is turned on, the server will restart

automatically when power is restored.

v If your operating system supports the Wake on LAN feature, the Wake on LAN

feature can turn on the server.

For 32-bit operating systems only: Some memory is reserved for various system resources and is unavailable to the operating system. The amount of memory that is reserved for system resources depends on the operating system, the

Chapter 1. The IBM System x3650 M4 BD Type 5466 server 21

configuration of the server, and the configured PCI options.

Turning off the server

Use this information to turn off the server.

When you turn off the server and leave it connected to power, the server can respond to requests from the IMM2, such as a remote request to turn on the server. While the server remains connected to power, one or more fans might continue to run. To remove all power from the server, you must disconnect it from the power source.

Some operating systems require an orderly shutdown before you turn off the server. See your operating-system documentation for information about shutting down the operating system.

Statement 5

The server can be turned off in any of the following ways: v You can turn off the server from the operating system, if your operating system

supports this feature. After an orderly shutdown of the operating system, the server will be turned off automatically.

v You can press the power-control button to start an orderly shutdown of the

operating system and turn off the server, if your operating system supports this feature.

v If the operating system stops functioning, you can press and hold the

power-control button for more than 4 seconds to turn off the server.

v The IMM2 can turn off the server as an automatic response to a critical system

failure.

v You can turn off the server through a request from the IMM2.

22 System x3650 M4 BD Type 5466: Installation and Service Guide

Chapter 2. Installing optional devices

This chapter provides detailed instructions for installing optional hardware devices in the server.

In addition to the instructions in this chapter for installing optional hardware devices, updating the firmware and device drivers, and completing the installation, IBM Business Partners must also complete the steps in “Instructions for IBM Business Partners” on page 24.

Important: To help ensure that the devices that you install work correctly and do not introduce problems, observe the following precautions:

1. Make sure that the server and the installed firmware levels support the devices that you are installing. If necessary, update the UEFI and IMM firmware and any other firmware that is stored on the system board. For information about where firmware is stored in the server, see“Updating the firmware” on page 87. For a list of supported optional devices for the server, go to http://www.ibm.com/systems/info/x86servers/serverproven/compat/us/.

2. Before you install optional hardware devices, make sure that the server is working correctly. Start the server and make sure that the operating system starts, if an operating system is installed, or that a 19990305 error code is displayed, indicating that an operating system was not found but the server is otherwise working correctly. If the server is not working correctly, see “Running the DSA Preboot diagnostic programs” on page 129 for information about how to run diagnostics.

3. Follow the installation procedures in this chapter and use the correct tools. Incorrectly installed device can cause system failure because of damaged pins in sockets or connectors, loose cabling, or loose components.

4. Use the best practices to apply current firmware and device-driver updates for the server and optional devices. To download the Firmware Update Guides document, go to www.ibm.com/support/entry/portal/ docdisplay?lndocid=MIGR-5082923&brandind=5000008. Additional hints and tips are available from the following sites:

v IBM support: http://www-947.ibm.com/support/entry/portal/overview v System x configuration tools: http://www-03.ibm.com/systems/x/

hardware/configtools.html

Installing optional hardware devices in the server

This following sections provide detailed instructions for installing optional hardware devices in the server.

Instructions for IBM Business Partners

Instructions for IBM Business Partners on verifying the newly installed devices by running the Dynamic System Analysis (DSA) stress test.

In addition to the instructions in this chapter for installing optional hardware devices, updating firmware and device drivers, and completing the installation, IBM Business Partners must also complete the following steps:

1. After you have confirmed that the server starts correctly and recognizes the newly installed devices and that no error LEDs are lit, run the Dynamic System Analysis (DSA) stress test. For information about using DSA, see “IBM Dynamic System Analysis” on page 127.

2. Shut down and restart the server multiple times to ensure that the server is correctly configured and functions correctly with the newly installed devices.

3. Save the DSA log as a file and send it to IBM. For information about transferring data and logs, see “How to send DSA data to IBM.”

4. To ship the server, repackage it in the original undamaged packing material and observe IBM procedures for shipping.

Support information for IBM Business Partners is available at http:// www.ibm.com/partnerworld/pwhome.nsf/weblook/index_us.html.

How to send DSA data to IBM

Use the IBM Enhanced Customer Data Repository to send diagnostic data to IBM.

Before you send diagnostic data to IBM, read the terms of use at http://www-05.ibm.com/de/support/ecurep/terms.html.

You can use any of the following methods to send diagnostic data to IBM:

v Standard upload: http://www.ibm.com/de/support/ecurep/send_http.html v Standard upload with the system serial number: http://www.ecurep.ibm.com/

app/upload_hw

v Secure upload: http://www.ibm.com/de/support/ecurep/

send_http.html#secure

v Secure upload with the system serial number: https://www.ecurep.ibm.com/

app/upload_hw

24 System x3650 M4 BD Type 5466: Installation and Service Guide

Server components

The following illustration shows the major components in the server.

The illustrations in this document might differ slightly from your hardware.

Top cover

Air baffle

Adapter

1U PCI riser-card assembly 1

1U PCI riser-card assembly 2

Rear fan

Front Fan

3.5-inch SAS/SATA front backplane with 12 hard disk drives

3.5-inch hot-swap hard disk drive filler

3.5-inch hot-swap hard disk drive

Figure 10. Server components

Battery carrier

Operator information panel

Heat sink

Microprocessor

DIMM

System board

240VA cover

ServeRaid adapter battery

3.5-inch SAS/SATA rear backplane

3.5-inch hard disk drive cage

Power-supply filler

Top power-supply paddle card

Lower power-supply paddle card

Power-supply

Chapter 2. Installing optional devices 25

Server internal LEDs, connectors, and jumpers

The illustrations in this section show the connectors, LEDs, and jumpers on the internal boards.

The illustrations might differ slightly from your hardware.

System-board internal connectors

The following illustration shows the internal connectors on the system board.

Figure 11. System board internal connectors

System-board DIMM connectors

The following illustration shows the DIMM connectors on the system board.

26 System x3650 M4 BD Type 5466: Installation and Service Guide

Figure 12. System board DIMM connectors

System-board external connectors

The following illustration shows the external input/output connectors on the system board.

Figure 13. System board external connectors

Chapter 2. Installing optional devices 27

System-board jumpers

This section describes the jumpers on the system board.

Figure 14. System board jumpers

Table 3. System board jumpers

Jumper number Jumper name Jumper setting

CN14 Clear CMOS jumper

J2 UEFI boot recovery jumper

J9 IMM TPM jumper

v Pins 1 and 2: Normal

(default) - This keeps the CMOS data.

v Pins 2 and 3: This clears

the CMOS data such as power-on password and loads the default UEFI settings.

Note 2

v Pins 1 and 2: Normal

(default) Loads the primary firmware ROM page.

v Pins 2 and 3: Loads the

secondary (backup) firmware ROM page.

Notes 1 and 2

v Pins 1 and 2: Normal

(default) TPM not physical present.

v Pins 2 and 3: TPM

physical present.

28 System x3650 M4 BD Type 5466: Installation and Service Guide

Table 3. System board jumpers (continued)

Jumper number Jumper name Jumper setting

Note:

1. If no jumper is present, the server responds as if the pins are set to 1 and 2.

2. Changing the position of the UEFI recovery jumper from pins 1 and 2 to pins 2 and 3

before the server is turned on sets the UEFI recovery process. Do not change the jumper pin position after the server is turned on. This can cause an unpredictable problem.

Important:

1. Before you change any switch settings or move any jumpers, turn off the server; then, disconnect all power cords and external cables. (Review the information on page“Safety” on page vii, “Installation guidelines” on page 32, “Handling static-sensitive devices” on page 34, and “Turning off the server” on page 22.

2. Any system-board switch or jumper blocks that are not shown in the illustrations in this document are reserved.

System-board LEDs

The following illustration shows the light-emitting diodes (LEDs) on the system board.

Figure 15. System board LEDs

Table 4. System board LEDs definition

LED name Description

Error LEDs When an error LED is lit, it indicates that

the associated component has failed.

RTMM heartbeat LED Power-on and power-off sequencing.

Chapter 2. Installing optional devices 29

Table 4. System board LEDs definition (continued)

LED name Description

IMM 2 heartbeat LED Indicates the status of the boot process of

the IMM2.

When the server is connected to power this LED flashes quickly to indicate that the IMM2 code is loading. When the loading is complete, the LED stops flashing briefly and then flashes slowly to indicate that the IMM2 if fully operational and you can press the power-control button to start the server.

Standby power LED When this LED is flashing, it indicates that

the server is connected to an ac power source.

When this LED is lit, it indicates that the

server is dc power on. System board error LED System-board has failed. Microprocessor mismatch LED When this LED is lit, it indicates that

microprocessor 1 is not installed, or the

microprocessors do not have the same cache

size and type, and clock speed. DIMM error LEDs A memory DIMM has failed or is incorrectly

installed. Microprocessor error LED Microprocessor has failed, is missing, or has

been incorrectly installed. Light path LED Indicates whether or not the lightpath

button is functional. If the light path LED is

lit after pressing the lightpath button, it

indicates that the lightpath button is

functioning properly. By contrast, if the

lightpath LED is not lit when pressing the

light path button, it means the lightpath

button is not functioning properly.

PCI riser-card adapter expansion slot connectors

The following illustration shows the respective expansion slot connectors on the three different types of PCI riser card assemblies that the server is capable of supporting.

Note: The specifications of the following slot labeling is defined in the following format.

PCIe3 x aa (b, c, d, e)

where:

v aa = Physical connector link width v b, c, d, e = Negotiable link width

PCI riser-card assembly 1 v Type 1

30 System x3650 M4 BD Type 5466: Installation and Service Guide

Figure 16. PCI riser-card assembly 1 (Type 1)

v Type 2

Figure 17. PCI riser-card assembly 1 (Type 2)

PCI riser-card assembly 2

Figure 18. PCI riser-card assembly 2

Chapter 2. Installing optional devices 31

Installation guidelines

Use the installation guidelines to install the System x3650 M4 BD Type 5466.

Attention:

v Static electricity that is released to internal server components when the server is

powered-on might cause the system to halt, which might result in the loss of data. To avoid this potential problem, always use an electrostatic-discharge wrist strap or other grounding system when removing or installing a hot-swap device.

v This product is not intended to be connected directly or indirectly by any means

whatsoever to interfaces of public telecommunications networks, neither to be used in Public Services Network.

Before you install optional devices, read the following information: v Read the safety information that begins on page “Safety” on page vii and the

guidelines in “Handling static-sensitive devices” on page 34. This information will help you work safely.

v Make sure that the devices that you are installing are supported. For a list of

supported optional devices for the server, go to http://www.ibm.com/systems/ info/x86servers/serverproven/compat/us/.

v When you install your new server, take the opportunity to download and apply

the most recent firmware updates. This step will help to ensure that any known issues are addressed and that your server is ready to function at maximum levels of performance. To download firmware updates for your server, go to http://www.ibm.com/support/fixcentral/.

Important: Some cluster solutions require specific code levels or coordinated code updates. If the device is part of a cluster solution, verify that the latest level of code is supported for the cluster solution before you update the code.

For additional information about tools for updating, managing, and deploying firmware, see the ToolsCenter for System x and BladeCenter at http://www.ibm.com/support/entry/portal/docdisplay?lndocid=TOOLCENTER.

v Before you install optional hardware, make sure that the server is working

correctly. Start the server, and make sure that the operating system starts, if an operating system is installed, or that a 19990305 error code is displayed, indicating that an operating system was not found but the server is otherwise working correctly. If the server is not working correctly, see “Running the DSA Preboot diagnostic programs” on page 129 for information about how to run diagnostics.

v Observe good housekeeping in the area where you are working. Place removed

covers and other parts in a safe place.

v Do not attempt to lift an object that you think is too heavy for you. If you have

to lift a heavy object, observe the following precautions: – Make sure that you can stand safely without slipping. – Distribute the weight of the object equally between your feet. – Use a slow lifting force. Never move suddenly or twist when you lift a heavy

object.

– To avoid straining the muscles in your back, lift by standing or by pushing

up with your leg muscles.

v Make sure that you have an adequate number of properly grounded electrical

outlets for the server, monitor, and other devices.

v Back up all important data before you make changes to disk drives.

32 System x3650 M4 BD Type 5466: Installation and Service Guide

v Have a small flat-blade screwdriver available. v To view the error LEDs on the system board and internal components, leave the

server connected to power.

v You do not have to turn off the server to install or replace hot-swap power

supplies, hot-swap fans, or hot-plug Universal Serial Bus (USB) devices. However, you must turn off the server before you perform any steps that involve removing or installing adapter cables and you must disconnect the power source from the server before you perform any steps that involve removing or installing a riser card.

v Blue on a component indicates touch points, where you can grip the component

to remove it from or install it in the server, open or close a latch, and so on.

v Orange on a component or an orange label on or near a component indicates

that the component can be hot-swapped, which means that if the server and operating system support hot-swap capability, you can remove or install the component while the server is running. (Orange can also indicate touch points on hot-swap components.) See the instructions for removing or installing a specific hot-swap component for any additional procedures that you might have to perform before you remove or install the component.

v When you are finished working on the server, reinstall all safety shields, guards,

labels, and ground wires.

System reliability guidelines

The system reliability guidelines to ensure proper system cooling.

To help ensure proper system cooling and system reliability, make sure that the following requirements are met:

v Each of the drive bays has a drive or a filler panel and electromagnetic

compatibility (EMC) shield installed in it.

v If the server has redundant power, each of the power-supply bays has a power

supply installed in it.

v There is adequate space around the server to allow the server cooling system to

work properly. Leave approximately 50 mm (2.0 in.) of open space around the front and rear of the server. Do not place objects in front of the fans. For proper cooling and airflow, replace the server cover before you turn on the server.

v You have followed the cabling instructions that come with optional adapters. v You have replaced a failed fan within 48 hours. v You have replaced a hot-swap drive within 2 minutes of removal. v You do not operate the server without the air baffles installed. Operating the

server without the air baffles might cause the microprocessor to overheat.

Chapter 2. Installing optional devices 33

Working inside the server with the power on

Guidelines to work inside the server with the power on.

Attention:

v IBM System x3650 M4 BD Type 5466 does not support service on rack. v Static electricity that is released to internal server components when the server is

powered-on might cause the server to halt, which might result in the loss of data. To avoid this potential problem, always use an electrostatic-discharge wrist strap or other grounding system when you work inside the server with the power on.

You might have to have the server turned on while the cover is off, to look at light path diagnostics LEDs or replace hot swap components. Follow these guidelines when you work inside a server that is turned on:

v Avoid wearing loose-fitting clothing on your forearms. Button long-sleeved

shirts before working inside the server; do not wear cuff links while you are working inside the server.

v Do not allow your necktie or scarf to hang inside the server. v Remove jewelry, such as bracelets, necklaces, rings, and loose-fitting wrist

watches.

v Remove items from your shirt pocket, such as pens and pencils, that could fall

into the server as you lean over it.

v Avoid dropping any metallic objects, such as paper clips, hairpins, and screws,

into the server.

Handling static-sensitive devices

Use this information to handle static-sensitive devices.

Attention: Static electricity can damage the server and other electronic devices. To avoid damage, keep static-sensitive devices in their static-protective packages until you are ready to install them.

To reduce the possibility of damage from electrostatic discharge, observe the following precautions:

v Limit your movement. Movement can cause static electricity to build up around

you.

v The use of a grounding system is highly recommended. For example, wear an

electrostatic-discharge wrist strap, if one is available. Always use an electrostatic-discharge wrist strap or other grounding system when working inside the server with the power on

v Handle the device carefully, holding it by its edges or its frame. v Do not touch solder joints, pins, or exposed circuitry. v Do not leave the device where others can handle and damage it. v While the device is still in its static-protective package, have the device be in

contact to an unpainted metal surface on the outside of the server for at least 2 seconds. This drains static electricity from the package and from your body.

v Remove the device from its package and install it directly into the server

without setting down the device. If it is necessary to set down the device, put it back into its static-protective package. Do not place the device on the server top cover or on a metal surface.

v Take additional care when handling devices during cold weather. Heating

reduces indoor humidity and increases static electricity.

34 System x3650 M4 BD Type 5466: Installation and Service Guide

Removing the server top cover

Use this information to remove the server top cover.

About this task

To remove the server top cover, complete the following steps:

Procedure

1. Read the safety information that begins on page“Safety” on page vii and “Installation guidelines” on page 32.

2. Turn off the server (see “Turning off the server” on page 22) and all attached peripheral devices. Disconnect all power cords; then, disconnect all external cables as necessary to replace the device.

3. If the server has been installed in a rack, press the two release latches on the front of the server and remove the server out of the rack enclosure.

Attention:

v Two or more people are required to remove the system from a rack cabinet. v To completely remove the server from the rack, press the latches on the sides

on the slide rails.

Figure 19. Latch

4. Loosen the two thumbscrews that secure the cover to the rear of the server.

5. Press on the two blue grip points and slide the cover toward the rear; then, lift

the cover off the server and set it aside. Attention: For proper cooling and airflow and to avoid damaging server

components, replace the cover before you turn on the server.

Chapter 2. Installing optional devices 35

Figure 20. Cover removal

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

Rotating the hot-swap rear hard disk drive cage up

Use this information to rotate the hot-swap rear hard disk drive cage up.

About this task

To rotate the hot-swap hard disk drive cage up, complete the following steps.

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

3. Remove the server top cover (see “Removing the server top cover” on page 35.

4. Open the two respective blue latches on the chassis▌1▐ .

5. Slowly rotate the rear hard disk drive cage outwards until it stops ▌2▐.

6. Shift the switch on the rear hard disk drive cage to the lock position to keep

the hard disk drive cage fixed ▌3▐.

36 System x3650 M4 BD Type 5466: Installation and Service Guide

Figure 21. Hot-swap rear hard disk drive cage rotation

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

Removing a PCI riser-card assembly

Use this information to remove a PCI riser-card assembly from the server.

About this task

To remove the PCI riser-card assembly, complete the following steps:

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

3. Remove the server top cover (see “Removing the server top cover” on page

258).

4. Rotate the hot-swap rear hard disk drive cage up (see “Rotating the hot-swap rear hard disk drive cage up” on page 36

5. If an adapter is installed in the PCI riser-card assembly, disconnect any cables that are connected to the adapter.

6. Grasp the front and rear of the PCI riser-card assembly at the blue touch-points and lift it out of the PCI riser connector on the system board.

Chapter 2. Installing optional devices 37

Figure 22. PCI riser-card assembly 1 removal

Figure 23. PCI riser-card assembly 2 removal

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

38 System x3650 M4 BD Type 5466: Installation and Service Guide

Removing the air baffle

Use this information to remove the air baffle from the server.

About this task

When you work with some optional devices, you must first remove the air baffle to access some components or connectors on the system board. The following illustration shows how to remove the air baffle.

To remove the air baffle, complete the following steps:

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

2. Turn off the server (see “Turning off the server” on page 22) and all attached peripheral devices. Disconnect all power cords; then, disconnect all external cables from the server.

3. Remove the top cover (see “Removing the server top cover” on page 35).

4. Rotate the hot-swap rear hard disk drive cage up (see “Rotating the hot-swap

rear hard disk drive cage up” on page 36.

5. Grasp the top of the air baffle and lift it out of the server. Attention: For proper cooling and airflow, replace the air baffle before you

turn on the server. Operating the server with the air baffle removed might damage server components.

Figure 24. Air baffle removal

Chapter 2. Installing optional devices 39

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

Removing a hot-swap hard disk drive

Use this information to remove a hot-swap hard disk drive from the server.

About this task

Attention:

v To avoid damage to the drive connectors, make sure that the server cover is in

place and fully closed whenever you install or remove a drive.

v To make sure that there is adequate system cooling, do not operate the server for

more than 2 minutes without either a drive or a filler panel installed in each bay.

Figure 25. Hot-swap hard disk drive removal

To remove a hot-swap hard disk drive, complete the following steps:

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

2. Press the release latch on the side of the drive front.

3. Grasp the handle and pull the hot-swap drive assembly out of the drive bay.

Note: You might have to reconfigure the disk arrays after you remove a hard disk drive. See the RAID documentation on the IBM ServeRAID Support CD for information about RAID controllers.

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

40 System x3650 M4 BD Type 5466: Installation and Service Guide

Removing an adapter from the PCI riser-card assembly

Use this information to remove an adapter from the PCI riser-card assembly.

About this task

To remove an adapter from the PCI riser-card assembly, complete the following steps:

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

3. Remove the server cover (see “Removing the server top cover” on page 258).

4. Rotate the hot-swap rear hard disk drive cage up (see “Rotating the hot-swap

rear hard disk drive cage up” on page 36.

5. Disconnect any cables from the adapter (make note of the cable routing, in case you reinstall the adapter later).

6. Remove the PCI riser-card assembly 1 or 2 (see “Removing a PCI riser-card assembly” on page 37).

7. The following illustrates the steps for removing an adapter from the PCI riser-card assemblies:

v For PCI riser-card assembly 1:

a. Rotate the retention latch to the open position. b. Carefully grasp the adapter by its top edge or upper corners, and pull the

adapter from the PCI riser-card assembly.

Chapter 2. Installing optional devices 41

Figure 26. Adapter removal

8. Place the adapter on a flat, static-protective surface.

9. If you are instructed to return the adapter, follow all packaging instructions,

and use any packaging materials for shipping that are supplied to you.

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

Removing a ServeRAID adapter from the PCI riser-card assembly

Use this information to remove a ServeRAID adapter from the PCI riser-card assembly.

About this task

To remove a ServeRAID adapter from the PCI riser-card assembly, complete the following steps:

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

3. Remove the server cover (see “Removing the server top cover” on page 258).

4. Rotate the hot-swap rear hard disk drive cage up (see “Rotating the hot-swap

rear hard disk drive cage up” on page 36.

42 System x3650 M4 BD Type 5466: Installation and Service Guide

5. Remove PCI riser-card assembly 1 or 2 (see “Removing a PCI riser-card assembly” on page 37).

6. The following illustrates the steps for removing an adapter from the PCI riser-card assemblies:

v For PCI riser-card assembly 1:

a. Rotate the retention latch to the open position. b. Carefully grasp the ServeRAID adapter by its top edge or upper corners,

and pull the ServeRAID adapter from the PCI riser-card assembly.

Figure 27. ServeRAID adapter removal

v For PCI riser-card assembly 2:

a. Pull the release pin to unlock the retention latch; then rotate the retention

latch to the open position.

b. Carefully grasp the ServeRAID adapter by the edge and pull it out of PCI

riser-card assembly 2.

Chapter 2. Installing optional devices 43

Figure 28. ServeRAID adapter removal

7. If you are instructed to return the ServeRAID adapter, follow all packaging instructions, and use any packaging materials for shipping that are supplied to you.

Note: When the ServeRAID adapter is removed, software RAID will not be supported. This system does not support downgrade software RAID function from hardware RAID configuration.

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

Installing a hot-swap hard disk drive

Use this information to a hot-swap hard disk drive into the server.

About this task

The following notes describe the type of hard disk drives that the server supports and other information that you must consider when you install a drive. For a list of supported drives, see http://www.ibm.com/systems/info/x86servers/ serverproven/compat/us/

v Locate the documentation that comes with the hard disk drive and follow those

instructions in addition to the instructions in this chapter.

v The system supports support up to fourteen 3.5-inch hot-swap SAS/SATA hard

disk drives (two 3.5-inch hot-swap SAS/SATA hard disk drives are located at the rear of the server).

v All hot-swap drives in the server should have the same throughput speed rating.

Using hard disk drives with different speed ratings will cause all drives to operate at the throughput speed of the slowest drive.

Attention: To maintain proper system cooling, do not operate the server for more than 10 minutes without either a drive or a filler panel installed in each bay.

To install a drive in a hot-swap bay, complete the following steps:

44 System x3650 M4 BD Type 5466: Installation and Service Guide

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

2. Touch the static-protective package that contains the drive to any unpainted metal surface on the server; then, remove the drive from the package and place it on a static-protective surface.

3. Remove the drive filler panel from one of the empty hot-swap bays.

4. Install the hard disk drive in the hot-swap bay: a. Orient the drive as shown in the illustration. b. Make sure that the tray handle is open. c. Align the drive assembly with the guide rails in the bay.

Figure 29. Hot-swap hard disk drive installation

d. Gently push the drive assembly into the bay until the drive stops. e. Push the tray handle to the closed (locked) position. f. If the system is turned on, check the hard disk drive status LED to verify

that the hard disk drive is operating correctly.

5. Check the drive status LED to verify that the drive is operating correctly. If the yellow drive status LED for a drive is lit continuously, that drive is faulty and must be replaced. If the green drive activity LED is flashing, the drive is being accessed.

Note: If the server is configured for RAID operation using a ServeRAID adapter, you might have to reconfigure your disk arrays after you install drives. See the ServeRAID adapter documentation for additional information about RAID operation and complete instructions for using the ServeRAID adapter.

6. If you are installing additional hot-swap drives, do so now.

7. Restart the server. Confirm that it starts correctly and recognizes the newly

installed devices, and make sure that no error LEDs are lit.

8. Complete the additional steps in “Instructions for IBM Business Partners” on page 24.

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

Chapter 2. Installing optional devices 45

Installing an adapter on the PCI riser-card assembly

Use this information to install an adapter on the PCI riser-card assembly.

About this task

The following notes describe the types of adapters that the server supports and other information that you must consider when you install an adapter:

Notes:

v To confirm that server supports the adapter that you are installing, see

http://www.ibm.com/systems/info/x86servers/serverproven/compat/us/.

v Locate the documentation that comes with the adapter and follow those

instructions in addition to the instructions in this section.

v Any high-definition video-out connector or stereo connector on any add-on

video adapter is not supported.

v The server does not support legacy 5 V PCI adapters.

To install an adapter, complete the following steps:

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

2. Turn off the server (see “Turning off the server” on page 22) and all attached peripheral devices. Disconnect all power cords; then, disconnect all external cables from the server.

3. Remove the server top cover (see “Removing the server top cover” on page

35).

4. Rotate the hot-swap rear hard disk drive cage up (see “Rotating the hot-swap rear hard disk drive cage up” on page 36.

5. Remove the PCI riser-card assembly (see “Removing a PCI riser-card assembly” on page 37.

6. Determine which expansion slot you will use for the adapter.

7. The following steps illustrate the procedure of installing an adapter on the

PCI riser-card assemblies: v For PCI riser-card assembly 1:

a. Rotate the retention latch to the open position. Insert the adapter into

the PCI riser-card assembly, aligning the edge connector on the adapter with the connector on the PCI riser-card assembly. Press the edge of the connector firmly into the PCI riser-card assembly. Make sure that the adapter snaps into the PCI riser-card assembly securely.

b. Rotate the retention latch to the close position. Make sure the retention

latch engages the adapter securely.

46 System x3650 M4 BD Type 5466: Installation and Service Guide

Figure 30. Adapter installation

8. Connect any required cables to the adapter.

Attention:

v When you route cables, do not block any connectors or the ventilated space

around any of the fans.

v Make sure that cables are not routed on top of components that are under

the PCI riser-card assembly.

v Make sure that cables are not pinched by the server components.

9. Install the PCI riser-card assembly (see “Installing a PCI riser-card assembly” on page 81).

10. Perform any configuration tasks that are required for the adapter.

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

Chapter 2. Installing optional devices 47

Installing a single / dual port 10GbE SFP+ embedded adapter with interposer

Use this information to install a single / dual port 10GbE SFP+ embedded adapter with interposer.

About this task

Note:

v To confirm that server supports the adapter that you are installing, see

http://www.ibm.com/systems/info/x86servers/serverproven/compat/us/.

v Locate the documentation that comes with the adapter and follow those

instructions in addition to the instructions in this section.

To install an adapter, complete the following steps:

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

2. Turn off the server (see “Turning off the server” on page 22) and all attached peripheral devices. Disconnect all power cords; then, disconnect all external cables from the server.

3. Remove the server top cover (see “Removing the server top cover” on page

35).

4. Rotate the hot-swap rear hard disk drive cage up (see “Rotating the hot-swap rear hard disk drive cage up” on page 36.

5. Remove the PCI riser-card assembly (see “Removing a PCI riser-card assembly” on page 37.

6. Rotate the retention latch to the open position. Insert the adapter into the PCI riser-card assembly, aligning the edge connector on the adapter with the connector on the PCI riser-card assembly. Press the edge of the connector firmly into the PCI riser-card assembly. Make sure that the adapter snaps into the PCI riser-card assembly securely.

48 System x3650 M4 BD Type 5466: Installation and Service Guide

Figure 31. Single port 10GbE SFP+ embedded adapter installation

Figure 32. Dual port 10GbE SFP+ embedded adapter installation

7. Rotate the retention latch to the close position. Make sure the retention latch engages the adapter securely.

8. Connect the cable to the network controller sideband connector on the system board. (See “System-board internal connectors” on page 26).

Chapter 2. Installing optional devices 49

Attention:

v When you route cables, do not block any connectors or the ventilated space

around any of the fans.

v Make sure that cables are not routed on top of components that are under

the PCI riser-card assembly.

v Make sure that cables are not pinched by the server components.

9. Install the PCI riser-card assembly (see “Installing a PCI riser-card assembly” on page 81).

10. Perform any configuration tasks that are required for the adapter.

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

Installing a ServeRAID adapter on the PCI riser-card assembly

Use this information to install a ServeRAID adapter on the PCI riser-card assembly.

About this task

Important: When you install ServeRAID adapters on the PCI riser-card assemblies, please install them in the order listed:

v Slot 3 v Slot 2 (For the rear backplane or external ServeRAID adapter only) v Slot 1 (For external ServeRAID adapter only)

Figure 33. Slot 3

50 System x3650 M4 BD Type 5466: Installation and Service Guide

Figure 34. Slot 2 and Slot 1

To install a ServeRAID adapter on the PCI riser-card assembly, complete the following steps:

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

2. Turn off the server (see “Turning off the server” on page 22) and all attached peripheral devices. Disconnect all power cords; then, disconnect all external cables from the server.

3. Remove the top cover (see “Removing the server top cover” on page 35).

4. If you are installing a new or replacement ServeRAID adapter, touch the

static-protective package that contains the new ServeRAID adapter to any unpainted metal surface on the server. Then, remove the ServeRAID adapter from the package.

5. If you are installing a new or replacement ServeRAID adapter that uses a battery, complete the following steps:

a. Remove the battery from the ServeRAID adapter package or the battery

package.

b. Install the battery and connect the battery to the ServeRAID controller as

instructed in the documentation that comes with the ServeRAID controller or the battery, or see “Installing a ServeRAID adapter battery or flash power module in the remote battery tray” on page 53.

6. The following illustrates the steps for installing a ServeRAID adapter on the PCI riser-card assemblies:

v For PCI riser-card assembly 1:

a. Rotate the retention latch to the open position. Insert the ServeRAID

adapter into the PCI riser-card assembly, aligning the edge connector on the adapter with the connector on the PCI riser-card assembly. Press the edge of the connector firmly into the PCI riser-card assembly. Make sure that the adapter snaps into the PCI riser-card assembly securely.

Chapter 2. Installing optional devices 51

b. Rotate the retention latch to the close position. Make sure the retention

latch engages the adapter securely.

Figure 35. ServeRAID adapter installation

v For PCI riser-card assembly 2:

a. Pull the release pin to unlock the retention latch; then rotate the retention

latch to the open position.

b. Align the ServeRAID adapter so that the keys align correctly with the

connector on PCI riser-card assembly 2.

c. Insert the ServeRAID adapter into the connector on the riser-card until it

is firmly seated.

Figure 36. ServeRAID adapter installation

Attention: Incomplete insertion might cause damage to the server or the adapter.

7. Connect any required cables to the ServeRAID adapter.

52 System x3650 M4 BD Type 5466: Installation and Service Guide

Attention:

v When you route cables, do not block any connectors or the ventilated space

around any of the fans.

v Make sure that cables are not routed on top of components that are under

the PCI riser-card assembly.

v Make sure that cables are not pinched by the server components.

8. Rotate the retention latch to the closed position, making sure the retention latch engages the ServeRAID adapter. Then, push the release pin to lock the retention latch in place.

9. Install PCI riser-card assembly 1 or 2 (see “Installing a PCI riser-card assembly” on page 81.

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

Note:

1. When you restart the server for the first time after you install a ServeRAID adapter with a battery, the monitor screen remains blank while the controller initializes the battery. This might take a few minutes, after which the startup process continues. This is a one-time occurrence.

Important: You must allow the initialization process to be completed. If you do not, the battery pack will not work, and the server might not start.

The battery comes partially charged, at 30% or less of capacity. Run the server for 4 to 6 hours to fully charge the battery. The LED just above the battery on the controller remains lit until the battery is fully charged.

Until the battery is fully charged, the controller firmware sets the controller cache to write-through mode; after the battery is fully charged, the controller firmware re-enables write-back mode.

2. When you restart the server, you are given the opportunity to import the existing RAID configuration to the new ServeRAID adapter.

Installing a ServeRAID adapter battery or flash power module in the remote battery tray

Use this information to install a ServeRAID adapter battery or flash power module in the remote battery tray.

About this task

The Intelligent Battery Backup Unit (iBBU) is an optional battery for the ServeRAID adapter. It is referred to as the battery throughout this section. You must purchase the remote battery cable and install the battery at a distance from the ServeRAID adapter to avoid overheating.

You can install up to two batteries on the remote battery trays on the chassis.

To install a battery on the remote battery tray, complete the following steps:

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

Chapter 2. Installing optional devices 53

2. Turn off the server (see “Turning off the server” on page 22) and all attached peripheral devices. Disconnect all power cords; then, disconnect all external cables from the server.

3. Remove the server top cover (see “Removing the server top cover” on page 35).

4. Install the battery in the RAID battery tray: a. Orient the battery as shown in the following illustration; then, lower the

battery into the RAID battery tray. If the battery comes with a battery carrier, ensure that battery carrier posts align with the rings on the battery mounting slot so that the battery carrier is secure in the slot.

b. Push the battery retention clip back to its vertical position until it snaps into

place, thereby securing the battery.

Figure 37. Battery installation

5. Connect the remote battery cable to the remote battery cable connector on the ServeRAID adapter. Route the remote battery cable in the server as shown in the following illustration.

54 System x3650 M4 BD Type 5466: Installation and Service Guide

Figure 38. Battery cable connection

Attention:

v Make sure the cable passes through the cable clips. v Make sure that the cable is not pinched and does not cover any connectors

or obstruct any components on the system board.

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

Chapter 2. Installing optional devices 55

Installing a hot-swap backplane on the rear hard disk drive cage

Use this information to install a hot-swap backplane on the rear hard disk drive cage.

About this task

The following illustrations show two different types of hot-swap backplanes. v Type1-SATA

Attention: This backplane has to be cascaded with the front backplane to make the master-slave connection.

Figure 39. Type1-SATA

v Type - SAS

Note: This backplane can be an independent configuration (Cascading with the front backplane is unnecessary)

Figure 40. Type2-SAS

To install the hot-swap backplane for the rear hard disk drive cage, complete the following steps.

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

2. Turn off the server (see “Turning off the server” on page 22) and all attached peripheral devices. Disconnect all power cords; then, disconnect all external cables from the server.

3. Remove the server top cover (see “Removing the server top cover” on page 35).

56 System x3650 M4 BD Type 5466: Installation and Service Guide

4. Connect cables to the backplane.

v Type1-SATA

– Connect the LED signal, SATA signal and power cables to the backplane.

Figure 41. Type1-SATA

v Type 2 - SAS

– Connect the I

C signal, SAS signal and power cables to the backplane.

Figure 42. Type2-SAS

5. Align the backplane with the slot on the rear hard disk drive cage.

6. Lower the backplane into the rear hard disk drive cage. Make sure the three

alignment pins securely engages the three holes on the hard disk drive cage.

Figure 43. Hot-swap backplane installation

Chapter 2. Installing optional devices 57

7. For information on how to connect the relevant cabling on the backplane to the server, please refer to “Replacing the hot-swap rear hard disk drive cage” on page 171.

8. Install the hot-swap hard disk drives in the rear hard disk drive cage (see “Installing a hot-swap hard disk drive” on page 44.

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

Installing a front fan

Use this information to install a front fan into the server.

About this task

For proper cooling, the server requires that all fans in the system be operating at all times.

Attention: To ensure proper server operation, if a fan fails, replace the fan immediately.

See “System-board internal connectors” on page 26 for the locations of the fan cable connectors.

To install a front fan, complete the following steps.

Procedure

1. Touch the static-protective package that contains the new fan to any unpainted metal surface on the server. Then, remove the new fan from the package.

2. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

3. Turn off the server (see “Turning off the server” on page 22) and all attached peripheral devices. Disconnect all power cords; then, disconnect all external cables from the server.

4. Remove the server top cover (see “Removing the server top cover” on page

35).

5. Rotate the hot-swap rear hard disk drive cage up (see “Rotating the hot-swap rear hard disk drive cage up” on page 36).

6. Remove the PCI riser-card assembly (see “Removing a PCI riser-card assembly” on page 37).

7. Remove the air baffle (see “Removing the air baffle” on page 39).

8. Installing Fan 1A:. (For installation of Fan 2A or Fan 3A, please go to step 10)

58 System x3650 M4 BD Type 5466: Installation and Service Guide

Figure 44. Fan installation

a. Pull up the blue handle on the fan cage. b. Orient the fan so that the fan cable points to the system board. c. Lower the fan into the fan slot in the server and ensure that is it seated

correctly.

d. Connect the fan cable to the connector on the system board. (See

“System-board internal connectors” on page 26).

Note: Make sure the cable passes through the cable clips.

e. Insert the fan cable into the cable retainer clip. f. Return the blue handle back to its horizontal position.

9. If you have other devices to install or remove, do so now. Otherwise, go to

“Completing the installation” on page 79.

10. Installing Fan 2A or 3A: a. Orient the fan so that the fan cable points to the system board. b. Lower the fan into the fan slot in the server and ensure that is it seated

correctly.

c. Connect the fan cable to the connector on the system board. (See

“System-board internal connectors” on page 26).

d. Insert the fan cable into the cable retainer clip.

Note: Make sure the cable passes through the cable clips.

11. If you have other devices to install or remove, do so now. Otherwise, go to

“Completing the installation” on page 79.

Chapter 2. Installing optional devices 59

Memory module installation

The following notes describe the types of dual inline memory modules (DIMMs) that the server supports and other information that you must consider when you install DIMMs.

About this task

v Confirm that the server supports the DIMM that you are installing, see

http://www.ibm.com/systems/info/x86servers/serverproven/compat/us/.

v When you install or remove DIMMs, the server configuration information

changes. When you restart the server, the system displays a message that indicates that the memory configuration has changed.

v The server supports only industry-standard double-data-rate 3 (DDR3) - 1600 or

1866 MHz (depending on the configuration) , synchronous dynamic random-access memory (SDRAM) registered dual inline memory modules (DIMMs) with error correcting code (ECC).

v The specifications of a DDR3 DIMM are on a label on the DIMM, in the

following format. ggg eRxff-PC3-wwwwwm-aa-bb-cc-dd where: – ggg is the total capacity of the DIMM (for example, 1GB, 2GB, or 4GB) – eis the number of ranks

1 = single-rank 2 = dual-rank

–xff is the device organization or bit width (for example, x4, x8, or x16)

4 = x4 organization (4 DQ lines per SDRAM) 8 = x8 organization 16 = x16 organization

– wwwww is the DIMM bandwidth, in MBps

12800 = 12.80 GBps PC3-1600 SDRAMs, 8-byte primary data bus) 14900 = 14.93 GBps PC3-1866 SDRAMS, 8-byte primary data bus)

– m is the DIMM type

E = Unbuffered DIMM (UDIMM) with ECC (x72-bit module data bus) R = Registered DIMM (RDIMM) U = Unbuffered DIMM with no ECC (x64-bit primary data bus) L = Load Reduction DIMM (LR-DIMM)

– aa is the DDR3 SDRAM CAS latency, in clocks at maximum operating

frequency – bb is the JEDEC SPD Revision Encoding and Additions level – cc is the reference design file for the design of the DIMM – d is the revision number of the reference design of the DIMM

Note: To determine the type of a DIMM, see the label on the DIMM. The information on the label is in the format xxx nRxxx PC3-xxxxx-xx-xx-xx-xx. The numeral in the fourth numerical position indicates whether the DIMM is single-rank (n=1) or dual-rank (n=2).

v Do not mix registered and unbuffered DIMMs in the server. v Do not mix load reduced DIMMs with other types of DIMMs in the server. v DO not mix ECC and non-ECC DIMMs in the server.

60 System x3650 M4 BD Type 5466: Installation and Service Guide

v The server supports 1.35-volt (low-voltage) and 1.5-volt DIMMs. v The server supports a maximum of 16 DIMMs (single-rank and dual-rank) on

the base system board.

v The DIMM options that are available for the server are 4 GB, 8 GB, 16 GB, and

32 GB (when available).

v The server supports memory sparing. Memory sparing reserves memory

capacity for failover in the event of a DIMM failure, and the reserved capacity is

deducted from the total available memory. Memory sparing provides less

redundancy than memory mirroring does. If a predetermined threshold of

correctable errors is reached, the contents of the failing DIMM are copied to the

spare memory, and the failing DIMM or rank is disabled. To enable memory

sparing through the Setup utility, select System Settings > Memory.

v The server system board supports a minimum of 4 GB and a maximum of 512

GB of system memory.

Note: The amount of usable memory is reduced depending on the system

configuration. A certain amount of memory must be reserved for system

resources. To view the total amount of installed memory and the amount of

configured memory, run the Setup utility. For additional information, see

“Configuring the server” on page 88.

v The following table shows the DIMM connectors that are associated with each

microprocessor:

Table 5. DIMM connectors associated with each microprocessor

DIMM connectors associated with the

Microprocessor

Microprocessor 1 1 through 8 Microprocessor 2 9 through 16

microprocessor

v When you replace a DIMM, the server provides automatic DIMM enablement

capability without you having to go to Setup to enable the new DIMM

manually.

v The maximum operating speed of the server is determined by the slowest

DIMM installed in the server.

v A minimum of one DIMM must be installed for each microprocessor. For

example, you must install a minimum of two DIMMs if the server has two

microprocessors installed.

v The server comes with a minimum of one DIMM installed in slot 1. When you

install additional DIMMs, install them in the order shown in the information in

the following tables to optimize system performance.

v The server supports independent mode, rank sparing mode, and mirroring

mode.

Chapter 2. Installing optional devices 61

DIMM installation sequence

When you install additional DIMMs, install them in the order shown in the following table to optimize system performance.

About this task

Figure 45. System board DIMM connectors

Table 6. Non-mirroring (normal) mode DIMM installation sequence

Number of installed microprocessors DIMM connector population sequence

1 8,6,1,3,7,5,2,4 2 8, 16, 6, 14, 1, 9, 3, 11, 7, 15, 5, 13, 2, 10, 4, 12

The following tables lists the DIMM connectors on each memory channel.

Table 7. DIMM connectors on each memory channel

Number of installed microprocessors Memory channel DIMM connectors

Channel 1 7, 8

Microprocessor 1

Channel 2 5, 6 Channel 3 1, 2 Channel 4 3, 4

The following table lists the DIMM connectors on each memory channel.

62 System x3650 M4 BD Type 5466: Installation and Service Guide

Table 8. DIMM connectors on each memory channel

Number of installed microprocessors Memory channel DIMM connectors

Channel 1 15, 16

Microprocessor 2

Channel 2 13, 14 Channel 3 9, 10 Channel 4 11, 12

Memory mirroring

Memory-mirroring mode replicates and stores data on two pairs of DIMMs within two channels simultaneously.

About this task

Memory-mirroring mode replicates and stores data on two pairs of DIMMs within two channels simultaneously. If a failure occurs, the memory controller switches from the primary pair of memory DIMMs to the backup pair of DIMMs. You must enable memory mirroring through the Setup utility. For details about enabling memory mirroring, see “Using the Setup utility” on page 91. When you use the memory mirroring feature, consider the following information:

v DIMMs must be installed in pairs. The DIMMs in each pair must be the same

size and type.

v The maximum available memory is reduced to one third of the installed

memory when memory mirroring is enabled. For example, if you install 96 GB

of memory, only 32 GB of addressable memory is available when you use

memory mirroring.

v Channel 1 DIMM connectors 1, 2, 7, and 8 are not used in memory-mirroring

mode.

The following table lists the installation sequence for installing DIMMs in memory-mirroring mode.

Table 9. DIMM population sequence (memory-mirroring mode)

Number of installed microprocessors DIMM connector population sequence

8, 6

1, 3 7, 5 2, 4 8, 6, 16, 14 1, 3, 9, 11 7, 5, 15, 13 2, 4, 10, 12

When you install or remove DIMMs, the server configuration information changes. When you restart the server, the system displays a message that indicates that the memory configuration has changed.

Chapter 2. Installing optional devices 63

Rank sparing

Sparing enables a failing rank to be replaced by ranks installed in an unoccupied space. An unused spare rank on the channel can be used to copy the contents of a failing rank on that channel.

About this task

When you use the memory mirroring feature, consider the following information: v In rank sparing mode, one rank of a DIMM in each populated channel is

reserved as spare memory. The spare rank is not available as active memory. When the active rank memory fails, its content is copied to the spare rank memory which becomes active. The spare rank must have identical or larger memory capacity than all the other ranks on the same channel.

v DIMMs must be installed in sets of three. The DIMMs in each set must be the

same size and type.

v The following table lists the DIMM installation sequence for rank sparing mode

when one or two microprocessors is installed in the server:

The following table shows the installation sequence for installing DIMMs for each microprocessor in memory online-spare mode:

Table 10. DIMM population sequence (rank sparing mode)

Number of installed microprocessors DIMM connector population sequence

18,7

1, 2 6, 5 3, 4

2 8, 7, 16, 15

6, 5 14, 13 1,2 9, 10 3, 4 11, 12

64 System x3650 M4 BD Type 5466: Installation and Service Guide

Installing a DIMM

Use this information to install a DIMM.

About this task

Note: The first DIMM connectors in every channel are white-colored, while the second DIMM connectors in every channel are black-colored.

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

3. Remove the server top cover (see “Removing the server top cover” on page

35).

4. Rotate the hot-swap rear hard disk drive cage up (see “Rotating the hot-swap rear hard disk drive cage up” on page 36

5. Remove the PCI riser-card assembly (see “Removing a PCI riser-card assembly” on page 37.

6. Remove the air baffle (see “Removing the air baffle” on page 39.

7. Carefully flip open the retaining clip on each end of the DIMM connector.

Attention: To avoid breaking the retaining clips or damaging the DIMM connectors, open and close the clips gently.

Figure 46. DIMM installation

8. Touch the static-protective package that contains the DIMM to any unpainted metal surface on the server. Then, remove the DIMM from the package.

9. Turn the DIMM so that the DIMM keys align correctly with the connector.

10. Insert the DIMM into the connector by aligning the edges of the DIMM with

the slots at the end of the DIMM connector. Firmly press the DIMM straight down into the connector by applying pressure on both ends of the DIMM simultaneously. The retaining clips snap into the locked position when the DIMM is firmly seated in the connector.

Chapter 2. Installing optional devices 65

Important: If there is a gap between the DIMM and the retaining clips, the DIMM has not been correctly inserted; open the retaining clips, remove the DIMM, and then reinsert it.

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

Installing an additional microprocessor and heat sink

Use this information to install an additional microprocessor and heat sink.

About this task

The following notes describe the type of microprocessor that the server supports and other information that you must consider when you install a microprocessor:

v The server supports Intel scalable multi-core microprocessors which are designed

for the LGA 2011 socket. Scalable up to ten cores with an integrated memory controller, quick-path interconnect and shared last cache. See http://www.ibm.com/systems/info/x86servers/serverproven/compat/us/ for a list of supported microprocessors.

v Both microprocessors must have the same QuickPath Interconnect (QPI) link

speed, integrated memory controller frequency, core frequency, power segment, cache size, and type.

v Read the documentation that comes with the microprocessor to determine

whether you must update the server firmware for the server. To download the most current level of server firmware and many other code updates for your server, complete the following steps:

1. Go to http://www-947.ibm.com/support/entry/portal/overview.

2. Under Product support, click System x.

3. Under Popular links, click Software and device drivers.

4. Click System x3650 M4 BD to display the matrix of downloadable files for

the server.

v (Optional) Obtain an SMP-capable operating system. For a list of supported

operating systems and optional devices, see http://www.ibm.com/systems/ info/x86servers/serverproven/compat/us/.

v To order additional microprocessor optional devices, contact your IBM sales

representative or IBM reseller.

v The microprocessor speeds are automatically set for this server; therefore, you

do not have to set any microprocessor frequency-selection jumpers or switches.

v If you have to replace a microprocessor, call for service. v If the thermal-grease protective cover (for example, a plastic cap or tape liner) is

removed from the heat sink, do not touch the thermal grease on the bottom of the heat sink or set down the heat sink.

v Do not remove the first microprocessor from the system board to install the

second microprocessor.

66 System x3650 M4 BD Type 5466: Installation and Service Guide

Attention:

v A startup (boot) microprocessor must always be installed in microprocessor

socket 1 on the system board.

v To ensure correct server operation when you install an additional

microprocessor, use microprocessors that are compatible and install at least one DIMM in a DIMM connector for microprocessor 2.

There are two types of microprocessor installation tools. The tools are similar in function and design, however Tool A has one setting for installing one size of microprocessor, and supports the following families of microprocessors: E5-26xx, E5-46xx. Installation Tool B has two settings for installing two different sizes of microprocessors. The settings that are marked on Tool B are “L” for smaller low core microprocessors, and “H” for larger high core microprocessors. Installation Tool B supports the following families of microprocessors: E5-26xx, E5-46xx, E5-26xx v2, E5-46xx v2. Microprocessor Installation Tools A and B are shown in the following illustration.

Installation tool

Microprocessor

Cover

Microprocessor

Microprocessor Installation Tool A Microprocessor Installation Tool B

Figure 47. Microprocessor installation tools

To install an additional microprocessor, complete the following steps:

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

2. Turn off the server (see “Turning off the server” on page 22) and all attached peripheral devices. Disconnect all power cords; then, disconnect all external cables from the server.

3. Remove the server top cover (see “Removing the server top cover” on page

35).

4. Rotate the hot-swap rear hard disk drive cage up (see “Rotating the hot-swap rear hard disk drive cage up” on page 36.

5. Remove the PCI riser-card assembly (see “Removing a PCI riser-card assembly” on page 37.

Chapter 2. Installing optional devices 67

6. Remove the air baffle (see “Removing the air baffle” on page 39).

7. Locate the second microprocessor socket on the system board (see

“System-board internal connectors” on page 26.

8. Open the microprocessor socket release levers and retainer:

Figure 48. Microprocessor release lever and microprocessor bracket frame

a. Identify which release lever is labeled as the first release lever. Then

release the microprocessor release lever by pressing down on the end, moving it to the side, and releasing it to the open (up) position.

b. Open the second release lever on the microprocessor socket. c. Open the microprocessor retainer.

Attention: Do not touch the connectors on the microprocessor and the microprocessor socket.

9. Install the microprocessor on the microprocessor socket: a. Touch the static-protective package that contains the new microprocessor

to any unpainted on the chassis or any unpainted metal surface on any other grounded rack component; then, carefully remove the microprocessor from the package.

b. Release the sides of the cover and remove the cover from the installation

tool. The microprocessor is preinstalled on the installation tool.

Figure 49. Installation tool cover removal

Note: Do not touch the microprocessor contacts. Contaminants on the microprocessor contacts, such as oil from your skin, can cause connection failures between the contacts and the socket.

68 System x3650 M4 BD Type 5466: Installation and Service Guide

c. Align the installation tool with the microprocessor socket. The installation

tool rests flush on the socket only if properly aligned.

Figure 50. Installation tool alignment

d. Install the microprocessor using the following instructions for your

installation tool. v If using Installation Tool A, twist the handle on the microprocessor tool

assembly counterclockwise to the open position to insert the microprocessor into the socket, and lift the installation tool out of the socket.

v If using Installation Tool B, twist the handle of the installation tool

assembly counterclockwise until the microprocessor is inserted into the socket, and lift the installation tool out of the socket. The following illustration shows the tool handle in the open position.

Figure 51. Installation tool handle adjustment

Chapter 2. Installing optional devices 69

E5-x6xx E5-x6xx v2

Figure 52. Installation Tool B

Attention:

v Do not press the microprocessor into the socket. v Make sure that the microprocessor is oriented and aligned correctly in

the socket before you try to close the microprocessor retainer.

v Do not touch the thermal material on the bottom of the heat sink or on

top of the microprocessor. Touching the thermal material will contaminate it.

10. Remove the microprocessor socket cover, tape, or label from the surface of the microprocessor socket, if one is present. Store the socket cover in a safe place.

Figure 53. Socket cover removal

Attention: When you handle static-sensitive devices, take precautions to avoid damage from static electricity. For details about handling these devices, see “Handling static-sensitive devices” on page 34.

11. Close the microprocessor socket release levers and retainer:

70 System x3650 M4 BD Type 5466: Installation and Service Guide

Figure 54. Microprocessor socket levers and retainer engagement

a. Close the microprocessor retainer on the microprocessor socket. b. Identify which release lever is labeled as the first release lever to close and

close it.

c. Close the second release lever on the microprocessor socket.

12. Install a heat sink on the microprocessor:

Attention:

v Do not set down the heat sink after you remove the plastic cover v Do not touch the thermal grease on the bottom of the heat sink or set down

the heat sink after you remove the plastic cover. Touching the thermal grease will contaminate it. If the thermal grease is contaminated, call IBM service and support to request a replacement thermal grease kit. For information about installing the replacement thermal grease, see “Thermal grease” on page 73.

Figure 55. Heat-sink

Chapter 2. Installing optional devices 71

Figure 56. Heat-sink installation

a. Remove the plastic protective cover from the bottom of the heat sink. b. Align the screw holes on the heat sink with the holes on the system board. c. Place the heat sink on the microprocessor with the thermal-grease side

down.

d. Press firmly on the captive screws and tighten them with a screwdriver.

The follow illustration shows the sequence in tightening the screws, which is also shown on top of the heat sink. Begin with the screw labeled as "1", then "2", "3" and finally "4". If possible, each screw should be rotated two full rotations at a time. Repeat until the screws are tight. Do not overtighten the screws by using excessive force. If you are using a torque wrench, tighten the screws to 8.5 Newton-meters (Nm) to 13 Nm (6.3 foot-pounds to 9.6 foot-pounds).

Note: Please use Phillips screw driver No.0 to fasten screws.

Figure 57. Screws sequence

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

72 System x3650 M4 BD Type 5466: Installation and Service Guide

Thermal grease

The thermal grease must be replaced whenever the heat sink has been removed from the top of the microprocessor and is going to be reused or when debris is found in the grease. Use this information to replace damaged or contaminated thermal grease on the microprocessor and heat sink.

About this task

When you are installing the heat sink on the same microprocessor that is was removed from, make sure that the following requirements are met:

v The thermal grease on the heat sink and microprocessor is not contaminated. v Additional thermal grease is not added to the existing thermal grease on the

heat sink and microprocessor.

Note:

v Read the Safety information on page “Safety” on page vii. v Read the “Installation guidelines” on page 32. v Read “Handling static-sensitive devices” on page 34.

To replace damaged or contaminated thermal grease on the microprocessor and heat exchanger, complete the following steps:

Procedure

1. Place the heat sink on a clean work surface.

2. Remove the cleaning pad from its package and unfold it completely.

3. Use the cleaning pad to wipe the thermal grease from the bottom of the heat

sink.

Note: Make sure that all of the thermal grease is removed.

4. Use a clean area of the cleaning pad to wipe the thermal grease from the microprocessor; then, dispose of the cleaning pad after all of the thermal grease is removed.

0.02 mL of thermal grease

Microprocessor

Figure 58. Thermal grease distribution

5. Use the thermal-grease syringe to place 9 uniformly spaced dots of 0.02 mL each on the top of the microprocessor. The outermost dots must be within approximately 5 mm of the edge of the microprocessor; this is to ensure uniform distribution of the grease.

Chapter 2. Installing optional devices 73

Figure 59. Syringe

Note: If the grease is properly applied, approximately half of the grease will remain in the syringe.

6. Install the heat sink onto the microprocessor as described in “Replacing a microprocessor and heat sink” on page 243.

Installing a hot-swap ac power supply

Use this information to install a hot-swap ac power supply.

About this task

The following items describe the type of power supply that the server supports and other information that you must consider when you install a power supply:

v To confirm that the server supports the power supply that you are installing, see

http://www.ibm.com/systems/info/x86servers/serverproven/compat/us/.

v The server comes standard with one 750-watt or 900-watt hot-swap power

supply. The input voltage is 110 V ac or 220 V ac auto-sensing.

Note: You cannot mix 110 V ac and 220 V ac, or 750-watt and 900-watt power supplies in the server, it is not supported.

v These power supplies are designed for parallel operation. In the event of a

power-supply failure, the redundant power supply continues to power the system. The server supports a maximum of two power supplies.

v The server can run fully configured with one power supply. For redundancy

support, you must install the second hot-swap power supply.

Note: You cannot mix high-efficiency and non-high-efficiency power supplies in the server.

Statement 5

74 System x3650 M4 BD Type 5466: Installation and Service Guide

Statement 8

CAUTION: Never remove the cover on a power supply or any part that has the following label attached.

Attention: During normal operation, each power-supply bay must contain either

a power supply or power-supply filler for proper cooling.

To replace a hot-swap ac power supply, complete the following steps.

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

2. Touch the static-protective package that contains the hot-swap power supply to any unpainted metal surface on the server; then, remove the power supply from the package and place it on a static-protective surface.

3. If you are installing a hot-swap power supply into an empty bay, remove the power-supply filler panel from the power-supply bay. Meanwhile, if you are replacing a failed hot-swap power supply, remove it from the bay.

Figure 60. Power supply installation

4. Grasp the handle on the rear of the power supply and slide the power supply forward into the power-supply bay until it clicks. Make sure that the power supply connects firmly into the power-supply connector.

Chapter 2. Installing optional devices 75

5. Connect the power cord for the new power supply to the power-cord connector on the power supply.

6. Route the power cord through the cable retainer clip so that it does not accidentally become disconnected.

Figure 61. Power cord

7. Connect the power cord to a properly grounded electrical outlet.

8. Make sure that the ac power LED and the dc power LED on the power supply

are lit, indicating that the power supply is operating correctly.

9. If you are adding a power supply to the server, attach the redundant power information label that comes with this option on the server top cover near the power supplies.

Figure 62. Power information label

76 System x3650 M4 BD Type 5466: Installation and Service Guide

Installing a USB embedded hypervisor flash device

Use this information to install a USB embedded hypervisor flash device.

About this task

Hypervisor is a virtualization platform that enables multiple operating systems to run on a host computer at the same time. Support for hypervisor is available with the purchase and installation of an optional USB hypervisor memory key, with embedded hypervisor software.

To install the USB hypervisor memory key, complete the following steps:

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

2. Turn off the server (see “Turning off the server” on page 22) and all attached peripheral devices. Disconnect all power cords; then, disconnect all external cables from the server.

3. Remove the top cover (see “Removing the server top cover” on page 35).

4. If you have the optional hot-swap rear hard disk drive cage installed, rotate it

up (see “Rotating the hot-swap rear hard disk drive cage up” on page 36).

5. Remove PCIe riser-card assembly 1 (see “Removing a PCI riser-card assembly” on page 37).

6. Locate the embedded hypervisor USB flash device connector on the system board as shown in the following illustration:

Figure 63. USB embedded hypervisor flash device connector

7. Slide the lockbar toward the riser-card assembly to the locked position until it is seated firmly.

Chapter 2. Installing optional devices 77

Figure 64. USB embedded hypervisor flash device installation

8. Align the USB flash device with the connector on the system board and push it into the connector until it is firmly seated.

9. Slide the lockbar toward the riser-card assembly to the locked position until it is seated firmly.

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

Note: You must configure the server to boot from the hypervisor USB drive. See “Configuring the server” on page 88 for information about enabling the embedded hypervisor.

78 System x3650 M4 BD Type 5466: Installation and Service Guide

Completing the installation

Use this information to complete the installation.

About this task

To complete the installation, complete the following steps:

Procedure

1. If you removed the air baffle, reinstall it (see “Installing the air baffle” on page

80).

2. If you removed a PCIe riser-card assembly, reinstall it (see “Installing a PCI riser-card assembly” on page 81).

3. If you have the optional hot-swap rear hard disk drive cage installed, rotate it down (see “Rotating the hot-swap rear hard disk drive cage down” on page

82.

4. If you removed the server top cover, replace it (see “Installing the server top cover” on page 84).

5. Install the server in the rack cabinet (see the Rack Installation Instructions that come with the server for instructions).

6. To attach peripheral devices and connect the power cords, see “Front view” on page 16).

7. Update the server configuration (see “Updating the server configuration” on page 85).

8. Slide the server back into the rack, if necessary.

9. Start the server. Confirm that is starts correctly and recognizes the newly

installed devices, and make sure that no error LEDs are lit.

10. (IBM Business Partners only) Complete the additional steps in “Instructions for IBM Business Partners” on page 24.

Note: Remember to route the power cord through the cable retainer clip so that it does not accidentally become disconnected.

Figure 65. Power cord

Chapter 2. Installing optional devices 79

Installing the air baffle

Use this information to install the air baffle.

About this task

To install the air baffle, complete the following steps:

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

2. Lower the air baffle into the server. Make sure that the tabs on the air baffle are inserted into the holes on the chassis.

Attention: For proper cooling and airflow, replace the air baffle before you turn on the server. Operating the server with the air baffle removed might damage server components.

Figure 66.

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

80 System x3650 M4 BD Type 5466: Installation and Service Guide

Installing a PCI riser-card assembly

Use this information to install a PCI riser-card assembly.

About this task

To install the PCI riser-card assembly, complete the following steps:

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

2. Make sure that the server and all peripheral devices are turned off and that the power cords and all external cables are disconnected.

3. Reinstall any adapters and reconnect any internal cables that you removed in other procedures.

4. Align the PCI riser-card assembly with the alignment pin and the guide rails on the chassis.

Figure 67. PCI riser-card assembly 1 installation

Chapter 2. Installing optional devices 81

Figure 68. PCI riser-card assembly 2 installation

5. Press down on the blue touch points on the PCI riser-card assembly to install the assembly in the server. Make sure that the PCI riser-card assembly is fully seated in the PCI connectors on the system board.

Attention: Make sure that the cables are not pinched.

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

Rotating the hot-swap rear hard disk drive cage down

Use this information to rotate the optional hot-swap rear hard disk drive cage down.

About this task

To rotate the optional hot-swap hard disk drive cage down, complete the following steps.

Procedure

1. Read the safety information that begins on page “Safety” on page vii and “Installation guidelines” on page 32.

Attention: Make sure you have routed the power cable correctly as the following illustration before you rotate the hot-swap rear hard disk drive cage down. You have to route the cable underneath the bracket; then, route the cable through the cable retainer clip. Improper cable routing may damage the power cable.

82 System x3650 M4 BD Type 5466: Installation and Service Guide

Figure 69. Cable routing

2. Shift the switch on the rear hard disk drive cage to the unlock position▌1▐ .

3. Slowly rotate the cage downwards until it sits into place ▌2▐.

4. Close the blue latches on the chassis ▌3▐.

Chapter 2. Installing optional devices 83

Figure 70. Hot-swap rear hard disk drive cage installation

Results

If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.

Installing the server top cover

Use this information to install the server top cover.

About this task

To install the server cover, complete the following steps:

Procedure

1. Make sure that all cables, adapters, and other components are installed and seated correctly and that you have not left loose tools or parts inside the server. Also, make sure that all internal cables are correctly routed.

2. Align the cover over the server (toward the rear of the server) until the cover edges slip into position over the chassis.

Attention: Before sliding the cover forward, make sure that all the tabs on both the front, rear, and side of the cover engage the chassis correctly. If all the tabs do not engage the chassis correctly, it will be hard to remove the cover later.

3. Slide the cover forward toward the front of the server until the cover is completely closed.

84 System x3650 M4 BD Type 5466: Installation and Service Guide

IBM System x3650 M4 BD Type 5466 Installation And Service Manual

Specifications and Main Features

Frequently Asked Questions

User Manual

Contents

Safety

Safety statements

Chapter 1. The IBM System x3650 M4 BD Type 5466 server

The IBM Documentation CD

Hardware and software requirements

Using the Documentation Browser

Related documentation

Notices and statements in this document

Server features and specifications

What your server offers

Reliability, availability, and serviceability

IBM Systems Director

Server controls, LEDs, and power

Front view

Operator information panel

Rear view

PCI riser-card adapter expansion slot locations

Power-supply LEDs

Server power features

Turning on the server

Turning off the server

Chapter 2. Installing optional devices

Installing optional hardware devices in the server

Instructions for IBM Business Partners

How to send DSA data to IBM

Server components

Server internal LEDs, connectors, and jumpers

System-board internal connectors

System-board DIMM connectors

System-board external connectors

System-board jumpers

System-board LEDs

PCI riser-card adapter expansion slot connectors

Installation guidelines

System reliability guidelines

Working inside the server with the power on

Handling static-sensitive devices

Removing the server top cover

Rotating the hot-swap rear hard disk drive cage up

Removing a PCI riser-card assembly

Removing the air baffle

Removing a hot-swap hard disk drive

Removing an adapter from the PCI riser-card assembly

Removing a ServeRAID adapter from the PCI riser-card assembly

Installing a hot-swap hard disk drive

Installing an adapter on the PCI riser-card assembly

Installing a single / dual port 10GbE SFP+ embedded adapter with interposer

Installing a ServeRAID adapter on the PCI riser-card assembly

Installing a ServeRAID adapter battery or flash power module in the remote battery tray

Installing a hot-swap backplane on the rear hard disk drive cage

Installing a front fan

Memory module installation

DIMM installation sequence

Memory mirroring

Rank sparing

Installing a DIMM

Installing an additional microprocessor and heat sink

Thermal grease

Installing a hot-swap ac power supply

Installing a USB embedded hypervisor flash device

Completing the installation

Installing the air baffle

Installing a PCI riser-card assembly

Rotating the hot-swap rear hard disk drive cage down

Installing the server top cover