Lenovo NeXtScale nx360 M5, NeXtScale n1200 Installation And Service Manual

Lenovo NeXtScale nx360 M5 water-cooled technology tray Lenovo NeXtScale n1200 Enclosure Installation and Service Guide

Machine Type: 5467 / 5468 and 5469

Note

Before using this information and the product it supports, read the general information in Appendix D “Getting help and technical assistance” on page 845, Appendix E “Notices” on page 849, the Warranty Information document, and the Safety Information and Environmental Notices and User Guide documents on the Lenovo Documentation CD.

Thirteenth Edition (August 2017)

LIMITED AND RESTRICTED RIGHTS NOTICE: If data or software is delivered pursuant to a General Services Administration “GSA” contract, use, reproduction, or disclosure is subject to restrictions set forth in Contract No. GS-35F-05925

Contents

Safety . . . . . . . . . . . . . . . . . . v

Safety statements . . . . . . . . . . . . . . . vi

Chapter 1. The Lenovo NeXtScale nx360 M5 water-cooled technology tray Type 5467, Lenovo NeXtScale n1200

Enclosure Types 5468 and 5469 . . . . . 1

The Lenovo Documentation CD . . . . . . . . . 3

Hardware and software requirements . . . . . 3

The Documentation Browser . . . . . . . . . 3

Related documentation. . . . . . . . . . . . . 4

Brocade documentation . . . . . . . . . . . . 4

Notices and statements in this document. . . . . . 5

Server features and specifications . . . . . . . . 5

What your compute node offers . . . . . . . . . 8

Lenovo XClarity Administrator . . . . . . . . . 11

Reliability, availability, and serviceability . . . . . 12

Systems Director . . . . . . . . . . . . . . 13

Server controls, LEDs, and power. . . . . . . . 13

Front view . . . . . . . . . . . . . . . 14

Rear view . . . . . . . . . . . . . . . 15

Server power features . . . . . . . . . . 19

Chapter 2. Components, features,

and controls . . . . . . . . . . . . . . 21

Instructions for Lenovo Business Partners . . . . 21

Sending DSA data to Lenovo . . . . . . . . . 22

Server components . . . . . . . . . . . . . 22

System-board internal connectors. . . . . . 24

System-board switches and jumpers. . . . . 25

System-board LEDs . . . . . . . . . . . 27

Installation guidelines . . . . . . . . . . . . 28

System reliability guidelines . . . . . . . . 29

Handling static-sensitive devices . . . . . . 30

Chapter 3. Configuration information

and instructions . . . . . . . . . . . . 31

Updating the firmware . . . . . . . . . . . . 31

Configuring the server . . . . . . . . . . . . 32

Using the ServerGuide Setup and Installation

CD . . . . . . . . . . . . . . . . . . 33

Using the Setup utility . . . . . . . . . . 34

Using the Boot Manager . . . . . . . . . 40

Starting the backup server firmware . . . . . 40

The UpdateXpress System Pack Installer . . . 40

Changing the Power Policy option to the default settings after loading UEFI defaults . . 40

Using the integrated management module . . 41 Using the remote presence and blue-screen

capture features . . . . . . . . . . . . . 42

Using the embedded hypervisor . . . . . . 44

Configuring the Ethernet controller . . . . . 45

Enabling Features on Demand Ethernet

software . . . . . . . . . . . . . . . . 45

Enabling Features on Demand RAID

software . . . . . . . . . . . . . . . . 45

Configuring RAID arrays. . . . . . . . . . 45

Lenovo Advanced Settings Utility program . . 46

Updating Lenovo Systems Director . . . . . 46

Updating the Universal Unique Identifier

(UUID). . . . . . . . . . . . . . . . . 47

Updating the DMI/SMBIOS data . . . . . . 49

Chapter 4. Troubleshooting . . . . . . 53

Start here . . . . . . . . . . . . . . . . . 53

Diagnosing a problem . . . . . . . . . . 53

Undocumented problems . . . . . . . . . 55

Service bulletins . . . . . . . . . . . . . . 55

Checkout procedure . . . . . . . . . . . . . 56

About the checkout procedure . . . . . . . 56

Performing the checkout procedure . . . . . 56

Diagnostic tools. . . . . . . . . . . . . . . 57

Light path diagnostics . . . . . . . . . . 59

Power-supply LEDs . . . . . . . . . . . 59

System pulse LEDs . . . . . . . . . . . 61

Event logs . . . . . . . . . . . . . . . 62

POST . . . . . . . . . . . . . . . . . 64

Lenovo Dynamic System Analysis . . . . . . 64

Automated service request (call home) . . . . . . 67

Lenovo Electronic Service Agent . . . . . . 67

Error messages . . . . . . . . . . . . . . . 67

Troubleshooting by symptom . . . . . . . . . 67

General problems . . . . . . . . . . . . 67

Hypervisor problems . . . . . . . . . . . 68

Intermittent problems. . . . . . . . . . . 68

Keyboard, mouse, or USB-device problems . . 69

Memory problems . . . . . . . . . . . . 69

Microprocessor problems . . . . . . . . . 70

Monitor and video problems . . . . . . . . 71

Network connection problems . . . . . . . 74

Optional-device problems . . . . . . . . . 74

Power problems. . . . . . . . . . . . . 75

Serial port problems . . . . . . . . . . . 77

ServerGuide problems . . . . . . . . . . 77

Software problems. . . . . . . . . . . . 78

Universal Serial Bus (USB) port problems . . . 79

Solving power problems . . . . . . . . . . . 79

Solving Ethernet controller problems . . . . . . 79

Solving undetermined problems . . . . . . . . 80

Problem determination tips . . . . . . . . . . 81

Recovering the server firmware (UEFI update

failure) . . . . . . . . . . . . . . . . . . 82

In-band manual recovery method . . . . . . 83

In-band automated boot recovery method . . 85

Out-of-band method . . . . . . . . . . . 85

Automated boot recovery (ABR) . . . . . . . . 85

Nx-boot failure . . . . . . . . . . . . . . . 85

Chapter 5. Parts listing, Lenovo NeXtScale nx360 M5 water-cooled technology tray Type 5467, Lenovo NeXtScale n1200 Enclosure Types 5468

and 5469 . . . . . . . . . . . . . . . . 87

Replaceable server components . . . . . . . . 87

Type 5468 chassis and type 5469 manifold

components . . . . . . . . . . . . . . . . 92

Structural parts . . . . . . . . . . . . . . . 95

Power cords . . . . . . . . . . . . . . . . 96

Chapter 6. Removing and replacing

server components . . . . . . . . . . 99

Returning a device or component . . . . . . . . 99

Removing and replacing server components . . . 99

Removing the manifold . . . . . . . . . . 99

Replacing the manifold . . . . . . . . . . 118

Removing a water-cooled technology tray

from a chassis . . . . . . . . . . . . . 139

Installing a water-cooled technology tray in a

chassis . . . . . . . . . . . . . . . . 140

Removing and replacing structural parts . . . 142

Removing and replacing Tier 1 CRUs . . . . 143

Removing and replacing Tier 2 CRUs or

FRUs . . . . . . . . . . . . . . . . . 165

Appendix A. Integrated Management Module 2.1 (IMM2.1) error

messages . . . . . . . . . . . . . . . 199

List of IMM events . . . . . . . . . . . . . . 200

Appendix B. UEFI/POST diagnostic

codes. . . . . . . . . . . . . . . . . . 693

List of UEFI events. . . . . . . . . . . . . . 694

Appendix C. DSA diagnostic test

results . . . . . . . . . . . . . . . . . 715

DSA Broadcom network test results . . . . . . . 715

Test results for the DSA Broadcom network

test . . . . . . . . . . . . . . . . . . 715

DSA Brocade test results . . . . . . . . . . . 723

Test results for the DSA Brocade test . . . . 723

DSA checkpoint panel test results . . . . . . . 731

Test results for the DSA checkpoint panel

test . . . . . . . . . . . . . . . . . . 731

DSA CPU stress test results . . . . . . . . . . 732

Test results for the DSA CPU stress test . . . 732

DSA Emulex adapter test results . . . . . . . . 735

Test results for the DSA Emulex adapter

test . . . . . . . . . . . . . . . . . . 735

DSA EXA port ping test results . . . . . . . . . 738

Test results for the DSA EXA port ping test . . 738

DSA hard drive test results . . . . . . . . . . 740

Test results for the DSA hard drive test . . . . 740

DSA Intel network test results . . . . . . . . . 741

Test results for the DSA Intel network test. . . 741

DSA LSI hard drive test results . . . . . . . . . 747

Test results for the DSA LSI hard drive test . . 747

DSA Mellanox adapter test results . . . . . . . 748

Test results for the DSA Mellanox adapter

test . . . . . . . . . . . . . . . . . . 748

DSA memory isolation test results. . . . . . . . 750

Test results for the DSA memory isolation

test . . . . . . . . . . . . . . . . . . 750

DSA memory stress test results . . . . . . . . 815

Test results for the DSA memory stress

test . . . . . . . . . . . . . . . . . . 816

DSA Nvidia GPU test results . . . . . . . . . . 818

Test results for the DSA Nvidia GPU test . . . 818

DSA optical drive test results . . . . . . . . . 824

Test results for the DSA optical drive test . . . 824

DSA system management test results . . . . . . 828

Test results for the DSA system management

test . . . . . . . . . . . . . . . . . . 828

DSA tape drive test results . . . . . . . . . . 839

Test results for the DSA tape drive test . . . . 839

Appendix D. Getting help and

technical assistance . . . . . . . . . . 845

Before you call . . . . . . . . . . . . . . . 845

Using the documentation . . . . . . . . . . . 846

Getting help and information from the World Wide

Web . . . . . . . . . . . . . . . . . . . 846

How to send DSA data . . . . . . . . . . . . 846

Creating a personalized support web page . . . . 846

Software service and support . . . . . . . . . 846

Hardware service and support . . . . . . . . . 847

Taiwan product service . . . . . . . . . . . . 847

ii Lenovo NeXtScale nx360 M5 water-cooled technology tray Lenovo NeXtScale n1200 Enclosure Installation and Service Guide

Appendix E. Notices . . . . . . . . . . 849

Trademarks . . . . . . . . . . . . . . . . 850

Important notes. . . . . . . . . . . . . . . 850

Recycling information . . . . . . . . . . . . 850

Particulate contamination . . . . . . . . . . . 851

Telecommunication regulatory statement. . . . . 851

Electronic emission notices . . . . . . . . . . 852

Federal Communications Commission (FCC)

statement . . . . . . . . . . . . . . . 852

Industry Canada Class A emission compliance

statement . . . . . . . . . . . . . . . 852

Avis de conformité à la réglementation

d'Industrie Canada. . . . . . . . . . . . 852

Australia and New Zealand Class A

statement . . . . . . . . . . . . . . . 852

European Union EMC Directive conformance

statement . . . . . . . . . . . . . . . 852

Germany Class A statement . . . . . . . . 853

Japanese electromagnetic compatibility

statements . . . . . . . . . . . . . . . 854

Korea Communications Commission (KCC)

statement . . . . . . . . . . . . . . . 854

Russia Electromagnetic Interference (EMI)

Class A statement . . . . . . . . . . . . 854

People's Republic of China Class A electronic

emission statement . . . . . . . . . . . 854

Taiwan Class A compliance statement . . . . 855

Taiwan BSMI RoHS declaration. . . . . . . 856

Index . . . . . . . . . . . . . . . . . . 857

iv Lenovo NeXtScale nx360 M5 water-cooled technology tray Lenovo NeXtScale n1200 Enclosure Installation and Service Guide

Safety

Before installing this product, read the Safety Information.

Antes de instalar este produto, leia as Informações de Segurança.

Læs sikkerhedsforskrifterne, før du installerer dette produkt.

Lees voordat u dit product installeert eerst de veiligheidsvoorschriften.

Ennen kuin asennat tämän tuotteen, lue turvaohjeet kohdasta Safety Information.

Avant d'installer ce produit, lisez les consignes de sécurité.

Vor der Installation dieses Produkts die Sicherheitshinweise lesen.

Prima di installare questo prodotto, leggere le Informazioni sulla Sicurezza.

Les sikkerhetsinformasjonen (Safety Information) før du installerer dette produktet.

Antes de instalar este produto, leia as Informações sobre Segurança.

Antes de instalar este producto, lea la información de seguridad.

Läs säkerhetsinformationen innan du installerar den här produkten.

Safety statements

These statements provide the caution and danger information that is used in this documentation.

Important: Each caution and danger statement in this documentation is labeled with a number. This number is used to cross reference an English-language caution or danger statement with translated versions of the caution or danger statement in the Safety Information document.

For example, if a caution statement is labeled Statement 1, translations for that caution statement are in the Safety Information document under Statement 1.

Be sure to read all caution and danger statements in this documentation before you perform the procedures. Read any additional safety information that comes with your system or optional device before you install the device.

Statement 1

vi Lenovo NeXtScale nx360 M5 water-cooled technology tray Lenovo NeXtScale n1200 Enclosure Installation and Service Guide

DANGER

Electrical current from power, telephone, and communication cables is hazardous.

To avoid a shock hazard:

• Do not connect or disconnect any cables or perform installation, maintenance, or reconfiguration of this product during an electrical storm.

• Connect all power cords to a properly wired and grounded electrical outlet.

• Connect to properly wired outlets any equipment that will be attached to this product.

• When possible, use one hand only to connect or disconnect signal cables.

• Never turn on any equipment when there is evidence of fire, water, or structural damage.

• Disconnect the attached power cords, telecommunications systems, networks, and modems before you open the device covers, unless instructed otherwise in the installation and configuration procedures.

• Connect and disconnect cables as described in the following table when installing, moving, or opening covers on this product or attached devices.

To Connect: To Disconnect:

1. Turn everything OFF.

2. First, attach all cables to devices.

3. Attach signal cables to connectors.

4. Attach power cords to outlet.

5. Turn device ON.

1. Turn everything OFF.

2. First, remove power cords from outlet.

3. Remove signal cables from connectors.

4. Remove all cables from devices.

Statement 2

CAUTION: When replacing the lithium battery, use only Part Number 33F8354 or an equivalent type battery recommended by the manufacturer. If your system has a module containing a lithium battery, replace it only with the same module type made by the same manufacturer. The battery contains lithium and can explode if not properly used, handled, or disposed of. Do not:

• Throw or immerse into water

• Heat to more than 100°C (212°F)

• Repair or disassemble

Dispose of the battery as required by local ordinances or regulations.

Statement 3

CAUTION:

When laser products (such as CD-ROMs, DVD drives, fiber optic devices, or transmitters) are installed, note the following:

• Do not remove the covers. Removing the covers of the laser product could result in exposure to hazardous laser radiation. There are no serviceable parts inside the device.

• Use of controls or adjustments or performance of procedures other than those specified herein might result in hazardous radiation exposure.

DANGER

Some laser products contain an embedded Class 3A or Class 3B laser diode. Note the following.

Laser radiation when open. Do not stare into the beam, do not view directly with optical instruments, and avoid direct exposure to the beam.

Statement 4

CAUTION: Use safe practices when lifting.

≥ 18 kg (39.7 lb) ≥ 32 kg (70.5 lb) ≥ 55 kg (121.2 lb)

Statement 5

viii Lenovo NeXtScale nx360 M5 water-cooled technology tray Lenovo NeXtScale n1200 Enclosure Installation and Service Guide

CAUTION: The power control button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device. The device also might have more than one power cord. To remove all electrical current from the device, ensure that all power cords are disconnected from the power source.

Statement 6

CAUTION: If you install a strain-relief bracket option over the end of the power cord that is connected to the device, you must connect the other end of the power cord to an easily accessible power source.

Statement 8

CAUTION: Never remove the cover on a power supply or any part that has the following label attached.

Hazardous voltage, current, and energy levels are present inside any component that has this label attached. There are no serviceable parts inside these components. If you suspect a problem with one of these parts, contact a service technician.

Statement 12

CAUTION: The following label indicates a hot surface nearby.

Statement 26

CAUTION: Do not place any object on top of rack-mounted devices.

Statement 27

CAUTION: Hazardous moving parts are nearby.

Statement 31

x Lenovo NeXtScale nx360 M5 water-cooled technology tray Lenovo NeXtScale n1200 Enclosure Installation and Service Guide

DANGER

Electrical current from power, telephone, and communication cables is hazardous.

To avoid a shock hazard:

• Do not connect or disconnect any cables or perform installation, maintenance, or reconfiguration of this product during an electrical storm.

• Connect all power cords to a properly wired and grounded power source.

• Connect to properly wired power sources any equipment that will be attached to this product.

• When possible, use one hand only to connect or disconnect signal cables.

• Never turn on any equipment when there is evidence of fire, water, or structural damage.

• Disconnect the attached ac power cords, dc power sources, network connections, telecommunications systems, and serial cables before you open the device covers, unless you are instructed otherwise in the installation and configuration procedures.

• Connect and disconnect cables as described in the following table when you install, move, or open covers on this product or attached devices.

To Connect: To Disconnect:

1. Turn OFF all power sources and equipment that is to be attached to this product.

2. Attach signal cables to the product.

3. Attach power cords to the product.

• For ac systems, use appliance inlets.

• For dc systems, ensure correct polarity of -48 V dc

connections: RTN is + and -48 V dc is -. Earth ground should use a two-hole lug for safety.

4. Attach signal cables to other devices.

5. Connect power cords to their sources.

6. Turn ON all the power sources.

1. Turn OFF all power sources and equipment that is to be attached to this product.

• For ac systems, remove all power cords from the

chassis power receptacles or interrupt power at the ac power distribution unit.

• For dc systems, disconnect dc power sources at

the breaker panel or by turning off the power source. Then, remove the dc cables.

2. Remove the signal cables from the connectors.

3. Remove all cables from the devices.

Statement 34

CAUTION: To reduce the risk of electric shock or energy hazards:

• This equipment must be installed by trained service personnel in a restricted-access location, as defined by the NEC and IEC 60950-1, First Edition, The Standard for Safety of Information Technology Equipment.

• Connect the equipment to a properly grounded safety extra low voltage (SELV) source. A SELV source is a secondary circuit that is designed so that normal and single fault conditions do not cause the voltages to exceed a safe level (60 V direct current).

• Incorporate a readily available approved and rated disconnect device in the field wiring.

• See the specifications in the product documentation for the required circuit-breaker rating for branch circuit overcurrent protection.

• Use copper wire conductors only. See the specifications in the product documentation for the

240VA

Statement 35:

CAUTION:

Hazardous energy present.Voltages with hazardous energy might cause heating when shorted with metal, which might result in splattered metal, burns, or both.

Statement 36:

CAUTION: Always install the slide retention screw.

required wire size.

• See the specifications in the product documentation for the required torque values for the wiringterminal screws.

Rack Safety Information, Statement 2

DANGER

• Always lower the leveling pads on the rack cabinet.

• Always install stabilizer brackets on the rack cabinet.

• Always install servers and optional devices starting from the bottom of the rack cabinet.

• Always install the heaviest devices in the bottom of the rack cabinet.

xii

Lenovo NeXtScale nx360 M5 water-cooled technology tray Lenovo NeXtScale n1200 Enclosure Installation and Service Guide

Chapter 1. The Lenovo NeXtScale nx360 M5 water-cooled technology tray Type 5467, Lenovo NeXtScale n1200 Enclosure Types 5468 and 5469

This Installation and Service Guide contains information and instructions for setting up your Lenovo NeXtScale nx360 M5 water-cooled technology tray Type 5467, Lenovo NeXtScale n1200 Enclosure Types 5468 and 5469, instructions for installing some optional devices, cabling and configuring the water-cooled technology tray, removing and replacing devices, and diagnostics and troubleshooting information.

The Lenovo NeXtScale nx360 M5 water-cooled technology tray Type 5467 is supported in the Lenovo NeXtScale n1200 Enclosure Types 5468 and 5469 only.

In addition to the instructions in Chapter 2 “Components, features, and controls” on page 21 for installing optional hardware devices, updating firmware and device drivers, and completing the installation, Lenovo Business Partners must also complete the steps in “Instructions for Lenovo Business Partners” on page 21.

The Lenovo NeXtScale nx360 M5 water-cooled technology tray Type 5467 is a 1-U cooled technology tray for high-volume network transaction processing. There are two separate nodes in a single tray. This high-performance, multi-core water-cooled technology tray is a high-availability, scalable water-cooled technology tray that is optimized to support the next-generation microprocessor technology and is ideally suited for medium and large businesses.

Performance, ease of use, reliability, and expansion capabilities were key considerations in the design of the water-cooled technology tray. These design features make it possible for you to customize the system hardware to meet your needs today and provide flexible expansion capabilities for the future.

The water-cooled technology tray comes with a limited warranty. For information about the terms of the warranty and getting service and assistance, see the Lenovo Warranty Information document that comes with the water-cooled technology tray.

The water-cooled technology tray contains X-Architecture next generation technologies, which help increase performance and reliability. For more information, see “What your compute node offers” on page 8 and “Reliability, availability, and serviceability” on page 12.

You can obtain up-to-date information about the water-cooled technology tray and other Lenovo watercooled technology tray products at http://shop.lenovo.com/us/ en/systems/. At http://www.lenovo.com/ support, you can create a personalized support page by identifying Lenovo products that are of interest to you. From this personalized page, you can subscribe to weekly email notifications about new technical documents, search for information and downloads, and access various administrative services.

If you participate in the Lenovo client reference program, you can share information about your use of technology, best practices, and innovative solutions; build a professional network; and gain visibility for your business. For more information about the Lenovo client reference program, see http://www.ibm.com/ibm/ clientreference/.

-high rack model water-

If firmware and documentation updates are available, you can download them from the Lenovo website. The water-cooled technology tray might have features that are not described in the documentation that comes with the water-cooled technology tray, and the documentation might be updated occasionally to include information about those features, or technical updates might be available to provide additional information

1. Racks are measured in vertical increments of 4.45 cm (1.75 inches) each. Each increment is called a "U." A 1-U-high device is 1.75 inches tall

that is not included in the water-cooled technology tray documentation. To check for updates, go to http://

Serial number

www.lenovo.com/support.

Record information about the water-cooled technology tray in the following table.

Table 1. Record of the system information

Product name

Lenovo NeXtScale nx360 M5 water-cooled technology tray Type 5467

Machine Type (s)

Type 5467

Model number Serial number

The model number and serial number are on the ID label on the front of the water-cooled technology tray, as shown in the following illustration.

Note: The illustrations in this document might differ slightly from your hardware.

Figure 1. ID label on the front of the water-cooled technology tray

In addition, the system service label, which is on the cover of the water-cooled technology tray, provides a QR code for mobile access to service information. You can scan the QR code using a QR code reader and scanner with a mobile device and get quick access to the Lenovo Service Information website. The Lenovo Service Information website provides additional information for parts installation and replacement videos, and error codes for water-cooled technology tray support.

The following illustration shows the QR code:

Figure 2. QR code

You can download the Lenovo ServerGuide Setup and Installation CD to help you configure the hardware, install device drivers, and install the operating system.

For a list of supported optional devices for the water-cooled technology tray, see http://www.lenovo.com/ serverproven/.

Lenovo NeXtScale nx360 M5 water-cooled technology tray Lenovo NeXtScale n1200 Enclosure Installation and Service Guide

See the Rack Installation Instructions document on the Lenovo System x Documentation CD for complete rack installation and removal instructions.

The Lenovo Documentation CD

The Lenovo Documentation CD contains documentation for the server in Portable Document Format (PDF) and includes the Lenovo Documentation Browser to help you find information quickly.

Hardware and software requirements

The hardware and software requirements of the Lenovo Documentation CD.

The Lenovo Documentation CD requires the following minimum hardware and software:

• Microsoft Windows or Red Hat Linux

• 100 MHz microprocessor

• 32 MB of RAM

• Adobe Acrobat Reader 3.0 (or later) or xpdf, which comes with Linux operating systems

The Documentation Browser

Use the Documentation Browser to browse the contents of the CD, read brief descriptions of the documents, and view documents, using Adobe Acrobat Reader or xpdf.

The Documentation Browser automatically detects the regional settings in use in your server and displays the documents in the language for that region (if available). If a document is not available in the language for that region, the English-language version is displayed.

Use one of the following procedures to start the Documentation Browser:

• If Autostart is enabled, insert the CD into the CD or DVD drive. The Documentation Browser starts

automatically.

• If Autostart is disabled or is not enabled for all users, use one of the following procedures:

– If you are using a Windows operating system, insert the CD into the CD or DVD drive and click Start ➙

Run. In the Open field, type:

e:\win32.bat

where e is the drive letter of the CD or DVD drive, and click OK.

– If you are using Red Hat Linux, insert the CD into the CD or DVD drive; then, run the following

command from the /mnt/cdrom directory:

sh runlinux.sh

Select the server from the Product menu. The Available Topics list displays all the documents for the server. Some documents might be in folders. A plus sign (+) indicates each folder or document that has additional documents under it. Click the plus sign to display the additional documents.

When you select a document, a description of the document is displayed under Topic Description. To select more than one document, press and hold the Ctrl key while you select the documents. Click View to view the selected document or documents in Acrobat Reader or xpdf. If you selected more than one document, all the selected documents are opened in Acrobat Reader or xpdf.

To search all the documents, type a word or word string in the Search field and click Search. The documents in which the word or word string appears are listed in order of the most occurrences. Click a document to view it, and press Crtl+F to use the Acrobat search function, or press Alt+F to use the xpdf search function within the document.

Chapter 1. The Lenovo NeXtScale nx360 M5 water-cooled technology tray Type 5467, Lenovo NeXtScale n1200 Enclosure Types 5468

and 5469

Click Help for detailed information about using the Documentation Browser.

Brocade documentation

Use this information to identify and locate related Brocade documentation.

The following section introduces Brocade documents that you might find useful for the installation and administration.

Lenovo NeXtScale nx360 M5 water-cooled technology tray Lenovo NeXtScale n1200 Enclosure Installation and Service Guide

• EN4023 User Guide – Network OS Layer 2 Switching Configuration Guide - http://www.brocade.com/content/html/en/

configuration-guide/nos-601a-l2guide/

– Network OS Command Reference Guide - http://www.brocade.com/content/html/en/command-

reference-guide/nos-601a-commandref/index.html

– Network OS Message Reference - http://www.brocade.com/content/html/en/message-reference-

guides/nos-601a-messageref/wwhelp/ wwhimpl/js/html/wwhelp.htm

• FC5022 User Guide – Fabric OS Administrator's Guide - http://www.brocade.com/content/html/en/administration-guide/fos-

740-adminguide/

– Fabric OS Command Reference - http://www.brocade.com/content/html/en/command-reference-

guide/fos-741-commandref/wwhelp/ wwhimpl/js/html/wwhelp.htm

– Fabric OS Message Reference - http://www.brocade.com/content/html/en/message-reference-guides/

FOS_740_MESSAGES/wwhelp/ wwhimpl/js/html/wwhelp.htm#href=Title.1.2.html

– Access Gateway Administrator's Guide - http://www.brocade.com/content/html/en/administration-

guide/fos-740-accessgateway/index.html

Notices and statements in this document

The caution and danger statements in this document are also in the multilingual Safety Information document, which is on the Lenovo Documentation CD. Each statement is numbered for reference to the corresponding statement in your language in the Safety Information document.

The following notices and statements are used in this document:

• Note: These notices provide important tips, guidance, or advice.

• Important: These notices provide information or advice that might help you avoid inconvenient or problem situations.

• Attention: These notices indicate potential damage to programs, devices, or data. An attention notice is placed just before the instruction or situation in which damage might occur.

• Caution: These statements indicate situations that can be potentially hazardous to you. A caution statement is placed just before the description of a potentially hazardous procedure step or situation.

• Danger: These statements indicate situations that can be potentially lethal or extremely hazardous to you. A danger statement is placed just before the description of a potentially lethal or extremely hazardous procedure step or situation.

Server features and specifications

Use this information for an overview of the server features and specifications.

The following information is a summary of the features and specifications of the server. Depending on the model, some features might not be available, or some specifications might not apply.

Microprocessor (depending on the model):

• Supports two ®Intel Xeon™ E5-2600 v3 or two ®Intel Xeon™ E5-2600 v4 series multi-core microprocessors per system board

• Level-3 cache

• Two QuickPath Interconnect (QPI) links speed up to 9.6 GT per second

Chapter 1. The Lenovo NeXtScale nx360 M5 water-cooled technology tray Type 5467, Lenovo NeXtScale n1200 Enclosure Types 5468

and 5469

Notes:

1. Use the Setup utility to determine the type and speed of the microprocessors in the server

2. For a list of supported microprocessors, see http://www.lenovo.com/ serverproven/.

Memory:

• 16 dual inline memory module (DIMM) connectors available per system board

• Type: Low-profile (LP) double-data rate (DDR4) DRAM

• Supports 8 GB / 16 GB RDIMMs and 32 GB DIMMs with up to 512 GB of total memory on the system board

PCI expansion slots:

• One PCI Express x16 slots (PCIe3.0, full-height, half-length, limited to specific adapters) per system board

• One PCI Express x16 (ML2) slots (support 50 mm in height only) per system board

Power supplies:

• Supports six hot-swap ac power supplies – 1300-watt ac

– 1500-watt ac

Notes:

• Power supplies in the chassis must be with the same power rating or wattage.

Integrated functions:

• Integrated management module 2.1 (IMM2.1), which consolidates multiple management functions in a single chip

• Concurrent COM/VGA/2x USB (KVM)

• System error LEDs

• Supports up to two optional ML2 network adapter

• Wake on LAN (WOL)

Video controller (integrated into IMM2.1):

• Matrox G200eR2

• SVGA compatible video controller

• Avocent Digital Video Compression

• Video memory is not expandable

Note: Maximum video resolution is 1600 x 1200 at 75 Hz.

Size:

• Height: 41 mm (1.6 in)

• Depth: 742 mm (29.2 in)

• Width: 438 mm (17.25 in)

• Weight estimation: 13.3 kg (29.3 lb)

Acoustical noise emissions:

Sound power: 7.0 bels

Environment:

Lenovo NeXtScale nx360 M5 water-cooled technology tray Lenovo NeXtScale n1200 Enclosure Installation and Service Guide

The water-cooled technology tray complies with ASHRAE class A3 specifications.

Storage (non-operating):

• Temperature: 1°C to 60°C (33.8°F to 140.0°F)

• Maximum altitude: 3,050 m (10,000 ft)

• Relative humidity: 5% to 80%

• Maximum dew point: 29°C (84.2°F)

Shipment (non-operating):

• Temperature: -40°C to 60°C (-40°F to 140.0°F)

• Maximum altitude: 10,700 m (35,105 ft)

• Relative humidity: 5% to 100%

• Maximum dew point: 29°C (84.2°F)

Server off:

• Temperature: 5°C to 45°C (41°F to 113°F)

• Relative humidity: 8% to 85%

• Maximum dew point: 27°C (80.6°F)

Server on

• Temperature: 5°C to 40°C (41°F to 104°F) up to 950 m

• Humidity, non-condensing: -12°C dew point (10.4°F) and 8% to 85% relative humidity

• Maximum dew point: 24°C (75°F)

• Maximum altitude: 3,050 m (10,000 ft) & 5°C to 28°C (41°F to 82°F)

• Maximum rate of temperature change: 20°C/hr (68°F/hr) for hard disk drives

Water requirement:

• Minimum water flow rate: 6.0 liters per minute per chassis, assuming 1.0 lpm per compute tray with 6 trays per chassis (1 tray consists of 2 compute nodes)

• Inlet Water Temperature: 18 °C to 45 °C (64°F to 113°F) for all processors up to and including 145 W TDP

• Inlet Water Temperature: 18 °C to 35 °C (64°F to 95°F) for processors at 165 W TDP (E5-2698A v3)

• Maximum pressure: 4.4 bars

Note: The water required to initially fill the system side cooling loop must be reasonably clean, bacteriafree water (<100 CFU/ml) such as de-mineralized water, reverse osmosis water, de-ionized water, or distilled water. The water must be filtered with an in-line 50 micron filter (approximately 288 mesh). The water must be treated with anti-biological and anti-corrosion measures. Refer to Water Treatment Specification (part number 00J0351).

Particulate contamination

Attention:

• Design to ASHRAE Class A3, temperature: 36°C to 40°C (96.8°F to 104°F), with relaxed support: – Support cloud such as workload with no performance degradation acceptable (turbo-off)

Chapter 1. The Lenovo NeXtScale nx360 M5 water-cooled technology tray Type 5467, Lenovo NeXtScale n1200 Enclosure Types 5468

and 5469

– Under no circumstance, can any combination of the worst case workload and configuration result

in system shutdown or design exposure at 40°C

– The worst case workload (such as linpack and turbo-on) may have performance degradation

• Airborne particulates and reactive gases acting alone or in combination with other environmental factors such as humidity or temperature might pose a risk to the water-cooled technology tray. For information about the limits for particulates and gases, see “Particulate contamination” on page 851.

Heat output:

Approximate heat output:

• Minimum configuration: 143 BTU per hour (42 watts)

• Maximum configuration: 1733 BTU per hour (508 watts)

Electrical input:

• Sine-wave input (50-60 Hz) required

• Input voltage low range: – Minimum: 100 V AC

– Maximum: 127 V AC

• Input voltage high range: – Minimum: 200 V AC

– Maximum: 240 V AC

• Input kilovolt-amperes (kVA), approximately: – Minimum: 0.042 kVA

– Maximum: 0.508 kVA

What your compute node offers

Your compute node offers features such as the integrated management module II, hard disk drive support, systems-management support, microprocessor technology, integrated network support, I/O expansion, large system-memory capacity, light path diagnostics LEDs, PCI Express, and power throttling.

• Features on Demand If a Features on Demand feature is integrated in the compute node or in an optional device that is installed

in the compute node, you can purchase an activation key to activate the feature. For information about Features on Demand, see https://fod.lenovo.com/lkms.

• Flexible network support The compute node provides flexible network capabilities:

– Models with embedded Ethernet

The server comes with an integrated dual-port Intel Gigabit Ethernet controller, which supports connection to a 10 Mbps, 100 Mbps, or 1000 Mbps network.

• Hard disk drive support Each tray supports up to two 2.5 inch simple swap SATA hard disk drives, or two 1.8-inch simple-swap

solid-state drives (one per node).

• LenovoServerGuide Setup and Installation CD The ServerGuide Setup and Installation CD, which you can download from the web, provides programs to

help you set up the server and install a Windows operating system. The ServerGuide program detects

Lenovo NeXtScale nx360 M5 water-cooled technology tray Lenovo NeXtScale n1200 Enclosure Installation and Service Guide

installed optional hardware devices and provides the correct configuration programs and device drivers. For more information about the ServerGuide Setup and Installation CD, see “Using the ServerGuide Setup and Installation CD” on page 33.

• Integrated management module 2.1 (IMM2.1) The integrated management module 2.1 (IMM2.1) combines service processor functions, video controller,

and remote presence and blue-screen capture features in a single chip. The IMM provides advanced service-processor control, monitoring, and alerting function. If an environmental condition exceeds a threshold or if a system component fails, the IMM lights LEDs to help you diagnose the problem, records the error in the IMM event log, and alerts you to the problem. Optionally, the IMM also provides a virtual presence capability for remote server management capabilities. The IMM provides remote server management through the following industry-standard interfaces:

– Intelligent Platform Management Interface (IPMI) version 2.0 – Simple Network Management Protocol (SNMP) version 3.0 – Common Information Model (CIM) – Web browser For additional information, see “Using the integrated management module” on page 41 and the Integrated

Management Module 2.1 Users Guide at the http://www.lenovo.com/support.

• Large system-memory capacity Each tray supports two compute nodes. Each compute node supports up to 512 GB of system memory.

The memory controller provides support for up to 16 industry-standard registered ECC DDR4 on lowprofile (LP) DIMMs on the system board. For the most current list of supported DIMMs, see http://www. lenovo.com/ serverproven/.

• Lenovo XClarity Administrator Lenovo XClarity Administrator is a centralized resource-management solution that enables administrators

to deploy infrastructure faster and with less effort. The solution seamlessly integrates into System x, ThinkServer, and NeXtScale servers, as well as the Flex System converged infrastructure platform.

Lenovo XClarity Administrator provides: – Automated discovery

– Agent-free hardware management – Monitoring – Firmware updates and compliance – Pattern-based configuration management – Deployment of operating systems and hypervisors Administrators are able to find the right information and accomplish critical tasks faster through an

uncluttered, dashboard-driven graphical user interface (GUI). Centralizing and automating foundational infrastructure deployment and lifecycle management tasks across large pools of systems frees up administrator time, and makes resources available to end-users faster.

Lenovo XClarity is easily extended into the leading virtualization management platforms from Microsoft and VMware using software plug-ins, called Lenovo XClarity Integrators. The solution improves workload uptime and service-level assurance by dynamically relocating workloads from affected hosts in the cluster during rolling server reboots or firmware updates, or during predicted hardware failures.

For more information about Lenovo XClarity Administrator, see the http://shop.lenovo.com/us/en/ systems/software/systems-management/xclarity/ and the http://pic.dhe.ibm.com/infocenter/flexsys/ information/topic/com.lenovo.lxca.doc/aug_product_page.html.

• Installing Lenovo XClarity Administrator – Installing Lenovo XClarity Administrator for the first time

Chapter 1. The Lenovo NeXtScale nx360 M5 water-cooled technology tray Type 5467, Lenovo NeXtScale n1200 Enclosure Types 5468

and 5469

The initial setup of Lenovo XClarity Administrator involves preparing the network, installing and configuring the Lenovo XClarity Administrator virtual appliance, managing systems, and optionally setting up automatic problem notification.

There are a number of different ways to connect manageable systems to the network and to set up the Lenovo XClarity Administrator to manage those systems based on the network topology that is implemented in your environment. For guidance for installing the Lenovo XClarity Administrator in VMware ESXi-based and Hyper-V environments, see http://pic.dhe.ibm.com/infocenter/flexsys/ information/index.jsp?topic=%2Fcom.lenovo.lxca.doc%2 Fsetup.html.

– Free 90-day trial

Lenovo XClarity Administrator offers a free, 90-day trial license that enables you to use all available features (including operating-system deployment, firmware maintenance, and configuration management) for a limited time.

After 90 days, you can continue to use Lenovo XClarity Administrator to manage and monitor your hardware for free; however, you must purchase a full-function-enablement license to continue using Lenovo XClarity Administrator to configure your hardware using Configuration Patterns and to deploy operating systems. You can purchase Lenovo XClarity Administrator licenses from your Lenovo seller or business partner.

For information about installing the license, see http://pic.dhe.ibm.com/infocenter/flexsys/information/ index.jsp?topic=%2Fcom.lenovo.lxca.doc%2 Fupdate_lxcasw.html.

– Updating Lenovo XClarity Administrator

You can download or import Lenovo XClarity Administrator updates and install the updates from the Lenovo XClarity Administrator web interface. For information about updating a Lenovo XClarity Administrator, see http://pic.dhe.ibm.com/infocenter/flexsys/information/index.jsp?topic=%2Fcom. lenovo.lxca.doc%2 Fupdate_lxcasw.html.Ensure that you carefully read the Installation and Setup Instructions in the Invgy_sw_lxca_***_anyos_noarch.txt file that is provided in the update package .zip file.

• Light path diagnostics Light path diagnostics provides LEDs to help you diagnose problems. For more information about light

path diagnostics and the LEDs, see “Server controls, LEDs, and power” on page 13.

• Microprocessor technology The compute node supports up to two multi-core IntelXeon microprocessors. For more information about

supported microprocessors and their part numbers, see http://www.lenovo.com/ serverproven/.

Note: The optional microprocessors that Lenovo supports are limited by the capacity and capability of the compute node. Any microprocessor that you install must have the same specifications as the microprocessor that came with the compute node.

• Mobile access to Lenovo Service Information website The server provides a QR code on the system service label, which is on the cover of the server, that you

can scan using a QR code reader and scanner with a mobile device to get quick access to the Lenovo Service Information website. The Lenovo Service Information website provides additional information for parts installation and replacement videos, and error codes for server support. For the QR code, see Chapter 1 “The Lenovo NeXtScale nx360 M5 water-cooled technology tray Type 5467, Lenovo NeXtScale n1200 Enclosure Types 5468 and 5469” on page 1.

• PCI Express PCI Express is a serial interface that is used for chip-to-chip interconnect and expansion adapter

interconnect. You can add optional I/O and storage devices. Optional expansion nodes are available to provide a cost-effective way for you to increase and customize

the capabilities of the compute node. Expansion nodes support a wide variety of industry-standard PCI Express, network, storage, and graphics adapters.

Lenovo NeXtScale nx360 M5 water-cooled technology tray Lenovo NeXtScale n1200 Enclosure Installation and Service Guide

• Power throttling By enforcing a power policy known as power-domain oversubscription, the Lenovo NeXtScale n1200

Enclosure Type 5468 can share the power load between six power supplies to ensure sufficient power for each device in the Lenovo NeXtScale n1200 Enclosure Type 5468. This policy is enforced when the initial power is applied to the Lenovo NeXtScale n1200 Enclosure Type 5468 or when a compute node is inserted into the Lenovo NeXtScale n1200 Enclosure Type 5468.

The following settings for this policy are available: – Basic power management

– Power module redundancy – Power module redundancy with compute node throttling allowed

Lenovo XClarity Administrator

Lenovo XClarity Administrator is a centralized, resource-management solution that simplifies infrastructure management, speeds responses, and enhances the availability of Lenovo® server systems and solutions. It runs as a virtual appliance that automates discovery, inventory, tracking, monitoring, and provisioning for Lenovo servers, Flex System servers, and RackSwitch switches in a secure environment.

Lenovo XClarity Administrator provides a central interface to perform the following functions for all managed endpoints.

• Hardware management Lenovo XClarity Administrator provides agent-free hardware management. It can automatically discover

manageable endpoints, including Flex System chassis and components, System x, NeXtScale, and ThinkServer servers, and RackSwitch switches. Inventory of the discovered endpoints is also gathered, so an at-a-glance view of the managed hardware inventory and status is possible.

• Hardware monitoring Lenovo XClarity Administrator provides a centralized view of all events and alerts that are generated from

the managed endpoints. When a CMM or IMM detects an issue, an alert or event is passed to the Lenovo XClarity Administrator and is displayed in the events or alerts log. A summary of all alerts and events is visible from the Dashboard and the Status bar. Events and alerts for a specific endpoint are available from the Alerts and Events detail page for that endpoint.

• Operating-system deployment You can use Lenovo XClarity Administrator to manage the repository of operating-system images and

deploy operating-system images to managed servers.

• Configuration management You can quickly provision and pre-provision all of your servers using a consistent configuration.

Configuration settings (such as local storage, I/O adapters, boot settings, firmware, ports, and IMM and UEFI settings) are saved as a server pattern that can be applied to one or more managed servers. When the server patterns are updated, the changes are automatically deployed to the applied servers.

• Firmware compliance and updates Firmware management is simplified by assigning firmware-compliance policies to managed endpoints.

When you create and assign a compliance policy to managed endpoints,Lenovo XClarity Administrator monitors changes to the inventory for those endpoints and flags any endpoints that are out of compliance.

• User management Lenovo XClarity Administrator provides a centralized authentication server to create and manage user

accounts and to manage and authenticate user credentials. The authentication server is created automatically when you start the management server for the first time. The user accounts that you create for Lenovo XClarity Administrator are also used to log in to managed chassis and servers.

Chapter 1. The Lenovo NeXtScale nx360 M5 water-cooled technology tray Type 5467, Lenovo NeXtScale n1200 Enclosure Types 5468

and 5469

• Security If your environment must comply with either NIST SP 800-131A or FIPS 140-2 standards, Lenovo XClarity

Administrator can help you achieve a fully compliant environment. It supports self-signed SSL certificates (which are issued by an internal certificate authority) and external SSL certificates (which are issued by a private or commercial CA). Firewalls on chassis and servers can be configured to accept incoming requests from only Lenovo XClarity Administrator.

• Service and support Lenovo XClarity Administrator can be set up to collect and send diagnostic files automatically to your

preferred service provider when certain serviceable events occur in Lenovo XClarity Administrator and the managed endpoints. You can choose to send diagnostic files to Lenovo Support using call home or to another service provider using SFTP. You can also manually collect diagnostic files, open a problem record, and send diagnostic files to the Lenovo Support Center.

• Task automation using scripts Lenovo XClarity Administrator can be integrated into external, higher-level management and automation

platforms through open REST application programming interfaces (APIs). Using the REST APIs, Lenovo XClarity Administrator can easily integrate with your existing management infrastructure. You can also run Lenovo XClarity cmdlets in a Microsoft PowerShell session to automate certain management functions. The cmdlets use Lenovo XClarity Administrator REST APIs and can automate functions

• Integration with other management software Lenovo XClarity Administrator is available stand-alone or as a bundled offering that is known asLenovo

XClarity Pro. Lenovo XClarity Pro is composed of the base Administrator product plus two Lenovo XClarity Integrator modules that provide integration into Microsoft Systems Center or VMware vCenter. Together, these tools provide discovery, monitoring, configuration, and management functions to reduce the cost and complexity of routine system administration for System x, NeXtScale, and Flex System endpoints.

More information about Lenovo XClarity Administrator is available at http://shop.lenovo.com/us/en/systems/ software/systems-management/xclarity/.

Reliability, availability, and serviceability

Three important computer design features are reliability, availability, and serviceability (RAS). The RAS features help to ensure the integrity of the data that is stored in the server, the availability of the server when you need it, and the ease with which you can diagnose and correct problems.

Your server has the following RAS features:

• 3-year parts and 3-year labor limited warranty (Machine Types 5467, 5468, and 5469)

• Backup basic input/output system switching under the control of the Integrated Management Module 2.1 (IMM2.1)

• Built-in monitoring for fan, power, temperature, voltage, and power-supply redundancy

• Chipkill memory protection

• Diagnostic support for ServeRAID and Ethernet adapters

• Error codes and messages

• Error correcting code (ECC) L3 cache and system memory

• Information and light path diagnostics LED panels

• Light path diagnostics LEDs for DIMMs, microprocessors, and power supplies

• Memory error correcting code and parity test

• Microprocessor built-in self-test (BIST), internal error signal monitoring, internal thermal trip signal monitoring, configuration checking, and microprocessor and voltage regulator module failure identification through light path diagnostics

• Nonmaskable interrupt (NMI) button

• Parity checking on the PCIe buses

• Power management: compliance with Advanced Configuration and Power Interface (ACPI)

Lenovo NeXtScale nx360 M5 water-cooled technology tray Lenovo NeXtScale n1200 Enclosure Installation and Service Guide

• Power-on self-test (POST)

• Redundant hot-swap power supplies

• Serial Presence Detection (SPD) on memory, VPD on system board, power supply, and hard disk drive or solid state drive backplanes, microprocessor and memory expansion tray, and Ethernet adapters

• Single-DIMM isolation of excessive correctable error or multi-bit error by the Unified Extensible Firmware Interface (UEFI)

• Upgradeable POST, Unified Extensible Firmware Interface (UEFI), diagnostics, IMM2.1 firmware, and read-only memory (ROM) resident code, locally or over the LAN

Systems Director

Systems Director is a platform-management foundation that streamlines the way you manage physical and virtual systems supports multiple operating systems and virtualization technologies in Lenovo and nonLenovo x86 platforms.

Through a single user interface, Systems Director provides consistent views for viewing managed systems, determining how these systems relate to one other, and identifying their statuses, helping to correlate technical resources with business needs. A set of common tasks that are included with Systems Director provides many of the core capabilities that are required for basic management, which means instant out-ofthe-box business value. The common tasks include:

• Discovery

• Inventory

• Configuration

• System health

• Updates

• Event notification

• Automation for managed systems

The Systems Director Web and command-line interfaces provide a consistent interface that is focused on driving these common tasks and capabilities:

• Discovering, navigating, and visualizing systems on the network with the detailed inventory and relationships to the other network resources

• Notifying users of problems that occur on systems and the ability to isolate the source of the problems

• Notifying users when systems need updates and distributing and installing updates on a schedule

• Analyzing real-time data for systems and setting critical thresholds that notify the administrator of emerging problems

• Configuring settings of a single system and creating a configuration plan that can apply those settings to multiple systems

• Updating installed plug-ins to add new features and functions to the base capabilities

• Managing the life cycles of virtual resources

For more information about Systems Director, see the Systems Director Information Center at http://publib. boulder.ibm.com/infocenter/director/v6r1x/index.jsp?topic=/director_6.1/fqm0_main.html, and the Systems Management website at http://shop.lenovo.com/us/en/systems/solutions/, which presents an overview of Systems Management and Systems Director.

Server controls, LEDs, and power

This section describes the controls and light-emitting diodes (LEDs) and how to turn the server on and off.

Chapter 1. The Lenovo NeXtScale nx360 M5 water-cooled technology tray Type 5467, Lenovo NeXtScale n1200 Enclosure Types 5468

and 5469

For the locations of other LEDs on the system board, see “System-board LEDs” on page 27.

EthernetKVM connector

System-error LED

Check log LED

Locator button/ locator LED

Power-control button/ power-on LED

Node 1 Node 2

HDD/SSD

Front view

The following illustration shows the controls, LEDs, and connectors on the front of the NeXtScale nx360 M5 water-cooled technology tray Type 5467.

Note: The illustrations in this document might differ slightly from your hardware.

There are two separate nodes in a single tray. The following illustration identifies the buttons, connectors, and LEDs on the control panel.

Figure 3. Water-cooled technology tray control panel buttons, connectors, and LEDs

If you have the optional hard-disk drives(HDDs) or solid-state drives(SSDs) installed, the following illustration identifies their locations.

Figure 4. Locations of the optional HDDs/SDDs

Power button/LED

When the water-cooled technology tray is connected to power through the Lenovo NeXtScale n1200 Enclosure Type 5468, press this button to turn on or turn off the water-cooled technology tray.

This button is also the power LED. This green LED indicates the power status of the water-cooled technology tray:

• Flashing rapidly: The LED flashes rapidly for the following reasons: – The water-cooled technology tray has been installed in a chassis. When you install the water-

cooled technology tray, the LED flashes rapidly for up to 90 seconds while the integrated management module (IMM2.1) in the water-cooled technology tray is initializing.

– The Lenovo NeXtScale n1200 Enclosure Type 5468 does not have enough power to turn on the

water-cooled technology tray.

– The IMM2.1 in the water-cooled technology tray is not communicating with the Chassis

Management Module.

Lenovo NeXtScale nx360 M5 water-cooled technology tray Lenovo NeXtScale n1200 Enclosure Installation and Service Guide

• Flashing slowly: The water-cooled technology tray is connected to power through the Lenovo NeXtScale n1200 Enclosure Type 5468 and is ready to be turned on.

• Lit continuously: The water-cooled technology tray is connected to power through the Lenovo NeXtScale n1200 Enclosure Type 5468 and is turned on.

When the water-cooled technology tray is on, pressing this button causes an orderly shutdown of the water-cooled technology tray so that it can be removed safely from the chassis. This includes shutting down the operating system (if possible) and removing power from the water-cooled technology tray.

If an operating system is running, you might have to press the button for approximately 4 seconds to initiate the shutdown.

Attention: Pressing the button for 4 seconds forces the operating system to shut down immediately. Data loss is possible.

Locator LED

Use this blue LED to visually locate the server among other servers. This LED is used as a presence detection as well. You can use Systems Director or IMM web interface to light this LED remotely. This LED is controlled by the IMM.

Check log LED

When this yellow LED is lit, it indicates that a system error has occurred. Check the “Event logs” on page 62 for additional information.

System error LED

When this yellow LED is lit, it indicates that a system error has occurred. An LED on the system board is also lit to help isolate the error. This LED is controlled by the IMM.

KVM connector

Connect the console breakout cable to this connector.

Note: It is best practice to connect the console breakout cable to only one water-cooled technology tray at a time in each Lenovo NeXtScale n1200 Enclosure Type 5468.

Ethernet connectors

Use either of these connectors to connect the server to a network. When you enable shared Ethernet for IMM2.1 in the Setup utility, you can access the IMM2.1 using either the Ethernet 1 or the systemmanagement Ethernet (default) connector. See Using the Setup utility for more information.

Ethernet link activity/status LED

When any of these LEDs is lit, they indicate that the server is transmitting to or receiving signals from the Ethernet LAN that is connected to the Ethernet port that corresponds to that LED.

Management connector

Use this connector to connect the server to a network for full systems-management information control. This connector is used only by the Integrated Management Module 2.1 (IMM2.1). A dedicated management network provides additional security by physically separating the management network traffic from the production network. You can use the Setup utility to configure the server to use a dedicated systems management network or a shared network.

Rear view

The following illustration shows the connector on the rear of Lenovo NeXtScale n1200 Enclosure Types 5468 and 5469.

Chapter 1. The Lenovo NeXtScale nx360 M5 water-cooled technology tray Type 5467, Lenovo NeXtScale n1200 Enclosure Types 5468

and 5469

Manifold

Power supply

Drip sensor assembly

FPC card module

Figure 5. Connectors on the rear of the Lenovo NeXtScale n1200 Enclosure Types 5468 and 5469

Fan and power controller

You can install the fan and power controller in the Lenovo NeXtScale n1200 Enclosure Type 5468.

Note: The fan and power controller has fault and power-on LEDs similar to those found on the other chassis components. The fan and power controller also has connectors that are unique to the device.

The fan and power controller provides integrated systems-management functions, including a 10/100 Mbps remote management and console (Ethernet) connector.

Fan and power controller indicators, controls, and connectors

The fan and power controller has LEDs, controls, and connectors that you can use to obtain status information and restart the fan and power controller.

Lenovo NeXtScale nx360 M5 water-cooled technology tray Lenovo NeXtScale n1200 Enclosure Installation and Service Guide

+ 848 hidden pages

Lenovo NeXtScale nx360 M5, NeXtScale n1200 Installation And Service Manual

Specifications and Main Features

Frequently Asked Questions

User Manual

Safety

Safety statements

Chapter 1. The Lenovo NeXtScale nx360 M5 water-cooled technology tray Type 5467, Lenovo NeXtScale n1200 Enclosure Types 5468 and 5469

The Lenovo Documentation CD

Hardware and software requirements

The Documentation Browser

Related documentation

Brocade documentation

Notices and statements in this document

Server features and specifications

What your compute node offers

Lenovo XClarity Administrator

Reliability, availability, and serviceability

Systems Director

Server controls, LEDs, and power

Front view

Rear view