Cisco UCS C240 Installation And Service Manual

Download

Page 1

Cisco UCS C240 Server Installation and Service Guide

Covers Server Generation M3

May 14, 2014

Americas Headquarters

Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000

800 553-NETS (6387)

Fax: 408 527-0883

Text Part Number: OL-25761-01

Page 2

THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.

THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.

The following information is for FCC compliance of Class A devices: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to part 15 of the FCC rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio-frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case users will be required to correct the interference at their own expense.

The following information is for FCC compliance of Class B devices: This equipment has been tested and found to comply with the limits for a Class B digital device, pursuant to part 15 of the FCC rules. These limits are designed to provide reasonable protection against harmful interference in a residential installation. This equipment generates, uses and can radiate radio frequency energy and, if not installed and used in accordance with the instructions, may cause harmful interference to radio communications. However, there is no guarantee that interference will not occur in a particular installation. If the equipment causes interference to radio or television reception, which can be determined by turning the equipment off and on, users are encouraged to try to correct the interference by using one or more of the following measures:

• Reorient or relocate the receiving antenna.

• Increase the separation between the equipment and receiver.

• Connect the equipment into an outlet on a circuit different from that to which the receiver is connected.

• Consult the dealer or an experienced radio/TV technician for help.

Modifications to this product not authorized by Cisco could void the FCC approval and negate your authority to operate the product.

The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public domain version of the UNIX operating system. All rights reserved. Copyright © 1981, Regents of the University of California.

NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS” WITH ALL FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE PRACTICE.

IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.

CCDE, CCENT, CCSI, Cisco Eos, Cisco Explorer, Cisco HealthPresence, Cisco IronPort, the Cisco logo, Cisco Nurse Connect, Cisco Pulse, Cisco SensorBase, Cisco StackPower, Cisco StadiumVision, Cisco TelePresence, Cisco TrustSec, Cisco Unified Computing System, Cisco WebEx, DCE, Flip Channels, Flip for Good, Flip Mino, Flipshare (Design), Flip Ultra, Flip Video, Flip Video (Design), Instant Broadband, and Welcome to the Human Network are trademarks; Changing the Way We Work, Live, Play, and Learn, Cisco Capital, Cisco Capital (Design), Cisco:Financed (Stylized), Cisco Store, Flip Gift Card, and One Million Acts of Green are service marks; and Access Registrar, Aironet, AllTouch, AsyncOS, Bringing the Meeting To You, Catalyst, CCDA, CCDP, CCIE, CCIP, CCNA, CCNP, CCSP, CCVP, Cisco, the Cisco Certified Internetwork Expert logo, Cisco IOS, Cisco Lumin, Cisco Nexus, Cisco Press, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Cisco Unity, Collaboration Without Limitation, Continuum, EtherFast, EtherSwitch, Event Center, Explorer, Follow Me Browsing, GainMaker, iLYNX, IOS, iPhone, IronPort, the IronPort logo, Laser Link, LightStream, Linksys, MeetingPlace, MeetingPlace Chime Sound, MGX, Networkers, Networking Academy, PCNow, PIX, PowerKEY, PowerPanels, PowerTV, PowerTV (Design), PowerVu, Prisma, ProConnect, ROSA, SenderBase, SMARTnet, Spectrum Expert, StackWise, WebEx, and the WebEx logo are registered trademarks of Cisco and/or its affiliates in the United States and certain other countries.

Cisco and the Cisco Logo are trademarks of Cisco Systems, Inc. and/or its affiliates in the U.S. and other countries. A listing of Cisco's trademarks can be found at

www.cisco.com/go/trademarks. Third party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership

relationship between Cisco and any other company. (1005R)

Any Internet Protocol (IP) addresses and phone numbers used in this document are not intended to be actual addresses and phone numbers. Any examples, command display output, network topology diagrams, and other figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses or phone numbers in illustrative content is unintentional and coincidental.

Cisco UCS C240 Server Installation and Service Guide

Page 3

Preface vii

Preface

This preface describes the audience, organization, and conventions of the Cisco UCS C240 Server Installation and Service Guide. It also provides information about how to obtain related documentation.

Organization

This guide is organized as follows:

Chapter Title Description

Chapter 1 Overview Provides an overview of the server.

Chapter 2 Installing the Server Describes how to install the server in a rack, how to cable and

Chapter 3 Maintaining the

Appendix A Server Specifications Lists physical, environmental, and power specifications for the

Appendix B Power Cord

Appendix C RAID Controller

Appendix D Installation for Cisco

Server

Specifications

Considerations

UCS Integration

power on the server, and how to initially set up the server in standalone mode.

Describes the server LEDs and buttons, identifies the replaceable components of the server, and describes how to replace them.

server.

Lists specifications for the supported international power cords.

Provides server RAID controller information.

Provides installation and upgrade procedures for installing the server into Unified Computing System (UCS) integration.

OL-25761-01

Cisco UCS C240 Server Installation and Service Guide

vii

Page 8

Audience

This guide is for experienced network administrators who configure and maintain Cisco servers.

Documentation Feedback

To provide technical feedback on this document, or to report an error or omission, please send your comments to ucs-docfeedback@external.cisco.com. We appreciate your feedback.

Conventions

This document uses the following conventions for notes, cautions, and safety warnings. Notes and cautions contain important information that you should know.

Note Means reader take note. Notes contain helpful suggestions or references to material that are not covered

in the publication.

Preface

Caution Means reader be careful. Cautions contain information about something you might do that could result

Warning

Waarschuwing

in equipment damage or loss of data.

Safety warnings appear throughout this guide in procedures that, if performed incorrectly, can cause physical injuries. A warning symbol precedes each warning statement.

IMPORTANT SAFETY INSTRUCTIONS

This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents. Use the statement number provided at the end of each warning to locate its translation in the translated safety warnings that accompanied this device.

SAVE THESE INSTRUCTIONS

BELANGRIJKE VEILIGHEIDSINSTRUCTIES

Dit waarschuwingssymbool betekent gevaar. U verkeert in een situatie die lichamelijk letsel kan veroorzaken. Voordat u aan enige apparatuur gaat werken, dient u zich bewust te zijn van de bij elektrische schakelingen betrokken risico's en dient u op de hoogte te zijn van de standaard praktijken om ongelukken te voorkomen. Gebruik het nummer van de verklaring onderaan de waarschuwing als u een vertaling van de waarschuwing die bij het apparaat wordt geleverd, wilt raadplegen.

Statement 1071

viii

BEWAAR DEZE INSTRUCTIES

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 9

Preface

Varoitus

Attention

Warnung

TÄRKEITÄ TURVALLISUUSOHJEITA

Tämä varoitusmerkki merkitsee vaaraa. Tilanne voi aiheuttaa ruumiillisia vammoja. Ennen kuin käsittelet laitteistoa, huomioi sähköpiirien käsittelemiseen liittyvät riskit ja tutustu onnettomuuksien yleisiin ehkäisytapoihin. Turvallisuusvaroitusten käännökset löytyvät laitteen mukana toimitettujen käännettyjen turvallisuusvaroitusten joukosta varoitusten lopussa näkyvien lausuntonumeroiden avulla.

SÄILYTÄ NÄMÄ OHJEET

IMPORTANTES INFORMATIONS DE SÉCURITÉ

Ce symbole d'avertissement indique un danger. Vous vous trouvez dans une situation pouvant entraîner des blessures ou des dommages corporels. Avant de travailler sur un équipement, soyez conscient des dangers liés aux circuits électriques et familiarisez-vous avec les procédures couramment utilisées pour éviter les accidents. Pour prendre connaissance des traductions des avertissements figurant dans les consignes de sécurité traduites qui accompagnent cet appareil, référez-vous au numéro de l'instruction situé à la fin de chaque avertissement.

CONSERVEZ CES INFORMATIONS

WICHTIGE SICHERHEITSHINWEISE

Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut. Suchen Sie mit der am Ende jeder Warnung angegebenen Anweisungsnummer nach der jeweiligen Übersetzung in den übersetzten Sicherheitshinweisen, die zusammen mit diesem Gerät ausgeliefert wurden.

Avvertenza

Advarsel

BEWAHREN SIE DIESE HINWEISE GUT AUF.

IMPORTANTI ISTRUZIONI SULLA SICUREZZA

Questo simbolo di avvertenza indica un pericolo. La situazione potrebbe causare infortuni alle persone. Prima di intervenire su qualsiasi apparecchiatura, occorre essere al corrente dei pericoli relativi ai circuiti elettrici e conoscere le procedure standard per la prevenzione di incidenti. Utilizzare il numero di istruzione presente alla fine di ciascuna avvertenza per individuare le traduzioni delle avvertenze riportate in questo documento.

CONSERVARE QUESTE ISTRUZIONI

VIKTIGE SIKKERHETSINSTRUKSJONER

Dette advarselssymbolet betyr fare. Du er i en situasjon som kan føre til skade på person. Før du begynner å arbeide med noe av utstyret, må du være oppmerksom på farene forbundet med elektriske kretser, og kjenne til standardprosedyrer for å forhindre ulykker. Bruk nummeret i slutten av hver advarsel for å finne oversettelsen i de oversatte sikkerhetsadvarslene som fulgte med denne enheten.

TA VARE PÅ DISSE INSTRUKSJONENE

OL-25761-01

Cisco UCS C240 Server Installation and Service Guide

Page 10

Preface

Aviso

¡Advertencia!

Varning!

INSTRUÇÕES IMPORTANTES DE SEGURANÇA

Este símbolo de aviso significa perigo. Você está em uma situação que poderá ser causadora de lesões corporais. Antes de iniciar a utilização de qualquer equipamento, tenha conhecimento dos perigos envolvidos no manuseio de circuitos elétricos e familiarize-se com as práticas habituais de prevenção de acidentes. Utilize o número da instrução fornecido ao final de cada aviso para localizar sua tradução nos avisos de segurança traduzidos que acompanham este dispositivo.

GUARDE ESTAS INSTRUÇÕES

INSTRUCCIONES IMPORTANTES DE SEGURIDAD

Este símbolo de aviso indica peligro. Existe riesgo para su integridad física. Antes de manipular cualquier equipo, considere los riesgos de la corriente eléctrica y familiarícese con los procedimientos estándar de prevención de accidentes. Al final de cada advertencia encontrará el número que le ayudará a encontrar el texto traducido en el apartado de traducciones que acompaña a este dispositivo.

GUARDE ESTAS INSTRUCCIONES

VIKTIGA SÄKERHETSANVISNINGAR

Denna varningssignal signalerar fara. Du befinner dig i en situation som kan leda till personskada. Innan du utför arbete på någon utrustning måste du vara medveten om farorna med elkretsar och känna till vanliga förfaranden för att förebygga olyckor. Använd det nummer som finns i slutet av varje varning för att hitta dess översättning i de översatta säkerhetsvarningar som medföljer denna anordning.

SPARA DESSA ANVISNINGAR

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 11

Preface

Aviso

Advarsel

INSTRUÇÕES IMPORTANTES DE SEGURANÇA

Este símbolo de aviso significa perigo. Você se encontra em uma situação em que há risco de lesões corporais. Antes de trabalhar com qualquer equipamento, esteja ciente dos riscos que envolvem os circuitos elétricos e familiarize-se com as práticas padrão de prevenção de acidentes. Use o número da declaração fornecido ao final de cada aviso para localizar sua tradução nos avisos de segurança traduzidos que acompanham o dispositivo.

GUARDE ESTAS INSTRUÇÕES

VIGTIGE SIKKERHEDSANVISNINGER

Dette advarselssymbol betyder fare. Du befinder dig i en situation med risiko for legemesbeskadigelse. Før du begynder arbejde på udstyr, skal du være opmærksom på de involverede risici, der er ved elektriske kredsløb, og du skal sætte dig ind i standardprocedurer til undgåelse af ulykker. Brug erklæringsnummeret efter hver advarsel for at finde oversættelsen i de oversatte advarsler, der fulgte med denne enhed.

GEM DISSE ANVISNINGER

OL-25761-01

Cisco UCS C240 Server Installation and Service Guide

Page 12

Preface

xii

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 13

Preface

Obtaining Documentation and Submitting a Service Request

For information on obtaining documentation, using the Cisco Bug Search Tool (BST), submitting a service request, and gathering additional information, see What’s New in Cisco Product Documentation at: http://www.cisco.com/c/en/us/td/docs/general/whatsnew/whatsnew.html.

Subscribe to What’s New in Cisco Product Documentation, which lists all new and revised Cisco technical documentation, as an RSS feed and deliver content directly to your desktop using a reader application. The RSS feeds are a free service.

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

xiii

Page 14

Preface

xiv

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 15

Overview

This chapter provides an overview of the Cisco UCS C240 server features.

External Features Overview, page 1-1

Summary of Server Features, page 1-5

External Features Overview

The figures in this chapter show an overview of external server features.

(Internal server features are illustrated in Figure 3-5 on page 3-9.)

The server is orderable in three different versions, each with one of three different front panel/backplane configurations:

• Cisco UCS C240 (small form-factor (SFF) drives, with 24-drive backplane and expander).

Holds up to twenty-four 2.5-inch hard drives or solid state drives.

CHA PTER

• Cisco UCS C240 (small form-factor (SFF) drives, with 16-drive backplane, no expander).

Holds up to sixteen 2.5-inch hard drives or solid state drives.

• Cisco UCS C240 (large form-factor (LFF) drives, with 12-drive backplane and expander).

Holds up to twelve 3.5-inch hard drives.

OL-25761-01

Cisco UCS C240 Server Installation and Service Guide

1-1

Page 16

Chapter 1 Overview

Figure 1-1 shows the front panel features of the small form-factor drives version of the server. This

version of the server can be ordered with either a 16-drive backplane or a 24-drive backplane with an expander. When the 16-drive backplane is installed, only the first 16 drive bays are used.

Figure 1-1 Cisco UCS C240 Server (Small Form-Factor Drives) Front Panel Features

331807

HDD 1

HDD 2

HDD 3

HDD 4

HDD 5

HDD 6

HDD 7

HDD 8

HDD 9

HDD 10

HDD 11

HDD 12

HDD 13

HDD 14

HDD 15

HDD 16

HDD 17

HDD 18

HDD 19

HDD 20

HDD 21

HDD 22

HDD 23

HDD 24

1 KVM connector

6 Temperature status LED

(used with KVM cable that provides two USB 2.0, one VGA, and one serial connector)

2 Pull-out asset tag 7 Fan status LED 3 Drives, hot-swappable (up to 24 2.5-inch drives) 8 System status LED 4 Network link activity LED 9 Identification button/LED 5 Power supply status LED 10 Power button/power status LED

1-2

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 17

Chapter 1 Overview

Figure 1-2 shows the front panel features of the Large Form-Factor drives version of the server. This

version of the server has a 12-drive backplane with an expander.

Figure 1-2 Cisco UCS C240 Server (Large Form-Factor Drives) Front Panel Features

HDD 1

HDD 5

HDD 9

HDD 2

HDD 6

HDD 10

HDD 3

HDD 7

HDD 11

HDD 4

HDD 8

HDD 12

1 KVM connector

6 Temperature status LED

(used with KVM cable that provides two USB 2.0, one VGA, and one serial connector)

2 Pull-out asset tag 7 Fan status LED 3 Drives, hot-swappable

8 System status LED

(up to twelve 3.5-inch drives)

4 Network link activity LED 9 Identification button/LED 5 Power supply status LED 10 Power button/power status LED

331825

OL-25761-01

Cisco UCS C240 Server Installation and Service Guide

1-3

Page 18

Chapter 1 Overview

PSU1 PSU2

PCIe 1

PCIe 2

PCIe 3

PCIe 4

PCIe 5

4 98 107 1165

2 3

331826

Figure 1-3 shows the rear panel features of the server (identical for all versions of the server).

Figure 1-3 Cisco UCS C240 Server Rear Panel Features

1 Power supplies (two) 7 1-Gb Ethernet dedicated management port 2 PCIe slot on riser 2:

PCIe 5—full-height, 3/4-length, x16 lane)

3 PCIe slot on riser 2:

PCIe 4—half-height, 3/4-length, x8 lane)

4 VGA video connector 10 PCIe slots on riser 1:

5 Serial port (RJ-45 connector) 11 Rear Identification button/LED 6 USB port –

8 USB 2.0 port

9 Quad 1-Gb Ethernet ports

(LAN1, LAN2, LAN3, and LAN4)

PCIe 1—full-height, half-length, x8 lane PCIe 2—full-height, half-length, x16 lane PCIe 3—full-height, half-length, x8 lane

Cisco UCS C240 Server Installation and Service Guide

1-4

OL-25761-01

Page 19

Chapter 1 Overview

Summary of Server Features

Table 1-1 lists a summary of server features.

Table 1-1 Cisco UCS C240 Server Features

Chassis Two rack-unit (2RU) chassis.

Processors Two Intel Xeon E5-2600 Series processors.

Memory The server provides 24 DIMM

This provides a possible total of up to 768 GB of industry-standard DDR3 memory.

Multi-bit error

This server supports multi-bit error protection.

protection

Baseboard management

BMC, running Cisco Integrated Management Controller (CIMC) firmware.

Depending on your CIMC settings, the CIMC can be accessed through the 1-Gb Ethernet dedicated management port, the 1-Gb Ethernet LOM ports, or a Cisco virtual interface card.

Network and

The server provides these connectors:

management I/O

WoL The 1-Gb Base-T Ethernet LAN ports support the wake-on-LAN (WoL) standard.

Power Two power supplies: Optionally both 650 W each or both 1200 W each. Do not mix

power supply types in the server.

sockets on the motherboard.

• One 1-Gb Ethernet dedicated management port

• Four 1-Gb Base-T Ethernet LAN ports

• One RS-232 serial port (RJ-45 connector)

• One 15-pin VGA

• Two USB

• One front-panel KVM connector that is used with the included KVM cable,

which provides two USB, one VGA, and one serial connector.

connector

2.0 connectors

OL-25761-01

Redundant as 1+1. See Power Specifications, page A-2.

ACPI This server supports the advanced configuration and power interface (ACPI) 4.0

standard.

Cooling Six hot-swappable fan modules for front-to-rear cooling.

PCIe I/O Five horizontal PCIe

expansion slots on two risers.

See Replacing a PCIe Card, page 3-40 for specifications of the slots.

InfiniBand The bus slots in this server support the InfiniBand architecture.

Cisco UCS C240 Server Installation and Service Guide

1-5

Page 20

Chapter 1 Overview

Table 1-1 Cisco UCS C240 Server Features (continued)

Storage Drives are installed into front-panel drive bays that provide hot-pluggable access.

The server is orderable in three different versions, each with one of three different front panel/backplane configurations:

• Cisco UCS C240 (small form-factor (SFF) drives, with 24-drive backplane

and expander). Holds up to twenty-four 2.5-inch hard drives or solid state drives.

• Cisco UCS C240 (small form-factor (SFF) drives, with 16-drive backplane, no

expander). Holds up to sixteen 2.5-inch hard drives or solid state drives.

• Cisco UCS C240 (large form-factor (LFF) drives, with 12-drive backplane and

expander). Holds up to twelve 3.5-inch hard drives.

The server also contains one internal USB port on the motherboard that you can use with a USB thumb drive for additional storage.

The server also has two internal bays for SD cards.

Disk Management

For a list of RAID

Considerations, page C-1.

(RAID)

RAID Backup There are two mounting points inside the chassis that can be used for RAID backup

units. This unit can be either of the following:

• The LSI battery backup unit that can be used with LSI MegaRAID cards.

controller options and required cabling, see RAID Controller

• The SuperCap power module that can be used with LSI MegaRAID-CV cards.

Video Resolution up to 1600x1200, 16bpp at 60 Hz. Up to 256 MB of video memory.

1. DIMM = dual inline memory module

2. DDR3 = double data rate, type 3

3. VGA = video graphics array

4. USB = universal serial bus

5. PCIe = peripheral component interconnect express

6. RAID = redundant array of independent disks

1-6

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 21

CHA PTER

Installing the Server

This chapter describes how to install the server, and it includes the following sections:

• Unpacking and Inspecting the Server, page 2-2

• Preparing for Server Installation, page 2-3

• Installing the Server In a Rack, page 2-5

• Initial Server Setup, page 2-10

• NIC Modes and NIC Redundancy Settings, page 2-14

• System BIOS and CIMC Firmware, page 2-15

• Updating the BIOS and CIMC Firmware, page 2-15

• Service Headers and Jumpers, page 2-17

Note Before you install, operate, or service a server, review the Regulatory Compliance and Safety

Information for Cisco UCS C-Series Servers for important safety information.

OL-25761-01

Warning

IMPORTANT SAFETY INSTRUCTIONS

Statement 1071

SAVE THESE INSTRUCTIONS

Cisco UCS C240 Server Installation and Service Guide

2-1

Page 22

Unpacking and Inspecting the Server

Cisco

UCS C-Series

1 2

3 4

331827

HDD 1

HDD 2

HDD 3

HDD 4

HDD 5

HDD 6

HDD 7

HDD 8

HDD 9

HDD 10

HDD 11

HDD 12

HDD 13

HDD 14

HDD 15

HDD 16

HDD 17

HDD 18

HDD 19

HDD 20

HDD 21

HDD 22

HDD 23

HDD 24

Unpacking and Inspecting the Server

Caution When handling internal server components, wear an ESD strap and handle modules by the carrier edges

only.

Tip Keep the shipping container in case the server requires shipping in the future.

Note The chassis is thoroughly inspected before shipment. If any damage occurred during transportation or

any items are missing, contact your customer service representative immediately.

To inspect the shipment, follow these steps:

Step 1 Remove the server from its cardboard container and save all packaging material. Step 2 Compare the shipment to the equipment list provided by your customer service representative and

Figure 2-1. Verify that you have all items.

Chapter 2 Installing the Server

Step 3 Check for damage and report any discrepancies or damage to your customer service representative. Have

the following information ready:

• Invoice number of shipper (see the packing slip)

• Model and serial number of the damaged unit

• Description of damage

• Effect of damage on the installation

Figure 2-1 Shipping Box Contents

1 Server 3 Documentation 2 Power cord (optional, up to two) 4 KVM cable

2-2

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 23

Chapter 2 Installing the Server

Preparing for Server Installation

This section provides information about preparing for server installation, and it includes the following topics:

• Installation Guidelines, page 2-3

• Rack Requirements, page 2-4

• Equipment Requirements, page 2-4

• Slide Rail Adjustment Range, page 2-4

Installation Guidelines

Preparing for Server Installation

Warning

Caution All Cisco UCS C-Series rack servers are shipped with rail kits and are expected to be rack-mounted. To

To prevent the system from overheating, do not operate it in an area that exceeds the maximum recommended ambient temperature of: 35° C (95° F).

Statement 1047

The plug-socket combination must be accessible at all times, because it serves as the main disconnecting device.

Statement 1019

This product relies on the building’s installation for short-circuit (overcurrent) protection. Ensure that the protective device is rated not greater than: 250 V, 15 A.

Statement 1005

Installation of the equipment must comply with local and national electrical codes.

Statement 1074

ensure proper air flow it is necessary to rack the servers using the provided rail kits. Physically placing the units on top of one another or “stacking” without the use of the rail kits blocks the air vents on top of the servers, which could result in overheating, higher fan speeds, and higher power consumption. It is recommended that you mount your servers on the rail kits when installing them into the rack because these rails provide the minimal spacing required between the servers. No additional spacing between the servers is required when you mount the units using the provided rail kits.

OL-25761-01

Caution Avoid UPS types that use ferroresonant technology. These UPS types can become unstable with systems

such as the Cisco UCS, which can have substantial current draw fluctuations from fluctuating data traffic patterns.

Cisco UCS C240 Server Installation and Service Guide

2-3

Page 24

Preparing for Server Installation

When you are installing a server, use the following guidelines:

• Plan your site configuration and prepare the site before installing the server. See the Cisco UCS Site

Preparation Guide for the recommended site planning tasks.

• Ensure that there is adequate space around the server to allow for servicing the server and for

adequate airflow. The airflow in this server is from front to back.

• Ensure that the air-conditioning meets the thermal requirements listed in the Server Specifications.

• Ensure that the cabinet or rack meets the requirements listed in the “Rack Requirements” section on

page 2-4.

• Ensure that the site power meets the power requirements listed in the Server Specifications. If

available, you can use an uninterruptible power supply (UPS) to protect against power failures.

Rack Requirements

This section provides the requirements for the standard open racks.

The rack must be of the following type:

• A standard 19-in. (48.3-cm) wide, four-post EIA rack, with mounting posts that conform to English

universal hole spacing, per section 1 of ANSI/EIA-310-D-1992.

Chapter 2 Installing the Server

• The rack post holes can be square 0.38-inch (9.6 mm), round 0.28-inch (7.1 mm), #12-24 UNC, or

#10-32 UNC when you use the supplied slide rails.

• The minimum vertical rack space per server must be two RUs, equal to 3.5 in. (88.9 mm).

Equipment Requirements

The slide rails supplied by Cisco Systems for this server do not require tools for installation if you install them in a rack that has square 0.38-inch (9.6 mm), round 0.28-inch (7.1 mm), or #12-24 UNC threaded holes. The inner rails are pre-attached to the sides of the server.

However, if you install the slide rails in a rack that has #10-32 round holes, a bladed screwdriver is required to remove the larger square/round mounting pegs from the front of the slide rails.

Slide Rail Adjustment Range

The slide rails for this server have an adjustment range of 26 to 36 inches (660 to 914 mm).

2-4

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 25

Chapter 2 Installing the Server

Installing the Server In a Rack

This section contains the following sections:

• Installing the Slide Rails, page 2-5

• Installing the Cable Management Arm (Optional), page 2-8

• Reversing the Cable Management Arm (Optional), page 2-9

Installing the Slide Rails

Installing the Server In a Rack

Warning

To prevent bodily injury when mounting or servicing this unit in a rack, you must take special precautions to ensure that the system remains stable. The following guidelines are provided to ensure your safety:

This unit should be mounted at the bottom of the rack if it is the only unit in the rack. When mounting this unit in a partially filled rack, load the rack from the bottom to the top with the heaviest component at the bottom of the rack. If the rack is provided with stabilizing devices, install the stabilizers before mounting or servicing the unit in the rack.

Statement 1006

To install the slide rails and the server into a rack, follow these steps:

Step 1 Install the slide rails into the rack (see Figure 2-2):

a. Align the slide-rail assembly inside the rack posts with the length-adjustment bracket (Figure 2-2,

item 4) toward the rear of the rack.

b. Compress the length-adjustment bracket until the mounting pegs (item 5) and locking clips (item 6)

engage the desired rack holes on the front and rear rack posts.

–

The mounting pegs fit square 0.38-inch (9.6 mm), round 0.28-inch (7.1 mm), or #12-24 UNC threaded holes. They fit the shape of the hole when the pegs are compressed.

–

The smaller #10-32 round mounting pegs are enclosed in the center of the compressible rear pegs. However, to use the #10-32 pegs, you must use a bladed screwdriver to remove the square/round front pegs.

OL-25761-01

Cisco UCS C240 Server Installation and Service Guide

2-5

Page 26

Installing the Server In a Rack

Figure 2-2 Attaching a Slide-Rail Assembly

1 2

Chapter 2 Installing the Server

1 Front-right rack post 4 Length-adjustment bracket 2 Rear-right rack post 5 Mounting pegs (two on each end of assembly) 3 Slide-rail assembly 6 Locking clips (one on each end of assembly)

Attach the second slide-rail assembly to the opposite side of the rack. Ensure that the two slide-rail

assemblies are level and at the same height with each other.

d. Pull the inner slide rails on each assembly out toward the rack front until they hit the internal stops

and lock in place.

Step 2 Insert the server into the slide rails (see Figure 2-3):

Caution This server weighs approximately 60 pounds (28 kilograms) when fully loaded with components. We

recommend that you use a minimum of two people when lifting the server. Attempting this procedure alone could result in personal injury or equipment damage.

330499

2-6

Note The inner rails are pre-attached to the sides of the server at the factory. You can order

replacement inner rails if these are damaged or lost (Cisco PID UCSC-RAIL-2U-I).

a. Align the inner rails that are attached to the server sides with the front ends of the empty slide rails. b. Push the server into the slide rails until it stops at the internal stops. c. Push in the slide rail locking clip (item 2) on each inner rail, and then continue pushing the server

into the rack until its front flanges latch onto the rack posts.

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 27

Chapter 2 Installing the Server

Figure 2-3 Inserting the Server Into the Slide Rails

1 Inner rail on server 3 Slide rail assembly on rack post 2 Slide rail locking clip 4 Right-front rack post

Installing the Server In a Rack

330534

Step 3 Optional–If you want to install the cable management arm, continue with Installing the Cable

Management Arm (Optional), page 2-8.

OL-25761-01

Cisco UCS C240 Server Installation and Service Guide

2-7

Page 28

Installing the Server In a Rack

TOP VIEW

SIDE VIEW

Chapter 2 Installing the Server

Installing the Cable Management Arm (Optional)

To install the cable management arm (CMA) to the rear of the slide rails, use the following procedure.

Note The CMA is reversible right-to-left. However when reversing, you must remove and reposition

the CMA attachment tabs for correct installation. To reverse the CMA, see Reversing the Cable

Management Arm (Optional), page 2-9 before installation.

Note When positioning the CMA, make sure that the CMA is correctly oriented with the “TOP” stamp

on the CMA arms facing upward. See Figure 2-4.

Step 1 With the server pushed fully into the rack, insert the outer CMA tab into the clip inside the rear of the

outer slide rail. Insert the tab into the clip until it clicks and locks.

Step 2 Pull outward on the spring-loaded peg that is on the inner CMA tab. You can turn this peg 90 degrees to

lock it in the open position.

Step 3 Push the inner CMA tab over the end of the inner rail that is attached to the server, and then release the

spring-loaded peg.

The spring-loaded peg must align with and enter the hole in the inner rail to lock the CMA in place. If you turned the peg 90 degrees to lock it open, now turn it back 90 degrees to release it.

Figure 2-4 Attaching the Cable Management Arm

1 Outer CMA tab attached to outer slide rail 3 Rear of right slide rail assembly 2 Inner CMA tab with spring-loaded peg

4 “TOP” stamp on CMA arms facing upward

attached to inner rail

2-8

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 29

Chapter 2 Installing the Server

Orientation for mounting to left slide rail

Orientation for mounting to right slide rail

Installing the Server In a Rack

Reversing the Cable Management Arm (Optional)

The CMA is shipped assembled for installation to the rear of the right-hand slide rails (when facing the rear of the server). The CMA is reversible so that you can mount it to the rear of either the right or left slide rails. However, you must remove and reposition the CMA tabs so that the hinges open correctly.

To reverse the CMA, use the following procedure:

Step 1 Orient the CMA so that the “TOP” stamp on the CMA arms are facing upward (see Figure 2-5). Step 2 Reverse the entire CMA assembly 180 degrees, keeping the “TOP” stamp on the CMA arms facing

upward.

Step 3 Loosen the captive thumbscrew on each CMA arm. Step 4 Remove the CMA tab from each arm.Slide the CMA tab forward until its pegs can be removed from the

keyed holes on the CMA arms.

Step 5 Install the inner CMA tab with the spring-loaded peg onto the CMA arm that is closest to the server (the

inner CMA arm). The tab fits onto the side of the arm that is opposite the captive thumbscrew.

a. Insert the pegs on the CMA tab into the keyed holes on the CMA arm and slide the tab to lock the

pegs in place.

b. Tighten the captive thumbscrew.

Step 6 Install the CMA tab with no spring-loaded tab onto the CMA arm that is farthest from the server (the

outer CMA arm).The tab fits onto the side of the arm that is opposite the captive thumbscrew.

a. Insert the pegs on the CMA tab into the keyed holes on the CMA arm and slide the tab to lock the

pegs in place.

b. Tighten the captive thumbscrew.

Step 7 Install the CMA to the slide rails using the procedure in Installing the Cable Management Arm

(Optional), page 2-8.

Figure 2-5 Reversing the Cable Management Arm

1 “TOP” stamp on CMA arms 3 Inner CMA tab attaches to CMA arm closest

2 Captive thumbscrews on CMA arms 4 Outer CMA tab attaches to CMA arm farthest

to server

from server

OL-25761-01

Cisco UCS C240 Server Installation and Service Guide

2-9

Page 30

Initial Server Setup

Connecting and Powering On the Server (Standalone Mode)

Note This section describes how to power on the server, assign an IP address, and connect to server

management when using the server in standalone mode. To use the server in UCS integration, specific cabling and settings are required. See Installation for Cisco UCS Integration, page D-1.

The server is shipped with these default settings:

• The NIC mode is Shared LOM EXT.

Shared LOM EXT mode enables the 1-Gb Ethernet ports and the ports on any installed Cisco virtual interface card (VIC) to access the Cisco Integrated Management Interface (Cisco IMC). If you want to use the 10/100 dedicated management ports to access the Cisco IMC, you can connect to the server and change the NIC mode as described in Step 4 of the following procedure.

• The NIC redundancy is active-active. All Ethernet ports are utilized simultaneously.

• DHCP is enabled.

• Internet protocol version 4 (IPv4) is enabled.

Chapter 2 Installing the Server

Use the following procedure to perform initial setup of the server:

Step 1 Attach a supplied power cord to each power supply in your server, and then attach the power cord to a

grounded AC power outlet. See the Power Specifications, page A-2 for power specifications.

Wait for approximately two minutes to let the server boot in standby power during the first bootup.

You can verify power status by looking at the Power Status LED (see Figure 1-1 on page 1-2):

• Off—There is no AC power present in the server.

• Amber—The server is in standby power mode. Power is supplied only to the CIMC and some

motherboard functions.

• Green—The server is in main power mode. Power is supplied to all server components.

Note During bootup, the server beeps once for each USB device that is attached to the server. Even if

there are no external USB devices attached, there is a short beep for each virtual USB device such as a virtual floppy drive, CD/DVD drive, keyboard, or mouse. A beep is also emitted if a USB device is hot-plugged or hot-unplugged during BIOS power-on self test (POST), or while you are accessing the BIOS Setup utility or the EFI shell.

Step 2 Connect a USB keyboard and VGA monitor by using the supplied KVM cable connected to the KVM

connector on the front panel (see Figure 1-1 on page 1-2).

2-10

Note Alternatively, you can use the VGA and USB ports on the rear panel. However, you cannot use

the front panel VGA and the rear panel VGA at the same time. If you are connected to one VGA connector and you then connect a video device to the other connector, the first VGA connector is disabled.

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 31

Chapter 2 Installing the Server

Step 3 Open the Cisco IMC Configuration Utility:

a. Press the Power button to boot the server. Watch for the prompt to press F8.

b. During bootup, press F8 when prompted to open the Cisco IMC Configuration Utility. Note the

Figure 2-6 Cisco IMC Configuration Utility Window 1 and Window 2 (Cisco IMC 2.0(1) and Later)

Initial Server Setup

differences between versions of Cisco IMC firmware:

–

In Cisco IMC 2.0(1) and later, there are two windows for this utility that you can switch between by pressing F1 or F2 (see Figure 2-6 for sample windows). The IPv4 and IPv6 protocols and dynamic domain name system (DDNS) are supported. You can also define a host name and a DDNS domain.

–

In Cisco IMC earlier than release 2.0(1), there is only one window for this utility. Only the IPv4 protocol is supported. DDNS is not supported.

Step 4

Set NIC mode and NIC redundancy:

a. Set the NIC mode to your choice for which ports to use to access the CIMC for server management

(see Figure 1-3 for identification of the ports):

• Shared LOM EXT (default)—This is shared LOM extended mode. This is the factory-default

setting, along with Active-active NIC redundancy and DHCP-enabled. With this mode, the shared LOM and Cisco Card interfaces are both enabled.

In this mode, DHCP replies are returned to both the shared LOM ports and the Cisco card ports. If the system determines that the Cisco card connection is not getting its IP address from a Cisco UCS Manager system because the server is in standalone mode, further DHCP requests from the Cisco card are disabled. Use the Cisco Card NIC mode if you want to connect to the CIMC through a Cisco card in standalone mode.

• Dedicated—The dedicated management port is used to access the CIMC. You must select a NIC

redundancy and IP setting.

• Shared LOM—The 1-Gb Ethernet ports are used to access the CIMC. You must select a NIC

redundancy and IP setting.

• Cisco Card—The ports on an installed Cisco UCS virtual interface card (VIC) are used to access the

CIMC. You must select a NIC redundancy and IP setting.

Note The Cisco Card NIC mode is currently supported only with a Cisco UCS VIC that is installed in

PCIe slot 2. See also Special Considerations for Cisco UCS Virtual Interface Cards, page 3-43.

OL-25761-01

Cisco UCS C240 Server Installation and Service Guide

2-11

Page 32

Initial Server Setup

Step 5 Choose whether to enable DHCP for dynamic network settings, or to enter static network settings.

Chapter 2 Installing the Server

b. Use this utility to change the NIC redundancy to your preference. This server has three possible NIC

redundancy settings:

–

None—The Ethernet ports operate independently and do not fail over if there is a problem.

–

Active-standby—If an active Ethernet port fails, traffic fails over to a standby port.

–

Active-active—All Ethernet ports are utilized simultaneously. See NIC Modes and NIC

Redundancy Settings, page 2-14 for more information.

Note Before you enable DHCP, your DHCP server must be preconfigured with the range of MAC

addresses for this server. The MAC address is printed on a label on the rear of the server. This server has a range of six MAC addresses assigned to the Cisco IMC. The MAC address printed on the label is the beginning of the range of six contiguous MAC addresses.

Note In Cisco IMC 2.0(1) and later, you can choose whether to use IPv4 or IPv6 IP addresses by

checking either the IPv4 or IPv6 check box.

The static IPv4 and IPv6 settings include:

• The Cisco IMC IP address.

• The prefix/subnet.

For IPv6, valid values are 1–127.

• The gateway.

For IPv6, if you do not know the gateway, you can set it as none by typing :: (two colons).

• The preferred DNS server address.

For IPv6, you can set this as none by typing :: (two colons).

Step 6 Optional: Use this utility to make VLAN settings. Step 7 Continue with the next action based on which release of Cisco IMC your server is running:

• Cisco IMC earlier than release 2.0(1)—Skip to Step 14.

• Cisco IMC 2.0(1) and later—Press F1 to go to the second settings window, then continue with the

next step. From the second window, you can press F2 to switch back to the first window.

Step 8 Optional: Set a host name for the server. Step 9 Optional: Enable dynamic DNS and set a dynamic DNS (DDNS) domain. Step 10 Optional: If you select the Factory Default check box, the server will be set back to the factory defaults. Step 11 Optional: Set a default user password. Step 12 Optional: Enable auto-negotiation of port settings or set the port speed and duplex mode manually.

2-12

Note Auto-negotiation is applicable only when you use the Dedicated NIC mode. Auto-negotiation

sets the port speed and duplex mode automatically based on the switch port to which the server is connected. If you disable auto-negotiation, you must set the port speed and duplex mode manually.

Step 13 Optional: Reset port profiles and the port name.

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 33

Chapter 2 Installing the Server

Step 14 Press F5 to refresh the settings you made. You might have to wait about 45 seconds until the new settings

appear and the message, next step.

Step 15 Press F10 to save your settings and reboot the server.

Note If you chose to enable DHCP, the dynamically assigned IP and MAC addresses are displayed on

Step 16 Connect to the CIMC for server management. Connect Ethernet cables from your LAN to the server by

using the ports that you selected by your NIC Mode setting in Step 4. The Active-active and Active-passive NIC redundancy settings require you to connect to two ports.

Step 17 Use a browser and the IP address of the CIMC to connect to the CIMC Setup Utility. The IP address is

based upon the settings that you made in Step 4 (either a static address or the address assigned by your DHCP server).

Note The default user name for the server is admin. The default password is password.

Initial Server Setup

Network settings configured is displayed before you reboot the server in the

the console screen during bootup.

To manage the server, see the Cisco UCS C-Series Rack-Mount Server Configuration Guide or the Cisco UCS C-Series Rack-Mount Server CLI Configuration Guide for instructions on using those interfaces. The links to these documents are in the C-Series documentation roadmap:

http://www.cisco.com/go/unifiedcomputing/c-series-doc

OL-25761-01

Cisco UCS C240 Server Installation and Service Guide

2-13

Page 34

NIC Modes and NIC Redundancy Settings

This server has the following NIC mode settings that you can choose from:

• Shared LOM EXT (default)—This is shared LOM extended mode. This is the factory-default

setting, along with Active-active NIC redundancy and DHCP-enabled. With this mode, the shared LOM and Cisco Card interfaces are both enabled.

In this mode, DHCP replies are returned to both the shared LOM ports and the Cisco card ports. If the system determines that the Cisco card connection is not getting its IP address from a Cisco UCS Manager system because the server is in standalone mode, further DHCP requests from the Cisco card are disabled. If the system determines that the Cisco card connection is getting its IP address from a Cisco UCS Manager system, the reply has parameters that automatically move the server to UCSM mode.

• Dedicated—The dedicated management port is used to access the CIMC. You must select a NIC

redundancy and IP setting.

• Shared LOM—The 1-Gb Ethernet ports are used to access the CIMC. You must select a NIC

redundancy and IP setting.

• Cisco Card—The ports on an installed Cisco UCS virtual interface card (VIC) are used to access the

CIMC. You must select a NIC redundancy and IP setting.

Chapter 2 Installing the Server

Note The Cisco Card NIC mode is currently supported only with a Cisco UCS VIC that is installed in

PCIe slot 2. See also Special Considerations for Cisco UCS Virtual Interface Cards, page 3-43.

This server has the following NIC redundancy settings that you can choose from:

• None—The Ethernet ports operate independently and do not fail over if there is a problem.

• Active-standby—If an active Ethernet port fails, traffic fails over to a standby port.

• Active-active—All Ethernet ports are utilized simultaneously.

The active/active setting uses Mode 5 or Balance-TLB (adaptive transmit load balancing). This is channel bonding that does not require any special switch support. The outgoing traffic is distributed according to the current load (computed relative to the speed) on each slave. Incoming traffic is received by the current slave. If the receiving slave fails, another slave takes over the MAC address of the failed receiving slave.

2-14

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 35

Chapter 2 Installing the Server

System BIOS and CIMC Firmware

This section includes information about the system BIOS and it includes the following sections:

• Updating the BIOS and CIMC Firmware, page 2-15

• Accessing the System BIOS, page 2-16

Updating the BIOS and CIMC Firmware

Caution When you upgrade the BIOS firmware, you must also upgrade the CIMC firmware to the same version

or the server will not boot. Do not power off the server until the BIOS and CIMC firmware are matching or the server will not boot.

Cisco provides the Cisco Host Upgrade Utility to assist with simultaneously upgrading the BIOS, CIMC, and other firmware to compatible levels.

The server uses firmware obtained from and certified by Cisco. Cisco provides release notes with each firmware image. There are several methods for updating the firmware:

• Recommended method for systems running firmware level 1.2 or later: Use the Cisco Host

Upgrade Utility to simultaneously upgrade the CIMC, BIOS, LOM, LSI storage controller, and Cisco UCS P81E VIC firmware to compatible levels.

See the Cisco Host Upgrade Utility Quick Reference Guide for your firmware level at the documentation roadmap link below.

System BIOS and CIMC Firmware

Note Your system firmware must be at minimum level 1.2 to use the Cisco Host Upgrade Utility. If

your firmware is prior to level 1.2, you must use the methods below to update the BIOS and CIMC firmware individually.

• You can upgrade the BIOS using the EFI interface, or upgrade from a Windows or Linux platform.

See the Cisco UCS C-Series Rack-Mount Server BIOS Upgrade Guide.

• You can upgrade the CIMC and BIOS firmware by using the CIMC GUI interface.

See the Cisco UCS C-Series Rack-Mount Server Configuration Guide.

• You can upgrade the CIMC and BIOS firmware by using the CIMC CLI interface.

See the Cisco UCS C-Series Rack-Mount Server CLI Configuration Guide.

For links to the documents listed above, see the documentation roadmap at the following URL:

http://www.cisco.com/go/unifiedcomputing/c-series-doc

OL-25761-01

Cisco UCS C240 Server Installation and Service Guide

2-15

Page 36

System BIOS and CIMC Firmware

Chapter 2 Installing the Server

Accessing the System BIOS

To change the BIOS settings for your server, follow these steps. Detailed instructions are also printed on the BIOS screens.

Step 1 Enter the BIOS setup utility by pressing the F2 key when prompted during bootup.

Note The version and build of the current BIOS are displayed on the Main page of the utility.

Step 2 Use the arrow keys to select the BIOS menu page. Step 3 Highlight the field to be modified by using the arrow keys. Step 4 Press Enter to select the field that you want to change, and then modify the value in the field. Step 5 Press the right arrow key until the Exit menu screen is displayed. Step 6 Follow the instructions on the Exit menu screen to save your changes and exit the setup utility (or Press

F10). You can exit without saving changes by pressing Esc.

2-16

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 37

Chapter 2 Installing the Server

Service Headers and Jumpers

This section includes the following topics:

• Header Locations on the Motherboard, page 2-17

• Using the BIOS Recovery Header J2068, page 2-18

• Using the Clear CMOS Header J2065, page 2-21

Header Locations on the Motherboard

See Figure 2-7. The block of headers is shown in red. The individual headers are shown in the magnified view. The pin numbering is the same for all headers in the block.

Service Headers and Jumpers

Figure 2-7 Service Header Locations

SAS2

SAS1

FAN1

FAN2

FAN3

FAN4

FAN5

FAN6

CPU1

CPU2

321

SAS1

SAS2

SAS1

Riser 1

SAS2

Riser 2

OL-25761-01

333941

1 J2068 BIOS RCVR BOOT 2 J2065 Clear CMOS

Cisco UCS C240 Server Installation and Service Guide

2-17

Page 38

Service Headers and Jumpers

Using the BIOS Recovery Header J2068

Depending on which stage the BIOS becomes corrupted, you might see different behavior.

• If the BIOS BootBlock is corrupted, you might see the system get stuck on the following message:

Initializing and configuring memory/hardware

• If it is a non-BootBlock corruption, the following message is displayed:

****BIOS FLASH IMAGE CORRUPTED**** Flash a valid BIOS capsule file using CIMC WebGUI or CLI interface. IF CIMC INTERFACE IS NOT AVAILABLE, FOLLOW THE STEPS MENTIONED BELOW.

1. Connect the USB stick with recovery.cap file in root folder.

2. Reset the host. IF THESE STEPS DO NOT RECOVER THE BIOS

1. Power off the system.

2. Mount recovery jumper.

3. Connect the USB stick with recovery.cap file in root folder.

4. Power on the system. Wait for a few seconds if already plugged in the USB stick. REFER TO SYSTEM MANUAL FOR ANY ISSUES.

Chapter 2 Installing the Server

Note As indicated by the message shown above, there are two procedures for recovering the BIOS. Try

procedure 1 first, then if that does not recover the BIOS, use procedure 2.

Note The server must have CIMC version 1.4(6) or later to use these procedures.

Procedure 1: Reboot With recovery.cap File

Step 1 Download the BIOS update package and extract it to a temporary location. Step 2 Copy the contents of the extracted recovery folder to the root directory a USB thumb drive. The recovery

folder contains the recovery.cap file that is required in this procedure.

Note The recovery.cap file must be in the root directory of the USB thumb drive. Do not rename this

file. The USB thumb drive must be formatted with either FAT16 or FAT32 file systems.

Step 3 Insert the USB thumb drive into a USB port on the server. Step 4 Reboot the server. Step 5 Return the server to main power mode by pressing the Power button on the front panel.

The server boots with the updated BIOS boot block. When the BIOS detects a valid recovery.cap file on the USB thumb drive, it displays this message:

Found a valid recovery file...Transferring to CIMC System would flash the BIOS image now... System would restart with recovered image after a few seconds...

2-18

Step 6 Wait for server to complete the BIOS update, then remove the USB thumb drive from the server.

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 39

Chapter 2 Installing the Server

Note During the BIOS update, the CIMC will shut down the server and the screen will be blank for

Service Headers and Jumpers

about 10 minutes. Do not unplug the power cords during this update. The CIMC will power on the server after the update is complete.

OL-25761-01

Cisco UCS C240 Server Installation and Service Guide

2-19

Page 40

Service Headers and Jumpers

Procedure 2: Use Recovery Jumper and recovery.cap File

See Figure 2-7 for the location of the J2068 header.

Step 1 Download the BIOS update package and extract it to a temporary location. Step 2 Copy the contents of the extracted recovery folder to the root directory a USB thumb drive. The recovery

folder contains the recovery.cap file that is required in this procedure.

Note The recovery.cap file must be in the root directory of the USB thumb drive. Do not rename this

file. The USB thumb drive must be formatted with either FAT16 or FAT32 file systems.

Step 3 Power off the server as described in Shutting Down and Powering Off the Server, page 3-7. Step 4 Disconnect all power cords from the power supplies. Step 5 Slide the server out the front of the rack far enough so that you can remove the top cover. You might have

to detach cables from the rear panel to provide clearance.

Chapter 2 Installing the Server

Caution If you cannot safely view and access the component, remove the server from the rack.

Step 6 Remove the top cover as described in Removing and Replacing the Server Top Cover, page 3-8. Step 7 Move the shorting jumper to pins 2 and 3 of the J2068 header (see Figure 2-7). Step 8 Reconnect AC power cords to the server. The server powers up to standby power mode. Step 9 Insert the USB thumb drive that you prepared in Step 2 into a USB port on the server. Step 10 Return the server to main power mode by pressing the Power button on the front panel.

The server boots with the updated BIOS boot block. When the BIOS detects a valid recovery.cap file on the USB thumb drive, it displays this message:

Found a valid recovery file...Transferring to CIMC System would flash the BIOS image now... System would restart with recovered image after a few seconds...

Step 11 Wait for server to complete the BIOS update, then remove the USB thumb drive from the server.

Note During the BIOS update, the CIMC will shut down the server and the screen will be blank for

about 10 minutes. Do not unplug the power cords during this update. The CIMC will power on the server after the update is complete.

Step 12 After the server has fully booted, power off the server again and disconnect all power cords. Step 13 Move the jumper back to the default pins 1 and 2 of the J41 header.

2-20

Note If you do not move the jumper, after recovery completion you see the prompt, “Please remove

the recovery jumper.”

Step 14 Replace the top cover, replace the server in the rack, replace power cords and any other cables, then

power on the server by pressing the Power button.

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 41

Chapter 2 Installing the Server

Using the Clear CMOS Header J2065

See Figure 2-7 for the location of this header. You can jumper this header to clear the server’s CMOS settings in the case of a system hang. For example, if the server hangs because of incorrect settings and does not boot, use this jumper to invalidate the settings and reboot with defaults.

Caution Clearing the CMOS removes any customized settings and might result in data loss. Make a note of any

necessary customized settings in the BIOS before you use this clear CMOS procedure.

Step 1 Power off the server as described in Shutting Down and Powering Off the Server, page 3-7. Step 2 Disconnect all power cords from the power supplies. Step 3 Slide the server out the front of the rack far enough so that you can remove the top cover. You might have

to detach cables from the rear panel to provide clearance.

Caution If you cannot safely view and access the component, remove the server from the rack.

Service Headers and Jumpers

Step 4 Remove the top cover as described in Removing and Replacing the Server Top Cover, page 3-8. Step 5 Move the shorting jumper to pins 2 and 3 of the J2065 header (see Figure 2-7). Step 6 Reinstall the top cover and reconnect AC power cords to the server. The server powers up to standby

power mode, indicated when the Power LED on the front panel is amber.

Step 7 Return the server to main power mode by pressing the Power button on the front panel. The server is in

main power mode when the Power LED is green.

Note You must allow the entire server, not just the service processor, to reboot to main power mode

to complete the reset. This is because the state of the jumper cannot be determined without the host CPU running.

Step 8 Press the Power button to shut down the server to standby power mode, and then remove AC power cords

from the server to remove all power.

Step 9 Remove the top cover from the server. Step 10 Move the shorting jumper from header pins 2 and 3, back to its default position on pins 1 and 2.

Note If you do not move the jumper, the CMOS settings are reset to the default every time that you

power-cycle the server.

Step 11 Replace the top cover, replace the server in the rack, replace power cords and any other cables, then

power on the server by pressing the Power button.

OL-25761-01

Cisco UCS C240 Server Installation and Service Guide

2-21

Page 42

Service Headers and Jumpers

Chapter 2 Installing the Server

2-22

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 43

CHA PTER

Maintaining the Server

This chapter describes how to diagnose server system problems using LEDs. It also provides information about how to install or replace hardware components, and it includes the following sections:

• Server Monitoring and Management Tools, page 3-1

• Status LEDs and Buttons, page 3-2

• Preparing for Server Component Installation, page 3-7

• Installing or Replacing Server Components, page 3-11

Server Monitoring and Management Tools

Cisco Integrated Management Interface (CIMC)

You can monitor the server inventory, health, and system event logs by using the built-in Cisco Integrated Management Controller (CIMC) GUI or CLI interfaces. See the user documentation for your firmware release at the following URL:

http://www.cisco.com/en/US/products/ps10739/products_installation_and_configuration_guides_list.html

Server Configuration Utility

Cisco has also developed the Cisco Server Configuration Utility for C-Series servers, which can aid and simplify the following tasks:

• Monitoring server inventory and health

• Diagnosing common server problems with diagnostic tools and logs

• Setting the BIOS booting order

• Configuring some RAID configurations

• Installing operating systems

You can download the ISO from Cisco.com. See the user documentation for your version of the utility at the following URL:

http://www.cisco.com/en/US/products/ps10493/products_user_guide_list.html

OL-25761-01

Cisco UCS C240 Server Installation and Service Guide

3-1

Page 44

Status LEDs and Buttons

This section describes the location and meaning of LEDs and buttons and includes the following topics

• Front Panel LEDs, page 3-2

• Rear Panel LEDs and Buttons, page 3-4

• Internal Diagnostic LEDs, page 3-6

Front Panel LEDs

Figure 3-1 shows the front panel LEDs. Table 3- 1 defines the LED states.

Chapter 3 Maintaining the Server

Figure 3-1 Front Panel LEDs

1 2

HDD 1

HDD 2

HDD 3

HDD 4

HDD 5

HDD 6

HDD 7

HDD 8

HDD 9

HDD 10

HDD 11

HDD 12

HDD 13

HDD 14

HDD 15

HDD 16

HDD 17

HDD 18

HDD 19

HDD 20

HDD 21

HDD 22

HDD 23

HDD 24

331828

1 Hard drive fault LED 6 Fan status LED 2 Hard drive activity LED 7 System status LED 3 Network link activity LED 8 Identification button/LED 4 Power supply status LED 9 Power button/power status LED 5 Temperature status LED –

Table 3-1 Front Panel LEDs, Definitions of States

LED Name State

Hard drive fault

Hard drive activity

Network link activity

Cisco UCS C240 Server Installation and Service Guide

• Off—The hard drive is operating properly.

• Amber—This hard drive has failed.

• Amber, blinking—The device is rebuilding.

• Off—There is no hard drive in the hard drive sled (no access, no fault).

• Green—The hard drive is ready.

• Green, blinking—The hard drive is reading or writing data.

• Off—The Ethernet link is idle.

• Green—One or more Ethernet LOM ports are link-active, but there is no activity.

• Green, blinking—One or more Ethernet LOM ports are link-active, with activity.

3-2

OL-25761-01

Page 45

Chapter 3 Maintaining the Server

Table 3-1 Front Panel LEDs, Definitions of States (continued)

LED Name State

Power supply status • Green—All power supplies are operating normally.

• Amber, steady—One or more power supplies are in a degraded operational state.

• Amber, blinking—One or more power supplies are in a critical fault state.

Temperature status

Fan status

System status

• Green—The server is operating at normal temperature.

• Amber, steady—One or more temperature sensors have exceeded a warning

threshold.

• Amber, blinking—One or more temperature sensors have exceeded a critical

threshold.

• Green—All fan modules are operating properly.

• Amber, steady—One fan module has failed.

• Amber, blinking—Critical fault, two or more fan modules have failed.

• Green—The server is running in normal operating condition.

Status LEDs and Buttons

Identification

Power button/Power status LED

• Green, blinking—The server is performing system initialization and memory check.

• Amber, steady—The server is in a degraded operational state. For example:

–

Power supply redundancy is lost.

–

CPUs are mismatched.

–

At least one CPU is faulty.

–

At least one DIMM is faulty.

–

At least one drive in a RAID configuration failed.

• Amber, blinking—The server is in a critical fault state. For example:

–

Boot failed.

–

Fatal CPU and/or bus error is detected.

–

Server is in over-temperature condition.

• Off—The Identification LED is not in use.

• Blue—The Identification LED is activated.

• Off—There is no AC power to the server.

• Amber—The server is in standby power mode. Power is supplied only to the CIMC

and some motherboard functions.

• Green—The server is in main power mode. Power is supplied to all server

components.

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-3

Page 46

Status LEDs and Buttons

Rear Panel LEDs and Buttons

Figure 3-2 shows the rear panel LEDs and buttons. Table 3-2 defines the LED states.

Figure 3-2 Rear Panel LEDs and Buttons

PSU1 PSU2

PCIe 5

Chapter 3 Maintaining the Server

PCIe 1

PCIe 4

PCIe 2

PCIe 3

331829

1 Power supply fault LED 5 1-Gb Ethernet link speed LED 2 Power supply AC OK LED 6 1-Gb Ethernet link status LED 3 1-Gb Ethernet dedicated management link

status LED

4 1-Gb Ethernet dedicated management link

speed LED

Table 3-2 Rear Panel LEDs, Definitions of States

LED Name State

Power supply fault

• Off—The power supply is operating normally.

• Amber, blinking—An event warning threshold has been reached, but the power

supply continues to operate.

• Amber, solid—A critical fault threshold has been reached, causing the power

supply to shut down (for example, a fan failure or an over-temperature condition).

Power supply AC OK AC power supplies:

• Off—There is no AC power to the power supply.

• Green, blinking—AC power OK, DC output not enabled.

• Green, solid—AC power OK, DC outputs OK.

3 4 5 61 2

7 Identification button/LED

–

1-Gb Ethernet dedicated management link speed

Cisco UCS C240 Server Installation and Service Guide

3-4

DC power supplies:

• Off—There is no DC power to the power supply.

• Green, blinking—DC power OK, DC output not enabled.

• Green, solid—DC power OK, DC outputs OK.

• Off—link speed is 10 Mbps.

• Amber—link speed is 100 Mbps.

• Green—link speed is 1 Gbps.

OL-25761-01

Page 47

Chapter 3 Maintaining the Server

Table 3-2 Rear Panel LEDs, Definitions of States (continued)

LED Name State

1-Gb Ethernet dedicated management link status

1-Gb Ethernet link speed

1-Gb Ethernet link status

Identification

• Off—No link is present.

• Green—Link is active.

• Green, blinking—Traffic is present on the active link.

• Off—link speed is 10 Mbps.

• Amber—link speed is 100 Mbps.

• Green—link speed is 1 Gbps.

• Off—No link is present.

• Green—Link is active.

• Green, blinking—Traffic is present on the active link.

• Off—The Identification LED is not in use.

• Blue—The Identification LED is activated.

Status LEDs and Buttons

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-5

Page 48

Status LEDs and Buttons

SAS2

SAS1

FAN1

FAN2

FAN3

FAN4

FAN5

FAN6

CPU1

CPU2

SAS1

SAS2

Riser 1

Riser 2

SAS1

SAS2

1 2

331830

Internal Diagnostic LEDs

The server is equipped with a SuperCap voltage source that can activate internal component fault LEDs up to one half-hour after AC power is removed. The server has internal fault LEDs for fan modules and DIMMs.

To use these LEDs to identify a failed component, press the front or rear Identification button (see

Figure 3-1 or Figure 3-2) with AC power removed. An LED lights amber to indicate a failed component.

See Figure 3-3 for the locations of these internal LEDs.

Figure 3-3 Internal Diagnostic LED Locations

Chapter 3 Maintaining the Server

3-6

1 Fan module fault LEDs (one on each fan

module)

Table 3-3 Internal Diagnostic LEDs, Definition of States

LED Name State

Cisco UCS C240 Server Installation and Service Guide

Internal diagnostic LEDs (all)

2 DIMM fault LEDs (one next to each DIMM

socket on the motherboard)

• Off—Component is functioning normally.

• Amber—Component has failed.

OL-25761-01

Page 49

Chapter 3 Maintaining the Server

Preparing for Server Component Installation

This section describes how to prepare for component installation, and it includes the following topics:

• Required Equipment, page 3-7

• Shutting Down and Powering Off the Server, page 3-7

• Removing and Replacing the Server Top Cover, page 3-8

• Replaceable Component Locations, page 3-9

• Serial Number Location, page 3-10

• Color-Coded Touch Points, page 3-10

Required Equipment

The following equipment is used to perform the procedures in this chapter:

• Number 2 Phillips-head screwdriver

• Electrostatic discharge (ESD) strap or other grounding equipment such as a grounded mat

Preparing for Server Component Installation

Shutting Down and Powering Off the Server

The server can run in two power modes:

• Main power mode—Power is supplied to all server components and any operating system on your

drives can run.

• Standby power mode—Power is supplied only to the service processor and the cooling fans and it

is safe to power off the server from this mode.

You can invoke a graceful shutdown or an hard shutdown by using either of the following methods:

• Use the CIMC management interface.

• Use the Power button on the server front panel. To use the Power button, follow these steps:

Step 1 Check the color of the Power Status LED (see the “Front Panel LEDs” section on page 3-2).

• Green—the server is in main power mode and must be shut down before it can be safely powered

off. Go to Step 2.

• Amber—the server is already in standby mode and can be safely powered off. Go to Step 3.

Step 2 Invoke either a graceful shutdown or a hard shutdown:

Caution To avoid data loss or damage to your operating system, you should always invoke a graceful shutdown

of the operating system.

OL-25761-01z

• Graceful shutdown—Press and release the Power button. The operating system performs a graceful

shutdown and the server goes to standby mode, which is indicated by an amber Power Status LED.

• Emergency shutdown—Press and hold the Power button for 4 seconds to force the main power off

and immediately enter standby mode.

Step 3 Disconnect the power cords from the power supplies in your server to completely power off the server.

Cisco UCS C240 Server Installation and Service Guide

3-7

Page 50

Preparing for Server Component Installation

Removing and Replacing the Server Top Cover

To remove or replace the top cover of the server, follow these steps:

Tip You do not have to remove the cover to replace hard drives or power supplies.

Step 1 Remove the top cover (see Figure 3-4).

a. Loosen the captive thumbscrew that secures the rear edge of the cover to the chassis. b. Press the release button. c. Using the rubber finger pads, push the top cover toward the server rear about one-half inch

(1.27 cm), until it stops.

d. Lift the top cover straight up from the server and set it aside.

Step 2 Replace the top cover:

a. Place the cover on top of the server about one-half inch (1.27 cm) behind the lip of the chassis front

cover panel. The cover should sit flat.

Chapter 3 Maintaining the Server

Note The rear of the cover has a wrap-around flanged edge that must be correctly aligned with the

chassis rear edge when sliding the cover forward.

b. Slide the top cover toward the front cover panel until it stops and the release button locks. c. Tighten the captive thumbscrew that secures the rear edge of the cover to the chassis.

Figure 3-4 Removing the Top Cover

3-8

1 Front cover panel 3 Rubber finger pads (two) 2 Release button 4 Captive thumbscrew

Cisco UCS C240 Server Installation and Service Guide

331832

OL-25761-01

Page 51

Chapter 3 Maintaining the Server

SAS2

SAS1

FAN1

FAN2

FAN3

FAN4

FAN5

FAN6

CPU1

CPU2

SAS1

SAS2

Riser 1

Riser 2

SAS1

SAS2

5 6

2 3 4 7 8 9 10 12

3213

3214

331833

Replaceable Component Locations

This section shows the locations of the components that are discussed in this chapter. The view in

Figure 3-5 is from the top down with the top cover and air baffles removed.

Figure 3-5 Replaceable Component Locations

Preparing for Server Component Installation

1 Drives

(hot-swappable, accessed through front panel)

11 Optional mezzanine RAID controller card,

mini-SAS connectors SAS1 and SAS2

2 Drive backplane 12 Trusted platform module socket on

motherboard

3 Drive backplane expander 13 PCIe riser 1 (three full-height slots) 4 RTC battery (on motherboard under fan tray) 14 PCIe riser 2 (one full-height slot and one

half-height slot)

5 Fan modules (six, hot-swappable) 15 SD card slot SD2 6 DIMM slots on motherboard (24) 16 SD card slot SD1 7 CPUs and heatsinks (two) 17 Internal USB 2.0 port on motherboard 8 SCU upgrade ROM header

(PBG DYNAMIC SKU)

9 Integrated RAID mini-SAS connectors on

motherboard, SASPORT 1 and SASPORT2

10 Software RAID 5 key header

(SW RAID KEY)

18 Power supplies (two, hot-swappable access

through rear panel)

19 RAID backup unit mounting locations

(two, on air baffle not shown in this view)

The Technical Specifications Sheet for this server, which includes component part numbers, is at:

http://www.cisco.com/en/US/prod/collateral/ps10265/ps10493/C240M3_SFF_SpecSheet.pdf.

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-9

Page 52

Preparing for Server Component Installation

Serial Number Location

The serial number for the server is printed on a label on the top of the server, near the front.

Color-Coded Touch Points

This server has color-coded touch points that indicate thumbscrews and latches on replaceable and hot-swappable components.

• Hot-swappable components have green plastic touch points. This includes the internal cooling fans

and the power supplies. (An exception is the drive trays on the front panel, which are hot-swappable but not green).

• Some replaceable but non-hot-swappable components have light-blue plastic touch-points.

Chapter 3 Maintaining the Server

3-10

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 53

Chapter 3 Maintaining the Server

Installing or Replacing Server Components

Warning

Caution When handling server components, wear an ESD strap to avoid damage.

Tip You can press the Identification button on the front panel or rear panel to turn on a flashing Identification

Blank faceplates and cover panels serve three important functions: they prevent exposure to hazardous voltages and currents inside the chassis; they contain electromagnetic interference (EMI) that might disrupt other equipment; and they direct the flow of cooling air through the chassis. Do not operate the system unless all cards, faceplates, front covers, and rear covers are in place.

Statement 1029

Class 1 laser product.

Statement 1008

LED on the front and rear panels of the server. This allows you to locate the specific server that you are servicing when you go to the opposite side of the rack. You can also activate these LEDs remotely by using the CIMC interface.See the “Status LEDs and Buttons” section on page 3-2 for locations of these LEDs.

This section describes how to install and replace server components, and it includes the following topics:

• Replacing Hard Drives or Solid State Drives, page 3-12

• Replacing a Drive Backplane, page 3-15

• Replacing Fan Modules, page 3-20

• Replacing DIMMs, page 3-24

• Replacing CPUs and Heatsinks, page 3-29

• Replacing the Motherboard RTC Battery, page 3-22

• Replacing a Mezzanine Card, page 3-36

• Replacing a PCIe Riser, page 3-38

• Replacing a PCIe Card, page 3-40

• Installing an NVIDIA GRID or Tesla GPU Card, page 3-48

• Replacing an Internal SD Card, page 3-62

• Replacing the LSI RAID Battery Backup Unit or SuperCap Power Module, page 3-64

• Installing a Trusted Platform Module, page 3-66

• Enabling the Intel Trusted Execution Technology (TXT) Feature For the TPM, page 3-67

• Replacing a SCU Upgrade ROM Module, page 3-69

• Replacing a Software RAID Key Module, page 3-70

• Replacing Power Supplies, page 3-71

• Enabling or Disabling the Internal USB Port, page 3-74

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-11

Page 54

Installing or Replacing Server Components

HDD 1

HDD 5

HDD 9

HDD 2

HDD 6

HDD 10

HDD 3

HDD 7

HDD 11

HDD 4

HDD 8

HDD 12

331835

Replacing Hard Drives or Solid State Drives

This section includes the following information:

• Drive Population Guidelines, page 3-12

• Drive Replacement Procedure, page 3-13

Drive Population Guidelines

The server is orderable in three different versions, each with one of three different front panel/backplane configurations:

• Cisco UCS C240 (small form-factor (SFF) drives, with 24-drive backplane and expander).

Holds up to twenty-four 2.5-inch hard drives or solid state drives.

• Cisco UCS C240 (small form-factor (SFF) drives, with 16-drive backplane, no expander).

Holds up to sixteen 2.5-inch hard drives or solid state drives.

Note When the server has the 16-drive backplane, only the first 16 drive bays are used.

Chapter 3 Maintaining the Server

• Cisco UCS C240 (large form-factor (LFF) drives, with 12-drive backplane and expander).

Holds up to twelve 3.5-inch hard drives.

The drive-bay numbering is shown in Figure 3-6 and Figure 3-7.

Figure 3-6 Drive Numbering, Small Form-Factor Drives

HDD 1

HDD 2

HDD 3

HDD 4

HDD 5

HDD 6

HDD 7

HDD 8

HDD 9

HDD 10

HDD 11

HDD 12

HDD 13

HDD 14

Figure 3-7 Drive Numbering, Large Form-Factor Drives

HDD 15

HDD 16

HDD 17

HDD 18

HDD 19

HDD 20

HDD 21

HDD 22

HDD 23

HDD 24

331834

3-12

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 55

Chapter 3 Maintaining the Server

Observe these drive population guidelines for optimal performance:

• When populating drives, add drives in the lowest numbered bays first (populate HDD1 to HDD24).

Note Sixteen-drive backplane option: If your SFF drives server has the 16-drive backplane installed, only

the first 16 drive bays are used, with population order HDD1 to HDD16. Keep blanking trays in the empty eight bays to ensure optimal air flow and cooling.

• Keep an empty drive blanking tray in any unused bays to ensure optimal air flow and cooling.

• You can mix hard drives and solid state drives in the same server. However, You cannot configure

a logical volume (virtual drive) that contains a mix of hard drives and SSDs. That is, when you create a logical volume, it must contain all hard drives or all SSDs.

Note The large form-factor drives version of the server does not support 3.5-inch solid state drives.

Drive Replacement Procedure

To replace or install a hot-pluggable hard drive, follow these steps:

Installing or Replacing Server Components

Tip You do not have to shut down or power off the server to replace hard drives or solid state drives (SSDs)

because they are hot-pluggable.

Step 1 Remove the drive that you are replacing or remove a blank drive tray from an empty bay:

a. Press the release button on the face of the drive tray. See Figure 3-8. b. Grasp and open the ejector lever and then pull the drive tray out of the slot. c. If you are replacing an existing drive, remove the four drive-tray screws that secure the drive to the

tray and then lift the drive out of the tray.

Step 2 Install a new drive:

a. Place a new drive in the empty drive tray and replace the four drive-tray screws. b. With the ejector lever on the drive tray open, insert the drive tray into the empty drive bay. c. Push the tray into the slot until it touches the backplane, then close the ejector lever to lock the drive

in place.

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-13

Page 56

Installing or Replacing Server Components

HDD 1

HDD 2

HDD 3

HDD 4

HDD 5

HDD 6

HDD 7

HDD 8

HDD 9

HDD 10

HDD 11

HDD 12

HDD 13

HDD 14

HDD 15

HDD 16

HDD 17

HDD 18

HDD 19

HDD 20

HDD 21

HDD 22

HDD 23

HDD 24

331836

Figure 3-8 Replacing Hard Drives

Chapter 3 Maintaining the Server

1 Release button 3 Drive tray securing screws (4) 2 Ejector lever –

3-14

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 57

Chapter 3 Maintaining the Server

Replacing a Drive Backplane

Note The Small Form-Factor (24-drive or 16-drive) and Large Form-Factor (12-drive) backplanes and their

corresponding chassis drive bays are factory-configurable options. When replacing a backplane, you must replace it with the same version of the backplane.

To install or replace a drive backplane, follow these steps:

Note The 16-drive backplane option does not use a SAS expander. You are instructed to skip steps that involve

the SAS expander in the following procedure, if your server has the 16-drive backplane.

Step 1 Prepare the server for component replacement:

a. Power off the server as described in the “Shutting Down and Powering Off the Server” section on

page 3-7.

b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might

have to detach cables from the rear panel to provide clearance.

Installing or Replacing Server Components

Caution If you cannot safely view and access the component, remove the server from the rack.

c. Remove the top cover as described in “Removing and Replacing the Server Top Cover” section on

page 3-8.

Step 2 Remove all drives and any empty drive trays from the server.

Tip Label the drive trays as you remove them to aid replacement.

Step 3 Remove the fan tray from the server (see Figure 3-9).

a. Pinch the blue-plastic lever at each end of the fan tray to release the lever from the chassis. b. Simultaneously rotate both levers up 90-degrees. The cam action of the levers lifts the fan tray up

and disengages the six fan modules from their connectors on the motherboard.

c. Lift the fan tray straight up and remove it from the chassis. Step 4 Disconnect all cables from the backplane. Step 5 If your server has a SAS expander, disconnect cables from this expander. (The SFF 16-drive backplane

option does not use an expander.)

Step 6 Disconnect the first backplane power harness cable from the motherboard to provide clearance. This is

motherboard connector BACKPLANE POWER1, between fan connectors 5 and 6 (see Figure 3-9).

Step 7 Loosen the two captive thumbscrews that secure the backplane to the chassis (see Figure 3-9). Step 8 Lift the backplane assembly, including steel tray and any expander card straight up from the chassis and

set it on an antistatic mat.

OL-25761-01z

Note If your SFF server has the 16-drive backplane, it does not use a SAS expander. Skip to Step 11.

Cisco UCS C240 Server Installation and Service Guide

3-15

Page 58

Installing or Replacing Server Components

Step 9 Remove the SAS expander card from the backplane assembly:

a. Use a #2 Phillips-head screwdriver to remove the two screws that secure the SAS expander to the

backplane assembly steel tray (see Figure 3-10).

b. Pull the SAS expander from the sockets on the drive backplane and then set the SAS expander aside

on an antistatic mat.

Step 10 Install the SAS expander card to the new backplane assembly:

a. Push the two connectors on the SAS expander into the two sockets on the backplane assembly. b. Use a #2 Phillips-head screwdriver to install the two screws that secure the SAS expander to the

backplane assembly steel tray (see Figure 3-10).

Step 11 Align the backplane assembly steel tray with the guides on the chassis walls, and then lower it evenly to

the chassis floor.

Step 12 Tighten the two captive thumbscrews that secure the backplane to the chassis. Step 13 Reconnect the power harness cable to the motherboard connector BACKPLANE POWER1. Step 14 If your server has a SAS expander, reconnect SAS cables to the SAS expander. (The SFF 16-drive

backplane option does not use an expander.)

Step 15 Reconnect all cables to the backplane.

Chapter 3 Maintaining the Server

Step 16 Replace all drives and drives trays to the drive bays. Step 17 Replace the fan tray.

a. With the blue-plastic lever at each end of the fan tray in the upright and open position, set the fan

tray in place in the chassis. Use the chassis guides at each end of the fan tray to keep the fan tray level and straight.

b. Rotate each blue-plastic lever down to the locked position. Stop when the levers click and lock. Step 18 Replace the top cover. Step 19 Replace the server in the rack, replace cables, and then power on the server by pressing the Power

button.

3-16

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 59

Chapter 3 Maintaining the Server

Figure 3-9 Replacing the Drive Backplane

Installing or Replacing Server Components

SAS1

FAN1

FAN2

SAS2

SAS1

FAN3

CPU1

SAS2

SAS1

SAS2

Riser 1

FAN4

FAN5

FAN6

CPU2

Riser 2

1 Backplane assembly captive thumbscrews (two) 3 Location of motherboard connector

BACKPLANE POWER 1

2 SAS expander cable connectors 4 Fan tray blue-plastic locking levers

331837

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-17

Page 60

Installing or Replacing Server Components

Replacing a SAS Expander

The SAS expander is a card that plugs directly into the drive backplane. See Appendix C, “RAID

Controller Considerations” for more information about supported RAID controllers.

Note The SAS expander is required for the SFF 24-drive option and the LFF 12-drive option.

The SFF 16-drive option does not use the SAS expander.

To install or replace a SAS expander, follow these steps:

Step 1 Prepare the server for component replacement:

a. Power off the server as described in the “Shutting Down and Powering Off the Server” section on

page 3-7.

b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might

have to detach cables from the rear panel to provide clearance.

Chapter 3 Maintaining the Server

Caution If you cannot safely view and access the component, remove the server from the rack.

c. Remove the top cover as described in “Removing and Replacing the Server Top Cover” section on

page 3-8.

Step 2 Remove the fan tray from the server (see Figure 3-10).

a. Pinch the blue-plastic lever at each end of the fan tray to release the lever from the chassis.

b. Simultaneously rotate both levers up 90-degrees. The cam action of the levers lifts the fan tray up

and disengages the six fan modules from their connectors on the motherboard.

c. Lift the fan tray straight up and remove it from the chassis. Step 3 Disconnect all cables from the SAS expander. Step 4 Remove the SAS expander:

a. Use a #2 Phillips-head screwdriver to remove the two screws that secure the SAS expander to the

backplane assembly steel tray (see Figure 3-10).

Caution The motherboard heatsinks in front of the DIMM slots have sharp corners. When you pull the SAS

expander from the backplane, use caution to avoid injuring your fingers.

b. Pull on both corners of the SAS expander to disengage it from the sockets on the drive backplane

and then set the SAS expander aside on an antistatic mat.

Step 5 Install the new SAS expander:

a. Push the two board-edge connectors on the new SAS expander into the two sockets on the

backplane.

3-18

b. Use a #2 Phillips-head screwdriver to install the two screws that secure the SAS expander to the

backplane assembly steel tray (see Figure 3-10).

Step 6 Reconnect SAS cables to the new SAS expander.

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 61

Chapter 3 Maintaining the Server

Step 7 Replace the fan tray.

a. With the blue-plastic lever at each end of the fan tray in the upright and open position, set the fan

tray in place in the chassis. Use the chassis guides at each end of the fan tray to keep the fan tray level and straight.

b. Rotate each blue-plastic lever down to the locked position. Stop when the levers click and lock. Step 8 Replace the top cover. Step 9 Replace the server in the rack, replace cables, and then power on the server by pressing the Power

button.

Figure 3-10 Replacing the SAS Expander

Installing or Replacing Server Components

SAS2

SAS1

FAN1

FAN2

FAN3

CPU1

SAS1

SAS2

SAS1

SAS2

Riser 1

1 2

FAN4

FAN5

FAN6

CPU2

Riser 2

1 SAS expander securing screws (two) 3 Fan tray blue-plastic locking levers

2 SAS expander cable connectors

331838

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-19

Page 62

Installing or Replacing Server Components

Replacing Fan Modules

The six hot-pluggable fan modules in the server are numbered as follows when you are facing the front of the server.

Figure 3-11 Fan Module Numbering

FAN 1 FAN 2 FAN 3 FAN 4 FAN 5 FAN 6

Tip There is a fault LED on the top of each fan module that lights amber if the fan module fails. To operate

these LEDs from the SuperCap power source, remove AC power cords and then press the Identification button. See also Internal Diagnostic LEDs, page 3-6.

To replace or install a hot-pluggable fan module, follow these steps:

Chapter 3 Maintaining the Server

Caution You do not have to shut down or power off the server to replace fan modules because they are hot-

pluggable. However, to maintain proper cooling, do not operate the server for more than one minute with any fan module removed.

Step 1 Remove a fan module that you are replacing (see Figure 3-12):

a. Slide the server out the front of the rack far enough so that you can remove the top cover. You might

have to detach cables from the rear panel to provide clearance.

Caution If you cannot safely view and access the component, remove the server from the rack.

b. Remove the top cover as described in “Removing and Replacing the Server Top Cover” section on

page 3-8.

c. Grasp and squeeze together the two plastic finger-latches on the top of the fan module and then lift

straight up to disengage the fan connector from the motherboard.

Step 2 Install a new fan module:

a. Set the new fan module in place, aligning the connector on the bottom of the fan module with the

connector on the motherboard (see Figure 3-12).

b. Press down gently on the fan module until the finger-latches click and lock in place. c. Replace the top cover. d. Replace the server in the rack.

3-20

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 63

Chapter 3 Maintaining the Server

Figure 3-12 Replacing Fan Modules

Installing or Replacing Server Components

SAS2

SAS1

FAN1

FAN2

FAN3

FAN4

FAN5

FAN6

CPU1

CPU2

SAS1

SAS2

SAS1

SAS2

Riser 1

Riser 2

331848

1 Finger latches on each fan module 2 Fan module fault LED on each fan module

3 Connector on underside of fan module

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-21

Page 64

Installing or Replacing Server Components

Replacing the Motherboard RTC Battery

Chapter 3 Maintaining the Server

Warning

There is danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer’s instructions.

[Statement 1015]

The real-time clock (RTC) battery retains system settings when the server is disconnected from power. The RTC battery is on the motherboard under the fan tray.

The battery type is Panasonic CR2032 or equivalent.

To replace or install the motherboard CMOS battery, follow these steps:

Step 1 Remove the RTC battery (see Figure 3-13):

a. Power off the server as described in the “Shutting Down and Powering Off the Server” section on

page 3-7.

b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might

have to detach cables from the rear panel to provide clearance.

Caution If you cannot safely view and access the component, remove the server from the rack.

c. Remove the top cover as described in “Removing and Replacing the Server Top Cover” section on

page 3-8.

d. Remove the fan tray from the server (see Figure 3-13).

1. Pinch the blue-plastic lever at each end of the fan tray to release the lever from the chassis.

2. Simultaneously rotate both levers up 90-degrees. The cam action of the levers lifts the fan tray

up and disengages the six fan modules from their connectors on the motherboard.

3. Lift the fan tray straight up and remove it from the chassis.

3-22

e. Gently remove the battery from its holder on the motherboard. Use a small screwdriver or pointed

object under the battery to gently pry upward.

Step 2 Install an RTC battery:

a. Insert the battery into its holder and press down until it clicks in place.

Note The positive side of the battery marked “3V+” should face upward.

b. Replace the fan tray.

1. With the blue-plastic lever at each end of the fan tray in the upright and open position, set the

fan tray in place in the chassis. Use the chassis guides at each end of the fan tray to keep the fan tray level and straight.

2. Rotate each blue-plastic lever down to the locked position. Stop when the levers click and lock. c. Replace the top cover. d. Replace the server in the rack, replace cables, and power on the server by pressing the Power button.

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 65

Chapter 3 Maintaining the Server

Figure 3-13 Replacing the Motherboard RTC Battery

Installing or Replacing Server Components

FAN1

FAN2

SAS2

SAS1

FAN3

FAN4

FAN5

FAN6

CPU1

CPU2

1 RTC battery holder on motherboard

(under fan tray)

SAS1

SAS2

SAS1

SAS2

Riser 1

Riser 2

331839

2 Fan tray blue-plastic locking levers

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-23

Page 66

Installing or Replacing Server Components

Replacing DIMMs

This section includes the following topics:

• Memory Performance Guidelines and Population Rules, page 3-24

• DIMM Replacement Procedure, page 3-27

Caution DIMMs and their sockets are fragile and must be handled with care to avoid damage during installation.

Caution Cisco does not support 3rd-party DIMMs. Using non-Cisco DIMMs in the server might result in system

problems or damage to the motherboard.

Note To ensure the best server performance, it is important that you are familiar with memory performance

guidelines and population rules before you install or replace memory.

Chapter 3 Maintaining the Server

Memory Performance Guidelines and Population Rules

This section describes the type of memory that the server requires and its effect on performance. The section includes the following topics:

• DIMM Slot Numbering, page 3-25

• DIMM Population Rules, page 3-25

• Memory Mirroring, page 3-27

3-24

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 67

Chapter 3 Maintaining the Server

Front of Server

CPU 1

CPU 2

F3 F2

F1 E3 E2 E1

G2 G3 H1 H2 H3

B2 B1 A3 A2 A1

C2 C3 D1 D2 D3

DIMM Slot Numbering

Figure 3-14 shows the numbering of the DIMM slots.

Installing or Replacing Server Components

Figure 3-14 CPUs and DIMM Slots on Motherboard

DIMM Population Rules

Observe the following guidelines when installing or replacing DIMMs:

• Each CPU supports four memory channels.

–

CPU1 supports channels A, B, C, and D.

–

CPU2 supports channels E, F, G, and H.

• Each channel has three DIMM slots (for example, channel A = slots A1, A2, and A3).

–

A channel can operate with one, two, or three DIMMs installed.

–

If a channel has only one DIMM, populate slot 1 first (the blue slot).

• When both CPUs are installed, populate the DIMM slots of each CPU identically.

–

Fill blue #1 slots in the channels first: A1, E1, B1, F1, C1, G1, D1, H1

–

Fill black #2 slots in the channels second: A2, E2, B2, F2, C2, G2, D2, H2

–

Fill black #3 slots in the channels third: A3, E3, B3, F3, C3, G3, D3, H3

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-25

Page 68

Installing or Replacing Server Components

• Any DIMM installed in a DIMM socket for which the CPU is absent is not recognized. In a

single-CPU configuration, populate the channels for CPU1 only.

• Although 1600 MHz DIMMs can be run in Power Saving Mode (low-voltage 1.35 V operation),

1600 MHz operation is supported only when the DDR mode is set to Performance Mode (see “Enabling Low-Voltage DIMM Operation.”) A 1600 MHz DIMM with DDR mode set to Power Saving Mode operates at 1066 MHz.

• Observe the DIMM mixing rules shown in Table 3- 4 .

• Memory mirroring reduces the amount of memory available by 50% because only one of the two

populated channels provides data. When memory mirroring is enabled, DIMMs must be installed in sets of 4, 6, 8, or 12 as described in Memory Mirroring, page 3-27.

• Note the following restrictions when using UDIMMs. Even though a UDIMM might be rated at

1600 MHz, actual operational speeds are slower because of the Intel implementation.

–

UDIMMs do not support 3 DIMMs per channel (3 DPC) configurations.

–

In Performance Mode (1.5 V operation), UDIMMs run at 1333 MHz in 1 DPC and 2 DPC configurations.

–

In Power Saving Mode (1.35 V operation), UDIMMs run at 1066 MHz in 1 DPC and 2 DPC configurations.

Chapter 3 Maintaining the Server

Table 3-4 DIMM Mixing Rules for C240 M3 Servers

DIMM Parameter DIMMs in the Same Channel DIMMs in the Same Bank

DIMM Capacity:

RDIMM = 4, 8, or 16 GB

LRDIMM = 32 GB

UDIMM = 4 GB

• You can mix different capacity

DIMMs in the same channel (for example, A1, A2, A3).

• You cannot mix 32 GB LRDIMMs

with any RDIMM or UDIMM.

• You cannot mix 4 GB UDIMMs with

any RDIMM or LRDIMM.

• You can mix different capacity DIMMs

in the same bank. However, for optimal performance DIMMs in the same bank (for example, A1, B1, C1, D1) should have the same capacity.

• You cannot mix 32 GB LRDIMMs with

any RDIMM or UDIMM.

• You cannot mix 4 GB UDIMMs with

any RDIMM or LRIMM.

DIMM Speed:

1866-, 1600-, or 1333-MHz

DIMM Type:

You can mix speeds, but DIMMs will run at the speed of the slowest DIMMs/CPUs installed in the channel.

You can mix speeds, but DIMMs will run at the speed of the slowest DIMMs/CPUs installed in the bank.

You cannot mix DIMM types in a channel. You cannot mix DIMM types in a bank.

RDIMMs, LRDIMMs, or UDIMMs

Enabling Low-Voltage DIMM Operation

3-26

You can enable low voltage (1.35 V) DIMM operation for all DIMMs in the server. There is a setting in the BIOS Setup utility that you can use to change the DDR memory mode to Power Saving mode, as described in the following procedure:

Step 1 Enter the BIOS setup utility by pressing the F2 key when prompted during bootup.

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 69

Chapter 3 Maintaining the Server

Step 2 Select the Advanced tab. Step 3 Select Low Voltage DDR Mode. Step 4 In the pop-up window, select either Power Saving or Performance Mode:

• Power Saving Mode–Prioritizes low-voltage memory operation.

• Performance Mode–Prioritizes performance memory operation. If you mix low-voltage DIMMs

Step 5 Press F10 to save your changes and exit the setup utility.

Memory Mirroring

When memory mirroring is enabled, the memory subsystem simultaneously writes identical data to two channels. If a memory read from one of the channels returns incorrect data due to an uncorrectable memory error, the system automatically retrieves the data from the other channel. A transient or soft error in one channel does not affect the mirrored data, and operation continues unless there is a simultaneous error in exactly the same location on a DIMM and its mirrored DIMM. Memory mirroring reduces the amount of memory available to the operating system by 50% because only one of the two populated channels provides data.

Installing or Replacing Server Components

with standard DIMMs, the system defaults to this setting.

Note You must choose to enable memory mirroring in the server BIOS setup utility, under

Advanced > Memory Configuration > Mirroring.

If you choose to enable memory mirroring, populate the DIMM slots in the order shown in Tab le 3-5.

Table 3-5 Memory Mirroring DIMM Population

Number of DIMMs per CPU CPU 1 Population CPU2 Population

4 A1, B1; A2, B2 E1, F1; E2, F2

6 A1, B1; A2, B2; A3, B3 E1, F1; E2, F2; E3, F3

8 A1, B1; C1, D1; A2, B2; C2, D2 E1, F1; G1, H1; E2, F2; G2, H2

10 A1, B1; C1, D1; A2, B2; C2, D2; A3, B3 E1, F1; G1, H1; E2, F2; G2, H2; E3, F3

12 A1, B1; C1, D1; A2, B2; C2, D2; A3, B3;

DIMM Replacement Procedure

This section includes the following topics:

• Identifying a Faulty DIMM, page 3-27

• Replacing DIMMs, page 3-28

C3, D3

E1, F1; G1, H1; E2, F2; G2, H2; E3, F3; G3, H3

Identifying a Faulty DIMM

Each DIMM slot has a corresponding DIMM fault LED. See Figure 3-3 for the locations of these LEDs.

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-27

Page 70

Installing or Replacing Server Components

The LEDs light amber to indicate a faulty DIMM. To operate these LEDs from the SuperCap power source, remove AC power cords and then press the Identification button. See also Internal Diagnostic

LEDs, page 3-6.

Replacing DIMMs

To install a DIMM assembly, follow these steps:

Step 1 Remove the DIMMs that you are replacing:

a. Power off the server as described in the “Shutting Down and Powering Off the Server” section on

page 3-7.

b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might

have to detach cables from the rear panel to provide clearance.

Caution If you cannot safely view and access the component, remove the server from the rack.

c. Remove the top cover as described in “Removing and Replacing the Server Top Cover” section on

page 3-8.

d. Identify the faulty DIMM by observing the DIMM slot fault LEDs on the motherboard (see

Figure 3-3).

Chapter 3 Maintaining the Server

e. Open the ejector levers at both ends of the DIMM slot, then lift the DIMM out of the slot.

Step 2 Install a new DIMM:

Note Before installing DIMMs, refer to the population guidelines. See Memory Performance

Guidelines and Population Rules, page 3-24.

a. Align the new DIMM with the empty slot on the motherboard. Use the alignment key in the DIMM

slot to correctly orient the DIMM.

b. Push down evenly on the top corners of the DIMM until it is fully seated and the ejector levers on

both ends lock into place.

c. Replace the top cover. d. Replace the server in the rack, replace cables, and then power on the server by pressing the Power

button.

3-28

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 71

Chapter 3 Maintaining the Server

Replacing CPUs and Heatsinks

This section contains the following topics:

• Special Information For Upgrades to Intel E5-2600 v2 Series CPUs, page 3-29

• CPU Configuration Rules, page 3-29

• CPU Replacement Procedure, page 3-30

• Additional CPU-Related Parts To Order With RMA Replacement Motherboards, page 3-35

Special Information For Upgrades to Intel E5-2600 v2 Series CPUs

Caution You must upgrade your server firmware to the required minimum level before you upgrade to Intel

E5-2600 v2 Series CPUs. Older firmware versions cannot recognize the new CPUs and this results in a non-bootable server.

The minimum software and firmware versions required for the server to support Intel E5-2600 v2 Series CPUs are as follows:

Installing or Replacing Server Components

Table 3-6 Minimum Requirements For Intel E5-2600 v2 Series CPUs

Software or Firmware Minimum Version

Server CIMC 1.5(3)

Server BIOS 1.5(3)

Cisco UCS Manager (UCSM-managed system only)

Do one of the following actions:

• If your server’s firmware and/or Cisco UCS Manager software are already at the required levels

shown in Table 3-6, you can install the CPU hardware by using the procedure in this section.

• If your server’s firmware and/or Cisco UCS Manager software is earlier than the required levels, use

the instructions in the Cisco UCS C-Series Servers Upgrade Guide for Intel E5-2600 v2 Series CPUs to upgrade your firmware. After you upgrade, return to the procedure in this section to install the CPU and heatsink hardware.

CPU Configuration Rules

This server has two CPUs. Each CPU supports four DIMM channels (12 DIMM slots). See Figure 3-14.

• The server can operate with one CPU or two identical CPUs installed.

• The minimum configuration is that the server must have at least CPU1 installed. Install CPU1 first,

then CPU2.

2.1(3)

OL-25761-01z

Note The following restrictions apply when using a single-CPU configuration: the maximum number

of DIMMs is twelve, the internal mezzanine card slot is unavailable, and PCIe riser 2, which contains PCIe slots 4 and 5, is unavailable.

Cisco UCS C240 Server Installation and Service Guide

3-29

Page 72

Installing or Replacing Server Components

Chapter 3 Maintaining the Server

CPU Replacement Procedure

Caution CPUs and their motherboard sockets are fragile and must be handled with care to avoid damaging pins

during installation. The CPUs must be installed with heatsinks and their thermal pads to ensure proper cooling. Failure to install a CPU correctly might result in damage to the server.

Caution The Pick-and-Place tools used in this procedure are required to prevent damage to the contact pins

between the motherboard and the CPU. Do not attempt this procedure without the required tools, which are included with each CPU option kit. If you do not have the tool, you can order a spare: Cisco PID UCS-CPU-EP-PNP= for 10-, 8-, 6-, 4-, or 2-core CPUs (green); UCS-CPU-EP2-PNP= for v2 12-core CPUs (purple).

To install or replace a CPU heatsink and CPU, follow these steps:

Step 1 Remove the CPU and heatsink that you are replacing:

a. Power off the server as described in the “Shutting Down and Powering Off the Server” section on

page 3-7.

b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might

have to detach cables from the rear panel to provide clearance.

Caution If you cannot safely view and access the component, remove the server from the rack.

c. Remove the top cover as described in “Removing and Replacing the Server Top Cover” section on

page 3-8.

d. Use a Number 2 Phillips-head screwdriver to loosen the four captive screws that secure the heatsink

and then lift it off of the CPU.

Note Alternate loosening each screw evenly to avoid damaging the heatsink or CPU.

e. Unclip the first CPU retaining latch labeled with the icon, then unclip the second retaining

latch labeled with the icon. See Figure 3-15.

f. Open the hinged CPU cover plate.

3-30

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 73

Chapter 3 Maintaining the Server

332093

Installing or Replacing Server Components

Figure 3-15 CPU Heatsink and Socket

1 CPU retaining latch, 3 Hinged CPU cover plate 2 CPU retaining latch, –

Step 2 Remove a protective cap or an old CPU from the socket (if present):

• If you are removing an old CPU, skip to Step 3.

• If you are installing a new CPU to a socket that was shipped empty, the socket has a protective cap

that is intended to prevent bent contact pins. Use the tool as shown in Figure 3-16 to grasp the protective cap and then pivot to remove the cap.

333565

Step 3 Remove an old CPU:

Figure 3-16 Protective Cap Removal Tool

a. Set the Pick-and-Place tool on the CPU in the socket, aligning the arrow on the tool with the

registration mark on the socket (the small triangular mark). See Figure 3-17.

b. Press the top button on the tool to grasp the installed CPU. c. Lift the tool and CPU straight up. d. Press the top button on the tool to release the old CPU on an anti-static surface.

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-31

Page 74

Installing or Replacing Server Components

331370

Chapter 3 Maintaining the Server

Figure 3-17 Removing or Inserting a CPU

1 Arrow on tool 2 Registration mark on CPU socket

Step 4 Insert the new CPU into the Pick-and-Place tool:

a. Remove the new CPU from the packaging and place it on the pedestal that is included in the kit.

Align the registration mark on the corner of the CPU with the arrow on the corner of the pedestal (see Figure 3-18).

b. Press down on the top button of the tool to lock it open. c. Set the Pick-and-Place tool on the CPU pedestal, aligning the arrow on the tool with the arrow on

the corner of the pedestal. Make sure that the tabs on the tool are fully seated in the slots on the pedestal.

d. Press the side lever on the tool to grasp and lock in the CPU. e. Lift the tool and CPU straight up off the pedestal.

3-32

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 75

Chapter 3 Maintaining the Server

333566

Installing or Replacing Server Components

1 Arrow marks for alignment –

Figure 3-18 CPU and Pick-and-Place Tool on Pedestal

Step 5 Install a new CPU:

a. Set the Pick-and-Place tool with CPU over the empty CPU socket on the motherboard.

Note Align the arrow on the top of the tool with the registration mark (small triangle) that is stamped

on the metal of the CPU socket, as shown in Figure 3-17.

b. Press the top button on the tool to set the CPU into the socket. Remove the empty tool. c. Close the hinged CPU cover plate. d. Clip down the CPU retaining latch with the icon, then clip down the CPU retaining latch

with the icon. See Figure 3-15.

Step 6 Install a heatsink:

Caution The heatsink must have a new, undamaged thermal pad on the heatsink-to-CPU surface to ensure proper

cooling. If you are replacing a heatsink that was previously used, you must remove the old thermal pad. If you are installing a new heatsink, skip to step d. below.

a. Apply an alcohol-based cleaning solution to the old thermal pad and let it soak for a least 15

seconds.

b. Wipe all of the old thermal pad off the old heatsink using a soft cloth that will not scratch the

heatsink surface.

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-33

Page 76

Installing or Replacing Server Components

334295

c. Apply thermal grease from an included syringe to the top of the CPU.

Apply about 2 cubic centimeters of grease (about half the syringe contents) to the top of the CPU in the pattern that is shown in Figure 3-19.

Note CPU spares come with two syringes of thermal grease; one with a blue cap and one with a red

cap. The syringe with the red cap is UCS-CPU-GREASE2=, which is used with this server.

Note If you do not have a syringe of thermal grease, you can order a spare (UCS-CPU-GREASE2=).

Chapter 3 Maintaining the Server

d. For a new heatsink, peel the protective film from the thermal pad that is on the bottom of the new

heatsink.

Figure 3-19 Thermal Grease Application Pattern

Note Do not apply a syringe of thermal grease if you are installing a new heatsink that already has a

pre-applied thermal pad.

e. Align the heatsink captive screws with the motherboard standoffs, then use a Number 2

Phillips-head screwdriver to tighten the captive screws evenly.

3-34

Note Alternate tightening each screw evenly to avoid damaging the heatsink or CPU.

f. Replace the top cover.

g. Replace the server in the rack, replace cables, and then power on the server by pressing the Power

button.

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 77

Chapter 3 Maintaining the Server

Installing or Replacing Server Components

Additional CPU-Related Parts To Order With RMA Replacement Motherboards

When a return material authorization (RMA) of the motherboard or CPU is done on a Cisco UCS C-series server, there are additional parts that might not be included with the CPU or motherboard spare bill of materials (BOM). The TAC engineer might need to add the additional parts to the RMA to help ensure a successful replacement.

• Scenario 1—You are re-using the existing heatsinks:

–

Heat sink cleaning kit (UCSX-HSCK=)

–

Thermal grease kit for C240 (UCS-CPU-GREASE2=)

–

Intel CPU Pick-n-Place tool: UCS-CPU-EP-PNP= for 10-, 8-, 6-, 4-, or 2-core CPUs (green); or UCS-CPU-EP2-PNP= for v2 12-core CPUs (purple)

• Scenario 2—You are replacing the existing heatsinks:

–

Heat sink (UCSC-HS-C240M3=)

–

Heat sink cleaning kit (UCSX-HSCK=)

–

Intel CPU Pick-n-Place tool: UCS-CPU-EP-PNP= for 10-, 8-, 6-, 4-, or 2-core CPUs (green); or UCS-CPU-EP2-PNP= for v2 12-core CPUs (purple)

A CPU heatsink cleaning kit is good for up to four CPU and heatsink cleanings. The cleaning kit contains two bottles of solution, one to clean the CPU and heatsink of old thermal interface material and the other to prepare the surface of the heatsink.

New heatsink spares have preinstalled thermal interface material covered by a small sheet of plastic. It is important to clean the old thermal interface material off of the CPU prior to installing the heatsinks. Therefore, when ordering new heatsinks it is still necessary to order the heatsink cleaning kit at a minimum.

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-35

Page 78

Installing or Replacing Server Components

Replacing a Mezzanine Card

The server has a dedicated socket on the motherboard for a mezzanine-style RAID controller card.

Note See RAID Controller Considerations, page C-1 for more information about supported cards and cabling.

To install or replace a mezzanine card, follow these steps:

Step 1 Remove the mezzanine card that you are replacing (see Figure 3-20):

a. Power off the server as described in the “Shutting Down and Powering Off the Server” section on

page 3-7.

b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might

have to detach cables from the rear panel to provide clearance.

Caution If you cannot safely view and access the component, remove the server from the rack.

Chapter 3 Maintaining the Server

c. Remove the top cover as described in “Removing and Replacing the Server Top Cover” section on

page 3-8.

d. Remove PCIe riser 2 from the server to provide clearance (see Figure 3-20). e. Disconnect all cables from the mezzanine card.

Tip Label the cables before you disconnect them to aid replacement.

f. Use a #2 Phillips-head screwdriver to remove the two screws that secure the card to the motherboard

standoffs.

g. Pull the mezzanine card straight up to disengage it from its motherboard socket, and then remove

the card from the chassis.

Step 2 Install a new mezzanine card:

a. Set the new mezzanine card in place on the motherboard, aligning its connector with the

motherboard socket.

b. Push down on both ends of the mezzanine card evenly to engage the card’s connector with the socket

on the motherboard.

c. Use a #2 Phillips-head screwdriver to install the two screws that secure the card to the motherboard

standoffs.

d. Reconnect cables to the new mezzanine card. See RAID Controller Considerations, page C-1 for

more information about supported cards and cabling.

e. Replace PCIe riser 2 to the server.

3-36

f. Replace the top cover.

g. Replace the server in the rack, replace cables, and then power on the server by pressing the Power

button.

h. If this was a replacement card, continue with Restoring RAID Configuration After Replacing a

RAID Controller, page C-24.

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 79

Chapter 3 Maintaining the Server

Figure 3-20 Replacing the Mezzanine Card (Shown With PCIe Riser 2 Removed)

Installing or Replacing Server Components

1 Mezzanine card connector on motherboard 2 Mezzanine card securing screws (two)

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-37

Page 80

Installing or Replacing Server Components

PSU1 PSU2

PCIe 1

PCIe 2

PCIe 3

PCIe 4

PCIe 5

331841

Replacing a PCIe Riser

Note The older PCIe risers UCSC-PCIE-RL-C240= and UCSC-PCIE-RR-C240= are compatible only with the

older version V01 chassis, and have been obsoleted. These parts have been replaced by a new single item (UCSC-GPUKIT1-C240=), which contains left and right risers along with additional hardware to facilitate installation of NVIDIA GPU cards. Order the new UCSC-GPUKIT1-C240= if riser replacement is required on any version of the C240 chassis, or if a version V01 chassis must be upgraded to support an NVIDIA GPU card. See also How to Determine Your Server Version, page 3-50.

The server contains two toolless PCIe risers for horizontal installation of PCIe cards. PCIe riser 2 also includes two internal sockets for SD cards. See Replacing a PCIe Card, page 3-40 for specifications of the PCIe slots on the risers.

Chapter 3 Maintaining the Server

Figure 3-21 Rear Panel, Showing PCIe Slots

1 PCIe riser 1 slots (three) 2 PCIe riser 2 slots (two)

To install or replace a PCIe riser, follow these steps:

Step 1 Remove the PCIe riser that you are replacing (see Figure 3-20):

a. Power off the server as described in the “Shutting Down and Powering Off the Server” section on

page 3-7.

b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might

have to detach cables from the rear panel to provide clearance.

Caution If you cannot safely view and access the component, remove the server from the rack.

c. Remove the top cover as described in “Removing and Replacing the Server Top Cover” section on

d. Disconnect external cables from any PCIe cards that are installed in the PCIe riser. e. Use the finger holes to lift straight up on both ends of the riser to disengage its circuit board from

f. If the riser has a card installed, remove the card from the riser.

Cisco UCS C240 Server Installation and Service Guide

3-38

page 3-8.

the socket on the motherboard. Set the riser on an antistatic mat.

To remove a card, push down on the retaining clip on the hinged card retainer and then swing open the retainer to free the rear-panel tab of the card (see Replacing a PCIe Card, page 3-40).

OL-25761-01

Page 81

Chapter 3 Maintaining the Server

Step 2 Install a new PCIe riser:

a. If you removed a card from the old PCIe riser, install the card to the new riser (see Replacing a PCIe

Card, page 3-40).

b. Position the PCIe riser over its socket on the motherboard and over its alignment slots in the chassis

(see Figure 3-22).

c. Carefully push down on both ends of the PCIe riser to fully engage its circuit board connector with

the socket on the motherboard.

d. Connect external cables to any PCIe cards installed in the riser. e. Replace the top cover.

f. Replace the server in the rack, replace cables, and then power on the server by pressing the Power

button.

Figure 3-22 Replacing the PCIe Riser

Installing or Replacing Server Components

FAN1

SAS1

SAS2

Riser 1

FAN2

SAS2

SAS1

FAN3

CPU1

SAS1

SAS2

FAN4

FAN5

FAN6

CPU2

Riser 2

331842

1 PCIe riser 1 alignment slot location 2 PCIe riser 2 alignment slot locations (three)

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-39

Page 82

Installing or Replacing Server Components

Replacing a PCIe Card

Caution Cisco supports all PCIe cards qualified and sold by Cisco. PCIe cards not qualified or sold by Cisco are

the responsibility of the customer. Although Cisco will always stand behind and support the C-Series rack-mount servers, customers using standard, off-the-shelf, third-party cards must go to the third-party card vendor for support if any issue with that particular third-party card occurs.

This section includes the following topics:

• PCIe Slots, page 3-40

• Replacing a PCIe Card, page 3-41

• Special Considerations for Cisco UCS Virtual Interface Cards, page 3-43

• Special Considerations for Cisco UCS Fusion ioDrive2 Storage Accelerator Cards, page 3-43

• RAID Controller Card Cable Routing, page 3-45

• Installing Multiple PCIe Cards and Resolving Limited Resources, page 3-46

Chapter 3 Maintaining the Server

PCIe Slots

The server contains two toolless PCIe risers for horizontal installation of PCIe cards. See Figure 3-23 and Tabl e 3-7.

Slot Number

2 Gen-3 x16 x24 extended 3/4 length

3 Gen-3 x8 x16 connector 1/2 length Full-height No

1. This is the supported length because of internal clearance.

2. This is the size of the rear panel opening.

Figure 3-23 Rear Panel PCIe Slots

PCIe 1

PCIe 2

PCIe 3

331841

PSU1 PSU2

PCIe 5

PCIe 4

1 PCIe riser 1 (slots 1, 2, and 3) 2 PCIe riser 2 (slots 4 and 5)

Table 3-7 PCIe Expansion Slots

Electrical Lane Width Connector Length Card Length1

Card Height 2

NCSI3 Support

Gen-3 x8 x16 connector 3/4 length Full-height No

Full-height Yes

(10.5 in./26.67 cm)

Gen-3 x8 x16 connector 1/2 length Half-height No

Gen-3 x16 x24 extended 3/4 length

10.5 in./26.67 cm)

Full-height, also supports double-width cards

Ye s

3-40

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 83

Chapter 3 Maintaining the Server

3. Network Communications Services Interface protocol

4. Slot 2 can operate when the server is in standby power mode.

5. Slot 4 is not available in single-CPU configurations.

6. Slot 5 is not available in single-CPU configurations.

Replacing a PCIe Card

Note For the list of supported PCIe adapters and other components, see the Technical Specifications Sheet at

http://www.cisco.com/en/US/prod/collateral/ps10265/ps10493/C240M3_SFF_SpecSheet.pdf.

Note If you are installing a Cisco UCS Virtual Interface Card, there are prerequisite considerations. See

Special Considerations for Cisco UCS Virtual Interface Cards, page 3-43.

Note If you are installing a RAID controller card, see RAID Controller Considerations, page C-1 for more

information about supported cards and cabling.

Installing or Replacing Server Components

To install or replace a PCIe card, follow these steps:

Step 1 Remove a PCIe card (or a blank filler panel) from the PCIe riser assembly:

a. Shut down and power off the server as described in the “Shutting Down and Powering Off the

Server” section on page 3-7.

b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might

have to detach cables from the rear panel to provide clearance.

Caution If you cannot safely view and access the component, remove the server from the rack.

c. Remove the top cover as described in the “Removing and Replacing the Server Top Cover” section

on page 3-8.

d. Disconnect cables from any PCIe cards that are installed in the PCIe riser.

Tip Label the cables when you disconnect them to aid correct connection to the new card.

e. Use the finger holes to lift straight up on both ends of the riser to disengage its circuit board from

the socket on the motherboard. Set the riser on an antistatic mat.

f. Push down on the securing clip on the hinged card retainer and then swing open the retainer to free

the rear-panel tab of the existing card (or blanking panel). See Figure 3-24.

OL-25761-01z

Note Slot 5 on PCIe riser 2 has an additional plastic retaining clip that stabilizes the front end of a

card. Push down on this clip before pulling the card from the riser socket (see Figure 3-24).

g. Pull evenly on both ends of the PCIe card to disengage it from the socket on the PCIe riser (or

remove a blanking panel) and then set the card aside.

Cisco UCS C240 Server Installation and Service Guide

3-41

Page 84

Installing or Replacing Server Components

1 2 3 4

331850

Step 2 Install a PCIe card:

a. Align the new PCIe card with the empty socket on the PCIe riser. b. Push down evenly on both ends of the card until it is fully seated in the socket.

Ensure that the card rear panel tab sits flat against the PCIe riser rear panel opening.

c. Close the hinged card retainer over the rear panel tab of the card and push in on the retainer until its

clip clicks into place to secure the card.

d. Position the PCIe riser over its socket on the motherboard and over its alignment features in the

chassis (see Figure 3-22).

e. Carefully push down on both ends of the PCIe riser to fully engage its circuit board connector with

the socket on the motherboard.

f. Connect cables to the PCIe card. See RAID Controller Considerations, page C-1 for more

information about supported cards and cabling.

g. Replace the top cover. h. Replace the server in the rack, replace cables, and then power on the server by pressing the Power

button.

i. If you replaced a RAID controller card, continue with Restoring RAID Configuration After

Replacing a RAID Controller, page C-24.

Chapter 3 Maintaining the Server

Figure 3-24 PCIe Riser card Retainers (Slot 5 on PCIe Riser 2 Shown)

1 Long card retainer

3 Securing clip on hinged card retainer

(on riser 2, slot 5 only)

2 Card socket on riser 4 Hinged card retainer

Cisco UCS C240 Server Installation and Service Guide

3-42

OL-25761-01

Page 85

Chapter 3 Maintaining the Server

Special Considerations for Cisco UCS Virtual Interface Cards

Table 3-8 describes the requirements for the supported Cisco UCS virtual interface cards (VICs).

Table 3-8 Cisco UCS C240 M3 Requirements for Virtual Interface Cards

Number of

VICs Virtual Interface Card (VIC)

Cisco UCS VIC P81E

Supported

in Server

2PCIE 2

N2XX-ACPCI01

Cisco UCS VIC1225

2PCIE 2

UCSC-PCIE-CSC-02

Cisco UCS VIC1225T

2PCIE 2

UCSC-PCIE-C10T-02

Cisco UCS VIC 1285

2PCIE 2

UCSC-PCIE-C40Q-02

1. See PCIe Slots, page 3-40.

2. Slot 5 is not available in single-CPU configurations.

3. The Cisco UCS VIC1225T is not supported for UCS integration at this time.

Slots That Support

VICs

PCIE 5

Primary Slot For UCS Integration or Cisco Card NIC Mode

Minimum CIMC Firmware

PCIE 2 1.4(4) 2.0(2) 5.0

PCIE 2 1.4(6) 2.1(0) 5.0

PCIE 2

1.5(1) 2.1(1) 5.0

PCIE 2 1.5(4) 2.2(1b) 5.0

Installing or Replacing Server Components

Minimum Nexus

OS on an Upstream Minimum VIC Firmware

Nexus Fabric

Interconnect

Special Considerations for Cisco UCS Fusion ioDrive2 Storage Accelerator Cards

Table 3-9 describes the requirements for the supported Cisco UCS Fusion ioDrive2 cards.

Table 3-9 Cisco UCS C240 M3 Requirements for Fusion ioDrive2 Cards

Slots That

Card

Cisco UCS 3.0 TB MLC Fusion ioDrive2

UCSC-F-FIO-3000M

Max. Number of Cards Supported

• 4 at default

25W power draw

• 3 at >25W

Slots That Support These Cards

PCIE 1

PCIE 2

PCIE 3

PCIE 5

Support >25W Power

Override

PCIE 1

PCIE 2

PCIE 3

PCIE 5

Minimum CIMC

Firmware

1.5(2) Full height

power draw

Cisco UCS 1205 GB MLC Fusion ioDrive2

UCSC-F-FIO-1205M

Cisco UCS 785 GB MLC Fusion ioDrive2

UCSC-F-FIO-785M

Cisco UCS 365 GB MLC Fusion ioDrive2

UCSC-F-FIO-365M

1. See PCIe Slots, page 3-40.

2. Some of the supported slots can be enabled to provide more than the default 25 W power draw for higher performance on some cards. See Enabling Higher

Power-Draw for Fusion ioDrive2 Cards, page 3-44.

3. Slot 2 is the primary slot for Cisco UCS VIC cards and so should be reserved if a VIC card is required in your configuration.

4. A rear-panel tab adapter is required to fit the half-height cards in full-height slots 1, 2, 3, and 5.

5All Not

applicable

5All Not

applicable

5All Not

applicable

1.5(2) Half height

Card Height (rear-panel tab)

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-43

Page 86

Installing or Replacing Server Components

Enabling Higher Power-Draw for Fusion ioDrive2 Cards

Some Fusion ioDrive2 accelerator cards such as the 3.0 TB card draw 25 W by default, but can achieve higher performance when the PCIe slot is configured to provide more than 25 W for the device. This topic describes the slots that are capable of providing more than 25W and the commands to enable that higher power draw.

PCIe slots that can be configured to support more than 25 W power draw: PCIE1, PCIE3, PCIE5.

These three slots can support the higher device power draw of 55 W (75 W maximum) when configured with the override parameter in the IO Accelerator VSL software.

How to Enable Higher Power Draw For a Device With the IO Accelerator Override Parameter

Chapter 3 Maintaining the Server

The override parameter in the IO Accelerator VSL software (in the

/usr/modprove.d/iomemory-vsl.conf

file) overrides the setting that prevents devices from drawing more than 25 W from the PCIe slot. The parameter is enabled by device, using the device serial numbers.

Caution Do not use the override parameter on any PCIe slots other than PCIE1, PCIE3, and PCIE5. If the PCIe slot

is not capable of providing the required amount of power, then enabling full power draw from the PCIe slot might result in malfunction or even damage to server hardware. The user is responsible for any damage to equipment due to improper use of the override parameter. Cisco expressly disclaims any liability for damage arising from improper use of the override parameter.

Note The override parameter persists in the server and enables full power draw on an enabled device even if the

device is removed and then placed in a different slot within the same system. If the device is moved to a slot that is not rated to provide 55 W of power, the server hardware could experience a power drag.

Note The override parameter is a setting for the IO Accelerator VSL software by server and is not stored in the

device. When moved to a new server, the device defaults to the 25 W power limit until an external power cable is added or the override parameter is enabled for that device in the new server.

Use the following procedure to enable the override parameter for a Fusion device that is installed in a slot capable of >25 W power draw:

3-44

Step 1 Determine the serial number of the installed Fusion device by using the fio-status command in the IO

Accelerator VSL software. Sample output is shown here:

fio-status

Adapter: Dual Controller Adapter Fusion-io ioDrive2 3.0TB, Product Number:F01-001-2T41-CS-0001, FIO SN:1149D0969 External Power: NOT connected PCIe Power limit threshold: 24.75W Connected ioMemory modules: fct2: SN:1149D0969-1121 fct3: SN:1149D0969-1111

In this example, 1149D0969 is the adapter serial number. If you have multiple Fusion ioDrive2 devices installed in your system, use the

Cisco UCS C240 Server Installation and Service Guide

fio-beacon command to verify where each device is physically located.

OL-25761-01

Page 87

Chapter 3 Maintaining the Server

Note There is also a serial number label on the card, but it is recommended that you use the

Step 2 Set the override parameter by editing the /usr/modprove.d/iomemory-vsl.conf file, which is installed

when you install the device drivers.

Installing or Replacing Server Components

fio-status command to confirm the serial number is an adapter serial number (FIO SN in the

sample output above).

Change the value for the a comma-separated list of adapter serial numbers.

options iomemory-vsl external_power_override=<value>

For example:

options iomemory-vsl external_power_override=1149D0969,1159E0972

Step 3 Reboot the server or unload and then load the drivers to enforce the parameter changes.

RAID Controller Card Cable Routing

If the PCIe card that you are installing or replacing is a RAID controller card, see RAID Controller

Considerations, page C-1 for cable routing and other guidelines.

external_power_override parameter, where the <value> for this parameter is

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-45

Page 88

Installing or Replacing Server Components

Installing Multiple PCIe Cards and Resolving Limited Resources

When a large number of PCIe add-on cards are installed in the server, the system may run out of the following resources required for PCIe devices:

• Option ROM memory space

• 16-bit I/O space

The topics in this section provide guidelines for resolving the issues related to these limited resources.

• Resolving Insufficient Memory Space to Execute Option ROMs, page 3-46

• Resolving Insufficient 16-Bit I/O Space, page 3-47

Resolving Insufficient Memory Space to Execute Option ROMs

The system has very limited memory to execute PCIe legacy option ROMs, so when a large number of PCIe add-on cards are installed in the server, the system BIOS might not able to execute all of the option ROMs. The system BIOS loads and executes the option ROMs in the order that the PCIe cards are enumerated (Slot 1, Slot 2, Slot 3, etc.).

If the system BIOS does not have sufficient memory space to load any PCIe option ROM, it skips loading that option ROM, reports a system event log (SEL) event to the CIMC controller and reports the following error in the Error Manager page of the BIOS Setup utility:

ERROR CODE SEVERITY INSTANCE DESCRIPTION 146 Major N/A PCI out of resources error.

Major severity requires user intervention but does not prevent system boot.

Chapter 3 Maintaining the Server

To resolve this issue, disable the Option ROMs that are not needed for system booting. The BIOS Setup Utility provides the setup options to enable or disable the Option ROMs at the PCIe slot level for the PCIe expansion slots and at the port level for the onboard NICs. These options can be found in the BIOS Setup Utility Advanced → PCI Configuration page.

• Guidelines for RAID controller booting:

If the server is configured to boot primarily from RAID storage, make sure that the option ROMs for the slots where your RAID controllers installed are enabled in the BIOS, depending on your RAID controller configuration.

If the RAID controller does not appear in the system boot order even with the option ROMs for those slots are enabled, the RAID controller option ROM might not have sufficient memory space to execute. In that case, disable other option ROMs that are not needed for the system configuration to free up some memory space for the RAID controller option ROM.

See also Factory-Default Option ROM Settings, page C-6.

• Guidelines for onboard NIC PXE booting:

If the system is configured to primarily perform PXE boot from onboard NICs, make sure that the option ROMs for the onboard NICs to be booted from are enabled in the BIOS Setup Utility. Disable other option ROMs that are not needed to create sufficient memory space for the onboard NICs.

3-46

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 89

Chapter 3 Maintaining the Server

Resolving Insufficient 16-Bit I/O Space

The system has only 64 KB of legacy 16-bit I/O resources available. This 64 KB of I/O space is divided between the CPUs in the system because the PCIe controller is integrated into the CPUs. This server BIOS has the capability to dynamically detect the 16-bit I/O resource requirement for each CPU and then balance the 16-bit I/O resource allocation between the CPUs accordingly during the PCI bus enumeration phase of the BIOS POST.

When a large number of PCIe cards are installed in the system, the system BIOS might not have sufficient I/O space for some PCIe devices. If the system BIOS is not able to allocate the required I/O resources for any PCIe devices, the following symptoms have been observed:

• The system might get stuck in an infinite reset loop.

• The BIOS might appear to hang while initializing PCIe devices.

• The PCIe option ROMs might take excessive time to complete, which appears to lock up the system.

• PCIe boot devices might not be accessible from the BIOS.

• PCIe option ROMs might report initialization errors. These errors are seen before the BIOS passes

control to the operating system.

• The keyboard might not work.

To work around this problem, rebalance the 16-bit I/O load using the following methods:

1. Physically remove any unused PCIe cards.

Installing or Replacing Server Components

2. If the system has one or more Cisco virtual interface cards (VICs) installed, disable the PXE boot

on the VICs that are not required for the system boot configuration by using the Network Adapters page in the CIMC WebUI to free up some 16-bit I/O resources. Each VIC uses a minimum 16 KB of 16-bit I/O resource, so disabling PXE boot on Cisco VICs would free up some 16-bit I/O resources that can be used for other PCIe cards that are installed in the system.

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-47

Page 90

Installing or Replacing Server Components

Installing an NVIDIA GRID or Tesla GPU Card

This section contains the following topics:

• Overview of Software Requirements, page 3-48

• Configuration Rules, page 3-48

• How to Determine Your Server Version, page 3-50

• Installing the GPU Card in Version 01 Servers, page 3-51

• Installing the GPU Card in Version 02 and Later Servers, page 3-56

• Installing Drivers to Support the NVIDIA GPU Cards, page 3-60

Overview of Software Requirements

Server Firmware

Table 3-10 lists the minimum server firmware versions for the GPU cards.

Chapter 3 Maintaining the Server

Table 3-10 Server Firmware Minimum Versions

GPU CIMC/BIOS Minimum Version

NVIDIA GRID K1 1.5(1)

NVIDIA GRID K2 1.5(1)

NVIDIA Tesla K20 1.5(3)

NVIDIA Tesla K20X 1.5(3)

NVIDIA Tesla K40 1.5(7)

Configuration Rules

The rules for configuring the server with GPUs differ, depending on the server version and other factors. This section includes the following topics:

• General NVIDIA GPU Card Configuration Rules, page 3-49

• NVIDIA GRID GPU Slot Population Rules, page 3-49

• NVIDIA Tesla GPU Slot Population Rules, page 3-49

3-48

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 91

Chapter 3 Maintaining the Server

Installing or Replacing Server Components

General NVIDIA GPU Card Configuration Rules

Caution When using NVIDIA GRID GPU cards, the operating temperature range is 32° to 95°F (0° to 35°C).

Caution When using dual NVIDIA GPU cards, you must preserve at least 10mm of space between servers to

ensure adequate airflow and cooling. The only exception is for NVIDIA GRID K1 GPU cards, which do not require this 10mm gap.

• Mixing different GPU cards in the same server is not supported.

• All GPU cards require two CPUs and two 1200 W power supplies in the server.

• It is not possible to use dual NVIDIA GPU cards and a Cisco virtual interface card (VIC) at the same

time. This is because dual NVIDIA GPUs must be installed in slots 2 and 5 of the server, and a Cisco VIC must be installed in either slot 2 or slot 5. If you require two GPU cards and 10-Gb Ethernet connectivity, you must chooses a different supported adapter that can be used in a different slot. For supported adapters, see the Technical Specifications Sheet for the Cisco UCS C240 M3 server (Small Form Factor or Large Form Factor) at:

http://www.cisco.com/en/US/products/ps10493/products_data_sheets_list.html

NVIDIA Tesla K40 Requirements

The NVIDIA Tesla K40 GPU card requires the following minimum items:

• Intel E5-2600 v2 Series CPUs in the server

• Cisco IMC and BIOS firmware minimum 1.5(7) or later.

NVIDIA GRID GPU Slot Population Rules

Table 3-11 shows the rules for populating NVIDIA GRID K1 or K2 GPU cards in the server.

Table 3-11 NVIDIA GRID GPU Population Rules By Server Version

C240 M3 Server Version Single K1 Dual K1 Single K2 Dual K2

Server version V01 Slot 5 Slots 2 and 5 Slot 5 Not supported

Server version V02 and later Slot 5 Slots 2 and 5 Slot 5 Slots 2 and 5

NVIDIA Tesla GPU Slot Population Rules

Table 3-12 shows the rules for populating NVIDIA Tesla K20, K20X, and K40 GPU cards in the server.

Note The NVIDIA Tesla K40 GPU card requires Intel E5-2600 v2 Series CPUs in the server.

Caution When using dual NVIDIA Tesla GPU cards, you must preserve at least 10mm of space between servers

to ensure adequate airflow and cooling.

OL-25761-01z

Table 3-12 NVIDIA Tesla GPU Population Rules By Server Version

C240 M3 Server Version Single Tesla GPU Dual Tesla GPUs

Server version V01 Slot 5 Not supported

Server version V02 and later Slot 5 Slots 2 and 5

Cisco UCS C240 Server Installation and Service Guide

3-49

Page 92

Installing or Replacing Server Components

How to Determine Your Server Version

The version of your server can be seen in the version ID on the PID/VID label. The PID/VID label is on the top of the server (see Figure 3-25).

• A version ID with “V01” designates version 01 of the server.

• A version ID with “V02” or later designates version 02 or later of the server.

V02 and later versions of the server support GPU card installation without the GPU upgrade kit.

Figure 3-25 Label and Version ID

Chapter 3 Maintaining the Server

PID VID:

|||||||||||||||||||||||||||||||||

UCSC-C240-M3S V01

1 PID/VID label on top of server 2 Version ID on label

336574

3-50

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 93

Chapter 3 Maintaining the Server

Installation Procedures

Use one of the following two procedures, depending on your server version:

• If you have a version 01 server, use the procedure in Installing the GPU Card in Version 01 Servers,

page 3-51. You are required to upgrade the server with a GPU upgrade kit before you can install the

GPU card.

• If you have a version 02 or later server, use the procedure in Installing the GPU Card in Version 02

and Later Servers, page 3-56. In this case, the GPU upgrade kit is not required.

See How to Determine Your Server Version, page 3-50 if you do not know your server version.

Installing the GPU Card in Version 01 Servers

The procedure in this section requires that you use the GPU upgrade kit to ready the server for GPU card installation.

• GPU Upgrade Kit, page 3-51

• Installation Procedure, page 3-52

Installing or Replacing Server Components

GPU Upgrade Kit

The GPU upgrade kit includes the following components (see Figure 3-26):

• Two replacement PCIe risers

• One replacement chassis mid-brace

• One 8-to-8 pin power-cable adapter (connects between the motherboard and the GPU power cable)

• One straight GPU power cable (for a single GPU)

• One “Y” GPU power cable (for dual GPUs)

Figure 3-26 Cisco UCS C240 GPU Kit

4 5 6

OL-25761-01z

2 3

336562

1 Chassis mid-brace 4 8-to-8 pin GPU power cable adapter 2 PCIe riser 2 5 Straight GPU power cable 3 PCIe riser 1 6 Y GPU power cable

Cisco UCS C240 Server Installation and Service Guide

3-51

Page 94

Installing or Replacing Server Components

Installation Procedure

Summary of procedure steps:

1. Prepare the server for component installation.

2. Replace the chassis mid-brace.

3. Connect the 8-to-8 pin power cable adapter and the power cable to the motherboard.

4. Install the GPU card into the new replacement riser.

5. Install the new replacement riser into the chassis.

6. Connect the power cable to the GPU card.

Use the following procedure to make the necessary chassis and cabling changes to a version 01 server before you install the GPU card.

Step 1 Prepare the server for component installation:

a. Shut down and power off the server as described in the “Shutting Down and Powering Off the

Server” section on page 3-7.

Chapter 3 Maintaining the Server

b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might

have to detach cables from the rear panel to provide clearance.

Caution If you cannot safely view and access the component, remove the server from the rack.

c. Remove the top cover as described in the “Removing and Replacing the Server Top Cover” section

on page 3-8.

d. Remove the air baffle that covers the CPUs and DIMMs.

Step 2 Replace the chassis mid-brace:

a. Remove the existing PCIe risers. Use the finger holes in each PCIe riser to lift straight up on both

ends. Set the risers on an antistatic mat.

b. Remove the existing chassis mid-brace. Compress the finger-latches on each end of the mid-brace

toward the center, then lift it straight up (see Figure 3-27).

c. Install the new chassis mid-brace. Set the mid-brace in place while compressing the finger-latches

on each end toward the center. Release the latches to lock the mid-brace into position.

3-52

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 95

Chapter 3 Maintaining the Server

SAS2

SAS1

FAN1

FAN2

FAN3

FAN4

FAN5

FAN6

CPU1

CPU2

SAS1

SAS2

Riser 1

Riser 2

SAS1

SAS2

336561

Figure 3-27 Removing the Chassis Mid-Brace and PCIe Risers

1 Chassis mid-brace finger-latch 3 PCIe riser 2 finger holes 2 PCIe riser 1 finger holes

Installing or Replacing Server Components

Step 3

Step 4

Connect the 8-to-8 pin power cable adapter to the motherboard connector GPU PWR (see Figure 3-28).

Figure 3-28 GPU PWR Motherboard Connector and PCIe Riser Alignment Slots

FAN1

FAN2

SAS2

SAS1

FAN3

FAN4

FAN5

FAN6

1 PCIe riser 1 alignment slot location 3 Motherboard connector GPU PWR 2 PCIe riser 2 alignment slot locations (three)

CPU1

CPU2

SAS1

SAS2

SAS1

SAS2

Riser 1

Riser 2

331842

Connect a GPU power cable to the free end of the 8-to-8 pin adapter (see Figure 3-29):

• If you are installing only one GPU, use the straight GPU power cable.

• If you are installing two GPU cards, use the “Y” GPU power cable.

OL-25761-01z

Cisco UCS C240 Server Installation and Service Guide

3-53

Page 96

Installing or Replacing Server Components

GPU

3 4

336123

Note Do not connect the power cable to the GPU card at this point.

Figure 3-29 Cabling Diagram, Single- and Dual-GPU Card Examples

Chapter 3 Maintaining the Server

1 Motherboard connector GPU PWR 3 Straight GPU power cable for single GPU 2 8-to-8 pin cable adapter 4 Y GPU power cable for dual GPUs

Note See Configuration Rules, page 3-48 before you install the GPU cards to the risers. Slot population

restrictions apply.

Step 5 Install your first GPU card into PCIe slot 5. See Figure 3-30 for the riser and slot locations.

Note The option ROM for the slot in which you are installing the GPU card must be enabled in the

BIOS Setup Utility or it will not be recognized by the system.

Figure 3-30 Rear Panel, Showing PCIe Risers and PCIe Slots

PCIe 1

PCIe 2

PCIe 3

PSU1 PSU2

PCIe 5

PCIe 4

331841

3-54

1 PCIe riser 1 slots (Slots 1, 2, 3) 2 PCIe riser 2 slots (Slots 4, 5)

a. Open the riser’s hinged card retainer and the long-card retainer (see Figure 3-31). b. Align the GPU card with the socket on the riser, then gently push the card’s edge connector into the

socket. Press evenly on both corners of the card to avoid damaging the connector.

c. Close the hinged card retainer, then the long-card retainer over the end of the card.

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 97

Chapter 3 Maintaining the Server

1 2 3

336576

Figure 3-31 PCIe Riser (Slot 5 on PCIe Riser 2 Shown)

1 Long-card retainer 3 Hinged card retainer for PCIe slot 5 2 Card socket

Installing or Replacing Server Components

Step 6 If you are installing a second GPU card, repeat the actions in Step 5 for PCIe slot 2 on the second riser.

Note When a GPU card is in slot 2, slot 1 is blocked and unavailable for use.

Step 7 Install the new PCIe risers:

a. Install any other PCIe cards that you want to install into the new risers.

Note If you are installing a Cisco UCS Virtual Interface Card (VIC), see the slot restrictions in Special

Considerations for Cisco UCS Virtual Interface Cards, page 3-43.

b. Install riser 2 first. Position the PCIe riser over its socket on the motherboard and over its alignment

slots in the chassis (see Figure 3-28).

Note It is easier to view and position the riser 2 connector over its socket with riser 1 removed.

c. Carefully push down on both ends of the PCIe riser to fully engage its circuit board connector with

the socket on the motherboard. The riser top surfaces should sit flat on the chassis and the mid-brace.

d. Install riser 1.

Step 8 Connect the power cable to the GPU cards. See Figure 3-29.

• If you installed one GPU card, connect the free end of the straight cable to the GPU card power

connector that is underneath the chassis mid-brace.

• If you installed two GPU cards, connect the shorter branch of the Y cable to the GPU card in slot 5.

Connect the longer branch to the GPU card in slot 2.

Note The power connector on the NVIDIA GRID K1 GPU card has only 6 pins, but the power cable

has an 8-pin connector. Plug the 8-pin cable connector into the 6-pin connector on the card, aligning the clip and keying features for the correct fit. Pins 4 and 8 on the cable connector do not engage with the connector on the card.

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01z

3-55

Page 98

Installing or Replacing Server Components

Note The NVIDIA GRID K2 GPU card has a 6-pin power connector and an 8-pin connector. When

you connect the power cable, use the 8-pin connector on the card.

Note There are cable clips on the underside of the chassis mid-brace through which you can route the

power cable.

Step 9 Install the air baffle. Step 10 Replace the top cover. Step 11 Replace the server in the rack, replace cables, and then power on the server by pressing the Power

button.

Step 12 Continue with Installing Drivers to Support the NVIDIA GPU Cards, page 3-60.

Installing the GPU Card in Version 02 and Later Servers

Chapter 3 Maintaining the Server

Use the following procedure to install a GPU card into a version 02 or later server, for which the GPU upgrade kit is not required. For these newer servers, the new risers and mid-brace are already installed and the power cable adapter is not required because the motherboard connector is already updated.

Step 1 Prepare the server:

a. Shut down and power off the server as described in the “Shutting Down and Powering Off the

Server” section on page 3-7.

b. Slide the server out the front of the rack far enough so that you can remove the top cover. You might

have to detach cables from the rear panel to provide clearance.

c. Remove the air baffle that covers the CPUs and DIMMs.

Step 2 Remove the PCI risers:

a. Use the finger holes in each PCIe riser to lift straight up on both ends. Set the risers on an antistatic

mat.

b. Remove any existing cards from the PCIe slots that you will use for GPUs (slot 5 or slot 2).

Note See Configuration Rules, page 3-48 before you install the GPU cards to the risers. Slot population

restrictions apply.

Step 3 Install your first GPU card into PCIe slot 5. See Configuration Rules, page 3-48 when planning which

slots to use for your card. See Figure 3-32 for the riser and slot locations.

3-56

Note The option ROM must be enabled in the BIOS Setup Utility for the slot in which you are

installing the GPU card or it will not be recognized by the system.

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Page 99

Chapter 3 Maintaining the Server

1 2 3

336576

Figure 3-32 Rear Panel, Showing PCIe Risers and PCIe Slots

1 PCIe riser 1 slots (Slots 1, 2, 3) 2 PCIe riser 2 slots (Slots 4, 5)

a. Open the riser’s hinged card retainer and the long-card retainer (see Figure 3-33). b. Align the GPU card with the socket on the riser, then gently push the card’s edge connector into the

c. Close the hinged card retainer, then the long-card retainer over the end of the card.

Installing or Replacing Server Components

PCIe 5

PSU1 PSU2

PCIe 4

socket. Press evenly on both corners of the card to avoid damaging the connector.

PCIe 1

PCIe 2

PCIe 3

331841

1 Long-card retainer 3 Hinged card retainer for PCIe slot 5 2 Card socket

Step 4 If you are installing a second GPU card, repeat the actions in Step 3 for PCIe slot 2 on the second riser.

Note When a GPU card is in slot 2, slot 1 is blocked and unavailable for use.

Figure 3-33 PCIe Riser (Slot 5 on PCIe Riser 2 Shown)

Step 5 Install the new PCIe risers:

a. Install any other PCIe cards that you want to install into the new risers.

Note If you are installing a Cisco UCS Virtual Interface Card (VIC), see the slot restrictions in Special

Considerations for Cisco UCS Virtual Interface Cards, page 3-43.

b. Install riser 2 first. Position the PCIe riser over its socket on the motherboard and over its alignment

slots in the chassis (see Figure 3-34).

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01z

3-57

Page 100

Installing or Replacing Server Components

Note It is easier to view and position the riser 2 connector over its socket with riser 1 removed.

c. Carefully push down on both ends of the PCIe riser to fully engage its circuit board connector with

the socket on the motherboard. The riser top surfaces should sit flat on the chassis and the mid-brace.

d. Install riser 1.

Step 6 Connect the GPU power cable to motherboard connector GPU PWR (see Figure 3-34).

• If you installed one GPU card, connect the white end of the straight cable to GPU PWR.

• If you installed two GPU cards, connect the white end of the Y cable to GPU PWR.

Step 7 Connect the power cable to the GPU cards (see Figure 3-35).

• If you installed one GPU card, connect the free end of the straight cable to the GPU card power

connector that is underneath the chassis mid-brace.

• If you installed two GPU cards, connect the shorter branch of the Y cable to the GPU card in slot 5.

Connect the longer branch to the GPU card in slot 2.

Chapter 3 Maintaining the Server

Note The power connector on the NVIDIA GRID K1 GPU card has only 6 pins, but the power cable

Note The NVIDIA GRID K2 card has a 6-pin power connector and an 8-pin connector. When you

connect the power cable, use the 8-pin connector on the card.

Note There are cable clips on the underside of the chassis mid-brace through which you can route the

power cable.

3-58

Cisco UCS C240 Server Installation and Service Guide

OL-25761-01

Cisco UCS C240 Installation And Service Manual

CONTENTS

Preface

Related Documentation

Organization

Audience

Documentation Feedback

Conventions

Obtaining Documentation and Submitting a Service Request

Overview

External Features Overview

Summary of Server Features

Installing the Server

Unpacking and Inspecting the Server

Preparing for Server Installation

Installation Guidelines

Rack Requirements

Equipment Requirements

Slide Rail Adjustment Range

Installing the Server In a Rack

Installing the Slide Rails

Installing the Cable Management Arm (Optional)

Reversing the Cable Management Arm (Optional)

Initial Server Setup

Connecting and Powering On the Server (Standalone Mode)

NIC Modes and NIC Redundancy Settings

System BIOS and CIMC Firmware

Updating the BIOS and CIMC Firmware

Accessing the System BIOS

Service Headers and Jumpers

Header Locations on the Motherboard

Using the BIOS Recovery Header J2068

Procedure 1: Reboot With recovery.cap File

Procedure 2: Use Recovery Jumper and recovery.cap File

Using the Clear CMOS Header J2065

Maintaining the Server

Server Monitoring and Management Tools

Cisco Integrated Management Interface (CIMC)

Server Configuration Utility

Status LEDs and Buttons

Front Panel LEDs

Rear Panel LEDs and Buttons

Internal Diagnostic LEDs

Preparing for Server Component Installation

Required Equipment

Shutting Down and Powering Off the Server

Removing and Replacing the Server Top Cover

Replaceable Component Locations

Serial Number Location

Color-Coded Touch Points

Installing or Replacing Server Components

Replacing Hard Drives or Solid State Drives

Drive Population Guidelines

Drive Replacement Procedure

Replacing a Drive Backplane

Replacing a SAS Expander

Replacing Fan Modules

Replacing the Motherboard RTC Battery

Replacing DIMMs

Memory Performance Guidelines and Population Rules

DIMM Replacement Procedure

Replacing CPUs and Heatsinks

Special Information For Upgrades to Intel E5-2600 v2 Series CPUs

CPU Configuration Rules

CPU Replacement Procedure

Additional CPU-Related Parts To Order With RMA Replacement Motherboards

Replacing a Mezzanine Card

Replacing a PCIe Riser

Replacing a PCIe Card

PCIe Slots

Replacing a PCIe Card

Special Considerations for Cisco UCS Virtual Interface Cards

Special Considerations for Cisco UCS Fusion ioDrive2 Storage Accelerator Cards

RAID Controller Card Cable Routing

Installing Multiple PCIe Cards and Resolving Limited Resources

Installing an NVIDIA GRID or Tesla GPU Card

Overview of Software Requirements

Configuration Rules

How to Determine Your Server Version

Installation Procedures