Cisco UCS C480 M5 Installation And Service Manual

Page 1
Cisco UCS C480 M5 Server Installation and Service Guide
First Published: 2017-10-12
Last Modified: 2018-06-08
Americas Headquarters
Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000
800 553-NETS (6387)
Fax: 408 527-0883
Page 2
THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.
THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.
The following information is for FCC compliance of Class A devices: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to part 15 of the FCC rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio-frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case users will be required to correct the interference at their own expense.
The following information is for FCC compliance of Class B devices: This equipment has been tested and found to comply with the limits for a Class B digital device, pursuant to part 15 of the FCC rules. These limits are designed to provide reasonable protection against harmful interference in a residential installation. This equipment generates, uses and can radiate radio frequency energy and, if not installed and used in accordance with the instructions, may cause harmful interference to radio communications. However, there is no guarantee that interference will not occur in a particular installation. If the equipment causes interference to radio or television reception, which can be determined by turning the equipment off and on, users are encouraged to try to correct the interference by using one or more of the following measures:
• Reorient or relocate the receiving antenna.
• Increase the separation between the equipment and receiver.
• Connect the equipment into an outlet on a circuit different from that to which the receiver is connected.
• Consult the dealer or an experienced radio/TV technician for help.
Modifications to this product not authorized by Cisco could void the FCC approval and negate your authority to operate the product
The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public domain version of the UNIX operating system. All rights reserved. Copyright©1981, Regents of the University of California.
NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED "AS IS" WITH ALL FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE PRACTICE.
IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
Any Internet Protocol (IP) addresses and phone numbers used in this document are not intended to be actual addresses and phone numbers. Any examples, command display output, network topology diagrams, and other figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses or phone numbers in illustrative content is unintentional and coincidental.
Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL:
https://www.cisco.com/go/trademarks. Third-party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership relationship
between Cisco and any other company. (1721R)
©
2017 Cisco Systems, Inc. All rights reserved.
Page 3
Overview
Overview, on page 1
External Features, on page 1
Serviceable Component Locations, on page 4
Summary of Server Features, on page 9
Overview
This chapter provides a summary overview of the Cisco UCS C480 M5 server.
External Features
This topic shows the external features of the server.
Cisco UCS C480 M5 Server Front Panel Features
CHAPTER 1
For definitions of LED states, see Front-Panel LEDs, on page 29.
Figure 1: Cisco UCS C480 M5 Server Front Panel
Cisco UCS C480 M5 Server Installation and Service Guide
1
Page 4
External Features
Overview
8Power button/LED1
Left bay module (drive bays 1 - 8)
• Bays 1, 2, 7, 8 support SAS/SATA and NVMe drives.
Front NVMe drives are not supported in a single-CPU module system.
• Bays 3, 4, 5, 6 support SAS/SATA drives only.
Note
An NVMe-only front drive module is available that supports up to 8 NVMe SSDs. You cannot mix this NVMe-only module with SAS/SATA modules or change module types in the field.
9Identification button/LED2
Center bay module (drive bays 9 - 16)
• Bays 9, 10, 15, 16 support SAS/SATA or NVMe drives.
Front NVMe drives are not supported in a single-CPU module system.
• Bays 11, 12, 13, 14 support SAS/SATA drives only.
10System status LED3
Right bay module, supports either:
• Optional DVD drive module
• Drive bays 17 - 24 (shown)
• Bays 17, 18, 23, 24 support SAS/SATA or NVMe drives.
Front NVMe drives are not supported in a single-CPU module system.
• Bays 19, 20, 21, 22 support SAS/SATA drives only.
11Fan status LED4
KVM console connector (used with a KVM cable that provides two USB, one VGA, and one serial connector)
Pull-out asset tag12Temperature status LED5
Cisco UCS C480 M5 Server Installation and Service Guide
2
Page 5
Overview
External Features
Cisco UCS C480 M5 Server Rear Panel Features
For definitions of LED states, see Rear-Panel LEDs, on page 32.
Figure 2: Cisco UCS C480 M5 Server Rear Panel
13Power supply status LED6
CPU module bay 1
The system must have at least one CPU module in bay 1 to boot.
It must also have either a CPU module or a blank filler module in bay 2.
14Network link activity LED7
CPU module bay 2
If no CPU module is present in bay 2, there must be a blank filler module in bay 2 or the system will not boot.
4
lower)
The dual LAN ports can suport 1 Gbps and 10 Gbps, depending on the link-partner capability.
Rear identification button/LED7Serial port COM 1 (DB-9 connector)1
USB 3.0 ports (three)8VGA video port (DB-15 connector)2
9Not used at this time3
Power supplies 1 – 4 (hot-swappable, redundant as 2+2 (default) or 3+1)
See Power Specifications, on page 128 for specifications and supported options.
Threaded holes for dual-hole grounding lug101-Gb/10-Gb Ethernet ports (LAN1 upper, LAN2
Cisco UCS C480 M5 Server Installation and Service Guide
3
Page 6
Serviceable Component Locations
Overview
5
(Base-T)
1110/100/1000 Ethernet dedicated management port
-Not used at this time6
Serviceable Component Locations
This topic shows the locations of the field-replaceable components and service-related items.
The Technical Specifications Sheets for all versions of this server, which include supported component part numbers, are at Cisco UCS Servers Technical Specifications Sheets (scroll down to Technical Specifications).
Serviceable Components Inside the Main Chassis, on page 5
Serviceable Components Inside a CPU Module, on page 8
Serviceable Components Inside an I/O Module, on page 9
PCIe slots 1 – 12
See PCIe Slot Specifications and Restrictions, on
page 89 for slot specifications.
Cisco UCS C480 M5 Server Installation and Service Guide
4
Page 7
Overview
Serviceable Components Inside the Main Chassis
Figure 3: Serviceable Component Locations Inside the Main Chassis
Serviceable Component Locations
Cisco UCS C480 M5 Server Installation and Service Guide
5
Page 8
Serviceable Component Locations
Overview
1
11RAID controller card for front-loading drives.
(not visible in this view; position is near chassis floor under CPU modules)
2
PCIe slot 01: Primary slot for Cisco UCS VIC adapter card.
(Secondary slot for Cisco UCS VIC is slot 02.)
Power connectors for high-power GPU cards (six)12Supercap (RAID backup) for front RAID controller
(not visible in this view; mounting bracket position is on chassis wall under CPU modules)
3
13Fan modules (four modules with two fans each;
hot-swappable)
4
Trusted platform module socket (TPM) on motherboard
CPU modules (up to two, font-loading)14Air diffuser for auxiliary rear drive module
This diffuser is required only when using SAS/SATA drives in the rear drive module.
5
15Position of the supercap unit (RAID backup) for
the rear RAID controller.
The clip for the supercap is on the inside surface of the air diffuser.
Left bay module (drive bays 1 - 8)
• Bays 1, 2, 7, 8 support SAS/SATA or NVMe drives.
Front NVMe drives are not supported in a single-CPU module system.
• Bays 3, 4, 5, 6 support SAS/SATA drives only.
Note
An NVMe-only front drive module is available that supports up to 8 NVMe SSDs. You cannot mix this NVMe-only module with SAS/SATA modules or change module types in the field.
6
16Auxiliary rear drive module; holds either (no
mixing):
• Up to eight 2.5-inch SAS/SATA drives
• Up to eight 2.5-inch NVMe SSDs
Center bay module (drive bays 9 - 16)
• Bays 9, 10, 15, 16 support SAS/SATA or NVMe drives.
Front NVMe drives are not supported in a single-CPU module system.
• Bays 11, 12, 13, 14 support SAS/SATA drives only.
Cisco UCS C480 M5 Server Installation and Service Guide
6
Page 9
Overview
Serviceable Component Locations
17Internal USB 2.0 socket on motherboard7
Right bay module, supports either:
• Drive bays 17 - 24 (shown)
• Bays 17, 18, 23, 24 support SAS/SATA or NVMe drives.
Front NVMe drives are not supported in a single-CPU module system.
• Bays 19, 20, 21, 22 support SAS/SATA drives only.
• Optional DVD drive module
8
18PCIe slots 1 – 12
For PCIe slot specifications, see PCIe Slot
Specifications and Restrictions, on page 89.
PCIe slot 12 is not available when the auxiliary internal drive cage is used because of internal clearance.
9
19PCIe slot 11: Default slot for rear RAID controller
whenthe rear drive module is used with SAS/SATA drives.
Note
In systems with only one CPU module,
I/O module
Note
The I/O module is not field replaceable, nor can you move an I/O module from one chassis to another. This module contains a security chip that requires it to stay with the PCIe module in the same chassis, as shipped from the factory.
Power supplies 1 – 4 (hot-swappable, redundant as 2+2 (default) or 3+1)
All power supplies in the system must be identical
(no mixing). slot 11 is not supported. In this case, the rear RAID controller must be installed in slot 10 and a blanking panel must be installed in slot 11.
10
-PCIe slot 10: Required slot for NVMe switch card
when the rear drive module is used with NVMe SSDs.
This slot must also be used for the rear RAID controller in systems with only one CPU module.
Cisco UCS C480 M5 Server Installation and Service Guide
7
Page 10
Serviceable Component Locations
Serviceable Components Inside a CPU Module
Figure 4: Serviceable Component Locations Inside a CPU Module
Overview
1
4CPU number differs depending on the CPU module
location:
DIMM sockets controlled by CPU 1 or 3 (channels A, B, C, D, E, F.)
• CPU 2 and heatsink (when module is in lower bay 1)
• CPU 4 and heatsink (when module is in upper bay 2)
Note
The CPUs in CPU module 1 must be identical with the CPUs in CPU module 2 (no mixing).
2
Release levers for module (two each module)5DIMM sockets controlled by CPU 2 or 4 (channels
G, H, J, K, L, M.)
See DIMM Population Rules and Memory
Performance Guidelines, on page 108 for DIMM
slot numbering.
Cisco UCS C480 M5 Server Installation and Service Guide
8
Page 11
Overview
Summary of Server Features
3
location:
• CPU 1 and heatsink (when module is in lower bay 1)
• CPU 3 and heatsink (when module is in upper bay 2)
Note
The CPUs in CPU module 1 must be identical with the CPUs in CPU module 2 (no mixing).
Serviceable Components Inside an I/O Module
Figure 5: Serviceable Component Locations Inside an I/O Module
-CPU number differs depending on the CPU module
2
Supports either an SD card carrier with two SD card slots or an M.2 SSD carrier with two SATA M.2 SSD slots.
Summary of Server Features
The following table lists a summary of server features.
RTC battery vertical socket3Micro SD card socket1
-Mini storage module connector
DescriptionFeature
Four rack-unit (4RU) chassisChassis
Cisco UCS C480 M5 Server Installation and Service Guide
9
Page 12
Summary of Server Features
Overview
DescriptionFeature
Central Processor
Memory
Baseboard management
Network and management I/O
The server supports one or two removable CPU modules, each with two CPUs.
Up to four CPUs from the Intel Xeon Processor Scalable Family. This includes CPUs from the following series:
• Intel Xeon Gold 5XXX Processors
• Intel Xeon Gold 6XXX Processors
• Intel Xeon Platinum 8XXX Processors
Each of the CPUs support up to 12 DIMMs for a total of 48 DIMMs.
The server supports up to two removable CPU modules, each with 24 DIMM sockets.
Multi-bit error protection is supportedMulti-bit error protection
BMC, running Cisco Integrated Management Controller (Cisco IMC) firmware.
Depending on your Cisco IMC settings, Cisco IMC can be accessed through the 1-Gb dedicated management port, the 1-Gb/10-Gb Ethernet LAN ports, or a Cisco virtual interface card.
The network and management I/O ports for this server are on a removeable I/O module:
WoL
• One 10/100/1000 Ethernet dedicated management port (RJ-45 connector)
• One 10/100/1000 Ethernet private inter-chassis port (RJ-45 connector)
• Two 1-Gb/10-Gb BASE-T Ethernet LAN ports (RJ-45 connectors)
• One RS-232 serial port (DB-9 connector)
• One VGA video connector port (DB-15 connector)
• Two USB 3.0 ports
Front panel:
• One front-panel keyboard/video/mouse (KVM) connector that is used with the KVM cable, which provides two USB
2.0, one VGA, and one DB-9 serial connector.
The two 1-Gb/10-Gb BASE-T Ethernet LAN ports support the wake-on-LAN (WoL) standard.
Cisco UCS C480 M5 Server Installation and Service Guide
10
Page 13
Overview
Summary of Server Features
DescriptionFeature
Power
ACPI
Cooling
PCIe I/O
InfiniBand
Storage, front-panel
Four power supplies, redundant as 2+2 (default) or 3+1:
• AC power supplies 1600 W AC each
Do not mix power supply types or wattages in the server.
The advanced configuration and power interface (ACPI) 4.0 standard is supported.
Four hot-swappable fan modules with two fans in each for front-to-rear cooling.
Twelve vertical PCIe expansion slots on the chassis motherboard.
See PCIe Slot Specifications and Restrictions, on page 89 for specifications of the slots.
The PCIe bus slots in this server support the InfiniBand architecture.
The server can hold up to 24 front-loading, 2.5-inch drives.
Front drive bays are divided across 3 removable drive bay modules. Each drive bay module has 8 drive bays for a total of 24 front-loading drive bays.
• All 24 front drive bays support SAS/SATA drives.
Storage, internal
• Each of the 3 drive bay modules have 4 bays that support NVMe SSDs, for a total of 12 bays that support NVMe SSDs.
Note
An NVMe-only front drive module is available that supports up to 8 NVMe SSDs. You cannot mix this NVMe-only module with SAS/SATA modules or change module types in the field.
The server has these internal storage options:
• The optional, rear drive bay module has 8 drive bays. All 8 bays support either all SAS/SATA drives or all NVMe SSDs. Mixing is not supported.
• One USB 2.0 port on the chassis motherboard.
• Mini-storage module socket on the I/O module board, optionally with either:
• SD card carrier. Supports up to two SD cards.
• M.2 SSD carrier. Supports two SATA M.2 SSDs.
• One micro-SD card socket on the I/O module board.
Cisco UCS C480 M5 Server Installation and Service Guide
11
Page 14
Summary of Server Features
Overview
DescriptionFeature
Other removable media
Storage management
RAID supercap backup
A DVD drive module option is available in place of the right drive bay module.
• Front-loading storage: the server has a dedicated internal socket near the chassis front for a single storage controller card (RAID or HBA). This controller card can control up to 24 front-loading drives.
• Internal, auxiliary storage. The server supports these options:
• When SAS/SATA drives are populated in the auxiliary rear drive bays, they can be controlled by a storage controller card in PCIe slot 11 or 10.
• When NVMe SSDs are populated in the auxiliary drive bays, you must have an NVMe switch card in PCIe slot
10.
For a detailed list of storage controller options, see Supported
Storage Controllers and Cables, on page 133.
The server supports the following options when RAID cards are installed:
• There is a bracket on the chassis wall for a supercap unit that backs up a front RAID controller for front-loading drives.
• There is a bracket on the rear drive module diffuser for a supercap unit that backs up a rear RAID controller.
Integrated VGA video.Integrated video
Cisco UCS C480 M5 Server Installation and Service Guide
12
Page 15
Installing the Server
Preparing for Installation, on page 13
Installing the Server in a Rack, on page 16
Initial Server Setup, on page 20
NIC Mode and NIC Redundancy Settings, on page 25
Updating the BIOS and Cisco IMC Firmware, on page 26
Accessing the System BIOS, on page 27
Preparing for Installation
This section contains the following topics:
Installation Warnings and Guidelines
CHAPTER 2
Note
Warning
Warning
Before you install, operate, or service a server, review the Regulatory Compliance and Safety Information for
Cisco UCS C-Series Servers for important safety information.
IMPORTANT SAFETY INSTRUCTIONS
This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents. Use the statement number provided at the end of each warning to locate its translation in the translated safety warnings that accompanied this device.
Statement 1071
To prevent the system from overheating, do not operate it in an area that exceeds the maximum recommended ambient temperature of: 35° C (95° F).
Statement 1047
Cisco UCS C480 M5 Server Installation and Service Guide
13
Page 16
Installation Warnings and Guidelines
Installing the Server
Warning
Warning
Warning
Warning
The plug-socket combination must be accessible at all times, because it serves as the main disconnecting device.
Statement 1019
This product relies on the building’s installation for short-circuit (overcurrent) protection. Ensure that the protective device is rated not greater than: 250 V, 15 A.
Statement 1005
Installation of the equipment must comply with local and national electrical codes.
Statement 1074
This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock, and key, or other means of security.
Statement 1017
Warning
Warning
Warning
This equipment must be grounded. Never defeat the ground conductor or operate the equipment in the absence of a suitably installed ground conductor. Contact the appropriate electrical inspection authority or an electrician if you are uncertain that suitable grounding is available.
Statement 1024
For Nordic countries (Norway, Finland, Sweden and Denmark) this system must be installed in a Restricted Access Location, where the voltage of the main ground connection of all equipment is the same (equipotential earth) and the system is connected to a grounded electrical outlet.
Statement 328
High leakage current – earth connection essential before connection to system power supply.
Statement 342
Cisco UCS C480 M5 Server Installation and Service Guide
14
Page 17
Installing the Server
Rack Requirements
Warning
Caution
Caution
This equipment must be externally grounded using a customer-supplied ground wire before power is applied. Contact the appropriate electrical inspection authority or an electrician if you are uncertain that suitable grounding is available.
Statement 366
To ensure proper airflow it is necessary to rack the servers using rail kits. Physically placing the units on top of one another or “stacking” without the use of the rail kits blocks the air vents on top of the servers, which could result in overheating, higher fan speeds, and higher power consumption. We recommend that you mount your servers on rail kits when you are installing them into the rack because these rails provide the minimal spacing required between the servers. No additional spacing between the servers is required when you mount the units using rail kits.
Avoid uninterruptible power supply (UPS) types that use ferroresonant technology. These UPS types can become unstable with systems such as the Cisco UCS, which can have substantial current draw fluctuations from fluctuating data traffic patterns.
When you are installing a server, use the following guidelines:
• Plan your site configuration and prepare the site before installing the server. See the Cisco UCS Site
Preparation Guide for the recommended site planning tasks.
• Ensure that there is adequate space around the server to allow for accessing the server and for adequate airflow. The airflow in this server is from front to back.
• Ensure that the air-conditioning meets the thermal requirements listed in the Environmental Specifications,
on page 127.
• Ensure that the cabinet or rack meets the requirements listed in the Rack Requirements, on page 15.
• Ensure that the site power meets the power requirements listed in the Power Specifications, on page 128. If available, you can use an uninterruptible power supply (UPS) to protect against power failures.
Rack Requirements
The rack must be of the following type:
• A standard 19-in. (48.3-cm) wide, four-post EIA rack, with mounting posts that conform to English universal hole spacing, per section 1 of ANSI/EIA-310-D-1992.
• The rack-post holes can be square 0.38-inch (9.6 mm), round 0.28-inch (7.1 mm), #12-24 UNC, or #10-32 UNC when you use the Cisco-supplied slide rails.
• The minimum vertical rack space per server must be four rack units (RUs), equal to 7.0 in. (177.8 mm).
Cisco UCS C480 M5 Server Installation and Service Guide
15
Page 18
Installing the Server in a Rack
Supported Cisco Slide Rail Kits
The server supports the following rail kit options:
• Cisco part UCSC-RAIL-4U-M5= (ball-bearing slide rail kit)
• Cisco part UCSC-CMA-4U-M5= (cable management arm)
Rack Installation Tools Required
The slide rails sold by Cisco Systems for this server do not require tools for installation.
Slide Rail and Cable Management Arm Dimensions
The slide rails for this server have an adjustment range of 24 to 36 inches (610 to 914 mm).
The optional cable management arm (CMA) adds additional length requirements:
• The additional distance from the rear of the server to the rear of the CMA is 5.4 inches (137.4 mm).
• The total length of the server including the CMA is 35.2 inches (894 mm).
Installing the Server
Installing the Server in a Rack
Warning
Step 1 Attach the inner rails to the sides of the server:
a) Align an inner rail with one side of the server so that the keyed slots in the rail align with the pegs on the side of the
b) Set the keyed slots over the pegs, and then slide the rail toward the front to lock it in place on the pegs. The front slot
c) Install the second inner rail to the opposite side of the server.
To prevent bodily injury when mounting or servicing this unit in a rack, you must take special precautions to ensure that the system remains stable. The following guidelines are provided to ensure your safety:
This unit should be mounted at the bottom of the rack if it is the only unit in the rack.
When mounting this unit in a partially filled rack, load the rack from the bottom to the top with the heaviest component at the bottom of the rack.
If the rack is provided with stabilizing devices, install the stabilizers before mounting or servicing the unit in the rack.
Statement 1006
server.
has a metal clip that locks over the front peg.
Cisco UCS C480 M5 Server Installation and Service Guide
16
Page 19
Installing the Server
Figure 6: Attaching the Inner Rail to the Side of the Server
Installing the Server in a Rack
Pegs on side of server2Inner rail1
Step 2 Open the front securing plate on both slide-rail assemblies. The front end of the slide-rail assembly has a spring-loaded
securing plate that must be open before you can insert the mounting pegs into the rack-post holes.
On the outside of the assembly, push the green-arrow button toward the rear to open the securing plate.
Figure 7: Front Securing Mechanism, Inside of Front End
3Front mounting pegs1
Securing plate shown pulled back to the open position
2
-Rack post between mounting pegs and opened
securing plate
Step 3 Install the outer slide rails into the rack:
a) Align one slide-rail assembly front end with the front rack-post holes that you want to use.
The slide rail front-end wraps around the outside of the rack post and the mounting pegs enter the rack-post holes from the outside-front.
Note
The rack post must be between the mounting pegs and the open securing plate.
Cisco UCS C480 M5 Server Installation and Service Guide
17
Page 20
Installing the Server in a Rack
b) Push the mounting pegs into the rack-post holes from the outside-front. c) Press the securing plate release button, marked PUSH. The spring-loaded securing plate closes to lock the pegs in
place.
d) Adjust the slide-rail length, and then push the rear mounting pegs into the corresponding rear rack-post holes. The
slide rail must be level front-to-rear.
The rear mounting pegs enter the rear rack-post holes from the inside of the rack post.
e) Attach the second slide-rail assembly to the opposite side of the rack. Ensure that the two slide-rail assemblies are at
the same height and are level front-to-back.
f) Pull the inner slide rails on each assembly out toward the rack front until they hit the internal stops and lock in place.
Step 4 Insert the server into the slide rails:
Installing the Server
Caution
This server can weigh up to 146 pounds (66.2 kilograms) when fully loaded with components. We recommend that you use a minimum of two people or a mechanical lift when lifting the server. Attempting this procedure alone could result in personal injury or equipment damage.
a) Align the rear ends of the inner rails that are attached to the server sides with the front ends of the empty slide rails
on the rack. b) Push the inner rails into the slide rails on the rack until they stop at the internal stops. c) Slide the inner-rail release clip toward the rear on both inner rails, and then continue pushing the server into the rack
until its front slam-latches engage with the rack posts.
Figure 8: Inner-Rail Release Clip
Outer slide rail attached to rack post3Inner-rail release clip1
2
-Inner rail attached to server and inserted into
outer slide rail
Step 5 (Optional) Secure the server in the rack more permanently by using the two screws that are provided with the slide rails.
Perform this step if you plan to move the rack with servers installed.
With the server fully pushed into the slide rails, open a hinged slam latch lever on the front of the server and insert a screw through the hole that is under the lever. The screw threads into the static part of the rail on the rack post and prevents the server from being pulled out. Repeat for the opposite slam latch.
Cisco UCS C480 M5 Server Installation and Service Guide
18
Page 21
Installing the Server
Installing the Cable Management Arm (Optional)
Installing the Cable Management Arm (Optional)
Note
The cable management arm (CMA) is reversible left-to-right. To reverse the CMA, see Reversing the Cable
Management Arm (Optional), on page 20 before installation.
Step 1 With the server pushed fully into the rack, slide the CMA tab of the CMA arm that is farthest from the server onto the
end of the stationary slide rail that is attached to the rack post. Slide the tab over the end of the rail until it clicks and locks.
Figure 9: Attaching the CMA to the Rear Ends of the Slide Rails
1
to end of stationary outer slide rail.
2
to end of inner slide rail attached to server.
Step 2 Slide the CMA tab that is closest to the server over the end of the inner rail that is attached to the server. Slide the tab
over the end of the rail until it clicks and locks
Step 3 Pull out the width-adjustment slider that is at the opposite end of the CMA assembly until it matches the width of your
rack.
Step 4 Slide the CMA tab that is at the end of the width-adjustment slider onto the end of the stationary slide rail that is attached
to the rack post. Slide the tab over the end of the rail until it clicks and locks.
3CMA tab on arm farthest from server attaches
CMA tab on width-adjustment slider attaches to end of stationary outer slide rail.
Rear of server4CMA tab on arm closest to the server attaches
Cisco UCS C480 M5 Server Installation and Service Guide
19
Page 22
Installing the Server
Reversing the Cable Management Arm (Optional)
Step 5 Open the hinged flap at the top of each plastic cable guide and route your cables through the cable guides as desired.
Reversing the Cable Management Arm (Optional)
Step 1 Rotate the entire CMA assembly 180 degrees, left-to-right. The plastic cable guides must remain pointing upward.
Step 2 Flip the tabs at the ends of the CMA arms so that they point toward the rear of the server.
Step 3 Pivot the tab that is at the end of the width-adjustment slider. Depress and hold the metal button on the outside of the tab
and pivot the tab 180 degrees so that it points toward the rear of the server.
Figure 10: Reversing the CMA
Initial Server Setup
Note
This section describes how to power on the server, assign an IP address, and connect to server management when using the server in standalone mode. To use the server in Cisco UCS Manager integration, specific cabling and settings are required. See Installation For Cisco UCS Manager Integration, on page 161.
Cisco UCS C480 M5 Server Installation and Service Guide
20
Metal button on outside of tab2CMA tab on end of width-adjustment slider1
Page 23
Installing the Server
Connecting to the Server Locally For Setup
Server Default Settings
The server is shipped with these default settings:
• The NIC mode is Shared LOM EXT.
Shared LOM EXT mode enables the 1-Gb/10-Gb Ethernet ports and the ports on any installed Cisco virtual interface card (VIC) to access the Cisco Integrated Management Interface (Cisco IMC). If you want to use the 10/100/1000 dedicated management port to access Cisco IMC, you can connect to the server and change the NIC mode as described in Setting Up the System With the Cisco IMC Configuration
Utility, on page 23.
• The NIC redundancy is Active-Active. All Ethernet ports are utilized simultaneously.
• DHCP is enabled.
• IPv4 is enabled.
Connection Methods
There are two methods for connecting to the system for initial setup:
• Local setup—Use this procedure if you want to connect a keyboard and monitor directly to the system for setup. This procedure can use a KVM cable (Cisco PID N20-BKVM) or the ports on the rear of the server.
• Remote setup—Use this procedure if you want to perform setup through your dedicated management LAN.
Note
To configure the system remotely, you must have a DHCP server on the same network as the system. Your DHCP server must be preconfigured with the range of MAC addresses for this server node. The MAC address is printed on a label that is on the pull-out asset tag on the front panel. This server node has a range of six MAC addresses assigned to the Cisco IMC. The MAC address printed on the label is the beginning of the range of six contiguous MAC addresses.
Connecting to the Server Locally For Setup
This procedure requires the following equipment:
• VGA monitor
• USB keyboard
• Either the supported Cisco KVM cable (Cisco PID N20-BKVM); or a USB cable and VGA DB-15 cable
Step 1 Attach a power cord to each power supply in your server, and then attach each power cord to a grounded AC power outlet.
Wait for approximately two minutes to let the server boot to standby power during the first bootup. You can verify system power status by looking at the system Power Status LED on the front panel. The system is in standby power mode when the LED is amber.
Cisco UCS C480 M5 Server Installation and Service Guide
21
Page 24
Connecting to the Server Remotely For Setup
Step 2 Connect a USB keyboard and VGA monitor to the server using one of the following methods:
• Connect an optional KVM cable (Cisco PID N20-BKVM) to the KVM connector on the front panel. Connect your USB keyboard and VGA monitor to the KVM cable.
• Connect a USB keyboard and VGA monitor to the corresponding connectors on the rear panel.
Step 3 Open the Cisco IMC Configuration Utility:
a) Press and hold the front panel power button for four seconds to boot the server. b) During bootup, press F8 when prompted to open the Cisco IMC Configuration Utility.
Installing the Server
Note
The first time that you enter the Cisco IMC Configuration Utility, you are prompted to change the default password. The default password is password. The Strong Password feature is enabled.
The following are the requirements for Strong Password:
• The password can have minimum 8 characters; maximum 14 characters.
• The password must not contain the user’s name.
• The password must contain characters from three of the following four categories:
• English uppercase letters (A through Z)
• English lowercase letters (a through z)
• Base 10 digits (0 through 9)
• Non-alphabetic characters !, @, #, $, %, ^, &, *, -, _, =, “
Step 4 Continue with Setting Up the System With the Cisco IMC Configuration Utility, on page 23.
Connecting to the Server Remotely For Setup
This procedure requires the following equipment:
• One RJ-45 Ethernet cable that is connected to your management LAN.
Before you begin
Note
To configure the system remotely, you must have a DHCP server on the same network as the system. Your DHCP server must be preconfigured with the range of MAC addresses for this server node. The MAC address is printed on a label that is on the pull-out asset tag on the front panel. This server node has a range of six MAC addresses assigned to the Cisco IMC. The MAC address printed on the label is the beginning of the range of six contiguous MAC addresses.
Step 1 Attach a power cord to each power supply in your server, and then attach each power cord to a grounded AC power outlet.
Cisco UCS C480 M5 Server Installation and Service Guide
22
Page 25
Installing the Server
Setting Up the System With the Cisco IMC Configuration Utility
Wait for approximately two minutes to let the server boot to standby power during the first bootup. You can verify system power status by looking at the system Power Status LED on the front panel. The system is in standby power mode when the LED is amber.
Step 2 Plug your management Ethernet cable into the dedicated management port on the rear panel.
Step 3 Allow your preconfigured DHCP server to assign an IP address to the server node.
Step 4 Use the assigned IP address to access and log in to the Cisco IMC for the server node. Consult with your DHCP server
administrator to determine the IP address.
Note
The default user name for the server is admin. The default password is password.
Step 5 From the Cisco IMC Server Summary page, click Launch KVM Console. A separate KVM console window opens.
Step 6 From the Cisco IMC Summary page, click Power Cycle Server. The system reboots.
Step 7 Select the KVM console window.
Note
The KVM console window must be the active window for the following keyboard actions to work.
Step 8 When prompted, press F8 to enter the Cisco IMC Configuration Utility. This utility opens in the KVM console window.
Note
The first time that you enter the Cisco IMC Configuration Utility, you are prompted to change the default password. The default password is password. The Strong Password feature is enabled.
The following are the requirements for Strong Password:
• The password can have minimum 8 characters; maximum 14 characters.
• The password must not contain the user’s name.
• The password must contain characters from three of the following four categories:
• English uppercase letters (A through Z)
• English lowercase letters (a through z)
• Base 10 digits (0 through 9)
• Non-alphabetic characters !, @, #, $, %, ^, &, *, -, _, =, “
Step 9 Continue with Setting Up the System With the Cisco IMC Configuration Utility, on page 23.
Setting Up the System With the Cisco IMC Configuration Utility
Before you begin
The following procedure is performed after you connect to the system and open the Cisco IMC Configuration Utility.
Step 1 Set the NIC mode to choose which ports to use to access Cisco IMC for server management:
Shared LOM EXT (default)—This is the shared LOM extended mode, the factory-default setting. With this mode, the Shared LOM and Cisco Card interfaces are both enabled. You must select the default Active-Active NIC redundancy setting in the following step.
Cisco UCS C480 M5 Server Installation and Service Guide
23
Page 26
Setting Up the System With the Cisco IMC Configuration Utility
In this NIC mode, DHCP replies are returned to both the shared LOM ports and the Cisco card ports. If the system determines that the Cisco card connection is not getting its IP address from a Cisco UCS Manager system because the server is in standalone mode, further DHCP requests from the Cisco card are disabled. Use the Cisco Card NIC mode if you want to connect to Cisco IMC through a Cisco card in standalone mode.
Shared LOM—The 1-Gb/10-Gb Ethernet ports are used to access Cisco IMC. You must select either the Active-Active or Active-standby NIC redundancy setting in the following step.
Dedicated—The dedicated management port is used to access Cisco IMC. You must select the None NIC redundancy setting in the following step.
Cisco Card—The ports on an installed Cisco UCS Virtual Interface Card (VIC) are used to access the Cisco IMC. You must select either the Active-Active or Active-standby NIC redundancy setting in the following step.
See also the required VIC Slot setting below.
Step 2 Set the NIC redundancy to your preference. This server has three possible NIC redundancy settings:
None—The Ethernet ports operate independently and do not fail over if there is a problem. This setting can be used only with the Dedicated NIC mode.
Installing the Server
Active-standby—If an active Ethernet port fails, traffic fails over to a standby port. Shared LOM and Cisco Card modes can each use either Active-standby or Active-active settings.
Active-active (default)—All Ethernet ports are utilized simultaneously. The Shared LOM EXT mode must use only this NIC redundancy setting. Shared LOM and Cisco Card modes can each use either Active-standby or Active-active settings.
Step 3 Choose whether to enable DHCP for dynamic network settings, or to enter static network settings.
Note
Before you enable DHCP, you must preconfigure your DHCP server with the range of MAC addresses for this server. The MAC address is printed on a label on the rear of the server. This server has a range of six MAC addresses assigned to Cisco IMC. The MAC address printed on the label is the beginning of the range of six contiguous MAC addresses.
The static IPv4 and IPv6 settings include the following:
• The Cisco IMC IP address.
For IPv6, valid values are 1 - 127.
• The gateway.
For IPv6, if you do not know the gateway, you can set it as none by entering :: (two colons).
• The preferred DNS server address.
For IPv6, you can set this as none by entering :: (two colons).
Step 4 (Optional) Make VLAN settings.
Step 5 Press F1 to go to the second settings window, then continue with the next step.
From the second window, you can press F2 to switch back to the first window.
Step 6 (Optional) Set a hostname for the server.
Step 7 (Optional) Enable dynamic DNS and set a dynamic DNS (DDNS) domain.
Step 8 (Optional) If you check the Factory Default check box, the server reverts to the factory defaults.
Cisco UCS C480 M5 Server Installation and Service Guide
24
Page 27
Installing the Server
Step 9 (Optional) Set a default user password.
NIC Mode and NIC Redundancy Settings
Note
The factory default username for the server is admin. The default password is password.
Step 10 (Optional) Enable auto-negotiation of port settings or set the port speed and duplex mode manually.
Note
Auto-negotiation is applicable only when you use the Dedicated NIC mode. Auto-negotiation sets the port speed and duplex mode automatically based on the switch port to which the server is connected. If you disable auto-negotiation, you must set the port speed and duplex mode manually.
Step 11 (Optional) Reset port profiles and the port name.
Step 12 Press F5 to refresh the settings that you made. You might have to wait about 45 seconds until the new settings appear
and the message, “Network settings configured” is displayed before you reboot the server in the next step.
Step 13 Press F10 to save your settings and reboot the server.
Note
If you chose to enable DHCP, the dynamically assigned IP and MAC addresses are displayed on the console screen during bootup.
What to do next
Use a browser and the IP address of the Cisco IMC to connect to the Cisco IMC management interface. The IP address is based upon the settings that you made (either a static address or the address assigned by your DHCP server).
Note
The factory default username for the server is admin. The default password is password.
To manage the server, see the Cisco UCS C-Series Rack-Mount Server Configuration Guide or the Cisco UCS C-Series Rack-Mount Server CLI Configuration Guide for instructions on using those interfaces for your Cisco IMC release. The links to the configuration guides are in the Cisco UCS C-Series Documentation
Roadmap.
NIC Mode and NIC Redundancy Settings
Table 1: Valid NIC Redundancy Settings For Each NIC Mode
Valid NIC Redundancy SettingsNIC Mode
Active-activeShared LOM
EXT
NoneDedicated
Shared LOM
Active-active
Active-standby
Cisco UCS C480 M5 Server Installation and Service Guide
25
Page 28
Updating the BIOS and Cisco IMC Firmware
Installing the Server
Cisco Card
This server has the following NIC mode settings that you can choose from:
Shared LOM EXT (default)—This is the shared LOM extended mode, the factory-default setting. With this mode, the Shared LOM and Cisco Card interfaces are both enabled. You must select the default Active-Active NIC redundancy setting in the following step.
In this NIC mode, DHCP replies are returned to both the shared LOM ports and the Cisco card ports. If the system determines that the Cisco card connection is not getting its IP address from a Cisco UCS Manager system because the server is in standalone mode, further DHCP requests from the Cisco card are disabled. Use the Cisco Card NIC mode if you want to connect to Cisco IMC through a Cisco card in standalone mode.
Shared LOM—The 1-Gb/10-Gb Ethernet ports are used to access Cisco IMC. You must select either the Active-Active or Active-standby NIC redundancy setting in the following step.
Dedicated—The dedicated management port is used to access Cisco IMC. You must select the None NIC redundancy setting in the following step.
Cisco Card—The ports on an installed Cisco UCS Virtual Interface Card (VIC) are used to access the Cisco IMC. You must select either the Active-Active or Active-standby NIC redundancy setting in the following step.
See also the required VIC Slot setting below.
Active-active
Active-standby
This server has the following NIC redundancy settings that you can choose from:
None—The Ethernet ports operate independently and do not fail over if there is a problem. This setting can be used only with the Dedicated NIC mode.
Active-standby—If an active Ethernet port fails, traffic fails over to a standby port. Shared LOM and Cisco Card modes can each use either Active-standby or Active-active settings.
Active-active (default)—All Ethernet ports are utilized simultaneously. The Shared LOM EXT mode must use only this NIC redundancy setting. Shared LOM and Cisco Card modes can each use either Active-standby or Active-active settings.
Updating the BIOS and Cisco IMC Firmware
Caution
When you upgrade the BIOS firmware, you must also upgrade the Cisco IMC firmware to the same version or the server does not boot. Do not power off the server until the BIOS and Cisco IMC firmware are matching or the server does not boot.
Cisco provides the Cisco Host Upgrade Utility to assist with simultaneously upgrading the BIOS, Cisco IMC, and other firmware to compatible levels.
The server uses firmware obtained from and certified by Cisco. Cisco provides release notes with each firmware image. There are several possible methods for updating the firmware:
Cisco UCS C480 M5 Server Installation and Service Guide
26
Page 29
Installing the Server
Recommended method for firmware update: Use the Cisco Host Upgrade Utility to simultaneously upgrade the Cisco IMC, BIOS, and component firmware to compatible levels.
See the Cisco Host Upgrade Utility Quick Reference Guide for your firmware release at the documentation roadmap link below.
• You can upgrade the Cisco IMC and BIOS firmware by using the Cisco IMC GUI interface.
See the Cisco UCS C-Series Rack-Mount Server Configuration Guide.
• You can upgrade the Cisco IMC and BIOS firmware by using the Cisco IMC CLI interface.
See the Cisco UCS C-Series Rack-Mount Server CLI Configuration Guide.
For links to the documents listed above, see the Cisco UCS C-Series Documentation Roadmap.
Accessing the System BIOS
Accessing the System BIOS
Step 1 Enter the BIOS Setup Utility by pressing the F2 key when prompted during bootup.
Note
Step 2 Use the arrow keys to select the BIOS menu page.
Step 3 Highlight the field to be modified by using the arrow keys.
Step 4 Press Enter to select the field that you want to change, and then modify the value in the field.
Step 5 Press the right arrow key until the Exit menu screen is displayed.
Step 6 Follow the instructions on the Exit menu screen to save your changes and exit the setup utility (or press F10). You can
exit without saving changes by pressing Esc.
The version and build of the current BIOS are displayed on the Main page of the utility.
Cisco UCS C480 M5 Server Installation and Service Guide
27
Page 30
Accessing the System BIOS
Installing the Server
Cisco UCS C480 M5 Server Installation and Service Guide
28
Page 31
Maintaining the Server
This chapter contains the following sections:
Status LEDs and Buttons, on page 29
Preparing For Component Installation, on page 34
Serviceable Component Locations, on page 39
Replacing Components Inside the Main Chassis, on page 44
Replacing Components Inside a CPU Module, on page 94
Replacing Components Inside an I/O Module, on page 111
Service DIP Switches, on page 118
Status LEDs and Buttons
This section contains information for interpreting LED states.
Front-Panel LEDs
CHAPTER 3
Figure 11: Front Panel LEDs
Table 2: Front Panel LEDs, Definition of States
StatesLED Name
Cisco UCS C480 M5 Server Installation and Service Guide
29
Page 32
Front-Panel LEDs
Maintaining the Server
Power button/LED1
• Off—There is no AC power to the server.
• Amber—The server is in standby power mode. Power is supplied only to the Cisco IMC and some motherboard functions.
• Green—The server is in main power mode. Power is supplied to all server components.
Unit identification2
• Off—The unit identification function is not in use.
• Blue, blinking—The unit identification function is activated.
System health3
• Green—The server is running in normal operating condition.
• Amber, steady—The server is in a degraded operational state (minor fault). For example:
• Power supply redundancy is lost.
• CPUs are mismatched.
• At least one CPU is faulty.
• At least one DIMM is faulty.
• At least one drive in a RAID configuration failed.
• Amber, blinking—The server is in a critical fault state. For example:
• Boot failure
• Fatal processor and/or bus error detected
• Over-temperature condition
Power supply status4
• Green—All power supplies are operating normally.
• Amber, steady—One or more power supplies are in a degraded operational state.
• Amber, blinking—One or more power supplies are in a critical fault state.
Fan status5
• Green—All fan modules are operating properly.
• Amber, steady—Fan modules are in a degraded state. One fan module has a fault.
• Amber, blinking—Two or more fan modules have faults.
Cisco UCS C480 M5 Server Installation and Service Guide
30
Page 33
Maintaining the Server
Front-Panel LEDs
8
SAS
Network link activity6
Temperature status7
SAS/SATA drive fault
Note
NVMe solid state drive (SSD) drive tray LEDs have different behavior than SAS/SATA drive trays.
• Off—The Ethernet LOM port link is idle.
• Green—One or more Ethernet LOM ports are link-active, but there is no activity.
• Green, blinking—One or more Ethernet LOM ports are link-active, with activity.
• Green—The server is operating at normal temperature. No error conditions detected.
• Amber, steady—One or more temperature sensors exceeded a warning threshold.
• Amber, blinking—One or more temperature sensors exceeded a critical non-recoverable threshold.
• Off—The hard drive is operating properly.
• Amber—Drive fault detected.
• Amber, blinking—The device is rebuilding.
• Amber, blinking with one-second interval—Drive locate function activated in the software.
SAS
8
NVMe
NVMe
SAS/SATA drive activity LED9
NVMe SSD drive fault
Note
NVMe solid state drive (SSD) drive tray LEDs have different behavior than SAS/SATA drive trays.
NVMe SSD activity9
• Off—There is no hard drive in the hard drive tray (no access, no fault).
• Green—The hard drive is ready.
• Green, blinking—The hard drive is reading or writing data.
• Off—The drive is not in use and can be safely removed.
• Green—The drive is in use and functioning properly.
• Green, blinking—the driver is initializing following insertion or the driver is unloading following an eject command.
• Amber—The drive has failed.
• Amber, blinking—A drive Locate command has been issued in the software.
• Off—No drive activity.
• Green, blinking—There is drive activity.
Cisco UCS C480 M5 Server Installation and Service Guide
31
Page 34
Rear-Panel LEDs
Maintaining the Server
CPU module power status10
CPU module fault11
-
DVD drive activity
(optional DVD module not shown)
Rear-Panel LEDs
Figure 12: Rear Panel LEDs
• Green—The CPU module is correctly seated and receiving power.
• Off—There is no power to the CPU module or it is incorrectly seated.
• Off—There is no fault with the CPUs or DIMMs on the CPU module board.
• Amber—There is a fault with a CPU or DIMM on the CPU module board, such as an over-temperature condition.
• Off—The drive is idle.
• Green, steady—The drive is spinning up a disk.
• Green, blinking—The drive is accessing data.
Table 3: Rear Panel LEDs, Definition of States
1
1-Gb/10-Gb Ethernet link speed (on both LAN1 and LAN2)
These ports auto-negotiate link speed based on the link-partner capability.
Cisco UCS C480 M5 Server Installation and Service Guide
32
StatesLED Name
• Off—Link speed is 100 Mbps.
• Amber—Link speed is 1 Gbps.
• Green—Link speed is 10 Gbps.
Page 35
Maintaining the Server
Internal Diagnostic LEDs
2
1-Gb/10-Gb Ethernet link status (on both LAN1 and LAN2)
• Off—No link is present.
• Green—Link is active.
• Green, blinking—Traffic is present on the active link.
1-Gb Ethernet dedicated management link speed3
• Off—Link speed is 10 Mbps.
• Amber—Link speed is 100 Mbps.
• Green—Link speed is 1 Gbps.
1-Gb Ethernet dedicated management link status4
• Off—No link is present.
• Green—Link is active.
• Green, blinking—Traffic is present on the active link.
Rear unit identification5
• Off—The unit identification function is not in use.
• Blue, blinking—The unit identification function is activated.
Power supply status (one LED each power supply unit)6
AC power supplies:
• Off—No AC input (12 V main power off, 12 V standby power off).
Internal Diagnostic LEDs
The system has the following internal fault LEDs to help with identifying a failing component:
• Each chassis fan module has a fault LED on top of the module. These fan LEDs operate only when the system is in standby power mode.
• The CPU module has internal fault LEDs for CPUs and DIMMs on the CPU module board. POST and runtime error detection routines are stored in on-board registers. The contents of the registers are preserved for a limited time by a supercap voltage source.
To operate the LEDs, press switch SW1 on the board after the CPU module is removed from the chassis.
• Green, blinking—12 V main power off; 12 V standby power on.
• Green, solid—12 V main power on; 12 V standby power on.
• Amber, blinking—Warning threshold detected but 12 V main power on.
• Amber, solid—Critical error detected; 12 V main power off (for example, over-current, over-voltage, or over-temperature failure).
Cisco UCS C480 M5 Server Installation and Service Guide
33
Page 36
Preparing For Component Installation
Figure 13: Internal Diagnostic LED Locations
Maintaining the Server
1
the board).
• Amber—CPU has a fault.
• Off—CPU is OK.
2
SW1 is labeled, " PRESS HERE TO SEE FAULTS".
3CPU fault LEDs (one behind each CPU socket on
-Switch SW1
Preparing For Component Installation
This section includes information and tasks that help prepare the server for component installation.
Required Equipment For Service Procedures
The following tools and equipment are used to perform the procedures in this chapter:
• T-30 Torx driver (supplied with replacement CPUs for heatsink removal)
DIMM fault LEDs (one next to each DIMM socket on the board)
• Amber—DIMM has a fault.
• Off—DIMM is OK.
Cisco UCS C480 M5 Server Installation and Service Guide
34
Page 37
Maintaining the Server
Shutting Down and Removing Power From the Server
• #1 flat-head screwdriver (supplied with replacement CPUs for heatsink removal)
• #1 Phillips-head screwdriver (for M.2 SSD replacement)
• Electrostatic discharge (ESD) strap or other grounding equipment such as a grounded mat
Shutting Down and Removing Power From the Server
The server can run in either of two power modes:
• Main power mode—Power is supplied to all server components and any operating system on your drives can run.
• Standby power mode—Power is supplied only to the service processor and certain components. It is safe for the operating system and data to remove power cords from the server in this mode.
Caution
After a server is shut down to standby power, electric current is still present in the server. To completely remove power, you must disconnect all power cords from the power supplies in the server, as directed in the service procedures.
You can shut down the server by using the front-panel power button or the software management interfaces.
Shutting Down Using the Power Button
Step 1 Check the color of the Power button/LED:
• Amber—The server is already in standby mode and you can safely remove power.
• Green—The server is in main power mode and must be shut down before you can safely remove power.
Step 2 Invoke either a graceful shutdown or a hard shutdown:
Caution
To avoid data loss or damage to your operating system, you should always invoke a graceful shutdown of the operating system.
• Graceful shutdown—Press and release the Power button. The operating system performs a graceful shutdown and the server goes to standby mode, which is indicated by an amber Power button/LED.
• Emergency shutdown—Press and hold the Power button for 4 seconds to force the main power off and immediately enter standby mode.
Step 3 If a service procedure instructs you to completely remove power from the server, disconnect all power cords from the
power supplies in the server.
Shutting Down Using The Cisco IMC GUI
You must log in with user or admin privileges to perform this task.
Cisco UCS C480 M5 Server Installation and Service Guide
35
Page 38
Maintaining the Server
Shutting Down Using The Cisco IMC CLI
Step 1 In the Navigation pane, click the Server tab.
Step 2 On the Server tab, click Summary.
Step 3 In the Actions area, click Power Off Server.
Step 4 Click OK.
The operating system performs a graceful shutdown and the server goes to standby mode, which is indicated by an amber Power button/LED.
Step 5 If a service procedure instructs you to completely remove power from the server, disconnect all power cords from the
power supplies in the server.
Shutting Down Using The Cisco IMC CLI
You must log in with user or admin privileges to perform this task.
Step 1 At the server prompt, enter:
Example:
server# scope chassis
Step 2 At the chassis prompt, enter:
Example:
server/chassis# power shutdown
The operating system performs a graceful shutdown and the server goes to standby mode, which is indicated by an amber Power button/LED.
Step 3 If a service procedure instructs you to completely remove power from the server, disconnect all power cords from the
power supplies in the server.
Shutting Down Using The Cisco UCS Manager Equipment Tab
You must log in with user or admin privileges to perform this task.
Step 1 In the Navigation pane, click Equipment.
Step 2 Expand Equipment > Rack Mounts > Servers.
Step 3 Choose the server that you want to shut down.
Step 4 In the Work pane, click the General tab.
Step 5 In the Actions area, click Shutdown Server.
Step 6 If a confirmation dialog displays, click Yes.
The operating system performs a graceful shutdown and the server goes to standby mode, which is indicated by an amber Power button/LED.
Cisco UCS C480 M5 Server Installation and Service Guide
36
Page 39
Maintaining the Server
Shutting Down Using The Cisco UCS Manager Service Profile
Step 7 If a service procedure instructs you to completely remove power from the server, disconnect all power cords from the
power supplies in the server.
Shutting Down Using The Cisco UCS Manager Service Profile
You must log in with user or admin privileges to perform this task.
Step 1 In the Navigation pane, click Servers.
Step 2 Expand Servers > Service Profiles.
Step 3 Expand the node for the organization that contains the service profile of the server that you are shutting down.
Step 4 Choose the service profile of the server that you are shutting down.
Step 5 In the Work pane, click the General tab.
Step 6 In the Actions area, click Shutdown Server.
Step 7 If a confirmation dialog displays, click Yes.
The operating system performs a graceful shutdown and the server goes to standby mode, which is indicated by an amber Power button/LED.
Step 8 If a service procedure instructs you to completely remove power from the server, disconnect all power cords from the
power supplies in the server.
Removing the Server Top Cover
Step 1 Remove the top cover:
a) If the cover latch is locked, use a screwdriver to turn the lock 90-degrees counterclockwise to unlock it. b) Lift on the end of the latch that has the green finger grip. The cover is pushed back to the open position as you lift
the latch.
c) Lift the top cover straight up from the server and set it aside.
Step 2 Replace the top cover:
a) With the latch in the fully open position, place the cover on top of the server about one-half inch (1.27 cm) behind
the lip of the front cover panel. The opening in the latch should fit over the peg that sticks up from the fan tray.
b) Press the cover latch down to the closed position. The cover is pushed forward to the closed position as you push
down the latch.
c) If desired, lock the latch by using a screwdriver to turn the lock 90-degrees clockwise.
Cisco UCS C480 M5 Server Installation and Service Guide
37
Page 40
Serial Number Location
Figure 14: Removing the Top Cover
Maintaining the Server
Locking cover latch2
Serial Number Location
The serial number for the server is printed on a label on the top of the server, near the front.
Hot Swap vs Hot Plug
Some components can be removed and replaced without shutting down and removing power from the server. This type of replacement has two varieties: hot-swap and hot-plug.
• Hot-swap replacement—You do not have to shut down the component in the software or operating system. This applies to the following components:
• SAS/SATA hard drives
• SAS/SATA solid state drives
• Cooling fan modules
• Power supplies (when redundant as 2+2 or 1+1)
Serial number location on label3Top cover1
Cisco UCS C480 M5 Server Installation and Service Guide
38
Page 41
Maintaining the Server
• Hot-plug replacement—You must take the component offline before removing it for the following component:
• NVMe PCIe solid state drives
Serviceable Component Locations
This topic shows the locations of the field-replaceable components and service-related items.
The Technical Specifications Sheets for all versions of this server, which include supported component part numbers, are at Cisco UCS Servers Technical Specifications Sheets (scroll down to Technical Specifications).
Serviceable Components Inside the Main Chassis, on page 40
Serviceable Components Inside a CPU Module, on page 43
Serviceable Components Inside an I/O Module, on page 44
Serviceable Component Locations
Cisco UCS C480 M5 Server Installation and Service Guide
39
Page 42
Serviceable Component Locations
Serviceable Components Inside the Main Chassis
Figure 15: Serviceable Component Locations Inside the Main Chassis
Maintaining the Server
Cisco UCS C480 M5 Server Installation and Service Guide
40
Page 43
Maintaining the Server
Serviceable Component Locations
1
11RAID controller card for front-loading drives.
(not visible in this view; position is near chassis floor under CPU modules)
2
PCIe slot 01: Primary slot for Cisco UCS VIC adapter card.
(Secondary slot for Cisco UCS VIC is slot 02.)
Power connectors for high-power GPU cards (six)12Supercap (RAID backup) for front RAID controller
(not visible in this view; mounting bracket position is on chassis wall under CPU modules)
3
13Fan modules (four modules with two fans each;
hot-swappable)
4
Trusted platform module socket (TPM) on motherboard
CPU modules (up to two, font-loading)14Air diffuser for auxiliary rear drive module
This diffuser is required only when using SAS/SATA drives in the rear drive module.
5
15Position of the supercap unit (RAID backup) for
the rear RAID controller.
The clip for the supercap is on the inside surface of the air diffuser.
Left bay module (drive bays 1 - 8)
• Bays 1, 2, 7, 8 support SAS/SATA or NVMe drives.
Front NVMe drives are not supported in a single-CPU module system.
• Bays 3, 4, 5, 6 support SAS/SATA drives only.
Note
An NVMe-only front drive module is available that supports up to 8 NVMe SSDs. You cannot mix this NVMe-only module with SAS/SATA modules or change module types in the field.
6
16Auxiliary rear drive module; holds either (no
mixing):
• Up to eight 2.5-inch SAS/SATA drives
• Up to eight 2.5-inch NVMe SSDs
Center bay module (drive bays 9 - 16)
• Bays 9, 10, 15, 16 support SAS/SATA or NVMe drives.
Front NVMe drives are not supported in a single-CPU module system.
• Bays 11, 12, 13, 14 support SAS/SATA drives only.
Cisco UCS C480 M5 Server Installation and Service Guide
41
Page 44
Serviceable Component Locations
Maintaining the Server
17Internal USB 2.0 socket on motherboard7
Right bay module, supports either:
• Drive bays 17 - 24 (shown)
• Bays 17, 18, 23, 24 support SAS/SATA
or NVMe drives.
Front NVMe drives are not supported in a single-CPU module system.
• Bays 19, 20, 21, 22 support SAS/SATA
drives only.
• Optional DVD drive module
8
18PCIe slots 1 – 12
For PCIe slot specifications, see PCIe Slot
Specifications and Restrictions, on page 89.
PCIe slot 12 is not available when the auxiliary internal drive cage is used because of internal clearance.
9
19PCIe slot 11: Default slot for rear RAID controller
whenthe rear drive module is used with SAS/SATA drives.
Note
In systems with only one CPU module,
I/O module
Note
The I/O module is not field replaceable, nor can you move an I/O module from one chassis to another. This module contains a security chip that requires it to stay with the PCIe module in the same chassis, as shipped from the factory.
Power supplies 1 – 4 (hot-swappable, redundant as 2+2 (default) or 3+1)
All power supplies in the system must be identical
(no mixing). slot 11 is not supported. In this case, the rear RAID controller must be installed in slot 10 and a blanking panel must be installed in slot 11.
10
-PCIe slot 10: Required slot for NVMe switch card
when the rear drive module is used with NVMe SSDs.
This slot must also be used for the rear RAID controller in systems with only one CPU module.
Cisco UCS C480 M5 Server Installation and Service Guide
42
Page 45
Maintaining the Server
Serviceable Components Inside a CPU Module
Figure 16: Serviceable Component Locations Inside a CPU Module
Serviceable Component Locations
1
4CPU number differs depending on the CPU module
location:
DIMM sockets controlled by CPU 1 or 3 (channels A, B, C, D, E, F.)
• CPU 2 and heatsink (when module is in lower bay 1)
• CPU 4 and heatsink (when module is in upper bay 2)
Note
The CPUs in CPU module 1 must be identical with the CPUs in CPU module 2 (no mixing).
2
Release levers for module (two each module)5DIMM sockets controlled by CPU 2 or 4 (channels
G, H, J, K, L, M.)
See DIMM Population Rules and Memory
Performance Guidelines, on page 108 for DIMM
slot numbering.
Cisco UCS C480 M5 Server Installation and Service Guide
43
Page 46
Replacing Components Inside the Main Chassis
Maintaining the Server
3
location:
• CPU 1 and heatsink (when module is in lower bay 1)
• CPU 3 and heatsink (when module is in upper bay 2)
Note
The CPUs in CPU module 1 must be identical with the CPUs in CPU module 2 (no mixing).
Serviceable Components Inside an I/O Module
Figure 17: Serviceable Component Locations Inside an I/O Module
-CPU number differs depending on the CPU module
RTC battery vertical socket3Micro SD card socket1
2
-Mini storage module connector
Supports either an SD card carrier with two SD card slots or an M.2 SSD carrier with two SATA M.2 SSD slots.
Replacing Components Inside the Main Chassis
Warning
Blank faceplates and cover panels serve three important functions: they prevent exposure to hazardous voltages and currents inside the chassis; they contain electromagnetic interference (EMI) that might disrupt other equipment; and they direct the flow of cooling air through the chassis. Do not operate the system unless all cards, faceplates, front covers, and rear covers are in place.
Statement 1029
Cisco UCS C480 M5 Server Installation and Service Guide
44
Page 47
Maintaining the Server
Replacing a CPU Module
Caution
When handling server components, handle them only by carrier edges and use an electrostatic discharge (ESD) wrist-strap or other grounding device to avoid damage.
Tip
You can press the unit identification button on the front panel or rear panel to turn on a flashing, blue unit identification LED on both the front and rear panels of the server. This button allows you to locate the specific server that you are servicing when you go to the opposite side of the rack. You can also activate these LEDs remotely by using the Cisco IMC interface.
This section describes how to install and replace main chassis components. See also:
Replacing Components Inside a CPU Module, on page 94
Replacing Components Inside an I/O Module, on page 111
Replacing a CPU Module
CPU Module Population Rules:
• The server can operate with one or two CPU modules.
• If you have only one CPU module, populate lower bay 1 first.
• If no CPU module is present in upper bay 2, you must insert a blank filler module or the system will not boot.
• The following restrictions apply when using only a two-CPU configuration (CPU module 2 is not present):
• The maximum number of DIMMs is 24 (only CPU 1 and CPU 2 memory channels).
• Some PCIe slots are unavailable when CPU module 2 is not present:
PCIe Slots Controlled by CPU Module 1
(CPUs 1 and 2)
PCIe Slots Controlled by CPU Module 2
(CPUs 3 and 4)
3, 4, 6, 7, 11, 121, 2, 5, 8, 9, 10
• Only four double-wide GPUs are supported, in PCIe slots 1, 2, 8, and 10.
• No front NVMe drives are supported.
• The optional NVMe-only drive bay module UCSC-C480-8NVME is not supported.
• If a rear RAID controller is used, it must be installed in PCIe slot 10 rather than the default slot 11. A blank filler must be installed in slot 11.
Cisco UCS C480 M5 Server Installation and Service Guide
45
Page 48
Replacing a CPU Module
Note
Maintaining the Server
Each CPU module has a fault LED on its front that turns amber to help to identify which CPU module has a fault.
Caution
Never remove a CPU module without shutting down and removing power from the server.
Step 1 Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server, on
page 35.
You do not have to pull the server out from the rack or remove the cover because the CPU modules are accessed from the front of the chassis.
Step 2 Remove an existing CPU module:
Note
Verify that the power LED on the front of the CPU module is off before removing the module.
a) Grasp the two ejector levers on the module and pinch their latches to release the levers. b) Rotate both levers to the outside at the same time to evenly disengage the module from the midplane connectors. c) Pull the module straight out from the chassis and then set it on an antistatic surface.
Figure 18: CPU Module Front
CPU module fault LED3Ejector levers (two each CPU module)1
-CPU module power status LED2
Step 3 If you are moving CPUs from the old CPU module to the new CPU module, see Moving an M5 Generation CPU, on
page 103.
Step 4 If you are moving DIMMs from the old CPU module to the new CPU module, perform the following steps:
a) Open the ejector lever at each end of the DIMM slot and pick the DIMM straight up from the old CPU module board. b) On the new CPU module board, align the new DIMM with an empty slot. Use the alignment feature in the DIMM
slot to correctly orient the DIMM.
c) Push down evenly on the top corners of the DIMM until it is fully seated and the ejector levers on both ends lock
into place.
Step 5 Install a new CPU module to the chassis:
a) With the two ejector levers open, align the new CPU module with an empty bay. b) Push the module into the bay until it engages with the midplane connectors and is flush with the chassis front. c) Rotate both ejector levers toward the center until they lay flat and their latches lock into the front of the module.
Cisco UCS C480 M5 Server Installation and Service Guide
46
Page 49
Maintaining the Server
Replacing Front-Loading SAS/SATA Drives
Step 6 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when
the front panel Power button LED lights amber).
Step 7 Fully power on the server by pressing the Power button.
Note
Verify that the power LED on the front of the CPU module returns to solid green.
Replacing Front-Loading SAS/SATA Drives
Note
Front-Loading SAS/SATA Drive Population Guidelines
You do not have to shut down the server or drive to replace SAS/SATA hard drives or SSDs because they are hot-swappable.
The front drives in the server are installed into three removable drive bay modules.
Figure 19: Drive Bay Numbering
• SAS/SATA/NVMe drive bay modules (UCSC-C480-8HDD):
• Left drive bay module: Bays 1, 2, 7, 8 support SAS/SATA or NVMe drives; bays 3, 4, 5, 6 support SAS/SATA drives only.
Note
• Center drive bay module: Bays 9, 10, 15, 16 support SAS/SATA or NVMe drives; bays 11, 12, 13, 14 support SAS/SATA drives only.
• Right bay module: Bays 17, 18, 23, 24 support SAS/SATA or NVMe drives; bays 19, 20, 21, 22 support SAS/SATA drives only.
Front NVMe drives are not supported in a system with only one CPU module.
Cisco UCS C480 M5 Server Installation and Service Guide
47
Page 50
4K Sector Format SAS/SATA Drives Considerations
Observe these drive population guidelines for optimum performance:
• When populating drives, add drives to the lowest-numbered bays first.
• Keep an empty drive blanking tray in any unused bays to ensure proper airflow.
• You can mix SAS/SATA hard drives and SAS/SATA SSDs in the same server. However, you cannot configure a logical volume (virtual drive) that contains a mix of hard drives and SSDs. That is, when you create a logical volume, it must contain all SAS/SATA hard drives or all SAS/SATA SSDs.
4K Sector Format SAS/SATA Drives Considerations
• You must boot 4K sector format drives in UEFI mode, not legacy mode. See the procedures in this section.
• Do not configure 4K sector format and 512-byte sector format drives as part of the same RAID volume.
• Operating system support on 4K sector drives is as follows: Windows: Win2012 and Win2012R2; Linux: RHEL 6.5, 6.6, 6.7, 7.0, 7.2; SLES 11 SP3, and SLES 12. ESXi/Vmware is not supported.
Maintaining the Server
Procedure
PurposeCommand or Action
Step 1
Setting Up UEFI Mode Booting in the BIOS Setup Utility
Step 1 Enter the BIOS setup utility by pressing the F2 key when prompted during bootup.
Step 2 Go to the Boot Options tab.
Step 3 Set UEFI Boot Options to Enabled.
Step 4 Under Boot Option Priorities, set your OS installation media (such as a virtual DVD) as your Boot Option #1.
Step 5 Go to the Advanced tab.
Step 6 Select LOM and PCIe Slot Configuration.
Step 7 Set the PCIe Slot ID: HBA Option ROM to UEFI Only.
Step 8 Press F10 to save changes and exit the BIOS setup utility. Allow the server to reboot.
Step 9 After the OS installs, verify the installation:
a) Enter the BIOS setup utility by pressing the F2 key when prompted during bootup. b) Go to the Boot Options tab. c) Under Boot Option Priorities, verify that the OS you installed is listed as your Boot Option #1.
Setting Up UEFI Mode Booting in the Cisco IMC GUI
Step 1 Use a web browser and the IP address of the server to log into the Cisco IMC GUI management interface.
Step 2 Navigate to Server > BIOS.
Step 3 Under Actions, click Configure BIOS.
Cisco UCS C480 M5 Server Installation and Service Guide
48
Page 51
Maintaining the Server
Replacing a Front-Loading SAS/SATA Drive
Step 4 In the Configure BIOS Parameters dialog, select the Advanced tab.
Step 5 Go to the LOM and PCIe Slot Configuration section.
Step 6 Set the PCIe Slot: HBA Option ROM to UEFI Only.
Step 7 Click Save Changes. The dialog closes.
Step 8 Under BIOS Properties, set Configured Boot Order to UEFI.
Step 9 Under Actions, click Configure Boot Order.
Step 10 In the Configure Boot Order dialog, click Add Local HDD.
Step 11 In the Add Local HDD dialog, enter the information for the 4K sector format drive and make it first in the boot order.
Step 12 Save changes and reboot the server. The changes you made will be visible after the system reboots.
Replacing a Front-Loading SAS/SATA Drive
Note
You do not have to shut down the server or drive to replace SAS/SATA hard drives or SSDs because they are hot-swappable.
Step 1 Remove the drive that you are replacing or remove a blank drive tray from the bay:
a) Press the release button on the face of the drive tray. b) Grasp and open the ejector lever and then pull the drive tray out of the slot. c) If you are replacing an existing drive, remove the four drive-tray screws that secure the drive to the tray and then lift
the drive out of the tray.
Step 2 Install a new drive:
a) Place a new drive in the empty drive tray and install the four drive-tray screws.
Note
When you insert the drive tray in the slot, the LEDs on the drive tray must be on the upper side. The ejector lever closes upward.
b) With the ejector lever on the drive tray open, insert the drive tray into the empty drive bay. c) Push the tray into the slot until it touches the backplane, and then close the ejector lever to lock the drive in place.
Cisco UCS C480 M5 Server Installation and Service Guide
49
Page 52
Replacing Rear (Internal) SAS/SATA Drives
Figure 20: Replacing a Drive in a Drive Tray
Maintaining the Server
Replacing Rear (Internal) SAS/SATA Drives
Note
You do not have to shut down the server or drive to replace SAS/SATA hard drives or SSDs because they are hot-swappable.
Rear SAS/SATA Drive Population Guidelines
The server supports an internal, rear drive module that holds up to eight 2.5-inch drives.
Cisco UCS C480 M5 Server Installation and Service Guide
50
Drive tray screws (two on each side)3Ejector lever1
Drive removed from drive tray4Release button2
Page 53
Maintaining the Server
Rear SAS/SATA Drive Requirements
• When using SAS/SATA drives, the eight drives must be all SAS/SATA; no mixing with NVMe drives is allowed.
• When populating drives, add drives to the lowest-numbered bays first.
• Keep an empty drive blanking tray in any unused bays to ensure proper airflow.
• You can mix SAS/SATA hard drives and SAS/SATA SSDs in the cage. However, you cannot configure a logical volume (virtual drive) that contains a mix of hard drives and SSDs. That is, when you create a logical volume, it must contain all SAS/SATA hard drives or all SAS/SATA SSDs.
Note
See also 4K Sector Format SAS/SATA Drives Considerations, on page 48.
Figure 21: Internal Drive Module Bays (Top View)
Rear SAS/SATA Drive Requirements
Observe these requirements:
• The optional, rear drive module (UCSC-C480-8HDD).
• The rear drive module requires minimum Cisco IMC and BIOS 3.1(3) or later.
• The rear drive-bay module must have air-diffuser UCSC-DIFF-C480M5 installed when SAS/SATA drives are installed.
Cisco UCS C480 M5 Server Installation and Service Guide
51
Page 54
Replacing a Rear (Internal) SAS/SATA Drive
• For RAID support: RAID controller card (UCSC-SAS9460-8i) installed in PCIe slot 11.
Note
In a system with only one CPU module, this RAID controller must be installed in PCIe slot 10 and a blank filler is required in slot 11 to ensure adequate air flow.
• For RAID support: RAID cable (CBL-AUX-SAS-M5). This cable connects the rear RAID card to the drive-bay module.
• For RAID support: Supercap RAID backup unit (UCSC-SCAP-M5). This unit installs to a clip on the inside of the air diffuser. It cables to the rear RAID controller.
Replacing a Rear (Internal) SAS/SATA Drive
Note
You do not have to shut down the server or drive to replace SAS/SATA hard drives or SSDs because they are hot-swappable.
Maintaining the Server
Step 1 Prepare the server for component installation:
a) Slide the server out the front of the rack far enough so that you can remove the top cover.
Caution
If you cannot safely view and access the component, remove the server from the rack.
b) Remove the top cover from the server as described in Removing the Server Top Cover, on page 37.
Step 2 Remove the drive that you are replacing or remove a blank drive tray from the bay:
a) Press the release button on the face of the drive tray. b) Grasp and open the ejector lever and then pull the drive tray up out of the bay. c) If you are replacing an existing drive, remove the four drive-tray screws that secure the drive to the tray and then lift
the drive out of the tray.
Step 3 Install a new drive:
a) Place a new drive in the empty drive tray and install the four drive-tray screws. b) With the ejector lever on the drive tray open, insert the drive tray into the empty drive bay. c) Push the tray into the slot until it touches the backplane, and then close the ejector lever to lock the drive in place.
Step 4 Replace the top cover to the server.
Step 5 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when
the front panel Power button LED lights amber).
Step 6 Fully power on the server by pressing the Power button.
Cisco UCS C480 M5 Server Installation and Service Guide
52
Page 55
Maintaining the Server
Figure 22: Replacing a Drive in a Drive Tray
Replacing Front-Loading NVMe SSDs
Replacing Front-Loading NVMe SSDs
Note
Note
OS-informed hot-insertion and hot-removal must be enabled in the system BIOS. See Enabling Hot-Plug
Support in the System BIOS, on page 55.
OS-surprise removal is not supported. OS-informed hot-insertion and hot-removal are supported on all supported operating systems except VMware ESXi.
Drive tray screws (two on each side)3Ejector lever1
Drive removed from drive tray4Release button2
Cisco UCS C480 M5 Server Installation and Service Guide
53
Page 56
Front-Loading NVMe SSD Population Guidelines
This section is for replacing 2.5-inch form-factor NVMe solid-state drives (SSDs) in front-panel drive bays.
Front-Loading NVMe SSD Population Guidelines
The front drive bay support for 2.5-inch NVMe SSDs differs, depending on what type of drive bay module is installed (NVMe-only or SAS/SATA/NVMe), and the number of CPU modules in the system:
Figure 23: Drive Bay Numbering
Maintaining the Server
Note
Front NVMe drives are not supported in a single CPU-module system. Front NVMe support requires two CPU modules in the system.
There are two types of front drive bay modules that support NVMe drives:
Note
You cannot mix front drive module types in the same system.
UCSC-C480-8HDD: SAS/SATA/NVMe drive bay modules that support up to four NVMe drives each:
• Left drive-bay module: Bays 1, 2, 7, 8 support SAS/SATA or NVMe drives; bays 3, 4, 5, 6 support SAS/SATA drives only.
Front NVMe drives are not supported in a single-CPU module system.
• Center drive-bay module: Bays 9, 10, 15, 16 support SAS/SATA or NVMe drives; bays 11, 12, 13, 14 support SAS/SATA drives only.
Front NVMe drives are not supported in a single-CPU module system.
• Right drive-bay module: Bays 17, 18, 23, 24 support SAS/SATA or NVMe drives; bays 19, 20, 21, 22 support SAS/SATA drives only.
Front NVMe drives are not supported in a single-CPU module system.
UCSC-C480-8NVME: NVMe-only drive bay modules. All eight bays support only NVMe drives.
Cisco UCS C480 M5 Server Installation and Service Guide
54
Page 57
Maintaining the Server
In a single CPU-module system, this NVMe-only module is not supported.
Observe these drive population guidelines for optimum performance:
• When populating drives, add drives to the lowest-numbered bays first.
• Keep an empty blanking tray in any unused bays to ensure proper airflow.
Front-Loading NVME SSD Requirements and Restrictions
Observe these requirements:
• Hot-plug support must be enabled in the system BIOS. If you ordered the system with NVMe drives, hot-plug support is enabled at the factory. See Enabling Hot-Plug Support in the System BIOS, on page
55.
Observe these restrictions:
• NVMe 2.5-inch SSDs support booting only in UEFI mode. Legacy boot is not supported. For instructions on setting up UEFI boot, see Setting Up UEFI Mode Booting in the BIOS Setup Utility, on page 48 or
Setting Up UEFI Mode Booting in the Cisco IMC GUI, on page 48.
Front-Loading NVME SSD Requirements and Restrictions
• You cannot control NVMe PCIe SSDs with a SAS RAID controller because NVMe SSDs interface with the server via the PCIe bus.
• You can combine NVMe 2.5-inch SSDs and HHHL form-factor SSDs in the same system, but the same partner brand must be used. For example, two Intel NVMe SFF 2.5-inch SSDs and two HGST HHHL form-factor SSDs is an invalid configuration. A valid configuration is two HGST NVMe SFF 2.5-inch SSDs and two HGST HHHL form-factor SSDs.
• UEFI boot is supported in all supported operating systems. Hot-insertion and hot-removal are supported in all supported operating systems except VMWare ESXi.
Enabling Hot-Plug Support in the System BIOS
Hot-plug (OS-informed hot-insertion and hot-removal) is disabled in the system BIOS by default.
• If the system was ordered with NVMe PCIe SSDs, the setting was enabled at the factory. No action is required.
• If you are adding NVMe PCIe SSDs after-factory, you must enable hot-plug support in the BIOS. See the following procedures.
Procedure
Step 1
PurposeCommand or Action
Enabling Hot-Plug Support Using the BIOS Setup Utility
Step 1 Enter the BIOS setup utility by pressing the F2 key when prompted during bootup.
Step 2 Navigate to Advanced > PCI Subsystem Settings > NVMe SSD Hot-Plug Support.
Cisco UCS C480 M5 Server Installation and Service Guide
55
Page 58
Enabling Hot-Plug Support Using the Cisco IMC GUI
Step 3 Set the value to Enabled.
Step 4 Save your changes and exit the utility.
Enabling Hot-Plug Support Using the Cisco IMC GUI
Step 1 Use a browser to log in to the Cisco IMC GUI for the server.
Step 2 Navigate to Compute > BIOS > Advanced > PCI Configuration.
Step 3 Set NVME SSD Hot-Plug Support to Enabled.
Step 4 Save your changes.
Replacing a Front-Loading NVMe SSD
This topic describes how to replace 2.5-inch form-factor NVMe SSDs in the front-panel drive bays.
Maintaining the Server
Note
OS-surprise removal is not supported. OS-informed hot-insertion and hot-removal are supported on all supported operating systems except VMware ESXi.
Note
OS-informed hot-insertion and hot-removal must be enabled in the system BIOS. See Enabling Hot-Plug
Support in the System BIOS, on page 55.
Step 1 Remove an existing front-loading NVMe SSD:
a) Shut down the NVMe SSD to initiate an OS-informed removal. Use your operating system interface to shut down
the drive, and then observe the drive-tray LED:
• Green—The drive is in use and functioning properly. Do not remove.
• Green, blinking—the driver is unloading following a shutdown command. Do not remove.
• Off—The drive is not in use and can be safely removed.
b) Press the release button on the face of the drive tray. c) Grasp and open the ejector lever and then pull the drive tray out of the slot. d) Remove the four drive tray screws that secure the SSD to the tray and then lift the SSD out of the tray.
Step 2 Install a new front-loading NVMe SSD:
a) Place a new SSD in the empty drive tray and install the four drive-tray screws.
Note
When you insert the drive tray in the slot, the LEDs on the drive tray must be on the upper side. The ejector lever closes upward.
b) With the ejector lever on the drive tray open, insert the drive tray into the empty drive bay. c) Push the tray into the slot until it touches the backplane, and then close the ejector lever to lock the drive in place.
Cisco UCS C480 M5 Server Installation and Service Guide
56
Page 59
Maintaining the Server
Replacing a Front-Loading NVMe SSD
Step 3 Observe the drive-tray LED and wait until it returns to solid green before accessing the drive:
• Off—The drive is not in use.
• Green, blinking—the driver is initializing following hot-plug insertion.
• Green—The drive is in use and functioning properly.
Figure 24: Replacing a Drive in a Drive Tray
Drive tray screws (two on each side)3Ejector lever1
Drive removed from drive tray4Release button2
Cisco UCS C480 M5 Server Installation and Service Guide
57
Page 60
Replacing Rear NVMe SSDs
Replacing Rear NVMe SSDs
Note
OS-surprise removal is not supported. OS-informed hot-insertion and hot-removal are supported on all supported operating systems except VMware ESXi.
Note
OS-informed hot-insertion and hot-removal must be enabled in the system BIOS. See Enabling Hot-Plug
Support in the System BIOS, on page 55.
This section is for replacing 2.5-inch form-factor NVMe solid-state drives (SSDs) in the internal, rear drive-bay module.
Rear NVMe SSD Population Guidelines
The server supports an rear, internal drive-bay module that holds up to eight 2.5-inch drives.
Maintaining the Server
• When using NVMe drives, the eight drives must be all NVMe; no mixing with SAS/SATA drives is allowed.
• When populating drives, add drives to the lowest-numbered bays first.
• Keep an empty drive blanking tray in any unused bays to ensure proper airflow.
Figure 25: Internal Drive Module Bays (Top View)
Cisco UCS C480 M5 Server Installation and Service Guide
58
Page 61
Maintaining the Server
Rear NVMe SSD Requirements and Restrictions
Observe these requirements:
• The optional, rear drive-bay module. When using NVMe drives, the eight drives must be all NVMe; no mixing with SAS/SATA drives is allowed.
• NVMe switch card (UCSC-NVME-SC). This card must be installed in PCIe slot 10.
• NVMe cable (CBL-AUX-NVME-M5). This cable connects the NVMe switch card to the module backplane.
• Hot-plug support must be enabled in the system BIOS. If you ordered the system with NVMe drives, hot-plug support is enabled at the factory.
Observe these restrictions:
• NVMe SSDs support booting only in UEFI mode. Legacy boot is not supported. For instructions on setting up UEFI boot, see Setting Up UEFI Mode Booting in the BIOS Setup Utility, on page 48 or
Setting Up UEFI Mode Booting in the Cisco IMC GUI, on page 48.
• You cannot control NVMe PCIe SSDs with a SAS RAID controller because NVMe SSDs interface with the server via the PCIe bus.
Rear NVMe SSD Requirements and Restrictions
• You can combine NVMe 2.5-inch SSDs and HHHL form-factor SSDs in the same system, but the same partner brand must be used. For example, two Intel NVMe SFF 2.5-inch SSDs and two HGST HHHL form-factor SSDs is an invalid configuration. A valid configuration is two HGST NVMe SFF 2.5-inch SSDs and two HGST HHHL form-factor SSDs.
• UEFI boot is supported in all supported operating systems. Hot-insertion and hot-removal are supported in all supported operating systems except VMWare ESXi.
Replacing a Rear (Internal) NVMe Drive
This topic describes how to replace 2.5-inch form-factor NVMe SSDs in the internal drive bays. You do not have to shut down the server, but you must shut down the NVMe drive before removal to avoid data loss.
Note
Note
OS-surprise removal is not supported. OS-informed hot-insertion and hot-removal are supported on all supported operating systems except VMware ESXi.
OS-informed hot-insertion and hot-removal must be enabled in the system BIOS. See Enabling Hot-Plug
Support in the System BIOS, on page 55.
Step 1 Prepare the server for component installation:
a) Slide the server out the front of the rack far enough so that you can remove the top cover.
Caution
If you cannot safely view and access the component, remove the server from the rack.
b) Remove the top cover from the server as described in Removing the Server Top Cover, on page 37.
Cisco UCS C480 M5 Server Installation and Service Guide
59
Page 62
Replacing a Rear (Internal) NVMe Drive
Step 2 Remove the drive that you are replacing or remove a blank drive tray from the bay:
a) Shut down the NVMe SSD to initiate an OS-informed removal. Use your operating system interface to shut down
the drive, and then observe the drive-tray LED:
• Green—The drive is in use and functioning properly. Do not remove.
• Green, blinking—the driver is unloading following a shutdown command. Do not remove.
• Off—The drive is not in use and can be safely removed.
b) Press the release button on the face of the drive tray. c) Grasp and open the ejector lever and then pull the drive tray up out of the bay. d) If you are replacing an existing drive, remove the four drive-tray screws that secure the drive to the tray and then lift
the drive out of the tray.
Step 3 Install a new drive:
a) Place a new drive in the empty drive tray and install the four drive-tray screws. b) With the ejector lever on the drive tray open, insert the drive tray into the empty drive bay. c) Push the tray into the slot until it touches the backplane, and then close the ejector lever to lock the drive in place.
Maintaining the Server
Step 4 Observe the drive-tray LED and wait until it returns to solid green before accessing the drive:
• Off—The drive is not in use.
• Green, blinking—the driver is initializing following hot-plug insertion.
• Green—The drive is in use and functioning properly.
Step 5 Replace the top cover to the server.
Step 6 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when
the front panel Power button LED lights amber).
Step 7 Fully power on the server by pressing the Power button.
Cisco UCS C480 M5 Server Installation and Service Guide
60
Page 63
Maintaining the Server
Figure 26: Replacing a Drive in a Drive Tray
Replacing HHHL Form-Factor NVMe Solid State Drives
Drive tray screws (two on each side)3Ejector lever1
Drive removed from drive tray4Release button2
Replacing HHHL Form-Factor NVMe Solid State Drives
This section is for replacing half-height, half-length (HHHL) form-factor NVMe SSDs in the PCIe slots.
HHHL SSD Population Guidelines
Observe the following population guidelines when installing HHHL form-factor NVMe SSDs:
• Dual CPU-Module systems—You can populate up to 12 HHHL form-factor SSDs, using PCIe slots 1 –
12.
Cisco UCS C480 M5 Server Installation and Service Guide
61
Page 64
HHHL Form-Factor NVME SSD Restrictions
Note
• Single CPU-Module systems—In a single CPU-module system (CPU module 2 is not present), PCIe slots 3, 4, 6, 7, 11, and 12 are not available. Therefore, the maximum number of HHHL form-factor SSDs you can populate is 6, using only PCIe slots 1, 2, 5, 8, 9, and 10.
Maintaining the Server
Other installed components affect how many PCIe slots are open to use. For example:
• If the auxiliary, internal drive module is installed, PCIe slot 12 is not available because of internal clearance.
• If the server has a rear RAID controller card, it must be installed in PCIe slot 11 (or slot 10 in single CPU-module systems).
• If the server has a rear NVMe switch card, it must be installed in PCIe slot
10.
PCIe Slots SupportedNumber of CPU Modules
HHHL Form-Factor NVME SSD Restrictions
Observe these restrictions:
• You cannot boot from an HHHL form-factor NVMe SSD.
• You cannot control HHHL NVMe SSDs with a SAS RAID controller because NVMe SSDs interface with the server via the PCIe bus.
• You can combine NVMe SFF 2.5- or 3.5-inch SSDs and HHHL form-factor SSDs in the same system, but the same partner brand must be used. For example, two Intel NVMe SFF 2.5-inch SSDs and two HGST HHHL form-factor SSDs is an invalid configuration. A valid configuration is two HGST NVMe SFF 2.5-inch SSDs and two HGST HHHL form-factor SSDs.
Replacing HHHL NVMe Drives
Step 1 Prepare the server for component installation:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 35.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
1 - 12 (all)Dual CPU-Module System (4 CPUs)
1, 2, 5, 8, 9, 10Single CPU-Module System (2 CPUs)
Caution
If you cannot safely view and access the component, remove the server from the rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 37.
Step 2 Remove any existing HHHL drive from the slot (or a blanking panel):
a) Open the hinged retainer bar that covers the top of the PCIe slot from which you are removing the HHHL drive.
Cisco UCS C480 M5 Server Installation and Service Guide
62
Page 65
Maintaining the Server
Replacing a Front Drive Bay Module
Use your fingertips to pull back on the wire locking-latches at each end of the retainer bar, and then hinge the bar open to expose the tops of the PCIe slots.
b) Pull both ends of the HHHL drive's card vertically to disengage the card from the socket, and then set it aside.
Step 3 Install a new HHHL drive:
a) Carefully align the HHHL drive's card edge with the PCIe socket. b) Push on both corners of the card to seat its connector in the socket. c) Close the hinged retainer bar over the top of the PCIe slots.
Use your fingertips to pull back on the wire locking-latches at each end of the retainer bar, and then hinge it closed to lock in the tops of the PCIe slots. Push the wire locking-latching back to the forward, locked position.
Step 4 Replace the top cover to the server.
Step 5 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when
the front panel Power button LED lights amber).
Step 6 Fully power on the server by pressing the Power button.
Figure 27: PCIe Slot Hinged Retainer Bars
1
(slots 10 - 12)
Replacing a Front Drive Bay Module
The front drive bays are divided across three removable drive bay modules that have eight bays each. There are two types of drive bay modules:
• SAS/SATA and NVMe (UCSC-C480-8HDD)
2Wire locking latches for left PCIe retainer bar
Wire locking latches for right PCIe retainer bar (slots 1 - 9)
Cisco UCS C480 M5 Server Installation and Service Guide
63
Page 66
Maintaining the Server
Replacing a Front Drive Bay Module
• NVMe only (UCSC-C480-8NVME)
Note
Mixing these two module types in the same chassis is not supported.
Step 1 Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 35.
Step 2 Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the rack.
Step 3 Remove the top cover from the server as described in Removing the Server Top Cover, on page 37.
Step 4 Remove all CPU modules from the chassis to provide clearance:
a) Grasp the two ejector levers on the module and pinch their latches to release the levers. b) Rotate both levers to the outside at the same time to evenly disengage the module from the midplane connectors. c) Pull the module straight out from the chassis and then set it on an antistatic surface.
Step 5 Remove an existing drive bay module:
a) Remove any drives from the existing module and set them aside. b) From the top of the chassis, loosen the single captive screw that secures the module to the chassis brace. c) Disconnect any SAS cables from the rear of the module. d) Push the module out the front of the chassis. e) Pull the module and its attached interposer board out the front of the chassis and then set it aside.
Step 6 Install a new drive module:
a) Insert the new module with attached interposer into the opening in the chassis front. b) Gently slide the module into the opening, ensuring that the connector on the end of the interposer board engages
with the socket on the chassis midplane. Press until the front edges of the module align evenly with the chassis.
c) Tighten the single captive screw that secures the module to the chassis brace.
Step 7 Connect any SAS cables that you disconnected earlier to the new drive module.
Step 8 Install your drives to the bays in the module.
Step 9 Reinstall the CPU modules to the chassis:
a) With the two ejector levers open, align the new CPU module with an empty bay. b) Push the module into the bay until it engages with the midplane connectors and is flush with the chassis front. c) Rotate both ejector levers toward the center until they lay flat and their latches lock into the front of the module.
Step 10 Replace the top cover to the server.
Step 11 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when
the front panel Power button LED lights amber).
Step 12 Fully power on the server by pressing the Power button.
Cisco UCS C480 M5 Server Installation and Service Guide
64
Page 67
Maintaining the Server
Figure 28: Front Drive-Bay Module Securing Screws (CPU Modules Removed)
Replacing a Front Drive Bay Module
Cisco UCS C480 M5 Server Installation and Service Guide
65
Page 68
Replacing a Front RAID Controller Card
Maintaining the Server
1
shown with both CPU modules removed)
Chassis brace2
Replacing a Front RAID Controller Card
For detailed information about storage controllers in this server, see Supported Storage Controllers and Cables,
on page 133.
The server supports one front RAID controller card for control of up to 24 front-loading SAS/SATA drives. The card installs to a dedicated, horizontal socket on the chassis midplane. The socket is below the CPU modules and can be accessed from the top of the server after the CPU modules are removed.
Firmware on the storage controller must be verified for compatibility with the current Cisco IMC and BIOS versions that are installed on the server. If not compatible, upgrade or downgrade the storage controller firmware using the Host Upgrade Utility (HUU) for your firmware release to bring it to a compatible level.
See the HUU guide for your Cisco IMC release for instructions on downloading and using the utility to bring server components to compatible levels: HUU Guides.
Step 1 Prepare the server for component installation:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 35.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
3Front of server (view of front compartment
Thumbscrews that secure drive bay modules (one each module)
Caution
If you cannot safely view and access the component, remove the server from the rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 37.
Step 2 Remove all CPU modules from the chassis to provide clearance:
a) Grasp the two ejector levers on the module and pinch their latches to release the levers. b) Rotate both levers to the outside at the same time to evenly disengage the module from the midplane connectors. c) Pull the module straight out from the chassis and then set it on an antistatic surface.
Step 3 Remove any existing front RAID controller card from the server:
a) Disconnect any SAS and supercap cables from the existing card. b) Remove the metal retainer plate that secures the front edge of the RAID card. Loosen its two captive screws and then
lift the plate out of the chassis and set it aside. c) Open the card's ejector lever to unseat it from the horizontal socket on the midplane. d) Pull both ends of the card horizontally to disengage the card from the socket, and then set it aside.
Step 4 Install a new front RAID controller card:
a) Carefully align the card edge with the dedicated horizontal socket on the midplane. b) Push on both corners of the card to seat its connector in the socket. c) Fully close the ejector lever on the card to lock the card into the socket. d) Reinstall the metal retainer plate. Align it over the two threaded standoffs, and then tighten both captive screws. e) Reconnect any SAS and supercap cables to the new card.
Cisco UCS C480 M5 Server Installation and Service Guide
66
Page 69
Maintaining the Server
Replacing a Front RAID Controller Card
Card connectors A1-A2 connect to SAS drive bay 1; card connectors B1-B2 connect to SAS drive bay 2; card connectors C1-C2 connect to SAS drive bay 3.
Step 5 Reinstall the CPU modules to the chassis:
a) With the two ejector levers open, align the new CPU module with an empty bay. b) Push the module into the bay until it engages with the midplane connectors and is flush with the chassis front. c) Rotate both ejector levers toward the center until they lay flat and their latches lock into the front of the module.
Step 6 Replace the top cover to the server.
Step 7 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when
the front panel Power button LED lights amber).
Step 8 Fully power on the server by pressing the Power button.
Step 9 If your server is running in standalone mode, use the Cisco UCS Host Upgrade Utility to update the controller firmware
and program the correct suboem-id for the controller.
Note
For servers running in standalone mode only: After you replace front controller hardware (UCSC-RAID-M5HD), you must run the Cisco UCS Host Upgrade Utility (HUU) to update the controller firmware, even if the firmware Current Version is the same as the Update Version. This is necessary to program the controller's suboem-id to the correct value for the server SKU. If you do not do this, drive enumeration might not display correctly in the software. This issue does not affect servers controlled in UCSM mode.
See the HUU guide for your Cisco IMC release for instructions on downloading and using the utility to bring server components to compatible levels: HUU Guides.
Cisco UCS C480 M5 Server Installation and Service Guide
67
Page 70
Replacing the Front RAID Supercap Unit
Figure 29: Front RAID Controller Card Location (CPU Modules removed)
Maintaining the Server
1
horizontal socket (view of the front compartment shown with the CPU modules removed)
Metal retainer plate securing screws2
Replacing the Front RAID Supercap Unit
This server supports installation of up to two supercap units, one for a front RAID controller and one for a rear RAID controller. The front supercap unit mounts to a bracket on the inner chassis wall, below the CPU modules.
Cisco UCS C480 M5 Server Installation and Service Guide
68
Card ejector lever (magnified view)3Location of front RAID card in dedicated
Page 71
Maintaining the Server
Replacing the Front RAID Supercap Unit
The supercap provides approximately three years of backup for the disk write-back cache DRAM in the case of a sudden power loss by offloading the cache to the NAND flash.
Warning
There is danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer’s instructions.
Statement 1015
Step 1 Prepare the server for component installation:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 35.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 37.
Step 2 Remove all CPU modules from the chassis to provide clearance:
a) Grasp the two ejector levers on the module and pinch their latches to release the levers. b) Rotate both levers to the outside at the same time to evenly disengage the module from the midplane connectors. c) Pull the module straight out from the chassis and then set it on an antistatic surface.
Step 3 Remove an existing supercap unit:
a) Disconnect the supercap cable from the existing supercap. b) Lift gently on the top securing tab that holds the supercap unit to its bracket. c) Lift the supercap unit free of the bracket and set it aside.
Step 4 Install a new supercap unit:
a) Lift gently on the top securing tab on the bracket while you set the supercap unit into the bracket. Relax the tab so
that it closes over the top of the supercap.
b) Connect the supercap cable from the RAID controller card to the connector on the new supercap cable.
Step 5 Reinstall the CPU modules to the chassis:
a) With the two ejector levers open, align the new CPU module with an empty bay. b) Push the module into the bay until it engages with the midplane connectors and is flush with the chassis front. c) Rotate both ejector levers toward the center until they lay flat and their latches lock into the front of the module.
Step 6 Replace the top cover to the server.
Step 7 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when
the front panel Power button LED lights amber).
Step 8 Fully power on the server by pressing the Power button.
Cisco UCS C480 M5 Server Installation and Service Guide
69
Page 72
Replacing the Front RAID Supercap Unit
Figure 30: Front Supercap Bracket Location (Below CPU Modules)
Maintaining the Server
Cisco UCS C480 M5 Server Installation and Service Guide
70
Page 73
Maintaining the Server
Replacing the Front RAID Supercap Unit
Cisco UCS C480 M5 Server Installation and Service Guide
71
Page 74
Replacing a Rear (Internal) Drive-Bay Module
Maintaining the Server
1
-Supercap bracket location on inner chassis
wall (view of the front compartment shown is with the CPU modules removed)
Replacing a Rear (Internal) Drive-Bay Module
The optional, rear drive-bay module provides eight drive bays.
Note
When the rear drive-bay module is used, PCIe slot 12 is not available because there is not enough clearance.
Note
When the rear drive-bay module is populated with SAS/SATA drives, the air diffuser must be installed.
Step 1 Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server, on
page 35.
Step 2 Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the rack.
Step 3 Remove the top cover from the server as described in Removing the Server Top Cover, on page 37.
Step 4 Remove any existing rear drive-bay module:
a) Remove any drives from the existing rear drive-bay module and set them aside. b) If the air diffuser is present on the module, remove the diffuser. Lift straight up on the diffuser and set it aside.
It is not necessary to remove the rear supercap unit from the diffuser.
c) Disconnect any cable from a RAID controller or NVMe switch card from the module connectors. d) Loosen the two screws that secure the module to the chassis. e) Grasp the module at each end and lift up evenly to disengage its connector from the socket on the motherboard.
Step 5 Install a new rear drive-bay module:
a) While holding the new module level, align it over the socket on the motherboard and the two screw-holes. b) Gently press the module connector to the motherboard socket. Stop when the module frame sits flat over the
screw-holes. c) Install the two screws that secure the module to the chassis. d) Connect any cable from a RAID card or NVMe switch card to the new module backplane. e) Reinstall the air diffuser to the module if you removed one earlier (required only if the module is populated with
SAS/SATA drives).
Note
In a system with only one CPU module, an additional filler panel is required in PCIe slot 11 to ensure adequate air flow. See Replacing a Rear RAID Controller Card, on page 77 for more information.
f) Install your drives to the bays in the new module.
Cisco UCS C480 M5 Server Installation and Service Guide
72
Page 75
Maintaining the Server
Replacing an Air Diffuser on the Rear Drive Module
Step 6 Replace the top cover to the server.
Step 7 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when
the front panel Power button LED lights amber).
Step 8 Fully power on the server by pressing the Power button.
Figure 31: Internal Rear Drive Module
1
Alignment flange on chassis floor4Air diffuser top view
This diffuser is required when SAS/SATA drivs are installed in the rear drive module.
2
Two drive module securing screws5Diffuser alignment points against the chassis
mid-brace
3
-Rear RAID supercap unit location on the
inside surface of the diffuser
Replacing an Air Diffuser on the Rear Drive Module
The air diffuser UCSC-BAFF-C480-M5 must be installed on the rear drive module when SAS/SATA hard drives or solid state drives are installed. The diffuser includes a clip for the rear supercap unit on its inside surface.
Cisco UCS C480 M5 Server Installation and Service Guide
73
Page 76
Replacing an Air Diffuser on the Rear Drive Module
Step 1 Prepare the server for component installation:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 35.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Maintaining the Server
Caution
If you cannot safely view and access the component, remove the server from the rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 37.
Step 2 Remove the air diffuser:
a) Grasp the two top edges of the diffuser and lift straight up to free it from the grooves on the chassis mid-brace. b) If there is a supercap unit present in the clip on the inside of the diffuser, gently pry the supercap from its clip and
set it aside. Do not disconnect the supercap cable.
Step 3 Install the new air diffuser:
a) Set the supercap unit into the clip on the inside of the air diffuser and push gently until it clicks in place and is secured. b) Position SAS and supercap cables so that they do not interfere with the diffuser installation. Cables must route out
the rear of the diffuser. c) Set the air diffuser in place and carefully lower it, using the grooves in the chassis mid-brace as guides. Make sure
that the diffuser alignment flange sits flat on the chassis floor and against PCIe slot 11.
Step 4 Replace the top cover to the server.
Step 5 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when
the front panel Power button LED lights amber).
Step 6 Fully power on the server by pressing the Power button.
Cisco UCS C480 M5 Server Installation and Service Guide
74
Page 77
Maintaining the Server
Figure 32: Rear Drive Module Air Diffuser
Replacing the Rear RAID Supercap Unit
1
This diffuser is required when SAS/SATA drivs are installed in the rear drive module.
2
mid-brace
Replacing the Rear RAID Supercap Unit
This server supports installation of up to two supercap units, one for a front RAID controller and one for a rear RAID controller. The rear supercap unit mounts to a clip on the air diffuser that wraps around the internal drive module.
The supercap provides approximately three years of backup for the disk write-back cache DRAM in the case of a sudden power loss by offloading the cache to the NAND flash.
3Air diffuser top view
Rear RAID supercap unit location on the inside surface of the diffuser
Alignment flange on chassis floor4Diffuser alignment points against the chassis
Cisco UCS C480 M5 Server Installation and Service Guide
75
Page 78
Replacing the Rear RAID Supercap Unit
Maintaining the Server
Warning
There is danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer’s instructions.
Statement 1015
Step 1 Prepare the server for component installation:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 35.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 37.
Step 2 Remove an existing rear supercap unit:
a) Grasp the two top edges of the air diffuser and lift straight up to free it from the grooves on the chassis mid-brace. b) Remove the supercap unit from the clip that is on the inside of the air diffuser. c) Disconnect the supercap cable from the rear RAID controller.
Step 3 Install a new supercap:
a) Set the new supercap unit into the clip on the inside of the air diffuser and push gently until it clicks in place and is
secured. b) Connect the supercap cable to the rear RAID controller card. c) Position SAS and supercap cables so that they do not interfere with the diffuser installation. Cables must route out
the rear of the diffuser. d) Set the air diffuser in place and carefully lower it, using the grooves in the chassis mid-brace as guides. Make sure
that the diffuser alignment flange sits flat on the chassis floor and against PCIe slot 11.
Step 4 Replace the top cover to the server.
Step 5 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when
the front panel Power button LED lights amber).
Step 6 Fully power on the server by pressing the Power button.
Cisco UCS C480 M5 Server Installation and Service Guide
76
Page 79
Maintaining the Server
Figure 33: Rear Drive Module Air Diffuser and Supercap Unit Location
Replacing a Rear RAID Controller Card
1
This diffuser is required when SAS/SATA drivs are installed in the rear drive module.
2
mid-brace
Replacing a Rear RAID Controller Card
The server supports one rear RAID controller card for control of up to eight internal SAS/SATA drives in the optional auxiliary drive module.
Note
The default slot for a rear RAID controller is PCIe slot 11. However, in a single CPU-module system, slot 11 is not supported. In this case, install the rear RAID controller in PCIe slot 10 and install the required blank filler to PCIe slot 11 to ensure adequate air flow.
For detailed information about storage controllers in this server, see Supported Storage Controllers and Cables,
on page 133.
3Air diffuser top view
Rear RAID supercap unit location on the inside surface of the diffuser
Alignment flange on chassis floor4Diffuser alignment points against the chassis
Cisco UCS C480 M5 Server Installation and Service Guide
77
Page 80
Replacing a Rear RAID Controller Card
Firmware on the storage controller (RAID or HBA) must be verified for compatibility with the current Cisco IMC and BIOS versions that are installed on the server. If not compatible, upgrade or downgrade the storage controller firmware using the Host Upgrade Utility (HUU) for your firmware release to bring it to a compatible level.
See the HUU guide for your Cisco IMC release for instructions on downloading and using the utility to bring server components to compatible levels: HUU Guides.
Step 1 Prepare the server for component installation:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 35.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Maintaining the Server
Caution
If you cannot safely view and access the component, remove the server from the rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 37.
Step 2 Remove an existing rear RAID card:
a) Disconnect the SAS and supercap cables from the existing card. b) Open the hinged retainer bar that covers the top of PCIe slot 11 or 10.
Use your fingertips to pull back on the wire locking-latches at each end of the retainer bar, and then hinge the bar
open to expose the tops of the PCIe slots. See Replacing a PCIe Card, on page 91.
c) Open the card's blue ejector lever to unseat it from the slot. d) Pull both ends of the card vertically to disengage the card from the socket, and then set it aside.
Step 3 Install a new rear RAID controller card:
a) Carefully align the card edge with the socket of PCIe slot 11 (or 10 in a single CPU module system). b) Push on both corners of the card to seat its connector in the socket. c) Fully close the blue ejector lever on the card to lock the card into the socket. d) Connect SAS cable (CBL-AUX-SAS-M5) and the supercap cable to the new card. e) Close the hinged retainer bar over the top of the PCIe slots.
Use your fingertips to pull back on the wire locking-latches at each end of the retainer bar, and then hinge it closed
to lock in the tops of the PCIe slots. Push the wire locking-latching back to the forward, locked position.
Step 4 Replace the top cover to the server.
Step 5 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when
the front panel Power button LED lights amber).
Step 6 Fully power on the server by pressing the Power button.
Cisco UCS C480 M5 Server Installation and Service Guide
78
Page 81
Maintaining the Server
Figure 34: Rear RAID Card and PCIe Slot 11 Filler (Single CPU Module System Shown)
Replacing a Rear NVMe Switch Card
1
controller card)
In this view, a blank filler is installed in slot
11. This is required only for single CPU module systems to ensure air flow.
Replacing a Rear NVMe Switch Card
When you install NVMe drives in the rear drive-bay module, you must have an NVMe switch card in PCIe slot 10. A PCIe cable connects the switch card to the drive-bay module backplane.
Note
Step 1 Prepare the server for component installation:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 35.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
If a rear NVMe switch card is used, it must be installed in PCIe slot 10.
2PCIe slot 11 (primary position for a rear RAID
PCIe slot 10, secondary slot for rear RAID controller
In a single CPU module system slot 11 is not supported, so the controller must install to slot
10.
Caution
If you cannot safely view and access the component, remove the server from the rack.
Cisco UCS C480 M5 Server Installation and Service Guide
79
Page 82
Replacing a Rear NVMe Switch Card
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 37.
Step 2 Remove any existing rear NVMe switch card from PCIe slot 10:
a) Disconnect the PCIe cable from the existing card. b) Open the hinged retainer bar that covers the top of PCIe slot 10. See Replacing a PCIe Card, on page 91.
Use your fingertips to pull back on the wire locking-latches at each end of the retainer bar, and then hinge the bar
open to expose the tops of the PCIe slots.
c) Open the card's blue ejector lever to unseat it from PCIe slot 10. d) Pull both ends of the card vertically to disengage the card from the socket, and then set it aside.
Step 3 Install a new rear NVMe switch card:
a) Carefully align the card edge with the socket of PCIe slot 10. b) Push on both corners of the card to seat its connector in the socket. c) Fully close the blue ejector lever on the card to lock the card into the socket. d) Connect the PCIe cable (CBL-AUX-NVME-M5) from the internal drive module backplane to the new switch card. e) Close the hinged retainer bar over the top of the PCIe slots.
Use your fingertips to pull back on the wire locking-latches at each end of the retainer bar, and then hinge it closed
to lock in the tops of the PCIe slots. Push the wire locking-latching back to the forward, locked position.
Maintaining the Server
Step 4 Replace the top cover to the server.
Step 5 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when
the front panel Power button LED lights amber).
Step 6 Fully power on the server by pressing the Power button.
Figure 35: Rear NVMe Switch Card Location (PCIe 10)
Cisco UCS C480 M5 Server Installation and Service Guide
80
Page 83
Maintaining the Server
Replacing Fan Modules
1
10)
Replacing Fan Modules
The four hot-swappable fan modules in the server are numbered as shown in Figure 3: Serviceable Component
Locations Inside the Main Chassis, on page 5. Each fan module contains two fans.
Tip
There is a fault LED on the top of each fan module. This LED lights green when the module is correctly seated and is operating OK. The LED lights amber when the module has a fault or is not correctly seated.
Caution
Step 1 Remove an existing fan module:
a) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
You do not have to shut down or remove power from the server to replace fan modules because they are hot­swappable. However, to maintain proper cooling, do not operate the server for more than one minute with any fan module removed.
-NVMe switch card in required location (PCIe
Caution
If you cannot safely view and access the component, remove the server from the rack.
b) Remove the top cover from the server as described in Removing the Server Top Cover, on page 37. c) Grasp and squeeze the fan module release latches on its top. Lift straight up to disengage its connector from the
motherboard.
Step 2 Install a new fan module:
a) Set the new fan module in place. The arrow printed on the top of the fan module should point toward the rear of the
server. b) Press down gently on the fan module to fully engage it with the connector on the motherboard. c) Replace the top cover to the server. d) Replace the server in the rack.
Cisco UCS C480 M5 Server Installation and Service Guide
81
Page 84
Replacing an Internal USB Drive
Figure 36: Top View of Fan Module
Maintaining the Server
Replacing an Internal USB Drive
This section includes procedures for installing a USB drive and for enabling or disabling the internal USB port.
Replacing a USB Drive
The server has one horizontal USB 2.0 socket on the motherboard.
Caution
Step 1 Remove an existing internal USB drive:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
We do not recommend that you hot-swap the internal USB drive while the server is powered on because of the potential for data loss.
on page 35.
cables from the rear panel to provide clearance.
Fan module fault LED2Fan module release latches1
Caution
82
If you cannot safely view and access the component, remove the server from the rack.
Cisco UCS C480 M5 Server Installation and Service Guide
Page 85
Maintaining the Server
Enabling or Disabling the Internal USB Port
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 37. d) Locate the USB socket on the motherboard as shown below, near PCIe slot 12. e) Grasp the USB drive and pull it horizontally to free it from the socket.
Step 2 Install a new internal USB drive:
a) Align the USB drive with the socket. b) Push the USB drive horizontally to fully engage it with the socket. c) Replace the top cover to the server.
Step 3 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when
the front panel Power button LED lights amber).
Step 4 Fully power on the server by pressing the Power button.
Figure 37: Internal USB 2.0 Socket Location
1
motherboard
Enabling or Disabling the Internal USB Port
The factory default is that all USB ports on the server are enabled. However, the internal USB port can be enabled or disabled in the server BIOS.
Step 1 Enter the BIOS Setup Utility by pressing the F2 key when prompted during bootup.
Step 2 Navigate to the Advanced tab.
Step 3 On the Advanced tab, select USB Configuration.
-Location of horizontal USB socket on
Cisco UCS C480 M5 Server Installation and Service Guide
83
Page 86
Maintaining the Server
Installing a Trusted Platform Module (TPM)
Step 4 On the USB Configuration page, select USB Ports Configuration.
Step 5 Scroll to USB Port: Internal, press Enter, and then choose either Enabled or Disabled from the dialog box.
Step 6 Press F10 to save and exit the utility.
Installing a Trusted Platform Module (TPM)
The trusted platform module (TPM) is a small circuit board that plugs into a motherboard socket and is then permanently secured with a one-way screw.
TPM Considerations
• This server supports either TPM version 1.2 or TPM version 2.0.
• Field replacement of a TPM is not supported; you can install a TPM after-factory only if the server does not already have a TPM installed.
• If there is an existing TPM 1.2 installed in the server, you cannot upgrade to TPM 2.0. If there is no existing TPM in the server, you can install TPM 2.0.
• If the TPM 2.0 becomes unresponsive, reboot the server.
Installing and Enabling a TPM
Note
Field replacement of a TPM is not supported; you can install a TPM after-factory only if the server does not already have a TPM installed.
This topic contains the following procedures, which must be followed in this order when installing and enabling a TPM:
1. Installing the TPM Hardware
2. Enabling the TPM in the BIOS
3. Enabling the Intel TXT Feature in the BIOS
Installing TPM Hardware
Note
For security purposes, the TPM is installed with a one-way screw. It cannot be removed with a standard screwdriver.
Step 1 Prepare the server for component installation:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 35.
Cisco UCS C480 M5 Server Installation and Service Guide
84
Page 87
Maintaining the Server
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Enabling the TPM in the BIOS
Caution
If you cannot safely view and access the component, remove the server from the rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 37.
Step 2 Install a TPM:
a) Locate the TPM socket on the motherboard, as shown below. b) Align the connector that is on the bottom of the TPM circuit board with the motherboard TPM socket. Align the
screw hole on the TPM board with the screw hole that is adjacent to the TPM socket. c) Push down evenly on the TPM to seat it in the motherboard socket. d) Install the single one-way screw that secures the TPM to the motherboard.
Step 3 Replace the cover to the server.
Step 4 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when
the front panel Power button LED lights amber).
Step 5 Fully power on the server by pressing the Power button.
Step 6 Continue with Enabling the TPM in the BIOS, on page 85.
Figure 38: TPM Socket Location
Enabling the TPM in the BIOS
After hardware installation, you must enable TPM support in the BIOS.
-TPM socket location on motherboard1
Cisco UCS C480 M5 Server Installation and Service Guide
85
Page 88
Enabling the Intel TXT Feature in the BIOS
Note
You must set a BIOS Administrator password before performing this procedure. To set this password, press the F2 key when prompted during system boot to enter the BIOS Setup utility. Then navigate to Security > Set Administrator Password and enter the new password twice as prompted.
Step 1 Enable TPM Support:
a) Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup. b) Log in to the BIOS Setup Utility with your BIOS Administrator password. c) On the BIOS Setup Utility window, choose the Advanced tab. d) Choose Trusted Computing to open the TPM Security Device Configuration window. e) Change TPM SUPPORT to Enabled. f) Press F10 to save your settings and reboot the server.
Step 2 Verify that TPM support is now enabled:
a) Watch during bootup for the F2 prompt, and then press F2 to enter BIOS setup. b) Log into the BIOS Setup utility with your BIOS Administrator password. c) Choose the Advanced tab. d) Choose Trusted Computing to open the TPM Security Device Configuration window. e) Verify that TPM SUPPORT and TPM State are Enabled.
Maintaining the Server
Step 3 Continue with Enabling the Intel TXT Feature in the BIOS, on page 86.
Enabling the Intel TXT Feature in the BIOS
Intel Trusted Execution Technology (TXT) provides greater protection for information that is used and stored on the business server. A key aspect of that protection is the provision of an isolated execution environment and associated sections of memory where operations can be conducted on sensitive data, invisibly to the rest of the system. Intel TXT provides for a sealed portion of storage where sensitive data such as encryption keys can be kept, helping to shield them from being compromised during an attack by malicious code.
Step 1 Reboot the server and watch for the prompt to press F2.
Step 2 When prompted, press F2 to enter the BIOS Setup utility.
Step 3 Verify that the prerequisite BIOS values are enabled:
a) Choose the Advanced tab. b) Choose Intel TXT(LT-SX) Configuration to open the Intel TXT(LT-SX) Hardware Support window. c) Verify that the following items are listed as Enabled:
• VT-d Support (default is Enabled)
• VT Support (default is Enabled)
• TPM Support
• TPM State
d) Do one of the following:
Cisco UCS C480 M5 Server Installation and Service Guide
86
Page 89
Maintaining the Server
• If VT-d Support and VT Support are already enabled, skip to step 4.
• If VT-d Support and VT Support are not enabled, continue with the next steps to enable them.
e) Press Escape to return to the BIOS Setup utility Advanced tab. f) On the Advanced tab, choose Processor Configuration to open the Processor Configuration window. g) Set Intel (R) VT and Intel (R) VT-d to Enabled.
Step 4 Enable the Intel Trusted Execution Technology (TXT) feature:
a) Return to the Intel TXT(LT-SX) Hardware Support window if you are not already there. b) Set TXT Support to Enabled.
Step 5 Press F10 to save your changes and exit the BIOS Setup utility.
Replacing a Chassis Intrusion Switch
The chassis intrusion switch in an optional security feature that logs an event in the system event log (SEL) whenever the cover is removed from the chassis.
Replacing a Chassis Intrusion Switch
Step 1 Prepare the server for component installation:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 35.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Caution
If you cannot safely view and access the component, remove the server from the rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 37.
Step 2 Remove an existing intrusion switch:
a) Disconnect the intrusion switch cable from the socket on the motherboard. b) Use a #1 Phillips-head screwdriver to loosen and remove the single screw that holds the switch mechanism to the
chassis wall. c) Slide the switch mechanism straight up to disengage it from the clips on the chassis.
Step 3 Install a new intrusion switch:
a) Slide the switch mechanism down into the clips on the chassis wall so that the screwholes line up. b) Use a #1 Phillips-head screwdriver to install the single screw that secures the switch mechanism to the chassis wall. c) Connect the switch cable to the socket on the motherboard.
Step 4 Replace the cover to the server.
Step 5 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when
the front panel Power button LED lights amber).
Step 6 Fully power on the server by pressing the Power button.
Cisco UCS C480 M5 Server Installation and Service Guide
87
Page 90
Replacing Power Supplies
Figure 39: Chassis Intrusion Switch
Maintaining the Server
Replacing Power Supplies
The server requires four power supplies. When four power supplies are installed they are redundant as 2+2 by default. You can change this to 3+1 redundancy in the system BIOS.
Note
The power supplies are hot-swappable and are accessible from the external rear of the server, so you do not have to pull the server out from the rack or remove the server cover.
• See also Power Specifications, on page 128 for more information about the supported power supplies.
• See also Rear-Panel LEDs, on page 32 for information about the power supply LEDs.
Replacing AC Power Supplies
Note
Do not mix power supply types or wattages in the server. All power supplies must be identical.
-Intrusion switch location1
Step 1 Remove the power supply that you are replacing or a blank panel from an empty bay:
a) Remove the power cord from the power supply that you are replacing.
Cisco UCS C480 M5 Server Installation and Service Guide
88
Page 91
Maintaining the Server
b) Grasp the power supply handle while pinching the release latch toward the handle. c) Pull the power supply out of the bay.
Step 2 Install a new power supply:
a) Grasp the power supply handle and insert the new power supply into the empty bay. b) Push the power supply into the bay until the release lever locks. c) Connect the power cord to the new power supply.
Figure 40: AC Power Supplies
Replacing a PCIe Card
Replacing a PCIe Card
Note
PCIe Slot Specifications and Restrictions
Cisco supports all PCIe cards qualified and sold by Cisco. PCIe cards not qualified or sold by Cisco are the responsibility of the customer. Although Cisco will always stand behind and support the C-Series rack-mount servers, customers using standard, off-the-shelf, third-party cards must go to the third-party card vendor for support if any issue with that particular card occurs.
The server provides 12 PCIe slots for vertical installation of up to 12 PCIe expansion cards.
The following figure shows a top view of the PCIe sockets and the corresponding PCIe slot openings in the rear panel. Some rear-panel openings are not used at this time.
Power supply handle3Power supply status LED1
-Power supply release latch2
Cisco UCS C480 M5 Server Installation and Service Guide
89
Page 92
PCIe Slot Specifications and Restrictions
Figure 41: PCIe Slot Numbering
Maintaining the Server
PCIe Slot Specifications
Table 4: PCIe Slot Specifications
Slot Number
Electrical Lane Width
Cisco UCS C480 M5 Server Installation and Service Guide
90
Connector Length
Maximum Card Length
Card Height (Rear Panel Opening)
NCSI Support
GPU Card Support
YesYesFull heightFull lengthx24 connectorGen-3 x161
Cisco VIC Card Support
Yes
(primary slot)
Page 93
Maintaining the Server
Replacing a PCIe Card
PCIe Population Guidelines and Restrictions
YesYesFull heightFull lengthx24 connectorGen-3 x162
Yes
(secondary slot)
YesNoYesFull heightFull lengthx24 connectorGen-3 x83
YesYesYesFull heightFull lengthx24 connectorGen-3 x164
YesNoYesFull heightFull lengthx24 connectorGen-3 x85
YesYesYesFull heightFull lengthx24 connectorGen-3 x166
YesNoYesFull heightFull lengthx24 connectorGen-3 x87
YesYesYesFull heightFull lengthx24 connectorGen-3 x168
NoNoNoFull heightFull lengthx24 connectorGen-3 x89
NoYesNoFull heightFull lengthx24 connectorGen-3 x1610
NoNoNoFull heightFull lengthx24 connectorGen-3 x811
NoNoNoFull heightFull lengthx8 connectorGen-3 x812
Note the following guidelines and restrictions:
• Control of the PCIe sockets is divided between the CPUs that are present in the system. Some PCIe slots are not available if your system does not have CPU module 2 installed:
• If the rear drive-bay module is installed, PCIe slot 12 is not available because of internal clearance.
• If the server has a rear RAID controller card, it must be installed in PCIe slot 11 or slot 10.
• If the server has a rear NVMe switch card, it must be installed in PCIe slot 10.
Replacing a PCIe Card
Before installing PCIe cards, see PCIe Slot Specifications and Restrictions, on page 89.
• If your system has four CPUs, all PCIe slots are supported.
• If your system has only two CPUs (CPU module 2 is not present), see the following table for the PCIe slots that are supported.
PCIe Slots Controlled by CPU Module 1
(CPUs 1 and 2)
PCIe Slots Controlled by CPU Module 2
(CPUs 3 and 4)
3, 4, 6, 7, 11, 121, 2, 5, 8, 9, 10
Cisco UCS C480 M5 Server Installation and Service Guide
91
Page 94
Replacing a PCIe Card
Step 1 Prepare the server for component installation:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 35.
b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach
cables from the rear panel to provide clearance.
Maintaining the Server
Caution
If you cannot safely view and access the component, remove the server from the rack.
c) Remove the top cover from the server as described in Removing the Server Top Cover, on page 37.
Step 2 Remove any existing card or a blanking panel:
a) Open the hinged retainer bar that covers the top of the PCIe slot.
Use your fingertips to pull back on the wire locking-latches at each end of the retainer bar, and then hinge the bar open to expose the tops of the PCIe slots.
b) Pull both ends of the card vertically to disengage the card from the socket, and then set it aside.
Step 3 Install a new PCIe card:
a) Carefully align the card edge with the socket while you align the card's rear tab with the rear panel opening. b) Push down on both corners of the card to seat its edge connector in the socket. c) Close the hinged retainer bar over the top of the PCIe slots.
Use your fingertips to pull back on the wire locking-latches at each end of the retainer bar, and then hinge it closed to secure the tops of the PCIe slots. Push the wire locking-latches back to the forward, locked position.
Step 4 Replace the top cover to the server.
Step 5 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when
the front panel Power button LED lights amber).
Step 6 Fully power on the server by pressing the Power button.
Cisco UCS C480 M5 Server Installation and Service Guide
92
Page 95
Maintaining the Server
Figure 42: PCIe Slot Hinged Retainer Bars
Cisco Virtual Interface Card (VIC) Considerations
1
(slots 10 - 12)
Cisco Virtual Interface Card (VIC) Considerations
This section describes VIC card support and special considerations for this server.
If you want to use the Cisco UCS VIC card for Cisco UCS Manager integration, see also the Installation For
Cisco UCS Manager Integration, on page 161 for details about supported configurations, cabling, and other
requirements.
Table 5: VIC Support and Considerations in This Server
VIC
UCSC-PCIE-C40Q-03
How Many Supported in Server
Slots That Support VICs
2Wire locking latches for left PCIe retainer bar
Wire locking latches for right PCIe retainer bar (slots 1 - 9)
Primary Slot For Cisco UCS Manager Integration
Primary Slot For Cisco Card NIC Mode
Minimum Cisco IMC Firmware
3.1(2)PCIe 1PCIe 1PCIe 1 - 88Cisco UCS VIC 1385
Cisco UCS C480 M5 Server Installation and Service Guide
93
Page 96
Replacing Components Inside a CPU Module
Replacing Components Inside a CPU Module
Maintaining the Server
Caution
Caution
When handling server components, handle them only by carrier edges and use an electrostatic discharge (ESD) wrist-strap or other grounding device to avoid damage.
This section describes how to install and replace CPUs and DIMMs inside a CPU module.
Never remove a CPU module without shutting down and removing power from the server.
See also:
Replacing Components Inside the Main Chassis, on page 44
Replacing Components Inside an I/O Module, on page 111
Replacing CPUs and Heatsinks
This section contains information for replacing CPUs and heatsinks inside a CPU module.
CPU Configuration Rules
The CPUs in this server install to sockets inside one or two removable CPU modules. Each CPU module has two CPU sockets.
• The system numbers the CPUs in CPU module 1 (the lower bay) as CPU 1 and CPU 2.
• The system numbers the CPUs in CPU module 2 (the upper bay) as CPU 3 and CPU 4.
Figure 43: CPU Numbering
• The server can operate with one or two CPU modules (two or four identical CPUs) installed.
Note
The CPUs in CPU module 1 must be identical with the CPUs in CPU module 2 (no mixing).
Cisco UCS C480 M5 Server Installation and Service Guide
94
Page 97
Maintaining the Server
Tools Required For CPU Replacement
• The minimum configuration is that the server must have at least CPU module 1 installed in the lower CPU module bay. Install CPU module 1 first, and then CPU module 2 in the upper bay.
Note
If CPU module 2 is not present in the upper bay, you must have a blank filler module in the upper bay or the server will not boot.
• The maximum combined memory allowed in the 12 DIMM slots controlled by any one CPU is 768 GB. To populate the 12 DIMM slots with more than 768 GB of combined memory, you must use a high-memory CPU that has a PID that ends with an "M", for example, UCS-CPU-6134M.
• The following restrictions apply when using only a two-CPU configuration (CPU module 2 is not present):
• The maximum number of DIMMs is 24 (only CPU 1 and CPU 2 memory channels).
• Some PCIe slots are unavailable when CPU module 2 is not present:
PCIe Slots Controlled by CPU Module 1
(CPUs 1 and 2)
• Only four double-wide GPUs are supported, in PCIe slots 1, 2, 8, and 10.
• No front NVMe drives are supported.
• The optional NVMe-only drive bay module UCSC-C480-8NVME is not supported.
• If a rear RAID controller is used, it must be installed in PCIe slot 10 rather than the default slot 11. A blank filler must be installed in slot 11.
Tools Required For CPU Replacement
You need the following tools and equipment for this procedure:
• T-30 Torx driver—Supplied with replacement CPU.
• #1 flat-head screwdriver—Supplied with replacement CPU.
• CPU assembly tool—Supplied with replacement CPU. Orderable separately as Cisco PID UCS-CPUAT=.
• Heatsink cleaning kit—Supplied with replacement CPU. Orderable separately as Cisco PID UCSX-HSCK=.
PCIe Slots Controlled by CPU Module 2
(CPUs 3 and 4)
3, 4, 6, 7, 11, 121, 2, 5, 8, 9, 10
• Thermal interface material (TIM)—Syringe supplied with replacement CPU. Use only if you are reusing your existing heatsink (new heatsinks have a pre-applied pad of TIM). Orderable separately as Cisco PID UCS-CPU-TIM=.
See also Additional CPU-Related Parts to Order with RMA Replacement CPUs, on page 102.
Cisco UCS C480 M5 Server Installation and Service Guide
95
Page 98
Replacing a CPU and Heatsink
Replacing a CPU and Heatsink
Maintaining the Server
Caution
CPUs and their sockets are fragile and must be handled with extreme care to avoid damaging pins. The CPUs must be installed with heatsinks and thermal interface material to ensure cooling. Failure to install a CPU correctly might result in damage to the server.
Step 1 Caution
Never remove a CPU module without shutting down and removing power from the server.
Prepare the server for component removal:
a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,
on page 35.
Note
You do not have to pull the server out of the rack or remove the server cover because the CPU modules are accessible from the front of the server.
Step 2 Remove an existing CPU module from the chassis:
Note
Verify that the power LED on the front of the CPU module is off before removing the module.
a) Grasp the two ejector levers on the front of the CPU module and pinch their latches to release the levers. b) Rotate both levers to the outside at the same time to evenly disengage the module from the midplane connectors. c) Pull the module straight out from the chassis and then set it on an antistatic surface.
Step 3 Remove the existing CPU/heatsink assembly from the CPU module:
a) Use the T-30 Torx driver that is supplied with the replacement CPU to loosen the four captive nuts that secure the
assembly to the board standoffs.
Note
Alternate loosening the heatsink nuts evenly so that the heatsink remains level as it is raised. Loosen the heatsink nuts in the order shown on the heatsink label: 4, 3, 2, 1.
b) Lift straight up on the CPU/heatsink assembly and set it heatsink-down on an antistatic surface.
Cisco UCS C480 M5 Server Installation and Service Guide
96
Page 99
Maintaining the Server
Figure 44: Removing the CPU/Heatsink Assembly
Replacing a CPU and Heatsink
Step 4 Separate the heatsink from the CPU assembly (the CPU assembly includes the CPU and the plastic CPU carrier):
a) Place the heatsink with CPU assembly so that it is oriented upside-down as shown in the following figure.
Note the thermal-interface material (TIM) breaker location. TIM BREAKER is stamped on the CPU carrier next to a small slot.
CPU socket on motherboard4Heatsink1
T-30 Torx driver5Heatsink captive nuts (two on each side)2
-CPU carrier (below heatsink in this view)3
Cisco UCS C480 M5 Server Installation and Service Guide
97
Page 100
Replacing a CPU and Heatsink
Figure 45: Separating the CPU Assembly From the Heatsink
Maintaining the Server
4CPU carrier1
CPU-carrier inner-latch nearest to the TIM breaker slot
5CPU2
#1 flat-head screwdriver inserted into TIM breaker slot
-TIM BREAKER slot in CPU carrier3
b) Pinch inward on the CPU-carrier clip that is nearest the TIM breaker slot and then push up to disengage the clip
from its slot in the heatsink corner.
c) Insert the blade of a #1 flat-head screwdriver into the slot marked TIM BREAKER.
Note
In the following step, do not pry on the CPU surface. Use gentle rotation to lift on the plastic surface of the CPU carrier at the TIM breaker slot. Use caution to avoid damaging the heatsink surface.
d) Gently rotate the screwdriver to lift up on the CPU until the TIM on the heatsink separates from the CPU.
Note
Do not allow the screwdriver tip to touch or damage the green CPU substrate.
e) Pinch the CPU-carrier clip at the corner opposite the TIM breaker and push up to disengage the clip from its slot
in the heatsink corner.
f) On the remaining two corners of the CPU carrier, gently pry outward on the outer-latches and then lift the
CPU-assembly from the heatsink.
Note
Handle the CPU-assembly by the plastic carrier only. Do not touch the CPU surface. Do not separate the CPU from the plastic carrier.
Cisco UCS C480 M5 Server Installation and Service Guide
98
Loading...