Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
First Published: 2016-01-28
Last Modified: 2018-03-19
Americas Headquarters
Cisco Systems, Inc.
170 West Tasman Drive
San Jose, CA 95134-1706
USA
http://www.cisco.com
Tel: 408 526-4000
800 553-NETS (6387)
Fax: 408 527-0883
THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS,
INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND,
EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.
THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH
THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY,
CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.
The following information is for FCC compliance of Class A devices: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to part 15
of the FCC rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment
generates, uses, and can radiate radio-frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications.
Operation of this equipment in a residential area is likely to cause harmful interference, in which case users will be required to correct the interference at their own expense.
The following information is for FCC compliance of Class B devices: This equipment has been tested and found to comply with the limits for a Class B digital device, pursuant to part 15 of
the FCC rules. These limits are designed to provide reasonable protection against harmful interference in a residential installation. This equipment generates, uses and can radiate radio
frequency energy and, if not installed and used in accordance with the instructions, may cause harmful interference to radio communications. However, there is no guarantee that interference
will not occur in a particular installation. If the equipment causes interference to radio or television reception, which can be determined by turning the equipment off and on, users are
encouraged to try to correct the interference by using one or more of the following measures:
• Reorient or relocate the receiving antenna.
• Increase the separation between the equipment and receiver.
• Connect the equipment into an outlet on a circuit different from that to which the receiver is connected.
• Consult the dealer or an experienced radio/TV technician for help.
Modifications to this product not authorized by Cisco could void the FCC approval and negate your authority to operate the product
The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public domain version of
the UNIX operating system. All rights reserved. Copyright©1981, Regents of the University of California.
NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED "AS IS" WITH ALL FAULTS.
CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE OF
MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE PRACTICE.
IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT
LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS
HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
Any Internet Protocol (IP) addresses and phone numbers used in this document are not intended to be actual addresses and phone numbers. Any examples, command display output, network
topology diagrams, and other figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses or phone numbers in illustrative content is unintentional
and coincidental.
Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL: www.cisco.com
go trademarks. Third-party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership relationship between Cisco and any
other company. (1721R)
©
2016–2016 Cisco Systems, Inc. All rights reserved.
Product Overview
• Fabric Interconnect Features, on page 1
• Cisco UCS 6332 Fabric Interconnect , on page 2
• Cisco UCS 6332-16UP Fabric Interconnect, on page 3
• Ports on the Cisco UCS 6300 Fabric Interconnects, on page 3
• Port Numbering, on page 5
• Port Breakout Feature, on page 6
• Power Supplies, on page 6
• Fan Modules, on page 8
• LED Descriptions, on page 8
• Supported Transceivers, on page 12
Fabric Interconnect Features
A Cisco UCS 6300 Series Fabric Interconnect provides both network connectivity and management capabilities
to a Cisco UCS system. The fabric interconnect provides Ethernet and Fibre Channel to the servers in the
system, the servers connect to the fabric interconnect, and the fabric interconnect connects to the LAN or
SAN.
CHAPTER 1
Each Cisco UCS 6300 Series Fabric Interconnect runs Cisco UCS Manager to fully manage all Cisco UCS
elements. The fabric interconnect supports full end-to-end 40-Gigabit capabilities in the fabric and enables
16-Gigabit Fibre Channel capabilities. High availability can be achieved when a Cisco UCS 6300 Series
Fabric Interconnect is connected to another Cisco UCS 6300 Series Fabric Interconnect through the L1 or L2
port on each device.
The Cisco UCS 6300 Series Fabric Interconnect joins next-generation UCS products, including the following
hardware:
• Cisco UCS 6332 Fabric Interconnect, an Ethernet or Fibre Channel over Ethernet (FCoE) chassis with
32 40-Gigabit QSFP+ ports
• Cisco UCS 6332-16UP Fabric Interconnect, an Ethernet, FCoE, and Fibre Channel chassis with 16 1or 10-Gigabit SFP+ ports or 16 4-, 8-, or 16-Gigabit Fibre Channel ports, 24 40-Gigabit QSFP+ ports
• Cisco 2304 IOM, an I/O module with 8 40-Gigabit backplane ports and 4 40-Gigabit uplink ports
• Multiple VICs
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
1
Cisco UCS 6332 Fabric Interconnect
Cisco UCS 6332 Fabric Interconnect
The Cisco UCS 6332 Fabric Interconnect is a 1 RU, top-of-rack switch with 32 40-Gigabit QSFP+ ports, one
100/1000 network management port, one RS-232 console port for setting the initial configuration, and two
USB ports for saving or loading configurations. The switch also includes an L1 port and an L2 port for
connecting two fabric interconnects to provide high availability. The switch mounts in a standard 19-inch
rack, such as the Cisco R Series rack.
Cooling fans pull air front-to-rear. That is, air intake is on the fan side and air exhaust is on the port side.
Figure 1: Cisco UCS 6332 Fabric Interconnect Rear View
Product Overview
1
2Port lane switch button, port lane LEDs,
and L1 and L2 ports. For additional
information about the port lane switch
and LEDs, see Lane Switch and LEDs,
on page 8.
Ports 1–12 and ports 15–26 can operate as
40-Gbps QSFP+ ports, or as 4 x 10-Gbps
SFP+ breakout ports.
Ports 1 - 4 support Quad to SFP or SFP+
(QSA) adapters to provide 1-Gbps/10 Gbps
operation.
Ports 13 and 14 can operate as 40-Gbps
QSFP+ ports. They cannot operate as 4 x
10-Gbps SFP+ breakout ports.
3
Ports 27–32 operate as 40-Gbps QSFP+
ports.
For additional information about the port groups, see Port Numbering, on page 5.
Figure 2: Cisco UCS 6332 Fabric Interconnect Front View
3
Management, console, and USB ports, and
LEDs. For more information about the
connections ports and LEDs, see Connection
Ports and LEDs, on page 10.
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
2
Fans1 through 4, numbered left to right, when
2Power supply and power cord connector1
facing the front of the chassis
Product Overview
Cisco UCS 6332-16UP Fabric Interconnect
The Cisco UCS 6332-16UP Fabric Interconnect is a 1 RU top-of-rack switch with 24 40-Gb QSFP+ ports,
16 10-Gb SFP ports, one 100/1000 network management port, one RS-232 console port for setting the initial
configuration, and two USB ports for saving or loading configurations. The switch also includes an L1 port
and an L2 port for connecting two fabric interconnects to provide high availability. The switch mounts in a
standard 19-inch rack, such as the Cisco R Series rack.
Cooling fans pull air front-to-rear. That is, air intake is on the fan side and air exhaust is on the port side.
Figure 3: Cisco UCS 3223-16UP Fabric Interconnect Rear View
Cisco UCS 6332-16UP Fabric Interconnect
1
L1 and L2 ports. For more information about
the port lane switch, see Lane Switch and
LEDs, on page 8.
3
ports, breakout mode for 4 x 10-Gigabit SFP+
breakout ports, or QSA for 10G.
Figure 4: Cisco UCS 6332-16UP Fabric Interconnect Front View
3
Management, console, and USB ports, and
LEDs. For more information about the
connection ports, see Connection Ports and
LEDs, on page 10.
2Port lane switch button, port lane LEDs, and
2Power supply and power cord connector1
Ports 1–16 are Unified Ports (UP) that operate
either as 1- or 10-Gbps SFP+ fixed Ethernet
ports; or as 4-, 8-, or 16-Gigabit Fibre Channel
ports.
Ports 35–40 operate as 40-Gbps QSFP+ ports.4Ports 17–34 operate either as 40-Gbps QSFP+
Fans1 through 4, numbered left to right, when
facing the front of the chassis
Ports on the Cisco UCS 6300 Fabric Interconnects
Ports on the Cisco UCS 6300 Series can be configured to carry either Ethernet or Fibre Channel traffic. These
ports are not reserved. They cannot be used by a Cisco UCS domain until you configure them.
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
3
Ports on the Cisco UCS 6300 Fabric Interconnects
Note
When you configure a port on a fabric interconnect, the administrative state is automatically set to enabled.
If the port is connected to another device, this may cause traffic disruption. You can disable the port after it
has been configured.
The following table summarizes the second and third generation ports for the Cisco UCS fabric interconnects.
Product Overview
Third GenerationSecond GenerationCisco UCS Mini
Description
fixed 10 GB
Interfaces
1GB
Interfaces
(depending on
the SFP
module
installed)
8-, 4-, 2-, 1Gbps, FC,
FCoE)
Cisco UCS 6324Item
Fabric Interconnect
with 4 ports and 1
scalability port
Cisco UCS
6248 UP
48-Port Fabric
Interconnect
Cisco UCS
6296 UP
96-Port Fabric
Interconnect
48324Number of
48324Number of
Cisco UCS
6332
32-Port Fabric
Interconnect
96 (24 X 4
using 4 x10G
breakout
cables), QSA
- 4 with QSA
adapter)
Cisco UCS
6332-16UP
40-Port Fabric
Interconnect
1 RU1 RU2 RU1 RU1 RUForm factor
88 (18 x 4 using 4
x 10G breakout
cables)
Ports 1-164 (only ports 1
NoneNoneAllAll4Unified Ports (
40-Gbps ports
Ports(1- or 10
Gbps Ethernet,
or 4-, 8-, or
16-Gbps, Fibre
Channel)
N/ACompatibility
with the IOM
Slots
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
4
UCS 2204,
UCS 2208
2432——1Number of
Ports 1-16NoneNoneNone—Unified
AllAllUCS 2204,
UCS 2208
NoneNone3 (16 port)1 (16 port)—Expansion
Product Overview
Port Numbering
Third GenerationSecond GenerationCisco UCS Mini
4552—Fan Modules
Supplies
Note
The third-generation ports support breakout capability. For more information on how the 40-Gigabit Ethernet
ports can be converted into 4 X 10-Gigabit Ethernet ports, see http://www.cisco.com/c/en/us/td/docs/unified_
computing/ucs/ucs-manager/GUI-User-Guides/Getting-Started/3-1/b_UCSM_Getting_Started_Guide_3_1/
b_UCSM_Initial_Configuration_Guide_3_0_chapter_011110.html.
Port Numbering
Ports on the Cisco UCS 6332 Fabric Interconnect are numbered and grouped according to their function. The
ports are numbered top to bottom and left to right. The following figure shows the port numbering.
Figure 5: Cisco UCS 6332 Fabric Interconnect Port Numbers
—Power
2 (AC/DC
available)
2 (AC/DC
available)
2
(AC/DC/HVDC
2 (AC/DC/HVDC
available)
available)
1
2Ports 1–12. Each port can operate as
either a 40-Gbps QSFP+ port or as 4 x
10-Gbps SFP+ breakout ports.
Ports 1 - 4 support Quad to SFP or
Ports 13–14. Each port operates as a
40-Gbps QSFP+ port. These two ports
cannot operate as 4 x 10-Gbps SFP+
breakout ports.
SFP+ (QSA) adapters to provide
1-Gbps/10-Gbps operation.
3
4Ports 15–26. Each port can operate as
either a 40-Gbps QSFP+ port or as 4 x
Ports 28–32. Each port operates as a
dedicated 40-Gbps QSFP+ port.
10-Gbps SFP+ breakout ports.
Ports on the Cisco UCS 6332-16UP Fabric Interconnect are numbered and grouped according to their function.
The ports are numbered top to bottom and left to right. The following figure shows the port numbering.
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
5
Port Breakout Feature
Product Overview
Figure 6: Cisco UCS 6332-16UP Fabric Interconnect Port Numbers
1
ports that operate as 1- or 10-Gbps
fixed Ethernet or as 4-, 8-, or 16-Gbps
Fibre Channel.
3
fixed 40-Gbps QSFP+ port.
Port Breakout Feature
Both the Cisco UCS 6332 fabric interconnect and the Cisco UCS 6332-16UP fabric interconnect have ports
that can be configured for the breakout feature that supports connectivity between 40-Gigabit Ethernet ports
and 10-Gigabit Ethernet ports. This feature provides backward compatibility to existing hardware that supports
10-Gigabit Ethernet. A 40-Gigabit Ethernet port can be used as 4 10-Gigabit Ethernet ports. Using a 40-Gigabit
Ethernet SFP, these ports on the UCS 6300 Series fabric interconnect can be configured as an appliance port,
server port (IOM, Fabric Extender, or C-series server), uplink, FCoE uplink and/or FCoE storage port.
The breakout feature can be configured on ports 1 to 12 and ports 15 to 26 on the Cisco UCS 6332 fabric
interconnect. Ports 17 to 34 on the Cisco UCS 6332-16UP fabric interconnect support the breakout feature.
For information on how to configure the breakout feature, see the Getting Started Guide for the latest release
of Cisco UCS Manager. The configuration guides are available at this URL: http://www.cisco.com/c/en/us/
support/servers-unified-computing/ucs-manager/products-installation-and-configuration-guides-list.html.
2Ports 1–16. These ports are universal
Ports 17–34. Each port operates as either
40-Gbps QSFP+ port, breakout mode for
4 x 10-Gigabit SFP+ breakout port, or QSA
for 10G.
—4Ports 35–40. Each port operates as a
Note
Configuring the breakout feature requires a reboot of the fabric interconnect.
Power Supplies
The fabric interconnect has two power supplies that are accessible from the rear of the chassis. Two power
supplies can be used for redundancy, but the fabric interconnect is fully functional with one power supply.
Table 1: Power Supply Models
UCS-PSU-6332-AC
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
6
WattageSourceFabric InterconnectCisco PID
650 W110 to 240 VACCisco UCS 6332 and
Cisco UCS 6332-16UP
Product Overview
Power Supplies
WattageSourceFabric InterconnectCisco PID
UCS-PSU-6332-DC
930 W-48 VDCCisco UCS 6332 and
Cisco UCS 6332-16UP
N9K-PUV-1200W
1230 W240 to 380 VDCCisco UCS 6332 and
Cisco UCS 6332-16UP
Figure 7: AC Power Supply for the Cisco UCS 6332 and UCS 6332-16UP Fabric Interconnect
Power supplies have two LEDs: one for power status and one for a failure condition.
Green power on LED2Amber fault/error LED1
DescriptionStateLED
Power supply is on and functioning properlySolid greenPower on LED
Blinking greenPower on LED
3.3 V voltage standby (VSB) is on but the power supply is not
powering the other units
There is no AC power to the power supplyOffPower on LED
Solid amberFault/error LED
Power supply failure that indicates an over voltage, over current,
or over temperature
Blinking amberFault/error LED
AC power is present, 3.3 VSB is on, and the power supply is
off
Normal operationOffFault/error LED
If one power supply is installed in the chassis, but the other power supply slot is empty, a blank filler panel
should be used to cover the empty slot.
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
7
Fan Modules
Fan Modules
LED Descriptions
The fabric interconnect has status LEDs and QSFP+ port LEDs .
Table 2: Status LEDs for the Cisco UCS 6300 Series Fabric Interconnect
Product Overview
LocationColorLED
Front and rear of chassisGreen and YellowPorts
Front and rear of chassisBlueBeacon
System Status
QSFP+ port LEDs on the front of the chassis allow you to see the link status of the ports. When you press the
push button on the front panel, a QSFP+ port LED shows the link and activity status for the selected lane, and
one of the four green LEDs show which lane is selected. You can press the push button four times to check
all four lanes of each QSFP+ port. After the fourth press, all LEDs turn off, indicating that the current link
status is 40-Gbps mode, which is the default mode.
Lane Switch and LEDs
Both the Cisco UCS 6332 Fabric Interconnect and the UCS 6332-16UP Fabric Interconnect have a lane switch
button and lane LEDs that are shown in the following figure:
Front and rear of chassisGreen, Amber, or
Red
Rear of chassisAmber or RedEnvironment
Front of chassisGreen or AmberPower supply
Front of chassis, integrated in the fanGreen or AmberFan modules
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
8
Product Overview
Lane Switch and LEDs
Figure 8: Port Lane Switch, HA Ports, and LEDs
L2 highly available port2L1 highly available port1
QSFP+ lane LEDs4Lane switch3
The port lane switch operates as follows:
• The default mode of operation after bootup is 40-Gbps. The LED on each individual port QSFP+ port
indicates the 40-Gbps link status. The lane switch button is illuminated, but none of the four lane LEDs
are illuminated.
• Pressing the lane switch button for the first time causes the lane 1 LED to illuminate. The LED on each
individual QSFP+ port represents the lane 1 status of the port.
• Pressing the lane switch button for the second time causes the lane 2 LED to illuminate. The LED on
each individual QSFP+ port represents the lane 2 status of the port.
• Pressing the lane switch button for the third time causes the lane 3 LED to illuminate. The LED on each
individual QSFP+ port represents the lane 3 status of the port.
• Pressing the lane switch button for the fourth time causes the lane 4 LED to illuminate. The LED on each
individual QSFP+ port represents the lane 4 status of the port.
• Pressing the lane switch button again causes the 40-Gbps mode to be in effect again.
When you cycle the lane switch button, the LED of a QSFP+ port indicates the status of the different lanes.
If a port is configured in breakout mode, the LED for a QSFP+ port is off when the lane LEDs are off. If a
40-Gbps port is not operating in breakout mode, and if the link is up, the LED on a QSFP+ port is green when
all the lane LEDs are off. The LED turns off when you press the lane button to lane 1, 2, 3, or 4.
The QSFP+ port LEDs for ports 13 and 14 are always the same as the 40-Gbps mode status because those
two ports cannot operate in breakout mode.
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
9
Connection Ports and LEDs
Connection Ports and LEDs
Both the Cisco UCS 6332 Fabric Interconnect and the UCS 6332-16UP Fabric Interconnect have the connection
ports and LEDs shown in the following figure:
Figure 9: Connection Ports and LEDs
Product Overview
The status of the beacon and system LEDs are as follows:
Front and rearSystem status
LED
power/health at bootup and
run time
Front and rearSystem status
LED
power/health at bootup and
run time
Front and rearSystem status
LED
power/health at bootup and
run time
USB port 12RJ45 network management port1
USB port 24RJ45 console port3
System status LED6Beaconing LED and button5
DescriptionStateColorFunctionLocationLED
Chassis selectedSolid onBlueIndicate selected chassisFront and rearBeacon LED
OffBlueIndicate selected chassisFront and rearBeacon LED
Chassis not
selected
Normal operationSolid onGreenIndicate system
OffGreenIndicate system
System powered
off
System faultOnAmberIndicate system
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
10
Product Overview
Management Port LEDs
DescriptionStateColorFunctionLocationLED
LED
LED
Management Port LEDs
The status of the management ports is listed below.
System Environment LEDs
Front and rearSystem status
power/health at bootup and
run time
Front and rearSystem status
power/health at bootup and
run time
DescriptionLED StateLED Position
No linkOffLeft
Physical linkSolid greenLeft
No activityOffRight
ActivityBlinking greenRight
Solid onRedIndicate system
BlinkingRedIndicate system
Power shut down
by software
Secure boot
validation has
failed
The system environment LED states are listed below.
Solid red
QSFP Port LEDs
The QSFP port LED states are listed below.
DescriptionLED State
Minor fan alarm (a fan is missing or there is a failure)Solid amber
Major fan alarm (two or more fans are missing or have failed, or there is a fan direction
mismatch
DescriptionLED State
Enabled, but SFP not insertedYellow
Enabled and link is upGreen
Enabled, but link is not connectedOff
Power On Self Test (POST) failedBlinking yellow
Port beacon enabledBlinking yellow
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
11
L1 and L2 Port LEDs
L1 and L2 Port LEDs
The L1 and L2 port LED states are listed below.
Product Overview
DescriptionLED State
Administrative (software shutdown)Yellow
DescriptionLED StateLED Position
No linkOffLeft
Physical linkSolid greenLeft
No activityOffRight
ActivityBlinking greenRight
Supported Transceivers
The Cisco UCS 6300 Series Fabric Interconnects support SFP+ Ethernet transceivers, SFP transceivers, SFP+
transceivers, SFP+ copper twinax cables with integrated transceivers, SFP Fibre Channel transceivers, QSFP
transceivers, and QSFP cables. Except where noted, both the UCS 6332 Fabric Interconnect and the UCS
6332-16UP Fabric Interconnect support all the transceivers listed in this section.
On the Cisco UCS 6332 Fabric Interconnect, all 1-Gigabit and 10-Gigabit transceivers and twinax cables
must use a QSA module (CVR-QSFP-SFP10G) to operate in a 40-Gbps QSFP+ port. In addition, the QSA
module is required for a 40-Gbps QSFP+ port to operate at 1 Gbps or 10 Gbps.
On the Cisco UCS 6332-16UP Fabric Interconnect, all 1-Gigabit and 10-Gigabit transceivers, Fibre Channel
transceivers, and twinax cables must use a QSA module (CVR-QSFP-SFP10G) to operate in ports 17–40 (the
40-Gbps QSFP+ ports). Ports 1–16 operate as SFP+ universal ports that are capable of operating at 1- or
10-Gbps fixed Ethernet or 4-, 8-, or 16-Gbps Fibre Channel ports and do not need a QSFP to SFP+ adapter.
In addition, the QSA module is required for a 40-Gbps QSFP+ port to operate at 1 Gbps or 10 Gbps.
SFP 1-Gigabit Transceivers
The SFP 1-Gigabit Ethernet transceiver module is a bidirectional device with a transmitter and receiver in the
same physical package.
Table 3: Supported SFP Optical Transceivers
DescriptionModel
SFP-GE-T
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
12
1000BASE-T standardGLC-T
1000BASE-SX short wavelength; with MDOMGLC-SX-MMD
1000BASE-T SFP (NEBS 3 ESD)—supported only
on the UCS 6332-16UP Fabric Interconnect
Product Overview
Note
The maximum length of fiber optic runs is limited to 300 meters. This is imposed by our use of
802.3X/802.1Qbb Priority Pauses. SFP-10G-LR is supported between fabric interconnect and I/O Module,
but the 300 m limit still applies.
SFP+ Transceivers and SFP+ Copper Cables
The enhanced SFP+ 10-Gigabit Ethernet transceiver module is a bidirectional device with a transmitter and
receiver in the same physical package. It has a 20-pin connector on the electrical interface and duplex LC
connector on the optical interface.
Table 4: Supported Transceivers
SFP+ Transceivers and SFP+ Copper Cables
DescriptionProduct ID
SFP-10G-SR
SFP-10G-SR -S
SFP-10G-LR
SFP-10G-LR -S
SFP+ Copper Cables with Integrated Transceivers
SFP-H10GB-CU1M
10GBASE-SR SFP+ module (multimode fiber
[MMF])
10GBASE-SR SFP+ module (multimode fiber
[MMF], S-Class)
10GBASE-LR SFP+ module (single-mode fiber
[SMF])
10GBASE-LR SFP+ module (single-mode fiber
[SMF], S-Class)
Cisco 10G Line Extender for FEXFET-10G
10GBASE-CU SFP+ cable 1 meter, passive
10GBASE-CU SFP+ cable 2 meter, passiveSFP-H10GB-CU2M
10GBASE-CU SFP+ cable 3 meter, passiveSFP-H10GB-CU3M
10GBASE-CU SFP+ cable 5 meter, passiveSFP-H10GB-CU5M
10GBASE-CU SFP+ cable 7 meter, activeSFP-H10GB-ACU7M
10GBASE-CU SFP+ cable 10 meter, activeSFP-H10GB-ACU10M
10GBASE-AOC SFP+ cable 1 meterSFP-10G-AOC1M
10GBASE-AOC SFP+ cable 2 meterSFP-10G-AOC2M
10GBASE-AOC SFP+ cable 3 meterSFP-10G-AOC3M
10GBASE-AOC SFP+ cable 5 meterSFP-10G-AOC5M
10GBASE-AOC SFP+ cable 7 meterSFP-10G-AOC7M
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
13
QSFP Transceivers and Cables
Note
The maximum length of fiber optic runs is limited to 300 meters. This is imposed by our use of
802.3X/802.1Qbb Priority Pauses. SFP-10G-LR is supported between fabric interconnect and FEX, but the
300 m limit still applies.
QSFP Transceivers and Cables
The Cisco UCS 6300 Series Fabric Interconnects support Cisco 40GGBASE Quad Small Form Factor (QSFP)
transceiver modules.
Table 5: Supported QSFP Transceivers and Cables
Product Overview
DescriptionProduct ID
10GBASE-AOC SFP+ cable 10 meterSFP-10G-AOC10M
DescriptionModel
QSFP-40G-LR4
QSFP-40G-LR4-S
QSFP-4x10G-AC7M
QSFP-4x10G-AC10M
40GBASE-SR4 QSFP module (multimode fiber [MMF]), 100 meterQSFP-40G-SR4
40GBASE-SR4 QSFP module (multimode fiber [MMF]), 100 meterQSFP-40G-SR4-S
40GBASE Extended CSR4 QSFP module (MMF), 300 meterQSFP-40G-CSR4
Cisco 40GBASE-LR4 QSFP+ transceiver module for SMF, duplex LC
connector
Cisco 40GBASE-LR4 QSFP+ transceiver module for SMF, duplex LC
connector
Cisco QSFP40G BiDi Short-reach transceiverQSFP-40G-SR-BD
Cisco 40G Line Extender for FEXFET-40G
Cisco 40GBASE-CR4 QSFP+ to 4 10GBASE-CU SFP+ active direct-attached
breakout cable, 7 meter
Cisco 40GBASE-CR4 QSFP+ to 4 10GBASE-CU SFP+ active direct-attached
breakout cable, 10 meter
Cisco 40GBASE-CR4 SFP+ passive direct-attach copper cable, 1 meterQSFP-H40G-CU1M
Cisco 40GBASE-CR4 SFP+ passive direct-attach copper cable, 3 meterQSFP-H40G-CU3M
Cisco 40GBASE-CR4 SFP+ passive direct-attach copper cable, 5 meterQSFP-H40G-CU5M
QSFP-4SFP10G-CU1M
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
14
Cisco 40GBASE-CR4 SFP+ active direct-attach copper cable, 7 meterQSFP-H40G-ACU7M
Cisco 40GBASE-CR4 SFP+ active direct-attach copper cable, 10 meterQSFP-H40G-ACU10M
Cisco 40GBASE-CR4 QSFP+ to 4 10GBASE-CU SFP+ passive direct-attach
copper transceiver assembly, 1 meter
Product Overview
QSFP Transceivers and Cables
QSFP-4SFP10G-CU3M
QSFP-4SFP10G-CU5M
QSFP-4X10G-AOC1M
QSFP-4X10G-AOC2M
QSFP-4X10G-AOC3M
QSFP-4X10G-AOC5M
QSFP-4X10G-AOC7M
QSFP-4X10G-AOC10M
Cisco 40GBASE-CR4 QSFP+ to 4 10GBASE-CU SFP+ passive direct-attach
copper transceiver assembly, 13 meter
Cisco 40GBASE-CR4 QSFP+ to 4 10GBASE-CU SFP+ passive direct-attach
copper transceiver assembly, 5 meter
Cisco 40GBASE-AOC QSFP TO 4 SFP+ Active Optical breakout Cable, 1
meter
Cisco 40GBASE-AOC QSFP TO 4 SFP+ Active Optical breakout Cable, 2
meter
Cisco 40GBASE-AOC QSFP TO 4 SFP+ Active Optical breakout Cable, 3
meter
Cisco 40GBASE-AOC QSFP TO 4 SFP+ Active Optical breakout Cable, 5
meter
Cisco 40GBASE-AOC QSFP TO 4 SFP+ Active Optical breakout Cable, 7
meter
Cisco 40GBASE-AOC QSFP TO 4 SFP+ Active Optical breakout Cable, 10
meter
Cisco 40GBASE-AOC QSFP direct-attach Active Optical Cable, 1 meterQSFP-H40G-AOC1M
Cisco 40GBASE-AOC QSFP direct-attach Active Optical Cable, 2 meterQSFP-H40G-AOC2M
Cisco 40GBASE-AOC QSFP direct-attach Active Optical Cable, 3 meterQSFP-H40G-AOC3M
Cisco 40GBASE-AOC QSFP direct-attach Active Optical Cable, 5 meterQSFP-H40G-AOC5M
Cisco 40GBASE-AOC QSFP direct-attach Active Optical Cable, 7 meterQSFP-H40G-AOC7M
Cisco 40GBASE-AOC QSFP direct-attach Active Optical Cable, 10 meterQSFP-H40G-AOC10M
Cisco 40GBASE-AOC QSFP direct-attach Active Optical Cable, 15 meterQSFP-H40G-AOC15M
Cisco 40GBASE QSFP to SFP+ and SFP adapterCVR-QSFP-SFP10G
Note
The Cisco UCS 6332 Fabric Interconnect does not support passive copper CR4 cables in ports 27 through 32
because these ports do not support negotiate auto. All other 40-Gigabit ports on the Cisco UCS 6332 Fabric
Interconnect support passive copper CR4 cables.
The Cisco UCS 6332-16UP Fabric Interconnect does not support passive copper CR4 cables in ports 35
through 40 because these ports do not support negotiate auto. All other 40-Gigabit ports on the Cisco UCS
6332-16UP Fabric Interconnect support passive copper CR4 cables.
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
15
SFP Fibre Channel Transceivers
SFP Fibre Channel Transceivers
The Cisco UCS 6332-16UP Fabric Interconnect supports the SFP Fibre Channel transceivers listed below.
These transceivers are not supported on the UCS 6332 Fabric Interconnect.
Table 6: SFP Fiber Channel Transceivers
Note
The maximum length of fiber optic runs from the fabric interconnect to a chassis is limited to 300 meters.
This restriction is imposed by the use of 802.3X/802.1Qbb Priority Pauses.
Product Overview
DescriptionModel
4 Gbps Fibre Channel-SW SFP, LCDS-SFP-FC4G-SW
8-Gbps Fibre Channel SW SFP+, LCDS-SFP-FC8G-SW
8-Gbps Fibre Channel LW SFP+, LCDS-SFP-FC8G-LW
16-Gbps Fibre Channel SW SFP+, LCDS-SFP-FC16G-SW
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
16
Installing the Cisco UCS 6300 Series Fabric
Interconnect
• Preparing for Installation, on page 17
• Cabinet and Rack Requirements, on page 20
• Cable Management Guidelines, on page 22
• Required Equipment, on page 22
• Unpacking and Inspecting the Cisco UCS Fabric Interconnect, on page 22
• Installing the Cisco UCS Chassis or UCS Chassis in a Cabinet or Rack, on page 23
• Grounding the System, on page 27
• Starting the System, on page 32
• Replacing or Installing Components, on page 34
• Repacking the Cisco UCS Fabric Interconnect for Return Shipment, on page 43
Preparing for Installation
CHAPTER 2
Considerations and Warnings
Note
Before you install, operate, or service the system, read the Regulatory Compliance and Safety Information
for Cisco UCS for important safety information.
Warning
IMPORTANT SAFETY INSTRUCTIONS This warning symbol means danger. You are in a situation that
could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical
circuitry and be familiar with standard practices for preventing accidents. Use the statement number provided
at the end of each warning to locate its translation in the translated safety warnings that accompanied this
device. Statement 1071
SAVE THESE INSTRUCTIONS
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
17
Installation Options
Installing the Cisco UCS 6300 Series Fabric Interconnect
Warning
Warning
This unit is intended for installation in restricted access areas. A restricted access area can be accessed only
through the use of a special tool, lock and key, or other means of security. Statement 1017
Only trained and qualified personnel must be allowed to install, replace, or service this equipment.
Statement 1030
Note
Each new fabric interconnect requires a license. For information on licensing, see the Configuration Guide
for the version of Cisco UCS Manager that you are using. The configuration guides are available at the
following URL:
http://www.cisco.com/en/US/products/ps10281/products_installation_and_configuration_guides_list.html
Installation Options
You can install the Cisco UCS Fabric Interconnect chassis in a perforated or solid-walled EIA cabinet or an
open EIA rack (the Cisco R Series Rack is an ideal choice), using the rack-mount kit shipped with the chassis.
For instructions on installing the chassis using the rack-mount kit shipped with the chassis, see Installing the
Cisco UCS Chassis or UCS Chassis in a Cabinet or Rack, on page 23.
Airflow Considerations
The FI's cooling fans pull air front-to-rear. That is, air intake is on the fan side and air exhaust is on the port
side.
To ensure proper airflow, follow these guidelines:
• Maintain ambient airflow throughout the data center to ensure normal operation.
• Consider the heat dissipation of all equipment when determining air conditioning requirements. When
evaluating airflow requirements, take into consideration that hot air generated by equipment at the bottom
of the rack can be drawn in the intake ports of the equipment above.
• Ensure that exhaust airflow is unobstructed.
Chassis Weight
When lifting the system, follow these guidelines:
• Disconnect all power and external cables before lifting the system.
• Have two people to lift the system. The Cisco UCS 6332 weighs 22 pounds (9.9 kg). The Cisco UCS
6332 16-UP weighs 22.61 pounds (10.2 kg). The Cisco UCS 6454 weighs 25.9 pounds (11.7 kg)
• Ensure that your footing is solid and that the weight of the system is evenly distributed between your
feet.
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
18
Installing the Cisco UCS 6300 Series Fabric Interconnect
• Lift the system slowly, keeping your back straight. Lift with your legs, not with your back. Bend at the
knees, not at the waist.
Installation Guidelines
When installing the Cisco UCS Fabric Interconnect, follow these guidelines:
• Prepare the site as described in the Site Preparation Checklist, on page 71.
• Plan your site configuration and prepare the site before installing the chassis. Site Preparation Checklist,
on page 71 lists the recommended site planning tasks.
• Record the information listed in Site Preparation Checklist, on page 71 as you install and configure the
fabric interconnect.
• Ensure that there is adequate space around the chassis to allow for servicing and for adequate airflow.
Site Preparation Checklist, on page 71 lists airflow requirements.
• Ensure that the air conditioning meets the heat dissipation requirements listed in Site Preparation Checklist,
on page 71.
Installation Guidelines
Note
Jumper power cords are available for use in a cabinet. See Cabinet Jumper Power
Cords, on page 69.
• Ensure that the chassis is adequately grounded. If the chassis is not mounted in a grounded rack, Cisco
recommends connecting both the system ground on the chassis and the power supply ground to an earth
ground.
• Ensure that the site power meets the power requirements listed in Power Specifications, on page 56 If
available, you can use an uninterruptible power supply (UPS) to protect against power failures.
Avoid UPS types that use ferroresonant technology. These UPS types can become unstable with systems
such as the Cisco UCS Fabric Interconnect, which can have substantial current draw fluctuations because
of fluctuating data traffic patterns.
• Ensure that circuits are sized according to local and national codes. For North America, the power supply
requires a 15-A or 20-A circuit.
To prevent loss of input power, ensure that the total maximum loads on the circuits supplying power to
the fabric interconnect are within the current ratings for the wiring and breakers.
• Use the following screw torques (listed in Newton-metres) when installing the chassis:
• Captive screws: 4 in-lb (0.45 N m)
• M3 screws: 4 in-lb (0.45 N m)
• M4 screws: 12 in-lb (1.36 N m)
• 10-32 screws: 20 in-lb (2.26 N m)
• 12-24 screws: 30 in-lb (3.39 N m)
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
19
Required Equipment
Required Equipment
Before beginning the installation, ensure that the following items are ready:
• Number 1 and number 2 Phillips screwdrivers with torque capability
• 3/16-inch flat-blade screwdriver
• Tape measure and level
• ESD wrist strap or other grounding device
• Antistatic mat or antistatic foam
The following additional items (not found in the accessory kit) are required to ground the chassis:
• Grounding cable (6 AWG recommended), sized according to local and national installation requirements;
the required length depends on the proximity of the Cisco UCS Fabric Interconnect to proper grounding
facilities
• Crimping tool large enough to accommodate girth of lug
Installing the Cisco UCS 6300 Series Fabric Interconnect
• Wire-stripping tool
Cabinet and Rack Requirements
This section provides the requirements for the following types of cabinets and racks, assuming an external
ambient air temperature range of 0 to 104°F (0 to 40°C):
• Standard perforated cabinets (60 percent or greater perforation front and back is required; the Cisco R
Series rack is an ideal choice)
• Standard open racks
Note
If you are using an enclosed cabinet, we recommend one of the thermally validated types: standard perforated
or solid-walled with a fan tray.
Note
Do not use racks that have obstructions (such as power strips), because the obstructions could impair access
to field-replaceable units (FRUs). The Cisco RP series PDUs when mounted in a Cisco R Series Rack should
not obstruct FRU replacement.
General Requirements for Cabinets and Racks
The cabinet or rack must be one of the following types:
• Standard 19 in. (48.3 cm) (four-post EIA cabinet or rack, with mounting rails that conform to English
universal hole spacing per section 1 of ANSI/EIA-310-D-1992. See the Requirements Specific to
Perforated Cabinets. (The Cisco R Series Rack is an ideal choice.)
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
20
Installing the Cisco UCS 6300 Series Fabric Interconnect
The cabinet or rack must also meet the following requirements:
• The minimum vertical rack space per Cisco UCS 6332 chassis must be one RU (rack unit), equal to 1.75
in. (4.4 cm).
• The minimum vertical rack space per Cisco UCS 6332 16-UP chassis must be one RU (rack unit), equal
to 1.75 in. (4.4 cm).
• The minimum vertical rack space per Cisco UCS 6454 chassis must be one RU (rack unit), equal to 1.75
in. (4.4 cm).
• The width between the rack-mounting rails must be at least 17.72 in. (45.0 cm) if the rear of the chassis
is not attached to the rack. For four-post EIA racks, this is the distance between the two front rails.
• For four-post EIA cabinets (perforated):
• The minimum spacing for the bend radius for fiber-optic cables should have the front-mounting
rails of the cabinet offset from the front door by a minimum of 3 in. (7.6 cm), and a minimum of 5
in. (12.7 cm) if cable management brackets are installed on the front of the chassis.
• The distance between the outside face of the front mounting rail and the outside face of the back
mounting rail should be 23.5 to 34.0 in. (59.7 to 86.4 cm) to allow for rear-bracket installation.
Requirements Specific to Perforated Cabinets
• A minimum of 2.5 in. (6.4 cm) of clear space should exist between the side edge of the chassis and
the side wall of the cabinet. No sizeable flow obstructions should be immediately in the way of
chassis air intake or exhaust vents.
Note
Optional jumper power cords are available for use in a cabinet.
Requirements Specific to Perforated Cabinets
A perforated cabinet is defined here as a cabinet with perforated front and rear doors and solid side walls. In
addition to the requirements listed in the General Requirements for Cabinets and Racks, on page 20, perforated
cabinets must meet the following requirements:
• The front and rear doors must have at least a 60 percent open area perforation pattern, with at least 15
square inches of open area per rack unit of door height.
• The roof should be perforated with at least a 20 percent open area.
• The cabinet floor should be open or perforated to enhance cooling.
The Cisco R Series racks meet or exceed all these requirements.
Requirements Specific to Standard Open Racks
In addition to the requirements listed in the General Requirements for Cabinets and Racks, on page 20, if
mounting the chassis in an open rack (no side panels or doors), the minimum vertical rack space per chassis
must be one RU (rack unit), equal to 1.75 in. (4.4 cm).
The Cisco R Series racks meet or exceed all these requirements.
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
21
Cable Management Guidelines
Cable Management Guidelines
To help with cable management, you might want to allow additional space in the rack above and below the
chassis to make it easier to route as many as 56 fiber or copper cables through the rack.
Required Equipment
Before beginning the installation, ensure that the following items are ready:
• Number 1 and number 2 Phillips screwdrivers with torque capability
• 3/16-inch flat-blade screwdriver
• Tape measure and level
• ESD wrist strap or other grounding device
• Antistatic mat or antistatic foam
Installing the Cisco UCS 6300 Series Fabric Interconnect
The following additional items (not found in the accessory kit) are required to ground the chassis:
• Grounding cable (6 AWG recommended), sized according to local and national installation requirements;
the required length depends on the proximity of the Cisco UCS Fabric Interconnect to proper grounding
facilities
• Crimping tool large enough to accommodate girth of lug
• Wire-stripping tool
Unpacking and Inspecting the Cisco UCS Fabric Interconnect
Caution
When handling chassis components, wear an ESD strap and handle modules by the carrier edges only. An
ESD socket is provided on the chassis. For the ESD socket to be effective, the chassis must be grounded
through the power cable, the chassis ground, or the metal-to-metal contact with a grounded rack.
Tip
Keep the shipping container in case the chassis requires shipping in the future.
Note
The interconnect is thoroughly inspected before shipment. If any damage occurred during transportation or
any items are missing, contact your customer service representative immediately.
Cisco UCS 6300 Series Fabric Interconnect Hardware Installation Guide
22
Loading...