Cisco Systems M SFS7000E User Manual
Note There are six chassis I/O module bays on the rear panel of the server chassis. The InfiniBand switches
Contents
Cisco M SFS7000E Installation Note:
InfiniBand Blade Switch for the Dell Modular
Server Chassis
This document provides instructions on how to install the Cisco M SFS7000E InfiniBand Switch in the
Dell Modular Server Chassis. The Dell Modular Server Chassis is a system that supports up to sixteen
server modules and up to four InfiniBand switches. You may inst all the InfiniBand switch in one of four
chassis I/O module bays on the rear panel of the server chassis.
are supported in the middle four bays that are connected to Fabrics B and C.
For details about the number , types, and location of the module bays and for additional i nformation about
the entire modular server system, see the documentation for the Dell PowerEdge Servers at
www.support.dell.com.
This publication includes the following sections:
• Safety Overview, page 2
• Parts List, page 3
• Switch Description, page 4
• I/O Module Bays and HCA Expansion Cards, page 5
• Pre-installation Guidelines, pag e 6
• Installing the Cisco M SFS7000E InfiniBand Switch, page 6
• Removing the Cisco M SFS7000E InfiniBand Switch, page 11
• Connecting InfiniBand Cables, page 11
• External LED Specifications, page 14
Americas Headquarters:
Cisco Systems, Inc., 170 West Tasman Drive, San Jose, CA 95134-1706 USA
© 2007 Cisco Systems, Inc. All rights reserved.
Safety Overview
• External Network Management Requirements, page 15
• Warning Translation, page 16
• Related Documentation, page 21
• Obtaining Documentation, Obtaining Support, and Security Guidelines, page 22
Safety Overview
Safety warnings appear throughout this publication in procedures that, if performed incorrectly, may
harm you. A warning symbol precedes each warning statement.
Warning
Warning
Warning
Warning
Warning
IMPORTANT SAFETY INSTRUCTIONS
This warning symbol means danger . You are in a situation that could cause bodily injury. Before you
work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar
with standard practices for preventing accidents. Use the statement number provided at the end of
each warning to locate its translation in the translated safety warnings that accompanied this
device.
SAVE THESE INSTRUCTIONS
During this procedure, wear grounding wrist straps to avoid ESD damage to the card. Do not directly
touch the backplane with your hand or any metal tool, or you could shock yourself.
Voltage is present on the ba ckplane when the system is operating. To reduce risk of an electric shock,
keep hands and fingers out of the power supply bays and backplane areas.
Read the installation instructions before connecting the system to the power source.
This unit is intended for installation in restricted access areas. A restricted access area can be
accessed only through the use of a special tool, lock and key, or other means of security.
Statement 1017
Statement 1071
Statement 94
Statement 166
Statement 1004
Warning
Warning
Cisco M SFS7000E Installation Note: InfiniBand Blade Switch for the Dell Modular Server Chassis
2
This equipment must be grounded. Never defeat the ground conductor or operate the equipment in the
absence of a suitably installed ground conductor. Contact the appropriate electrical inspection
authority or an electrician if you are uncertain that suitable grounding is available.
Only trained and qualified personnel should be allowed to install, replace, or service thisequipment.
Statement 1030
Statement 1024
78-18371-01
Parts List
Warning
Warning
Warning
Parts List
Ultimate disposal of this product should be handled according to all national laws and regulations.
Statement 1040
Class 1M laser radiation when open. Do not view directly with optical instruments.
Use of controls, adjustments, or performing procedures other than those specified may result in
hazardous radiation exposure.
Statement 1057
Statement 1053
This section describes the parts list. The Cisco M SFS7000E InfiniBand Switch package includes the
following parts:
• One Cisco M SFS7000E InfiniBand Switch
• One document titled Regulatory Compliance and Safety Information for the Cisco M SFS7000E
InfiniBand Blade Switch for the Dell Modular Server Chassis
• One document titled Cisco M SFS7000E Installation Note:
InfiniBand Blade Switch for the Dell Modular Server Chassis
• One warranty card
78-18371-01
Cisco M SFS7000E Installation Note: InfiniBand Blade Switch for the Dell Modular Server Chassis
3
Switch Description
Switch Description
This section describes the Cisco M SFS7000E InfiniBand Switch.
The Cisco M SFS7000E InfiniBand Switch (see Figure 1) connects to the mid-plane of the Dell Modular
Server Chassis and provides user-accessible rear-plane ports. The blade switches are installed in the
system I/O module bays in the rear of the chassis. Each switch has sixteen 4x ports facing the mid-plane
and eight 4x ports facing the exteri or of the chassis. These ports drive Cisco- or Dell-approved DDR IB
cables.
Figure 1 Cisco M SFS7000E InfiniBand Switch
M SFS7000E
TX/RX
TX/
RX
TX/
RX
TX/
RX
TX/
RX
TX/
RX
TX/
RX
250396
TX/
RX
Cisco M SFS7000E Installation Note: InfiniBand Blade Switch for the Dell Modular Server Chassis
4
78-18371-01
I/O Module Bays and HCA Expansion Cards
D
185785
Within the Dell Modular Serv er Chassis un it, blade swi tches mana ge traffic to and from up to two HCA
IB mezzanine cards on the hosts. Each HCA IB mezzanine card adds two IB ports to a host. Each HCA
port connects through the unit mid-plane to a particular blade swi tch slot. The IB ports of the H CA card
that is seated in the HCA B location, connect to I/O module bays B1 and B2. The IB ports of the HCA
card that is seated in the HCA C location, connect to I/O module bays C1 and C2. See Figure 2 and
Table 1 for the location of the HCA cards and the corresponding I/O module bays.
For more details about the location of the HCA IB mezzanine card slots in the Dell Serv er Blade, see the
Dell PowerEdge M600 and M605 Hardware Owners Manual.
.
Figure 2 HCA Mezzanine Card Ports and Corresponding Switch I/O Module Bays
ell Server Blade
I/O Module Bays and HCA Expansion Cards
HCA C
HCA B
Table 1 HCA Mezzanine Card Ports and Corresponding Switch I/O Module Bays
Port 2
Port 1
Port 2
Port 1
B1 C1 C2 B2
Chassis Rear - I/O Module Bays
InfiniBand Switch I/O Module
HCA Mezzanine Card HCA InfiniBand Port
Bay
B1B1
2B2
C1C1
2C2
78-18371-01
Cisco M SFS7000E Installation Note: InfiniBand Blade Switch for the Dell Modular Server Chassis
5
Pre-installation Guidelines
Pre-installation Guidelines
This section describes some pre-installation guidelines. Before you begin installation, complete the
following procedures:
• Ground yourself using an approved ground wrist strap.
• Make sure that you have the correct cables.
• Unpack the Cisco M SFS7000E InfiniBand Switch. Remove the packaging from around the switch.
Do not cut the packaging, as you could damage the switch. Save the box and packaging.
Note If you order the switches with the Dell Modular Server Chassis, the switches are already installed, and
no unpacking is required. The unpacking procedure applies only if you order a
Cisco M SFS7000E InfiniBand Switch, separately or without a chassis.
Installing the Cisco M SFS7000E InfiniBand Switch
This section describes how to install the Cisco M SFS7000E InfiniBand Switch.
The Cisco M SFS7000E InfiniBand Switch can be hot-swapped while the Dell 10G system (PowerEdge)
is online. When you install a switch, you do not need to power down the server chassis.
The Cisco M SFS7000E InfiniBand Switch fits into four different bays on the Dell Modular Server
Chassis. These bays connect to either fabric B or C. Each one of th ese fabrics connects to a mezzanine
card on each of the 16 server modules. The HCA is designed to reside in these mezzanine connectors.
T wo swit ches may be used for each fab ric in a non-blocking conf iguration. Multiple fa brics may be used
simultaneously for increased bandwidth.
Note Each bay into which a Cisco M SFS7000E InfiniBand Switch fits must contain either a switch or a blank
input/output module (IOM). When you remove a switch, you must either replace it with an identical
switch or a blank IOM within one minute of removal.
To install the Cisco M SFS7000E InfiniBand Switch in the Dell Modular Server Chassis, perform the
following steps:
Step 1 Select a chassis I/O mod ule bay in which to in stall the swi tch. (See Figure 3 for th e locati on of the I/O
module bays.)
If the HCA IB mezzanine card B is installed, you may install the Cisco M SFS7000E InfiniBand Switch
in I/O slots B1 and/or B2. If the HCA IB mezzanine card C is installed, you may install the
Cisco M SFS7000E InfiniBand Switch in I/O slots C1 and/or C2.
Cisco M SFS7000E Installation Note: InfiniBand Blade Switch for the Dell Modular Server Chassis
6
78-18371-01
Figure 3 Chassis I/O Module Bays
Installing the CiscoMSFS7000E InfiniBand Switch
1
!
!
!
!
!
2
3
!
!
!
4
5
!
!
!
!
!
!
!
!
!
!
!
!
250401
78-18371-01
1 Dell Modular Server Chassis 2 I/O module B1
3 I/O module C1 4 I/O module C2
5 I/O module B2
Step 2 Remove the IOM blank from the selected bay, if it is present, and store it for future use.
Cisco M SFS7000E Installation Note: InfiniBand Blade Switch for the Dell Modular Server Chassis
7
Loading...