Cisco Systems MDS 9500 User Manual

Send documentation comments to mdsfeedback-doc@cisco.com.
Cisco MDS 9500 Series Hardware Installation Guide
October 2008
Americas Headquarters
Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000
Fax: 408 527-0883
Text Part Number: OL-17467-02
Send documentation comments to mdsfeedback-doc@cisco.com.
THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.
THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.
The following information is for FCC compliance of Class A devices: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to part 15 of the FCC rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio-frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case users will be required to correct the interference at their own expense.
The following information is for FCC compliance of Class B devices: The equipment described in this manual generates and may radiate radio-frequency energy. If it is not installed in accordance with Cisco’s installation instructions, it may cause interference with radio and television reception. This equipment has been tested and found to comply with the limits for a Class B digital device in accordance with the specifications in part 15 of the FCC rules. These specifications are designed to provide reasonable protection against such interference in a residential installation. However, there is no guarantee that interference will not occur in a particular installation.
Modifying the equipment without Cisco’s written authorization may result in the equipment no longer complying with FCC requirements for Class A or Class B digital devices. In that event, your right to use the equipment may be limited by FCC regulations, and you may be required to correct any interference to radio or television communications at your own expense.
You can determine whether your equipment is causing interference by turning it off. If the interference stops, it was probably caused by the Cisco equipment or one of its peripheral devices. If the equipment causes interference to radio or television reception, try to correct the interference by using one or more of the following measures:
• Turn the television or radio antenna until the interference stops.
• Move the equipment to one side or the other of the television or radio.
• Move the equipment farther away from the television or radio.
• Plug the equipment into an outlet that is on a different circuit from the television or radio. (That is, make certain the equipment and the television or radio are on circuits controlled by different circuit breakers or fuses.)
Modifications to this product not authorized by Cisco Systems, Inc. could void the FCC approval and negate your authority to operate the product.
The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public domain version of the UNIX operating system. All rights reserved. Copyright © 1981, Regents of the University of California.
NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS” WITH ALL FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE PRACTICE.
IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
CCDE, CCENT, Cisco Eos, Cisco Lumin, Cisco Nexus, Cisco StadiumVision, Cisco TelePresence, Cisco WebEx, the Cisco logo, DCE, and Welcome to the Human Network are trademarks; Changing the Way We Work, Live, Play, and Learn and Cisco Store are service marks; and Access Registrar, Aironet, AsyncOS, Bringing the Meeting To You, Catalyst, CCDA, CCDP, CCIE, CCIP, CCNA, CCNP, CCSP, CCVP, Cisco, the Cisco Cisco
Systems Capital, the Cisco Systems logo, Cisco Unity, Collaboration Without Limitation, EtherFast, EtherSwitch, Event Center, Fast Step, Follow Me Browsing, FormShare, GigaDrive, HomeLink, Internet Quotient, IOS, iPhone, iQuick Study, IronPort, the IronPort MeetingPlace Chime Sound, MGX, Networkers, Networking Academy, Network Registrar, PCNow, PIX, PowerPanels, ProConnect, ScriptShare, SenderBase, SMARTnet, Spectrum Expert, StackWise, The Fastest Way to Increase Your Internet Quotient, TransPath, WebEx, and the WebEx and/or its affiliates in the United States and certain other countries.
All other trademarks mentioned in this document or website are the property of their respective owners. The use of the word partner does not imply a partnership relationship between Cisco and any other company. (0809R)
Cisco MDS 9500 Series Hardware Installation Guide
© 2003–2008 Cisco Systems, Inc. All rights reserved.
Certified Internetwork Expert logo, Cisco IOS, Cisco Press, Cisco Systems,
IMPLIED, INCLUDING, WITHOUT
logo, LightStream, Linksys, MediaTone, MeetingPlace,
logo are registered trademarks of Cisco Systems, Inc.
Send documentation comments to mdsfeedback-doc@cisco.com.

CONTENTS

New and Changed Information ix
Preface xv
Audience xv
Organization xv
Conventions xvi
Related Documentation xviii
Release Notes xviii Compatibility Information xviii Regulatory Compliance and Safety Information xviii Hardware Installation xviii Cisco Fabric Manager xix Command-Line Interface xix Intelligent Storage Networking Services Configuration Guides xix Troubleshooting and Reference xix Installation and Configuration Note xix
CHAPTER
Obtaining Documentation, Obtaining Support, and Security Guidelines xx
1 Product Overview 1-1
Chassis 1-2
Cisco MDS 9513 Director 1-3 Cisco MDS 9509 Director 1-6 Cisco MDS 9506 Director 1-7
Backplane and Clock Modules 1-8
Cisco MDS Fibre Channel Switch for IBM Blade Center 1-9
Power Supplies 1-9
Cisco MDS 9513 Power Supplies 1-10 Cisco MDS 9509 Power Supplies 1-12 Cisco MDS 9506 Power Supplies 1-15
Fan Modules 1-16
Supervisor Modules 1-16
Supervisor-2 Modules 1-17
Control and Management 1-18 Processor 1-18
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
i
Contents
Send documentation comments to mdsfeedback-doc@cisco.com.
Port Interfaces 1-18 LEDs on the Supervisor-2 Module 1-19
Supervisor-1 Modules 1-21
Control and Management 1-21 Crossbar Switching Fabric 1-22 Processor 1-22 Port Interfaces 1-22 LEDs on the Supervisor-1 Module 1-23
Crossbar Modules 1-25
Cisco MDS 9000 Series Module Compatibility 1-27
Port Index Availability 1-28
Switching Modules 1-32
48-port 8-Gbps Fibre Channel Switching Module 1-33 24-port 8-Gbps Fibre Channel Switching Module 1-33 4/44-port 8-Gbps Host-Optimized Fibre Channel Switching Module 1-33 48-Port 4-Gbps Fibre Channel Switching Module 1-34 24-port 4-Gbps Fibre Channel Switching Module 1-35 12-port 4-Gbps Fibre Channel Switching Module 1-35 4-port 10-Gbps Fibre Channel Switching Module 1-36 LEDs on the Generation 2 Switching Modules 1-37 32-Port 2-Gbps Fibre Channel Switching Module 1-37 16-Port 2-Gbps Fibre Channel Switching Module 1-38 Switching Module Features 1-39 LEDs on the Generation 1 Switching Module 1-40
Services Modules 1-41
18/4-Port Multiservice Module 1-41 18/4-Port Multiservice Federal Information Processing Standards Module 1-42
LEDs on the 18/4-Port Multiservice Module 1-43
14/2-Port Multiprotocol Services Module 1-44
LEDs on the MPS-14/2 Module 1-45
IP Storage Services Modules 1-46
LEDs on IP Storage Services Modules 1-47
32-Port Fibre Channel Advanced Services Module 1-48
LEDs on the Fibre Channel Advanced Services Modules 1-49
32-Port Fibre Channel Storage Services Module 1-50
LEDs on the Storage Services Modules 1-51
Caching Services Module 1-52
LEDs on the Caching Services Module 1-54
Supported Transceivers 1-55
Cisco MDS 9500 Series Hardware Installation Guide
ii
OL-17467-02
Contents
Send documentation comments to mdsfeedback-doc@cisco.com.
X2 Transceivers 1-55 Fibre Channel SFP Transceivers 1-56 Combination Fibre Channel/Gigabit Ethernet SFP Transceivers 1-56 CWDM Combination Fibre Channel/Gigabit Ethernet SFP Transceivers 1-56 Gigabit Ethernet SFP Transceivers 1-56 DWDM Fibre Channel SFP Transceivers 1-57
CHAPTER
2 Installing the Cisco MDS 9500 Series 2-1
Preinstallation 2-2
Installation Options 2-2 Installation Guidelines 2-3 Required Equipment 2-5 Unpacking and Inspecting the Switch 2-5
Installing the Chassis in a Cabinet or Rack 2-6
Installing the Cisco MDS 9513 Director in a Rack 2-7 Installing the Cisco MDS 9509 Director in a Rack 2-11 Installing the Cisco MDS 9506 Director in a Rack 2-15
System Grounding 2-17
Proper Grounding Practices 2-17 Preventing Electrostatic Discharge Damage 2-19 Establishing the System Ground 2-22 Required Tools and Equipment 2-22
Grounding the Chassis 2-23
Starting Up the Switch 2-28
Connecting the Power Supplies 2-28
Providing Power to an AC Power Supply for the Cisco MDS 9513 Director 2-29 Providing Power to an AC Power Supply for the Cisco MDS 9509 and Cisco MDS 9506
Directors
2-30
Providing Power to a DC Power Supply in the Cisco MDS 9509 Director 2-33 Providing Power to a DC Power Supply in the Cisco MDS 9506 Director 2-34
Powering Up the Switch and Verifying Component Installation 2-36
OL-17467-02
Removing, Installing, and Verifying Supervisor, Switching, and Services Modules 2-38
Removing Supervisor Modules 2-39 Installing Supervisor Modules 2-40 Removing a Caching Services Module 2-44 Removing Other Switching and Services Modules 2-45 Installing a Switching or Services Module, Including Caching Services Modules 2-45 Verifying Installation of Supervisor, Switching, and Services Modules 2-46 Removing and Installing a Crossbar Module 2-47
Cisco MDS 9500 Series Hardware Installation Guide
iii
Contents
Send documentation comments to mdsfeedback-doc@cisco.com.
Maintaining a Caching Services Module 2-50
Maintaining the Batteries on the Caching Services Module 2-50 Maintaining the Disk Drives on the Caching Services Module 2-51
Removing and Installing a Power Supply or PEM 2-51
Removing and Installing the Power Supplies on the Cisco MDS 9513 Director 2-52 Removing an AC Power Supply from the Cisco MDS 9513 Director 2-52 Installing an AC Power Supply in the Cisco MDS 9513 Director 2-54 Removing an AC Power Supply from the Cisco MDS 9509 Director 2-56 Installing an AC Power Supply in the Cisco MDS 9509 Director 2-57 Removing a DC Power Supply from the Cisco MDS 9509 Director 2-61 Installing a DC Power Supply in the Cisco MDS 9509 Director 2-62 Removing and Installing the PEMs on the Cisco MDS 9506 Director 2-64
Removing an AC PEM 2-64 Removing a DC PEM 2-64 Installing an AC PEM 2-66
Installing a DC PEM 2-66 Removing an AC or DC Power Supply from the Cisco MDS 9506 Director 2-67 Installing an AC or DC Power Supply in the Cisco MDS 9506 Director 2-67
Removing and Installing Fan Modules 2-68
Removing a Front Fan Module on the Cisco MDS 9513 Director 2-69 Installing a Front Fan Module on the Cisco MDS 9513 Director 2-70 Removing the Crossbar Module Fan Tray 2-71 Installing the Crossbar Module Fan Tray 2-72 Removing a Front Fan Module on the Cisco MDS 9509 Director 2-73 Installing a Front Fan Module on the Cisco MDS 9509 Director 2-73 Removing a Front Fan Module on the Cisco MDS 9506 Director 2-74 Installing a Front Fan Module on the Cisco MDS 9506 Director 2-74
Removing and Installing CompactFlash Cards 2-75
Removing a CompactFlash Card 2-75 Installing a CompactFlash Card 2-76
Removing and Installing Clock Modules 2-76
Removing a Clock Module from the Cisco MDS 9513 Director 2-77 Installing a Clock Module into the Cisco MDS 9513 Director 2-79 Removing a Clock Module from the Cisco MDS 9509 Director 2-80 Installing a Clock Module into the Cisco MDS 9509 Director 2-83 Removing a Clock Module from the Cisco MDS 9506 Director 2-83 Installing a Clock Module into the Cisco MDS 9506 Director 2-86
iv
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Contents
Send documentation comments to mdsfeedback-doc@cisco.com.
APPENDIX
CHAPTER
A Migrating to Generation 3 8-Gbps Fibre Channel Switching Modules A-1
Overview A-1
Usage Guidelines A-2
Before You Begin Upgrading the MDS 9513 Director A-3
Migration Procedures for the MDS 9513 Director A-3
Installing the MDS 9000 4/44-Port 8-Gbps Host-Optimized Module A-3 Installing MDS 9513 Fabric 2 Modules and Running Cisco SAN-OS 3.x A-5 Installing MDS 9513 Fabric 2 Modules and Installing MDS 9000 24-port or 48-port 8-Gbps
Modules
A-9
Installing the MDS 9513 Fabric 2 Modules and Activating Higher Bandwidth by Reloading the Switch
A-10
Installing the MDS 9513 Fabric 2 Modules and Activating Higher Bandwidth by Powering Down the Switch
A-11
Migration Procedure for the MDS 9509 Director and MDS 9506 Director A-12
B Connecting the Cisco MDS 9500 Series B-1
Preparing for Network Connections B-2
Connecting to the Console Port B-2
APPENDIX
Connecting to the COM1 Port B-4
Connecting to the MGMT 10/100/1000 Ethernet Port B-6
Connecting to the MGMT 10/100 Ethernet Port B-7
Connecting to a Fibre Channel Port B-9
Removing and Installing X2 Transceivers B-9
Removing an X2 Transceiver B-11 Installing an X2 Transceiver B-11
Removing and Installing SFP Transceivers B-12
Removing an SFP Transceiver B-12 Installing an SFP Transceiver B-14
Removing and Installing Cables into SFP Transceivers B-14
Removing a Cable from an SFP Transceiver B-14 Installing a Cable into an SFP Transceiver B-15
Maintaining SFP Transceivers and Fiber-Optic Cables B-16
C Cabinet and Rack Installation C-1
Cabinet and Rack Requirements C-1
General Requirements for Cabinets and Racks C-1
Cabinet and Rack Requirements for the Cisco MDS 9513 Chassis C-2 Cabinet and Rack Requirements for the Cisco MDS 9509 and Cisco MDS 9506 Chassis C-2
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
v
Contents
Send documentation comments to mdsfeedback-doc@cisco.com.
Requirements Specific to Perforated Cabinets C-3
Perforated Cabinet Requirements for the Cisco MDS 9513 Chassis C-3
Perforated Cabinet Requirements for the Cisco MDS 9509 and the Cisco MDS 9506
Chassis Requirements Specific to Solid-Walled Cabinets C-4
Solid-Walled Cabinet Requirements for the Cisco MDS 9513 Chassis C-4
Solid-Walled Cabinet Requirements for the Cisco MDS 9509 and the Cisco MDS 9506
Chassis Requirements Specific to Standard Open Racks C-5 Requirements Specific to Two-Post Telco Racks C-6
Cisco MDS 9000 Family Telco and EIA Shelf Bracket C-6
Rack-Mounting Guidelines C-7 Before Installing the Rack-Mount Support Brackets C-7 Before Installing the Shelf Brackets C-8
Required Equipment C-8 Installing the Shelf Bracket Kit into a Two-Post Telco Rack C-9 Installing the Shelf Bracket Kit into a Four-Post EIA Rack C-10 Installing the Switch on the Rack-Mount Support Brackets C-11 Installing the Switch on the Shelf Brackets C-12 Removing the Shelf Bracket Kit (Optional) C-12
C-3
C-5
APPENDIX
Cisco MDS 9500 Shelf Bracket C-13
Rack-Mounting Guidelines C-14 Before Installing the Shelf Brackets C-14
Required Equipment C-14 Installing the Cisco MDS 9500 Shelf Bracket Kit into a Cabinet or Rack C-15 Installing the Switch on the Shelf Brackets C-16
D Technical Specifications D-1
Switch Specifications D-1
Module Specifications D-4
Weight of Modules D-5
Power Specifications for the Cisco MDS 9513 Director D-6
Specifications for the Cisco MDS 9513 Power Supplies D-6 Component Power Requirements and Heat Dissipation for the Cisco MDS 9513 Director D-7 AC Power Consumption for the Cisco MDS 9513 Director D-8
Power Specifications for the Cisco MDS 9509 Director D-9
Specifications for the Cisco MDS 9509 Power Supplies D-9 Component Power Requirements and Heat Dissipation for the Cisco MDS 9509 Director D-11 AC Power Consumption for the Cisco MDS 9509 Director D-14
vi
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Contents
Send documentation comments to mdsfeedback-doc@cisco.com.
Power Specifications for the Cisco MDS 9506 Director D-14
Specifications for the Cisco MDS 9506 Power Supplies D-15 Component Power Requirements and Heat Dissipation for the Cisco MDS 9506 Director D-16 AC Power Consumption for the Cisco MDS 9506 Director D-19
X2 Transceiver Specifications D-19
Cisco 10-Gbps Fibre Channel X2 Transceivers D-20 General Specification for Cisco 10-Gbps Fibre Channel X2 Transceivers D-20 Environmental Conditions and Power Requirement Specifications for Cisco 10-Gbps Fibre
Channel X2 Transceivers Cisco 10-Gbps Ethernet X2 Transceivers D-21 General Specification for Cisco 10-Gbps Ethernet X2 Transceivers D-21 Environmental and Power Requirements Specifications for Cisco 10-Gbps Ethernet X2
Transceiver
D-22
Cisco 10-Gbps Ethernet DWDM X2 Transceiver D-22
SFP and SFP+ Transceiver Specifications D-22
Cisco Fibre Channel SFP and SFP+ Transceivers D-23
General Specifications for Cisco 8-Gbps Fibre Channel SFP+ Transceivers D-24 Environmental and Power Requirements for Cisco 8-Gbps Fibre Channel SFP+
Transceivers
D-24
General Specifications for Cisco 4-Gbps Fibre Channel SFP Transceivers D-26 Environmental and Power Requirement for Cisco 4-Gbps Fibre Channel SFP Transceivers D-26 General Specifications for Cisco 2-Gbps Fibre Channel SFP Transceivers D-27 Environmental and Power Requirement for Cisco 2-Gbps Fibre Channel SFP Transceivers D-27 Maximum Environmental and Electrical Ratings for Cisco Fibre Channel SFP Transceivers D-28
Cisco Fibre Channel and Gigabit Ethernet Transceivers D-28
General Specifications for Cisco Fibre Channel and Gigabit Ethernet SFP Transceivers D-29 Environmental and Power Requirement Specifications for Cisco Fibre Channel and Gigabit
Ethernet SFP Transceivers
Cisco CWDM SFP Transceivers D-30
Environmental and Optical Specifications for Cisco 2-Gbps CWDM SFP Transceivers D-31 Environmental and Optical Specifications for Cisco 4-Gbps CWDM SFP Transceivers D-33
Cisco Gigabit Ethernet Transceivers D-34
General Specifications for Cisco Gigabit Ethernet Transceivers D-34 Environmental and Power Requirement Specifications for Cisco Gigabit Ethernet
Transceivers
D-34
Cisco DWDM SFP Transceivers D-34
D-20
D-29
APPENDIX
OL-17467-02
E Cable and Port Specifications E-1
Cables and Adapters Provided E-1
Console Port E-2
Cisco MDS 9500 Series Hardware Installation Guide
vii
Contents
Send documentation comments to mdsfeedback-doc@cisco.com.
Console Port Pinouts E-2 Connecting the Console Port to a Computer Using the DB-25 Adapter E-2 Connecting the Console Port to a Computer Using the DB-9 Adapter E-3
COM1 Port E-3
COM1 Port Pinouts E-3 Connecting the COM1 Port to a Modem E-4
MGMT 10/100/1000 Ethernet Port E-4
MGMT 10/100 Ethernet Port E-6
Supported Power Cords and Plugs E-7
Power Cords E-7
Supported Plugs for 6000-W AC, 2500-W AC, and 1900-W AC Power Supplies E-9
Supported Plugs for the 4000-W AC Power Supply E-11 Jumper Power Cord E-11 Power Supply AC Power Cords E-12 AC Power Cord Illustrations E-13
APPENDIX
F Site Planning and Maintenance Records F-1
Contacting Customer Service F-1
Finding the Chassis Serial Number F-2
Site Preparation Checklist F-4
Contact and Site Information F-6
Chassis and Module Information F-7
viii
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Send documentation comments to mdsfeedback-doc@cisco.com.

New and Changed Information

This Cisco MDS 9500 Series Hardware Installation Guide applies to Cisco MDS NX-OS Release
4.1(1b) and earlier Cisco MDS SAN-OS releases.
Table 1 lists the new and changed features available with each supported Cisco MDS NX-OS release and
SAN-OS release for the Cisco MDS 9500 Series, with the latest release first.
Note As of NX-OS Release 4.1(1b), SAN-OS has been changed to NX-OS. References to SAN-OS releases
before 4.1(1b) still apply.
Ta b l e 1 Documented Features for the Cisco MDS 9500 Series
Changed in
Feature Description
48-port 8-Gbps Fibre Channel switching module
24-port 8-Gbps Fibre Channel switching module
4/44-port 8-Gbps Host-Optimize d Fibre Channel switching module
Added 48-port 8-Gbps Fibre Channel switching module. The switching module offers 48 autosensing 1-, 2-, 4­and 8-Gbps Fibre Channel ports and can be used in the Cisco MDS 9500 Series Switches.
Added 24-port 8-Gbps Fibre Channel switching module. The switching module offers 24 autosensing 1-, 2-, 4­and 8-Gbps Fibre Channel ports and can be used in the Cisco MDS 9500 Series Switches.
Added 4/44-port 8-Gbps Host-Optimized Fibre Channel switching module. The switching module offers 48 autosensing 1-, 2-, 4­and 8-Gbps Fibre Channel ports and can be used in any of the Cisco MDS 9500 Series chassis and in the Cisco MDS 9222i Switches.
Release
4.1(1b) The “48-port 8-Gbps Fibre
4.1(1b) The “24-port 8-Gbps Fibre
4.1(1b) The “4/44-port 8-Gbps
Where Documented
Channel Switching Module” section on page 1-33 and the “Technical Specifications” section on page D-1.
Channel Switching Module” section on page 1-33 and the “Technical Specifications” section on page D-1.
Host-Optimized Fibre Channel Switching Module” section on page 1-33 and the “Technical Specifications” section on page D-1.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
ix
New and Changed Information
Send documentation comments to mdsfeedback-doc@cisco.com.
Table 1 Documented Features for the Cisco MDS 9500 Series (continued)
Changed in
Feature Description
Migration to Generation 3 modules
Added the information associated with readying the MDS 9500 Series to support Generation 3 8-Gbps Fibre Channel switching modules.
Crossbar
Added DS-13SLT-FAB2 support 4.1(1b) “Technical Specifications”
modules
SFP+ transceivers
Cisco MDS Fibre Channel Bladeswitch
Added the SFP+ transceivers information.
Description of the Cisco MDS Fibre Channel Bladeswitch for IBM BladeCenter.
overview
18/4-port
Added information on IPV6 support. 3.3(1a) Product Overview chapter. Multiservice (MSM-18/4) module
18/4-port Multiservice
Added information on SAN extension
support. (MSM-18/4) module
18/4-port Multiservice
Added the Storage Media Encryption
information. (MSM-18/4) module
18/4-port Multiservice
Added the new 18/4-port Multiservice
(MSM-18/4) module. (MSM-18/4) module
18/4-port Multiservice
Added the new 18/4-port Multiservice
FIPS (MSFM-18/4) module. FIPS (MSFM-18/4) module
Cisco MDS 9513 Multilayer Director
Added Cisco MDS 9513 Multilayer
Director. The chassis consists of 13
horizontal slots, where slots 1 to 6 and
slots 9 to 13 are reserved for switching,
services, and IPS modules, and slots 7
and 8 are for Supervisor-2 modules
only.
Release Where Documented
4.1(1b) “Migrating to Generation 3
8-Gbps Fibre Channel Switching Modules” section on page A-1.
section on page D-1.
4.1(1b) “Technical Specifications”
section on page D-1.
3.3(1a) Product Overview chapter.
3.3(1a) The “18/4-Port Multiservice
Module” section on page 1-41.
3.2(1) The “18/4-Port Multiservice
Module” section on page 1-41.
3.2(1) The “18/4-Port Multiservice
Module” section on page 1-41
and the “Technical
Specifications” section on page D-1.
3.2(1) The “18/4-Port Multiservice
Federal Information Processing Standards Module” section on page 1-42
and the “Technical
Specifications” section on page D-1.
3.0(1) The “Chassis” section on
page 1-2 and the “Installing the Cisco MDS 9513 Director in a Rack” section on page 2-7.
Cisco MDS 9500 Series Hardware Installation Guide
x
OL-17467-02
New and Changed Information
Send documentation comments to mdsfeedback-doc@cisco.com.
Table 1 Documented Features for the Cisco MDS 9500 Series (continued)
Changed in
Feature Description
Supervisor-2 module
Added Supervisor-2 module. Supervisor-2 modules can be used in the Cisco MDS 9509 and 9506 Director in slots 5 and 6. Dual Supervisor-2 modules must be used in slots 7 and 8 of the Cisco MDS 9513 Director.
48-port 4-Gbps Fibre Channel switching module
Added 48-port 4-Gbps Fibre Channel switching module. The switching module offers 48 autosensing 1-, 2-, and 4-Gbps Fibre Channel ports and can be used in any of the Cisco MDS 9500 Series chassis and in the Cisco MDS 9216i and 9216A Switches.
24-port 4-Gbps Fibre Channel switching module
Added 24-port 4-Gbps Fibre Channel switching module. The switching module offers 24 autosensing 1-, 2-, and 4-Gbps Fibre Channel ports and can be used in any of the Cisco MDS 9500 Series chassis and in the Cisco MDS 9216i and 9216A Switches.
12-port 4-Gbps Fibre Channel switching module
Added 12-port 4-Gbps Fibre Channel switching module. The switching module can be used in any of the Cisco MDS 9500 Series chassis and in the Cisco MDS 9216i and 9216A Switches.
4-port 10-Gbps Fibre Channel switching module
Crossbar modules
Added 4-port 10-Gbps Fibre Channel
switching module. The switching module offers four dedicated bandwidth Fibre Channel ports running at 10
Gbps with no oversubscription.
Added crossbar modules. The Cisco MDS 9513 Director supports two crossbar modules located at the rear of the chassis. Each Supervisor-2 module has an associated crossbar module.
X2 transceiver Added the X2 transceiver information.
The X2 transceiver is a small form-factor pluggable optimized for 10-Gbps applications.
Fibre Channel SFP transceiver
Added 4-Gbps Fibre Channel SFP trans-
ceiver.
Release Where Documented
3.0(1) The “Supervisor-2 Modules”
section on page 1-17.
3.0(1) The “48-Port 4-Gbps Fibre
Channel Switching Module” section on page 1-34 and the “Technical Specifications” section on page D-1.
3.0(1) The “24-port 4-Gbps Fibre
Channel Switching Module” section on page 1-35 and the “Technical Specifications” section on page D-1.
3.0(1) The “12-port 4-Gbps Fibre
Channel Switching Module” section on page 1-35 and the “Technical Specifications” section on page D-1.
3.0(1) The “4-port 10-Gbps Fibre
Channel Switching Module” section on page 1-36 and “Technical Specifications” section on page D-1.
3.0(1) The “Crossbar Modules”
section on page 1-25 and “Removing and Installing a Crossbar Module” section on page 2-47.
3.0(1) The “X2 Transceivers” section
on page 1-55 and the “X2 Transceiver Specifications” section on page 19.
3.0(1) The “Fibre Channel SFP
Transceivers” section on page 1-56 and the “SFP and SFP+ Transceiver Specifications” section on page D-22.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
xi
New and Changed Information
Send documentation comments to mdsfeedback-doc@cisco.com.
Table 1 Documented Features for the Cisco MDS 9500 Series (continued)
Changed in
Feature Description
3000W Power Supply for the
Added 3000W power supply for the
Cisco MDS 9509 Director. Cisco MDS 9509 Director
Gigabit Ethernet SFP
Added Gigabit Ethernet SFP
transceiver. transceiver
32-port Fibre Channel
Added 32-port Fibre Channel Storage
Services Module (SSM). Storage Services Module (SSM)
14/2-port Multiprotocol Services
Provided FCIP, iSCSI, and Fibre
Channel capability in a multiprotocol
module. (MPS-14/2) module
Clock module installation
Added installation procedure for clock
modules.
9500 Shelf Kit Added optional shelf bracket kit for the
Cisco MDS 9509 Director.
4-port IP Storage Services
Provided FCIP services and iSCSI
services capability in a 4-port Gigabit
Ethernet module. (IPS-4) module
Jumper power cord
Added jumper power cord available for
use in a cabinet.
Installation Modified Cisco MDS 9509 installation
options.
Power supplies Added information on Cisco MDS
9509 power supplies.
Release Where Documented
3.0(1) The “Cisco MDS 9509 Power
Supplies” section on page 1-12, “Installing an AC Power Supply in the Cisco MDS 9509 Director” section on page 2-57, and the “Specifications for the Cisco MDS 9509 Power Supplies” section on page D-9.
Not release specific
The “Supported Transceivers”
section on page 1-55 and the “SFP and SFP+ Transceiver Specifications” section on page D-22.
2.0(2b) The “32-Port Fibre Channel
Storage Services Module” section on page 1-50.
2.0(1b) The “14/2-Port Multiprotocol
Services Module” section on page 1-44.
Not release specific
The “Removing and Installing
Clock Modules” section on page 2-76.
Not release specific
The “Cisco MDS 9500 Shelf
Bracket” section on page C-13.
1.3(4a) The “IP Storage Services
Modules” section on page 1-46.
Not release specific
Not release specific
Not release specific
The “Jumper Power Cord”
section on page E-11.
The “Installation Options”
section on page 2-2.
The “Installing the Cisco
MDS 9509 Director in a Rack” section on page 2-11.
xii
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
New and Changed Information
Send documentation comments to mdsfeedback-doc@cisco.com.
Table 1 Documented Features for the Cisco MDS 9500 Series (continued)
Changed in
Feature Description
Installation of SFP
Added instructions for installation and removal of SFP transceivers and cables.
transceivers
Additional UK power cable
Added United Kingdom power cable BS89/13, BS 1363/A, for use with 1900-W power supply.
Caching Services Module (CSM)
Tel c o a nd EIA Shelf Bracket
Added virtualization services for reallocating physical resources as virtual resources.
Allowed single-user installation and installation in a telco rack.
Kit
Advanced Services Module (ASM)
Added support for up to 32 Fibre Channel ports, provided distributed intelligent storage services, and enabled virtualization.
Console port to modem Connection
COM1 port to modem Connection
Gigabit Ethernet and CWDM SFP transceivers
8-port IP Storage Services
Added support for connecting the console port on the Cisco MDS 9500 Series to a modem.
Added support for connecting the COM1 port on the Cisco MDS 9500 Series to a modem.
Added support for Gigabit Ethernet/Fibre Channel SFP transceivers and CWDM SFP transceivers.
Provided FCIP services and iSCSI services capability in an 8-port Gigabit Ethernet module.
(IPS-8) module
Cisco MDS 9506 Director
Added the Cisco MDS 9506 Director, a multilayer Fibre Channel switch that supports up to six modules.
16-port Fibre Channel module
32-port Fibre Channel module
Cisco MDS 9509 Switch
Added 16-port Fibre Channel hot-swappable switching module for use with the Cisco MDS 9500 Series.
Added 32-port Fibre Channel hot-swappable switching module for use with the Cisco MDS 9500 Series.
Added the Cisco MDS 9509 Director, a multilayer Fibre Channel switch that supports up to nine modules.
Release Where Documented
Not release specific
The “Removing, Installing,
and Verifying Supervisor, Switching, and Services Modules” section on page 2-38.
Not release specific
The “Power Cords” section on
page E-7.
1.3(1) The “32-Port 2-Gbps Fibre
Channel Switching Module” section on page 1-37.
Not release specific
The “Cisco MDS 9000 Family
Telco and EIA Shelf Bracket” section on page C-6.
1.2(2a) The “32-Port Fibre Channel
Advanced Services Module” section on page 1-48.
1.2(2a) The “Connecting to the
Console Port” section on page B-2.
1.2(1a) The “Connecting to the COM1
Port” section on page B-4.
1.1(1a) The “Supported Transceivers”
section on page 1-55.
1.1(1a) The “IP Storage Services
Modules” section on page 1-46.
1.1(1a) This guide.
1.0(2a) The “Switching Modules”
section on page 1-32.
1.0(2a) The “Switching Modules”
section on page 1-32.
1.0(2a) This guide.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
xiii
New and Changed Information
Send documentation comments to mdsfeedback-doc@cisco.com.
xiv
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Send documentation comments to mdsfeedback-doc@cisco.com.

Preface

This preface describes the audience, organization, and conventions of the
Cisco
MDS 9500 Series Hardware Installation Guide. It also provides information on how to obtain
related documentation.

Audience

To use this installation guide, you must be familiar with electronic circuitry and wiring practices and preferably be an electronic or electromechanical technician.

Organization

This guide is organized as follows:
Chapter Title Description
Chapter 1 Product Overview Provides an overview of the Cisco MDS 9500 Series and its
Chapter 2 Installing the Cisco
Chapter B Connecting the
Appendix A Migrating to
Appendix C Cabinet and Rack
Appendix D Technical
MDS 9500 Series
Cisco MDS 9500 Series
Generation 3 8-Gbps Fibre Channel Switching Modules
Installation
Specifications
components.
Describes how to install the Cisco MDS 9500 Series, including installing the chassis, modules, CompactFlash card, power supplies, and fan assembly.
Describes how to connect the Cisco MDS 9500 Series, including the modules.
Describes the tasks associated with readying the MDS 9500 Series to support Generation 3 8-Gbps Fibre Channel switching modules.
Provides guidelines for selecting an enclosed cabinet, and the procedure for installing a switch using the optional Telco and EIA Shelf Bracket Kit.
Lists the Cisco MDS 9500 Series switch specifications, and includes safety information, site requirements, and power connections.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
xv
Preface
Send documentation comments to mdsfeedback-doc@cisco.com.
Chapter Title Description
Appendix E Cable and Port
Specifications
Appendix F Site Planning and
Maintenance
Lists cable and port specifications for the Cisco MDS 9500 Series switch.
Provides a site-planning checklist and sample maintenance and network records.
Records

Conventions

This document uses the following conventions for notes, cautions, and safety warnings.
Notes and Cautions contain important information that you should be aware of.
Note Means reader take note. Notes contain helpful suggestions or references to material that
are not covered in the publication.
Caution Means reader be careful. You are capable of doing something that might result in equipment damage or
Warning
Waarschuwing
Varoitus
loss of data.
Safety warnings appear throughout this publication in procedures that, if performed incorrectly, may harm you. A warning symbol precedes each warning statement.
This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents. Use the statement number provided at the end of each warning to locate its translation in the translated safety warnings that accompanied this device.
Dit waarschuwingssymbool betekent gevaar. U verkeert in een situatie die lichamelijk letsel kan veroorzaken. Voordat u aan enige apparatuur gaat werken, dient u zich bewust te zijn van de bij elektrische schakelingen betrokken risico's en dient u op de hoogte te zijn van standaard maatregelen om ongelukken te voorkomen. Voor vertalingen van de waarschuwingen die in deze publicatie verschijnen, kunt u het document Regulatory Compliance and Safety Information (Informatie over naleving van veiligheids- en andere voorschriften) raadplegen dat bij dit toestel is ingesloten.
Tämä varoitusmerkki merkitsee vaaraa. Olet tilanteessa, joka voi johtaa ruumiinvammaan. Ennen kuin työskentelet minkään laitteiston parissa, ota selvää sähkökytkentöihin liittyvistä vaaroista ja tavanomaisista onnettomuuksien ehkäisykeinoista. Tässä julkaisussa esiintyvien varoitusten käännökset löydät laitteen mukana olevasta Regulatory Compliance and Safety Information -kirjasesta (määräysten noudattaminen ja tietoa turvallisuudesta).
Statement 1071
xvi
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Preface
Send documentation comments to mdsfeedback-doc@cisco.com.
Attention
Warnung
Avvertenza
Ce symbole d'avertissement indique un danger. Vous vous trouvez dans une situation pouvant causer des blessures ou des dommages corporels. Avant de travailler sur un équipement, soyez conscient des dangers posés par les circuits électriques et familiarisez-vous avec les procédures couramment utilisées pour éviter les accidents. Pour prendre connaissance des traductions d’avertissements figurant dans cette publication, consultez le document Regulatory Compliance and Safety Information (Conformité aux règlements et consignes de sécurité) qui accompagne cet appareil.
Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu einer Körperverletzung führen könnte. Bevor Sie mit der Arbeit an irgendeinem Gerät beginnen, seien Sie sich der mit elektrischen Stromkreisen verbundenen Gefahren und der Standardpraktiken zur Vermeidung von Unfällen bewußt. Übersetzungen der in dieser Veröffentlichung enthaltenen Warnhinweise finden Sie im Dokument Regulatory Compliance and Safety Information (Informationen zu behördlichen Vorschriften und Sicherheit), das zusammen mit diesem Gerät geliefert wurde.
Questo simbolo di avvertenza indica un pericolo. La situazione potrebbe causare infortuni alle persone. Prima di lavorare su qualsiasi apparecchiatura, occorre conoscere i pericoli relativi ai circuiti elettrici ed essere al corrente delle pratiche standard per la prevenzione di incidenti. La traduzione delle avvertenze riportate in questa pubblicazione si trova nel documento Regulatory Compliance and Safety Information (Conformità alle norme e informazioni sulla sicurezza) che accompagna questo dispositivo.
Advarsel
Aviso
¡Advertencia!
Dette varselsymbolet betyr fare. Du befinner deg i en situasjon som kan føre til personskade. Før du utfører arbeid på utstyr, må du vare oppmerksom på de faremomentene som elektriske kretser innebærer, samt gjøre deg kjent med vanlig praksis når det gjelder å unngå ulykker. Hvis du vil se oversettelser av de advarslene som finnes i denne publikasjonen, kan du se i dokumentet Regulatory Compliance and Safety Information (Overholdelse av forskrifter og sikkerhetsinformasjon) som ble levert med denne enheten.
Este símbolo de aviso indica perigo. Encontra-se numa situação que lhe poderá causar danos físicos. Antes de começar a trabalhar com qualquer equipamento, familiarize-se com os perigos relacionados com circuitos eléctricos, e com quaisquer práticas comuns que possam prevenir possíveis acidentes. Para ver as traduções dos avisos que constam desta publicação, consulte o documento Regulatory Compliance and Safety Information (Informação de Segurança e Disposições Reguladoras) que acompanha este dispositivo.
Este símbolo de aviso significa peligro. Existe riesgo para su integridad física. Antes de manipular cualquier equipo, considerar los riesgos que entraña la corriente eléctrica y familiarizarse con los procedimientos estándar de prevención de accidentes. Para ver una traducción de las advertencias que aparecen en esta publicación, consultar el documento titulado Regulatory Compliance and Safety Information (Información sobre seguridad y conformidad con las disposiciones reglamentarias) que se acompaña con este dispositivo.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
xvii
Preface
Send documentation comments to mdsfeedback-doc@cisco.com.
Varning!
Denna varningssymbol signalerar fara. Du befinner dig i en situation som kan leda till personskada. Innan du utför arbete på någon utrustning måste du vara medveten om farorna med elkretsar och känna till vanligt förfarande för att förebygga skador. Se förklaringar av de varningar som förkommer i denna publikation i dokumentet Regulatory Compliance and Safety Information (Efterrättelse av föreskrifter och säkerhetsinformation), vilket medföljer denna anordning.

Related Documentation

The documentation set for the Cisco MDS 9000 Family includes the following documents. To find a document online, use the Cisco MDS NX-OS Documentation Locator at:
http://www.cisco.com/en/US/docs/storage/san_switches/mds9000/roadmaps/doclocater.htm.

Release Notes

Cisco MDS 9000 Family Release Notes for Cisco MDS NX-OS Releases
Cisco MDS 9000 Family Release Notes for Storage Services Interface Images
Cisco MDS 9000 Family Release Notes for Cisco MDS 9000 EPLD Images

Compatibility Information

Cisco MDS 9000 NX-OS Hardware and Software Compatibility Information
Cisco MDS 9000 Family Interoperability Support Matrix
Cisco MDS Storage Services Module Interoperability Support Matrix
Cisco MDS NX-OS Release Compatibility Matrix for Storage Service Interface Images

Regulatory Compliance and Safety Information

Regulatory Compliance and Safety Information for the Cisco MDS 9000 Family

Hardware Installation

Cisco MDS 9124 Multilayer Fabric Switch Quick Start Guide
Cisco MDS 9500 Series Hardware Installation Guide
Cisco MDS 9200 Series Hardware Installation Guide
Cisco MDS 9100 Series Hardware Installation Guide
xviii
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Preface
Send documentation comments to mdsfeedback-doc@cisco.com.

Cisco Fabric Manager

Cisco MDS 9000 Family Fabric Manager Quick Configuration Guide
Cisco MDS 9000 Family Fabric Manager Configuration Guide
Cisco MDS 9000 Family Fabric Manager Database Schema
Cisco MDS 9000 Family Data Mobility Manager Configuration Guide

Command-Line Interface

Cisco MDS 9000 Family Software Upgrade and Downgrade Guide
Cisco MDS 9000 Family Storage Services Module Software Installation and Upgrade Guide
Cisco MDS 9000 Family CLI Quick Configuration Guide
Cisco MDS 9000 Family CLI Configuration Guide
Cisco MDS 9000 Family Command Reference

Intelligent Storage Networking Services Configuration Guides

Cisco MDS 9000 Family Data Mobility Manager Configuration Guide
Cisco MDS 9000 Family Storage Media Encryption Configuration Guide
Cisco MDS 9000 Family Secure Erase Configuration Guide - For Cisco MDS 9500 and 9200 Series

Troubleshooting and Reference

Cisco MDS 9000 Family Troubleshooting Guide
Cisco MDS 9000 Family MIB Quick Reference
Cisco MDS 9000 Family SMI-S Programming Reference
Cisco MDS 9000 Family System Messages Reference

Installation and Configuration Note

Cisco MDS 9000 Family SSM Configuration Note
Cisco MDS 9000 Family Port Analyzer Adapter Installation and Configuration Note
Cisco 10-Gigabit X2 Transceiver Module Installation Note
Cisco MDS 9000 Family CWDM SFP Installation Note
Cisco MDS 9000 Family CWDM Passive Optical System Installation Note
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
xix
Preface
Send documentation comments to mdsfeedback-doc@cisco.com.

Obtaining Documentation, Obtaining Support, and Security Guidelines

For information on obtaining documentation, submitting a service request, and gathering additional information, see the monthly What’s revised Cisco
http://www.cisco.com/en/US/docs/general/whatsnew/whatsnew.html
Subscribe to the What’s New in Cisco Product Documentation as a Really Simple Syndication (RSS) feed and set content to be delivered directly to your desktop using a reader application. The RSS feeds are a free service and Cisco currently supports RSS version 2.0.
technical documentation, at:
New in Cisco Product Documentation, which also lists all new and
xx
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Send documentation comments to mdsfeedback-doc@cisco.com.
CHAP T ER
1

Product Overview

The Cisco MDS 9500 Multilayer Director elevates the standard for director-class switches. Providing industry-leading availability, scalability, security, and management, the Cisco MDS 9500 Series allows deployment of high-performance SANs with lowest total cost of ownership. Layering a rich set of intelligent features onto a high-performance, protocol-agnostic switch fabric, the Cisco MDS 9500 Series of Multilayer Directors addresses the stringent requirements of large data-center storage environments: uncompromisingly high availability, security, scalability, ease of management, and transparent integration of new technologies.
The Cisco MDS 9500 Series includes the Cisco MDS 9513 Director, the Cisco MDS 9509 Director, and the Cisco MDS 9506 Director, which all provide the following high availability features:
Redundant Supervisor-2 modules with associated external crossbar modules for the Cisco MDS
9513 Director.
Redundant Supervisor-2 modules with associated integrated crossbar modules for the Cisco MDS
9509 and 9506 Directors.
Redundant Supervisor-1 modules with dual switching fabrics for the Cisco MDS 9509 and 9506
Directors.
Optional hot-swappable switching or services modules.
OL-17467-02
Switching module port interfaces that support field-replaceable, hot-swappable, form-factor
pluggable X2 transceivers.
Switching module port interfaces that support field-replaceable, hot-swappable, small form-factor
pluggable (SFP) and Enhanced small form-factor pluggable (SFP+) transceivers.
Redundant and hot-swappable power supplies and fan modules.
Power and cooling management and environmental monitoring.
Nondisruptive code load and activation.
Redundant and self-monitoring system clocks.
For more information about high availability features, redundant supervisor operation, and how to configure the Cisco MDS 9500 Series, see the Cisco the Cisco MDS 9000 Family Fabric Manager Configuration Guide.
The Cisco MDS 9500 Series supports the following hot-swappable, field-replaceable modules:
48-port 8-Gbps Fibre Channel switching module (DS-X9248-96K9)
24-port 8-Gbps Fibre Channel switching module (DS-X9224-96K9)
4/44-port 8-Gbps Host-Optimized Fibre Channel switching module (DS-X9248-48K9)
MDS 9000 Family CLI Configuration Guide and
Cisco MDS 9500 Series Hardware Installation Guide
1-1
Chapter 1 Product Overview

Chassis

Send documentation comments to mdsfeedback-doc@cisco.com.
48-port 4-Gbps Fibre Channel switching module (DS-X9148)
24-port 4-Gbps Fibre Channel switching module (DS-X9124)
12-port 4-Gbps Fibre Channel switching module (DS-X9112)
4-port 10-Gbps Fibre Channel switching module (DS-X9704)
32-port 2-Gbps Fibre Channel switching module (DS-X9032)
16-port 2-Gbps Fibre Channel switching module (DS-X9016)
18/4-port Multiservice (MSM-18/4) module (DS-X9304-18K9)
18/4-port Multiservice FIPS (MSFM-18/4) module (DS-X9304-18FK9)
14/2-port Multiprotocol Services (MPS-14/2) module (DS-X9302-14K9)
8-port IP Storage Services (IPS-8) module (DS-X9308-SMIP)
4-port IP Storage Services (IPS-4) module (DS-X9304-SMIP)
Storage Services Module (SSM) (DS-X9032-SSM)
Advanced Services Module (ASM) (DS-X9032-SMV)
Caching Services Module (CSM) (DS-X9560-SMC)
Chassis
This chapter includes the following sections:
Chassis, page 1-2
Backplane and Clock Modules, page 1-8
Cisco MDS Fibre Channel Switch for IBM Blade Center, page 1-9
Power Supplies, page 1-9
Fan Modules, page 1-16
Supervisor Modules, page 1-16
Crossbar Modules, page 1-25
Cisco MDS 9000 Series Module Compatibility, page 1-27
Port Index Availability, page 1-28
Switching Modules, page 1-32
Services Modules, page 1-41
Supported Transceivers, page 1-55
This section describes the different chassis offerings in the Cisco MDS 9500 Series:
Cisco MDS 9513 Director, page 1-3
Cisco MDS 9509 Director, page 1-6
Cisco MDS 9506 Director, page 1-7
1-2
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 1 Product Overview
Chassis
Send documentation comments to mdsfeedback-doc@cisco.com.

Cisco MDS 9513 Director

The Cisco MDS 9513 Director is a 13-slot Fibre Channel switch. The front panel consists of 13 horizontal slots, where slots 1 to 6 and slots 9 to 13 are reserved for switching and services modules only, and slots 7 and 8 are for Supervisor-2 modules only. A variable speed fan tray, with 15 individual fans, is located on the front left panel of the chassis.
The Cisco MDS 9513 Director uses a midplane. Modules exist on both sides of the plane. (See
Figure 1-1.) The Cisco MDS 9513 Director supports the following:
Two Supervisor-2 modules that reside in slots 7 and 8.
Switching and storage services modules. (See the “Port Index Availability” section on page 1-28 for
possible configurations.)
One hot-swappable front panel fan tray with redundant individual fans.
Two power supplies located at the rear of the chassis. The power supplies are redundant by default
and can be configured to be combined if desired.
Two crossbar modules located at the rear of the chassis.
One hot-swappable fan module for the crossbar modules located at the rear of the chassis.
Two hot-swappable clock modules located at the rear of the chassis.
Note The Cisco MDS 9513 Director does not support the Advanced Services Module (ASM) or the Caching
Services Module (CSM).
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-3
Chapter 1 Product Overview
1
2
3
4
Chassis
Send documentation comments to mdsfeedback-doc@cisco.com.
Figure 1-1 Cisco MDS 9513 Chassis Front Panel View
1 Switching or services modules in slots 1–6 3 Switching or services modules in slots 9–13 2 Supervisor-2 modules in slots 7 and 8 4 Fan tray
The rear of the chassis supports two vertical, redundant power supplies, two clock modules, two vertical, redundant, external crossbar modules, and a variable speed fan tray with two individual fans located above the crossbar modules. (See
Figure 1-2.)
Cisco MDS 9500 Series Hardware Installation Guide
1-4
OL-17467-02
Chapter 1 Product Overview
144426
1
2
3
45
Chassis
Send documentation comments to mdsfeedback-doc@cisco.com.
Figure 1-2 Rear Panel 9513 Chassis
1 Power supplies 4 Air vent panels 2 crossbar module fans 5 Clock module
1
3 crossbar modules
1. Clock modules are located inside the air vent panel. You must remove the air vent panel to access the clock modules.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-5
Chapter 1 Product Overview
91692
1
4
5
6
8
7
2
3
Chassis
Send documentation comments to mdsfeedback-doc@cisco.com.

Cisco MDS 9509 Director

The Cisco MDS 9509 Director has a 9-slot chassis as shown in Figure 1-3, and it supports the following:
Redundant Supervisor-2 modules with associated internal crossbar modules.
Up to two Supervisor-1 modules that provide a switching fabric, plus a console port, COM1 port,
and a MGMT 10/100 Ethernet port on each module. Slots 5 and 6 are reserved for the supervisor modules.
Seven slots for optional modules that can include up to seven switching modules or six IPS modules.
Two power supplies located in the front of the chassis. The power supplies are redundant by default
and can be configured to be combined if desired.
One hot-swappable fan module with redundant fans.
Figure 1-3 Cisco MDS 9509 Chassis
1 Switching or services modules in
5 Fan module
slots 1–4
2 Supervisor module in slot 5 6 Power supply 1 3 Redundant supervisor module in
7 ESD socket
slot 6
4 Switching or services modules in
8 Power supply 2 (redundant)
slots 7–9
Cisco MDS 9500 Series Hardware Installation Guide
1-6
OL-17467-02
Chapter 1 Product Overview
91580
1
2
3
4
6
5
Chassis
Send documentation comments to mdsfeedback-doc@cisco.com.

Cisco MDS 9506 Director

The Cisco MDS 9506 Director has a 6-slot chassis as shown in Figure 1-4, and it supports the following:
Up to two Supervisor-1 modules that provide a switching fabric, with a console port, COM1 port,
and a MGMT 10/100 Ethernet port on each module. Slots 5 and 6 are reserved for the supervisor modules.
Four slots for optional modules that can include up to four switching modules or three IPS modules.
Two power supplies located in the back of the chassis. The power supplies are redundant by default
and can be configured to be combined if desired.
Two power entry modules (PEMs) in the front of the chassis for easy access to power supply
connectors and switches.
One hot-swappable fan module with redundant fans.
Figure 1-4 Cisco MDS 9506 Chassis
1 Switching or services modules in slots 1–4 4 ESD Socket 2 Supervisor modules in slots 5 and 6 5 Power supplies (in back) 3 Fan module 6 Location of power entry modules (PEMs) --
one PEM shown and one filler panel shown.
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
1-7
Chapter 1 Product Overview
181336
1
2
CLOCK A CLOCK B

Backplane and Clock Modules

Send documentation comments to mdsfeedback-doc@cisco.com.
Backplane and Clock Modules
The Cisco MDS 9500 Series includes one or more clock modules that are accessible from the back of the chassis. The Cisco MDS 9513 and 9509 Directors have two field-replaceable clock modules for redundancy and failover. The Cisco MDS 9506 Director has one field-replaceable clock module. In the unlikely event of a clock module failure, the Cisco MDS 9500 Series generates an error message and a switchover from one clock module to the other, causing the system to reset automatically. Cisco recommends that the failed clock module be replaced during a maintenance window. See the
and Installing Clock Modules” section on page 2-76 for information on replacing clock modules.
There are two LEDs per clock module. Figure 1-5 shows the upper and lower LEDs.
Figure 1-5 Clock Module LEDs
“Removing
Cisco MDS 9500 Series Hardware Installation Guide
1-8
1 Lower LEDs 2 Upper LEDs
Ta b l e 1-1 Clock LEDs for the Cisco MDS 9500 Series Directors
LED Status Description
Upper LED Green Clock module is active and in use.
Off Clock module is in standby mode.
Lower LED Green Power supply is on and working properly.
Red Power supply is not in a stable state. If this
indication continues after initial power on, check that all connections are secure.
Off Normal operation or power supply is turned off.
OL-17467-02
Chapter 1 Product Overview

Cisco MDS Fibre Channel Switch for IBM Blade Center

Send documentation comments to mdsfeedback-doc@cisco.com.
Cisco MDS Fibre Channel Switch for IBM Blade Center
The Cisco MDS Fibre Channel Bladeswitch for IBM BladeCenter is designed for IBM BladeCenter environments. The Cisco MDS Fibre Channel Bladeswitch is based on the Cisco MDS 9000 Family SAN switching technology, which integrates the Cisco MDS 9000 Family of switches and directors into a blade-switch architecture. The advanced architecture of the Cisco MDS Fibre Channel Bladeswitch for IBM BladeCenter, along with 4-Gb technology, provides outstanding performance between Bladeswitches and the rest of the Fibre Channel infrastructure.
The Cisco MDS Fibre Channel Bladeswitch for IBM BladeCenter provides 4-Gb Fibre Channel performance to blade-server switching. It also provides network intelligence features such as virtual SANs (VSANs), quality of service (QoS), and N-port interface virtualization (NPIV). It also offers nondisruptive software upgrades and on-demand port activation and is the most complete embedded Fibre Channel switching available for the IBM BladeCenter, BladeCenter-T, and BladeCenter-H platforms.
The Cisco MDS Fibre Channel Bladeswitch for IBM BladeCenter provides up to 20 nonblocking 1-, 2-, and 4-Gb Fibre Channel ports that are available in two configurations: 7 internal ports and 3 external ports, or 14 internal ports and 6 external ports. Each port provides line-rate performance up to 4-Gb without any performance loss for integrated features such as VSANs, QoS, or Network Address Translation (NAT). The Cisco MDS Fibre Channel Bladeswitch for IBM BladeCenter supports up to 16 VSANs per blade switch.
Each external port on the Cisco MDS FC Bladeswitch for IBM BladeCenter also provides line-rate performance up to 4-Gb for Inter-Switch Links (ISLs) or additional device connectivity such as storage or host bus adapters (HBAs).
The Cisco NX-OS software provides role-based access control (RBAC) for management access of the Cisco Fibre Channel Bladeswitch for IBM BladeCenter command-line interface (CLI) and Simple Network Management Protocol (SNMP). For more information, see the Cisco 9000 Family Command Reference.

Power Supplies

The Cisco MDS 9500 Series supports dual hot-swappable power supplies, each of which is capable of supplying sufficient power to the entire chassis should one power supply fail. The power supplies monitor their output voltage and provide status to the supervisor modules. To prevent the unexpected shutdown of an optional module, the power management software only allows a module to power up if adequate power is available.
The power supplies can be configured to be redundant or combined. By default, they are configured as redundant, so that if one fails, the remaining power supply can still power the entire system. For information about how to configure the power supplies, see the Cisco
Configuration Guide.
MDS 9000 CLI Family
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-9
Chapter 1 Product Overview
144466
3
2
1
Power Supplies
Send documentation comments to mdsfeedback-doc@cisco.com.

Cisco MDS 9513 Power Supplies

The Cisco MDS 9513 Director supports the 6000-W AC power supply (AC input). (See Figure 1-6.)
Figure 1-6 Cisco MDS 9513 Power Supply
1 Power supply switch 3 Power Supply LEDs 2 AC power connection
Cisco MDS 9500 Series Hardware Installation Guide
1-10
OL-17467-02
Chapter 1 Product Overview
Power Supplies
Send documentation comments to mdsfeedback-doc@cisco.com.
Table 1-2 describes the LEDs for the Cisco MDS 9513 Director power supplies.
Ta b l e 1-2 LEDs for the Cisco MDS 9513 Director Power Supplies
LED Status Description
Input 1 OK Green AC input at greater than 85 V is good and power
supply is functioning normally if two single 110 V or one single 220 V are connected.
Off Power supply is turned off or power is not
connected.
Input 2 OK Green AC input at greater than 85 V is good and power
supply is functioning normally if two single 110 V or one single 220 V are connected.
Off Power supply is turned off or power is not
connected.
INPUT 1 = 220VAC Green AC input is good at greater than 168 V and power
supply should function normally.
Off AC input is 163 V or less or power is not
connected.
INPUT 2 = 220VAC Green AC input is good at greater than 168 V and power
supply should function normally.
Off AC input is 163 V or less or power is not
connected.
FAN OK Green Power supply fans are operating properly.
Off Fan is not operating or power supply is off.
OUTPUT FAIL Red Power supply is not in a stable state. If this
indication continues after initial power on, check that all connections are secure, including the system fan tray.
Off Normal operation or power supply is turned off.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-11
Chapter 1 Product Overview
99370
INPUT
OK
FAN
OK
OUTPUT
FAIL
I
0
3
4
1
2
5
Power Supplies
Send documentation comments to mdsfeedback-doc@cisco.com.

Cisco MDS 9509 Power Supplies

The Cisco MDS 9509 Director supports the following types of power supplies:
4000-W AC power supply (AC input and DC output)
The 4000-W AC power supply has a permanently attached power cable, and it requires 220-VAC input. (See
3000-W AC power supply (AC input)
The 3000-W AC power supply requires 220 VAC to deliver 3000 W of power. If powered with 110
VAC, it delivers only 1400 W. (See Figure 1-8.)
2500-W AC power supply (AC input and DC output)
The 2500-W AC power supply requires 220 VAC to deliver 2500 W of power. If powered with 110 VAC, it delivers only 1300 W. (See
2500-W DC power supply (DC input and DC output)
The 2500-W DC power supply requires positive, negative, and ground wires. (See Figure 1-10).
Figure 1-7 4000-W AC Power Supply for the Cisco MDS 9509 Director
Figure 1-7.)
Figure 1-9.)
1 AC power connection 4 Power supply switch 2 Power supply LEDs 5 Permanent power cable 3 Captive screws
Cisco MDS 9500 Series Hardware Installation Guide
1-12
OL-17467-02
Chapter 1 Product Overview
144986
1
2
3
4
5 5
Power Supplies
Send documentation comments to mdsfeedback-doc@cisco.com.
Figure 1-8 3000-W AC Power Supply for the Cisco MDS 9509 Director
1 AC power connection 4 Power supply LEDs 2 Power cable 5 Captive screws 3 Power supply switch
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-13
Chapter 1 Product Overview
94992
IN
PU
T
OK
FAN
OK
O
UTP
UT
FAIL
I
0
4
3
1
5
2
99360
INPUT
OK
FAN
OK
OUTPUT
FAIL
I
0
1
23
4
5
Power Supplies
Send documentation comments to mdsfeedback-doc@cisco.com.
Figure 1-9 2500-W AC Power Supply for the Cisco MDS 9509 Director
1 AC power connection 4 Captive screws 2 Cable retention device 5 Power supply LEDs 3 Power supply switch
Figure 1-10 2500-W DC Power Supply for the Cisco MDS 9509 Director
1 Terminal block cover 4 Power supply switch 2 Power supply LEDs 5 Terminal block 3 Captive screw
1-14
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 1 Product Overview
INPUT OK
FAN OK
OUTPUT FAIL
94996
1
2
Power Supplies
Send documentation comments to mdsfeedback-doc@cisco.com.

Cisco MDS 9506 Power Supplies

The Cisco MDS 9506 Director supports the following types of power supplies:
1900-W AC power supply (AC input and DC output)
1900-W DC power supply (DC input and DC output)
Power is supplied to the Cisco MDS 9506 power supplies though PEMs in the front of the chassis. The AC power requires an AC PEM, and the DC power requires a DC PEM.
The 1900-W AC and DC power supplies are similar in appearance (see Figure 1-11), except for the label that indicates whether the power supply is AC or DC.
Figure 1-11 Cisco MDS 9506 Power Supply (1900-W AC or DC)
1 Power supply LEDs 2 Captive screws
Table 1-3 describes the power supply LEDs for the Cisco MDS 9509 and 9506 Directors.
Ta b l e 1-3 Power Supply LEDs for the Cisco MDS 9509 and 9506 Directors
LED Status Description
Input OK Green AC input is good and power supply is functioning
normally.
Off Power supply is turned off or is not seated
properly in the chassis.
Fan OK Green Power supply fans are operating properly.
Off Fan is not operating or power supply is off.
Output Fail Red Power supply is not in a stable state. If this
indication continues after initial power on, check that all connections are secure, including the system fan tray.
Off Normal operation or power supply is turned off.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-15
Chapter 1 Product Overview

Fan Modules

Send documentation comments to mdsfeedback-doc@cisco.com.
Fan Modules
The Cisco MDS 9513 Director has a front panel fan tray with 15 fans with an abrupt stop-to-fan rotation safety feature after power is disconnected or the fan tray is removed from the midplane. The Cisco MDS 9509 Director has a front panel fan module with nine fans and the Cisco MDS 9506 Director has a front panel fan module with six fans.
Sensors on the supervisor module monitor the internal air temperature. If the air temperature exceeds a preset lower-level threshold, the environmental monitor displays warning messages. If the air temperatures exceeds a preset higher-level threshold, the switch will shut down.
If one or more fans within the module fail, the Fan Status LED turns red and the module must be replaced. If the higher-level temperature threshold is not exceeded, the switch continues to run for five minutes after the fan module is removed. This allows you to swap out a fan module without having to bring the system down. For information on how to replace a fan module, see the
Installing Fan Modules” section on page 2-68.
The fan module has one status LED that indicates the following conditions:
Green—Fan module is operating normally.
Red—One or more fans failed. Fan module should be replaced.
“Removing and
Off—Fan module is not properly seated in the chassis or power supply has failed.
Caution The Cisco MDS 9000 Family switches have internal temperature sensors that are capable of shutting
down the system if the temperature at different points within the chassis exceed certain safety thresholds. To be effective, the temperature sensors require the presence of airflow; therefore, in the event a fan module is removed from the chassis, the Cisco MDS 9000 Family switches will be shut down after five minutes to prevent potentially undetectable overheating. However, the switches will shut down sooner if the higher-level temperature threshold is exceeded.
The Cisco MDS 9513 Director also has crossbar module fan trays located at the back of the chassis. There is one fan per crossbar module. There is one LED that provides operational status. shows the fan status LED on the Cisco MDS 9513 Director. To replace these fan modules, see the
“Removing and Installing Fan Modules” section on page 2-68.

Supervisor Modules

The Cisco MDS 9500 Series supports two types of supervisor modules: Supervisor-1 and Supervisor-2 modules. Both the supervisor modules provide the control and management functions for the Cisco MDS 9500 Series. The Cisco MDS 9500 Series supports two supervisor modules for redundancy. In the event of an internal component failure, the standby supervisor module takes over, if installed. This section discusses the following modules:
Supervisor-2 Modules, page 1-17 (DS-X9530-SF2-K9)
Figure 1-2
1-16
Supervisor-1 Modules, page 1-21 (DS-X9530-SF1-K9)
Note The internal bootflash installed on the modules are not field-replaceable units. Do not remove or replace
internal bootflash on the modules. Modifying the factory installed bootflash is not supported.
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 1 Product Overview
144472
7 8
3
4 95
2 6
1
Supervisor Modules
Send documentation comments to mdsfeedback-doc@cisco.com.

Supervisor-2 Modules

The Cisco MDS 9500 Series offers redundant, hot-swappable, Supervisor-2 modules. (See Figure 1-12.) Supervisor-2 modules can be used in the Cisco MDS 9509 and 9506 Directors in slots 5 and 6. Supervisor-2 modules must be used in slots 7 and 8 of the Cisco MDS 9513 Director.
Supervisor-2 modules provide an integrated crossbar switching fabric to connect all the switching modules when used in a Cisco MDS 9509 or 9506 Director. Single fabric configurations provide 720-Gbps full duplex speed with 80-Gbps full duplex bandwidth per switching module. Dual fabric configurations provide 1.4-Tbps speed with 160-Gbps full duplex bandwidth per switching module. This integrated crossbar switching fabric is disabled when a Supervisor-2 module is installed in a Cisco MDS 9513 Director. The Cisco MDS 9513 Director supports two external crossbar modules located at the rear of the chassis that handle this function. (For more information, see the
page 1-25.)
Figure 1-12 Cisco MDS 9500 Series Supervisor-2 Module
“Crossbar Modules” section on
1 Status, System, Active, and Power
Management LEDs
1
6 CompactFlash LED
2 Reset button 7 CompactFlash eject button 3 Console port 8 CompactFlash slot 4 MGMT 10/100/1000 Ethernet port
9 USB ports
(with integrated Link and Activity LEDs)
5 COM1 serial port
1. See Table 1-4 on page 1-20 for status LED descriptions.
The main functions and components of the Supervisor-2 modules are as follows:
Control and Management
Processor
Port Interfaces
LEDs on the Supervisor-2 Module
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-17
Chapter 1 Product Overview
Supervisor Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
Control and Management
The Supervisor-2 modules provide the following control and management features:
A redundant central arbiter that provides traffic control and access fairness.
A nondisruptive restart of a single failing process on the same supervisor.
A service running on the Supervisor-2 module keeps track of the high availability policy of each process and issues a restart when a process fails. The type of restart issued is based on the process’s capability:
Warm or stateful (state is preserved)
Cold or stateless (state is not preserved)
A nondisruptive switchover from the active Supervisor-2 to a redundant standby without loss of
traffic.
If the Supervisor-2 module has to be restarted, then the secondary Supervisor-2 (which is continuously monitoring the primary) takes over. Once a switchover has occurred and the failed Supervisor-2 has been replaced or restarted, operation does not switch back to the original primary Supervisor-2, unless it is forced to switch back or another failure occurs.
Processor
Port Interfaces
The Supervisor-2 module has a processor running at 1.4 GHz. It contains a PowerPC class processor and offers the following memory specifications:
Memory Bytes
DRAM 1 GB
1 internal CompactFlash card
1 external CompactFlash slot
1. The card stores software images.
2. The slot is for optional cards to store additional images, and for configuration, debugging, and syslog information.
3. NA = not applicable.
1
2
512 MB
3
NA
The Supervisor-2 module provides the following port interfaces:
RS-232 (EIA/TIA-232) console port with an RJ-45 connection that you can use to:
Configure the Cisco MDS 9500 Series from the CLI
Monitor network statistics and errors
Configure SNMP agent parameters
RS-232 COM1 port with a DB-9 connector, which can be attached to a modem.
Front panel triple speed (10/100/1000) management port with CTS function. This port is used as an
out-of-band management port. There are two LEDs associated with it. The Link LED on the left side indicates the link status and the Activity LED on the right side blinks when there is traffic going through this port.
1-18
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 1 Product Overview
Supervisor Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
Two USB ports provide a simple interface allowing you to connect to different devices supported by
Cisco MDS NX-OS. On the double decker connector, USB port 1 is on the lower position and port is on the upper position.
Supervisor CPU subsystem based on Motorola PowerPC 7447.
Reset button that resets the Supervisor-2 without cycling the power.
External CompactFlash slot for an optional CompactFlash card provides a convenient way to boot
different images, back up the image, or store running-configuration data. The optional card can be used for storing additional software images and configuration, debugging, and syslog information. There is one LED that blinks when accessing this CompactFlash.
Caution Use only the CompactFlash devices that are certified for use with Cisco MDS 9000 switches and are
formatted using Cisco MDS 9000 switches. Using CompactFlash devices that are uncertified or are formatted using other platforms may result in errors.
LEDs on the Supervisor-2 Module
The front panel on the supervisor module has the following LEDs:
2
Status LED
System LED
Active LED
Power Management LED
MGMT 10/100/1000 Ethernet port LEDs (at right of the port):
Link LED (on top)
Activity LED (on bottom)
CompactFlash LED for external CompactFlash card
The front panel on the Supervisor-2 module also includes a reset button (see Figure 1-13).
The LEDs on the Supervisor-2 module indicate the status of the Supervisor-2 module, power supplies, and fan module.
Figure 1-13 Supervisor-2 Module LEDs
Table 1-4 provides more information about these LEDs.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-19
Chapter 1 Product Overview
Supervisor Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
Ta b l e 1-4 LEDs for the Cisco MDS 9500 Series Supervisor-2 Modules
LED Status Description
Status Green All diagnostics pass. The module is operational
(normal initialization sequence).
Orange One of the following occurs:
The module is booting or running diagnostics
(normal initialization sequence).
An over-temperature condition occurred (a minor
threshold was exceeded during environmental monitoring).
Red One of the following occurred:
The diagnostic test failed. The module is not
operational because a fault occurred during the initialization sequence.
An over-temperature condition occurred (a major
threshold was exceeded during environmental monitoring).
System Green All chassis environmental monitors are reporting OK.
Orange One of the following occurred:
The power supply failed or the power supply fan
failed.
Incompatible power supplies are installed.
The redundant clock failed.
Red The temperature of the supervisor module exceeded
the major threshold.
Active Green The Supervisor-2 module is operational and active.
Orange The Supervisor-2 module is in standby mode.
Power Management
MGMT 10/100/1000 Ethernet Link
Green Sufficient power is available for all modules.
Orange Sufficient power is not available for all modules.
Green Link is up.
Off No link.
LED
MGMT 10/100 Ethernet Activity LED
Green Traffic is flowing through port.
Off No link or no traffic.
CompactFlash Green The external CompactFlash card is being accessed.
Off No activity.
1-20
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 1 Product Overview
77688
3 4 5 7 8
6
2
1
9
Supervisor Modules
Send documentation comments to mdsfeedback-doc@cisco.com.

Supervisor-1 Modules

The Cisco MDS 9509 and 9506 Directors support up to two Supervisor-1 or Supervisor-2 modules that can be installed in slots 5 and 6 only. The main functions and components of the Supervisor-1 modules are as follows:
Control and Management, page 1-21
Crossbar Switching Fabric, page 1-22
Processor, page 1-22
Port Interfaces, page 1-22
LEDs on the Supervisor-1 Module, page 1-23
Note Supervisor-1 is not supported on the Cisco MDS 9513 Director.
Figure 1-14 shows a Cisco MDS 9500 Series Supervisor-1 module.
Figure 1-14 Cisco MDS 9500 Series Supervisor-1 Module
Control and Management
1 Status, System, Active, and Pwr
Mgmt LEDs
1
6 CompactFlash LED
2 Reset button 7 CompactFlash eject button 3 Console port 8 CompactFlash slot 4 MGMT 10/100 Ethernet port (with
9 Asset tag
integrated Link and Activity LEDs)
5 COM1 serial port
1. See Table 1-5 on page 1-24 for status LED descriptions.
The supervisor modules provide the following control and management features:
A redundant central arbiter that provides traffic control and access fairness.
A nondisruptive restart of a single failing process on the same supervisor.
A kernel service running on the supervisor module keeps track of the high availability policy of each process and issues a restart when a process fails. The type of restart issued is based on the process’s capability:
Warm or stateful (state is preserved)
Cold or stateless (state is not preserved)
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-21
Chapter 1 Product Overview
Supervisor Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
If the kernel service cannot perform a warm restart of the process, it issues a cold restart.
A nondisruptive switchover from the active supervisor to a redundant standby without loss of traffic.
If the supervisor module has to be restarted, then the secondary supervisor (which is continuously monitoring the primary) takes over. Once a switchover has occurred and the failed supervisor has been replaced or restarted, operation does not switch back to the original primary supervisor, unless it is forced to switch back or another failure occurs.
Crossbar Switching Fabric
The Cisco MDS 9500 Series supervisor modules provide an integrated crossbar switching fabric to connect all the switching modules. Single fabric configurations provide 720-Gbps full duplex speed with 80-Gbps full duplex bandwidth per switching module. Dual fabric configurations provide 1.4-Tbps speed with 160-Gbps full duplex bandwidth per switching module.
The Cisco MDS 9500 Series supports redundant supervisor modules. Upon power up with slots 5 and 6 active, the supervisors negotiate to determine which one is active and which is the standby supervisor.
Each supervisor exchanges its own status and updates the signal quality error (SQE) status periodically. If the active supervisor becomes disabled, the standby supervisor switches over to become the active supervisor.
Dual supervisor modules provide dual crossbar switching fabrics for redundancy.
Processor
Port Interfaces
The Supervisor-1 module contains a Pentium III class processor. It has the following memory specifications:
Memory Bytes
DRAM 1 GB
1 internal CompactFlash card
1 external CompactFlash slot
1. The card stores software images.
2. The slot is for optional cards to store additional images, and for configuration, debugging, and syslog information.
3. NA = not applicable.
1
2
512 MB
3
NA
The Supervisor-1 module provides the following port interfaces:
RS-232 (EIA/TIA-232) console port with an RJ-45 connection that you can use to:
Configure the Cisco MDS 9500 Series from the CLI
Monitor network statistics and errors
Configure SNMP agent parameters
MGMT 10/100 Ethernet port with an RJ-45 connection that provides network management
capabilities.
1-22
RS-232 COM1 port with a DB-9 connector, which can be attached to a modem.
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 1 Product Overview
144853
Supervisor Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
CompactFlash slot for an optional CompactFlash card. The optional card can be used for storing
additional software images and configuration, debugging, and syslog information.
Caution Use only the CompactFlash devices that are certified for use with Cisco MDS switches and are formatted
using Cisco MDS switches. Using CompactFlash devices that are uncertified or are formatted using other platforms may result in errors.
LEDs on the Supervisor-1 Module
The front panel on the Supervisor-1 module has the following LEDs:
Status LED
System LED
Active LED
Power Management LED
MGMT 10/100 Ethernet port LEDs (at top of port):
Link LED (on left)
Activity LED (on right)
CompactFlash LED for external CompactFlash card
The front panel on the supervisor module also includes a reset button (see Figure 1-15).
The LEDs on the Supervisor-1 module indicate the status of the Supervisor-1 module, power supplies, and fan module.
Figure 1-15 Supervisor-1 Module LEDs
Table 1-5 provides more information about these LEDs.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-23
Chapter 1 Product Overview
Supervisor Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
Ta b l e 1-5 LEDs for the Cisco MDS 9500 Series Supervisor Modules
LED Status Description
Status Green All diagnostics pass. The module is operational
(normal initialization sequence).
Orange One of the following occurs:
The module is booting or running diagnostics
(normal initialization sequence).
An over-temperature condition occurred (a minor
threshold was exceeded during environmental monitoring).
Red One of the following occurs:
The diagnostic test failed. The module is not
operational because a fault occurred during the initialization sequence.
An over-temperature condition occurred (a major
threshold was exceeded during environmental monitoring).
System
1
Green All chassis environmental monitors are reporting OK.
Orange One of the following occurs:
The power supply failed or the power supply fan
failed.
Incompatible power supplies are installed.
The redundant clock failed.
Red The temperature of the supervisor module exceeded
the major threshold.
Active Green The supervisor module is operational and active.
Orange The supervisor module is in standby mode.
Pwr Mgmt
1
Green Sufficient power is available for all modules.
Orange Sufficient power is not available for all modules.
MGMT 10/100 Ethernet Link LED
MGMT 10/100 Ethernet Activity LED
Green Link is up.
Off No link.
Green Traffic is flowing through port.
Off No link or no traffic.
CompactFlash Green The external CompactFlash card is being accessed.
Off No activity.
1. The System and Pwr Mgmt LEDs on a redundant supervisor module are synchronized to the active supervisor module.
1-24
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 1 Product Overview
181335

Crossbar Modules

Send documentation comments to mdsfeedback-doc@cisco.com.
Crossbar Modules
The Cisco MDS 9513 Director supports two external crossbar modules located at the rear of the chassis. Each Supervisor-2 module has an associated external crossbar module for redundancy. The Supervisor-2 module in slot 7 is associated with crossbar module 1 and Supervisor-2 in slot 8 is associated with crossbar module 2. Redundant crossbar modules act in an active-active method, where each switching module forwards traffic across both crossbar fabrics based on the intended destination. The traffic load is shared across both crossbar modules. Each crossbar fabric channel connects to a fabric interface ASIC on the switching modules through serial links on the midplane. Each Supervisor-2 processor also has a 20-Gbps (40-Gbps FDX) link to each crossbar fabric for participating in management and control protocols and for in-band diagnostics.
The LEDs on the crossbar modules indicate the status of the crossbar modules. Tab le 1-6 provides more information about these LEDs.
For information regarding migrating to Generation 3 modules, see the “Migrating to Generation 3
8-Gbps Fibre Channel Switching Modules” section on page A-1.
Figure 1-16 Crossbar Module LEDs
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-25
Chapter 1 Product Overview
Crossbar Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
Ta b l e 1-6 LEDs for the Cisco MDS 9500 Crossbar Modules
LED Status Description
Status Green All diagnostics pass. The module is operational
(normal initialization sequence).
Orange One of the following occurs:
The module is booting or running diagnostics
(normal initialization sequence).
An over-temperature condition occurred (a minor
threshold was exceeded during environmental monitoring).
Red One of the following occurs:
The diagnostic test failed. The module is not
operational because a fault occurred during the initialization sequence.
An over-temperature condition occurred (a major
threshold was exceeded during environmental monitoring).
1-26
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 1 Product Overview

Cisco MDS 9000 Series Module Compatibility

Send documentation comments to mdsfeedback-doc@cisco.com.
Cisco MDS 9000 Series Module Compatibility
Table 1-7 lists the hardware modules available and the chassis compatibility associated with them.
Ta b l e 1-7 MDS 9000 Modules and Platform Compatibility Matrix
Module 9513 9509 9506 9222i 9216A 9216i 9216
Supervisor-2 module X X X
Supervisor -1 module X X
48-port 8-Gbps Fibre Channel switching module X X X
24-port 8-Gbps Fibre Channel switching module X X X
4/44-port 8-Gbps Host-Optimized Fibre Channel switching module
48-port 4-Gbps Fibre Channel switching module X X X X X X
24-port 4-Gbps Fibre Channel switching module X X X X X X
12-port 4-Gbps Fibre Channel switching module X X X X X X
4-port 10-Gbps Fibre Channel switching module X X X X X X
32-port 1-Gbps/2-Gbps Fibre Channel switching module X X X X X X
16-port 1-Gbps/2-Gbps Fibre Channel switching module X X X X X X
8-port Gigabit Ethernet IP Storage Services module X X X X X X X
4-port Gigabit Ethernet IP Storage Services module X X X X X X
32-port 1-Gbps/2-Gbps Fibre Channel Storage Services Module (SSM)
32-port Fibre Channel Advanced Services Module (ASM) X X X X X
Caching Services Module (CSM) X X X X X
18-port Fibre Channel and 4-port Gigabit Ethernet IP Services (MSM-18/4) module
18-port Fibre Channel and 4-port Gigabit Ethernet IP Services FIPS (MSFM-18/4) module
14-port Fibre Channel/2-port Gigabit Ethernet Multiprotocol Services (MPS-14/2) module
X X X X
X X X X X X X
X X X X X X
X X X X X X
X X X X X X
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-27
Chapter 1 Product Overview

Port Index Availability

Send documentation comments to mdsfeedback-doc@cisco.com.
Port Index Availability
The Cisco MDS 9500 Multilayer Directors are designed to operate with any combination of Cisco MDS 9000 modules. However, you should be aware of the maximum port availability your chassis can support. A port index is an internally assigned number that Cisco NX-OS uses to switch data packets within the director or fabric switch. When the maximum number of port indexes is reached in a chassis, any modules remaining or added to the chassis will not boot up. The number of physical ports on a Fibre Channel module is equal to its number of port indexes. However, for Gigabit Ethernet modules (IPS-8, IPS-4, MPS-14/2, MSM-18/4, and MSFM 18/4), one physical port is equal to four port indexes (one port index for iSCSI and three port indexes for FC IP tunnels). indexes (virtual ports) available per Cisco MDS 9000 module.
Ta b l e 1-8 Port Index Allocation
Module Physical Ports Port Indexes Allocated
48-port 8-Gbps Fibre Channel switching module 48 48
24-port 8-Gbps Fibre Channel switching module 24 24
4/44-port 8-Gbps Host-Optimized Fibre Channel switching module
48-port 4-Gbps Fibre Channel switching module 48 48
24-port 4-Gbps Fibre Channel switching module 24 24
12-port 4-Gbps Fibre Channel switching module 12 12
4-port 10-Gbps Fibre Channel switching module 4 4
16-port 2-Gbps Fibre Channel switching module 16 16
32-port 2-Gbps Fibre Channel switching module 32 32
8-port Gigabit Ethernet IP Storage Services module 8 32
4-port Gigabit Ethernet IP Storage Services module 4 32 (with Supervisor-1)
32-port 2-Gbps Fibre Channel Storage Services module (SSM)
18-port Fibre Channel and 4-port Gigabit Ethernet IP Multiservice module (MSM-18/4)
18-port Fibre Channel and 4-port Gigabit Ethernet IP Multiservice FIPS module (MSFM-18/4)
14-port Fibre Channel/2-port Gigabit Ethernet Multiprotocol Services (MPS-14/2) module
1. All Generation 1 modules reserve port indexes on fixed boundaries with Supervisor-1. See Table 1-9.
2. 18 Fibre Channel ports and four Gigabit Ethernet ports.
3. 18 Fibre Channel ports and four Gigabit Ethernet ports.
4. 14 Fibre Channel ports and two Gigabit Ethernet ports.
Table 1-8 lists the physical ports and port
48 48
1
1
1
16 (with Supervisor-2)
32 32
2
22
3
22
4
16
1
34
34
32 (with Supervisor-1) 22 (with Supervisor-2)
1-28
Using any combination of modules that include a Generation 1 module or a Supervisor-1 module limits the port index availability to 252 on all Cisco MDS 9500 Series directors. Generation 1 modules also require contiguous port indexes where the system assigns a block of port index numbers contiguously starting from the first port index reserved for the slot that the module is inserted in (See
Cisco MDS 9500 Series Hardware Installation Guide
Table 1-9). This
OL-17467-02
Chapter 1 Product Overview
Port Index Availability
Send documentation comments to mdsfeedback-doc@cisco.com.
means that while there may be enough port indexes available for a Generation 1 module, the module may not boot up because the available port indexes are not in a contiguous range or the contiguous block does not start at the first port index for a given slot.
Example 1-1 shows a scenario with a Supervisor-1 module, where a 48-port Generation 2 module
borrowed port indexes from the first slot. Slot 1 still has 16 port indexes available, but the full 32 indexes are no longer available (28-31 are used by the module in slot 4). This means that no Generation 1 module except a 16-port Fibre Channel switching module can be inserted into slot 1 because some of the port indexes for the slot are already in use.
Example 1-1 Borrowing Port Indexes from Another Slot
switch# show port index-allocation Module index distribution:
---------------------------------------------------+ Slot | Allowed | Alloted indices info | | range* | Total | Index values |
-------|---------|-------|-------------------------| 1 | 0- 31| - | - | 2 | 32- 63| 32 | 32-63 | 3 | 64- 95| 48 | 64-95,224-239 | 4 | 96- 127| 48 | 96-127, 240-252, 28-31 | 7 | 128- 159| 32 | 128-159 | 8 | 160- 191| 32 | 160-191 | 9 | 192- 223| 32 | 192-223 | SU | 253-255 | 3 | 253-255 | *Allowed range applicable only for Generation-1 modules
Using any combination of modules that include a Generation 1 module and a Supervisor-2 module limits the port index availability to 252 on all Cisco MDS 9500 Series Directors. The Generation 1 modules can use any contiguous block of port indexes that start on the first port index reserved for any slot in the range 0-252. (See
Table 1-9.)
Using any combination of only Generation 2 with a Supervisor-2 module allows a maximum of 528 (with an architectural limit of 1020) port indexes on all Cisco MDS 9500 Series Directors. Generation 2 modules do not need contiguous port indexes. Generation 2 modules use the available indexes in the slot that it is installed and then borrow available indexes from the supervisors. If the module requires more indexes, it starts borrowing available indexes from slot 1 of the chassis until it has the number of port indexes necessary.
Note Enter the purge module CLI command to free up reserved port indexes after you remove a module.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-29
Chapter 1 Product Overview
Port Index Availability
Send documentation comments to mdsfeedback-doc@cisco.com.
Ta b l e 1-9 Port Index Requirements
Supervisor Module Port Index Requirements
Supervisor-1 Generation 1 Indexes must be:
Contiguous
In the range assigned to the given slot
Start with the lowest value assigned to
that slot
Maximum 252 assignable port indexes available,
Generation 2 Indexes can be any available number in the
range 0–252.
Supervisor-2 Generation 1 Indexes must be contiguous, but can be any
available contiguous block in the range 0–252.
Generation 2 Indexes can be any available number in the
range 0–1020 if all modules are Generation 2 modules. Otherwise, indexes can be any available number in the range 0–252.
Table 1-10 shows a valid sample configuration for maximum capacity within the port index limits. The
table lists a mixture of Generation 1 and Generation 2 modules on a Cisco MDS 9509 Director.
Ta b l e 1-10 Sample Chassis Configuration on a Cisco MDS 9509 Director (Valid)
Slot No. Modules in Cisco MDS 9509 Director Generation
Physical Ports
Port Indexes
1 12-port 4-Gbps Fibre Channel switching module 1 12 12
2 48-port 4-Gbps Fibre Channel switching module 2 48 48
3 48-port 4-Gbps Fibre Channel switching module 2 48 48
4 48-port 4-Gbps Fibre Channel switching module 2 48 48
5 Supervisor-1 1
6 Supervisor-1 1
7 48-port 4-Gbps Fibre Channel switching module 2 48 48
8 48-port 4-Gbps Fibre Channel switching module 2 48 48
9
Tot al s 252 252
Table 1-11 shows a sample configuration that exceeds the port index limit. The table lists a mixture of
Generation 1 storage IPS modules and Generation 2 modules on a Cisco MDS 9509 Director. In this example, one of the modules installed will not boot up because the number of port indexes needed has been exceeded.
1-30
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 1 Product Overview
Port Index Availability
Send documentation comments to mdsfeedback-doc@cisco.com.
Ta b l e 1-11 Maximum Chassis Configuration on a Cisco MDS 9509 Director (Exceeded)
Slot No. Modules in Cisco MDS 9509 Director Generation
1 18-port Fibre Channel and 4-port Gigabit Ethernet IP
2 22 34
Physical Ports
Port Indexes
Multiservice module (MSM-18/4)
2 14-port Fibre Channel/2-port Gigabit Ethernet
1 16 22
Multiprotocol Services (MPS-14/2) module
3 8-port Gigabit Ethernet IP Storage Services module 1 8 32
4 4-port Gigabit Ethernet IP Storage Services module 1 4 16
5 48-port 4-Gbps Fibre Channel switching module 2 48 48
6 Supervisor-1 1
7 Supervisor-1 1
8 48-port 4-Gbps Fibre Channel switching module 2 48 48
9 48-port 4-Gbps Fibre Channel switching module 2 48 48
10 48-port 4-Gbps Fibre Channel switching module 2 48 48
Tot al s 240 296
Using any combination of modules that include a Generation 1 module and a Supervisor-2 module limits the port index availability to 252 on all Cisco MDS 9500 Series Directors. But the Generation 1 modules can use any contiguous block of port indexes in the range 0–252 (See
Table 1-9).
Using any combination of only Generation 2 with a Supervisor-2 module allows a maximum of 528 (with an architectural limit of 1020) port indexes on all Cisco MDS 9500 Series Directors. Generation 2 modules do not need contiguous port indexes. Generation 2 modules will use the available ports in the slot that it is installed and then borrow available ports from the supervisors, and then restart at slot 1 of the chassis until it has the number of port indexes necessary.
Table 1-12 shows a valid sample configuration for maximum capacity within the port index limits. The
table only lists Generation 2 modules in a Cisco MDS 9513 Director.
OL-17467-02
Ta b l e 1-12 Maximum Chassis Configuration on a Cisco MDS 9513 Director (Valid)
Physical
Slot No. Modules in Cisco MDS 9513 Director Generation
Ports
1 48-port 4-Gbps Fibre Channel switching module 2 48 48
2 48-port 4-Gbps Fibre Channel switching module 2 48 48
3 48-port 4-Gbps Fibre Channel switching module 2 48 48
4 48-port 4-Gbps Fibre Channel switching module 2 48 48
5 48-port 4-Gbps Fibre Channel switching module 2 48 48
6 48-port 4-Gbps Fibre Channel switching module 2 48 48
7 Supervisor-2 2
8 Supervisor-2 2
9 48-port 4-Gbps Fibre Channel switching module 2 48 48
10 48-port 4-Gbps Fibre Channel switching module 2 48 48
Cisco MDS 9500 Series Hardware Installation Guide
Port Indexes
1-31
Chapter 1 Product Overview

Switching Modules

Send documentation comments to mdsfeedback-doc@cisco.com.
Table 1-12 Maximum Chassis Configuration on a Cisco MDS 9513 Director (Valid) (continued)
Slot No. Modules in Cisco MDS 9513 Director Generation
11 48-port 4-Gbps Fibre Channel switching module 2 48 48
12 48-port 4-Gbps Fibre Channel switching module 2 48 48
13 48-port 4-Gbps Fibre Channel switching module 2 48 48
Tot al s 528 528
Switching Modules
The Cisco MDS 9500 Series supports the following hot-swappable Fibre Channel switching modules:
Generation 3 modules
48-port 8-Gbps Fibre Channel Switching Module
24-port 8-Gbps Fibre Channel Switching Module
4/44-port 8-Gbps Host-Optimized Fibre Channel Switching Module
Generation 2 modules
48-Port 4-Gbps Fibre Channel Switching Module
24-port 4-Gbps Fibre Channel Switching Module
12-port 4-Gbps Fibre Channel Switching Module
4-port 10-Gbps Fibre Channel Switching Module
Generation 1 modules
Physical Ports
Port Indexes
32-Port 2-Gbps Fibre Channel Switching Module
16-Port 2-Gbps Fibre Channel Switching Module
The Cisco MDS 9500 Series supports up to eleven hot-swappable switching modules. By combining different switching modules in a single, modular chassis, you can design cost and performance optimized storage networks in a wide range of application environments.
The Fibre Channel switching modules provide system-wide power management and autonegotiation, which allows ports to negotiate for speed at the other end of the link. Each module has temperature sensors and an EEPROM that stores serial number and model number information.
The Fibre Channel port interfaces support hot-swappable Fibre Channel SFP and SFP+ transceivers, which can be short wavelength (SWL) or long wavelength (LWL). The port interfaces also support coarse wavelength-division multiplexing (CWDM) and dense wavelength-division multiplexing (DWDM) SFP transceivers, which can be used for extended long wavelength (ELWL) transmission or for coarse wavelength-division multiplexing (CWDM) and dense wavelength-division multiplexing (DWDM). See the
Note The internal bootflash installed on the modules are not field-replaceable units. Do not remove or replace
“Supported Transceivers” section on page 1-55.
internal bootflash on the modules. Modifying the factory-installed bootflash is not supported.
For configuration information about the modules, see the Cisco MDS 9000 Family CLI Configuration Guide or the Cisco MDS 9000 Family Fabric Manager Configuration Guide.
1-32
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 1 Product Overview
Switching Modules
Send documentation comments to mdsfeedback-doc@cisco.com.

48-port 8-Gbps Fibre Channel Switching Module

The 48-Port 8-Gbps Fibre Channel switching module offers 48 autosensing 1-, 2-, 4- and 8-Gbps Fibre Channel ports and can be used in the Cisco MDS 9500 Series Switches. The 48-port switching module can be configured in one of two operational modes: shared bandwidth mode (default) and dedicated bandwidth mode.
Figure 1-17 shows a 48-port 8-Gbps Fibre Channel switching module. The front panel connectors
support standard modular SFP and SFP+ transceivers and the speed detection is autosensing.
Figure 1-17 48-Port 8-Gbps Fibre Channel Switching Module
188655

24-port 8-Gbps Fibre Channel Switching Module

The 24-Port 8-Gbps Fibre Channel switching module offers 24 autosensing 1-, 2-, 4- and 8-Gbps Fibre Channel ports and can be used in the Cisco MDS 9500 Series Switches. The 24-port switching module can be configured in one of two operational modes: shared bandwidth mode (default) and dedicated bandwidth mode.
Figure 1-18 shows a 24-port 8-Gbps Fibre Channel switching module. The front panel connectors
support standard modular SFP and SFP+ transceivers and the speed detection is autosensing.
Figure 1-18 24-Port 8-Gbps Fibre Channel Switching Module

4/44-port 8-Gbps Host-Optimized Fibre Channel Switching Module

The 4/44-port 8-Gbps Host-Optimized Fibre Channel switching module offers 48 autosensing 1-, 2-, 4­and 8-Gbps Fibre Channel ports and can be used in any of the Cisco MDS 9500 Series chassis and in the Cisco MDS 9222i Switches. The 48-port switching module can be configured in one of two operational modes: shared bandwidth mode (default) and dedicated bandwidth mode.
Figure 1-19 shows a 4/44-port 8-Gbps Host-Optimized Fibre Channel switching module. The front panel
connectors support standard modular SFP and SFP+ transceivers and the speed detection is autosensing.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-33
Chapter 1 Product Overview
144474
144809
1
2
3
Switching Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
Figure 1-19 4/44-port 8-Gbps Host-Optimized Fibre Channel Switching Module
188657

48-Port 4-Gbps Fibre Channel Switching Module

The 48-port 4-Gbps Fibre Channel switching module offers 48 autosensing 1-, 2-, and 4-Gbps Fibre Channel ports and can be used in any of the Cisco MDS 9500 Series chassis and in the Cisco MDS 9216i and 9216A Switches. The 48-port switching module can be configured in one of two operational modes: shared bandwidth mode (default) and dedicated bandwidth mode.
Figure 1-20 shows a 48-port 4-Gbps Fibre Channel switching module. The front panel connectors
support standard modular SFP and the speed detection is autosensing.
Figure 1-20 48-Port 4-Gbps Fibre Channel Switching Module
Figure 1-21 shows the port numbering and LEDs on the 48-port 4-Gbps Fibre Channel switching
module.
Figure 1-21 48-Port 4-Gbps Fibre Channel Switching Module LEDs
1 Status LED 3 Fibre Channel ports 2 Link LEDs
1-34
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 1 Product Overview
144471
2
34
1
144470
3
2
1
Switching Modules
Send documentation comments to mdsfeedback-doc@cisco.com.

24-port 4-Gbps Fibre Channel Switching Module

The 24-port 4-Gbps Fibre Channel switching module offers 24 autosensing 1-, 2-, and 4-Gbps Fibre Channel ports and can be used in any of the Cisco MDS 9500 Series chassis and in the Cisco MDS 9216i and 9216A Switches. The 24-port switching module can be configured in one of two operational modes: shared bandwidth mode (default) and dedicated bandwidth mode.
Figure 1-22 shows a 24-port 4-Gbps Fibre Channel switching module. The front panel connectors
support standard modular SFP and the speed detection is autosensing.
Figure 1-22 24-Port 4-Gbps Fibre Channel Switching Module
1 Status LED 3 Fibre Channel ports 2 Link LEDs 4 Port group

12-port 4-Gbps Fibre Channel Switching Module

The 12-port 4-Gbps Fibre Channel switching module can be used in any of the Cisco MDS 9500 Series chassis and in the Cisco MDS 9216i and 9216A Switches. The 12-port 4-Gbps switching module is a full rate mode module providing 12 SPF-based Fibre Channel interfaces. Each interface is capable of supporting full line rate operation at 4-Gbps interface speed. The module delivers a sustained data rate of up to 4 Gbps in each direction, on all ports simultaneously, and up to 96 Gbps of continuous, aggregate bandwidth when attached to high-performance servers and storage subsystems.
Figure 1-23 shows a 12-port 4-Gbps Fibre Channel switching module. The front panel connectors
support standard modular SFP and the speed detection is autosensing.
Figure 1-23 12-Port 4-Gbps Fibre Channel Switching Module
1 Status LED 3 Link LEDs 2 Fibre Channel ports
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-35
Chapter 1 Product Overview
144473
2
3
1
Switching Modules
Send documentation comments to mdsfeedback-doc@cisco.com.

4-port 10-Gbps Fibre Channel Switching Module

The 4-port 10-Gbps Fibre Channel switching module offers four dedicated bandwidth Fibre Channel ports running at 10 Gbps with no oversubscription. This module can be used in any of the Cisco MDS 9500 Series chassis and in the Cisco MDS 9216i and 9216A Switches. The module delivers a sustained data rate of up to 10 Gbps in each direction, on all ports simultaneously, and up to 80 Gbps of continuous, aggregate bandwidth.
Figure 1-24 shows a 4-port 10-Gbps switching module. The front panel connectors support standard
modular X2 interfaces and the speed is fixed at 10 Gbps.
Figure 1-24 4-Port 10-Gbps Fibre Channel Switching Module
1 Status LED 3 Link LED 2 X2 port interfaces
Cisco MDS 9500 Series Hardware Installation Guide
1-36
OL-17467-02
Chapter 1 Product Overview
Switching Modules
Send documentation comments to mdsfeedback-doc@cisco.com.

LEDs on the Generation 2 Switching Modules

Table 1-13 describes the LEDs for the 48-port, 24-port, and 12-port 4-Gbps Fibre Channel switching
modules and the 4-port 10-Gbps Fibre Channel switching module.
Ta b l e 1-13 LEDs for the Cisco MDS 9000 Family Generation 2 Fibre Channel Switching Modules
LED Status Description
Status Green All diagnostics pass. The module is operational
(normal initialization sequence).
Orange One of the following occurs or occurred:
The module is booting or running diagnostics
(normal initialization sequence).
The inlet air temperature of the system has
exceeded the maximum system operating temperature limit (a minor environmental warning). To ensure maximum product life, you should immediately correct the environmental temperature and restore the system to normal operation.
Red One of the following occurs or occurred:
The diagnostic test failed. The module is not
operational because a fault occurred during the initialization sequence.
The inlet air temperature of the system has
exceeded the safe operating temperature limits of the card (a major environmental warning). The card has been shut down to prevent permanent damage.
Link Solid green Link is up.
Intermittent flashing green
Solid yellow Link is disabled by software.
Flashing yellow
Off No link.
Link is up (traffic on port).
A fault condition exists.

32-Port 2-Gbps Fibre Channel Switching Module

The 32-port 2-Gbps Fibre Channel switching module can be used to allocate bandwidth optimally. The module is organized into eight four-port groups. Only the first port in each four-port group can be an ISL. If the first port is an ISL, the other three ports in the group are disabled. The four ports within a port group share a single internal channel resulting in a subscription ratio of approximately 3.2 to 1. The 32-port 2-Gbps switching module provides more ports at a lower price per port. 32-port switching module.
Figure 1-25 shows a
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-37
Chapter 1 Product Overview
91673
2
1 4
3
17 20
4
DS-X9032
5
21 24
89
25 28
12 13
29 32
16
91672
4
3
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
2
1
Switching Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
Tip For a full 2-Gbps bandwidth between two hosts, connect one host to the first port group and the second
host to the second port group.
Figure 1-25 Cisco MDS 9000 Family 32-Port 2-Gbps Switching Module
1 Status LED 3 Link LEDs (under ports, on left) and
Speed LEDs (under ports, on right)
2 1-Gbps/2-Gbps Fibre Channel port
group
4 Asset tag

16-Port 2-Gbps Fibre Channel Switching Module

The 16-port 2-Gbps switching module supports a sustained data rate of up to 2-Gbps in each direction, on all ports simultaneously. The autosensing 2-Gbps ports of the 16-port Fibre Channel switching module deliver up to 64-Gbps of continuous, aggregate bandwidth when attached to high-performance servers and storage subsystems.
Figure 1-26 Cisco MDS 9000 Family 16-Port 2-Gbps Switching Module
1 Status LED 3 Link LEDs (under ports, on left) and
2 1-Gbps/2-Gbps Fibre Channel
ports
Figure 1-26 shows a 16-port 2-Gbps switching module.
Speed LEDs (under ports, on right)
4 Asset tag
Cisco MDS 9500 Series Hardware Installation Guide
1-38
OL-17467-02
Chapter 1 Product Overview
Switching Modules
Send documentation comments to mdsfeedback-doc@cisco.com.

Switching Module Features

Each switching module draws its power from the 42 V supplied on the backplane with local DC/DC power converters and regulators.
The control processor on the switching module provides power-on, offline, and online diagnostics. The control processor can be used for configuring devices on the switching module and to gather statistical data from each port.
The control processor can determine which slot it is plugged into, and it can monitor its DC/DC power source and temperature. The control processor signals the supervisor module and displays an alarm on its front panel when a problem is detected.
The front panel on the switching module provides basic status information, such as power-on, self-test running, self-test passed, alarm, and ready.
The binary image for the switching module is downloaded from the supervisor module. Prior to the image download, the control processor on the switching module runs from code stored on its local CompactFlash card.
Note Routine software downloads are not required.
The supervisor module can force a reset on the switching module and controls whether power is applied to the switching module.
If a single component or a set of components on the switching module fails, this does not disable other switching modules if that is the only failure in the system.
Each switching module has a hardware watchdog timer for detecting most component failures. This watchdog resets the card if is not serviced periodically.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-39
Chapter 1 Product Overview
Switching Modules
Send documentation comments to mdsfeedback-doc@cisco.com.

LEDs on the Generation 1 Switching Module

Table 1-14 describes the LEDs for the 16-port and 32-port switching modules.
Ta b l e 1-14 LEDs for the Cisco MDS 9000 Family Generation 1 Fibre Channel Switching Modules
LED Status Description
Status Green All diagnostics pass. The module is operational
(normal initialization sequence).
Orange One of the following occurs or occurred:
The module is booting or running diagnostics
(normal initialization sequence).
The inlet air temperature of the system has
exceeded the maximum system operating temperature limit (a minor environmental warning). To ensure maximum product life, you should immediately correct the environmental temperature and restore the system to normal operation.
Red One of the following occurs or occurred:
The diagnostic test failed. The module is not
operational because a fault occurred during the initialization sequence.
The inlet air temperature of the system has
exceeded the safe operating temperature limits of the card (a major environmental warning). The card has been shut down to prevent permanent damage.
Speed On 2-Gbps mode.
Off 1-Gbps mode.
Steady
Link is up (beacon used to identify port).
1
flashing green
Link Solid green Link is up.
Intermittent
Link is up (traffic on port).
flashing green
Solid yellow Link is disabled by software.
Flashing
A fault condition exists.
yellow
Off No link.
1. The flashing green light turns on automatically when an external loopback is detected that causes the interfaces to be isolated. The flashing green light overrides the beacon mode configuration. The state of the LED is restored to reflect the beacon mode configuration after the external loopback is removed.
1-40
The Fibre Channel switching modules provide autoconfiguring Fibre Channel ports that support Fibre Channel speeds of 1.0625 the Cisco
Cisco MDS 9500 Series Hardware Installation Guide
MDS 9000 Family CLI Configuration Guide.
Gbps and 2.125 Gbps. For more information about supported port types, see
OL-17467-02
Chapter 1 Product Overview

Services Modules

Send documentation comments to mdsfeedback-doc@cisco.com.
Services Modules
The Cisco MDS 9500 Series supports the following hot-swappable Generation 1 services modules:
18/4-Port Multiservice Module, page 1-41
18/4-Port Multiservice Federal Information Processing Standards Module, page 1-42
14/2-Port Multiprotocol Services Module, page 1-44
IP Storage Services Modules, page 1-46
32-Port Fibre Channel Advanced Services Module, page 1-48
32-Port Fibre Channel Storage Services Module, page 1-50
Caching Services Module, page 1-52
Note The internal bootflash installed on the modules are not field-replaceable units. Do not remove or replace
internal bootflash on the modules. Modifying the factory installed bootflash is not supported.

18/4-Port Multiservice Module

The Cisco MDS 9000 Family 18/4-port Multiservice (MSM-18/4) module provides 18 autosensing 1-, 2-, and 4-Gbps Fibre Channel ports and four Gigabit Ethernet IP services ports. The MSM-18/4 module provides multiprotocol capabilities such as Fibre Channel, Fibre Channel over IP (FCIP), Small Computer System Interface over IP (iSCSI), IBM Fiber Connectivity (FICON), and FICON Control Unit Port (CUP) management.
The MSM-18/4 module provides18 4-Gbps Fibre Channel interfaces for high-performance SAN and mainframe connectivity and four Gigabit Ethernet ports for FCIP and iSCSI storage services. Individual ports can be configured with hot-swappable shortwave, longwave, extended-reach, coarse wavelength-division multiplexing (CWDM) or dense wavelength-division multiplexing (DWDM) Small Form-Factor Pluggables (SFPs) for connectivity up to 125 miles (200 km).
The MSM-18/4 module can minimize latency for disk and tape through FCIP write acceleration and FCIP tape write and read acceleration. The MSM-18/4 module provides up to 16 virtual Inter-Switch Link (ISL) connections on the four 1-Gigabit Ethernet ports through tunneling, and provides up to 4095 buffer-to-buffer credits that can be assigned to a single Fibre Channel port.
The MSM-18/4 supports hardware-based encryption and it is required to run the Storage Media Encryption (SME) which, is a part of the Cisco NX-OS. For more information on SME, see the Cisco MDS Storage Media Encryption Guide.
The MSM-18/4 supports SAN extension over IP and is compatible with current SAN extension products, such as MPS-14/2, 9216i, and IPS. The MSM-18/4 provides an integrated next generation 4-Gbps FC platform for SAN extension. The MSM-18/4 module supports Internet Protocol version 6 (IPv6) as mandated by the U.S. Department of Defense (DoD), Japan, and China. The IPv6 support is provided for FCIP, iSCSI, and management traffic routed in-band and out-of-band.
The MSM-18/4 provides intelligent diagnostics, protocol decoding, and network analysis tools with the integrated Call Home capability.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-41
Chapter 1 Product Overview
184706
1
2
4
3
Services Modules
Send documentation comments to mdsfeedback-doc@cisco.com.

18/4-Port Multiservice Federal Information Processing Standards Module

The Cisco MDS 9000 Family 18/4-port Multiservice FIPS (MSFM-18/4) module is a FIPS 140-2 Level 3-compliant version of the MSM-18/4 module. The MSFM-18/4 module is identical to the MSM-18/4 module in form and function, with the exception of an opaque potting material encapsulating the cryptographic boundary of the MSFM-18/4 module to prevent unauthorized access and tampering.
Note Cisco MDS 9500 Series switches running Cisco MDS SAN-OS Release 3.2(1) or later, or NX-OS
Release 4.1(1b) support the MSM-18/4 and the MSFM-18/4 module.
Figure 1-27 shows the MSM-18/4 module.
Figure 1-27 18/4-Port Multiservice Module
1 Status LED 3 Gigabit Ethernet ports 2 1-Gbps/2-Gbps/4-Gbps Fibre Channel ports 4 Link LEDs
1-42
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 1 Product Overview
Services Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
LEDs on the 18/4-Port Multiservice Module
Table 1-15 describes the LEDs for the 18/4-port Multiservice module.
Ta b l e 1-15 LEDs for the Cisco MDS 9000 Family 18/4-Port Multiservice Modules
LED Status Description
Status Green All diagnostics pass. The module is operational (normal
initialization sequence).
Orange One of the following occurs or occurred:
The module is booting or running diagnostics (normal
initialization sequence).
The inlet air temperature of the system exceeded the
maximum system operating temperature limit (a minor environmental warning). To ensure maximum product life, you should immediately correct the environmental temperature and restore the system to normal operation.
Red One of the following occurred:
Link Solid
green
Solid yellow
Flashing yellow
Off No link.
The diagnostic test failed. The module is not operational
because a fault occurred during the initialization sequence.
The inlet air temperature of the system exceeded the safe
operating temperature limits of the card (a major environmental warning). The card shut down to prevent permanent damage.
Link is up.
Link is disabled by software.
A fault condition exists.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-43
Chapter 1 Product Overview
Services Modules
Send documentation comments to mdsfeedback-doc@cisco.com.

14/2-Port Multiprotocol Services Module

The 14/2-port Multiprotocol Services (MPS-14/2) module provides 14 2-Gbps Fibre Channel autosensing ports and two 1-Gigabit Ethernet ports for iSCSI and FCIP over Gigabit Ethernet. The MPS-14/2 module supports the intelligent features available on other modules, including VSANs, security, and traffic management.
The 14 2-Gbps autosensing Fibre Channel ports (labeled 1 through 14) are best used for applications requiring high bandwidth; for example, Inter-Switch Link (ISL) connections between switches and high-performance host or storage controllers. Each Fibre Channel port supports a sustained data rate of up to 2
Gbps in each direction.
The Cisco 9513 supports up to seven MPS-14/2 modules. The Cisco MDS 9509 supports up to seven MPS-14/2 modules. The Cisco MDS 9506 supports up to four MPS-14/2 modules. The two Gigabit Ethernet ports (labeled 1 and 2) provide 1-Gbps throughput for IP services, including iSCSI and FCIP over Gigabit Ethernet. The MPS-14/2 also supports hardware-based encryption and compression for these Gigabit Ethernet ports. This hardware-based encryption handles the computationally intensive IPsec feature for IP services.
The MPS-14/2 modules support FCIP compression to maximize the effective WAN bandwidth of SAN extension solutions. It achieves up to a 30 to 1 compression ratio, with typical ratios of 2 to 1 over a wide variety of data sources. With the addition of hardware-based compression, the MPS-14/2 module is able to provide optimal levels of compressed throughput for implementations across low-bandwidth to high-bandwidth links.
The Gigabit Ethernet ports on the MPS-14/2 module support the iSCSI protocol, the FCIP protocol, or both protocols simultaneously. For information about configuring the ports, see the Cisco Family CLI Configuration Guide or the Cisco MDS Family Fabric Manager Configuration Guide.
The Fibre Channel port interfaces support hot-swappable Fibre Channel SFP transceivers, which can be short wavelength (SWL) for connectivity up to 1640 feet (500 meters), or long wavelength (LWL) for connectivity up to 6.2 miles (10 km). All Fibre Channel interfaces are autosensing 1-Gbps or 2-Gbps compatible. The Fibre Channel interfaces also support coarse wavelength-division multiplexing (CWDM) SFP transceivers, which can be used for extended long wavelength (ELWL) transmission or for CWDM. See the
Note Cisco MDS 9500 Series switches running Cisco MDS SAN-OS Release 2.x, 3.x, or NX-OS Release
4.1(1b) support the MPS-14/2 module.
“Supported Transceivers” section on page 1-55.
MDS 9000
1-44
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 1 Product Overview
—SPEED LINK—
LINK-
—SPEEDLINK—
STATUS
1 56789
LINK— —SPEED
10 11 12 13 14234
12
LINK-
GIGABIT E THERNET
116889
1 6
2 4
3 5
Services Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
Figure 1-28 shows an MPS-14/2 module.
Figure 1-28 Cisco MDS 9000 Family MPS-14/2 Module
1 Status LED 4 Gigabit Ethernet ports 2 1-Gbps/2-Gbps Fibre Channel ports 5 Link LEDs 3 Link LEDs (under ports, on left) and Speed LEDs
(under the ports, on the right)
LEDs on the MPS-14/2 Module
Table 1-16 describes the LEDs for the MPS-14/2 modules.
Ta b l e 1-16 LEDs for the Cisco MDS 9000 Family MPS-14/2 Modules
LED Status Description
Status Green All diagnostics pass. The module is operational (normal initialization sequence).
Orange One of the following occurs or occurred:
Red One of the following occurred:
Speed On 2-Gbps mode.
Off 1-Gbps mode.
6 Asset tag
The module is booting or running diagnostics (normal initialization sequence).
The inlet air temperature of the system exceeded the maximum system
operating temperature limit (a minor environmental warning). To ensure maximum product life, you should immediately correct the environmental temperature and restore the system to normal operation.
The diagnostic test failed. The module is not operational because a fault
occurred during the initialization sequence.
The inlet air temperature of the system exceeded the safe operating temperature
limits of the card (a major environmental warning). The card shut down to prevent permanent damage.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-45
Chapter 1 Product Overview
91694
2
1
4
3
Services Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
Table 1-16 LEDs for the Cisco MDS 9000 Family MPS-14/2 Modules (continued)
LED Status Description
Link Solid
Link is up.
green
Flashing
Link is up (beacon used to identify port).
green
Solid
Link is disabled by software.
yellow
Flashing
A fault condition exists.
yellow
Off No link.

IP Storage Services Modules

The 4-port and 8-port IP Storage services (IPS-4 and IPS-8) modules provide four or eight 1-Gigabit Ethernet ports for iSCSI as well as FCIP over Gigabit Ethernet, and they support the intelligent features available on other modules, including VSANs, security, and traffic management.
The IPS module ports can be configured to support the iSCSI protocol, the FCIP protocol, or both protocols simultaneously. For information about configuring the ports, see the Cisco CLI Configuration Guide or the Cisco MDS Family Fabric Manager Configuration Guide.
The Fibre Channel port interfaces support hot-swappable Gigabit Ethernet SFP transceivers, which can be short wavelength (SWL) for connectivity up to 1640 feet (500 meters), or long wavelength (LWL) for connectivity up to 6.2 miles (10 km). The port interfaces also support coarse wavelength-division multiplexing (CWDM) SFP transceivers, which can be used for extended long wavelength (ELWL) transmission or for CWDM. See the
“Supported Transceivers” section on page 1-55.
MDS 9000 Family
Figure 1-29 shows an IPS-8 services module.
Figure 1-29 Cisco MDS 9000 Family IPS-8 Services Module
1 Status LED 3 Link LEDs 2 Gigabit Ethernet ports 4 Asset tag
Cisco MDS 9500 Series Hardware Installation Guide
1-46
OL-17467-02
Chapter 1 Product Overview
113161
LINK LINK LINK LINK
1234
1
4
3
2
Services Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
Figure 1-30 shows the IPS-4 services module.
Figure 1-30 Cisco MDS 9000 Family IPS-4 Services Module
1 Status LED 3 Link LEDs 2 Gigabit Ethernet ports 4 Asset tag
LEDs on IP Storage Services Modules
Table 1-17 describes the LEDs for the IPS services modules.
Ta b l e 1-17 LEDs for the Cisco MDS 9000 Family IPS Module
LED Status Description
Status Green All diagnostics pass. The module is operational (normal initialization sequence).
Orange One of the following occurs or occurred:
The module is booting or running diagnostics (normal initialization
sequence).
The inlet air temperature of the system exceeded the maximum system
operating temperature limit (a minor environmental warning). To ensure maximum product life, you should immediately correct the environmental temperature and restore the system to normal operation.
Red One of the following occurred:
The diagnostic test failed. The module is not operational because a fault
occurred during the initialization sequence.
The inlet air temperature of the system exceeded the safe operating
temperature limits of the card (a major environmental warning). The card shut down to prevent permanent damage.
Link Solid
Link is up.
green
Flashing
Link is up (beacon used to identify port).
green
Solid
Link is disabled by software.
yellow
Flashing
A fault condition exists.
yellow
Off No link.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-47
Chapter 1 Product Overview
94298
2
1 43
17 20
45
21 24
89
25 28
12 13
29 32
16
DS-X9032
Services Modules
Send documentation comments to mdsfeedback-doc@cisco.com.

32-Port Fibre Channel Advanced Services Module

The Cisco MDS 9000 Family 32-port Fibre Channel Advanced Services Module (ASM) enables pooling of heterogeneous storage for increased storage utilization, simplified storage management, and reduced total cost of storage ownership. The ASM incorporates all the capabilities of the Cisco MDS 9000 DS-X9032 Fibre Channel switching module and also provides scalable, in-band storage virtualization services. The module makes it possible to allocate bandwidth optimally.
The Fibre Channel port interfaces support hot-swappable Fibre Channel SFP transceivers, which can be short wavelength (SWL) for connectivity up to 500 meters (1640 feet), or long wavelength (LWL) for connectivity up to 10 km (6.2 miles). All interfaces are autosensing 1-Gbps or 2-Gbps compatible. The port interfaces also support coarse wavelength-division multiplexing (CWDM) SFP transceivers, which can be used for extended long wavelength (ELWL) transmission or for CWDM. See the
Transceivers” section on page 1-55.
Note Cisco MDS 9509 and 9506 Directors running Cisco MDS SAN-OS Release 1.2(2a) to Release 2.1(x)
support the Fibre Channel ASM. The Cisco MDS 9513 Director does not support the ASM.
Figure 1-31 shows the Fibre Channel ASM.
“Supported
Figure 1-31 Fibre Channel ASM
1 Status LED 3 Link and Speed LEDs 2 1-Gbps/2-Gbps Fibre Channel port
4 Asset tag
group
Each module draws power from the 42 V supplied on the backplane with local DC/DC power converters and regulators.
The control processor on the module provides power-on, offline, and online diagnostics. The control processor can be used to configure devices on the switching module and to gather statistical data from each port.
The control processor monitors the DC/DC power source and temperature. The control processor signals the supervisor module and displays an alarm on its front panel when a problem is detected.
The front panel on the services module provides basic status information, such as power-on, self-test running, self-test passed, alarm, and ready.
The binary image for the services module is downloaded from the supervisor module. Prior to the image download, the control processor on the switching module runs from code stored on its local CompactFlash card. The image for an ASM can be specified using the ASM-SFN boot variable. For details on how to specify the ASM-SFN boot variable, see the Cisco MDS 9000 Family CLI Configuration
Guide.
1-48
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 1 Product Overview
Services Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
Note Software downloads are only necessary when a revision of the code is needed.
The supervisor module can force a reset on the services module and controls whether power is applied to the switching module.
If a single component or a set of components on the switching module fails, this failure does not disable another switching module if that is the only failure in the system.
Each ASM has a hardware watchdog timer to detect most component failures. The watchdog timer resets the card if it is not serviced periodically.
LEDs on the Fibre Channel Advanced Services Modules
Table 1-18 describes the LEDs for the ASM.
Ta b l e 1-18 LEDs for the Cisco MDS 9000 Family Fibre Channel ASMs
LED Status Description
Status Green All diagnostics pass and the module is operational (normal
initialization sequence).
Orange One of the following occurs or occurred:
The module is booting or running diagnostics (normal
initialization sequence).
The inlet air temperature of the system exceeded the
maximum system operating temperature limit (a minor environmental warning). To ensure maximum product life, you should immediately correct the environmental temperature and restore the system to normal operation.
Red One of the following occurred:
OL-17467-02
The diagnostic test failed. The module is not operational
because a fault occurred during the initialization sequence.
The inlet air temperature of the system exceeded the safe
operating temperature limits of the card (a major environmental warning). The card shut down to prevent permanent damage.
Speed On 2-Gbps mode.
Off 1-Gbps mode.
Link Solid green Link is up.
Steady flashing
Link is up (beacon used to identify port).
green
Intermittent
Link is up (traffic on port).
flashing green
Solid yellow Link is disabled by software.
Flashing yellow A fault condition exists.
Off No link.
Cisco MDS 9500 Series Hardware Installation Guide
1-49
Chapter 1 Product Overview
120094
2
43
17 20
45
21 24
89
25 28
12 13
29 32
16
Storage Services Module
1
DS-X9032
Services Modules
Send documentation comments to mdsfeedback-doc@cisco.com.

32-Port Fibre Channel Storage Services Module

The 32-port Fibre Channel Storage Services Module (SSM) for the Cisco MDS 9000 Family supports up to 32 Fibre Channel ports, provides distributed intelligent storage services, and supports future storage services.
Note Cisco MDS 9500 Series switches running Cisco MDS SAN-OS Release 2.x, 3.x, or NX-OS Release
4.1(1b) support the SSM.
The Fibre Channel ports support hot-swappable Fibre Channel SFP transceivers, which can be short wavelength (SWL) for connectivity up to 1640 ft (500 m), or long wavelength (LWL) for connectivity up to 6.2 miles (10 km). All interfaces are autosensing 1-Gbps/2-Gbps compatible. The ports also support coarse wavelength-division multiplexing (CWDM) SFP transceivers, which can be used for extended long wavelength (EWL) transmission or for CWDM. For more information about SFP transceivers, see the
Figure 1-32 shows the SSM.
Figure 1-32 Cisco MDS 9000 Family Storage Services Module
“Supported Transceivers” section on page 1-55.
1 Status LED 3 Link and speed LEDs 2 1-Gbps/2-Gbps Fibre Channel port group 4 Asset tag
Each module draws power from the 42 V supplied on the backplane with local DC/DC power converters and regulators.
The control processor on the module provides power-on, offline, and online diagnostics. The control processor can be used to configure devices on the switching module and to gather statistical data from each port.
The control processor monitors the DC/DC power source and temperature. The control processor signals the SSM and displays an alarm on its front panel when it detects a problem.
The front panel of the SSM provides basic status information, such as power-on, self-test running, self-test passed, alarm, and ready.
The binary image for the SSM is downloaded from the supervisor module. Prior to the image download, the control processor on the services module runs from code stored on its local CompactFlash card. The image for an SSM can be specified using the SSI boot variable. For details on how to specify the SSI boot variable, see the Cisco MDS 9000 Family CLI Configuration Guide.
Note Software downloads are only necessary when a revision of the code is needed.
The SSM can force a reset and control whether or not power is applied to the switching module.
1-50
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 1 Product Overview
Services Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
If a single component or a set of components on the switching module fails, this failure will not disable another switching module if that is the only failure in the system.
For the detection of most component failures, each switching module has a hardware watchdog timer that resets the card if is not serviced periodically.
LEDs on the Storage Services Modules
Table 1-19 describes the LEDs for the Storage Services Modules.
Ta b l e 1-19 LEDs for the Cisco MDS 9000 Family Storage Services Modules
LED Status Description
Status Green All diagnostics pass. The module is operational (normal
initialization sequence).
Orange One of the following occurs or occurred:
The module is booting or running diagnostics (normal
initialization sequence).
The inlet air temperature of the system exceeded the
maximum system operating temperature limit (a minor environmental warning). To assure maximum product life, you should immediately correct the environmental temperature and restore the system to normal operation.
Red One of the following occurred:
The diagnostic test failed. The module is not operational
because a fault occurred during the initialization sequence.
The inlet air temperature of the system exceeded the safe
operating temperature limits of the card (a major environmental warning). The card shut down to prevent permanent damage.
Speed On 2-Gbps mode.
Off 1-Gbps mode.
Link Solid green Link is healthy.
Steady flashing
Link is healthy and beacon is enabled.
green
Intermittent
Link is up and traffic is flowing through port.
flashing green
Solid yellow Link is disabled by software.
Flashing yellow A fault condition exists.
Off No link.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-51
Chapter 1 Product Overview
91626
STATUS
DS-X9560-SMXX
BATTERY STATUS
NODE 1
NODE 2
DISK STATUS DISK
Cashing Services Module
3 6
852
1 4 7
Services Modules
Send documentation comments to mdsfeedback-doc@cisco.com.

Caching Services Module

The Caching Services Module (CSM) provides virtualization services that allow the Cisco MDS 9000 Family switches to reallocate physical resources as virtual resources for increased efficiency. The CSM receives and sends data through the switch backplane. It has two disk drives, two internal batteries for backup in case of power failure, and no external ports.
CSMs must be implemented in pairs in the fabric to provide redundancy and backup. Only two or more CSMs in a fabric are supported. However, the CSMs do not have to be installed in the same switch.
The CSM may shut down because of the software, an external power failure, or the module separated from the backplane while it still had power. The CSM automatically backs up the data in memory to the disk drives and then shuts down. The CSM batteries provide adequate power to back up data without external power.
Note The Cisco MDS 9513 does not support the CSM.
Figure 1-33 shows the CSM.
Figure 1-33 CSM
1 Status LED 5 Disk 1 Status LED 2 Battery LED 6 Node 2 LEDs 3 Node 1 LEDs 7 Node 2 Status LED 4 Node 1 Status LED 8 Disk 2 Status LED
Figure 1-34 shows the location of the disk drives and batteries on the CSM.
Caution The batteries are shipped fully charged and should be handled with caution accordingly.
Cisco MDS 9500 Series Hardware Installation Guide
1-52
OL-17467-02
Chapter 1 Product Overview
94038
1
3
4
2
Services Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
Figure 1-34 CSM, Internal View
1 Disk drive 2 3 Battery 2 2 Disk drive 1 4 Battery 1
See the “Installing a Switching or Services Module, Including Caching Services Modules” section on
page 2-45 for information about installing the CSM and maintaining the CSM batteries.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-53
Chapter 1 Product Overview
Services Modules
Send documentation comments to mdsfeedback-doc@cisco.com.
LEDs on the Caching Services Module
Table 1-20 describes the LEDs for the CSM.
Ta b l e 1-20 LEDs for the Cisco MDS 9000 Family CSM
LED Status Description
Status Green All diagnostics pass, and the module is operational (normal
initialization sequence).
Orange One of the following occurs or occurred:
The module is booting or running diagnostics (normal
initialization sequence).
The inlet air temperature of the system exceeded the
maximum system operating temperature limit (a minor environmental warning). To ensure maximum product life, you should immediately correct the environmental temperature and restore the system to normal operation.
Red One of the following occurred:
The diagnostic test failed. The module is not operational
because a fault occurred during the initialization sequence.
The inlet air temperature of the system exceeded the safe
operating temperature limits of the card (a major environmental warning). The card shut down to prevent permanent damage.
Node Green Node is fully operational.
Flashing green Node is not yet part of a cluster.
Orange The module is booting or node is administratively down.
Flashing orange Node is in service mode.
Red Node failure.
Off Node does not have power.
Battery Green Battery has sufficient charge to dump cache.
Flashing green Battery is charging and has sufficient charge to dump cache.
Battery conditioning in progress.
Flashing orange Battery is charging but has insufficient charge to dump cache.
Red Battery failure or battery is charged to the extent possible but in-
sufficient to dump cache; replace CSM.
Off Battery does not have power and is not charged.
Disk Solid green Disk is operational.
Flashing orange Dumping cache to disk.
Flashing green Restoring cache from disk.
Red Disk failure.
Off Disk does not have power.
1-54
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 1 Product Overview

Supported Transceivers

Send documentation comments to mdsfeedback-doc@cisco.com.
Supported Transceivers
The following types of transceivers are available from Cisco and are supported on the Cisco MDS 9500 Series:
X2 transceivers
Fibre Channel SFP and SFP+ transceivers, in either SWL or LWL
Combination Fibre Channel/Gigabit Ethernet SFP transceivers, in either SWL or LWL
Combination Fibre Channel/Gigabit Ethernet CWDM SFP transceivers, which can be used for
ELWL transmission or for CWDM
Gigabit Ethernet SFP transceiver, 1-Gbps copper
Fibre Channel DWDM SFP transceiver, which can be used for ELWL transmission or for DWDM
Note Switches running Cisco MDS SAN-OS Release 1.x, 2.x, 3.x, or NX-OS Release 4.1(1b) support
combination Fibre Channel/Gigabit Ethernet SFP transceivers.
The transceivers are field-replaceable and hot-swappable. You can use any combination of SFP transceivers that are supported by the switch. The only restrictions are that SWL transceivers must be paired with SWL transceivers, and LWL transceivers with LWL transceivers, and the cable must not exceed the stipulated cable length for reliable communications.
For more information about the X2 transceiver, see the “X2 Transceiver Specifications” section on
page D-19.
For more information about a specific Cisco SFP transceiver, see the “SFP and SFP+ Transceiver
Specifications” section on page D-22. SFP transceivers can be ordered separately or with the Cisco MDS
9500 Series.
Note Use only Cisco transceivers in the Cisco MDS 9500 Series. Each Cisco transceiver is encoded with
model information that enables the switch to verify that the transceiver meets the requirements for the switch.

X2 Transceivers

The X2 transceiver is a small form-factor transceiver optimized for 10-Gbps applications and uses an SC connector. The X2 transceiver is ideally suited for Ethernet, Fibre Channel and telecom switches, and standard (PCI) peripheral component interconnect based server and storage connections. The X2 provides robust thermal performance and electromagnetic shielding.
For more information about X2 transceiver specifications, see the “X2 Transceiver Specifications”
section on page D-19.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-55
Chapter 1 Product Overview
Supported Transceivers
Send documentation comments to mdsfeedback-doc@cisco.com.

Fibre Channel SFP Transceivers

Cisco Fibre Channel SFP transceivers are available in SWL or LWL versions. Both of these versions are 1-Gbps/2-Gbps/4-Gbps capable. Cisco Fibre Channel SFP+ transceivers are available in SWL or LWL versions. Both of these versions are 2-Gbps/4-Gbps/8-Gbps capable.
Cisco Fibre Channel SFP transceivers have LC connectors and comply with 1-Gbps/2-Gbps/4-Gbps Fibre Channel standards as defined in FC-PI 10.0 2. Cisco Fibre Channel SFP+ transceivers have LC connectors and comply with 2-Gbps/4-Gbps/8-Gbps Fibre Channel standards as defined in FC-PI-4.
For more information about Fibre Channel SFP and SFP+ transceiver specifications, see the “SFP and
SFP+ Transceiver Specifications” section on page D-22.

Combination Fibre Channel/Gigabit Ethernet SFP Transceivers

The combination Fibre Channel/Gigabit Ethernet SFP transceivers from Cisco Systems are available in SWL or LWL versions. Both of these versions are 1-Gbps/2-Gbps capable.
The combination SFP transceivers from Cisco Systems have LC connectors and comply with 1-Gbps/2-Gbps Fibre Channel as defined in FC-PI 10.0 2 and Gigabit Ethernet as defined in IEEE
802.3z.
For more information about Fibre Channel/Gigabit Ethernet SFP transceiver specifications, see the “SFP
and SFP+ Transceiver Specifications” section on page D-22.

CWDM Combination Fibre Channel/Gigabit Ethernet SFP Transceivers

The Cisco CWDM SFP transceivers have LC connectors and support Gigabit Ethernet and 1-Gbps/2-Gbps Fibre Channel. They match the wavelength plan of Cisco CWDM GBICs and Cisco CWDM optical add/drop multiplexers (OADMs). Cisco 4-Gbps CWDM SFP transceivers are also available.
CWDM SFP transceivers are used in the following ways:
CWDM transmission can send and receive up to eight laser wavelengths carrying different signals
simultaneously on the same optical fiber using an OADM.
ELWL signals can transmit over longer distances than LWL SFP transceivers.
There are eight different “colors” of CWDM SFP transceivers, one for each fixed wavelength. The fiber-optic cables from the CWDM SFP transceivers must be connected to an OADM. The OADM combines the wavelengths of the different outgoing signals into one composite send signal. The OADM also separates the received transmissions into the different wavelengths and sends them to the corresponding CWDM SFP transceiver.
For more information about CWDM SFP transceiver specifications, see the “SFP and SFP+ Transceiver
Specifications” section on page D-22.

Gigabit Ethernet SFP Transceivers

The 4-port and 8-port IP Storage services (IPS-4 and IPS-8) modules provide four or eight 1-Gigabit Ethernet ports that support Gigabit Ethernet SFP transceivers. The Gigabit Ethernet SFP transceivers have RJ-45 connectors and support Gigabit Ethernet (1-Gbps).
Cisco MDS 9500 Series Hardware Installation Guide
1-56
OL-17467-02
Chapter 1 Product Overview
Supported Transceivers
Send documentation comments to mdsfeedback-doc@cisco.com.
For more information about Gigabit Ethernet SFP transceiver specifications, see the “SFP and SFP+
Transceiver Specifications” section on page D-22.

DWDM Fibre Channel SFP Transceivers

The Cisco DWDM SFP transceivers have LC connectors and support 1-Gbps/2-Gbps Fibre Channel. The DWDM SFP transceivers match the International Telecommunications Union (ITU) 100-Ghz wavelength grid and the wavelength plan of Cisco 100-Ghz ONS product family.
DWDM SFP transceivers are used in the following ways:
DWDM transmission can send and receive up to 32 laser wavelengths carrying different signals
simultaneously on the same optical fiber using an optical filter.
ELWL signals can transmit over longer distances than LWL SFP transceivers.
For more information about Gigabit Ethernet SFP transceiver specifications, see the “SFP and SFP+
Transceiver Specifications” section on page D-22.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
1-57
Chapter 1 Product Overview
Supported Transceivers
Send documentation comments to mdsfeedback-doc@cisco.com.
1-58
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Send documentation comments to mdsfeedback-doc@cisco.com.
CHAP T ER
2

Installing the Cisco MDS 9500 Series

This chapter describes how to install the Cisco MDS 9500 Series chassis and its components, and includes the following information:
Preinstallation, page 2-2
Installing the Chassis in a Cabinet or Rack, page 2-6
System Grounding, page 2-17
Grounding the Chassis, page 2-23
Starting Up the Switch, page 2-28
Removing, Installing, and Verifying Supervisor, Switching, and Services Modules, page 2-38
Maintaining a Caching Services Module, page 2-50
Removing and Installing a Power Supply or PEM, page 2-51
Removing and Installing Fan Modules, page 2-68
Removing and Installing CompactFlash Cards, page 2-75
Removing and Installing Clock Modules, page 2-76
OL-17467-02
Note Before you install, operate, or service the system, read the Regulatory Compliance and Safety
Information for the Cisco MDS 9000 Family for important safety information.
Warning
Warning
IMPORTANT SAFETY INSTRUCTIONS
This warning symbol indicates danger. You are in a situation that could cause physical injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents. Use the statement number provided at the end of each warning to locate its translation in the translated safety warnings that accompanied this device.
Statement 1071
SAVE THESE INSTRUCTIONS
This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security.
Statement 1017
Cisco MDS 9500 Series Hardware Installation Guide
2-1
Chapter 2 Installing the Cisco MDS 9500 Series

Preinstallation

Send documentation comments to mdsfeedback-doc@cisco.com.
Warning
Warning
Only trained and qualified personnel should be allowed to install, replace, or service this equipment.
Statement 1030
A readily accessible two-poled disconnect device must be incorporated in the fixed wiring.
1022
Preinstallation
This section provides the following topics:
Installation Options, page 2-2
Installation Guidelines, page 2-3
Required Equipment, page 2-5
Unpacking and Inspecting the Switch, page 2-5

Installation Options

The Cisco MDS 9513 Director can be installed using the following methods:
In an open four-post EIA rack, using:
Statement
The rack-mount kit shipped with the switch
The Cisco MDS 9509 Director can be installed using the following methods:
In an open EIA rack, using:
The rack-mount kit shipped with the switch
The telco and EIA Shelf Bracket Kit (optional and purchased separately) in addition to the rack-mount kit shipped with the switch
In a perforated or solid-walled EIA cabinet, using:
The rack-mount kit shipped with the switch
The telco and EIA Shelf Bracket Kit (optional and purchased separately) in addition to the rack-mount kit shipped with the switch
In a two-post telco rack using the rack-mount kit shipped with the switch
In a four-post nonthreaded cabinet or rack using the optional 9500 Shelf Bracket Kit
The Cisco MDS 9506 Director can be installed using the following methods:
In an open EIA rack, using:
The rack-mount kit shipped with the switch
The telco and EIA Shelf Bracket Kit (optional and purchased separately) in addition to the rack-mount kit shipped with the switch
In a perforated or solid-walled EIA cabinet, using:
The rack-mount kit shipped with the switch
2-2
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 2 Installing the Cisco MDS 9500 Series
Preinstallation
Send documentation comments to mdsfeedback-doc@cisco.com.
The telco and EIA Shelf Bracket Kit (optional and purchased separately) in addition to the rack-mount kit shipped with the switch
In a two-post telco rack, using:
The rack-mount kit shipped with the switch
The telco and EIA Shelf Bracket Kit (optional and purchased separately) in addition to the front brackets shipped with the switch
For instructions on installing the switch using the rack-mount kit shipped with the switch, see the
“Installing the Chassis in a Cabinet or Rack” section on page 2-6.
For instructions on installing the switch using the optional telco and EIA Shelf Bracket Kit (purchased separately), see the
Note The telco and EIA Shelf Bracket Kit is optional and is not provided with the switch. To order the kit,
contact your switch provider.
Note The telco and EIA Shelf Bracket Kit is not intended for use with a Cisco MDS 9513 Director or Cisco
MDS 9509 Director in a two-post telco rack.
“Cisco MDS 9000 Family Telco and EIA Shelf Bracket” section on page C-6.

Installation Guidelines

Follow these guidelines when installing the Cisco MDS 9500 Series:
Plan your site configuration and prepare the site before installing the chassis. Cisco recommends
that you use the site planning tasks listed in
Ensure that there is adequate space around the switch to allow for servicing the switch and for
adequate airflow (airflow requirements are listed in
Ensure that the air-conditioning meets the heat dissipation requirements listed in Appendix D,
“Technical Specifications.”
Ensure that the cabinet or rack meets the requirements listed in Appendix C, “Cabinet and Rack
Requirements.”
Note Jumper power cords are available for use in a cabinet. For more information, see the “Jumper Power
Cord” section on page E-11.
Ensure that the chassis is adequately grounded. Grounding the chassis is recommended in all cases,
and is mandatory for Cisco MDS 9506 Directors that have a DC power supply installed. If the switch is not mounted in a grounded rack or cabinet, Cisco recommends connecting the system ground on the chassis and the power supply ground to an earth ground, regardless of whether the power supplies are AC or DC.
Ensure that the site power meets the power requirements listed in Appendix D, “Technical
Specifications.” You can use an uninterruptible power supply (UPS) to protect against power
failures.
Appendix F, “Site Planning and Maintenance Records.”
Appendix D, “Technical Specifications”).
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
2-3
Chapter 2 Installing the Cisco MDS 9500 Series
Preinstallation
Send documentation comments to mdsfeedback-doc@cisco.com.
Caution Avoid UPS types that use ferroresonant technology. These UPS types can become unstable
with systems such as the Cisco fluctuations because of fluctuating data traffic patterns.
Ensure that circuits are sized according to local and national codes. For North America:
The 1900-W AC power supplies require a 20-A circuit.
The 1900-W DC power supplies require a 70-A circuit.
The 2500-W AC power supplies require a 20-A circuit.
The 2500-W DC power supplies require a 100-A circuit.
The 4000-W AC power supplies require a 30-A circuit.
The 6000-W AC power supplies require two 220 V inputs at 20-A circuit.
If you are using 200/240 VAC power sources in North America, the circuits must be protected by two-pole circuit breakers.
MDS 9000 Family, which can have substantial current draw
Caution To prevent loss of input power, ensure that the total maximum loads on the circuits supplying
power are within the current ratings of the wiring and breakers.
Record your installation and configuration information as you work. See Appendix F, “Site Planning
and Maintenance Records.”
Use the following screw torques when installing the switch:
Captive screws: 4 in-lb
M3 screws: 4 in-lb
M4 screws: 12 in-lb
M6 screws: 20 in-lb
10-32 screws: 20 in-lb
12-24 screws: 30 in-lb
2-4
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 2 Installing the Cisco MDS 9500 Series
Preinstallation
Send documentation comments to mdsfeedback-doc@cisco.com.

Required Equipment

Gather the following items before beginning the installation:
Number 1 and number 2 Phillips screwdrivers with torque capability.
3/16-inch flat-blade screwdriver.
Tape measure and level.
ESD wrist strap or other grounding device.
Antistatic mat or antistatic foam.
In addition to the grounding items provided in the accessory kit, you need the following items:
Grounding cable (6 AWG recommended), sized according to local and national installation requirements; the required length depends on the proximity of the Cisco MDS 9500 to proper grounding facilities.
Crimping tool large enough to accommodate girth of lug.
Wire-stripping tool.
For DC power supplies in a Cisco MDS 9506 Director, you need two 10-32 ring lugs for each DC
power supply.
For the Cisco MDS 9513 Director, you need a mechanical lift to handle the weight of the chassis.

Unpacking and Inspecting the Switch

Warning
Caution Use a mechanical lift to lift the MDS 9513 chassis. The Cisco MDS 9513 Director can weigh up to 375 lb
Caution Cisco recommends that a third person assist whenever the chassis is being moved or lifted. The Cisco
Caution When handling switch components, wear an ESD strap and handle modules by the carrier edges only.
Two people are required to lift the chassis. Grasp the chassis underneath the lower edge and lift with both hands. To prevent injury, keep your back straight and lift with your legs, not your back. To prevent damage to the chassis and components, never attempt to lift the chassis with the handles on the power supplies or on the interface processors, or by the plastic panels on the front of the chassis. These handles were not designed to support the weight of the chassis.
(170 kg) when fully loaded, depending on what modules populate the chassis.
MDS 9509 Director weighs approximately 170 lb (77 kg) when fully loaded, and the Cisco MDS 9506 Director weighs approximately 125 lb (57 kg) when fully loaded with all modules and power supplies.
An ESD socket is provided on the chassis. For the ESD socket to be effective, the chassis must be grounded either through the power cable, the chassis ground, or metal-to-metal contact with a grounded rack.
Statement 5
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
2-5
Chapter 2 Installing the Cisco MDS 9500 Series

Installing the Chassis in a Cabinet or Rack

Send documentation comments to mdsfeedback-doc@cisco.com.
Tip Keep the shipping container for use when moving or shipping the chassis in the future. The shipping
carton can be flattened and stored with the pallet.
Note If you purchased this product through a Cisco reseller, contact the reseller directly for technical support.
If you purchased this product directly from Cisco Systems, contact Cisco Technical Support at this URL:
http://www.cisco.com/warp/public/687/Directory/DirTAC.shtml.
Note The switch is thoroughly inspected before shipment. If any damage occurred during transportation or
any items are missing, contact your customer service representative immediately.
To inspect the shipment, follow these steps:
Step 1 Compare the shipment to the equipment list provided by your customer service representative and ensure
that you have received all items, including the following:
Print documentation and CD-ROMs
Grounding lug kit
Rack-mount kit
ESD wrist strap
Cables and connectors
Any optional items ordered
Step 2 Check for damage and report any discrepancies or damage to your customer service representative. Keep
the following information ready:
Invoice number of shipper (see packing slip)
Model and serial number of the damaged unit
Description of damage
Effect of damage on the installation
Installing the Chassis in a Cabinet or Rack
This section describes how to install the Cisco MDS 9500 Series in a cabinet or rack that meets the requirements described in this document, using the rack-mount kit provided with the switch. A separate procedure is provided for each type of director:
Installing the Cisco MDS 9513 Director in a Rack, page 2-7
Installing the Cisco MDS 9509 Director in a Rack, page 2-11
2-6
Installing the Cisco MDS 9506 Director in a Rack, page 2-15
Caution If the rack is on wheels, ensure that the brakes are engaged or that the rack is otherwise stabilized.
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 2 Installing the Cisco MDS 9500 Series
Installing the Chassis in a Cabinet or Rack
Send documentation comments to mdsfeedback-doc@cisco.com.
Note You can remove the modules and other field-replaceable components to make moving and positioning
the chassis easier and safer. See the
“Removing, Installing, and Verifying Supervisor, Switching, and
Services Modules” section on page 2-38 for instructions specific to the component.

Installing the Cisco MDS 9513 Director in a Rack

The 6000-W AC power supplies for the Cisco MDS 9513 Director are designed to provide an output power for the modules and fans. Each power supply has two AC power connections and will provide power as follows:
One AC power connection @110 VAC = No output
Two AC power connection @110 VAC = 2900-W output
One AC power connection @ 220 VAC = 2900-W output
Two AC power connection @ 220 VAC = 6000-W output
Note Power output does not include the power used by the individual modules used in the chassis.
Installation of the Cisco MDS 9513 Director in a rack requires a mechanical lift to place the chassis in the rack. Ensure that you have access to the lift during the installation process.
Table 2-1 lists the items provided in the Cisco MDS 9513 rack-mount kit.
Note The rack-mount kit for the Cisco MDS 9513 Director includes rack-mount support brackets, which are
required for the duration of the installation and are not removable.
Ta b l e 2-1 Contents for the Rack-Mount Support Bracket Kit
Quantity Part Description
2 Rack-mount support bracket
2 Rack-mount support bar
20 12-24 x 3/4-in. Phillips screws
20 10-32 x 3/4-in. Phillips screws
To install the Cisco MDS 9513 chassis in a rack using the rack-mount kit provided with the switch, follow these steps:
OL-17467-02
Step 1 Adjust the distance between the front and rear cabinet vertical rack-mount rails to 26.56 ± 0.15 in. (67.46
cm). This step must be performed prior to installing the support rack-mount brackets.
Step 2 Position one of the support rack-mount brackets in the rack and adjust it to the depth of the cabinet rack.
Repeat this step for the other side. Use the screws to secure the brackets but do not tighten them yet.
Cisco MDS 9500 Series Hardware Installation Guide
2-7
Chapter 2 Installing the Cisco MDS 9500 Series
146035
26.56 in
Installing the Chassis in a Cabinet or Rack
Send documentation comments to mdsfeedback-doc@cisco.com.
Note If you are using the cable management bracket shipped with the switch, do not install the top
four screws into the front right of the bracket. However, you must install the bottom screw (see
Figure 2-1). The top four screws will be used to install the cable management bracket to the rail.
Figure 2-1 Positioning the Rack-Mount Support Brackets
2-8
Step 3 Install one rack-mount support bar into the slots located on the rack-mount support brackets. Repeat this
for the other support bar.
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 2 Installing the Cisco MDS 9500 Series
146034
2
2
1
1
1
1
3
3
Installing the Chassis in a Cabinet or Rack
Send documentation comments to mdsfeedback-doc@cisco.com.
Figure 2-2 Positioning the Support Bars
1 Screws 3 Rack-mount support bar 2 Rack-mount support bracket
Step 4 Once the support bars are installed, secure the rack-mount support brackets to the rack using the screws
provided.
Note If you are using the cable management bracket shipped with the switch, do not install the top
four screws to the front right side of the bracket. These will be installed after placing the cable management bracket along that side. The bottom screw should be installed to support the front of the rack-mount support bracket.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
2-9
Chapter 2 Installing the Cisco MDS 9500 Series
146036
Installing the Chassis in a Cabinet or Rack
Send documentation comments to mdsfeedback-doc@cisco.com.
Figure 2-3 Securing the Rack-Mount Support Brackets
Step 5 Position a person at each side of the chassis and one at the mechanical lift. Place the chassis on the lift
by lifting on the top front of rear of the chassis.
Step 6 Using the mechanical lift, lift the chassis up onto the rack-mount support brackets.
Step 7 Place the rear of the chassis on the rack-mount support brackets between the front mounting rails.
Step 8 Manually slide the chassis into the rack until it rests on the crossbar and the side rack-mount brackets.
Step 9 If you are installing the optional cable management brackets, place the cable management brackets in
front of the right rack-mount brackets. Align the holes in the cable management brackets with the holes in the front rack-mount brackets on the right and mounting rails, and then insert the screws.
Step 10 Align the holes in the front rack-mount bracket with the holes in the mounting rails and insert the 12-24
x 3/4-inch or 10-32 x 3/4-inch screws, using six screws per side. (See
Note Use a minimum of six screws to ensure that the switch is adequately supported.
Figure 2-4.)
2-10
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 2 Installing the Cisco MDS 9500 Series
146038
1
4
3
2
Installing the Chassis in a Cabinet or Rack
Send documentation comments to mdsfeedback-doc@cisco.com.
Figure 2-4 Installing the Cable Management Brackets on the MDS 9513 Chassis
1 Screws, 12-24 or 10-32 3 Mounting rail 2 Support bracket 4 Cable guide

Installing the Cisco MDS 9509 Director in a Rack

Caution If connecting a Cisco MDS 9509 Director to a 110-VAC power system, ensure that sufficient power is
provided to meet the chassis power requirements for the number of modules installed.
When connected to 220 VAC, the 2500-W AC power supplies (DS-CAC-2500W) for the Cisco MDS 9509 Director are designed to provide an output power of 2331 W to power the modules and fans. When connected to a 110 VAC power system, the power supply provides approximately 1150 W. In this case, and if the power supplies are used in redundant rather than combined mode, they might not provide adequate power, depending on the number of modules loaded in the chassis.
If a 110-VAC input is chosen, a 110-VAC power cord (CAB-7513AC=) must be ordered separately.
Table 2-2 lists the items provided in the Cisco MDS 9509 rack-mount kit.
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
2-11
Chapter 2 Installing the Cisco MDS 9500 Series
Installing the Chassis in a Cabinet or Rack
Send documentation comments to mdsfeedback-doc@cisco.com.
Note The rack-mount kit for the Cisco MDS 9509 Director includes side rack-mount brackets, which are
required for the duration of the installation only and can be removed once the front rack-mount brackets are securely fastened to the rack-mounting rails.
Note The Cisco MDS 9500 Shelf Bracket Kit can be purchased as an optional shelf bracket kit for the Cisco
MDS 9509 Director. See “Cisco MDS 9500 Shelf Bracket” section on page C-13.
Ta b l e 2-2 Contents of Cisco MDS 9509 Rack-Mount Kit
Quantity Part Description
3 RU shelf bracket kit
6 12-24 x 3/4-inch Phillips binder-head screws
6 10-32 x 3/4-inch Phillips binder-head screws
2 M3 x 8-mm Phillips pan-head screws
2 Side rack-mount brackets
1 Crossbar bracket
Cable management bracket kit
2 Cable management brackets
18 12-24 x 3/4-inch Phillips binder-head screws
18 10-32 x 3/4-inch Phillips binder-head screws
To install the Cisco MDS 9509 chassis in a rack using the rack-mount kit provided with the switch, follow these steps:
Step 1 Position one of the side rack-mount brackets in the rack as shown in Figure 2-5. Secure the side
rack-mount bracket to the rack using three of the 12-24 x 3/4-inch or 10-32 x 3/4-inch screws, depending on the type of holes in the mounting rails.
Step 2 Repeat for the second side rack-mount bracket, ensuring that the side rack-mount brackets are at the
same height.
2-12
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 2 Installing the Cisco MDS 9500 Series
94997
1 2 1
94995
Front of rack
1
2
3
4
3
Installing the Chassis in a Cabinet or Rack
Send documentation comments to mdsfeedback-doc@cisco.com.
Figure 2-5 Installing the Side Rack-Mount Brackets for the Cisco MDS 9509 Chassis
1 Side rack-mount bracket 2 Screws, 12-24 or 10-32
Step 3 Attach the crossbar to the back of the side rack-mount brackets using one M3 x 8-mm screw per side as
shown in
Figure 2-6.
Figure 2-6 Attaching the Crossbar to the Side Rack-Mount Brackets (Rear View)
1 Side rack-mount bracket 3 Screws, M3 2 Side rack-mount bracket 4 Crossbar
Step 4 Position a person at each side of the chassis. Grasp the chassis handle with one hand and use the other
hand near the back of the chassis for balance. Slowly lift the chassis in unison, avoiding sudden twists or moves to prevent injury. Place the rear of the chassis on the side rack-mount brackets between the front mounting rails, and slide it until it rests on the crossbar and the side rack-mount brackets (see
Figure 2-7).
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
2-13
Chapter 2 Installing the Cisco MDS 9500 Series
1
3
2
90022
Installing the Chassis in a Cabinet or Rack
Send documentation comments to mdsfeedback-doc@cisco.com.
Figure 2-7 Installing the Cisco MDS 9509 Chassis in the Rack
2-14
1 Crossbar 3 Side rack-mount bracket 2 Mounting rail
Step 5 If you are installing the optional cable management bracket, place the cable management bracket in front
of the front right rack-mount brackets. Align the holes in the cable management brackets with the holes in the front rack-mount brackets and mounting rails, and then insert the screws.
Note Because the fan tray is on the left side of the chassis, Cisco recommends using only the right
side for cable management. Using the right side for cable management allows easy removal of the fan tray if you need to replace a fan.
Step 6 Align the holes in the front rack-mount bracket with the holes in the mounting rails and insert the 12-24
x 3/4-inch or 10-32 x 3/4-inch screws (see
Note Use a minimum of six screws per side to ensure that the switch is adequately supported.
Cisco MDS 9500 Series Hardware Installation Guide
Figure 2-8), using six screws per side.
OL-17467-02
Chapter 2 Installing the Cisco MDS 9500 Series
99023
1
4
2
3
Installing the Chassis in a Cabinet or Rack
Send documentation comments to mdsfeedback-doc@cisco.com.
Figure 2-8 Installing the Cable Management Bracket on the MDS 9509 Chassis
1 Screws, 12-24 or 10-32 3 Mounting rail 2 Front rack-mount bracket (behind
4 Cable guide
cable guide)

Installing the Cisco MDS 9506 Director in a Rack

Table 2-3 lists the items provided in the Cisco MDS 9506 rack-mount kit. The kit contains extra M4
screws in case the front rack-mount brackets were removed from the switch and must be reinstalled.
Note The rack-mount kit for the Cisco MDS 9506 Director does not include side rack-mount brackets, because
they are not required to install the Cisco MDS 9506 Director.
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
2-15
Chapter 2 Installing the Cisco MDS 9500 Series
99021
2
4
1
3
Installing the Chassis in a Cabinet or Rack
Send documentation comments to mdsfeedback-doc@cisco.com.
Ta b l e 2-3 Contents of Cisco MDS 9506 Rack-Mount Kit
Quantity Part Description
14 12-24 x 3/4-in. Phillips binder-head screws
14 10-32 x 3/4-in. Phillips binder-head screws
14 M4 x 6-mm Phillips pan-head screws
2 Cable management brackets
Figure 2-9 shows the installation of a Cisco MDS 9506 director into a rack, using the cable management
bracket.
Figure 2-9 Installing the Cisco MDS 9506 Chassis in the Rack
2-16
1 Screws, 12-24 or 10-32 3 Mounting rail 2 Front rack-mount bracket (behind cable
guide)
Cisco MDS 9500 Series Hardware Installation Guide
4 Cable management bracket
OL-17467-02
Chapter 2 Installing the Cisco MDS 9500 Series

System Grounding

Send documentation comments to mdsfeedback-doc@cisco.com.
To install the Cisco MDS 9506 chassis in the rack using the rack-mount kit, follow these steps:
Step 1 Place all the parts and screwdrivers near the rack for easy access while attaching the switch to the rack.
Note The front rack-mount brackets are shipped installed on the switch. If they have been uninstalled,
reinstall them on the switch using the M4 x 6-mm screws.
Step 2 Position a person at each side of the chassis. Grasp the bottom of the chassis and slowly lift the chassis
in unison, avoiding sudden twists or moves to prevent injury. Insert the rear of the chassis between the front mounting rails (see complete.
Step 3 If you are installing the optional cable management bracket, align the holes in the cable management
bracket with the holes in the front, right rack-mount brackets and the mounting rail. Ensure that the chassis is level, and pass the screws through the cable management brackets and front rack-mount bracket and into the mounting rail.
Note Because the fan tray is on the left side of the chassis, Cisco recommends using only the right
side for cable management. This allows easy removal of the fan tray if you need to replace a fan.
Figure 2-9), supporting the switch inside the rack until the next step is
Step 4 Align the holes in the front rack-mount bracket with the holes in the mounting rail, and ensure that the
chassis is level. Insert the 12-24 x 3/4-inch or 10-32 x 3/4-inch screws (depending on the type of holes in the mounting rails) through the holes in the front rack-mount bracket and into the holes in the mounting rails, using four screws per side.
Caution Use a minimum of four screws per side to ensure that the switch is adequately supported by
the front rack-mount brackets.
System Grounding
This section describes the need for system grounding and explains how to prevent damage from electrostatic discharge.

Proper Grounding Practices

Grounding is one of the most important parts of equipment installation. Proper grounding practices ensure that the buildings and the installed equipment within them have low-impedance connections and low-voltage differentials between chassis. When you properly ground systems during installation, you reduce or prevent shock hazards, equipment damage due to transients, and data corruption. lists grounding best practices.
Table 2-4
OL-17467-02
Cisco MDS 9500 Series Hardware Installation Guide
2-17
Chapter 2 Installing the Cisco MDS 9500 Series
System Grounding
Send documentation comments to mdsfeedback-doc@cisco.com.
Ta b l e 2-4 Grounding Best Practices
Electromagnetic Noise Severity
Environment
Commercial building is subjected to direct lightning strikes.
For example, some places in the United States, such as Florida, are subject to more lightning strikes than other areas.
Commercial building is located in an area where lightning storms frequently occur but is not subject to direct lightning strikes.
Commercial building contains a mix of information technology equipment and industrial equipment, such as welding.
Existing commercial building is not subject to natural environmental noise or man-made industrial noise. This building contains a standard office environment. This installation has a history of malfunction due to electromagnetic noise.
New commercial building is not subject to natural environmental noise or man-made industrial noise. This building contains a standard office environment.
Existing commercial building is not subject to natural environmental noise or man-made industrial noise. This building contains a standard office environment.
Level
Grounding Recommendations
High All lightning protection devices
must be installed in strict accordance with manufacturer recommendations. Conductors carrying lightning current should be spaced away from power and data lines in accordance with applicable recommendations and codes. Appropriate grounding practices must be closely followed.
High Appropriate grounding practices
must be closely followed.
Medium to high Appropriate grounding practices
must be closely followed.
Medium Appropriate grounding practices
must be closely followed. Determine source and cause of noise if possible, and mitigate as closely as possible at the noise source or reduce coupling from the noise source to the victim equipment.
Low Appropriate grounding practices
should be followed as closely as possible. Electromagnetic noise problems are not anticipated, but installing a best practice grounding system in a new building is often the least expensive route and the best way to plan for the future.
Low Appropriate grounding practices
should be followed as much as possible. Electromagnetic noise problems are not anticipated, but installing a best practice grounding system is always recommended.
2-18
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Chapter 2 Installing the Cisco MDS 9500 Series
System Grounding
Send documentation comments to mdsfeedback-doc@cisco.com.
Note In all situations, grounding practices must comply with local National Electric Code (NEC)
requirements or local laws and regulations.
Note Always ensure that all of the modules are completely installed and that the captive installation screws
are fully tightened. In addition, ensure that all I/O cables and power cords are properly seated. These practices are normal installation practices and must be followed in all installations.

Preventing Electrostatic Discharge Damage

Electrostatic discharge (ESD) damage, which can occur when modules or other FRUs are improperly handled, results in intermittent or complete failures. Modules consist of printed circuit boards that are fixed in metal carriers. Electromagnetic interference (EMI) shielding and connectors are integral components of the carrier. Although the metal carrier helps protect the board from ESD. Always wear an ESD grounding strap when handling modules.
Follow these guidelines for preventing ESD damage:
Always wear an ESD wrist strap and ensure that it makes maximum contact with bare skin. ESD
grounding straps are available with banana plugs, metal spring clips, or alligator clips. All MDS 9500 series chassis are equipped with a banana plug connector (identified by the ground symbol next to the connector) somewhere on the front panel. Cisco recommends that you use a personal ESD grounding strap equipped with a banana plug.
If you choose to use the disposable ESD wrist strap supplied with most FRUs or an ESD wrist strap
equipped with an alligator clip, you must attach the system ground lug to the chassis in order to provide a proper grounding point for the ESD wrist strap.
Note This system ground is also referred to as the network equipment building system (NEBS) ground.
If your chassis does not have the system ground attached, you must install the system ground lug.
For installation instructions and location of the chassis system ground pads, see
“Establishing the
System Ground” section on page 2-22.
Note You do not need to attach a supplemental system ground wire to the system ground lug; the lug provides
a direct path to the bare metal of the chassis.
After you install the system ground lug, follow these steps to correctly attach the ESD wrist strap:
Step 1 Attach the ESD wrist strap to bare skin as follows:
OL-17467-02
a. If you are using the ESD wrist strap supplied with the FRUs, open the wrist strap package and
unwrap the ESD wrist strap. Place the black conductive loop over your wrist and tighten the strap so that it makes good contact with your bare skin.
b. If you are using an ESD wrist strap equipped with an alligator clip, open the package and remove
the ESD wrist strap. Locate the end of the wrist strap that attaches to your body and secure it to your bare skin.
Cisco MDS 9500 Series Hardware Installation Guide
2-19
Chapter 2 Installing the Cisco MDS 9500 Series
System Grounding
Send documentation comments to mdsfeedback-doc@cisco.com.
Step 2 Grasp the spring or alligator clip on the ESD wrist strap and momentarily touch the clip to a bare metal
spot (unpainted surface) on the rack. Cisco recommends that you touch the clip to an unpainted rack rail so that any built-up static charge is then safely dissipated to the entire rack.
Step 3 Attach either the spring clip or the alligator clip to the ground lug screw as follows (see Figure 2-10):
a. If you are using the ESD wrist strap that is supplied with the FRUs, squeeze the spring clip jaws
open, position the spring clip to one side of the system ground lug screw head, and slide the spring clip over the lug screw head so that the spring clip jaws close behind the lug screw head.
Note The spring clip jaws do not open wide enough to fit directly over the head of the lug screw or
the lug barrel.
b. If you are using an ESD wrist strap that is equipped with an alligator clip, attach the alligator clip
directly over the head of the system ground lug screw or to the system ground lug barrel.
2-20
Cisco MDS 9500 Series Hardware Installation Guide
OL-17467-02
Loading...