Cisco Systems, Inc.
170 West Tasman Drive
San Jose, CA 95134-1706
USA
http://www.cisco.com
Tel: 408 526-4000
800 553-NETS (6387)
Fax: 408 527-0883
THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS,
INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND,
EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.
THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH
THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY,
CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.
The following information is for FCC compliance of Class A devices: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to part 15
of the FCC rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment
generates, uses, and can radiate radio-frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications.
Operation of this equipment in a residential area is likely to cause harmful interference, in which case users will be required to correct the interference at their own expense.
The following information is for FCC compliance of Class B devices: This equipment has been tested and found to comply with the limits for a Class B digital device, pursuant to part 15
of the FCC rules. These limits are designed to provide reasonable protection against harmful interference in a residential installation. This equipment generates, uses and can radiate radio
frequency energy and, if not installed and used in accordance with the instructions, may cause harmful interference to radio communications. However, there is no guarantee that interference
will not occur in a particular installation. If the equipment causes interference to radio or television reception, which can be determined by turning the equipment off and on, users are
encouraged to try to correct the interference by using one or more of the following measures:
Reorient or relocate the receiving antenna.
•
Increase the separation between the equipment and receiver.
•
Connect the equipment into an outlet on a circuit different from that to which the receiver is connected.
•
Consult the dealer or an experienced radio/TV technician for help.
•
Modifications to this product not authorized by Cisco could void the FCC approval and negate your authority to operate the product
NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED "AS IS" WITH ALL FAULTS.
CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE OF
MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE PRACTICE.
IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT
LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS
HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
Any Internet Protocol (IP) addresses and phone numbers used in this document are not intended to be actual addresses and phone numbers. Any examples, command display output, network
topology diagrams, and other figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses or phone numbers in illustrative content is unintentional
and coincidental.
Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL: http://
www.cisco.com/go/trademarks. Third-party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership
relationship between Cisco and any other company. (1110R)
This preface describes the audience, and conventions of the Cisco MDS 9396S Multilayer Fabric Switch
Hardware Installation Guide. It also provides information on how to obtain related documentation.
Preface, page 1
•
Audience, page 1
•
Document Conventions, page 1
•
Related Documentation, page 2
•
Obtaining Documentation and Submitting a Service Request, page 2
•
This preface describes the audience, organization, and conventions of Cisco MDS 9000 Series Configuration
Guides. It also provides information on how to obtain related documentation.
Audience
To use this installation guide, you need to be familiar with electronic circuitry and wiring practices and
preferably be an electronic or electromechanical technician.
Document Conventions
This document uses the following conventions:
Note
Means reader take note. Notes contain helpful suggestions or references to material not covered in the
manual.
Means reader be careful. In this situation, you might do something that could result in equipment damage
or loss of data.
Warnings use the following conventions:
This warning symbol means danger. You are in a situation that could cause bodily injury. Before you
work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with
standard practices for preventing accidents. Use the statement number provided at the end of each warning
to locate its translation in the translated safety warnings that accompanied this device. Statement 1071.
Related Documentation
The documentation set for the Cisco MDS 9000 Family includes the following documents. To find a document
online, use the Cisco MDS NX-OS Documentation Locator at:
Obtaining Documentation and Submitting a Service Request
For information on obtaining documentation, using the Cisco Bug Search Tool (BST), submitting a service
request, and gathering additional information, see What's New in Cisco Product Documentation.
The Cisco MDS 9396S Multilayer Fabric Switch (DS-C9396S-K9) is a next generation multilayer Intelligent
Services-oriented fabric switch. With powerful, compact, two rack unit (2 RU) form factors, it has an
integrated 96-port Fibre Channel functionality. The Cisco MDS 9396S switch meets the requirements for a:
Standalone storage area network (SAN) in small departmental storage environments.
•
Middle-of-row switch in medium-sized redundant fabrics.
•
Edge switch in enterprise data center core-edge topologies.
•
The Cisco MDS 9396S switch has the following major features:
96 licensed ports, or 48 licensed ports expandable up to 96 ports in 12 port increments with On-Demand
•
licenses.
All Fibre Channel ports capable of line rate at 2, 4, 8, 10, 16 Gbps.
•
Port interfaces that support field-replaceable, hot-swappable small form-factor pluggable (SFP)
•
transceivers.
Redundant hot-swappable power supplies and fan trays.
•
Port Channels for Inter-Switch Link (ISL) resiliency, and F-port channeling for resiliency on uplinks
•
from a Cisco MDS 9396S operating in NPV mode.
Enterprise class features such as In-Service Software Upgrades (ISSU), Virtual SANs (VSANs), security
•
features, and Quality of Service (QoS).
Power On Auto Provisioning (POAP) to automate software image upgrades and configuration file
•
installation on newly deployed switches.
Generic OnLine Diagnostics (GOLD), a built in diagnostic system with intelligent boot up and periodic
•
runtime tests.
Full compatibility with the Cisco MDS 9000 Family.
10/100/1000 Mbps Ethernet management port7System status LED2
Fibre Channel ports8Power supply LED3
Exhaust grill9Fan LED4
Exhaust grill5
The rear of the Cisco MDS 9396S switch has two PSU bays for the redundant AC PSUs, two fan bays for
the redundant fan modules and the chassis ground pad. Each side panel has attachments points for rack mount
rails.
Figure 2: Side and Rear view of the Cisco MDS 9396S Switch
The rear of the Cisco MDS 9396S switch also contains the grounding point which is present under a label
(Figure 2).
Figure 3: Grounding point and fan securing screws
•
•
•
•
•
Fan Modules
The Cisco MDS 9396S Multilayer Fabric switch supports two hot-swappable fan modules that allow the
switches to continue to run if a fan module is removed, provided that the preset temperature thresholds have
not been exceeded. You can swap out a fan module without having to bring the system down. Each fan module
on the Cisco MDS 9396S switch has two fans.
New fan modules which support reverse airflow (port-side intake) have been introduced in Cisco MDS NX-OS
Releases 6.2(x) starting from Cisco MDS NX-OS Release 6.2(15) and Cisco MDS NX-OS Releases 7.3(x)
starting from Cisco MDS NX-OS Release 7.3(1)D1(1).
To verify the direction of airflow in fan modules, the following colors are denoted on the fan modules:
• Red—Port-side intake airflow
• Blue—Port-side exhaust airflow
Fan modules which support port-side intake airflow can be used with a new Power Supply Unit,
DS-CAC-1200W, only. If an older PSU (DS-CAC-1200W-E) is used with the fan modules which support
port-side intake airflow, a warning is issued on the software after which the switch shuts down in 10 minutes.
If a chassis has two different fan modules, one supporting port-side exhaust airflow and the other supporting
port-side intake airflow, the switch is immediately powered down.
To verify the current fan module on the switch, use the show inventory fan command.Note
The Cisco MDS 9396S switch has internal temperature sensors that can shut down the system if the
temperature at different points within the chassis exceeds certain safety thresholds. To be effective, the
temperature sensors require the presence of airflow; therefore, in the event a fan module is removed from
the chassis, the Cisco MDS 9396S switch will shut down after five minutes to prevent potentially
undetectable overheating. However, the switches will shut down sooner if the higher-level temperature
threshold is exceeded. For normal operation, the Cisco MDS 9396S switch requires four fans. Fan module
status is also indicated on a front panel LED. To check temperature threshold values, use the showenvironment temperature command.
Procedures for replacing and installing the fan modules are available in the Removing and Installing
Components, on page 26 section.
Power Supplies
The Cisco MDS 9396S Multilayer Fabric switch supports two hot swappable AC power supply units (PSUs).
Each unit has a power receptacle and a status LED on the faceplate, and a handle for inserting and removing
the unit from the chassis. In the event of a PSU or AC supply (in grid redundant mode) failure, the system
will continue to run. PSUs are hot swappable and can be individually replaced without shutting down the
system. Procedures for installing and removing PSUs are detailed in the Removing and Installing AC Power
Supplies, on page 26 section.
A new PSU (DS-CAC-1200W) which supports both port-side exhaust airflow and port-side intake airflow of
fan modules has been introduced in Cisco MDS NX-OS Releases 6.2(x) starting from Cisco MDS NX-OS
Release 6.2(15) and Cisco MDS NX-OS Releases 7.3(x) starting from Cisco MDS NX-OS Release 7.3(1)D1(1).
To verify the direction of airflow in PSUs, the following colors are denoted on the PSUs:
Switch Ports
The Cisco MDS 9396S Multilayer Fabric Switch provides host, target and Inter Switch Link (ISL) connectivity.
Each port has an LED which indicates the link status. The ports support SFP+ type Fibre Channel transceivers.
For more information on transceivers, see the Supported SFP+ Transceivers section.
Up to 96 auto speed detecting Fibre Channel ports capable of 2, 4, 8, 10, and 16 Gbps speeds are available.
By default, the first 48 ports are licenced and activated. The remaining ports can be activated by purchasing
On Demand Port Activation Licences, which are available in 12 port increments.
The Cisco 9396S switch has an out of band Ethernet management port. This port has link and link activity
LEDs. There is also an out of band RS-232 console port for access and monitoring the system in the boot
mode. This port provides software flow control only.
• White—Port-side intake airflow or port-side exhaust airflow depending on the type of airflow of the
system fan modules. This PSU automatically configures itself to work in port-side exhaust airflow mode
if the switch has Blue system fan modules installed. Similarly, the PSU automatically configures itself
to work in port-side intake airflow mode if the switch has Red fan modules installed. For more information
on the direction of airflow in fan modules, see the Fan Modules, on page 8 section.
The Cisco 9396S switch has a USB port. This can be used for increasing the flash storage of the system or
moving files between the system and outside world through a USB stick.
Switch LEDs
The Cisco MDS 9396S Multilayer Fabric Switch includes the LEDs shown in the following figure. You can
use the LEDs to quickly identify the system status.
Figure 5: LEDs : Front view of the Cisco MDS 9396S Switch
Any of the following conditions
exists in the PSU:
Over voltage
Over current
Over temperature
Fan failure.
PSU has a fault, but is still
operating.
PSU is operating normally.Off
Fan module is operating normally.Solid onGreenFaceplate of each
One fan in the fan module has
failed.
Supported SFP+ Transceivers
SFP+ transceivers are field-replaceable. You can use any combination of SFP+ transceivers that are supported
by the switch. The only restrictions are that SWL transceivers must be paired with SWL transceivers, and
LWL transceivers with LWL transceivers, and the cable must not exceed the stipulated cable length for reliable
communications.
For the list of SFP+ transceivers supported on the Cisco MDS 9396S Switch, see the Cisco MDS 9000 Family
Release Notes for Cisco MDS NX-OS Release 6.2(13). For more information about a specific Cisco SFP+
transceiver, see the SFP Transceiver Specifications section. SFP+ transceivers can be ordered separately or
with the Cisco MDS 9396S Switch.
Note
Use only Cisco SFP+ transceivers on the Cisco MDS 9396S switches. Each Cisco SFP+ transceiver is
encoded with model information that enables the switch to verify that the SFP+ transceiver meets the
requirements for the switch.
This chapter describes how to install the Cisco MDS 9396S switch and its components.
Note
Warning
Warning
Warning
Before you install, operate, or service the system, see the Regulatory Compliance and Safety Information
for the Cisco MDS 9000 Family for important safety information.
IMPORTANT SAFETY INSTRUCTIONS
This warning symbol means danger. You are in a situation that could cause bodily injury. Before
you work on any equipment, be aware of the hazards involved with electrical circuitry and be
familiar with standard practices for preventing accidents. Use the statement number provided at
the end of each warning to locate its translation in the translated safety warnings that accompanied
this device. Statement 1071
SAVE THESE INSTRUCTIONS
This unit is intended for installation in restricted access areas. A restricted access area can be
accessed only through the use of a special tool, lock and key, or other means of security. Statement
1017
Only trained and qualified personnel should be allowed to install, replace, or service this equipment.
Statement 1030
Note
Each new switch requires a license; see the Cisco MDS 9000 Family NX-OS Licensing Guide for
instructions on installing a license.
The Cisco MDS 9396S Switch can be installed using the following methods:
In an open EIA rack, using:
•
The rack-mount kit shipped with the switch
◦
Installing the Cisco MDS 9396S Switch
The Telco and EIA Shelf Bracket Kit (an optional kit, purchased separately) in addition to the
◦
rack-mount kit shipped with the switch
In a perforated or solid-walled EIA cabinet, using:
•
The rack-mount kit shipped with the switch
◦
The Telco and EIA Shelf Bracket Kit (an optional kit, purchased separately) in addition to the
◦
rack-mount kit shipped with the switch
For instructions on installing the switch using the optional, separately purchased Telco and EIA Shelf Bracket
Kit, see the Cisco MDS 9000 Family Telco and EIA Shelf Bracket section.
Note
The Telco and EIA Shelf Bracket Kit is optional and is not provided with the switch. To order the kit,
contact your switch provider.
Installation Guidelines
Follow these guidelines when installing the Cisco MDS 9396S Switch:
Plan your site configuration and prepare the site before installing the switch. The recommended site
•
planning tasks are listed in the Site Planning and Maintenance Records section.
Ensure there is adequate space around the switch to allow for servicing the switch and for adequate
•
airflow (airflow requirements are listed the Technical Specifications section).
Ensure the air-conditioning meets the heat dissipation requirements listed the Technical Specifications
•
section.
Ensure the cabinet or rack meets the requirements listed in the Cabinet and Rack Installation section.
If the front cabinet mounting rails are not offset from the front door or bezel panel by a minimum of 3
inch (7.6 cm), and a minimum of 5 inch. (12.7 cm), and cable management brackets are installed on the
front of the chassis, the chassis should be mounted rear-facing to ensure the minimum bend radius for
fiber-optic cables.
Jumper power cords are available for use in a cabinet. For more information, see the Jumper Power Cord
section.
Ensure the chassis is adequately grounded. If the switch is not mounted in a grounded rack, we recommend
•
connecting both the system ground on the chassis and the power supply ground to an earth ground.
Ensure the site power meets the power requirements listed in the Technical Specifications section. If
•
available, you can use an uninterrupted power supply (UPS) to protect against power failures.
Avoid UPS types that use ferro-resonant technology. These UPS types can become unstable with systems
such as the Cisco MDS 9000 Family, which can have substantial current draw fluctuations because of
fluctuating data traffic patterns.
Ensure that circuits are sized according to local and national codes.
•
For North America, the 300 W power supplies require a 20 A circuit. If you are using a 200 or 240 VAC
power source in North America, the circuit must be protected by a two-pole circuit breaker.
Caution
To prevent loss of input power, ensure the total maximum loads on the circuits supplying power to the
switch are within current ratings for wiring and breakers.
As you install and configure the switch, record the information listed in the Site Planning and Maintenance
•
Records section
Use the following screw torques when installing the switch:
Before beginning the installation, ensure that you have the following items available in addition to the switch
and its accessory kit:
Eight customer-supplied 12-24 or 10-32 screws (required for attaching slider rails and mounting bracket
•
to the mounting rails)
Number 1 and number 2 Phillips screwdrivers with torque capability
•
3/16-inch flat-blade screwdriver
•
Tape measure and level
•
ESD wrist strap or other grounding device
•
Anti static surface
•
The following additional items (not found in the accessory kit) are required to ground the chassis:
Grounding cable (6 AWG recommended), sized according to local and national installation requirements;
•
the required length depends on the proximity of the switch to proper grounding facilities
Crimping tool large enough to accommodate girth of lug
Installing the Cisco MDS 9396S Switch
Wire stripping tool
•
Unpacking and Inspecting the Switch
Caution
Note
Note
When handling switch components, wear an ESD strap and handle modules by the carrier edges only. An
ESD socket is provided on the chassis. For the ESD socket to be effective, the chassis must be grounded
through the power cable, the chassis ground, or the metal-to-metal contact with a grounded rack.
Keep the shipping container in case the chassis requires shipping in the future.Tip
If you purchased Cisco support through a Cisco reseller, contact the reseller directly. If you purchased
support directly from Cisco, contact Cisco Technical Support at this URL: http://www.cisco.com/c/en/us/
support/web/tsd-cisco-worldwide-contacts.html
The switch is thoroughly inspected before shipment. If any damage occurred during transportation or any
items are missing, contact your customer representative immediately.