Brocade Communications Systems DCX Backbone Hardware Installation Manual

HARDWARE INSTALLATION GUIDE

Brocade DCX Backbone Hardware Installation Guide

53-1000685-24 28 February 2017

Brocade, the B-wing symbol, and MyBrocade are registered trademarks of Brocade Communications Systems, Inc., in the United States and in other countries. Other brands, product names, or service names mentioned of Brocade Communications Systems, Inc. are listed at www.brocade.com/en/legal/

brocade-Legal-intellectual-property/brocade-legal-trademarks.html. Other marks may belong to third parties.

Notice: This document is for informational purposes only and does not set forth any warranty, expressed or implied, concerning any equipment, equipment feature, or service oered or to be oered by Brocade. Brocade reserves the right to make changes to this document at any time, without notice, and assumes no responsibility for its use. This informational document describes features that may not be currently available. Contact a Brocade sales oce for information on feature and product availability. Export of technical data contained in this document may require an export license from the United States government.

The authors and Brocade Communications Systems, Inc. assume no liability or responsibility to any person or entity with respect to the accuracy of this document or any loss, cost, liability, or damages arising from the information contained herein or the computer programs that accompany it.

The product described by this document may contain open source software covered by the GNU General Public License or other open source license agreements. To nd out which open source software is included in Brocade products, view the licensing terms applicable to the open source software, and obtain a copy of the programming source code, please visit http://www.brocade.com/support/oscd.

2 53-1000685-24

Brocade DCX Backbone Hardware Installation Guide

Contents

Preface...................................................................................................................................................................................................................................9

Document conventions............................................................................................................................................................................................................................9

Notes, cautions, and warnings.....................................................................................................................................................................................................9

Text formatting conventions.........................................................................................................................................................................................................9

Command syntax conventions.................................................................................................................................................................................................10

Brocade resources..................................................................................................................................................................................................................................10

Document feedback.............................................................................................................................................................................................................................. 10

Contacting Brocade Technical Support......................................................................................................................................................................................... 11

Brocade customers.......................................................................................................................................................................................................................11

Brocade OEM customers..........................................................................................................................................................................................................11

About This Document..................................................................................................................................................................................................... 13

Supported hardware and software...................................................................................................................................................................................................13

What’s new in this document............................................................................................................................................................................................................. 13

Overview.............................................................................................................................................................................................................................15

Brocade DCX features.......................................................................................................................................................................................................................... 15

Hardware components..........................................................................................................................................................................................................................15

Port side of the Brocade DCX..................................................................................................................................................................................................17

Nonport side of the Brocade DCX......................................................................................................................................................................................... 18

Brocade DCX blades.............................................................................................................................................................................................................................18

Chassis slots............................................................................................................................................................................................................................................. 20

Port numbering........................................................................................................................................................................................................................................20

High availability........................................................................................................................................................................................................................................ 20

Reliability.....................................................................................................................................................................................................................................................21

Serviceability............................................................................................................................................................................................................................................. 21

Software features.....................................................................................................................................................................................................................................22

Security........................................................................................................................................................................................................................................................22

Network manageability.........................................................................................................................................................................................................................23

Preparing for the Installation..........................................................................................................................................................................................25

Installation and safety considerations.............................................................................................................................................................................................25

Time and items required for installation.........................................................................................................................................................................................26

Items included with the device...........................................................................................................................................................................................................27

Mounting the Device........................................................................................................................................................................................................29

Mounting precautions............................................................................................................................................................................................................................29

Mounting options....................................................................................................................................................................................................................................30

Unpacking, transporting, and installing the device....................................................................................................................................................................30

Installing the 14U Rack Mount Kit for Four-Post Racks (XBR-DCX-0120 and XBR-DCX-0152) ..................................................................31

Time and items required.............................................................................................................................................................................................................32

Parts list............................................................................................................................................................................................................................................. 32

Parts list – NEBS kit..................................................................................................................................................................................................................... 33

Assembling the rack hardware.................................................................................................................................................................................................34

Installing the device in the rack................................................................................................................................................................................................ 37

Installing the 14U Chassis Mid-Mount Rack Kit for Two-Post Racks (XBR-DCX-0121)...................................................................................... 39

Time and Items required.............................................................................................................................................................................................................40

Brocade DCX Backbone Hardware Installation Guide 53-1000685-24 3

Cable Management..........................................................................................................................................................................................................47

Requirements and precautions..........................................................................................................................................................................................................47

Qualied cables for the FC8-64 port blade................................................................................................................................................................................48

Installing ICL cables (optional)...........................................................................................................................................................................................................49

Logging In and Conguring the DCX Backbone....................................................................................................................................................... 51

Items required...........................................................................................................................................................................................................................................51

Providing power to the DCX Backbone.........................................................................................................................................................................................52

Conguring the Brocade DCX...........................................................................................................................................................................................................52

Establishing a serial connection and logging on to the Brocade DCX.............................................................................................................................53

Logging in to the serial console port...............................................................................................................................................................................................54

Conguring the IP addresses.............................................................................................................................................................................................................54

Logging o the serial console port and disconnecting the serial cable............................................................................................................................56

Connecting an Ethernet cable and opening a Telnet session...............................................................................................................................................56

Customizing a switch name................................................................................................................................................................................................................56

Customizing a chassis name..............................................................................................................................................................................................................57

Setting the domain ID........................................................................................................................................................................................................................... 57

Setting the date and time.....................................................................................................................................................................................................................57

Setting the date...............................................................................................................................................................................................................................57

Setting the time zone................................................................................................................................................................................................................... 58

Synchronizing local time.............................................................................................................................................................................................................59

Verifying the PID mode and connecting to the fabric..............................................................................................................................................................59

Software licenses.....................................................................................................................................................................................................................................59

Installing transceivers and attaching cables.................................................................................................................................................................................60

Managing cables..................................................................................................................................................................................................................................... 60

Verifying correct operation and backing up the conguration..............................................................................................................................................61

Powering o the Brocade DCX.........................................................................................................................................................................................................62

Monitoring System Components..................................................................................................................................................................................63

Monitoring overview...............................................................................................................................................................................................................................63

Determining the status of a port, application, or encryption blade.....................................................................................................................................63

Determining the status of a control processor blade (CP8)..................................................................................................................................................72

Determining the status of a core switch blade (CR8)...............................................................................................................................................................74

Determining the status of a power supply....................................................................................................................................................................................76

Determining the status of a blower assembly.............................................................................................................................................................................77

Determining the status of a WWN card.........................................................................................................................................................................................80

Removal and Replacement Procedures.......................................................................................................................................................................83

Introduction................................................................................................................................................................................................................................................83

Removal and replacement of the chassis door.......................................................................................................................................................................... 83

Removing a chassis door...........................................................................................................................................................................................................83

Replacing a chassis door............................................................................................................................................................................................................84

Removal and replacement of the cable management comb................................................................................................................................................84

Removing a cable management comb................................................................................................................................................................................85

Replacing a cable management comb.................................................................................................................................................................................86

Removal and replacement of the port, application, and encryption blades....................................................................................................................86

4 53-1000685-24

Brocade DCX Backbone Hardware Installation Guide

Removing a blade..........................................................................................................................................................................................................................87

Replacing a blade...........................................................................................................................................................................................................................88

Removal and replacement of the blade ller panel...................................................................................................................................................................89

Removing a ller panel................................................................................................................................................................................................................89

Replacing a ller panel.................................................................................................................................................................................................................90

Removal and replacement of the control processor blade (CP8).......................................................................................................................................91

Verifying the necessity of replacement.................................................................................................................................................................................91

Recording critical Brocade DCX information..................................................................................................................................................................... 92

Power-up procedure.....................................................................................................................................................................................................................92

Power-down procedure...............................................................................................................................................................................................................94

Verifying operation of the new CP blade............................................................................................................................................................................. 95

Removal and replacement of the core switch blade (CR8)....................................................................................................................................................97

Removing a core switch blade (CR8).................................................................................................................................................................................... 98

Replacing a core switch blade (CR8).....................................................................................................................................................................................99

Removal and replacement of the power supply......................................................................................................................................................................100

Identifying power supplies...................................................................................................................................................................................................... 100

Power-cord notice......................................................................................................................................................................................................................101

Removing a power supply......................................................................................................................................................................................................101

Replacing a power supply.......................................................................................................................................................................................................102

Removal and replacement of the blower assembly...............................................................................................................................................................103

Removing a blower assembly ..............................................................................................................................................................................................103

Replacing a blower assembly................................................................................................................................................................................................104

WWN card removal and replacement..........................................................................................................................................................................................105

Using the wwnrecover utility...................................................................................................................................................................................................106

Verifying the need for replacement.....................................................................................................................................................................................106

Preparing for WWN card replacement...............................................................................................................................................................................107

Hot-swap replacement.............................................................................................................................................................................................................107

Power-down replacement.......................................................................................................................................................................................................108

Removing the WWN card and WWN bezel (logo plate).............................................................................................................................................110

Removal and replacement of the transceivers.........................................................................................................................................................................113

Time Required..............................................................................................................................................................................................................................113

Items Required.............................................................................................................................................................................................................................113

Removing and replacing an SFP, SFP+, or XFP optical transceiver.....................................................................................................................113

Removing and replacing an mSFP optical transceiver...............................................................................................................................................114

Removal and replacement of the inter-chassis link (ICL) cables......................................................................................................................................115

Time and items Required........................................................................................................................................................................................................116

Removing an ICL cable............................................................................................................................................................................................................116

Replacing an ICL cable.............................................................................................................................................................................................................117

Removal and replacement of the Brocade DCX chassis....................................................................................................................................................125

Verifying need for replacement.............................................................................................................................................................................................125

Recording critical Brocade DCX and SAN information..............................................................................................................................................126

Disconnecting from network and fabric............................................................................................................................................................................129

Removing components from the chassis.........................................................................................................................................................................130

Brocade DCX Backbone Hardware Installation Guide 53-1000685-24 5

Installing the replacement chassis.......................................................................................................................................................................................130

Installing components into the new chassis....................................................................................................................................................................131

Downloading the conguration.............................................................................................................................................................................................132

Verifying correct operation of system................................................................................................................................................................................ 132

Reconnecting the system to the network and fabric....................................................................................................................................................134

Verifying correct conguration of the fabric.....................................................................................................................................................................135

Cable routing table.....................................................................................................................................................................................................................135

Application and Encryption Blades............................................................................................................................................................................139

FS8-18 blade....................................................................................................................................................................................................................................... 139

FX8-24 blade....................................................................................................................................................................................................................................... 139

FCOE10-24 blade.............................................................................................................................................................................................................................141

Diagnostics and Troubleshooting...............................................................................................................................................................................143

Obtaining chassis and component status................................................................................................................................................................................. 143

Interpreting POST and boot results............................................................................................................................................................................................. 144

POST...............................................................................................................................................................................................................................................144

Boot..................................................................................................................................................................................................................................................144

Diagnostics.............................................................................................................................................................................................................................................145

Troubleshooting....................................................................................................................................................................................................................................145

Port Numbering Template........................................................................................................................................................................................... 149

Regulatory Statements.................................................................................................................................................................................................157

BSMI statement (Taiwan)..................................................................................................................................................................................................................157

Canadian requirements......................................................................................................................................................................................................................157

CE statement.........................................................................................................................................................................................................................................157

China ROHS.......................................................................................................................................................................................................................................... 158

FCC warning (US only)...................................................................................................................................................................................................................... 158

KCC statement (Republic of Korea)..............................................................................................................................................................................................158

VCCI statement.....................................................................................................................................................................................................................................158

Brocade DCX Backbone Technical Specications................................................................................................................................................. 159

System specications.........................................................................................................................................................................................................................159

Fibre Channel.........................................................................................................................................................................................................................................159

LEDs..........................................................................................................................................................................................................................................................159

Other......................................................................................................................................................................................................................................................... 160

Weight and physical dimensions................................................................................................................................................................................................... 160

Environmental requirements........................................................................................................................................................................................................... 160

Power supply specications (per PSU).......................................................................................................................................................................................160

Power consumption (maximum conguration)........................................................................................................................................................................161

Data port specications (Fibre Channel).....................................................................................................................................................................................161

Fibre Channel data transmission ranges....................................................................................................................................................................................161

Serial port specications (DB9)..................................................................................................................................................................................................... 162

Serial port specications (pinout mini-USB)............................................................................................................................................................................ 162

Serial port specications (pinout RJ-45)....................................................................................................................................................................................162

Serial port specications (protocol)...............................................................................................................................................................................................163

Regulatory compliance (EMC)........................................................................................................................................................................................................163

Regulatory compliance (safety)...................................................................................................................................................................................................... 163

Regulatory compliance (environmental)..................................................................................................................................................................................... 163

6 53-1000685-24

Brocade DCX Backbone Hardware Installation Guide

Caution and Danger Notices....................................................................................................................................................................................... 165

Cautions...................................................................................................................................................................................................................................................165

Danger notices......................................................................................................................................................................................................................................166

Brocade DCX Backbone Hardware Installation Guide 53-1000685-24 7

8 53-1000685-24

Brocade DCX Backbone Hardware Installation Guide

Preface

• Document conventions......................................................................................................................................................................................9

• Brocade resources............................................................................................................................................................................................ 10

• Document feedback.........................................................................................................................................................................................10

• Contacting Brocade Technical Support....................................................................................................................................................11

Document conventions

The document conventions describe text formatting conventions, command syntax conventions, and important notice formats used in Brocade technical documentation.

Notes, cautions, and warnings

Notes, cautions, and warning statements may be used in this document. They are listed in the order of increasing severity of potential

hazards.

NOTE

A Note provides a tip, guidance, or advice, emphasizes important information, or provides a reference to related information.

ATTENTION

An Attention statement indicates a stronger note, for example, to alert you when trac might be interrupted or the device might

reboot.

CAUTION

A Caution statement alerts you to situations that can be potentially hazardous to you or cause damage to hardware,

rmware, software, or data.

DANGER

A Danger statement indicates conditions or situations that can be potentially lethal or extremely hazardous to you. Safety

labels are also attached directly to products to warn of these conditions or situations.

Text formatting conventions

Text formatting conventions such as boldface, italic, or Courier font may be used to highlight specic words or phrases.

Format Description bold text Identies command names.

Identies keywords and operands.

Identies the names of GUI elements.

Identies text to enter in the GUI.

italic text Identies emphasis.

Identies variables.

Identies document titles.

Courier font

Identies CLI output.

Brocade DCX Backbone Hardware Installation Guide 53-1000685-24 9

Brocade resources

Format Description

Identies command syntax examples.

Command syntax conventions

Bold and italic text identify command syntax components. Delimiters and operators relationships.

Convention Description bold text Identies command names, keywords, and command options.

italic text Identies a variable. value In Fibre Channel products, a xed value provided as input to a command option is printed in plain text, for

example, --show WWN.

[ ] Syntax components displayed within square brackets are optional.

Default responses to system prompts are enclosed in square brackets.

{ x | y | z } A choice of required parameters is enclosed in curly brackets separated by vertical bars. You must select

one of the options.

In Fibre Channel products, square brackets may be used instead for this purpose. x | y A vertical bar separates mutually exclusive elements. < > Nonprinting characters, for example, passwords, are enclosed in angle brackets. ... Repeat the previous element, for example, member[member...]. \ Indicates a “soft” line break in command examples. If a backslash separates two lines of a command

input, enter the entire command at the prompt without the backslash.

dene groupings of parameters and their logical

Brocade resources

Visit the Brocade website to locate related documentation for your product and additional Brocade resources.

White papers, data sheets, and the most recent versions of Brocade software and hardware manuals are available at www.brocade.com. Product documentation for all supported releases is available to registered users at MyBrocade.

Click the Support tab and select Document Library to access product documentation on MyBrocade or www.brocade.com. You can locate documentation by product or by operating system.

Release notes are bundled with software downloads on MyBrocade. Links to software downloads are available on the MyBrocade landing page and in the Document Library.

Document feedback

Quality is our However, if you nd an error or an omission, or you think that a topic needs further development, we want to hear from you. You can provide feedback in two ways:

• Through the online feedback form in the HTML documents posted on www.brocade.com

• By sending your feedback to documentation@brocade.com

Provide the publication title, part number, and as much detail as possible, including the topic heading and page number if applicable, as well as your suggestions for improvement.

10 53-1000685-24

rst concern at Brocade, and we have made every eort to ensure the accuracy and completeness of this document.

Brocade DCX Backbone Hardware Installation Guide

Contacting Brocade Technical Support

As a Brocade customer, you can contact Brocade Technical Support 24x7 online or by telephone. Brocade OEM customers should contact their OEM/solution provider.

Brocade customers

For product support information and the latest information on contacting the Technical Assistance Center, go to www.brocade.com and select Support.

If you have purchased Brocade product support directly from Brocade, use one of the following methods to contact the Brocade Technical Assistance Center 24x7.

Online Telephone

Preferred method of contact for non-urgent issues:

• Case management through the MyBrocade portal.

• Quick Access links to Knowledge Base, Community, Document Library, Software Downloads and Licensing tools

Required for Sev 1-Critical and Sev 2-High issues:

• Continental US: 1-800-752-8061

• Europe, Middle East, Africa, and Asia Pacic: +800-AT FIBREE (+800 28 34 27 33)

• Toll-free numbers are available in many countries.

• For areas unable to access a toll-free number: +1-408-333-6061

Brocade OEM customers

If you have purchased Brocade product support from a Brocade OEM/solution provider, contact your OEM/solution provider for all of your product support needs.

• OEM/solution providers are trained and

• Brocade provides backline support for issues that cannot be resolved by the OEM/solution provider.

• Brocade Supplemental Support augments your existing OEM support contract, providing direct access to Brocade expertise. For more information, contact Brocade or your OEM.

• For questions regarding service levels and response times, contact your OEM/solution provider.

certied by Brocade to support Brocade® products.

Brocade DCX Backbone Hardware Installation Guide 53-1000685-24 11

12 53-1000685-24

Brocade DCX Backbone Hardware Installation Guide

About This Document

• Supported hardware and software..............................................................................................................................................................13

• What’s new in this document........................................................................................................................................................................13

Supported hardware and software

This document includes information specic to the Brocade DCX running Brocade Fabric OS version 7.4.0. and later.

Initial support for this device was at Fabric OS version 6.2.0.

What’s new in this document

The following changes have been made in this document:

Modied the copyright statement.

•

• Added note about RTC/NVRAM batteries in Hardware components on page 15.

• Editorial changes to sections in GUID-25F4B3AC-7D35-4DBB-A847-68D335839B41.ditamap.

• Added notes to following sections directing users replacing a defective chassis to not replace WWN cards shipped preinstalled in replacement chassis with existing WWN cards as this will cause licensing and RMA problems. Note also describes license transfer process.

– Removing components from the chassis on page 130 – Installing components into the new chassis on page 131

• Editorial changes in rack mount kit procedures.

Brocade DCX Backbone Hardware Installation Guide 53-1000685-24 13

14 53-1000685-24

Brocade DCX Backbone Hardware Installation Guide

Overview

• Brocade DCX features.....................................................................................................................................................................................15

• Hardware components....................................................................................................................................................................................15

• Brocade DCX blades........................................................................................................................................................................................18

• Chassis slots........................................................................................................................................................................................................20

• Port numbering.................................................................................................................................................................................................. 20

• High availability...................................................................................................................................................................................................20

• Reliability................................................................................................................................................................................................................21

• Serviceability........................................................................................................................................................................................................21

• Software features............................................................................................................................................................................................... 22

• Security.................................................................................................................................................................................................................. 22

• Network manageability....................................................................................................................................................................................23

Brocade DCX features

The Brocade DCX represents the next generation of advanced Fibre Channel enterprise-class platforms used to intelligently interconnect storage devices, hosts, and servers in a Storage Area Network (SAN). The Brocade DCX is the highest-performance and highestscalability enterprise-class platform oered by Brocade. It satises the most demanding Reliability, Availability, and Serviceability (RAS), performance, and scalability requirements, while delivering investment protection, interoperability, and fabric-based intelligence advantages found only in the Brocade product family.

Key features of the Brocade DCX include:

• Up to 512 external ports in a single chassis, enabling high density SAN congurations with reduced footprint.

• Support for 1-, 2-, 4-, and 8-Gbps auto-sensing Fibre Channel (FC) ports. Trunking technology groups up to eight ports to create high performance 64-Gbps ISL trunks between switches. (10-Gbps ports (FC10-6) are 10 Gbps only.)

• Up to 1024 ports in the same rack can connect with the use of inter-chassis links (ICLs). Up 1536 ports can be connected via ICLs in adjacent racks.

• Support for high-performance port blades running at 1, 2, 4, 8, or 10 Gbps, enabling exible system conguration.

• Redundant and hot-swappable CP8 and CR8 blades, power supplies, blower assemblies, and WWN cards that enable a high availability platform and enable nondisruptive software upgrades for mission-critical SAN applications.

• Universal ports that self-congure as E_Ports, F_Ports, FL_Ports, Ex_Ports and M_Ports (mirror ports). (10-Gbps ports (FC10-6) are E_Ports only.)

• Data cryptographic (encryption/decryption) and data compression capabilities through the Brocade FS8-18 Encryption Blade.

• Fibre Channel over IP (FCIP) functionality through the FX8-24 blade.

• Fibre Channel over Ethernet (FCoE) capability through the FCOE10-24 blade.

Hardware components

The Brocade DCX features a modular and scalable mechanical construction that allows a wide range of design, and maintenance. The chassis can be mounted with the cables facing the front of the equipment rack or to the rear, and consists of the following:

• Up to eight hot-swappable port blade assemblies that can be congured in a single chassis, delivering up to 512 Fibre Channel ports.

Brocade DCX Backbone Hardware Installation Guide 53-1000685-24 15

exibility in installation, fabric

Hardware components

• Two slots for control processor blades (CP8): – A single active CP8 blade can control all 512 ports in the chassis.

– The standby CP8 blade assumes control of the Brocade DCX if the active CP fails.

NOTE

Device control processors and management modules contain batteries for RTC/NVRAM backup. Do not attempt to replace these batteries. Dispose of hardware components containing these batteries as required by local ordinances and regulations.

• Two slots for core switch blades (CR8): – CR8 blade interconnects all port blades.

– Two inter-chassis link (ICL) connectors per blade to connect to another chassis. – Both CR8 blades are active.

• Modular hot-swappable port blades: – 16-port, 8-Gbps blades (FC8-16)

– 32-port, 8-Gbps blades (FC8-32) – 48-port, 8-Gbps blades (FC8-48) – 64-port, 8-Gbps blades (FC8-64)

• Modular hot-swappable application blades: – FX8-24: 24-port (12 FC, 10 GbE, 2 10GbE) FCIP extension blade enabling long distance communication over existing

IP infrastructure.

– FCOE10-24: 24-port (24 10GbE) CEE-based FCoE blade enabling enhanced connectivity using existing Ethernet

infrastructure. This blade cannot be used in the same chassis as the high density port blade FC8-64 or any of the other application blades (FX8-24 or FS8-18).

• Modular hot-swappable encryption blades: – FS8-18: 16-port, up to 4 blades per chassis, supporting data cryptographic (encryption/decryption) and data-

compression capabilities.

• Modular hot-swappable eld-replaceable units (FRUs): – Three blower assemblies.

– Up to four power supplies (100-240 VAC auto-sensing).

› At 240 VAC: A minimum of two power supplies is required, regardless of the number of port or application blades.

240 VAC is recommended for eciency and high availability. › At 120 VAC: Four power supplies are required when using the FS8-18, FX8-24, or FCOE10-24 blades. › Redundant AC primary power connections to ensure high availability. Each power supply has its own connector, so the

number of primary power connections varies from two (recommended minimum) to four (optimum eciency and

redundancy).

– Two WWN cards. – Small Form-factor Pluggable (SFP, SFP+, and mSFP) optical transceivers. SFP transceivers support speeds of 1, 2, and 4

Gbps. SFP+ and mSFP transceivers support speeds of 2, 4, and 8 Gbps.

– Extended Form-factor Pluggable (XFP) optical transceivers (10 Gbps).

NOTE

The 8-Gbps SFPs and mSFPs auto-negotiate at 2, 4, and 8 Gbps. The 4-Gbps SFPs auto-negotiate at 1, 2, and 4 Gbps.

• Blades that are serviced from the port side of the Brocade DCX. Blowers, power supplies, and power cables that are serviced from the nonport side.

16 53-1000685-24

Brocade DCX Backbone Hardware Installation Guide

Hardware components

• World Wide Name (WWN) cards on the nonport side, to maintain chassis-specic information such as WWNs, IP addresses, and summary status information of each port blade and power supply through LEDs.

• Redesigned cable management comb and chassis door.

• Constant intake and FRU temperature monitoring.

Port side of the Brocade DCX

NOTE

Airow in the Brocade DCX is from the nonport (noncable) side to the port (cable) side and out the exhaust vent.

The following illustration displays a sample conguration of the port side of the Brocade DCX.

FIGURE 1 Port side of the Brocade DCX (sample conguration)

1. Exhaust Vent

2. Core switch blade (CR8)

3. Control processor blade (CP8)

Brocade DCX Backbone Hardware Installation Guide 53-1000685-24 17

Brocade DCX blades

4. FC8-48 port blade

5. Cable management comb

Nonport side of the Brocade DCX

The following illustration displays a sample conguration of the nonport side of the Brocade DCX.

FIGURE 2 Nonport side of the Brocade DCX (sample conguration)

1. WWN bezel (logo plate)

2. Power supply (4x)

3. Blower assembly (3x)

Brocade DCX blades

The following table summarizes the port, application, control processor, and core switch blades that are supported on the Brocade DCX.

18 53-1000685-24

Brocade DCX Backbone Hardware Installation Guide

Brocade DCX blades

TABLE 1 Blades supported on Brocade DCX

Description Name Function

Brocade DCX control processor blade CP8 The CP8 blade contains the control plane for the

chassis. There are two CP8 blades for redundancy. This control processor blade is compatible with the Brocade DCX and Brocade DCX-4S.

Brocade DCX core switch blade CR8 The CR8 blade contains the ASICs for switching

between port blades. Every port blade connects to each core switch blade. There can be up to 512 total ports for port blades. Each core switch blade connects to 128 backplane ports. Core switch blades have additional front port connectivity to connect multiple chassis and backplane connections for the storage server blade. This core switch blade is compatible only with the Brocade DCX.

16-port 8-Gbps port blade FC8-16 A 16-port Brocade port blade supporting 1, 2,

4, and 8 Gbps port speeds. This port blade is compatible with the Brocade 48000 Director, Brocade DCX, and Brocade DCX-4S.

32-port 8-Gbps port blade FC8-32 A 32-port Brocade port blade supporting 1, 2,

4, and 8 Gbps port speeds. This port blade is compatible with the Brocade 48000 Director, Brocade DCX, and Brocade DCX-4S.

48-port 8-Gbps port blade FC8-48 A 48-port Brocade port blade supporting 1, 2,

4, and 8 Gbps port speeds. This port blade is compatible with the Brocade 48000 Director, Brocade DCX, and Brocade DCX-4S.

64-port 8-Gbps port blade FC8-64 A 64-port Brocade port blade supporting 2, 4,

and 8 Gbps port speeds. This port blade is compatible with the Brocade DCX and Brocade DCX-4S. This blade cannot be used in the same chassis with an FCOE10-24 blade.

Storage encryption blade FS8-18 The FS8-18 blade enables data cryptographic

(encryption/decryption) and data-compression capabilities. It has 16 Fibre Channel optical SFP ports. This application blade is compatible with the Brocade 48000 Director, Brocade DCX, and Brocade DCX-4S.

FCIP extension blade FX8-24 The FX8-24 blade enables FCIP functionality

over existing IP infrastructure. It has 12 FC ports, 10 GbE ports, and 2 10GbE ports available. This application blade is compatible with the Brocade DCX and Brocade DCX-4S.

Fibre Channel over Ethernet blade FCOE10-24 The FCOE10-24 blade enables FCoE

functionality over existing Ethernet infrastructure utilizing CEE protocols. It has 24 10GbE ports available. This application blade is compatible with the Brocade DCX and Brocade DCX-4S.This blade cannot be used in the same chassis with an FC8-64 high density port blade or any of the other application blades (FX8-24 or FS8-18).

Brocade DCX Backbone Hardware Installation Guide 53-1000685-24 19

Chassis slots

Chassis slots are numbered 1 through 12, from left to right when facing the port side of the Brocade DCX. Control processor blades (CP8) can be installed only in slots 6 and 7. Core switch blades (CR8) can be installed only in slots 5 and 8. The rest of the slots ,1-4 and 9-12, can be lled with port, application, or encryption blades. Unused slots must be lled with blade ller panels to maintain adequate cooling.

Port numbering

The Brocade DCX uses the following port numbering method (Port Numbering Template on page 149).

Port or application blade Port numbering Trunking port group numbering

FC8-16 port blade

FC8-32 port blade

FC8-48 port blade

FC8-64 port blade

FS8-18 blade

FX8-24 blade

FCOE10-24 blade

• 0 through 15 from bottom to top.

• 0 through 15 from bottom to top on the left set of ports.

• 16 through 31 from bottom to top on the right set of ports.

• 0 through 23 from bottom to top on the left set of ports.

• 24 through 47 from bottom to top on the right set of ports.

• 0 through 31 from bottom to top on the left set of ports.

• 32 through 63 from bottom to top on the right set of ports.

• FC ports: 0 through 15 from bottom to top.

• 10/100/1000 BaseT ports: GE0 and GE1 from the bottom.

• FC ports: 0 through 11 in two vertical rows of six ports starting from the bottom left and bottom right in the lower group of 12 ports. Labeled as FC on the front panel diagram.

• 10-GbE ports: 0 and 1 in the left-hand column just above the FC ports. Labeled as 10GE on the front panel diagram.

• 1-GbE ports: 0 through 9 in both columns above the FC and 10GE ports. Labeled as GE on the front panel diagram.

• 0 through 23 in two vertical rows from bottom left to top right.

• 0-7, 8-15, 16-23, 24-31, 32-39, 40-47, 48-55, and 56-63.

Up to three FC trunking groups are permitted.

• Trunk group 0: FC ports 0, 1

• Trunk group 1: FC ports 6, 7

• Trunk group 2: FC ports 2, 3, 4, 5, 8, 9, 10, 11

High availability

The following features contribute to the Brocade DCX high-availability design:

• Redundant, hot-swappable blades and FRUs

• Enhanced data integrity on all data paths

• Fabric Shortest Path First (FSPF) rerouting around failed links

20 53-1000685-24

Brocade DCX Backbone Hardware Installation Guide

Serviceability

• Integration with Simple Network Management Protocol (SNMP) managers

• Automatic control processor failover

• Nondisruptive "hot" software code loads and activation

• Easy conguration, save, and restore

• Hot-swappable World Wide Name (WWN) cards

The high-availability software architecture of the Brocade DCX provides a common framework for all applications that reside on the system, allowing global and local states to be maintained through any component failure. High-availability elements consist of the High Availability Manager, the heartbeat, the fault/health framework, the replicated database, initialization, and software upgrade.

The High Availability Manager controls access to the standby control processor, facilitates software upgrades, prevents extraneous switchover activity, closes and ushes streams, provides ow control and message buering, and supports a centralized active and standby state.

Reliability

The Brocade DCX uses the following error detection and correction mechanisms to ensure reliability of data:

• Error Detection and Fault Isolation (EDFI) mechanism, which checks for encoder errors and fault isolation, such as cyclic redundancy checking (CRC), parity checking, checksum, and illegal address checking.

• Power-on self-test (POST).

• Dual control processors that enable hot, nondisruptive fast

• One serial port and two Ethernet ports (on each control processor) for management and for service. Oine control processor diagnostics and remote diagnostics simplify troubleshooting. The standby control processor monitors diagnostics to ensure it is operational, should a failover be necessary.

• Bus monitoring and control of blades and other eld-replaceable units (FRUs).

rmware upgrades.

Serviceability

The Brocade DCX provides the following features to enhance and ensure serviceability:

• Modular design with hot-swappable components

• Flash memory that stores two

• USB port on control processor blades for all tasks that formerly required an FTP/SCP server, including software and rmware upgrades

• Nonvolatile random-access memory (NVRAM), containing the OEM serial number, Brocade serial number, revision information, and part number information

• Background health-check daemon

• Memory scrubber, self test, and bus ping to determine if a bus is not functioning

• RASlog messages

• SMI-S compliant

• Watchdog timers

• Status LEDs

• Predictive diagnostics analysis through Fabric Watch

Brocade DCX Backbone Hardware Installation Guide 53-1000685-24 21

rmware images per control processor

Software features

• SNMP (including version 3) integration with higher-layer managers

Software features

The Fabric OS allows any Fibre Channel-compliant device to attach to the switches as long as it conforms to the device login, name service, and related Fibre Channel standards. Each operating environment requires that a Fibre Channel host bus adapter (HBA) be available with a standards-compliant driver for correct interface to the fabric.

Fabric OS consists of a set of embedded applications running on top of an embedded Linux operating system kernel. These applications include:

• Name server

• Alias server

• Zone server

• Simple Network Management Protocol (SNMP) agent

• SMI-S compliant API

• Syslog auditing

• RCS (Reliable Commit Service)

• NTP

• Tasks to manage address assignment, routing, link initialization, fabric initialization, link shutdown, Brocade DCX shutdown, and the user interface

Security

The following table highlights some of the key security features available for the Brocade DCX and for other Brocade enterprise-class products running Fabric OS 5.2.0 or later. For details, contact your Brocade DCX supplier and refer to the Brocade White Paper, "The Growing Need for Security in Storage Area Networks".

TABLE 2 Brocade security features

Brocade Security Features Description

DH-CHAP Login banner SSHv2 (using AES, 3DES, RSA) Monitoring of attempted security breaches (through audit logging) HTTPS (using AES) Monitoring of attempted security breaches (through Fabric Watch Security

Class) SNMPv3 Fibre Channel security policies: DCC and SCC FC-SP Trusted Switch (FCS) for central security management Secure RPC Management access controls (SNMPv3, Telnet, FTP, serial port, front

panel) Secure le copy (SCP) Hardware-enforced zoning by WWN, domain/port ID, or both Telnet disable Default zoning Telnet timeout RSCN suppression and aggregation IP lters (block listeners) Congurable RSCN suppression by port Secure passwords (centralized control through RADIUS/CHAP) NTPv3 (to synchronize timestamps) Up to 255 multiple user accounts (MUAs). Event auditing Role-based access controls (RBACs) Change tracking

22 53-1000685-24

Brocade DCX Backbone Hardware Installation Guide

Network manageability

TABLE 2 Brocade security features (continued)

Brocade Security Features Description

Administrative domains/Virtual fabrics Firmware change alerts in Fabric Manager Boot PROM password reset Persistent port disable Password hardening policies Persistent domain ID Upfront login in Web Tools E_Port disable

Network manageability

The Brocade DCX has a single domain and is managed as a single element with the Data Center Fabric Manager (DCFM). The Brocade DCX responds to its own IP address and appears as a separate entity to the Telnet protocol and SNMP.

All management interfaces, such as Telnet, Web Tools, standards-compliant SMI-S, and Management Server, support a "port N within blade M" naming scheme.

The Brocade DCX supports SNMPv1 and SNMPv3. When SNMP devices send SNMP messages to a management console running SAN management software, the information is stored in a management information base (MIB). Fabric OS v6.1.1_enc and later supports the latest Fibre Alliance Fibre Channel Management (FCMGMT) and Storage Management Initiative (SMI) MIBs, which allow common information necessary for management software to provide information to a SAN administrator. Refer to the Brocade Fabric OS Administration Guide for additional MIB information.

Brocade DCX Backbone Hardware Installation Guide 53-1000685-24 23

24 53-1000685-24

Brocade DCX Backbone Hardware Installation Guide

Preparing for the Installation

• Installation and safety considerations........................................................................................................................................................25

• Time and items required for installation...................................................................................................................................................26

• Items included with the device.....................................................................................................................................................................27

Installation and safety considerations

NOTE

Read the safety notices before installation.

Read the following sections before preparing to install the device.

• Caution and Danger Notices on page 165.

• Brocade DCX Backbone Technical Specications on page 159, power supply specications section, and plan for meeting the power supply standards based on your device conguration.

• Cable Management on page 47 and plan for cable management.

The following steps are required to ensure correct installation and operation:

1. Ensure that dedicated electrical branch circuits with the following characteristics are available:

• 200-240 VAC, 50-60 Hz (two branch circuits)

• 110-120 VAC, 50-60 Hz (up to four branch circuits)

• Two cables for 200-240 VAC service; up to four cables for 110-120 VAC service

• Power supply standards are met

• Protected by a circuit breaker in accordance with local electrical codes

• Supply circuit, line fusing, and wire size adequate to the electrical rating on the chassis nameplate

• Location close to the chassis and easily accessible

• Grounded outlets installed by a licensed electrician and compatible with the power cords

ATTENTION

To maximize fault tolerance, connect each power cord to a separate power source.

2. Plan for cable management before installing the chassis (Cable Management on page 47).

Cables can be managed in a variety of ways, such as by routing cables below the chassis, to either side of the chassis, through cable channels on the sides of the cabinet, or by using patch panels.

Brocade DCX Backbone Hardware Installation Guide 53-1000685-24 25

Time and items required for installation

3. Ensure that the following is available for conguration of the Brocade DCX:

• Workstation with an installed terminal emulator, such as HyperTerminal

• Serial cable (provided)

• Three Ethernet cables (including one spare)

• Access to an FTP server for backing up the switch conguration or collecting supportsave output data (optional)

• A Brocade USB stick for collecting supportsave output data (optional)

• SFPs and compatible cables

NOTE

For information about the SFP transceivers that are qualied for the Brocade Encryption Switch, go to http:// www.brocade.com/products/interop_and_compatibility.jsp.

4. Ensure that the air intake and exhaust vents have a minimum of 2 inches of airspace.

5. Ensure that the air temperature on the air intake side is less than 40 degrees Celsius (104 degrees Fahrenheit) during operation.

Time and items required for installation

The following table describes the main installation and setup tasks, the estimated time required for each, and the items required to complete the task based on a fully populated Brocade DCX (512 Fibre Channel ports).

Congurations with fewer ports require less time.

These time estimates assume a prepared installation site and appropriate power and network connectivity.

TABLE 3 Installation tasks, time, and items required

Installation task Time estimate Items required

Site preparation and unpacking Brocade DCX 30 minutes 1/2-in. socket wrench (to remove pallet bolts).

#2 Phillips screwdriver(for cable management comb).

Pallet jack.

Hydraulic lift or assisted lift, able to raise to a minimum of 140 cm (55 in.), with a minimum capacity of 113 kg (250 lb). The Brocade DCX weighs 159.2 kg (351 lb) with eight FC8-64

port blades installed (512 ports). Installing rack mount kit 30 minutes Refer to Mounting the Device on page 29 . Mounting and securing Brocade DCX in rack 30 minutes Installing power cables and powering on the

Brocade DCX Establishing serial connection, logging on to

Brocade DCX, and conguring IP addresses

Installing an Ethernet cable, opening a Telnet session, and conguring the Brocade DCX domain ID, date and time, and additional system parameters. Verify and back up conguration.

20 minutes Power cables.

20 minutes Serial cable (provided in the accessory kit).

Workstation computer with a serial port or

terminal server port and a terminal emulator

application (such as HyperTerminal).

Ethernet IP addresses for the Brocade DCX and

for both control processor blades: total three

addresses.

20 minutes Ethernet cabling (optional) for Telnet access.

Refer to the Brocade Fabric OS Administration

Guide.

26 53-1000685-24

Brocade DCX Backbone Hardware Installation Guide

TABLE 3 Installation tasks, time, and items required (continued)

Installation task Time estimate Items required

Installing SFP, SFP+, mSFP, and XFP (10Gbps) optical transceivers as needed

Attaching ber optic cables, cable ties, and cable guides

30 minutes SFP, SFP+, mSFP, and XFP (10-Gbps) optical

transceivers as needed.

2-3 hours Fiber optic cables, cable ties, and cable comb.

Items included with the device

The Brocade DCX ships with the following:

• Brocade DCX chassis, populated with: – Control processor blades (CP8)

– Core switch blades (CR8) – Port blades and application blades, and encryption blades (included based on customer specication) – Blade slot ller panels (for slots not lled by a port, control processor, or core switch blade) – WWN cards – WWN bezel (logo plate) – Power supplies – Power supply ller panels (included if there are fewer than four power supplies) – Blower assemblies – Cable management comb – Chassis door

• Accessory kit containing the following items: – ESD grounding strap

– USB device – RS-232 serial cable. The RS-232 cable has an adapter at one end that can be removed to provide an RJ-45-style

connector.

• 14U Rack Mount Kit with instructions (includes rear brackets and bottom support rails)

Items included with the device

Order the optical transceivers (SFP, SFP+, mSFP, and XFP) from Brocade. The Brocade DCX supports SWL, LWL, and ELWL transceivers. The mSFPs are SWL transceivers only.

NOTE

For information about the SFP, SFP+, mSFP, and XFP transceivers that are qualied for the Brocade DCX, go to http:// www.brocade.com/products/interop_and_compatibility.jsp.

Brocade DCX Backbone Hardware Installation Guide 53-1000685-24 27

28 53-1000685-24

Brocade DCX Backbone Hardware Installation Guide

Mounting the Device

• Mounting precautions......................................................................................................................................................................................29

• Mounting options...............................................................................................................................................................................................30

• Unpacking, transporting, and installing the device.............................................................................................................................. 30

• Installing the 14U Rack Mount Kit for Four-Post Racks (XBR-DCX-0120 and XBR-DCX-0152) ............................ 31

• Installing the 14U Chassis Mid-Mount Rack Kit for Two-Post Racks (XBR-DCX-0121).................................................39

Mounting precautions

Ensure that the following amount of space is available in the rack.

NOTE

1U is equal to 4.45 cm (1.75 inches).

• 14 rack units (14U) high

• 61.29 cm (24.09 in.) deep

• 43.74 cm (17.22 in.) wide

The following general considerations for mounting the device.

• Review Installation and safety considerations on page 25 before mounting the device and ensure that all facility requirements are met.

• The device can be installed facing either direction in a cabinet, if serviceability and cooling requirements are met.

• Plan to install the device with the nonport side facing the air-intake aisle. The device can be installed facing either direction, if serviceability and cooling requirements are met.

• Ensure that the air intake and exhaust vents have a minimum of 5.1 cm (2 in.) of airspace.

• Ensure that the air temperature on the air intake side is less than 40°C (104°F) during operation.

• Use a hydraulic lift or assisted lift that can raise a minimum of 140 cm (55 in.), with a minimum capacity of 115 kg (254 lb). Refer to Brocade DCX Backbone Technical Specications on page 159 for the weight of your device, fully populated with the required blades.

CAUTION Do not use the port cover tabs to lift the module. They are not designed to support the weight of the module, which can fall and be damaged.

CAUTION Make sure the airow around the front, and back of the device is not restricted.

DANGER

Mount the devices you install in a rack as low as possible. Place the heaviest device at the bottom and progressively place lighter devices above.

DANGER

Use safe lifting practices when moving the product.

Brocade DCX Backbone Hardware Installation Guide 53-1000685-24 29

Mounting options

CAUTION To prevent damage to the chassis and components, never attempt to lift the chassis using the fan or power supply handles. These handles were not designed to support the weight of the chassis.

CAUTION Never leave tools inside the chassis.

DANGER

Make sure the rack housing the device is adequately secured to prevent it from becoming unstable or falling over.

Mounting options

This device can be installed as a standalone unit on a post telecommunications (TELCO)equipment rack.

• In a four-post 19 in. (48.3 cm) EIA rack: – Use the 14U rack mount kit for four-post racks (XBR-DCX-0120), which contains shelf brackets that telescope from 27 in.

(68.58 cm) to 31 in. (78.74 cm) to t the majority of racks.

– Use the 14U rack mount kit for four-post racks (XBR-DCX-0152), which contains 22 in. (55.88 cm) xed shelf brackets

designed for specic racks.

– Refer to Installing the 14U Rack Mount Kit for Four-Post Racks (XBR-DCX-0120 and XBR-DCX-0152) on page 31 for

instructions.

• In a two-post Telco rack: – Use the 14U mid-mount rack kit for two-post racks (XBR-DCX-0121).

– Refer to Installing the 14U Chassis Mid-Mount Rack Kit for Two-Post Racks (XBR-DCX-0121) on page 39 for

instructions.

NOTE

Review the Installation and safety considerations on page 25 before mounting the device and ensure that all facility requirements are met.

NOTE

The preceding rack mount kits are supported for this device at the publication date of this Hardware Installation Guide. For current support information, contact your Brocade representative.

at surface or mounted a 19-inch Electronic Industries Association (EIA) or two-

Unpacking, transporting, and installing the device

DANGER

Use safe lifting practices when moving the product.

DANGER

A fully populated Brocade DCX (eight FC8-64 port cards, 512 ports) weighs approximately 159.2 kg (351 lbs) and requires a hydraulic or assisted lift to install it.

30 53-1000685-24

Brocade DCX Backbone Hardware Installation Guide

+ 137 hidden pages

Brocade Communications Systems DCX Backbone Hardware Installation Manual

Specifications and Main Features

Frequently Asked Questions

User Manual

Preface

Document conventions

Notes, cautions, and warnings

Text formatting conventions

Brocade resources

Command syntax conventions

Document feedback

Contacting Brocade Technical Support

Brocade customers

Brocade OEM customers

About This Document

Supported hardware and software

What’s new in this document

Overview

Brocade DCX features

Hardware components

Port side of the Brocade DCX

Brocade DCX blades

Nonport side of the Brocade DCX

Chassis slots

Port numbering

High availability

Serviceability

Reliability

Software features

Security

Network manageability

Preparing for the Installation

Installation and safety considerations

Time and items required for installation

Items included with the device

Mounting the Device

Mounting precautions

Mounting options

Unpacking, transporting, and installing the device