Brocade, the B-wing symbol, Brocade Assurance, ADX, AnyIO, DCX, Fabric OS, FastIron, HyperEdge, ICX, MLX, MyBrocade, NetIron,
OpenScript, VCS, VDX, and Vyatta are registered trademarks, and The Effortless Network and the On-Demand Data Center are
trademarks of Brocade Communications Systems, Inc., in the United States and in other countries. Other brands and product
names mentioned may be trademarks of others.
Notice: This document is for informational purposes only and does not set forth any warranty, expressed or implied, concerning
any equipment, equipment feature, or service offered or to be offered by Brocade. Brocade reserves the right to make changes to
this document at any time, without notice, and assumes no responsibility for its use. This informational document describes
features that may not be currently available. Contact a Brocade sales office for information on feature and product availability.
Export of technical data contained in this document may require an export license from the United States government.
The authors and Brocade Communications Systems, Inc. assume no liability or responsibility to any person or entity with respect
to the accuracy of this document or any loss, cost, liability, or damages arising from the information contained herein or the
computer programs that accompany it.
The product described by this document may contain open source software covered by the GNU General Public License or other
open source license agreements. To find out which open source software is included in Brocade products, view the licensing
terms applicable to the open source software, and obtain a copy of the programming source code, please visit http://
www.brocade.com/support/oscd.
Brocade Communications Systems, Incorporated
Corporate and Latin American Headquarters
Brocade Communications Systems, Inc.
130 Holger Way
San Jose, CA 95134
Tel: 1-408-333-8000
Fax: 1-408-333-8101
E-mail: info@brocade.com
European Headquarters
Brocade Communications Switzerland Sàrl
Centre Swissair
Tour B - 4ème étage
29, Route de l'Aéroport
Case Postale 105
CH-1215 Genève 15
Switzerland
Tel: +41 22 799 5640
Fax: +41 22 799 5641
E-mail: emea-info@brocade.com
Asia-Pacific Headquarters
Brocade Communications Systems China HK, Ltd.
No. 1 Guanghua Road
Chao Yang District
Units 2718 and 2818
Beijing 100020, China
Tel: +8610 6588 8888
Fax: +8610 6588 9999
E-mail: china-info@brocade.com
Asia-Pacific Headquarters
Brocade Communications Systems Co., Ltd. (Shenzhen WFOE)
Citic Plaza
No. 233 Tian He Road North
Unit 1308 – 13th Floor
Guangzhou, China
Tel: +8620 3891 2000
Fax: +8620 3891 2111
E-mail: china-info@brocade.com
Document History
TitlePublication numberSummary of changesDate
Brocade VDX 8770-4 Hardware Reference
Manual
Brocade VDX 8770-4 Hardware Reference
Manual
Brocade VDX 8770-4 Hardware Reference
Manual
Brocade VDX 8770-4 Hardware Reference
Manual
53-1002563-01New document.Sept 2012
53-1002563-02NEBS GR-1089 installation
requirements added including air filter
replacement procedure.
53-1002563-03Additional NEBS requirement added
for air filter replacement. Changed
reference to availability of SX and LX
transceivers. Changed LED indication
for Ethernet management link on MM.
53-1002563-04Added information about 48x10G-T,
27x40 GbE, and 6x100 GbE line
cards.
Mar 2013
Aug 2013
April 2014
Contents
DRAFT: BROCADE CONFIDENTIAL
About This Document
How this document is organized . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
This document is a hardware reference manual written for system administrators and technicians
experienced with networking and IP technologies to help them install, set up, configure, operate,
maintain, and troubleshoot the Brocade VDX 8770-4. It is organized in loosely chronological order,
beginning with an overview of the Brocade VDX 8770-4 and ending with removal and replacement
procedures of field-replaceable units (FRUs).
The document contains the following sections:
•Chapter 1, “Brocade VDX 8770-4 Overview,” identifies the components of the Brocade VDX
8770-4 and provides a brief description of its features.
•Chapter 2, “Installation of the Brocade VDX 8770-4,” describes how to install, set up, and
power on the Brocade VDX 8770-4.
•Chapter 3, “Configuring the Brocade VDX 8770-4,” provides the initial configuration
information required to get the Brocade VDX 8770-4 up and running.
•Chapter 4, “Monitoring System Components,” provides descriptions of the LEDs and their
functions, and also lists Network OS commands required for monitoring.
•Chapter 5, “Removal and Replacement Procedures,” describes how to remove and replace
each of the FRUs in the Brocade VDX 8770-4.
•Appendix A, “Specifications,”provides information on the physical characteristics,
environmental requirements, and regulatory certifications for the Brocade VDX 8770-4.
•Appendix B, “Caution and Danger Notices,” contains a list of the translated Caution and
This document includes information specific to the Brocade VDX 8770-4 running Brocade Network
OS version 4.1.0. and later.
What’s new in this document
The following changes have been made since this document was last released:
•Updated the following sections in Chapter 1, “Brocade VDX 8770-4 Overview”:
-Brocade VDX 8770-4 features
-Brocade VDX 8770-4 hardware components
-Brocade VDX 8770-4 line cards
-27x40 GbE port groups and operating modes (new section)
-Tru nking
-Software features (Licensing)
•Updated the following sections in Chapter 2, “Installation of the Brocade VDX 8770-4”:
-Time and items required
-Preparing for the Brocade VDX 8770-4 installation
-Power specifications
-Port numbering
-Providing power to the Brocade VDX 8770-4
•Updated the following sections in Chapter 3, “Logging In and Configuring the Brocade VDX
8770-4”:
-Configuring operating modes on 27x40 GbE line cards (new section)
-Installing QSFP transceivers and cables
•Updated the following sections in Chapter 4, “Monitoring System Components”:
-Determining the status of a line card
-Line card illustrations
•Updated the following sections in Chapter 5, “Removal and Replacement Procedures”:
-Line card removal and replacement
-Power supply removal and replacement
-Replacing an AC power supply
-Replacing a DC power supply
-Removing a fan
-SFP transceiver removal and replacement
•Updated the following sections in Appendix A, “Specifications”:
-System module and FRU weights
-Ethernet port supported optics
-Power cord notice
xivBrocade VDX 8770-4 Hardware Reference Manual
53-1002563-04
•Updated the following sections in Appendix B, “Caution and Danger Notices”:
-Caution notices
-Danger notices
Document conventions
This section describes text formatting conventions and important notices formats.
Text formatting
The narrative-text formatting conventions that are used in this document are as follows:
bold textIdentifies command names
italic textProvides emphasis
code textIdentifies CLI output
Identifies GUI elements
Identifies keywords and operands
Identifies text to enter at the GUI or CLI
Identifies variables
Identifies paths and Internet addresses
Identifies document titles
Identifies syntax examples
For readability, command names in the narrative portions of this guide are presented in mixed
lettercase: for example, switchShow. In actual examples, command lettercase is often all
lowercase. Otherwise, this manual specifically notes those cases in which a command is
case-sensitive.
Command syntax conventions
Command syntax in this manual follows these conventions:
ConventionDescription
[ ]Keywords or arguments that appear within square brackets are optional. For example:
command [active | standby | disabled] = One (and only one) of this set of keywords may be
used.
command [active] [standby] [disabled] = Three independent options, and one or more may
be used on the same command line.
{ x | y | z }A choice of required keywords appears in braces separated by vertical bars. You must
select one. For example:
command {active | standby | disabled} = One (and only one) of this set of
keywords/operands must be used.
screen fontExamples of information displayed on the screen.
< > Nonprinting characters, for example, passwords, appear in angle brackets.
[ ] Default responses to system prompts appear in square brackets.
bold textIdentifies literal command options and keywords.
Command examples
This book describes how to perform configuration tasks using the Network OS command line
interface, but does not describe the commands in detail. You will enter these commands while in
various configuration modes. Steps to enter specific modes are included in procedures in this
publication.
The main modes for entering commands are privileged EXEC and global configuration modes:
•Privileged EXEC mode. You will enter this mode when you log into the switch. Following is an
example of the privileged EXEC prompt when you log into the switch:
switch#
•Global configuration mode. Enter this mode from the privileged EXEC prompt using the
Move back to a preceding configuration mode by entering exit. Move back from any configuration
mode to privileged EXEC mode by entering end.
switch(config)#exit
switch#
For complete descriptions of all Network OS commands, including syntax, operand description, and
sample output, refer to the Network OS Command Reference.
Notes, cautions, and warnings
The following notices and statements are used in this manual. They are listed here in order of
increasing severity of potential hazards.
A note provides a tip, guidance, or advice, emphasizes important information, or provides a
reference to related information.
An Attention statement indicates potential damage to hardware or data.
xviBrocade VDX 8770-4 Hardware Reference Manual
53-1002563-04
CAUTION
A Caution statement alerts you to situations that can be potentially hazardous to you or cause
DANGER
damage to hardware, firmware, software, or data.
A Danger statement indicates conditions or situations that can be potentially lethal or extremely
hazardous to you. Safety labels are also attached directly to products to warn of these conditions
or situations.
Notice to the reader
This document may contain references to the trademarks of the following corporations. These
trademarks are the properties of their respective companies and corporations.
These references are made for informational purposes only.
CorporationReferenced trademarks and products
Microsoft CorporationWindows, Windows NT, Internet Explorer
Oracle CorporationSun, Solaris
Netscape Communications CorporationNetscape
Red Hat, Inc.Red Hat, Red Hat Network, Maximum RPM, Linux Undercover
Velcro Industries B.V.Velcro
Additional information
This section lists additional Brocade and industry-specific documentation that you might find
helpful.
Brocade resources
To get up-to-the-minute information, go to http://my.brocade.com to register at no cost for a user ID
and password.
White papers, online demonstrations, and data sheets are available through the Brocade website
at:
Release notes are available on the MyBrocade website and are also bundled with the Network OS
'"!&'
FT00X0054E9
firmware.
Other industry resources
For additional resource information, visit the Technical Committee T11 website. This website
provides interface standards for high-performance and mass storage applications for Fibre
Channel, storage management, and other applications:
http://www.t11.org
For information about the Fibre Channel industry, visit the Fibre Channel Industry Association
website:
http://www.fibrechannel.org
For information about the Ethernet industry, visit the Internet Engineering Task Force website:
http://www.ietf.org
Getting technical help
Contact your Brocade VDX 8770-4 supplier for hardware, firmware, and software support, including
product repairs and part ordering. To expedite your call, have the following information available:
1. General information
• Technical Support contract number, if applicable
• Model name
• Operating system version
• Error numbers and messages received
• Copy support command output
• Detailed description of the problem and specific questions
• Description of any troubleshooting steps already performed and results
• Serial console and Telnet session logs
• Syslog message logs
2. Brocade VDX 8770-4 serial number
The Brocade VDX 8770-4 serial number (Switch Serial No.) and corresponding bar code shown
on the following illustration are located on a label located on the nonport side of the chassis,
on the upper right side and directly above the fans.:
In addition, the show chassis command displays the Brocade VDX 8770-4 serial number, as
well as information about the line cards and other field-replaceable units (FRUs).
3. License ID/World Wide Name (WWN)
xviiiBrocade VDX 8770-4 Hardware Reference Manual
53-1002563-04
The License ID/World Wide Name (WWN) are located on the same label as the serial number.
In addition, the show license id command displays the license ID/WWN.
Document feedback
Quality is our first concern at Brocade and we have made every effort to ensure the accuracy and
completeness of this document. However, if you find an error or an omission, or you think that a
topic needs further development, we want to hear from you. Forward your feedback to:
documentation@brocade.com
Provide the title and version number of the document and as much detail as possible about your
comment, including the topic heading and page number and your suggestions for improvement.
The Brocade VDX 8770-4 is part of the Brocade Next Generation Data Center Networks product
line, a highly robust class of network switching platforms that combines breakthrough
performance, scalability, and energy efficiency with long-term investment. These chassis are
designed to address the data growth and application demands of evolving enterprise data centers.
1
The Brocade VDX 8770-4 features the Brocade CloudPlex™ architecture, a fabric-based Ethernet
technology that can present virtual desktops over a global network that integrates both static and
cloud-based resources.
The Brocade VDX 8770-4 requires Brocade Network Operating System (Network OS) v3.0.0 or later.
For details about Network OS, refer to the Brocade Network OS Administrator’s Guide.
A key, licensable feature of the Brocade VDX 8770-4 chassis is Brocade VCS
includes virtual cluster switching, a new set of technologies that allows users to create flatter,
virtualized, and highly available data center networks. VCS fabrics are scalable, permitting users to
expand at their own pace, and simplified, allowing users to manage the fabric as a single entity.
VCS fabrics are convergence-capable, supporting technologies such as iSCSI and network access
server (NAS) as well as Fibre Channel over Ethernet (FCoE) (licensable) for storage.
Key features of the Brocade VDX 8770-4 include:
• A variety of external port types and speeds in supported line card modules
• Dual, redundant management modules (MMs)
• Up to three switch fabric modules (SFMs)
• Up to four redundant, hot-swappable power supplies at 220 VAC or -48 VDC
• Two hot-swappable fan modules
• Serial (console), Ethernet, and USB connections for management modules
USB support is for Brocade-branded USB devices only
®
technology, which
• Support for short wavelength (SX) and long wavelength (LX) 1 Gbps SFP transceivers
• Support for (short range (SR) and (long range (LR) 10 Gbps SFP+ transceivers
• Support for 40 Gbps QSFP transceivers
• Support for 100 Gbps CFP2 (SR10 and LR4) optical transceivers
• Support for 10 GbE SFP+ optical transceivers
• Support for 1 GbE optical and copper SFP transceivers
• Support for SFP transceivers that enable you to adapt an SFP slot to a copper GbE interface.
• Support for fixed 10Base-T (RJ-45) copper transceivers
• Support for active twinaxial (twinax) cable at 1, 3, and 5 meters for 10 GbE ports
• Support for twinax and optical breakout cables for 40 GbE ports
Support for the preceding optics depends on the installed line card. For details, refer to the “Brocade
VDX 8770-4 hardware components” and “Brocade VDX 8770-4 line cards” sections of this chapter.
• NEBS-compliant chassis (certification in process)
• Support for in-band management
• 8U form factor for chassis (10U with Intake Air Duct Kit)
• Support for Brocade trunking through the 48x10 GbE and 48x10G-T line card modules
• Support for Fibre Channel over Ethernet (FCoE)
Brocade VDX 8770-4 hardware components
The Brocade VDX 8770-4 features a modular and scalable mechanical construction that allows a
wide range of flexibility in installation, fabric design, and maintenance. The minimum chassis
configuration is one MM, one SFM, and one line card. The chassis can be mounted with the cables
facing the front of the equipment rack and consists of the following components:
• Four slots for hot-swappable line cards that can be configured in a single chassis. Depending
on the line cards installed, the following ports are available:
-Up to 192 1/10 Gbps ports for the 48x10 GbE line card.
48x10 GbE line cards support 10 GbE SFP+ and 1 GbE SFP optical transceivers, as well as
1 GbE copper SFP transceivers. They also support direct-attach 10 GbE copper twinaxial
(twinax) cables at 1, 3, or 5 meters.
-Up to 192 1 Gigabit Ethernet (GbE) ports for the 48x1 GbE line card.
48x1 GbE line cards support 1 GbE SFP optical and copper transceivers.
-Up to 48 40 Gigabit Ethernet (GbE) ports for the 12x40 GbE line card. Up to 192 10 Gbps
ports are supported in QSFP breakout mode.
12x40 GbE line cards support 40 GbE QSFP optical transceivers.
-Up to 24 100 Gigabit Ethernet (GbE) ports for the 6x100 GbE line card.
6x100 GbE line cards support 100 GbE CFP2 (SR10 and LR4) optical transceivers.
-Up to 192 1/10 Gigabit Base-T Ethernet ports for the 48x10G-T line card.
2Brocade VDX 8770-4 Hardware Reference Manual
53-1002563-04
Brocade VDX 8770-4 hardware components
NOTE
48x10G-T line cards support fixed 10 GbE Base-T (RJ-45) copper transceivers.
-Up to 108 40 Gigabit Ethernet (GbE) ports for the 27x40 GbE line card. Up to 288 10
Gigabit ports are supported in QSFP breakout mode.
27x40 GbE line cards support 40 GbE QSFP optical transceivers.
• Two slots for management modules:
-A single active management module can control all ports in the chassis.
-The standby management module takes control of the Brocade VDX 8770-4 if the active
management module fails.
• Three slots for switch fabric modules that interconnect all line cards.
• Modular, hot-swappable field-replaceable units (FRUs):
-48x10 GbE line card
-48x1 GbE line card
-12x40 GbE line card
-6x100 GbE line card
-48x10G-T line card
-27x40 GbE line card
-Two fan asse mblies
-Up to four 3000W power supplies, 200–240 VAC auto-sensing or -48 VDC (each power
supply connection should be separately fused)
• Two vertical cable m a nagement finger assemblies
1
Port side of the Brocade VDX 8770-4
Airflow in the Brocade VDX 8770-4 is from the port side and left side (viewed from the port side) to
the rear (fan side) of the chassis.
Figure 1 displays a sample configuration of the port side of the Brocade VDX 8770-4.
This section provides general information on the line cards. For specific information on line card
ports and port hardware, refer to Chapter 1, “Brocade VDX 8770-4 Overview”. Table 1 summarizes
the line cards that are available for the Brocade VDX 8770-4.
TABLE 1Line cards available for the Brocade VDX 8770-4
Line cardDescription
12x40 GbE12 40 Gbps QSFP Ethernet ports.
48x10 GbE48 1/10 Gbps Ethernet ports.
48x1 GbE48 1 Gbps Ethernet ports.
6x100 GbE6 100 Gbps Ethernet ports
48x10G-T48 1/10 Gbps Base-T Ethernet ports
27x40 GbE27 40 Gbps QSFP Ethernet ports
Breakout mode
Quad SFP (QSFP) 40 Gbps ports on 12x40 GbE and 27x40 GbE line cards can be configured in
breakout mode to create four separate 10 Gbps interfaces. You can administer and operate these
interfaces as any other SFP port. Special breakout cables provide a connection to the 40 Gbps
QSFP port and to four 10 Gbps SFP ports on another switch. Twinax active copper cables at 1, 3,
and 5 meters and fiber-optic breakout cables are supported.
While 40 GbE ports are in breakout mode, port status (individual or as a group) cannot be
determined from the port LED state color.
For more information on configuring breakout mode, refer to the Network OS Administrator’s Guide.
Trunking
Network OS supports Brocade trunks (hardware-based link aggregation groups, or LAGs). These
trunks are dynamically formed between two adjacent switches with connected interswitch link (ISL)
ports unless trunking is disabled on connecting ports. Traffic is evenly distributed along all links in
a trunk. For more information on Brocade Trunking and enabling and disabling trunking, refer to the
“Configuring Brocade VCS Fabrics” chapter in the Network OS Administrator’s Guide.
Trunking is supported on GbE interface ports of all line cards
Port groups
Port groups are established for trunking on supported line cards. To successfully form a trunk from
line card ports to another switch, select ports from same line card port group and configure each
port to operate at the same speed. Following are trunk and port group specifications for supported
line cards:
6Brocade VDX 8770-4 Hardware Reference Manual
53-1002563-04
Brocade VDX 8770-4 line cards
NOTE
1
• For the 48x10 GbE line card, up to 8 ports are allowed per trunk. Select ports from octet port
groups consisting of ports 1-8, 9-16, 17-24, 25-32, 33-40, and 41-48.
• For the 48x10G-T line card, up to 16 ports are allowed per trunk. Select ports from three port
groups consisting of ports 1-16, 17-32, and 33-48.
• For the 12x40 GbE line card, up to two 40GbE ports are allowed per trunk when these ports
are configured in breakout mode to provide 10GbE interfaces. Select ports from six port
groups consisting of 40GbE ports 1-2, 3-4, 5-6, and 7-8, 9-10, and 11-12.
• For the 27x40 GbE line card, 40GbE ports must be configured in breakout mode to provide
10GbE interfaces for trunking. There are nine port groups consisting of 40GbE ports 1-3, 4-6,
7-9, 10-12, 13-15, 16-18, 19-21, 22-24, and 25-27. The following rules apply to configuring
breakout mode and trunking on ports in these groups:
-You must configure a port group in Performance operating mode. Breakout mode is not
supported on ports configured in Density (default) operating mode.
-When the port group is in Performance mode, you can only configure the first two ports in
the port group in breakout mode, since the third port in the group is disabled. Hence,
trunking is only supported on the first two ports in the port group.
For more information on Performance and Density operating modes, refer to “Configuring
operating modes on 27x40 GbE line cards” on page 35.
27x40 GbE operating modes
The 27x40 GbE line card supports nine port groups of three ports each that you can configure for
Performance or Density operating modes.
• Performance mode - Because the line card is oversubscribed and cannot support the 40 Gbps
line rate on all 27 ports, you can configure Performance mode to achieve 40 Gbps rate for up
to 18 ports. When a port group is configured In Performance mode, the third port in the port
group is persistently disabled, but the remaining two ports operate at up to 40 Gbps to achieve
the 80 Gbps maximum rate for the port group. QSFP breakout mode is only supported on ports
configured in Performance mode.
• Density mode - This is the default mode for all the port groups. In this mode, all the three
ports are enabled in each group, but cannot support the 40 Gbps maximum rate. If this
mode is configured on all port groups, 27 total ports are available for use.
Configure Performance or Density mode for individual port groups using Network OS commands
(refer to the Network OS Command Reference).
For configuring operation modes, ID numbers are assigned to each port group sequentially from
port 1 through 27 as shown in the Tab le 2 and Figure 3.
Port groups for configuring operation modes are illustrated in Figure 3. If you configure a port group
in Performance mode, the first two ports in a group are enabled for Performance mode. The third
port is disabled as it can only be configured in density mode only. If you configure the port group in
Density mode, all three ports are enabled for density mode. To identify the port group, use the
format rbridge-id/slot-id/port group-id. For example, 1/3/9 denotes RBridge 1, slot 3, and
port-group-id 9.
FIGURE 3Port groups for configuring Performance and Density modes on 27x40 GbE line card
To configure Performance and Density modes for line card port groups using Network OS
commands, refer to “Configuring operating modes on 27x40 GbE line cards” on page 35.
High availability
High availability is currently limited to management module configuration synchronization. Failover
to the standby module will occur in case of active module failure, but the standby module will go
through a cold recovery in which all system components are reset. This will disrupt traffic on the
chassis. The reset could take up to eight minutes depending on chassis configuration and traffic
load.
The Brocade VDX 8770-4 provides the following features to enhance and ensure serviceability:
• Modular design with hot-swappable components.
• Flash memory that stores two firmware images per control processor.
• USB port on management module for most tasks that formerly required an FTP/SCP server,
including software and firmware upgrades.
• Nonvolatile random-access memory (NVRAM), containing the OEM serial number, Brocade
serial number, revision information, and part number information.
• Background health-check daemon.
• Memory scrubber, self test, and bus ping to determine if a bus is not functioning.
• RASlog messages.
• SMI-S compliant.
8Brocade VDX 8770-4 Hardware Reference Manual
53-1002563-04
• Hardware and software watchdog timers.
• Status LEDs.
• Predictive diagnostics analysis through Fabric Watch.
• SNMP (including version 3) integration with higher-layer managers.
• Cable management using vertical finger assemblies to accommodate the horizontal
orientation of the blades.
Software features
The following is a partial list of the features supported in the software. Refer to the Brocade
Network OS Administrator’s Guide for details on software and supported features.
Layer 2
• Layer 2 data forwarding
• MAC learning and aging
• Brocade Trunking
• Priority Flow Control (PFC)
• Enhanced Transmission Selection (ETS)
• Terminal Access Controller Access-Control System Plus (TACACS+)
• Link Aggregation Control Protocol (LACP)
• Link Layer Discovery Protocol/ Data Center Bridging eXchange (LLDP/DCBX)
• 802.1x
• Brocade Link Discovery Protocol (BLDP)
Software features
1
Layer 3
• Open Shortest Path First (OSPF) v2
• Static routes
• Virtual Router Redundancy Protocol (VRRP and VRRP-E)
• Internet Group Management Protocol (IGMP) v1 and v2 and snooping
• Address Resolution Protocol (ARP)
Virtualization
• Automatic Migration of Port Profiles (AMPP)
• Support for VLAN, QoS, security, and FCoE port profiles
• VMware vCenter and Brocade Network OS integration