ADX, AnyIO, Brocade, Brocade Assurance, the B-wing symbol, DCX, Fabric OS, ICX, MLX, MyBrocade, OpenScript, VCS, VDX, and
Vyatta are registered trademarks, and HyperEdge, The Effortless Network, and The On-Demand Data Center are trademarks of
Brocade Communications Systems, Inc., in the United States and/or in other countries. Other brands, products, or service names
mentioned may be trademarks of their respective owners.
o
Notice: This document is for informational purposes only and does not set f
any equipment, equipment feature, or service offered or to be offered by Brocade. Brocade reserves the right to make changes to
this document at any time, without notice, and assumes no responsibility for its use. This informational document describes
features that may not be currently available. Contact a Brocade sales office for information on feature and product availability.
Export of technical data contained in this document may require an export license from the United States government.
The authors and Brocade Communications Systems, Inc. shall have no liability or responsibility to any person or entity with
t to any loss, cost, liability, or damages arising from the information contained in this book or the computer programs that
c
respe
accompany it.
nta
The product described by this document may co
open source license agreements. To find out which open source software is included in Brocade products, view the licensing
terms applicable to the open source software, and obtain a copy of the programming source code, please visit
http://www.brocade.com/support/oscd.
in “open source” software covered by the GNU General Public License or other
rth any warranty, expressed or implied, concerning
Brocade Communications Systems, Incorporated
Corporate and Latin American Headquarters
Brocade Communications Systems, Inc.
130 Holger Way
San Jose, CA 95134
Tel: 1-408-333-8000
Fax: 1-408-333-8101
E-mail: info@brocade.com
European Headquarters
Brocade Communications Switzerland Sàrl
Centre Swissair
Tour B - 4ème étage
29, Route de l'Aéroport
Case Postale 105
CH-1215 Genève 15
Switzerland
Tel: +41 22 799 5640
Fax: +41 22 799 5641
E-mail: emea-info@brocade.com
Asia-Pacific Headquarters
Brocade Communications Systems China HK, Ltd.
No. 1 Guanghua Road
Chao Yang District
Units 2718 and 2818
Beijing 100020, China
Tel: +8610 6588 8888
Fax: +8610 6588 9999
E-mail: china-info@brocade.com
Asia-Pacific Headquarters
Brocade Communications Systems Co., Ltd. (Shenzhen WFOE)
Citic Plaza
No. 233 Tian He Road North
Unit 1308 – 13th Floor
Guangzhou, China
Tel: +8620 3891 2000
Fax: +8620 3891 2111
E-mail: china-info@brocade.com
This document is organized to help you find the information that you want as quickly and easily as
possible.
This document contains the following components:
• Chapter 1, “Brocade 6545 16 Gbps FC Switch Module Product Overview,”introduces the
supported hardware and software features, identifies operation mode
model options.
s, available licenses and
• Chapter 2, “Installing the Brocade 6545 16 Gbps FC Switch Module,”provides shipping carton
contents, safety information, and set-up instructions for installing the device into the Fujitsu
PRIMERG
Y XXX chassis.
• Chapter 3, “Configuring the Brocade 6545 16 Gbps FC Switch Module,”enables you to perform
tasks that include methods for configuring an IP add
connections to the device, how to install the optical transceivers and cables, and backing up
the configuration.
ress on the device, establishing
• Chapter 4, “Managing the Brocade 6545 16 Gbps FC Switch Module,”discusses methods for
managing the device and describes LED behavior.
• Appendix A, “Brocade 6545 16 Gbps FC Switch Module Specifications,”provides device
This document includes information specific to the Brocade 6545 16 Gbps FC Switch Module using
the Brocade Fabric OS. For more information regarding the Fabric OS version information, refer to
the release notes that come with your Brocade 6545 16 Gbps FC Switch Module.
Document conventions
This section describes text formatting conventions and important notice formats used in this
document.
Text formatting
The narrative-text formatting conventions that are used are as follows:
bold textIdentifies command names
Id
entifies the names of userIdentifies keywords and operands
Identifies text to enter at the GUI or CLI
italic textProvides emphasis
entifies variables
Id
Identifies paths and Internet addresses
Identifies docum
e
nt titles
manipulated GUI elements
code textIdentifies CLI output
Identifies command syntax examples
For readability, command names in the narrative portions of this guide are presented in mixed
lett
ercase: for example, switchShow. In actual examples, command lettercase is all lowercase.
Command syntax conventions
Command syntax in this manual follows these conventions:
commandCommands are printed in bold.
--option, optionCommand options are printed in bold.
-argument, argArguments.
[ ]Optional elements appear in bracke
variableVariables are printed in italics. In the help pages, values are
enclosed in angled brackets < >.
...Repeat the previous element, for example “member[;member...]”
valueFixed values following arguments are printed
--show WWN
|Boolean. Elements are exclusive. Example:
ts.
underlined or
in plain font. For example,
--show -mode egress | ingress
viiiBrocade 6545 Gen5 16-Gbps FC Switch Module Hardware Reference Manual
53-1003184-01
Notes, cautions, and warnings
NOTE
CAUTION
DANGER
The following notices and statements are used in this manual. They are listed below in order of
increasing severity of potential hazards.
A note provides a tip, guidance, or advice, emphasizes important information, or provides a
reference to related information.
A Caution statement alerts you to situations that can be potentially hazardous to you or cause
damage to hardware, firmware, software, or data.
A Danger statement indicates conditions or situations that can be potentially lethal or extremely
hazardous to you. Safety labels are also attached directly to products to warn of these conditions
or situations.
Key terms
For definitions specific to Brocade and Fibre Channel, see the technical glossaries on MyBrocade.
See “Brocade resources” on page x f
For definitions of SAN-specific terms, visit the Stora
dictionary at:
http://www.snia.org/education/dictionary
Notice to the reader
This document may contain references to the trademarks of the following corporations. These
trademarks are the properties of their respective companies and corporations.
These references are made for informational purposes only.
CorporationReferenced Trademarks and Products
FujitsuFujitsu Server PRIMERGY
Microsoft CorporationWindows, Windows NT, Internet Explorer
Oracle CorporationOracle, Java
Red Hat, Inc.Red Hat, Red Hat Network, Maximum RPM, Linux Undercover
Release notes are available on the MyBrocade website.
Brocade website:
available through the Brocade website
Other industry resources
For additional resource information, visit the Technical Committee T11 website. This website
provides interface standards for high-performance and mass storage applications for Fibre
Channel, storage management, and other applications:
http://www.t11.org
For information about the Fibre Channel industry, vi
website:
http://www.fibrechannel.org
sit the Fibre Channel Industry Association
xBrocade 6545 Gen5 16-Gbps FC Switch Module Hardware Reference Manual
53-1003184-01
Getting technical help
Contact your switch support supplier for hardware, firmware, and software support, including
product repairs and part ordering. To expedite your call, have the following information available:
1. General Information
• Switch model
• Switch operating system version
• Software name and software version, if applicable
• Error numbers and messages received
• supportSave command output
• Detailed description of the problem, including the switch or fabric behavior immediately
following the problem, and specific questions
• Description of any troubleshooting steps already performed and the results
• Serial console and Telnet session logs
• syslog message logs
2. Switch Serial Number
The switch serial number and corresponding bar code are pr
as illustrated below:
*FT00X0054E9*
FT00X0054E9
The serial number label for the Brocade 6545 16 Gbps FC
on the top cover:
3. License ID
For the Brocade embedded switches, use the lice
Document feedback
Quality is our first concern at Brocade and we have made every effort to ensure the accuracy and
completeness of this document. However, if you find an error or an omission, or you think that a
topic needs further development, we want to hear from you. Forward your feedback to:
documentation@brocade.com
Provide the title and version number of the document and as much detail as possible abou
comment, including the topic heading and page number and your suggestions for improvement.
The Brocade 6545 Gen5 16 Gbps FC Switch Module is a 26-port, 16-Gbps Fibre Channel
embedded switch that is designed to work in the Fujitsu PRIMERGY BX900 S2 and BX400 Blade
Servers. It provides 18 internal Fibre Channel ports that communicate with the blade servers by
way of a passive midplane, and 8 external ports on the front panel that support 16-, 8-, and 4-Gbps
speeds through 16- and 8-Gbps SFP+ optical transceivers.
The PRIMERGY BX400 Blade Server holds a maximum of
Modules, while the PRIMERGY BX900 S2 Blade Server holds a maximum of four
Brocade 6545 16 Gbps FC Switch Modules.
The Brocade 6545 16 Gbps FC Switch Module runs on Brocade Fabric OS. Refer to the FabAdministrator’s Guide and product release notes for additional information about the Brocade
6545 16 Gbps FC Switch Module.
The Brocade 6545 16 Gbps FC Switch Module is also referred to as the “Switch Module” throughout
this document.
The Brocade 6545 16 Gbps FC Switch Module can be managed through the Fujitsu PRIMERGY
BX900 S2 and BX400 Blade Servers and standard Brocade management methods, such as the
command-line interface (CLI), and the Brocade Web Tools user interface.
The Switch Module supports the following features and functionality:
• 26 ports running up to 16 Gbps
• 18 internal links running up to 16 Gbps with auto-negotiation capability
• 8 external ports capable of supporting 16, 8 and 4 Gbps speeds through 16 GB and 8 Gb SFP+
optical transceivers
• Two 100-Mbps physical Ethernet ports connecting from the Management Blade (MMB1 and
MMB2); however, only one MMB with a single IP address can access the Switch Module at any
one time
• Advanced Integrated SERDES with Forward Error Correction capability at 16 Gbps
• 440EPX processor running at 667 MHz
• 1 Gb DDR2 SDRAM with ECC, SORDIMM package, running at 166 MHz
• 4 MB of Boot ROM
• 4 MB of Flash
• 1 GB Compact Flash module (Type I & II) supported through a 440EPX IDE interface
• FPGA for system glue logic and MMB interface management
• CPLD for LLI MUX support
• One real-time clock
• One local I2C bus
• One Global I2C bus
• Three I2C switches
• Temperature monitoring
• Voltage monitoring and margining
• 8 port LEDs to indicate port status
• 3 system LEDs to indicate board status
• Brocade Fabric OS with advanced Web Tools and Fabric Services
• Dynamic Ports on Demand (POD) support
• In-flight compression
• Full Fabric and Access Gateway operation
• Advanced virtualization capabilities
2Brocade 6545 Gen5 16-Gbps FC Switch Module Hardware Reference Manual
53-1003184-01
Supported software features
NOTE
The Brocade 6545 16 Gbps FC Switch Module runs on Fabric OS. Included with the Switch Module
as part of the ease-of-use functionality are the following software features.
• Brocade Advanced Web Tools enables advanced administration, configuration, and
maintenance of the fabric switches.
• Brocade Advanced Zoning segments a fabric into virtual private SANs. You can create zones
using the Ease of Setup tool to set up and configure the entry-level SAN automatically.
• Brocade Enhanced Group Management (EGM) enables switches, directors, and DCX backbone
platforms to be managed as a group. Group management tasks can include:
-Replicating security settings for a group of switches.
-Downloading firmware to a group of switches.
-Uploading the configuration from a group of switches.
-Managing and editing multiple PCDM configurations.
-Scheduling periodic backup to a server database.
• Brocade Secure Fabric OS delivers protection from unauthorized access and corruption
through change control management.
Supported software features
1
Fabric OS Native and Access Gateway modes
The Brocade 6545 16 Gbps FC Switch Module can function in either Fabric OS Native mode or
Brocade Access Gateway mode. The features available on the Switch Module depend on the mode
that has been configured. The Switch Module is shipped in Fabric OS Native mode by default.
Access Gateway mode simplifies SAN deployment by using NPIV t
Channel switch functions that improve Switch Module scalability, manageability, and
interoperability. For more information on Access Gateway, refer to the following:
• For a list of Switch Module F_Ports mapped to N_Ports in the Switch Module as shipped from
the factory, refer to “Access Gateway mode default port mapping” on
• Because Access Gateway relies on NPIV technology for its connection to the edge fabric, you
may have to prepare the edge fabric before connecting it to Access Gateway.
• For general information and details on using Access Gateway, refer to the Brocade Access
Gateway Administrator’s Guide.
When the switch is in Access Gateway mode it can only be directly connected to storage array if
and only if at least one other N_port on the same switch is connected to a SAN network.Access
Gateway cannot be connected directly into a storage array.
The Brocade 6545 16 Gbps FC Switch Module supports the following features when operating in
Fabric OS Native mode:
• Up to 8 external autosensing Fibre Channel ports (up to 16 Gbps). These universal and
self-configuring ports are capable of becoming one of the following port types:
-F_Port (fabric enabled)
-E_Port (expansion port)
These ports are capable of Brocade ISL Trunking with appropriate licensing.
• Up to 18 internal copper backplane F_Ports. Each port can automatically negotiate its speed at
8 or 16 Gbps to match the highest speed supported by the attached devices.
The internal copper F_ports are hard-wired to the blade server chassis backplane, with an
internal connection to the server blades installed in the chassis. Please note that Brocade
Gen5 16Gb platforms do not support FL_port.
• Dynamic ports on demand, which allows ports to be activated as needed based on available
licenses. This also applies to Access Gateway mode.
• Frame filtering that augments the hardware zoning capabilities of the Brocade ASIC, which
implements hardware zoning at the port level of the Switch Module. The single switch ASIC
design eliminates blocking, guaranteeing full transmit and receive bandwidth to all Fibre
Channel ports at all times.
• Brocade ASIC expanded capabilities, including World Wide Name (WWN), device-level,
protocol-level, and Logical Unit Number (LUN)-level zoning to provide the flexibility of
second-generation software zoning with the enhanced security of hardware zoning.
• Hardware zoning implemented by firmware-accessible table per output port, which permits or
denies delivery of frames to any particular destination port address.
• Extensive diagnostics, system-monitoring, and reliable power and cooling capabilities. This
also applies to Access Gateway mode.
• Up to eight Brocade-branded small form-factor pluggable (SFP) optical transceivers. The SFP
optical transceivers support any combination of Short Wavelength (SWL) and Long Wavelength
(LWL) optical media.
You can add additional transceivers by purchasing them separately from your vendor.
• One green and amber light-emitting diode (LED) above each port to indicate port status.
If dark, the port is unlicensed.
• The following system LEDs:
-One green power LED to indicate module power-on.
-One green or amber LED to indicate module status.
-One blue LED to locate and identify the module.
Refer to “Interpreting LED activity” on pag
4Brocade 6545 Gen5 16-Gbps FC Switch Module Hardware Reference Manual
e 38 for details about the Switch Module LEDs.
53-1003184-01
Fabric OS Native and Access Gateway modes
1
Access Gateway mode
The Switch Module has the following features when operating in Access Gateway mode:
• Up to 8 autosensing (4, 8, and 16 Gbps) Fibre Channel ports. These are universal and
self-configuring ports capable of becoming the following types:
-F_Port (Fabric port)
-N_Port (Node port)
• Up to 18 internal backplane F_Ports. Each port can automatically negotiate its speed at either
8 or 16 Gbps to match the speed of attached devices
• Dynamic ports on demand, which allows any port to be activated as needed based on available
licenses. This also applies to Fabric OS native mode.
• Extensive diagnostics, system monitoring, and reliable power and cooling capabilities. This also
applies to Fabric OS mode.
• One green/amber LED to indicate status for each port.
If dark, the port is unlicensed.
• The following system light-emitting diodes (LEDs):
-One green power LED to indicate module power-on.
-One green/amber LED to indicate module status.
-One blue LED to locate and identify the module.
See “Interpreting LED activity” on page 38 for details about the Switch Module LEDs.
Ports on Demand
The base version of the Brocade 6545 16 Gbps FC Switch Module ships with 14 active ports. You
can purchase a Ports on Demand (POD) license to activate 12 additional ports. The Switch Module
supports two port activation methods: static and dynamic. The default method is dynamic.
• For Dynamic POD, 14 licenses are available for the first 14 active ports. Ports 19 to 22 are
licensed at the factory. The remaining licenses are assigned to active ports on a first-come,
first-served basis. Once licenses are issued, they can be moved from one port to another,
making port licensing more flexible.
• For static POD, Table 1 shows the 14 base internal and external ports that are licensed. In
static mode, you cannot move licenses from one port to another.
This section describes the physical Switch Module as shipped from the factory. For specifications,
such as installed memory, weight and physical dimensions, facility requirements, architectural
specifications, and regulatory compliance, refer to Appendix A, “Brocade 6545 16 Gbps FC Switch
Module Specifications”
Front panel
Externally accessible ports and LEDs are on the port side of the Switch Module. The front panel
faces out when the Switch Module is inserted in the I/O bay of the Blade Server chassis. Figure 1
details the front panel. For a complete description of t
LEDs, see “Interpreting LED activity” on page 38.
ccess the I/O module handle at the front of the port side of the Switch Module. By pressing the
A
handle’s release
Server chassis.
FIGURE 1Front panel view
he locations and interpretations of these
latch, you can open the handle to remove and insert the unit from the Blade
1. Module status indicator
2. Health indicator
3. Module Locator
4. Port status indicators (See “Interpreting LED activity” on p
The Switch Module has a Re
inserting a pin (or an object of similar size) in the small hole. Depress the Reset button for up to
5 seconds to reboot the Switch Module.
set button, which is a small, recessed micro-switch that is accessed by
ge 38.)
a
6Brocade 6545 Gen5 16-Gbps FC Switch Module Hardware Reference Manual
53-1003184-01
Hardware Description
1
Non-port side
The non-port side of the Brocade 6545 16 Gbps FC Switch Module is seated in the chassis. (Refer
to Figure 2.) The Switch Module will seat correct
ly when the insertion arm is closed.
When the Switch Module is inserted, the backplane conn
the Switch Module to be configured in the Blade Server chassis.
ectors activate a connection port, allowing
FIGURE 2Non-port side, as viewed from the top
1. I/O module handle. Pressing the handle’s release
the module from the Blade Server chassis.
Brocade-designed ASICs provide the switching functionality. The CPU runs the Brocade Fabric OS
and is responsible for switch initialization, configuration, and management. The Switch Module
CPU subsystem provides the following:
• AMCC PPC440EPX-667 MHz CPU
• On-board 1 GB DDR2 memory with ECC operating at 166 MHz
• 4 MB Boot flash
• On-board compact flash, which includes a 1 GB module for firmware download and logging
• Digital thermometers for temperature monitoring
• LEDs:
-Eight FC port and status LEDs, one per external port
-One ID LED
-One health LED
-One status LED
• One Brocade ASIC supporting 26-port at 16 Gbps
• Up to eight optional pluggable SFP optical media
• One real-time clock (RTC)
• One 10/100 Ethernet port share among three connections (one external and two internal)
using analog switching.
• Two major power domains
ASIC
One ASIC within the system is Brocade-designed and provides switching and connectivity
functionality for external N_ports (as an F_port) or to other Brocade switches (as an E_port). Each
port can operate at 4 Gbps, 8 Gbps or 16 Gbps.
The ASIC contains the Fibre Channel interface logic, message
receive buffer memory for the on-chip ports, and other support logic.
and buffering queuing logic, the
Ports
The Brocade 6545 16 Gbps FC Switch Module supports the following port types:
• Eight external optical ports
• Eighteen internal copper ports
Optical ports
For optical ports, SFP+ fiber-optic transceivers that convert electrical signals to optical signals, and
optical signals to electrical signals, are used. Each 16 Gbps SFP+ optical transceiver is capable of
transmitting at 4, 8 Gbps or 16 Gbps speeds.
8Brocade 6545 Gen5 16-Gbps FC Switch Module Hardware Reference Manual
53-1003184-01
ISL Trunking groups
NOTE
NOTE
1
Copper ports
For internal copper ports, connection occurs by way of SerDes 4-wire signaling through the
backplane to the server bays. The internal ports are capable of transmitting at 8 or 16 Gbps
speeds. The internal port speed is auto-generated to the highest speed supported by the chassis.
There is one server per switch port that interfaces to the blade server chassis switch.
When implementing port number zoning on the embedded
the correct switch port number when zoning a server blade and a target device. The server blades
are numbered one through eighteen (1 – 18).
SFP+ optical transceivers
The Brocade 6545 16 Gbps FC Switch Module is designed to work with SFP+ optical transceivers.
The Switch Module ships with a specific number of 16 Gbps Brocade-branded SFPs.
You can also install 8 Gbps SFPs in the Switch Module. All SFPs must be Brocade-branded.
SFPs provide optical connections to external devices for both short wavelength (SWL) and long
wavelength (LWL) connections. Replace SFPs with a new pluggable unit rather than replacing the
Switch Module. Refer to the manufacturer’s instructions when installing SFPs.
For instructions on removing and replacing
replacing the Switch Module” on page 42.
or a complete list of SFP+optical transceivers and ot
F
Connect Web site at: http://www.brocadeconnect.com an
compatibility information.
ISL Trunking groups
Fibre Channel switch, be sure to select
the SFP+ optical transceivers, refer to “Removing and
her interoperable hardware, visit the Brocade
d follow the links to the latest
If your Brocade 6545 16 Gbps FC Switch Module has a Brocade ISL Trunking license, external ports
can form trunking groups of Inter-Switch Links (ISLs) between adjacent switches. ISL trunking
allows up to eight ports between a pair of switches to be combined to form a single, logical ISL with
an aggregate speed of up to 128 Gbps for optimal bandwidth utilization and load balancing.
All external ports (0, 19-25) can be fo
an 8-port trunk. The ports can also form 2 to 7-port trunks.
For details about Brocade ISL T
Only the external ports are available for trunking. The Enterprise model includes the trunking
licenses.
rmed into a single 8-port trunk if the attached switch supports
runking, refer to the Brocade Fabric OS Administrator’s Guide.
Models available
Brocade 6545 16 Gbps FC Switch Module is available in two models: the Base model and the
Enterprise model.
• Enterprise model Includes all licenses. Refer to Tabl e 2.
The Switch Module suppor ts the following optional software which is activated with the purchase of
the corresponding license key. Applicable options depend on whether the Switch Module operates
in Fabric OS native mode or Access Gateway mode.
TABLE 2Licenses
Software featureDescriptionMode
Ports on Demand (POD)Enables users to instantly scale the fabric by provisioning
additional ports using license key upgrade for the base
(14-port) version only.
Fabric Vision (FV)Continuously monitors SAN fabrics for potential faults
based on thresh
elements and events—automatically alerting
administrators to potential problems before they become
costly failures.
Inter-Switch Link (ISL)
nk ing
Tru
Extended Fabrics (EXF)Extends the reach of storage environments across longer
Enhanced Group
nagement (EGM)
Ma
Optimizes the performance and availability of SAN fabrics
while simplifying ISL management. For example, multiple
16 Gbps Brocade switches can automatically group up to
eight ISLs into a single logical “trunk,” with a total
throughput of up to 128 Gbps.
distances b
and storage devices, depending on the connectivity
bandwidth. 4, 8, and 16 GBps links are available.
Enables centralized management of Brocade Switches.
Drives consistency across the fabric and minimizes
downtime. It simplifies and automates configuration and
administrative tasks.
olds set for a variety of SAN fabric
y supporting up to 500 Km between the hosts
A bundle license is also supported which includes ISL, FV, and EXF.
Native (switch) mode
Access Gateway mode
Native (switch) mode
Native (switch) mode
Access Gateway mode
Native (switch) mode
Native (switch) mode
Access Gateway mode
10Brocade 6545 Gen5 16-Gbps FC Switch Module Hardware Reference Manual
53-1003184-01
Chapter
Installing the Brocade 6545 16 Gbps FC Switch Module