Brocade 10GbE User Manual

r

򔻐򗗠򙳰 ®

Brocade Converged 10GbE Switch Module for IBM
BladeCenter

IBM BladeCenter at-a-glance guide

The Brocade Converged 10GbE Switch Module and Brocade 2-Port 10Gb Converged Network Adapter
are part of a leading Converged Ethernet solution for IBM BladeCenter that offers Fibre Channel
investment protection, maximum bandwidth and performance, and simplicity in a converged environment.
The Brocade Converged 10GbE Switch Module also features Dynamic Ports on Demand capability
through the Port Upgrade Key. This capability allows you to enable any combination of Fibre Channel and
Ethernet ports based on your infrastructure requirements, and to experience Converged Ethernet benefits
without significant investment.

With the base model Converged 10GbE Switch Module, you can enable 16 of the 30 ports on the switch
(eight 10Gb CEE external ports, eight 8Gb FC external ports, and 14x 10Gb CEE internal ports). If you
purchase the Port Upgrade Key, you can enable all 30 ports on the Switch Module for a fully realized
Converged Ethernet solution.

Figure 1 shows the switch module.

Figure 1. Brocade Converged 10GbE Switch Module for IBM BladeCenter

Did you know?

The Brocade CNAs and Brocade Converged 10GbE Switch Modules for IBM BladeCenter are the
industry's first truly converged FCoE BladeCenter solution with native Fibre Channel and Ethernet ports
built into a single switch module. The converged switch module provides up-front reduction in SAN/LAN
cost and complexity. It requires fewer adapters, switch modules and cabling, which means an up-front
reduction in your network investment.

Brocade Converged 10GbE Switch Module for IBM BladeCente

1

r

Part number information

Table 1 lists the part numbers to order these modules and additional options for them.

Table 1. IBM part numbers and feature codes for ordering

Description IBM part number IBM feature code

Brocade Converged 10GbE Switch Module for IBM BladeCenter 69Y1909 7656

Brocade 10Gb SFP+ SR Optical Transceiver 49Y4216 0069

Brocade 8Gb SFP+ SW Optical Transceiver 44X1962 5084

Brocade 14-port Converged 10GbE Switch Port Upgrade 69Y1917 2425

Brocade ISL Trunking software upgrade 26K5607 4247

Brocade Fabric Watch software upgrade 45W0504 4398

Brocade Performance Monitor upgrade 45W0508 4248

Part number 69Y1909 include the following items:



One Brocade Converged 10GbE Switch Module for IBM BladeCenter (includes two 10GbE SFP+
modules standard)



IBM Important Notices document



IBM Warranty and Support Guide



One mini-USB console cable with serial connectors



BC-HT interposer gasket kit (used if the switch module is inserted in the BladeCenter HT chassis)



DB9 to RJ45 adapter



The IBM Documentation CD which contains the following documents:



Brocade Converged 10GbE Switch Module for IBM BladeCenter Installation and Users Guide



IBM Safety Information



IBM Environmental Notices and Users Guide



Brocade EULA



Brocade CEE Admin guide



Brocade CEE CLI guide



Brocade MIBS manual

document (multilingual)

The base model of the Brocade Converged 10GbE Switch Module, 69Y1909, ships with 16 licensed
ports. This module supports the Dynamic Ports on Demand (DPOD) feature, where ports are licensed as
they come online independent of the port type. In the base model, two external CEE ports (ports 15 and

16) are pre-licensed and are pre-installed with two 10GbE optical transceivers. The remaining 14 licenses
are available to be assigned to other internal or external ports. The 16 licensed ports may be any
combination of external CEE ports, external FC ports, or internal CEE ports. After all the licenses have
been assigned, you can manually move licenses from one port to another.

Additional ports can be activated by purchasing the Brocade Converged 10GbE Switch Port Upgrade,
part number 69Y1917. This upgrade option activates the license for the remaining 14 ports. All internal
and external ports will then be licensed and can be used.

The switch ships standard with two small form-factor pluggable plus (SFP+) modules. Additional SFP+
transceivers can be ordered separately if required. Table 1 lists the transceivers that are supported.

Brocade Converged 10GbE Switch Module for IBM BladeCente

2

r

Benefits and features

The Brocade Converged 10GbE Switch Module with a supported converged network adapter (CNA)
provides these benefits:



Highly integrated BladeCenter switch module

The Brocade Converged 10GbE Switch Module offers one of the industry's best integrated I/O
solutions. The compact design incorporates Ethernet and Fibre Channel switching and provides a
total of 30 ports: eight external 10Gb Ethernet CEE ports for LAN connectivity and eight external 8Gb
Fibre Channel ports for storage and SAN connectivity. With the high integration of this module, you
can achieve all of your networking and storage I/O needs with a single module.



Unique flexible ports and server deployment

The Dynamic Port on Demand (DPoD) feature of the Brocade Converged 10GbE Switch Module lets
you activate any combination of internal or external ports. This means you can to balance server and
I/O port assignments to accommodate the workloads of applications and satisfy business needs.
DPoD gives you the ability to enable only 10GbE ports for networking needs, only Fibre Channel ports
for storage support, or any combination of Ethernet and Fibre Channel ports



Support for Data Center Fabric Manager

IBM System Storage Data Center Fabric Manager (DCFM) is available for use with the switch. DCFM
is fully integrated with IBM Systems Director for end-to-end data center management. A 75-day trial
version and can be downloaded from:

http://www.ibm.com/systems/storage/san/b-type/dcfm/



Highest bandwidth and low latency

The total available bandwidth of 144 Gbps (80 Gbps Ethernet and 65 Gbps Fibre Channel) accessible
through external ports means the switch module can support high demanding applications and
storage solutions. In addition to the high bandwidth available on external ports, the switch module
supports an additional 140 Gbps on 14 internal 10GbE ports. The switch module uses cut-through
and non-blocking to deliver high performance and low latency for demanding virtual applications and
high speed environments.



Low total cost of ownership

The highly integrated design delivers the lowest total cost of ownership (TCO). The Brocade
Converged 10GbE Switch Module is two switches in one, Ethernet and Fibre Channel, which reduces
the cost of acquisition. The switch module is built around a pay-as-you-go model that gives you a
lower price entry point and lets you add ports as your business needs dictate. The switch module
ships with two 10GbE SFP+ transceivers to further lower initial investments. Because it is designed
for seamless integration into existing networking and storage environments, this module truly protects
existing investments. Overall, with this integrated switch module, your server infrastructure will use
fewer hardware components with lower costs and higher reliability, which further drives a lower TCO.

Brocade Converged 10GbE Switch Module for IBM BladeCente

3

r

The converged switch modules have the following features:



Eight external 10 Gb Converged Enhanced Ethernet ports



Eight external auto-negotiated Fibre Channel ports (2 Gbps, 4 Gbps, or 8 Gbps)



14 internal auto-negotiated 10 GbE ports (1 Gbps or 10 Gbps)



Two internal full-duplex 100 Mbps Ethernet interfaces for management purposes



One external RS232 console port with a mini-USB interface for serial console management



One external 10/100/1000 Mb RJ45 Ethernet copper port for management



CEE features



Priority-based Flow Control (PFC): IEEE 802.1Qbb



Enhanced Transmission Selection (ETS): IEEE 802.1Qaz



Data Center Bridging eXchange (DCBX)



Layer 2 features



Layer 2 Virtual Local Area Networks (VLANs): 4096



VLAN Encapsulation 802.1Q



Rapid Spanning Tree Protocol (RSTP)



Multiple Spanning Tree MSTP (802.1s): 16 instances



Link Aggregation Control Protocol (LACP) IEEE- 802.3ad



Brocade enhanced frame-based trunking



Advanced PortChannel hashing based on Layer 2, 3, and 4 information



Pause Frames (802.3x)



Storm Control (unicast, multicast, and broadcast)



Address Resolution Protocol (ARP) RFC 826



Layer 2 security



Ingress Access Control Lists (ACLs)



Standard and extended Layer 2 ACLs



VLAN-based ACLs (VACLs)



Port-based ACLs (PACLs)



ACL statistics



Port-based Network Access Control: IEEE 802.1X



Layer 2 Quality of Service (QoS)



Eight priority levels for QoS



IEEE 802.1p Class of Service (CoS)



Eight hardware queues per port



Per-port QoS configuration



CoS trust: IEEE 802.1p



Per-port Virtual Output Queuing



CoS-based egress queuing



Egress strict priority queuing



Egress port-based scheduling: Weighted Round-Robin (WRR)



Layer 3 features



Static IP routes



External Fibre Channel ports that can operate as F_ports (fabric ports), FL_ports (fabric loop ports),
or E_ports (expansion ports)

Brocade Converged 10GbE Switch Module for IBM BladeCente

4

r



FC fabric services



Simple Name Server (SNS)



Registered State Change Notification (RSCN)



Dynamic Path Selection (DPS)



Enhanced Group Management (EGM)



ISL Trunking (optional)



Fabric Watch (optional)



Advanced Performance Monitor (optional)



Power-on self-test diagnostics and status reporting

The following software features come with the switch modules:



Brocade Web Tools



16-port licensing

The switch supports the following fabric management (all management connections go through the
management module except direct serial connection, which goes through the mini-USB port):



Web interface through Web Tools



Command-line interface (CLI) through the Telnet program



A terminal emulation program connection to the mini-USB port interface



IBM System Storage Data Center Fabric Manager (DCFM) application



Switch's SNMP agent

Supported BladeCenter chassis and expansion cards

The Brocade Converged 10GbE Switch Module is supported in the IBM BladeCenter H and HT chassis
as listed in Table 2.

Table 2. IBM BladeCenter chassis that support the Brocade Converged 10GbE Switch Module

I/O module Part number

Brocade Converged 10GbE Switch Module 69Y1909 N N Y N Y N N

Brocade Converged 10GbE Switch Module for IBM BladeCente

5

r

The Brocade Converged 10GbE Switch Module supports the expansion cards listed in Table 3. This table
also lists the chassis bays in which the switch module must be installed when used with each expansion
card.

Table 3. Brocade Converged 10GbE Switch Module and BladeCenter chassis I/O bays support

Part

Description

Gigabit Ethernet integrated in the server None N N N N N N N N N N

Ethernet Expansion Card (CFFv) 39Y9310 N N N N N N N N N N

Ethernet Expansion Card (CIOv) 44W4475 N N N N N N N N N N

QLogic Ethernet and 4Gb FC Card (CFFh) 39Y9306 N N N N N N N N N N

2/4 Port Ethernet Expansion Card (CFFh) 44W4479 N N N N N N N N N N

QLogic Ethernet and 8Gb FC Card (CFFh) 44X1940 N N N N N N N N N N

NetXen 10Gb Ethernet Expansion Card (CFFh) 39Y9271 N N N N N N N N N N

number

Broadcom 2-port 10Gb Ethernet Expansion Card
(CFFh)

Broadcom 4-port 10Gb Ethernet Expansion Card
(CFFh)

QLogic 2-port 10Gb Converged Network Adapter
(CFFh)

Emulex Virtual Fabric Adapter (CFFh) 49Y4245 N N N N N N N N N N

Intel 2-port 10Gb Ethernet Expansion Card (CFFh) 42C1810 N N N N N N N N N N

Brocade 2-port 10GbE Converged Network Adapter 81Y1650 N N N N N N Y N* Y N*

44W4466 N N N N N N N N N N

44W4465 N N N N N N N N N N

42C1830 N N N N N N Y N* Y N*

* One Brocade Converged 10GbE Switch Module occupies two adjacent high-speed bays, and the ports
on supported cards are physically routed to the bays 7 and 9.

The BladeCenter chassis have the following bays:



BladeCenter S, E, and T have four standard I/O bays (1, 2, 3, and 4)



BladeCenter H has four standard I/O bays (1, 2, 3, and 4), two bridge bays (5 and 6), and four
high-speed bays (7, 8, 9, and 10)



BladeCenter HT has four standard I/O bays (1, 2, 3, and 4) and four high-speed bays (7, 8, 9, and 10)

The Brocade Converged 10GbE Switch Module fits in one of the high-speed I/O bay (bays 7-10).

Brocade Converged 10GbE Switch Module for IBM BladeCente

6

r

Popular configurations

Figure 2 shows the use of Brocade Converged 10GbE Switch Modules to route two 10 Gb Converged
Enhanced Ethernet ports from a Brocade 2-port 10GbE Converged Network Adapter installed into each
server. Two Brocade Converged 10GbE Switch Modules are installed in bays 7/8 and bays 9/10 of the
BladeCenter H chassis. All connections between the controller, card, and the switch modules are internal
to the chassis. No internal cabling is needed.

Figure 2. A converged 20 Gb solution using redundant Brocade Converged 10GbE Switch Modules

The components used in this configuration are listed in Table 4.

Table 4. Components used when connecting Brocade 2-port 10GbE Converged Network Adapter to two
Brocade Converged 10GbE Switch Modules

Diagram
reference

Part
number/machine
type

Varies IBM BladeCenter HS22 or other supported server 1 to 14 or

81Y1650 Brocade 2-port 10GbE Converged Network Adapter 1 per

8852 or 8740/8750 BladeCenter H or BladeCenter HT 1

69Y1909 Brocade Converged 10GbE Switch Module 1 to 2

49Y4216 Brocade 10Gb SFP+ SR Optical Transceiver Up to 6*

44X1962 Brocade 8Gb SFP+ SW Optical Transceiver Up to 6*

Description Quantity

1 to 12

server

*The Brocade Converged 10GbE Switch Module has 16 external ports - eight 10 Gb CEE ports and eight
8 Gb Fibre Channel ports. You must have one transceiver for each port in an I/O module (every switch
module comes standard with two 10Gb Ethernet SFP+ transceivers).

Refer to the IBM System Storage Interoperability Center web link for information about the compatibility of
Brocade Converged 10GbE Switch Modules with storage systems and fabrics:

http://www.ibm.com/systems/support/storage/config/ssic

Brocade Converged 10GbE Switch Module for IBM BladeCente

7

r

Connectors and LEDs

Figure 3 shows the front panel of the Brocade Converged 10GbE Switch Module.

Figure 3. Front panel of the Brocade Converged 10GbE Switch Module

Table 5 explains the components shown in Figure 3.

Table 5. Key to components in Figure 3

Diagram reference Description

1 Status/Fault LED (amber)

2 Power LED (green)

3 Ethernet port (RJ45)

4 Console port (mini-USB)

5 Fibre Channel ports (23-30 - right to left)

6 CEE ports (15-22 - right to left)

7 CEE port fault status LED (amber)

8 CEE port link status LED (green)

9 FC port fault status LED (amber)

10 FC port Tx/Rx link status LED (green)

11 Ethernet port speed LED (green)

12 Ethernet port Link LED (green)

13 Release levers (2)

Brocade Converged 10GbE Switch Module for IBM BladeCente

8

r

The front panel contains the following components:



LEDs that display the following information:



The status of the switch module and its network connection



The status of the external connections to the switch module



Eight FC SFP+ port connectors to attach SFP+ modules. They are numbered 23-30 right to left.



Eight FCoE/CEE SFP+ port connectors to attach SFP+ modules. They are numbered 15-22 right to
left.



One RJ-45 Ethernet port connector for debug and field support.



One mini-USB console port connector used for switch management. This port requires a mini-USB
plug on the serial cable.

Network cabling requirements

The following network cables are supported for the Brocade Converged 10GbE Switch Module:



10GBASE-SR for 10Gb CEE ports



850 Nm wavelength, multimode fiber, 50 µ or 62.5 µ (300 meters maximum), with LC duplex
connector



8 Gb FC ports when operating at 8 Gbps speed



850 Nm wavelength, multimode fiber, 50 µ (150 meters maximum) or 62.5 µ (21 meters
maximum), with LC duplex connector



1000BASE-T for RJ-45 port



UTP Category 6 (100 meters maximum)



UTP Category 5e (100 meters maximum)



UTP Category 5 (100 meters maximum)



EIA/TIA-568B 100-ohm STP (100 meters maximum)

Operating environment

The switch module has the following physical specifications:



Dimensions:



Approximate height: 4.10 cm (1.61 inches)



Approximate width: 29.38 cm (11.57 inches)



Approximate depth: 25.70 cm (10.12 inches)



Approximate weight: 2.13 kg (4.7 lb)

Operating:



0° to 40° C (32° to 104° F) at 0 to 3,048 m (0 to 10,000 ft) operating

Non-operating:



-20° to 70° C (-4°F to 158° F) at 0 to 10,688 km (0 to 35,000 ft) non-operating

Humidity:



10% to 90% (non-condensing) at 29° C operating



5% to 95% (non-condensing) at 38° C non-operating

Brocade Converged 10GbE Switch Module for IBM BladeCente

9

r

Related publications

For more information refer to these documents:



Brocade Converged 10GbE Switch Module for IBM BladeCenter Installation and User's Guide

http://ibm.com/support/entry/portal/docdisplay?lndocid=MIGR-5088152



IBM System Storage Data Center Fabric Manager

http://www.ibm.com/systems/storage/san/b-type/dcfm/



IBM BladeCenter Interoperability Guide

http://www.ibm.com/support/docview.wss?uid=psg1MIGR-5073016



IBM Redbooks publication

http://www.redbooks.ibm.com/abstracts/sg247523.html

IBM BladeCenter Products and Technology

, SG24-7523

Brocade Converged 10GbE Switch Module for IBM BladeCente

10

r

Notices

/

©

This information was developed for products and services offered in the U.S.A.

IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local
IBM representative for information on the products and services currently available in your area. Any reference to an
IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may
be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property
right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM
product, program, or service. IBM may have patents or pending patent applications covering subject matter described
in this document. The furnishing of this document does not give you any license to these patents. You can send
license inquiries, in writing, to:

IBM Director of Licensing, IBM Corporation, North Castle Drive, Armonk, NY 10504-1785 U.S.A.

The following paragraph does not apply to the United Kingdom or any other country where such provisions
are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS

PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT
NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS
FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain
transactions, therefore, this statement may not apply to you. This information could include technical inaccuracies or
typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in
new editions of the publication. IBM may make improvements and
described in this publication at any time without notice.

Any references in this information to non-IBM Web sites are provided for convenience only and do not in any manner
serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this
IBM product and use of those Web sites is at your own risk.IBM may use or distribute any of the information you
supply in any way it believes appropriate without incurring any obligation to you. Information concerning non-IBM
products was obtained from the suppliers of those products, their published announcements or other publicly
available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility
or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be
addressed to the suppliers of those products. This information contains examples of data and reports used in daily
business operations. To illustrate them as completely as possible, the examples include the names of individuals,
companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses
used by an actual business enterprise is entirely coincidental.

Any performance data contained herein was determined in a controlled environment. Therefore, the results obtained
in other operating environments may vary significantly. Some measurements may have been made on
development-level systems and there is no guarantee that these measurements will be the same on generally
available systems. Furthermore, some measurement may have been estimated through extrapolation. Actual results
may vary. Users of this document should verify the applicable data for their specific environment.

COPYRIGHT LICENSE:

This information contains sample application programs in source language, which illustrate programming techniques
on various operating platforms. You may copy, modify, and distribute these sample programs in any form without
payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to
the application programming interface for the operating platform for which the sample programs are written. These
examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability,
serviceability, or function of these programs.

or changes in the product(s) and/or the program(s)

Copyright International Business Machines Corporation 2010. All rights reserved.

Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by
GSA ADP Schedule Contract with IBM Corp.

Brocade Converged 10GbE Switch Module for IBM BladeCente

11

r

This document was created or updated on August 7, 2011.

Send us your comments in one of the following ways:

Use the online Contact us review form found at:



ibm.com/redbooks

Send your comments in an e-mail to:



[e-mail]

Mail your comments to:



IBM Corporation, International Technical Support Organization
Dept. HYTD Mail Station P099
2455 South Road
Poughkeepsie, NY 12601-5400 U.S.A.

This document is available online at http://www.ibm.com/redbooks/abstracts/tips0789.html .

Trademarks

IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business
Machines Corporation in the United States, other countries, or both. These and other IBM trademarked
terms are US registered or common law trademarks owned by IBM at the time this information was
published. Such trademarks may also be registered or common law trademarks in other countries. A
current list of IBM trademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml

The following terms are trademarks of the International Business Machines Corporation in the United
States, other countries, or both:

BladeCenter®
IBM®
Redbooks®
Redpaper™
Redbooks (logo)®
System Storage®
System x®

The following terms are trademarks of other companies:

Intel, Intel logo, Intel Inside logo, and Intel Centrino logo are trademarks or registered trademarks of Intel
Corporation or its subsidiaries in the United States and other countries.

Other company, product, or service names may be trademarks or service marks of others.

Brocade Converged 10GbE Switch Module for IBM BladeCente

12