IBMFlexSystemFabricCN409310GbConverged
Scalable Switch
User's Guide
IBMFlexSystemFabricCN409310GbConverged
Scalable Switch
User's Guide
Note: Before using this information and the product it supports, read the general information in Appendix B, “Notices,” on page 39,
the Safety Information and Environmental Notices and User Guide documents on the IBM Notices for Network Devices CD, and the
Warranty Information document that comes with the product.
Second Edition, August 2013
© Copyright IBM Corporation 2013.
US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.
Contents
Safety ............................v
Safety statements ........................vi
UL Regulatory Information.....................viii
Chapter 1. The IBM Flex System Fabric CN4093 10 Gb Converged Scalable
Switch ...........................1
Related documentation ......................1
Notices and statements in this document................2
Features and specifications .....................2
Major components of the switch ...................2
Chapter 2. Installing and removing the switch module .........5
Before installing the switch module ..................6
Installation guidelines .......................7
System reliability guidelines....................7
Handling static-sensitive devices ..................8
Installing the switch........................8
Removing or replacing the switch ..................10
Installing and removing SFP+ and QSFP+ modules and DACs .......11
Handling the SFP+ or QSFP+ module ...............11
Installing the SFP+ module ...................12
Installing the QSFP+ module ...................13
Removing the SFP+ or QSFP+ module ...............13
Cabling the switch and the SFP+ and QSFP+ modules ..........14
Connecting the serial console cable ................14
Disconnecting the serial console cable ...............15
Connecting the SFP+ or QSFP+ module cable ............15
Disconnecting the SFP+ or QSFP+ module cable ...........15
Connecting the RJ-45 cable ...................15
Disconnecting the RJ-45 cable ..................16
Locating the information panels, LEDs, and external ports .........16
Information panel .......................16
Information LEDs .......................18
Switch status LEDs .....................18
Port status LEDs ......................19
Chapter 3. Configuring the switch .................21
Establishing a TCP/IP session through the management module ......22
Enabling management through external ports..............23
Accessing the switch through the SSHv2/Telnet interface .........24
Connecting to the switch ....................24
Accessing the main menu ....................24
Accessing the switch through the serial-port interface...........25
Accessing the switch through the switch browser-based interface ......25
Initial configuration .......................26
Logging in to the switch .....................26
Chapter 4. Updating the firmware and licensing ...........27
Determining the level of switch firmware ...............27
Obtaining the latest level of switch firmware ..............27
Upgrading the switch firmware ...................28
Resetting and restarting the switch .................29
Acquiring feature licenses .....................29
© Copyright IBM Corp. 2013 iii
Installing feature licenses .....................30
Chapter 5. Solving problems ...................31
Running POST .........................31
POST errors ..........................31
Chapter 6. Parts listing .....................33
Appendix A. Getting help and technical assistance ..........35
Before you call .........................35
Using the documentation .....................36
Getting help and information from the World Wide Web ..........36
How to send Dynamic System Analysis data to IBM ...........36
Creating a personalized support web page...............36
Software service and support ...................36
Hardware service and support ...................37
IBM Taiwan product service ....................37
Appendix B. Notices ......................39
Trademarks ..........................39
Important notes.........................40
Particulate contamination .....................41
Documentation format ......................42
Telecommunication regulatory statement ...............42
Electronic emission notices ....................42
Federal Communications Commission (FCC) statement .........42
Industry Canada Class A emission compliance statement ........43
Avis de conformité à la réglementation d'Industrie Canada ........43
Australia and New Zealand Class A statement ............43
European Union EMC Directive conformance statement .........43
Germany Class A statement ...................43
Deutschland: Einhaltung des Gesetzes über die elektromagnetische
Verträglichkeit von Geräten .................44
Zulassungsbescheinigung laut dem Deutschen Gesetz über die
elektromagnetische Verträglichkeit von Geräten (EMVG) (bzw. der EMC
EG Richtlinie 2004/108/EG) für Geräte der Klasse A ........44
VCCI Class A statement ....................44
Japan Electronics and Information Technology Industries Association (JEITA)
statement .........................44
Korea Communications Commission (KCC) statement .........45
Russia Electromagnetic Interference (EMI) Class A statement.......45
People's Republic of China Class A electronic emission statement .....45
Taiwan Class A compliance statement ...............45
Index ............................47
iv CN4093 10 Gb Converged Scalable Switch: User's Guide
Safety
Before installing this product, read the Safety Information.
Antes de instalar este produto, leia as Informações de Segurança.
Læs sikkerhedsforskrifterne, før du installerer dette produkt.
Lees voordat u dit product installeert eerst de veiligheidsvoorschriften.
Ennen kuin asennat tämän tuotteen, lue turvaohjeet kohdasta Safety Information.
Avant d'installer ce produit, lisez les consignes de sécurité.
Vor der Installation dieses Produkts die Sicherheitshinweise lesen.
Prima di installare questo prodotto, leggere le Informazioni sulla Sicurezza.
Les sikkerhetsinformasjonen (Safety Information) før du installerer dette produktet.
Antes de instalar este produto, leia as Informações sobre Segurança.
Antes de instalar este producto, lea la información de seguridad.
© Copyright IBM Corp. 2013 v
Läs säkerhetsinformationen innan du installerar den här produkten.
Bu ürünü kurmadan önce güvenlik bilgilerini okuyun.
Safety statements
Important:
Each caution and danger statement in this document is labeled with a
number. This number is used to cross reference an English-language
caution or danger statement with translated versions of the caution or
danger statement in the Safety Information document.
For example, if a caution statement is labeled “Statement 1,”
translations for that caution statement are in the Safety Information
document under “Statement 1.”
Be sure to read all caution and danger statements in this document
before you perform the procedures. Read any additional safety
information that comes with the system or optional device before you
install the device.
vi CN4093 10 Gb Converged Scalable Switch: User's Guide
Statement 1:
DANGER
Electrical current from power, telephone, and communication cables is
hazardous.
To avoid a shock hazard:
v Do not connect or disconnect any cables or perform installation,
maintenance, or reconfiguration of this product during an electrical
storm.
v Connect all power cords to a properly wired and grounded electrical
outlet.
v Connect to properly wired outlets any equipment that will be attached to
this product.
v When possible, use one hand only to connect or disconnect signal
cables.
v Never turn on any equipment when there is evidence of fire, water, or
structural damage.
v Disconnect the attached power cords, telecommunications systems,
networks, and modems before you open the device covers, unless
instructed otherwise in the installation and configuration procedures.
v Connect and disconnect cables as described in the following table when
installing, moving, or opening covers on this product or attached
devices.
To Connect: To Disconnect:
1. Turn everything OFF.
2. First, attach all cables to devices.
3. Attach signal cables to connectors.
4. Attach power cords to outlet.
5. Turn device ON.
1. Turn everything OFF.
2. First, remove power cords from outlet.
3. Remove signal cables from connectors.
4. Remove all cables from devices.
Safety vii
Statement 3:
CAUTION:
When laser products (such as CD-ROMs, DVD drives, fiber optic devices, or
transmitters) are installed, note the following:
v Do not remove the covers. Removing the covers of the laser product could
result in exposure to hazardous laser radiation. There are no serviceable
parts inside the device.
v Use of controls or adjustments or performance of procedures other than
those specified herein might result in hazardous radiation exposure.
DANGER
Some laser products contain an embedded Class 3A or Class 3B laser
diode. Note the following.
Laser radiation when open. Do not stare into the beam, do not view directly
with optical instruments, and avoid direct exposure to the beam.
UL Regulatory Information
This device is for use only with Listed IBM Flex System Enterprise Chassis.
viii CN4093 10 Gb Converged Scalable Switch: User's Guide
Chapter 1. The IBM Flex System Fabric CN4093 10 Gb
Converged Scalable Switch
This User's Guide provides information and instructions for installing, updating the
firmware, and solving problems for an IBM Flex System
Converged Scalable Switch. For information about configuration and management
of the converged switch, see the Command Reference for the IBM Flex System
Fabric CN4093 10 Gb Converged Scalable Switch and the product release notes.
The switch provides support for L2 and L3 switching, Converged Enhanced
Ethernet (PFC, ETS, DCBX), Fibre Channel over Ethernet (FCoE), NPV Gateway
and Full Fabric Fibre Channel Forwarder (FCF).
The base model of this scalable switch provides fourteen internal 10 Gb
Ethernet/FCoE ports, two external 1 Gb or 10 Gb Ethernet/FCoE ports and six
external flexible ports, usable for either 10 Gb Ethernet/FCoE or 4 Gb or 8 Gb Fibre
Channel. With the optional licensing for pay-as-you-grow scalability, you easily and
cost-effectively can enable additional internal 10 Gb Ethernet/FCoE ports, external
10 Gb to 40 Gb Ethernet/FCoE ports and external flexible ports, usable for either 10
Gb Ethernet/FCoE or 4 Gb to 8 Gb Fibre Channel.
v Upgrade 1 - This upgrade feature adds an additional fourteen compute node
ports and two 40 Gb uplink ports (also usable in four 10 Gb mode) to the base
product.
v Upgrade 2 - This upgrade feature adds an additional fourteen compute node
ports and six uplink ports to the base product.
Note: Upgrade 1 and Upgrade 2 are independent and can be installed in any
order, with or without the other.
™
Fabric CN4093 10 Gb
This User's Guide contains information and instructions for installing the switch,
updating the firmware, and solving problems.
For information about the types of compatible devices available for IBM
contact your IBM marketing representative or authorized reseller. For a list of
supported optional devices, see http://www.ibm.com/servers/eserver/serverproven/
compat/us/.
You can obtain up-to-date information about the switch at http://www.ibm.com/
supportportal/.
Notes:
1. The illustrations in this document might differ slightly from your hardware.
2. The screens that are described or referenced in this document might differ
slightly from the screens that are displayed by your system. Screen content
varies according to the type of IBM chassis and the firmware versions and
options that are installed.
Related documentation
This User's Guide contains setup and installation instructions for the switch and
general information about the switch, including how to configure, update, and
troubleshoot the switch, and how to get help. The most recent version of this User's
Guide and all other related documents are at http://publib.boulder.ibm.com/
infocenter/flexsys/information/index.jsp
®
products,
© Copyright IBM Corp. 2013 1
v IBM Flex System Fabric CN4093 10 Gb Converged Scalable Switch Application
Guide
v IBM Flex System Fabric CN4093 10 Gb Converged Scalable Switch Menu-Based
CLI Command Reference
v IBM Flex System Fabric CN4093 10 Gb Converged Scalable Switch
ISCLI—Industry Standard CLI Command Reference
v IBM Flex System Fabric CN4093 10 Gb Converged Scalable Switch BBI Quick
Guide
v IBM Flex System Fabric CN4093 10 Gb Converged Scalable Switch Release
Notes
v IBM Flex System Network Devices Basic Troubleshooting Information for the
switch module
Notices and statements in this document
The caution and danger statements in this document are also in the multilingual
Safety Information document, which is on the IBM Documentation CD. Each
statement is numbered for reference to the corresponding statement in the Safety
Information document.
The following notices and statements are used in this document:
v Note: These notices provide important tips, guidance, or advice.
v Important: These notices provide information or advice that might help you avoid
inconvenient or problem situations.
v Attention: These notices indicate potential damage to programs, devices, or
data. An attention notice is placed just before the instruction or situation in which
damage could occur.
v Caution: These statements indicate situations that can be potentially hazardous
to you. A caution statement is placed just before the description of a potentially
hazardous procedure step or situation.
v Danger: These statements indicate situations that can be potentially lethal or
extremely hazardous to you. A danger statement is placed just before the
description of a potentially lethal or extremely hazardous procedure step or
situation.
Features and specifications
For detailed information about the switch hardware and firmware features,
specifications, and standards, see the switch Application Guide. See the
documentation that came with your IBM chassis for information about the
environmental conditions and specifications that are supported by the system.
Major components of the switch
The switch has the following components:
v Forty-two 10 Gb Ethernet internal ports and twenty-two external ports. External
ports are arranged as two (small form-factor pluggable plus) SFP+ ports, twelve
SFP+ Omni Ports, and two Quad Small Form-Factor Pluggable Plus (QSFP+)
ports.
v Each Omni Port is capable of running in 10 Gb Ethernet or 4 Gb to 8 Gb FC
mode with auto-negotiation capability.
2 CN4093 10 Gb Converged Scalable Switch: User's Guide
v Support for Converged Enhanced Ethernet (CEE) and Fibre Channel over
Ethernet (FCoE) over all Ethernet ports including Omni Ports (in Ethernet mode).
v Support for the Full Fabric FCF (Fibre Channel Forwarder) and NPV gateway.
v Support for full fabric FC services including Name Server, hardware-based
Zoning.
v Support for IBM vNIC (virtual network interface card) Virtual Fabric Adapter with
Single Root I/O Virtualization (SR-IOV) capability.
v The 10 Gb Ethernet switch supports single compute node port capability (14
ports). Dual compute node port capability (28 ports) and triple compute node port
capability (42 ports) are available with optional licenses. See “Acquiring feature
licenses” on page 29 for information on how to upgrade the switch with optional
licenses.
You can manage and configure the switch through the following interfaces:
v A SSHv2/Telnet connection to the embedded command-line interface (CLI)
v A terminal emulation program connection to the serial port interface
v A Web browser-based interface (https/http) connection to the switch
Chapter 1. The IBM Flex System Fabric CN4093 10 Gb Converged Scalable Switch 3
4 CN4093 10 Gb Converged Scalable Switch: User's Guide
Chapter 2. Installing and removing the switch module
This chapter provides instructions for installing and for removing the switch in the
IBM Flex System chassis. See the documentation for your IBM Flex System chassis
for information about I/O bay locations and the components that can be installed in
them that is specific to your IBM Flex System chassis type.
You can install up to four I/O modules in the IBM Flex System chassis, including
Ethernet switches, Fibre Channel switches, Infiniband, and pass-thru modules.
The following illustration shows an example of a IBM Flex System chassis
(rear-view) with the I/O bays identified.
I/O module
bay 1
I/O module
bay 3
I/O module
bay 2
I/O module
bay 4
The IBM Flex System network adapter must be installed in each compute node with
which you want to communicate. To enable the switch to communicate with a
compute node, at least one switch must be installed in the IBM Flex System
chassis. For details about network adapter installation, configuration, and use, see
the documentation that comes with the IBM Flex System network adapter.
Installing a second switch enables a redundant path and a separate connection
from the compute node to the external Ethernet network.
The IBM Flex System chassis supports a maximum of four IBM CN4093 10 Gb
Converged Scalable Switches. The IBM Flex System chassis supports a maximum
of 28 network adapters.
Notes:
v I/O bays 1 and 2 support any standard IBM Flex System switch or pass-thru
module. When you install an I/O network adapter in the left-most fabric connector
on the compute node, these I/O bays support any switch with the same type of
network interface that is used by the corresponding network adapter.
© Copyright IBM Corp. 2013 5
v I/O bays 3 and 4 support any standard IBM Flex System switch or pass-thru
module. When you install an I/O network adapter in the right-most fabric
connector on the compute node, these I/O bays support any switch with the
same type of network interface that is used by the corresponding network
adapter.
v The compute nodes or IBM Flex System chassis that are described or shown in
this document might be different from your compute node or IBM Flex System
chassis. For additional information, see the documentation that comes with your
IBM Flex System chassis.
v When the switch is installed in a IBM Flex System chassis, the internal ports
operate at 10 Gbps. The external ports can operate at 1 Gbps, 4 Gbps, 8 Gbps,
or 10 Gbps, depending on the port configuration and the transceiver module
installed.
Before installing the switch module
Locate and record information about the system interconnect module in the
following table. The labels contain the product name, model number, serial number,
part number and the media access control (MAC) address for the system
interconnect module. After the system interconnect module is installed most of the
labels are hidden from view (located on the bottom and rear of the module) and
require removing the system interconnect module in order to relocate them.
Figure 1. Locating labels
Record this information below and print this page and keep it in a safe place for
possible future reference. You will need this information when you register the
switch module with IBM. You can register the switch module at
http://www.ibm.com/support/mysupport/.
6 CN4093 10 Gb Converged Scalable Switch: User's Guide
Product name IBM Flex System Fabric CN4093 10 Gb Converged Scalable
Model number _____________________________________________
Serial number _____________________________________________
Part number _____________________________________________
Media access control
(MAC) address for switch
MAC addresses for other
components
Installation guidelines
Before you install the switch in the IBM Flex System chassis, read the following
information:
v Read the safety information that begins on page v, “Handling static-sensitive
devices” on page 8, and the safety statements in the IBM Flex System chassis
documentation. This information provides a safe working environment.
v Observe good housekeeping in the area where you are working. Place removed
covers and other parts in a safe place.
v Blue on a component indicates touch points, where you can grip the component
to remove it from or install it in the compute node or IBM Flex System chassis,
open or close a latch, and so on.
v Orange on a component or an orange label on or near a component on the
switch, compute node, or IBM Flex System chassis indicates that the component
can be hot-swapped, which means that if the IBM Flex System chassis and
operating system support hot-swap capability, you can remove or install the
component while the IBM Flex System chassis is running. (Orange can also
indicate touch points on hot-swap components.) See the instructions for removing
or installing a specific hot-swap component for any additional procedures that
you might have to perform before you remove or install the component.
v You do not have to turn off the IBM Flex System chassis to install or replace any
of the hot-swap modules on the front or rear of the IBM Flex System chassis.
v When you install a switch in the IBM Flex System chassis, you must also install a
compatible I/O network adapter in the compute node to support the switch.
v When you are finished working on the compute node or IBM Flex System
chassis, reinstall all safety shields, guards, labels, and ground wires.
v For a list of supported optional devices for the IBM Flex System chassis and
other IBM products, see http://www.ibm.com/servers/eserver/serverproven/
compat/us/.
Switch
_____________________________________________
_____________________________________________
_____________________________________________
_____________________________________________
System reliability guidelines
To help ensure proper cooling, performance, and system reliability, make sure that
the following requirements are met:
v Each of the bays on the rear of the IBM Flex System chassis contains either a
module or a filler module.
v A removed hot-swap module is replaced with an identical module or filler module
within 1 minute of removal.
v A removed hot-swap compute node is replaced with another compute node or
filler node within 1 minute of removal.
Chapter 2. Installing and removing the switch module 7
v The ventilation areas on the sides of the compute node are not blocked.
v You have followed the reliability guidelines in the documentation that comes with
the IBM Flex System chassis.
Cable requirements for the switch are described in the IBM Configuration and
Options Guide at http://www.ibm.com/servers/eserver/xseries/cog/.
Handling static-sensitive devices
Attention: Static electricity can damage the IBM Flex System chassis and other
electronic devices. To avoid damage, keep static-sensitive devices in their
static-protective packages until you are ready to install them.
To reduce the possibility of electrostatic discharge, observe the following
precautions.
v Limit your movement. Movement can cause static electricity to build up around
you.
v Handle the device carefully, holding it by its edges or its frame.
v Do not touch solder joints, pins, or exposed printed circuitry.
v Do not leave the device where others can handle and damage it.
v While the device is still in its static-protective package, touch it to an unpainted
metal surface of the IBM Flex System chassis or an unpainted metal surface on
any other grounded rack component in the rack that you are installing the device
in for at least 2 seconds. This drains static electricity from the package and from
your body.
v Remove the device from its package and install it directly into the IBM Flex
System chassis without setting down the device. If it is necessary to set down
the device, put it back into its static-protective package. Do not place the device
on the IBM Flex System chassis or on a metal surface.
v Take additional care when you handle devices during cold weather. Heating
reduces indoor humidity and increases static electricity.
v Some types of IBM Flex System chassis come with electrostatic discharge (ESD)
connectors. If your unit is equipped with an ESD connector, see the
documentation that comes with the IBM Flex System chassis for using the ESD
connector.
Installing the switch
Note: The following illustration shows how to install a switch in an IBM Flex
System chassis. The appearance of your IBM Flex System chassis might be
different; see the documentation for your IBM Flex System chassis for
additional information.
Use the following instructions to install a switch in the IBM Flex System chassis.
You can install a switch while the IBM Flex System chassis is powered on. For
redundancy support, you must install I/O modules of the same type in I/O bays 1
and 2, and I/O modules of the same type in bays 3 and 4 of the chassis.
To install a switch, complete the following steps.
8 CN4093 10 Gb Converged Scalable Switch: User's Guide
1. Read the safety information that begins on page v and “Installation guidelines”
on page 7.
2. Verify that the switch is compatible with the chassis. For a list of supported
optional devices for the IBM Flex System chassis and other IBM products, see
http://www.ibm.com/servers/eserver/serverproven/compat/us/.
3. Select I/O bay in which to install the switch.
Note: For details about I/O bay requirements and bay locations, see the
documentation for the IBM Flex System chassis.
4. Remove the filler module from the selected bay. Store the filler module for
future use.
5. If you have not already done so, touch the static-protective package that
contains the switch to an unpainted metal surface of the IBM Flex System
chassis or an unpainted metal surface on any other grounded rack-component
for at least 2 seconds.
6. Remove the switch from its static-protective package.
7. Make sure that the release levers on the switch are in the open position
(perpendicular to the switch).
8. Slide the switch into the applicable I/O bay until it stops.
9. Push the release levers on the front of the switch to the closed position. After
you insert and lock the switch, it is turned on, and a power-on self-test (POST)
occurs to verify that the switch is operating correctly. There may be a slight
delay before the switch is powered on.
Note: The switch takes approximately 100 seconds to complete the POST.
10. Make sure that the LEDs on the switch indicate that it is operating correctly
(see “Information LEDs” on page 18).
11. If you have another switch to install, repeat step 4 through step 10; otherwise,
go to the next step.
12. Install the SFP+, QSFP+ modules, or DACs in the switch. For information and
instructions, see “Installing and removing SFP+ and QSFP+ modules and
DACs” on page 11 and the documentation that comes with the cables and
transceivers.
During POST, the Power LED continuously flashes. Once POST has
successfully completed, the Power LED remains on and the Error LED
is off.
Chapter 2. Installing and removing the switch module 9
Loading...