McDATA 4416
Fibre Channel Switch Module
Installation Guide
P/N 59180-00
REV A
Record of Revisions and Updates
Revision Date Description
59180-00 A 01/13/06 Release
Copyright © 2006 McDATA Corporation. All rights reserved.
The software includes technology under a license from QLogic Corporation.
Printed January 2006
First Edition
No part of this publication may be reproduced or distributed in any form or by any means, or stored in a database or
retrieval system, without the prior written consent of McDATA Corporation.
The information contained in this document is subject to change without notice. McDATA Corporation assumes no
responsibility for any errors that may appear.
All computer software programs, including but not limited to microcode, described in this document are furnished
under a license, and may be used or copied only in accordance with the terms of such license.
McDATA either owns or has the right to license the computer software programs described in this document.
McDATA Corporation retains all rights, title and interest in the computer software programs.
McDATA Corporation makes no warranties, expressed or implied, by operation of law or otherwise, relating to this
document, the products or the computer software programs described herein. McDATA CORPORATION DISCLAIMS
ALL IMPLIED WARRANTIES OF MERCHANTIBILITY AND FITNESS FOR A PARTICULAR PURPOSE. In no event
shall McDATA Corporation be liable for (a) incidental, indirect, special, or consequential damages or (b) any damages
whatsoever resulting from the loss of use, data or profits, arising out of this document, even if advised of the possibility
of such damages.
McDATA, the McDATA logo, McDATA Eclipse, Fabricenter, HotCAT, Intrepid, Multi-Capable Storage Network
Solutions, Networking the World's Business Data, nScale, nView, OPENready, SANavigator, SANpilot, SANtegrity,
SANvergence, SecureConnect and Sphereon are trademarks or registered trademarks of McDATA Corporation. OEM
and Reseller logos are the property of such parties and are reprinted with limited use permission. All other trademarks
are the property of their respective companies. All specifications subject to change.
ii
McDATA 4416 Fibre Channel Switch Module Installation Guide
Contents
Preface........................................................................................................................................ xi
Who Should Use this Manual......................................................................... xi
How to Use this Manual.................................................................................. xi
Related Documentation .................................................................................. xii
Chapter 1 General Description
Switch Module Controls and LEDs ............................................................. 1-2
Maintenance Button................................................................................ 1-2
Resetting a Switch ............................................................................ 1-2
Placing the Switch in Maintenance Mode .................................... 1-2
Switch Module LEDs .............................................................................. 1-3
Identifier LED (Green)..................................................................... 1-3
Input Power LED (Green)............................................................... 1-3
System Fault LED (Amber)............................................................. 1-3
Fibre Channel Ports........................................................................................ 1-4
External Port LEDs.................................................................................. 1-5
Port Logged-In LED (Green) .......................................................... 1-5
Port Activity LED (Green) .............................................................. 1-5
Transceivers.............................................................................................. 1-6
Port Types................................................................................................. 1-6
Ethernet Port ................................................................................................... 1-7
Switch Module Management........................................................................ 1-8
McDATA Embedded Web Server.......................................................... 1-8
McDATA Element Manager................................................................... 1-8
Command Line Interface........................................................................ 1-8
Simple Network Management Protocol............................................... 1-8
File Transfer Protocol .............................................................................. 1-8
Chapter 2 Planning
Devices ............................................................................................................. 2-1
Device Access.................................................................................................. 2-2
Soft Zones ................................................................................................. 2-3
Access Control List Hard Zones............................................................ 2-3
Contents
iii
Contents
Performance .................................................................................................... 2-4
Distance..................................................................................................... 2-4
Bandwidth ................................................................................................ 2-5
Latency...................................................................................................... 2-5
Multiple Chassis Fabrics................................................................................ 2-6
Optimizing Device Performance........................................................... 2-6
Domain ID, Principal Priority, and Domain ID Lock......................... 2-6
Switch Module Services................................................................................. 2-7
Fabric Security................................................................................................. 2-9
Connection Security ................................................................................ 2-9
Device Security ...................................................................................... 2-10
User Account Security ...........................................................................2-11
Fabric Management.......................................................................................2-11
Chapter 3 Installation
Site Requirements........................................................................................... 3-1
Fabric Management Workstation.......................................................... 3-1
Environmental Conditions..................................................................... 3-2
Installing a Switch .......................................................................................... 3-2
Install SFP Transceivers .......................................................................... 3-2
Mount the Switch Module in the Server Chassis................................ 3-3
Connect the Management Workstation to the Switch Module......... 3-4
Start McDATA Embedded Web Server or
McDATA Element Manager................................................................... 3-5
Configure the Switch Module ............................................................... 3-6
Cable Devices to the Switch................................................................... 3-7
Install Firmware.............................................................................................. 3-7
Using McDATA Embedded Web Server or McDATA Element
Manager to Install Firmware ................................................................. 3-8
Using the CLI to Install Firmware ........................................................ 3-9
Chapter 4 Troubleshooting
Input Power LED Is Extinguished ............................................................... 4-1
System Fault LED is Illuminated.................................................................. 4-1
Logged-In LED Indications........................................................................... 4-2
E_Port Isolation........................................................................................ 4-2
Excessive Port Errors .............................................................................. 4-4
Recovering a Switch Module ........................................................................ 4-5
Maintenance – Exit.................................................................................. 4-6
Maintenance – Image Unpack ............................................................... 4-6
Maintenance – Reset Network Config.................................................. 4-7
Maintenance – Reset User Accounts to Default.................................. 4-7
Maintenance – Copy Log Files .............................................................. 4-7
Maintenance – Remove Switch Config ................................................ 4-7
Maintenance – Remake Filesystem....................................................... 4-7
Maintenance – Reset Switch .................................................................. 4-7
Maintenance – Update Boot Loader ..................................................... 4-7
Appendix A Specifications
Fabric Specifications...................................................................................... A-1
Maintainability Specifications .....................................................................A-2
iv
McDATA 4416 Fibre Channel Switch Module Installation Guide
Fabric Management Specifications .............................................................A-3
Dimensional Specifications .......................................................................... A-3
Electrical Specifications ................................................................................ A-3
Environmental Specifications ...................................................................... A-4
Regulatory Certifications..............................................................................A-5
Glossary .....................................................................................................................................g-1
Index............................................................................................................................................. i-1
Contents
Contents
v
Contents
Notes
vi
McDATA 4416 Fibre Channel Switch Module Installation Guide
Figures
1-1 McDATA 4416 Switch Module ................................................................................... 1-1
1-2 Switch Module Controls and LEDS ........................................................................... 1-2
1-3 Switch Module LEDs.................................................................................................... 1-3
1-4 Fibre Channel Ports ...................................................................................................... 1-4
1-5 Internal Port/Server Blade Mapping......................................................................... 1-4
1-6 External Port LEDs ....................................................................................................... 1-5
1-7 Ethernet Port.................................................................................................................. 1-7
3-1 Mounting the Switch Module in the Server Chassis ............................................... 3-3
3-2 Ethernet Cable Connections ........................................................................................3-4
4-1 Logged-In LED.............................................................................................................. 4-2
Figures
vii
Figures
Notes
viii
McDATA 4416 Fibre Channel Switch Module Installation Guide
Tables
2-1 Zoning Database Limits............................................................................................... 2-2
2-2 Port-to-Port Latency ..................................................................................................... 2-5
3-1 Workstation Requirements.......................................................................................... 3-1
A-1 Fabric Specifications ....................................................................................................A-1
A-2 Maintainability Specifications.................................................................................... A-2
A-3 Fabric Management Specifications ............................................................................ A-3
A-4 Dimensional Specifications.........................................................................................A-3
A-5 Electrical Specifications ............................................................................................... A-3
A-6 Environmental Specifications.....................................................................................A-4
A-7 Regulatory Certifications ............................................................................................A-5
Ta bl es
ix
Tables
Notes
x
McDATA 4416 Fibre Channel Switch Module Installation Guide
This manual describes the features and installation of the McDATA 4416
switch module, firmware version 5.2.3.
Who Should Use this Manual
This manual introduces users to the switch module and explains its
installation and service. It is intended for users who are responsible for
installing and servicing network equipment.
Preface
How to Use this Manual
This publication is organized as follows:
• Chapter 1 is an overview of the switch module. It describes the ports and
indicator LEDs.
• Chapter 2 describes the factors to consider when planning a fabric.
• Chapter 3 explains how to install and configure the switch.
• Chapter 4 describes the diagnostic methods and troubleshooting
procedures.
• Appendix A lists the switch module specifications.
A glossary and an index are also provided.
Preface
xi
Preface
Related Documentation
Other publications that provide additional information about the McDATA
4416 switch module are:
• McDATA 4416 Product Information Guide, publication number, 59179-00.
• McDATA 4416 Quick Start Guide, publication number 50562-00.
• McDATA Switch Module Management Guide, publication number 59181-00.
• McDATA 4416 Command Line Interface Guide, publication number
59182-00.
• Fibre Channel-Arbitrated Loop (FC-AL-2) Rev. 6.8.
• Fibre Channel-10-bit Interface Rev. 2.3.
• Definitions of Managed Objects for the Fabric Element in Fibre Channel
Standard (draft-ietf-ipfc-fabric-element-mib-04.txt).
The Fibre Channel Standards are available from:
Global Engineering Documents, 15 Inverness Way East, Englewood, CO
80112-5776 Phone: (800) 854-7179 or (303) 397-7956
Fax: (303) 397-2740.
xii
McDATA 4416 Fibre Channel Switch Module Installation Guide
General Description
This section describes the features and capabilities of the McDATA 4416 Fibre
Channel Switch Module in a server blade chassis. The following topics are
described:
• Switch Module Controls and LEDs
• Fibre Channel Ports
• Ethernet Port
1
• Switch Module Management
Fabrics are managed with the McDATA Embedded Web Server™ switch
management application (version 5.02.03) and the Command Line Interface
(CLI). With the Element Manager Product Features Enabled (PFE) key, you
can manage a single switch through EFCM using McDATA Element
Manager™. Refer to the McDATA Switch Module Management Guide for
information about using the McDATA Embedded Web Server application and
McDATA Element Manager. Refer to the McDATA 4416 Command Line
Interface Guide for more information about the command line interface.
Figure 1-1. McDATA 4416 Switch Module
General Description
1-1
Switch Module Controls and LEDs
Switch Module Controls and LEDs
The switch module LEDs provide information about the switch module’s
operational status. These LEDS include the Identifier LED, System Fault LED,
and Input Power LED. The Maintenance button shown in Figure 1-2 is the
only switch module control and is used to reset a switch module or to recover
a disabled switch module.
Maintenance
Button
Figure 1-2. Switch Module Controls and LEDS
Switch Module
LEDS
Maintenance Button
The Maintenance button is a dual-function momentary switch on the front
panel. Its purpose is to reset the switch module or to place the switch module
in maintenance mode. Maintenance mode sets the IP address to 10.0.0.1 and
provides access to the switch module for maintenance purposes when flash
memory or the resident configuration file is corrupted. Refer to “Recovering a
Switch Module” on page 4-5 for more information about using maintenance
mode.
Resetting a Switch
To reset the switch module, use a pointed tool to momentarily press and
release (less than 2 seconds) the Maintenance button. The switch module will
respond as follows:
1. All switch module LEDs will illuminate, then the System Fault LED
extinguishes leaving only the Input Power LED illuminated.
2. After approximately 1 minute, the power-on self test (POST) begins.
3. When the POST is complete, the Input Power LED is illuminated.
Placing the Switch in Maintenance Mode
To place the switch module in maintenance mode, do the following:
1. Isolate the switch module from the fabric.
2. Press and hold the Maintenance button with a pointed tool for 2–4
seconds.
3. After a few seconds, the POST begins illuminating all switch module
LEDs.
4. When the POST is complete, the switch module LEDs extinguish.
To exit maintenance mode and return to normal operation, momentarily press
and release the Maintenance button to reset the switch module.
1-2
McDATA 4416 Fibre Channel Switch Module Installation Guide
Switch Module LEDs
Identifier LED (Green)
Switch Module Controls and LEDs
The switch module LEDs shown in Figure 1-3 provide status information
about switch module operation. Refer to “External Port LEDs” on page 1-5 for
information about port LEDs.
Identifier LED
(Green)
System Fault LED
(Amber)
Input Power LED
(Green)
Figure 1-3. Switch Module LEDs
The Identifier LED identifies a specific switch module through the server
blade interface.
Input Power LED (Green)
System Fault LED (Amber)
The Input Power LED indicates the voltage status at the switch module logic
circuitry. During normal operation, this LED illuminates to indicate that the
switch module logic circuitry is receiving the proper DC voltages. When the
switch module is in maintenance mode, this LED is extinguished.
The System Fault LED illuminates to indicate an over temperature condition
or a Power on Self Test (POST) error.
General Description
1-3
Fibre Channel Ports
Fibre Channel Ports
The switch module has 6 external Fibre Channel ports through which to
connect to devices or other switches and 10 internal ports connecting to the
server midplane. Each of the external Fibre Channel ports is served by a Small
Form-Factor Pluggable (SFP) optical transceiver and is capable of 1-Gbps,
2-Gbps, or 4-Gbps transmission. SFPs are hot-pluggable. External ports can
self-discover both the port type and transmission speed when connected to
public devices or other switches. The internal ports operate at 1-Gbps or
2-Gbps.
The external ports are named Ext10, Ext11, Ext12, Ext13, Ext14, and Ext15 and
are numbered 10–15 as shown in Figure 1-4. The external port LEDs are
located to the left their respective ports and provide port login and activity
status information.
14 15
10 11
Figure 1-4. Fibre Channel Ports
12 13
Internal ports are named Int0–Int9 and numbered 0–9. The port numbers 0–9
correspond to server blades 1–10 as shown in Figure 1-5.
Server Blades
123456
78910
0123456789
Switch Module Ports
10 11
Figure 1-5. Internal Port/Server Blade Mapping
12 13 14
15
NOTE: The switch module comes from the factory as a 12-port switch, enabling
external ports 10–13 and internal ports 0–7 . You can upgrade the switch module to
enable the remaining external ports (14, 15) and internal ports (8, 9) through the
purchase of the Port Activation PFE key. Refer to the McDATA Switch Module
Management Guide for information about installing a PFE key. For additional McDATA
PFE keys, please contact your McDATA representative or visit the web site at
www.mcdata.com.
1-4
McDATA 4416 Fibre Channel Switch Module Installation Guide
External Port LEDs
Fibre Channel Ports
Each external port has its own Logged-In LED (L) and Activity LED (A) as
shown in Figure 1-6.
Logged-In
LED (Green)
Activity LED
(Green)
Port Logged-In LED (Green)
Port Activity LED (Green)
14 15
10
Figure 1-6. External Port LEDs
11
12 13
The Logged-in LED indicates the logged-in or initialization status of the
connected devices. After successful completion of the POST, the switch
module extinguishes all Logged-In LEDs. Following a successful loop
initialization or port login, the switch module illuminates the corresponding
logged-in LED. This shows that the port is properly connected and able to
communicate with its attached devices. The Logged-In LED remains
illuminated as long as the port is initialized or logged in. If the port
connection is broken or an error occurs that disables the port, the Logged-In
LED will flash. Refer to “Logged-In LED Indications” on page 4-2 for more
information about the Logged-In LED.
The Activity LED indicates that data is passing through the port. Each frame
that the port transmits or receives causes this LED to illuminate for 50
milliseconds. This makes it possible to observe the transmission of a single
frame. When extending credits, the Activity LED for a donor port will reflect
the traffic of the recipient port. Refer to “Distance” on page 2-4 for more
information about extended credits and donor ports.
General Description
1-5
Fibre Channel Ports
Transceivers
Port Types
Switch modules support SFP optical transceivers for the Fibre Channel ports.
A transceiver converts electrical signals to and from optical laser signals to
transmit and receive data. Duplex fiber optic cables plug into the transceivers
which then connect to the devices. A Fibre Channel port is capable of
transmitting at 1-Gbps, 2-Gbps, or 4-Gbps; however, the transceiver must also
be capable of delivering at these rates.
The SFP transceivers are hot pluggable. This means that you can remove or
install a transceiver while the switch module is operating without harming
the switch module or the transceiver. However, communication with the
connected device will be interrupted. Refer to “Install SFP Transceivers” on
page 3-2 for information about installing and removing SFP optical
transceivers.
Switch modules support generic ports (G_Port, GL_Port), fabric ports
(F_Port, FL_Port), and expansion ports (E_Port). Switch modules come from
the factory with internal ports configured as FL_Ports and external ports
configured as GL_Ports. Generic, fabric, and expansion ports function as
follows:
• A GL_Port self-configures as an FL_Port when connected to a public loop
device, as an F_Port when connected to a single public device, or as an
E_Port when connected to another switch. If the device is a single device
on a loop, the GL_Port will attempt to configure first as an F_Port, then if
that fails, as an FL_Port.
• A G_Port self-configures as an F_Port when connected to a single public
device, or as an E_Port when connected to another switch.
• An FL_Port supports a loop of up to 126 public devices. An FL_Port can
also configure itself during the fabric login process as an F_Port when
connected to a single public device (N_Port).
• An F_Port supports a single public device.
E_Ports enable you to expand the fabric by connecting switch modules with
other switches. Switch modules self-discover all inter-switch connections.
Refer to “Multiple Chassis Fabrics” on page 2-6 for more information about
multiple chassis fabrics. Refer to the McDATA Switch Module Management
Guide for information about defining port types.
1-6
McDATA 4416 Fibre Channel Switch Module Installation Guide
Ethernet Port
Ethernet Port
The Ethernet port shown in Figure 1-7 is an RJ-45 connector that provides a
connection to a management workstation through a 10/100 Base-T Ethernet
cable. A management workstation can be a Windows® or a Linux®
workstation that is used to configure and manage the switch fabric. The
switch through which the fabric is managed is called the fabric management
switch. You can manage the switch module over an Ethernet connection with
the following management tools:
• McDATA Embedded Web Server
• McDATA Element Manager through EFCM
• Command Line Interface (CLI)
• Simple Network Management Protocol (SNMP)
The Ethernet port has two LEDs: the Link Status LED (green) and the Activity
LED (green). The Link Status LED illuminates continuously when an Ethernet
connection has been established. The Activity LED illuminates when data is
being transmitted or received over the Ethernet connection.
Activity LED
(Green)
Figure 1-7. Ethernet Port
Link Status LED
(Green)
RJ-45 Ethernet Port
General Description
1-7
Switch Module Management
Switch Module Management
The switch supports the following management tools:
• McDATA Embedded Web Server
• McDATA Element Manager
• Command Line Interface
• Simple Network Management Protocol
• File Transfer Protocol
McDATA Embedded Web Server
McDATA Embedded Web Server is a graphical user interface that provides
both fabric and switch module management functions. Because McDATA
Embedded Web Server resides in the switch firmware, no installation is
needed. You can run one instance of the McDATA Embedded Web Server at a
time by opening the switch IP address with an internet browser. Refer to the
McDATA Switch Module Management Guide for information about the
McDATA Embedded Web Server.
McDATA Element Manager
McDATA Element Manager is a subset of the McDATA Embedded Web
Server and enables you to manage a single switch through EFCM. To open
McDATA Element Manager through EFCM, you must install the Element
Manager (PFE) key on the switch module. For information about McDATA
Element Manager and its capabilities, refer to the McDATA Switch Module
Management Guide.
Command Line Interface
The command line interface (CLI) provides monitoring and configuration
functions by which the administrator can manage the fabric and its switches.
The CLI is accessible over an Ethernet connection. Refer to McDATA 4416
Command Line Interface Guide for more information.
Simple Network Management Protocol
SNMP provides monitoring and trap functions for the fabric. The switch
module firmware supports SNMP versions 1 and 2, the Fibre Alliance
Management Information Base (FA-MIB) version 4.0, and the Fabric Element
Management Information Base (FE-MIB) RFC 2837. Traps can be formatted
using SNMP version 1 or 2.
File Transfer Protocol
FTP provides the command line interface for exchanging files between the
switch module and the management workstation. These files include
firmware image files, configuration files, and log files. Refer to the McDATA
4416 Command Line Interface Guide for an example of using FTP to transfer
configuration backup files.
1-8
McDATA 4416 Fibre Channel Switch Module Installation Guide
Loading...