IBM F16, TotalStorage SAN 2109 F16 User Manual

IBM TotalStorage SAN Switch

2109 Model F16 User’ s Guide



Read Before Using

This product contains software that is licensed under written license agreements. Your use of such software is subject to the license agreements under which they are provided.

GC26-7439-03

IBM TotalStorage SAN Switch

2109 Model F 16 User’ s Gu ide



GC26-7439-03

Note:

Before using this information and the product it supports, read the general information under “Safety and environmental notices” on page xi and “Notices” on page 79.

Fourth Edition (May 2003)

This edition replaces GC26-7439-02.

US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

Contents

Figures ...........................vii

Tables ............................ix

Safety and environmental notices .................xi

Safety notices .........................xi

Removing ac power .......................xi

External machine checks .....................xii

Safety label checks .......................xii

AC grounding ........................xiii

Environmental notices and statements ................xiii

Laser safety .........................xiii

Fire suppression systems ....................xiii

Product recycling .......................xiv

About this document ......................xv

Who should read this document...................xv

Additional information ......................xv

2109 Model F16 library .....................xv

Related documents ......................xv

Web sites ..........................xvi

Getting help .........................xvi

Getting software updates ....................xvi

How to send your comments ..................xvii

Chapter 1. Introduction ......................1

Product overview ........................1

Hardware components ......................2

CPU subsystem ........................3

Ports ............................7

Enclosure ..........................8

Power supply .........................8

LEDs ............................9

Software components ......................10

Firmware ..........................10

|| ||

|| || || || || || ||

Features and functions .....................10

Optional licensed features ....................11

Managing the 2109 Model F16 ...................12

Diagnostics ..........................12

Diagnostic environment .....................12

Hardware support .......................13

Diagnostic coverage ......................13

Chapter 2. Operating the 2109 Model F16 ..............15

Turning on and off the 2109 Model F16 ................15

Interpreting LED activity .....................15

LEDs on the front panel ....................16

LEDs on the back panel ....................18

Interpreting POST ........................19

Maintaining the switch ......................20

Appendix A. Standards and protocol compliance ...........21

Standards...........................21

Protocol compliance .......................21

Support for Fibre Channel ports..................21

Fibre Channel class operation ..................21

Auto-configuration .......................21

In-order delivery .......................22

Flexibility of fabric topology and operation ..............22

Appendix B. Interoperability, reliability, serviceability, and specifications 23

Interoperability .........................23

Switch interoperability .....................23

Host bus adapter interoperability .................23

Reliability and serviceability ....................23

Reliability ..........................23

Serviceability ........................24

Specifications .........................24

Appendix C. Safety certifications and regulatory compliance ......27

Safety ............................27

EMI/EMC ...........................27

Immunity ..........................28

Appendix D. Translated safety notices ...............29

Arabic ............................30

Brazilian-Portuguese .......................32

Chinese, simplified .......................34

Chinese, traditional .......................36

Croatian ...........................38

Czech ............................40

Danish ............................42

Dutch ............................44

Finnish ............................46

French ............................48

German ...........................50

Greek ............................52

Hebrew............................54

Hungarian...........................56

Italian ............................58

Japanese ...........................60

Korean ............................62

Macedonian ..........................64

Portuguese ..........................66

Russian ...........................68

Slovak ............................70

Slovenian ...........................72

Spanish ...........................74

Swedish ...........................76

Notices ...........................79

Trademarks ..........................80

Electronic emission statements ...................80

Federal Communications Commission (FCC) statement .........80

Industry Canada compliance statement ...............80

Chinese Class A warning statement ................80

European Community compliance statement .............81

Germany compliance statement..................81

Japanese Voluntary Control Council for Interference (VCCI) class 1 statement 82

iv IBM TotalStorage SAN Switch: 2109 Model F16 User’s Guide

Korean Government Ministry of Communication (MOC) statement .....82

Taiwan class A compliance statement ...............82

Glossary ...........................83

Index ............................95

Contents v

vi IBM TotalStorage SAN Switch: 2109 Model F16 User’s Guide

Figures

1. Safety label on the 2109 Model F16 ........................xii

2. Linecord caution label .............................xiii

3. 2109 Model F16 ...............................1

4. Simplified 2109 Model F16 CPU subsystem block diagram ................4

5. Front panel of the 2109 Model F16 ........................9

6. Back panel of the 2109 Model F16 ........................10

7. Front panel LEDs ..............................16

8. Back panel LEDs...............................18

viii IBM TotalStorage SAN Switch: 2109 Model F16 User’s Guide

Tables

1. Brocade and IBM product and model number matrix..................xvi

2. Power supply requirements ...........................9

3. Front panel LED patterns during normal (non-POST) operation ..............17

4. Back panel LED patterns during normal (non-POST) operation ..............18

5. Performance, physical, environmental, and power specifications for the 2109 Model F16 switch 25

x IBM TotalStorage SAN Switch: 2109 Model F16 User’s Guide

Safety and environmental notices

This section contains information about:

v Safety notices that this document uses

v Safety inspection for this product

v Environmental guidelines for this product

Safety notices

Safety notices are printed throughout this document.

v A Danger notice warns you of conditions or procedures that can result in death or

severe personal injury.

v A Caution notice warns you of conditions or procedures that can cause personal

injury that is neither lethal nor extremely hazardous.

v An Attention notice warns you of conditions or procedures that can cause

damage to machines, equipment, or programs.

See Appendix D, “Translated safety notices”, on page 29 for translations of Danger notices and Caution notices. The notices are listed in numeric order based on their IDs, which are displayed in parentheses at the end of each notice. See the following examples of Danger notices and Caution notices for the location of the ID numbers.

DANGER

An electrical outlet that is not correctly wired could place a hazardous voltage on the metal parts of the system or the products that attach to the system. It is the customer’s responsibility to ensure that the outlet is correctly wired and grounded to prevent an electrical shock. (1)

CAUTION: This unit may have two linecords. To remove all power, disconnect both linecords. (1)

PSU1 PSU2

Removing ac power

Perform the following steps to remove the alternating current (ac) power:

1. Perform a controlled system shutdown.

2. Set the power switch on the 2109 Model F16 to the off position.

3. Disconnect the power cable from the power source.

> 240

PN 18P4036

SJ000325

External machine checks

Perform the following external machine checks:

1. Verify that all external covers are present and are not damaged.

2. Ensure that all latches and hinges are in correct operating condition.

3. If the 2109 Model F16 is not installed in a rack cabinet, check for loose or broken feet.

4. Check the power cable for damage.

5. Check the external signal cable for damage.

6. Check the cover for sharp edges, damage, or alterations that expose the internal parts of the device.

Safety label checks

Perform the following safety label checks:

1. Verify that the safety label that Figure 1 shows is installed on the 2109 Model F16.

Marca Registrada

Type: 2109 Model: F16

100–240

2,5

kVA

0,25

47-63

This machine is manufactured from new parts, or new and used parts.

3882I054

Registered Trademark of International

Business Machines Corporation IBM Canada Ltd. Registered User

Assembled in the US of US and Non–US Components for International Business Machines Corporation Armonk, NY

This device complies with part 15 of FCC rules. Operation is subject to the following two conditions: (1) this device may not cause harmful interference, and (2) this device must accept any interference received, including interference that may cause undesired operation.

Canada ICES/NMB-003 Class/Classe A

VCCI-A

LISTED I.T.E. 88Y4

E176896

TÜV

Rheinland

ProductSafety

geprüfte Sicherheit

LR110877

P/N 18P3688

SJ000297

Figure 1. Safety label on the 2109 Model F16

2. Verify that the linecord safety label that Figure 2 on page xiii shows is installed on the power supply of the 2109 Model F16.

CAUTION: This unit may have two linecords. To remove all power, disconnect both linecords. (1)

xii IBM TotalStorage SAN Switch: 2109 Model F16 User’s Guide

PSU1 PSU2

> 240

Figure 2. Linecord caution label

AC grounding

DANGER

Environmental notices and statements

This section describes the environmental notices and statements.

Laser safety

PN 18P4036

SJ000325

CAUTION:

In the United States use only GBIC units or Fibre-Optic products that comply with FDA radiation performance standards, 21 CFR Subchapter J. Internationally use only GBIC units or Fibre-Optic products that comply with IEC standard 825-1. Optical products that do not comply with these standards may produce light that is hazardous to the eyes.

This unit might contain a single-mode or a multimode transceiver Class 1 laser product. The transceiver complies with IEC 825-1 and FDA 21 CFR 1040.10 and

1040.11. The transceiver must be operated under the recommended operating conditions.

This equipment contains Class 1 laser products and complies with FDA radiation Performance Standards, 21 CFR Subchapter J and the international laser safety standard IEC 825-2.

Usage restrictions

You must terminate the optical ports of the modules with an optical connector or with a dust plug.

Fire suppression systems

A fire suppression system is the responsibility of the customer. The customer’s own insurance underwriter, local fire marshal, or a local building inspector, or both,

SJ000327

Safety and environmental notices xiii

should be consulted in selecting a fire suppression system that provides the correct level of coverage and protection. IBM designs and manufactures equipment to internal and external standards that require certain environments for reliable operation. Because IBM does not test any equipment for compatibility with fire suppression systems, IBM does not make compatibility claims of any kind nor does IBM provide recommendations on fire suppression systems.

Product recycling

This unit contains recyclable materials. You should recycle these materials where processing sites are available and according to local regulations. In some areas, IBM provides a product take-back program that ensures proper handling of the product. Contact your IBM representative for more information.

xiv IBM TotalStorage SAN Switch: 2109 Model F16 User’s Guide

About this document

This document introduces the IBM®TotalStorage™SAN Switch 2109 Model F16 (hereafter referred to as the 2109 Model F16).

Who should read this document

This document is intended for network and system administrators whose responsibilities include administration and management of a storage area network.

Before you use this document, you should know how to service the switch hardware, including how to analyze, isolate, report, and resolve problems. You must also know how to safely work with electrical components. Throughout this document, the term switch applies to the IBM 2109 Model F16 switch.

Additional information

This section contains the following information:

v A list of the documents in the 2109 Model F16 library

v A list of related documents

v A list of related Web sites

v Instructions on how to get help

v Instructions on how to get software updates

v Information about how to send your comments

2109 Model F16 library

The following documents contain information related to this product:

v IBM TotalStorage SAN Switch 2109 Model F16 Installation and Service Guide,

SY27-7623

v IBM TotalStorage SAN Switch 2109 Model F16 User’s Guide, GC26-7439 (this

document)

Related documents

You can find additional information related to the software for the 2109 Model F16 in the following documents:

v Brocade Advanced Performance Monitoring User’s Guide

v Brocade Advanced Web Tools User’s Guide

v Brocade Advanced Zoning User’s Guide

v Brocade Diagnostic and System Error Message Reference

v Brocade Distributed Fabric User’s Guide

v Brocade Fabric Manager User’s Guide

v Brocade Fabric OS Procedures Guide

v Brocade Fabric OS Reference

v Brocade Fabric Watch User’s Guide

v Brocade ISL Trunking User’s Guide

v Brocade Secure Fabric OS Procedures Guide

v Brocade MIB Reference

v Building and Scaling Brocade SAN Fabrics: Design and Best Practices Guide

Web sites

When you use any of the Brocade documents, you will notice that the model numbers reflect the original Brocade switches. Table 1 provides a product matrix for you to use to correlate the Brocade model numbers to the IBM product and model numbers.

Table 1. Brocade and IBM product and model number matrix

Brocade model number IBM product and model number

2010 3534 Model 1RU

2400 2109 Model S08

2800 2109 Model S16

3200 3534 Model F08

3800 2109 Model F16

3900 2109 Model F32

12000 2109 Model M12

To get specific details about models and firmware that the switch supports, see the following Web site:

www.ibm.com/storage/fcswitch/

Getting help

| |

For detailed information about the Fibre Channel standards, see the Fibre Channel Association Web site at:

www.fibrechannel.com/

For a directory of worldwide contact information, including technical support, see the following Web site:

www.ibm.com/contact/

Contact your switch supplier for technical support. This includes hardware support, all product repairs, and ordering of spare components.

Be prepared to provide the following information to the support personnel:

v The switch serial number

v The switch worldwide name

v The topology configuration v Any output from the supportShow Telnet command

v A detailed description of the problem

v Any troubleshooting steps that have already been performed

Getting software updates

xvi IBM TotalStorage SAN Switch: 2109 Model F16 User’s Guide

Contact your system vendor for software updates and maintenance releases.

For utility programs to facilitate loading firmware, sample Fabric Watch configurations, and management information base (MIB) files for switch management by Simple Network Management Protocol (SNMP), see the following Web site:

www.storage.ibm.com/ibmsan/products/sanfabric.htm

How to send your comments

Your feedback is important to help us provide the highest quality of information. If you have any comments about this document, you can submit them in one of the following ways:

v E-mail

Submit your comments electronically to:

starpubs@us.ibm.com

Be sure to include the name and order number of the document and, if applicable, the specific location of the text that you are commenting on, such as a page number or table number.

v Mail or fax

Fill out the Readers’ Comments form (RCF) at the back of this document and return it by mail or fax (1-800-426-6209) or give it to an IBM representative. If the RCF has been removed, you can address your comments to:

International Business Machines Corporation RCF Processing Department Dept. M86/Bldg. 050-3 5600 Cottle Road San Jose, CA 95193-0001 U.S.A.

About this document xvii

xviii IBM TotalStorage SAN Switch: 2109 Model F16 User’s Guide

Chapter 1. Introduction

This chapter describes the TotalStorage SAN Switch 2109 Model F16, hereafter referred to as the 2109 Model F16. It provides the following information:

v “Product overview”

v “Hardware components” on page 2

v “Software components” on page 10

v “Diagnostics” on page 12

v “Managing the 2109 Model F16” on page 12

Product overview

Figure 3 shows the 2109 Model F16.

SJ000309

Figure 3. 2109 Model F16

The 2109 Model F16 is a 16-port, dual speed, auto-sensing Fibre Channel switch. It delivers the next generation of performance and functionality for Storage Area Networks (SANs). As the first product in the new 2109 Model F16 series, the 2109 Model F16 is functionally compatible and interoperable with the current 2109 series of switches and the 3534 switch. The 2109 Model F16 is an enterprise class switch that is designed to handle the large scale SAN requirements of an enterprise. You can also use it to address the SAN requirements of a small to medium-sized workgroup. Providing 16 ANSI Fibre Channel compliant ports (E_ports, FL_ports, and F_ports), the 2109 Model F16 is a flexible switching platform that meets both low-latency and high-throughput demands. Based on Application Specific Integrated Circuit (ASIC) technology (called the Bloom), the 2109 Model F16 provides high levels of reliability, availability, and port density. The 2109 Model F16 provides Fibre Channel throughput at twice the previous speeds. It also has new features that enhance the manageability and performance of the switch.

The 2109 Model F16 switch provides the following features:

v 16 nonblocking ports that provide full-duplex, throughput bandwidth at either

1.0625 Gbps or 2.125 Gbps

v Fibre Channel auto-sensing ports that self-negotiate to the highest speed that is

supported by the attached devices

v Universal ports that self-configure as fabric ports (F_ports), fabric loop ports

(FL_ports), or expansion ports (E_ports)

v Trunking, which allows you to group up to four ports to create high-performance

8 Gbps inter-switch link (ISLs) between switches

v Hardware zoning that permits or denies delivery of frames to any particular

destination port address

v Frame filtering, which augments the hardware zoning capabilities of the

second-generation ASIC. The second-generation ASIC implements hardware zoning at the port level of the switch. The expanded capabilities of the third-generation ASICs include world wide name (WWN), device-level zoning, protocol-level zoning, and logical unit number (LUN)-level zoning to provide the flexibility of second generation software zoning with the enhanced security of hardware zoning.

Note: You will need Fabric OS version 3.1 for protocol-level and LUN-level

zoning support.

v Phantom loop addressing that allows private 8-bit loop addresses to be treated

as equivalent to public loop addresses

v Support for unicast, multicast (up to 256 groups), and broadcast data traffic types

v Extensive diagnostics, system-monitoring capabilities, and dual redundant,

hot-swappable power supplies and cooling units that provide high reliability, availability, and serviceability

v A single system board design with a 100 MHz 80960VH reduced instruction-set

computer (RISC) central processing unit (CPU) with integrated peripherals that provide high performance

v Small form-factor pluggable (SFP) media that supports short wavelength (SWL)

optical, and long wavelength (LWL) optical

v Fabric Operating System (OS) that delivers distributed intelligence throughout the

network and enables a wide range of applications

v A flexible topology that allows the interconnection of up to 239 switches to create

a medium to large Fibre Channel fabric. The topology can change dynamically as you add new switches or links to the fabric or as your needs change.

v Central memory architecture that maximizes switch throughput, guarantees full

transmit and receive bandwidth to all Fibre Channel ports at all times, and enables a number of sophisticated queuing, messaging, and buffer pool management schemes to optimize switch performance characteristics in heavily loaded systems

v Cut-through frame routing that minimizes port-to-port latency

Hardware components

The 2109 Model F16 system board is a single-board design with a highly integrated CPU. The Intel®80960VH CPU is a RISC core processor and is the top choice for this platform. It provides over 70% of the functionality for the digital section of the system board. The system uses three types of memory devices: DRAM, Flash File, and Boot Flash. On the Fibre Channel section of the system board, the Bloom

2 IBM TotalStorage SAN Switch: 2109 Model F16 User’s Guide

CPU subsystem

ASICs, the Serializer/Deserializer (SERDES), and the SFP media are the key components that provide high-speed data transfer. SFP media interfaces support SWL and LWL.

The system chassis is a 1U height enclosure with space for two power supply units and one system board. The system board is placed in an Electromagnetic Interference (EMI) enclosure tray as an EMI-proof system unit. Two 126-watt removable, redundant power supplies provide hot-swappable capability. Cooling fans are mounted in the rear to provide airflow for system cooling.

An Intel 80960VH CPU is used for switch initialization and management functions. The CPU runs the Fabric OS and is responsible for switch initialization, configuration, and management. IBM-designed ASICs provide the switching functionality.

The following peripherals are also supported:

v An Ethernet port

v A serial port

v Three digital thermometers

v A real-time clock

v Two power supply controls

v General input/output (I/O)

The CPU subsystem is a mixed voltage system using 1.8 V, 2.5 V, 3.3 V, and 5 V, depending on the device. The maximum board power consumption is 78 W.

Features

The 2109 Model F16 CPU subsystem includes the following features:

v A 80960VH-100 MHz CPU

v An SDRAM controller with parity check at 33 MHz

v A peripheral control interconnect (PCI) bus arbiter

v An on-board SDRAM with data parity to support a 16 MB configuration

v One PLCC32 Boot Flash socket to support up to 512 KB of Flash memory

v 8 MB (2 x 4 MB) Flash memory for software storage

v 10BASE-T or 100BASE-T port for management connection with RJ45 connector

v One RS232 port with DB9 connector

v 16 light emitting diodes (LEDs) to indicate the status for each port

v 16 LEDs to indicate the link speed for each port

v One LED (green) to indicate the system power-on status

v Three digital thermometers for temperature sensing

v Two analog switches to control the power supply inter-integrated circuit (I2C) bus

access

v One 3.3 V to 1.8 V dc/dc converter for Bloom ASIC core supply

v Two Bloom ASICs supporting up to 16 nonblocking ports

v 16 SERDES

v One real-time clock with a battery and 56 bytes of nonvolatile RAM (NVRAM)

Chapter 1. Introduction 3

Electronics

Figure 4 shows a simplified block diagram of the 2109 Model F16 CPU subsystem electronics.

Ser/ Des

SFF

Ser/ Des

SFF

I/O Port

Clock

Temp

Sensor

Power

Supply

Control

Ser/ Des

SFF

I C Bus (100 KHz)

E/F/FL_Port ASIC 0 (ports 0-7)

Ser/

Des

SFF

PCI Bus (33 MHz)

Ser/

Des

SFF

80960VH CPU

SSLT2 Bus (106.25 MHz)

Ser/

Ser/ Des

Des

SFF

Ser/ Des

Des

SFF

Des

SFF

Local Bus (33 MHz)

E/F/FL_port ASIC 1 (ports 8-15)

Ser/

Ser/ Des

Des

SFF

Ser/ Des

Des

SFF

Ser/

Ser/ Des

Des

SFF

Ser/

Ser/ Des

Des

SFF

RS232 Port

User Flash

Boot Flash

SDRAM

Ethernet

MAC/PHY

Ser/

Ser/ Des

Des

SFF

Ser/

Ser/ Des

Des

SFF

SJ000310

Figure 4. Simplified 2109 Model F16 CPU subsystem block diagram

Embedded processor

The embedded processor is an Intel 80960VH processor with a clock speed of 100 MHz. It contains the following features:

v A high-performance RISC processor core (compatible with the 2109 series of

switches and the 3534 switch)

v An integrated EDO memory controller (for DRAM, SRAM, ROM, and Flash

memory)

v A PCI bus interface

v A complex programmable logic device (CPLD) for SDRAM control

v Two direct memory access (DMA) channels

v An I2C interface

v General purpose I/O

You access system memory through the local bus. The external CPLD SDRAM device provides SDRAM controller functionality at 33 MHz. It supports parity checking to enhance the data integrity of the system. The CPU communicates with the ASIC and the 10BASE-T or 100BASE-T Ethernet media access controller (MAC) through the PCI interface. An external PCI bus arbiter enables the Ethernet device to be a bus master.

You can also access the RS232 Universal Asynchronous Receiver Transmitter (UART) serial port through the local bus. Other I/O peripherals, such as the real-time clock, the two power supply controls, the LEDs, the three digital

4 IBM TotalStorage SAN Switch: 2109 Model F16 User’s Guide

thermometers, and miscellaneous I/O are handled by the I2C bus of the CPU. The CPU is the only I2C bus master in the system. The RS232 port and drivers, Ethernet MAC/PHY, and LEDs are external components to the CPU. An RJ45 connector provides Ethernet connection to external systems. The DB9 RS232 is a ribbon-cable connection through the on-board 10-pin header.

Bus operations

The interface between the embedded processor, the ASICs, and the 10BASE-T or 100BASE-T Ethernet MAC is implemented by using a PCI bus. All PCI devices on the bus are PCI Revision 2.2 compliant. The PCI bus interface operates at 32-bit, up to 33 MHz and has a worldwide even parity bit. A slave-only PCI interface is provided by each ASIC to allow the processor to program various registers, routing tables, and so on within the chip. An external PCI bus arbiter enables the Ethernet device to be a bus master.

The local bus, a 32-bit multiplexed burst bus, provides the interface between the system memory and the I/O. Because the integrated EDO memory controller on the CPU allows only direct control for DRAM, SRAM, ROM, and Flash memory, the external CPLD controller is included to provide SDRAM controller functionality.

The I2C bus provides peripheral I/O control for the LEDs, the thermometers, and general I/O functions. The 80960VH CPU serves as the master on the I2C bus.

Each Bloom ASIC is an eight-port Fibre Channel switch controller. There are two Bloom ASICs to support up to 16 ports. The communication between ASICs is over a proprietary 10-bit wide SSTL2 bus running at 106.25 MHz. An SSTL2 bus is also used between the Bloom ASICs and the SERDES.

Memory

The system design uses three types of memory devices:

v DRAM

v Flash File

v Boot Flash

Two on-board SDRAM chips provide up to 16 MB for system memory. Two additional SDRAM chips provide data parity. The printed circuit board (PCB) SDRAM footprint is designed to be compatible with 64 MB, 128 MB, and 256 MB devices. An external CPLD device added to the local bus provides control functions for the 80960VH processor.

The system provides 4 MB of on-board redundant Flash File memory for software and data storage. The Boot Flash is an 8-bit Flash device socket that is used only for system start. The Boot Flash device contains a block area for startup code protection. The PLCC32 socket supports 3.3 V Boot Flash memory up to 512 KB.

Central memory: As with the 2019 series of switches and the 3534 switch, the 2109 Model F16 is based on a central memory architecture. In this architecture, a set of buffers in the central memory is assigned to each port to be used for receipt of frames. As an ASIC port receives and validates a frame, it stores the frame in one of its receive buffers in the central memory and forwards a routing request (a Put message) to the appropriate destination ports. When a destination port is capable of transmitting the frame, it reads the frame contents from central memory and forwards the frame to its transmit interface. It does not wait for the frame to be written in memory, unless the port is busy. After it removes an entry for a frame from its internal transmit queue in preparation for transmitting a frame, the

Chapter 1. Introduction 5

destination port sends a transmission complete message (a Finish message) to the port that received the frame. This method allows the receiving port to reuse the buffer for subsequent frames received.

The central memory is also incorporated into the ASICs. Frames received on the ports in an ASIC are written into the portion of central memory in the receiving chip. Received frames cannot be written into the sections of central memory located in other ASICs. All transmitters in a 2109 Model F16 switch can read from the memories in any of the ASICs, through inter-chip connections clocked at 106.25 MHz.

Each ASIC contains RAM devices plus data path crossbar logic that is used to implement the central memory. Memory blocks are accessed in a time-sliced fashion. The buffer pool can be split into 2112-byte buffers or into 312-byte mini-buffers. If frames that need to be buffered are smaller than the maximum 2112 bytes, using mini-buffers effectively expands the buffer pool and increases the efficiency of memory usage by providing more (but smaller) receive buffers.

Additionally, the Bloom ASIC provides a special memory interface (SMI). The SMI provides the firmware with a mechanism to read and write frame contents to and from the ASIC. It also supports higher throughput transfers. The SMI includes a set of two buffers that are large enough for an entire maximum-sized frame to be transferred in a single operation. Additionally, because two buffers are available, the firmware can perform a read or write on a frame in one of the buffers while the ASIC streams another frame into the other buffer.

ASICs

Two ASICs within the system provide the switching functionality. Each ASIC provides eight Fibre Channel ports that you can use to connect to external node ports (N_ports) (as an F_port), external loop devices (as an FL_port), or to other 3534 or 2109 series boxes (as an E_port).

Each port can operate at either 1.0625 Gbps or 2.125 Gbps link speeds. The ASIC contains the Fibre Channel interface logic, message and buffer queuing logic, receive buffer memory for the eight on-chip ports, and other support logic.

The Bloom ASICs are PCI slaves to the CPU. The two ASICs interface through an inter-chip 10-bit SSLT2 bus connection clocked at 106.25 MHz. A 16-channel SERDES is used to support 16 ports. The interface between ASIC and SERDES is also a 10-bit SSTL2 bus running at 106.25 MHz. The SERDES converts the 10-bit wide parallel data from the SSTL2 bus into high-speed serial data for the SFP media and vice versa. The SERDES supports single data rate (SDR) or double data rate (DDR) transfer between the SERDES and the SFP media. The DDR operation supports 2.125 Gbps data transfer rate between ASICs. Implementing the SERDES external to the ASIC reduces the risk of silicon packaging as well as the risk of running 2.125 Gbps signals on a board with a long trace length.

The SFP media interfaces to external devices and enables support for shortwave laser and longwave laser. Two LEDs for each port provide port status and link speed information.

Control Message Interface: The 2109 Model F16 Control Message Interface (CMI) consists of a set of control signals that are used to pass hardware-level messages between ports. Recipient ports use these control signals to inform transmitting ports when a new frame needs to be added to the output queue of the transmitter. Transmitting ports also use the CMI to inform recipient ports that a

6 IBM TotalStorage SAN Switch: 2109 Model F16 User’s Guide

Ports

frame transmission has completed. A recipient port is free to reuse a receive buffer when it receives notification that the frame was transmitted. In the case of multicast, multiple notifications are required to determine when a receive buffer is freed.

The CMI interfaces for the ASICs are connected inside each ASIC through a message crossbar, implementing a barrel shift message scheme. Each chip time slices its output port to each possible destination chip in the switch. If it has a message to send to a particular destination during the corresponding time slot, the chip uses the time slot to send the message. Otherwise, the output port lines are driven to indicate that no message is present.

The time slicing of the output CMI control signals of the ASICs are arranged out of phase from each other so that each chip’s output port is time sliced to a different destination chip in any given clock cycle. Messages that display at the input control signal interface of a given ASIC are also time sliced through each possible source chip in the switch.

The 2109 Model F16 supports the following port types:

v Optical ports

v Ethernet port

v Serial port

Each ASIC in the 2109 Model F16 switch connects up to eight SFP media. SFP devices are encased in metal to ensure low emissions and high thermal management. They are hot-swappable and use industry-standard local channel connectors. Each port provides ISL, loop, and fabric (E, F, and FL respectively) type connectivity that the 2109 Model F16 senses automatically. It requires no administration to identify the port type.

Optical ports

For optical ports, the 2109 Model F16 uses SFP fiber-optic transceivers that convert electrical signals to optical signals (and optical signals to electrical signals).

Each SFP fiber-optic transceiver is capable of transmitting at both 1 and 2 Gbps speeds and supports:

v 850 nm SWL on multimode fiber-optic cable

v 1310 nm LWL on single-mode fiber-optic cable

v 1550 nm ELWL 5 on single-mode fiber-optic cable

These miniature optical transceivers provide high port density and deliver twice the port density of standard removable GBIC transceivers.

Ethernet port

The 2109 Model F16 provides a fully IEEE-compliant 10BASE-T or 100BASE-T Ethernet port for switch management console interface. When a device is connected to the port, both ends negotiate to determine the optimal speed. The Ethernet port uses an RJ45 connector. Two LEDs are for the port. One LED indicates transmit and receive activity and the other LED indicates speed (10 Mbps or 100 Mbps). You can configure the TCP/IP address for the port from the serial port.

Serial port

The 2109 Model F16 provides an RS232 serial port. The serial port uses a DB9 connector. The connector is a header pin block on the system board. The

Chapter 1. Introduction 7

Enclosure

parameters of the serial port are fixed at 9600 baud, 8 data bits, no parity, no hardware flow control, 1 start and 1 stop bit.

Use this connector to configure the Internet protocol (IP) address and to recover the factory default settings of the switch should Flash memory contents be lost. You should not use the serial port connection to perform normal administration or maintenance functions. Accessible functions are limited to connecting a terminal to the port to reinitialize the switch defaults, which restores the switch to its factory configuration. This is required to restore the switch passwords to a known state and to allow customers to set a specific switch IP address.

The 2109 Model F16 enclosure is designed so that you can mount it in a 19-inch rack, with a height of 1 RETMA unit (1µ). But you can also use it in a tabletop configuration. The enclosure houses dual-redundant power supplies, dual-redundant fan assemblies, and a system board that supports the two ASICs and the CPU.

The 2109 Model F16 enclosure has forced-air cooling. The fans push the air from the rear chassis intake through the enclosure and exhaust the air through venting holes in the front panel. The SFP media, the cooling fan, and the power supplies are hot-swappable so that they can be removed and replaced without interrupting the system power.

The top panel of the 2109 Model F16 enclosure can be removed without tools, allowing access to the system board. The enclosure design provides for simple assembly of the system board into the enclosure, allowing for ease of manufacture and maintenance. All pieces of the product are modular. You can perform all maintenance without special tools.

Power supply

On the front of the unit, there are two port connections (an RS232 connection and an RJ45 connection). The RJ45 connection provides a 10BASE-T or 100BASE-T Ethernet port for a full system management console interface. The RS232 connection provides a serial port interface for setting the IP address of the switch and for resetting the switch to factory defaults.

The fibre-optic cables, Ethernet cables, and serial port cables are located on the front of the switch. AC power input cables, power supplies, and cooling modules are inserted and removed from the rear of the switch.

The 2109 Model F16 power supply is a hot-swappable switching unit, allowing 1+1 redundant configurations. The unit is a universal power supply capable of functioning worldwide without voltage jumpers or switches. The fully enclosed, self-contained unit has its own internal fans to provide cooling. It is auto-ranging in terms of accommodating input voltages. The power supply has three dc outputs (3.3 V, 5 V, and 12 V) that provide a total output power of 126 maximum usable watts. The power supplies plug directly into the enclosure from the rear of the unit, mating to internal blind connectors that connect both the dc outputs and the interface signals to the system backplane. The power supply provides an integral on/off switch, input filter, and power indicator.

8 IBM TotalStorage SAN Switch: 2109 Model F16 User’s Guide

LEDs

| |

Table 2 lists the power supply requirements.

Table 2. Power supply requirements

Specification Value

Total power 126 watts delivered over temperature range

Input voltage 100 - 240 V ac, auto range

Input line frequency 47 - 63 Hz

Inrush current 10 Amps peak > 300 microseconds (hot or

cold start)

Harmonic distortion Active power factor correction per

IEC1000-3-2

Input line protection Fused in both hot and neutral lines

Maximum dimensions 8.255 cm (3.25 in.) wide, 3.81 cm (1.5 in.)

high, and 36.83 cm (14.5 in.) deep

Redundancy Dual supplies 1+1 redundant-hot-pluggable,

active current share

This section describes the LEDs located on front and back panels of the 2109 Model F16.

| |

Front panel

Figure 5 shows the front panel of the 2109 Model F16 switch. The front panel provides access to the serial port, Ethernet port, and the fiber optic ports, and shows the corresponding port LED and the power LED.

Switch Status LED

Serial Port

Port Status LED (16X)

Figure 5. Front panel of the 2109 Model F16

| | |

| | | |

The ports on the front panel are color-coded in groups (four blue ports alternate with four blue outlined ports) to indicate which ports you can use in the same ISL Trunking group.

Note: ISL Trunking is a feature that enables traffic to be evenly distributed across

the links between two adjacent switches while preserving in-order delivery. It is managed through the software. For more information, see the Brocade ISL Trunking User’s Guide.

Port Speed LED (16X)

Optical Port (16X)

Ethernet Port

SJ000151

| |

Back panel

Figure 6 on page 10 shows the back panel of the 2109 Model F16 switch. The back panel provides access to the fan trays and the power supplies, and shows the

Chapter 1. Introduction 9

| | |

status LED. Each power supply also has an LED that indicates the status of that power supply. The power supplies, fan trays, chassis, and system board are all field replaceable units (FRUs).

| |

Figure 6. Back panel of the 2109 Model F16

Software components

This section briefly describes the software components of the 2109 Model F16.

Power Supply LED (2X)

A/C Power Switch (2X)

Power Supply (2X)

System Board LED

Fan Tray Assembly (2X)

Spring Latch (2X)

SJ000152

Firmware

| | | |

| |

Features and functions

| |

| | |

The 2109 Model F16 switch is supported by Fabric OS version 3.0 or later.

The Fabric OS is implemented in firmware and manages the operation of the 2109 Model F16 switch. The firmware is designed to make a switch easy to install, to use, and to manage. You can view the firmware as a set of applications that run on top of a proprietary real-time operating system. The Fabric OS is made up of the following two major software components:

v Firmware that initializes and manages the switch hardware

v Diagnostics that perform component self-testing algorithms for fault isolation

during the manufacturing process and in customer installations

For information about Fabric OS, see Brocade Fabric OS Procedures Guide, and Brocade Fabric OS Reference.

The software that supports the 2109 F16 includes these features and functions.

Secure Fabric OS

The Fabric OS supports the Secure Fabric OS, which includes security features that you can use with other security tools (Advanced Security feature) to implement increased security in your SAN. For more information, see the Brocade Secure

Fabric OS User’s Guide

| |

| | |

Web Tools

Web Tools provides a graphical user interface (GUI) that enables you to monitor and manage entire fabrics and individual switches and ports from a standard workstation. For more information, see the Brocade Advanced Web Tools User’s Guide.

10 IBM TotalStorage SAN Switch: 2109 Model F16 User’s Guide

+ 93 hidden pages

IBM F16, TotalStorage SAN 2109 F16 User Manual

Specifications and Main Features

Frequently Asked Questions

User Manual