IBM SAN06B-R Installation, Service And User Manual

IBM System Storage SAN06B-R



Installation, Service, and User Guide

Serviceinformation:2498/R06

Read Before Using

This product contains software that is licensed under written license agreements. Your use of such software is subject to the license agreements under which they are provided.

GC27-2270-02

IBM System Storage SAN06B-R



Installation, Service, and User Guide

Serviceinformation:2498/R06

GC27-2270-02

Note:

Before using this information and the product it supports, read the information in “Notices” on page 47.

The following paragraph does not apply to any country (or region) where such provisions are inconsistent with local law.

INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION “AS IS” WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states (or regions) do not allow disclaimer of express or implied warranties in certain transactions; therefore, this statement may not apply to you.

US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

Read this first

Summary of changes

| | | | |

| |

Getting help

This is the third edition of the IBM System Storage SAN06B-R Installation, Service, and User Guide. The content changes since the last edition of this publication are

noted by a vertical line placed in the left margin beside each change. Minor edits are not identified by this mark. A summary of the changes for each edition are listed below.

Third edition

The following changes were made in the third edition: v Addition of information regarding the need for clean optics with higher

transmission speeds.

v Addition of information for link troubleshooting v Other minor content updates

Second edition

The following changes were made in the second edition:

v Additional optional FICON Accelerator feature v Additional optional Server Application Optimization (SAO) feature v Minimum Fabric Operating System (FOS) was changed to 6.4.

For the latest version of your product documentation, visit the web at www.ibm.com/shop/publications/order. Search by form number or title.

For more information about IBM www.ibm.com/servers/storage/san/

IBM Redbooks configurations, and more technical information. For redbooks associated with this product, enter search terms on the following Web site: www.redbooks.ibm.com/.

For support information for this and other IBM products, see the IBM Support Portal, www.ibm.com/supportportal. Search for the product Machine type or product name.

For Fabric OS Release Notes and access to Fabric OS firmware downloads, go to the IBM Support Portal, www.ibm.com/supportportal. Search for the product Machine type or product name, and then follow links for Downloads. More detailed instructions are available through the Accessing firmware updates and OS documentation updates link on the product documentation CD that is shipped with this product.

You can also contact IBM within the United States at 1-800-IBMSERV (1-800-426-7378). For support outside the United States, you can find the service number at: www.ibm.com/planetwide/.

often provide in depth information about product best practices,

SAN products, see the following Web site:

Visit www.ibm.com/contact for the contact information for your country or region.

For detailed information about the Fibre Channel standards, see the Fibre Channel Industry Association (FCIA) Web site at: www.fibrechannel.org/

For information about storage industry standards, see the Storage Networking Industry Association (SNIA) Web site at: www.snia.org/

Taiwan Contact Information

IBM Taiwan Product Service Contact Info: IBM Taiwan Corporation 3F, No 7, Song Ren Rd., Taipei Taiwan Tel: 0800-016-888

Accessibility features for the SAN06B-R

Accessibility features help users with restricted mobility or limited vision successfully use information technology products. IBM strives to provide products with usable access for everyone, regardless of age or ability. This product uses standard Windows navigation keys.

Accessibility features

The following list includes the major accessibility features in this product: v Light emitting diodes (LEDs) that flash at different rates, to represent the same

information as the colors of the LEDs

v Industry-standard devices for ports and connectors v Management of the product through management applications is available

through Web and Graphical User Interface (GUI) options

Keyboard navigation

This product does not have an attached or integrated keyboard. Any keyboard navigation is provided through the management software and GUI. This product uses standard Microsoft Windows navigation keys. You can navigate the software and the product documentation from the keyboard by using the shortcut keys for your browser or screen-reader software. See your browser or screen-reader software Help for a list of shortcut keys that it supports.

Vendor software

This product includes certain vendor software that is not covered under the IBM license agreement. IBM makes no representation about the accessibility features of these products. Contact the vendor for the accessibility information about its products.

Related accessibility information

You can view the publications for this product in Adobe Portable Document Format (PDF) using the Adobe Acrobat Reader. The PDFs are provided on a

iv SAN06B-R Installation, Service, and User Guide

product documentation CD-ROM that is packaged with the product. The CD-ROM also includes an accessible HTML version of this document.

IBM and accessibility

See the IBM Human Ability and Accessibility Center web site at www.ibm.com/able/ for more information about the commitment that IBM has to accessibility.

How to send your comments

Your feedback is important in helping us provide the most accurate and high-quality information. If you have comments or suggestions for improving this document, send us your comments by email to starpubs@us.ibm.com. Be sure to include the following information:

v Exact publication title v Form number (for example, GC27-2270-00) v Page numbers to which you are referring

You can also mail your comments to:

International Business Machines Corporation Information Development Department GZW 9000 South Rita Road Tucson, Arizona 85744-0001 U.S.A.

When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you.

Read this first v

vi SAN06B-R Installation, Service, and User Guide

Contents

Read this first ............iii

Summary of changes ...........iii

Third edition .............iii

Second edition ............iii

Getting help ..............iii

Taiwan Contact Information ........iv

Accessibility features for the SAN06B-R .....iv

Accessibility features ..........iv

Keyboard navigation ..........iv

Vendor software ............iv

Related accessibility information ......iv

IBM and accessibility ..........v

How to send your comments .........v

Figures ...............ix

Tables ...............xi

Safety and environmental notices . . . xiii

Safety notices and labels..........xiii

Danger notices ............xiii

Caution notices ............xvi

Safety labels ............xviii

Attention notices ...........xviii

Rack safety ..............xix

Rack installation ...........xix

Rack relocation (19" rack).........xx

Product recycling and disposal........xxi

About this document ........xxiii

Product documents ...........xxiii

Brocade documents ...........xxiii

IBM and Brocade product matrix .....xxiv

Chapter 1. Introducing the SAN06B-R . . 1

SAN06B-R features ............2

Available licenses .............3

Port side of the switch ...........3

Nonport side of the switch .........4

SAN06B-R management ..........5

Chapter 2. Installing and configuring the

SAN06B-R ..............7

Items included with the switch ........7

Installation and safety considerations ......8

Setting up the switch as a standalone unit ....8

Installing in an EIA cabinet .........9

Time required .............9

Items required .............9

Installation instructions ..........9

Cabling and setting up the switch .......14

Planning for cable management ......15

Items required for setup .........15

Setting up the switch ..........15

Setting the switch date and time ......19

Configuring FCIP and Fibre Channel routing

services...............20

Installing SFPs ............21

Connecting cables ...........21

Verifying correct operation of the switch....22

Backing up the configuration .......23

Managing license keys (optional) .......23

Viewing current license keys........24

Adding a license key ..........24

Removing a license key .........24

Chapter 3. Operating the SAN06B-R . . 25

LED activity ..............25

LEDs on the port side of the switch .....25

LEDs on the nonport side of the switch ....29

Interpreting POST results ..........30

Diagnostics and troubleshooting .......31

Diagnostic tests ............31

CRU status .............31

Powering off the switch .........34

Removing the battery ..........34

Appendix A. Product specifications . . 37

Summary of switch components .......37

Weight and physical dimensions .......37

Power supply .............38

Environmental requirements.........38

Data transmission ranges ..........39

Memory specifications ...........40

Port specifications ............40

Fibre Channel port specifications ......40

GbE port specifications .........40

Serial port specifications .........40

Parts list (CRUs) .............41

Appendix B. Link troubleshooting . . . 43

Fault isolation .............43

Dust, dirt, or other contaminants .......44

Best practices for minimizing link loss .....44

Attenuation on LWL connections .......45

Best Practice for LWL connections – Optically

engineer a long-distance connection .....45

2G LWL SFP maximum receive power ....45

Notices ..............47

Trademarks ..............49

Electronic emission notices .........50

Federal Communications Commission (FCC)

Class A Statement ...........50

Industry Canada Class A Emission Compliance

Statement ..............50

Avis de conformité à la réglementation

d'Industrie Canada ...........50

European Union EMC Directive Conformance

Statement ..............50

Germany Electromagnetic Compatibility Directive 51 People's Republic of China Class A Electronic

Emission Statement ...........52

Japan VCCI Council Class A Statement ....52

Japan Electronics and Information Technology Industries Association (JEITA) Statement . . . 52

Korea Communications Commission (KCC)

Statement ..............52

Russia Electromagnetic Interference (EMI) Class

A Statement .............53

Australia and New Zealand Class A Statement 53

Index ...............55

viii

SAN06B-R Installation, Service, and User Guide

Figures

1. Port side view ............3

2. Port numbering ...........4

3. Nonport side of the switch ........4

4. Rack assembly ...........10

5. Separating the inner and outer rails. ....11

6. Mounting the moving portion of the slide and

mounting brackets to the switch .....12

7. Mounting the fixed portion of the rail and the

locking brackets to the rack .......13

8. Inserting slides into the rack rails .....14

9. LEDs on port side ..........26

10. Nonport side components ........29

11. Power supply/fan locations .......32

12. Orientation of the power supply and fan

assembly .............33

13. Location of battery holder........35

14. Identifying the origin of failure ......43

x SAN06B-R Installation, Service, and User Guide

Tables

1. Sample caution notices ........xvi

2. Brocade and IBM product and model

number matrix ...........xxiv

3. Feature comparison - base model and with the

upgrade license ...........2

4. Management options ..........5

5. Parts supplied with the rack-mount kit 10

6. tsTimeZone command parameter values 20

7. Power status LED patterns .......27

8. System status LED patterns .......27

9. Management port LED patterns......27

10. FC port status LED patterns .......28

11. GbE optical port status LED patterns ....28

12. GBE copper port status LED patterns ....29

13. Power supply/fan status LED patterns 30

14. Switch dimensions ..........37

15. Power supply specifications .......38

16. Environmental requirements .......38

17. Fibre channel data transmission ranges by

cable type and port speed........39

18. Gigabit Ethernet data transmission ranges 39

19. Copper cabling and RJ-45 data transmission

ranges ..............39

20. Serial cable pinouts ..........40

21. CRU part numbers ..........41

22. Specifications of LWL 10km transceivers 45

23. Maximum receive power of 2 Gbps LWL SFPs 46

xii SAN06B-R Installation, Service, and User Guide

Safety and environmental notices

This section contains information about:

v “Safety notices and labels” v “Rack safety” on page xix v “Product recycling and disposal” on page xxi

Safety notices and labels

When using this product, observe the danger, caution, and attention notices contained in this guide. The notices are accompanied by symbols that represent the severity of the safety condition. The danger and caution notices are listed in numerical order based on their IDs, which are displayed in parentheses, for example (D004), at the end of each notice. Use this ID to locate the translation of these danger and caution notices in the safety notices publication that is shipped with this product.

The following notices and statements are used in IBM documents. They are listed below in order of increasing severity of potential hazards. Follow the links for more detailed descriptions and examples of the danger, caution, and attention notices in the sections that follow.

v Note: These notices provide important tips, guidance, or advice. v “Attention notices” on page xviii: These notices indicate potential damage to

programs, devices, or data.

v “Caution notices” on page xvi: These statements indicate situations that can be

potentially hazardous to you.

v “Danger notices”: These statements indicate situations that can be potentially

lethal or extremely hazardous to you. Safety labels are also attached directly to products to warn of these situations.

v In addition to these notices, “Safety labels” on page xviii may be attached to the

product to warn of potential hazards.

Danger notices

A danger notice calls attention to a situation that is potentially lethal or extremely hazardous to people. A lightning bolt symbol accompanies a danger notice to represent a dangerous electrical condition. Read and comply with the following danger notices before installing or servicing this device.

DANGER

To prevent a possible shock from touching two surfaces with different protective ground (earth), use one hand, when possible, to connect or disconnect signal cables. (D001)

DANGER

Overloading a branch circuit is potentially a fire hazard and a shock hazard under certain conditions. To avoid these hazards, ensure that your system electrical requirements do not exceed branch circuit protection requirements. Refer to the information that is provided with your device or the power rating label for electrical specifications. (D002)

DANGER

If the receptacle has a metal shell, do not touch the shell until you have completed the voltage and grounding checks. Improper wiring or grounding could place dangerous voltage on the metal shell. If any of the conditions are not as described, STOP. Ensure the improper voltage or impedance conditions are corrected before proceeding. (D003)

DANGER

An electrical outlet that is not correctly wired could place hazardous voltage on metal parts of the system or the devices that attach to the system. It is the responsibility of the customer to ensure that the outlet is correctly wired and grounded to prevent an electrical shock. (D004)

The following general electrical danger notice provides instructions on how to avoid shock hazards when servicing equipment. Unless instructed otherwise, follow the procedures in the following danger notice.

xiv SAN06B-R Installation, Service, and User Guide

DANGER

When working on or around the system, observe the following precautions:

Electrical voltage and current from power, telephone, and communication cables are hazardous. To avoid a shock hazard:

v Connect power to this unit only with the IBM provided power

cord. Do not use the IBM provided power cord for any other product.

v Do not open or service any power supply assembly.

v Do not connect or disconnect any cables or perform installation,

maintenance, or reconfiguration of this product during an electrical storm.

v The product might be equipped with multiple power cords. To

remove all hazardous voltages, disconnect all power cords.

v Connect all power cords to a properly wired and grounded

electrical outlet. Ensure that the outlet supplies proper voltage and phase rotation according to the system rating plate.

v Connect any equipment that will be attached to this product to

properly wired outlets.

v When possible, use one hand only to connect or disconnect

signal cables.

v Never turn on any equipment when there is evidence of fire,

water, or structural damage.

v Disconnect the attached power cords, telecommunications

systems, networks, and modems before you open the device covers, unless instructed otherwise in the installation and configuration procedures.

v Connect and disconnect cables as described below when

installing, moving, or opening covers on this product or attached devices.

To disconnect:

1. Turn off everything (unless instructed otherwise).

2. Remove the power cords from the outlets.

3. Remove the signal cables from the connectors.

4. Remove all cables from the devices.

To connect:

1. Turn off everything (unless instructed otherwise).

2. Attach all cables to the devices.

3. Attach the signal cables to the connectors.

4. Attach the power cords to the outlets.

5. Turn on the devices.

(D005)

Safety and environmental notices xv

Caution notices

A caution notice calls attention to a situation that is potentially hazardous to people because of some existing condition. A caution notice can be accompanied by different symbols, as in the examples below:

Table 1. Sample caution notices

If the symbol is... It means...

18-32 kg (39.7-70.5 lbs)

P/N 18P5850-B

SJ000752

svc00167

A hazardous electrical condition with less severity than electrical danger.

A generally hazardous condition not represented by other safety symbols.

A specification of product weight that requires safe lifting practices. The weight range of the product is listed below the graphic, and the graphic and the wording of the caution varies, depending on the weight of the device.

A potential hazard of pinching the hand or other body parts between parts.

A hazardous condition due to moving parts nearby.

A hazardous condition due to the use of a laser in the product. Laser symbols are always accompanied by the classification of the laser as defined by the U. S. Department of Health and Human Services (for example, Class I, Class II, and so forth).

Read and comply with the following caution notices before installing or servicing this device.

CAUTION: Energy hazard present. Shorting may result in system outage and possible physical injury. Remove all metallic jewelry before servicing. (C001)

CAUTION: The battery contains lithium. To avoid possible explosion, do not burn or charge the battery. Do not: v Throw or immerse into water v Heat to more than 100°C (212°F) v Repair or disassemble Exchange only with the IBM-approved part. Recycle or discard the battery as instructed by local regulations. In the United States, IBM has a process for the collection of this battery. For information, call 1-800-426-4333. Have the IBM part number for the battery unit available when you call. (C003)

xvi SAN06B-R Installation, Service, and User Guide

CAUTION: This part or unit is heavy but has a weight smaller than 18 kg (39.7 lb). Use care when lifting, removing, or installing this part or unit. (C008)

CAUTION: The system contains circuit cards, assemblies, or both that contain lead solder. To avoid the release of lead (Pb) into the environment, do not burn. Discard the circuit card as instructed by local regulations. (C014)

CAUTION: This product is equipped with a 3-wire (two conductors and ground) power cable and plug. Use this power cable with a properly grounded electrical outlet to avoid electrical shock. (C018)

CAUTION: This product might contain one or more of the following devices: CD-ROM drive, DVD-ROM drive, DVD-RAM drive, or laser module, which are Class 1 laser products. Note the following information:

v Do not remove the covers. Removing the covers of the laser product

could result in exposure to hazardous laser radiation. There are no serviceable parts inside the device.

v Use of the controls or adjustments or performance of procedures

other than those specified herein might result in hazardous radiation exposure.

(C026)

CAUTION: The power-control button on the device does not turn off the electrical current supplied to the device. The device might also have more than one connection to dc power. To remove all electrical current from the device, ensure that all connections to dc power are disconnected at the dc power input terminals. (C031)

Safety and environmental notices xvii

Safety labels

As an added precaution, safety labels are often installed directly on products or product components to warn of potential hazards. These can be either danger or caution notices, depending upon the level of the hazard.

The actual product safety labels may differ from these sample safety labels:

DANGER

Hazardous voltage, current, or energy levels are present inside any component that has this label attached. Do not open any cover or barrier that contains this label. (L001)

DANGER

Rack-mounted devices are not to be used as a shelf or work space. (L002)

DANGER

Multiple power cords. The product might be equipped with multiple power cords. To remove all hazardous voltages, disconnect all power cords. (L003)

Attention notices

An attention notice indicates the possibility of damage to a program, device, or system, or to data. An exclamation point symbol may accompany an attention notice, but is not required. A sample attention notice follows:

Attention: Do not bend a fibre cable to a radius less than 5 cm (2 in.); you can damage the cable. Tie wraps are not recommended for optical cables because they can be easily overtightened, causing damage to the cable.

DANGER

Hazardous voltage present. Voltages present constitute a shock hazard, which can cause severe injury or death. (L004)

xviii SAN06B-R Installation, Service, and User Guide

Rack safety

Rack installation

DANGER

Observe the following precautions when working on or around your IT rack system:

v Heavy equipment—personal injury or equipment damage might result if

mishandled.

v Always lower the leveling pads on the rack cabinet.

v Always install stabilizer brackets on the rack cabinet.

v To avoid hazardous conditions due to uneven mechanical loading, always install the

heaviest devices in the bottom of the rack cabinet. Always install servers and optional devices starting from the bottom of the rack cabinet.

v Rack-mounted devices are not to be used as shelves or work spaces. Do not place

objects on top of rack-mounted devices.

v Each rack cabinet might have more than one power cord. Be sure to disconnect all

power cords in the rack cabinet when directed to disconnect power during servicing.

v Connect all devices installed in a rack cabinet to power devices installed in the

same rack cabinet. Do not plug a power cord from a device installed in one rack cabinet into a power device installed in a different rack cabinet.

v An electrical outlet that is not correctly wired could place hazardous voltage on the

metal parts of the system or the devices that attach to the system. It is the responsibility of the customer to ensure that the outlet is correctly wired and grounded to prevent an electrical shock.

(R001 part 1 of 2) CAUTION:

v Do not install a unit in a rack where the internal rack ambient temperatures will

exceed the manufacturer ’s recommended ambient temperature for all your rack-mounted devices.

v Do not install a unit in a rack where the air flow is compromised. Ensure that air flow

is not blocked or reduced on any side, front, or back of a unit used for air flow through the unit.

v Consideration should be given to the connection of the equipment to the supply circuit

so that overloading of the circuits does not compromise the supply wiring or overcurrent protection. To provide the correct power connection to a rack, refer to the rating labels located on the equipment in the rack to determine the total power requirement of the supply circuit.

v (For sliding drawers) Do not pull out or install any drawer or feature if the rack stabilizer

brackets are not attached to the rack. Do not pull out more than one drawer at a time. The rack might become unstable if you pull out more than one drawer at a time.

v (For fixed drawers) This drawer is a fixed drawer and must not be moved for servicing

unless specified by the manufacturer. Attempting to move the drawer partially or completely out of the rack might cause the rack to become unstable or cause the drawer to fall out of the rack.

(R001 part 2 of 2)

Safety and environmental notices xix

Rack relocation (19" rack)

CAUTION: Removing components from the upper positions in the rack cabinet improves rack stability during relocation. Follow these general guidelines whenever you relocate a populated rack cabinet within a room or building:

v Reduce the weight of the rack cabinet by removing equipment starting at the

top of the rack cabinet. When possible, restore the rack cabinet to the configuration of the rack cabinet as you received it. If this configuration is not known, you must do the following:

– Remove all devices in the 32U position and above.

– Ensure that the heaviest devices are installed in the bottom of the rack

cabinet.

– Ensure that there are no empty U-levels between devices installed in the

rack cabinet below the 32U level.

– If the rack cabinet you are relocating is part of a suite of rack cabinets,

detach the rack cabinet from the suite.

– Inspect the route that you plan to take when moving the rack to eliminate

potential hazards.

– Verify that the route that you choose can support the weight of the loaded

rack cabinet. Refer to the documentation that came with your rack cabinet for the weight of a loaded rack cabinet.

– Verify that all door openings are at least 760 x 2030 mm (30 x 80 in.).

– Ensure that all devices, shelves, drawers, doors, and cables are secure.

– Ensure that the four leveling pads are raised to their highest position.

– Ensure that there is no stabilizer bracket installed on the rack cabinet

during movement.

– Do not use a ramp inclined at more than 10 degrees.

– Once the rack cabinet is in the new location, do the following:

- Lower the four leveling pads.

- Install stabilizer brackets on the rack cabinet.

- If you removed any devices from the rack cabinet, repopulate the rack cabinet from the lowest position to the highest position.

– If a long distance relocation is required, restore the rack cabinet to the

configuration of the rack cabinet as you received it. Pack the rack cabinet in the original packaging material, or equivalent. Also, lower the leveling pads to raise the casters off of the pallet and bolt the rack cabinet to the pallet.

(R002)

xx SAN06B-R Installation, Service, and User Guide

Product recycling and disposal

Refer to the IBM Systems Environmental Notices and User Guide (Z125-5823) for translated environmental statements and information regarding product recycling and disposal. This document may be provided either in printed version or on the product documentation CD. See “Removing the battery” on page 34 for instructions on how to remove the battery.

Safety and environmental notices xxi

xxii SAN06B-R Installation, Service, and User Guide

About this document

This document is intended for use by systems administrators and technicians experienced with networking, Fibre Channel, and storage area network (SAN) technologies. It describes how to install, service, and use the IBM System Storage SAN06B-R (machine type 2498, model R06). Throughout this document, the product is referred to as the SAN06B-R extension switch, or simply the switch.

This document has been created to include information specific to SAN06B-R

| |

switches running on Fabric OS Fabric OS version 7.1.1 and later. For information about a Fabric OS version other than 7.1.1, refer to the documentation specific to your Fabric OS version.

Note: 7.0.0c is the latest FICON supported release.

Product documents

The following documents contain information related to this product. The documentation may be printed material or may be on the documentation CD that is shipped with the product. Newer versions of product documentation may be available through the IBM Publications Center Web site www.ibm.com/shop/ publications/order. Search by publication title or publication number. Newer versions may also be available through the IBM Support Portal www.ibm.com/supportportal. Enter your product machine type (2498) or product name in the search field, and then select Documentation from the displayed page.

v IBM System Storage SAN06B-R Installation, Service, and User Guide, GC27-2270

v Safety Notices v IBM Environmental Notices and User Guide, Z125-5823 v IBM System Storage SAN06B-R Quick Start Guide, GC27-2271

Brocade documents

IBM b-type switches use software licensed from Brocade Communications Systems, Inc. You can find information related to the software that supports the director in the following documents on the CD-ROM supplied with this product:

(this document)

Brocade Fabric OS

v Fabric OS Administrator's Guide

v Fabric OS Command Reference

v Fabric OS MIB Reference Manual

v Fabric OS Message Reference Manual

v Fabric OS Troubleshooting and Diagnostics Guide

v Fabric OS Fibre Channel over IP Administrator's Guide

v EZSwitchSetup Administrator's Guide

v FICON

Brocade Fabric OS optional features

v Fabric Watch Administrator's Guide

Administrator's Guide

v Web Tools Administrator's Guide

IBM and Brocade product matrix

When you use any of the Brocade documents, such as Fabric Operating System (FOS) publications, you will notice that the model numbers reflect the corresponding Brocade products. Table 2 provides a product matrix for you to use to correlate the Brocade products and models to the IBM product names and machine types and model numbers. Products withdrawn from marketing are not listed.

Table 2. Brocade and IBM product and model number matrix

Brocade product name IBM product name

Brocade 6520 SAN96B-5 2498 Models F96 and N96

Brocade 6505 SAN24B-5 2498 Model F24, 249824G

Brocade 6510 SAN48B-5 2498 Model F48

Brocade DCX 8510-4 SAN384B-2 2499 Model 416

Brocade DCX 8510-8 SAN768B-2 2499 Model 816

Brocade DCX-4S SAN384B 2499 Model 192

Brocade DCX SAN768B 2499 Model 384

Brocade Encryption Switch SAN32B-E4 2498 Model E32

Brocade 7800 SAN06B-R 2498 Model R06

Brocade 5300 SAN80B-4 2498 Model B80

Brocade 300 SAN24B-4 2498 Models B24 and 24E

IBM machine type and model number

xxiv SAN06B-R Installation, Service, and User Guide

Chapter 1. Introducing the SAN06B-R

The SAN06B-R is intended as a platform for Fibre Channel over IP (FCIP). This enables transmission of Fibre Channel data over long distances via IP networks by wrapping Fibre Channel frames in IP packets. Each end of the FCIP communication path must be a compatible FCIP device, either the SAN06B-R or the FX8-24 blade in a SAN384B or SAN768B chassis.

Refer to the Fabric OS Administrator’s Guide for information on configuring these features.

The base model of the switch is shipped with six Fibre Channel SFP ports and two physical Gigabit Ethernet (GbE) ports active. It includes the latest FOS level and is compatible with the entire IBM b-type switch family. It can operate independently or in a fabric containing multiple Extension Switches.

A fully licensed SAN06B-R provides the following functionality features: v FCIP capability

– Up to 8 FCIP tunnels. – Each FCIP tunnel is represented and managed as a virtual Fibre Channel

E_Port (VE_Port). – Fibre Channel Routing Services functionality can be used over the FCIP link. – Fabrics connected through FCIP merge if the ports are configured as

VE_Ports, and do not merge if one end of the connection is configured as a

VEx_Port. If VE_Ports are used in a Fibre Channel Routing Services backbone

fabric configuration, then the backbone fabric merges but the Ex_Port

attached to edge fabrics do not merge. For more information see the Fabric OS

Administrator’s Guide.

v FCIP Trunking with load balancing and network-based failure recovery v Adaptive Rate Limiting

– Configurable maximum and minimum committed bandwidth per FCIP tunnel – Minimum rate is guaranteed rate

v FC frame compression before FCIP encapsulation v Fibre Channel Routing v SO-TCP with reorder resistance v FastWrite over FCIP (not over FC) v Open Systems Tape Pipelining over FCIP v FICON CUP v FCIP QoS v TCP performance graphing in Web Tools

The switch provides the following hardware features: v Up to 16 Fibre Channel SFP ports supporting Fibre Channel Routing Services

with link speeds up to 1, 2, 4, or 8 Gbps.

v Up to six 1 GbE ports supporting the FCIP and Fibre Channel Routing Services

features with transmit link speeds up to 1-Gbps on each port.

Note: Two ports (ge0 and ge1) can be configured for use with either copper or

v Rack mountable 1U chassis. v One 10/100/1000 Base-T Ethernet port for management interface. v One RJ45 terminal port. v Two redundant, hot-swappable combined power supply/fan assembly FRUs. v Five internal temperature sensors.

SAN06B-R features

Table 3 compares features supported on the base and fully upgraded SAN06B-R. It also shows optionally licensed features.

Table 3. Feature comparison - base model and with the upgrade license

Feature Base model With upgrade license

Number of Fibre Channel ports

Number of GbE ports 2 6

Fibre Channel routing between remote fabrics for fault isolation

FCIP Tunnel Yes Yes

Number of FCIP tunnels 2 8

FCIP Trunking Yes

Adaptive Rate Limiting Yes

FC frame compression Yes Yes

Storage optimized TCP Yes Yes

Fast Write over FCIP tunnel Yes Yes

Open Systems Tape Pipelining over FCIP tunnel

FICON CUP No Yes

Requires IR license

Requires Advanced Extension license

Requires FICON CUP license

optical cables.

416

Yes

No Yes

v Before the installation of the upgrade license, ports beyond the basic four FC

and two GbE are shown as Disabled with the switchShow command.

v On the base SAN06B-R model, the two GbE ports (ge0 and ge1) can be

configured for use with either copper or optical cables (physically separate ports provided).

v FC frame compression is not the same as IP compression and is disabled by

default. It can be enabled using the portCfg command. For more information see the Fabric OS Administrator’s Guide.

v FCIP tunnel bandwidth has a minimum rate of 1544 Kbps (T1 rate).

Configuration requests of lower rates will be rejected.

v FCIP Trunking is available which will “virtualize” two or more TCP connections

(circuits) as part of a single FCIP tunnel. Up to four circuits can be configured for a single FCIP tunnel. See the Fabric OS Administrator’s Guide for details on explicitly configuring circuits.

2 SAN06B-R Installation, Service, and User Guide

v Multiple FCIP tunnels can share the same GbE port. At the same time, VE_ and

VEx_Ports are not associated with a single physical GbE port.

Available licenses

The following features are available with the purchase of a specific license key for the SAN06B-R.

v Advanced Extension –enables two advanced extension features, FCIP Trunking

and Adaptive Rate Limiting (ARL).

v Integrated Routing (IR)–allows any port in a SAN768B, SAN384B, SAN80B-4,

SAN40B-4, and SAN06B-R to be configured as an (EX_port) supporting Fibre Channel Routing (FCR)

v FICON Accelerator –designed to support secure data movement across the

enterprise data centers

v FICON CUP –designed to provide in-band management of the supported SAN

b-type switch, router, and director products by System Automation for z/OS from IBM System zSeries servers

v Extended Fabric –extends SAN fabrics beyond the FC standard 10 km by

increasing the internal switch buffers to help maintain performance on ISLs at distances

v Adapative Networking –provides a set of capabilities allowing high-priority

connections to obtain the bandwidth necessary for optimum performance

v ISL Trunking–provides the ability to aggregate multiple physical links into one

logical link.

v Fabric Watch–enables real-time proactive awareness of the health, performance,

and security of each switch.

v Advanced Performance Monitoring–enables performance monitoring of

networked storage resources.

v Server Application Optimization (SAO)–designed to bring Quality of Service

(QoS) enhancements for server consolidation and virtualization (requires a minimum FOS version 6.4.

For more information on these features, see the Fabric OS Administrator’s Guide.

Port side of the switch

Figure 1 shows the port side of the switch.

32 4 5

Figure 1. Port side view

1 System Power LED 6 Fibre Channel Ports (16)

2 System Status LED 7 GbE ports - copper RJ45(2)

3 Console Port (RJ45) 8 GbE ports - optical SFP (6)

6 7 8

r06b001

Chapter 1. Introducing the SAN06B-R 3

4 Ethernet Management

Port

5 USB Port

9 Serial number pull-out tab

The Fibre Channel ports are numbered from left to right on the faceplate (see Figure 2).

1 3

2 4

Figure 2. Port numbering

r06b002

1 Fibre Channel Ports 0

through 3

2 Fibre Channel Ports 4

through 15

Nonport side of the switch

Figure 3 shows the nonport side of the switch, which contain the combined power supplies and fans.

3 4

Figure 3. Nonport side of the switch

1 Fan and power

supply assembly 2

2 Fan and power

supply assembly 1

3 Fan assembly 2 9 Power supply 1

4 FRU LED 10 Fan assembly 1

5 Power supply 2 11 FRU handle

6 Fan assembly 2 12 FRU handle

3 GbE ports ge0-ge1 (copper only)

4 GbE ports ge0 through ge5 (SFP)

111 12

5 6

7 Fan assembly 1

8 FRU LED

r06b003

4 SAN06B-R Installation, Service, and User Guide

SAN06B-R management

You can use the management functions built into the switch to monitor the fabric topology, port status, physical status, and other information to help you analyze switch performance and to accelerate system debugging.

Note: The switch automatically performs a power-on self-test (POST) each time it

is turned on. Any errors are recorded in the error log. For more information about POST, see “Interpreting POST results” on page 30.

For information about upgrading the version of Fabric OS installed on your switch, see the Fabric OS Administrator’s Guide.

You can manage the switch using any of the management options listed in Table 4.

Table 4. Management options

Management Tool Out-of-band Support In-band Support

Command line interface (CLI)

Up to two admin sessions and four user sessions simultaneously. For more information, see the Fabric OS Administrator’s Guide and the Fabric OS Command Reference.

Data Center Fabric Manager (DCFM)

Ethernet (preferred) or console port connection

IP over Fibre Channel

For information, see the Data

Center Fabric Manager User Manual.

Web Tools

For information, see the Web Tools Administrator’s Guide.

Standard SNMP applications

For information, see the Fabric OS MIB Reference.

Management Server

For information, see the

Fabric OS Administrator’s Guide and the Fabric OS Command Reference.

Ethernet (preferred) or console port connection

IP over Fibre Channel

Native in-band interface (over HBA only)

Chapter 1. Introducing the SAN06B-R 5

6 SAN06B-R Installation, Service, and User Guide

Chapter 2. Installing and configuring the SAN06B-R

You can install the SAN06B-R in the following ways: v As a stand-alone unit on a flat surface. For instructions and more information,

see “Setting up the switch as a standalone unit” on page 8.

v In an Electronic Industries Association (EIA) cabinet using the fixed rack mount

kit, slide rack mount kit, or the mid-mount rack kit. For more information, see “Installing in an EIA cabinet” on page 9.

To install and operate the switch successfully, ensure that the following requirements are met:

v The primary AC input is 100-240 VAC (switch autosenses input voltage), 47-63

Hz. 200-240 VAC is recommended.

v The primary outlet is correctly wired, protected by a circuit breaker, and

grounded in accordance with local electrical codes.

v The supply circuit, line fusing, and wire size are adequate, as specified by the

electrical rating on the switch nameplate.

For power supply information, see “Power supply” on page 38.

To ensure adequate cooling, install the switch with the nonport side, which contains the air intake vents, facing a cool-air aisle.

Verify that the ambient air temperature does not exceed 40° C (104° F) and that the ambient humidity remains between 20% and 85% while the switch is operating.

This chapter provides the following information:

v “Items included with the switch” v “Installation and safety considerations” on page 8 v “Setting up the switch as a standalone unit” on page 8 v “Installing in an EIA cabinet” on page 9 v “Cabling and setting up the switch” on page 14 v “Managing license keys (optional)” on page 23

Items included with the switch

The following items are included with the standard shipment of the switch. When you open the packaging, verify that these items are included in the package and that no damage occurred during shipping.

Note: If any items are damaged or missing, within the United States and Canada,

contact the IBM Quality Hotline toll-free 1-800-442-6773 or direct dial in other locations: 770-858-8459.

v The SAN06B-R switch, containing two combined power supply/fan assembly

FRUs

v The following rack mount kits are optionally available:

– Fixed rack mount kit, with installation instructions – Slide rack mount kit, with installation instructions – Mid-mount kit, with installation instructions

v An accessory kit that contains the following items:

– SAN06B-R Quick Start Guide – SAN06B-R Installation, Service, and User Guide (this document). – IBM documentation CD – Four rubber mounting feet, required for setting up the product as a

stand-alone unit

– Two grounded 6 ft. (1.8 m.) country-specific power cables – One RJ-45 serial cable with an RJ-45 to DB9 adaptor – Paperpack of optional features license and key activation information (if

ordered)

Attention: Retain this paperpack in a safe place. The transaction keys in the paperpack are required for activation of optional features on the switch. Once a feature is activated, its activation key is associated with a specific product WWN and serial number.

Installation and safety considerations

Use this section to prepare your site for a safe and successful installation.

Attention: Read the “Safety and environmental notices” on page xiii before attempting any installation, maintenance, or service procedures.

Ensure that two dedicated electrical branch circuits with the following characteristics are available:

v Primary ac input 100-240 V ac, 2.0A, 47 to 63 Hz (the switch autosenses input

voltage)

v Correctly wired primary outlets, with circuit protected by a circuit breaker and

grounded in accordance with local electrical codes

v Adequate supply circuit, line fusing, and wire size, as specified by the electrical

rating on the chassis nameplate

v Located close to the product, and easily accessible

Note: To maximize fault tolerance, connect each power cord to a separate power

source.

For power supply information, see “Power supply” on page 38.

To ensure adequate cooling, install the switch with the nonport side, which contains the air intake vents, facing a cool-air aisle.

Verify that the ambient air temperature does not exceed 40° C (104° F) and that the ambient humidity remains between 20% and 85% while the switch is operating.

Setting up the switch as a standalone unit

To install the switch as a standalone unit, use the following procedure:

1. Unpack the switch and verify that all items listed in “Items included with the switch” on page 7 are present and undamaged.

8 SAN06B-R Installation, Service, and User Guide

2. Clean the four corner depressions on the bottom of the switch enclosure, place an adhesive rubber foot in each one, and firmly press into place. The rubber feet on the switch help prevent the switch from sliding off the supporting surface.

3. Place the switch on a flat, sturdy surface.

4. Provide power to the switch as described in “Providing power to the switch”

on page 16.

Attention: Do not connect the switch to the network until the IP address is correctly set. For instructions on how to cable and configure the switch, and how to set the IP address, see “Cabling and setting up the switch” on page 14.

Installing in an EIA cabinet

Attention: Refer to “Rack safety” on page xix for danger and caution notices related to rack and cabinet installations.

You can install the rack mount kit in only one way in a cabinet, with the port side of the switch able to slide out of the exhaust-air side of the cabinet. In this installation, the port side of the switch is flush with the edge of the cabinet.

Time required

Approximately 30 minutes, not including configuration.

Items required

You need the following items to install the switch in a slide-rail rack:

v Straight slot screwdriver v Rack space: 1U of rack space v Two power cables that are provided with the switch v Two power outlets v Rack mount kit

Attention: Use the exact screws specified in the procedure for use with the switch chassis. Using screws longer than 3/16 in. can damage the switch. The different types of screws are listed in Table 5 on page 10. Make sure that you tighten all screws used in this procedure.

Installation instructions

To install the switch in a slide-rail rack that meets EIA standards, use the following procedure.

Note: These procedures use parts that are included in the rack-mount kit. These

parts are listed in Table 5 on page 10. The installation procedure cross-references the items in this table. Be sure to use the referenced parts when you perform each step.

Before you start the rack-mount installation process, locate the rack-mount slides and the mounting bracket that are provided in the shipping container.

Figure 4 on page 10 shows the rack assembly. The number keys, such as 1, refer to the items listed in Table 5 on page 10.

Chapter 2. Installing and configuring the SAN06B-R 9

Inner Slide

Front of Switch

Figure 4. Rack assembly

EIA Rack Rail

Outer Slide

Detail A

See

Detail A

SJ000153

1. Unpack the rack-mount kit and verify that all ordered items and parts are present and undamaged. See Table 5 for a list of parts and the quantities supplied.

Table 5. Parts supplied with the rack-mount kit

Item Description Quantity

1 Rack mount slide (inner and outer slide) 2

2 Right rack mount bracket (optional bracket

for front of switch)

3 Left rack mount bracket (optional bracket for

front of switch)

4 Rack mounting bracket (3-hole) 4

5 Nut clip, M5 11

6 Screw, 8-32 x 3/16 in., zinc 11

7 Screw, M5 x 12 11

8 Bracket to slide rack kit (contains items 9 -

12)

9 Screw, 8-32 x 3/8 in., zinc 8

10 Washer, flat, No. 8 8

11 Washer, lock, No. 8 8

12 Nut, hex, 8-32 8

10 SAN06B-R Installation, Service, and User Guide

2. Separate the inner and outer slides. a. Open one of the slides until the lock engages. b. Press the lock release lever (1 in Figure 5) and remove the inner rail from

the outer rail.

Figure 5. Separating the inner and outer rails.

c. Repeat step 2a and step 2b for the other rail.

SJ000046

Note: For racks with flush-mount doors, such as the 9306 Netfinity

racks, do not install the ears. Instead, use the rack-mount slides by attaching the switch to the set of mounting holes, which are offset 3 inches into the rack.

3. Install the inner (smaller) slide on the switch chassis, as Figure 4 on page 10 shows.

Attention: If you use screws longer than 3/16 in. you can damage the switch.

a. Position the flat side of the inner rail along one side of the switch. Align the

holes in the rail with the threaded holes in the side of the switch chassis. The chamfered end of the inner rail should face toward the rear of the switch (away from the ports) as shown in Figure 6 on page 12.

b. Attach the inner rail by using three of the 8-32 x 3/16 in. zinc screws (6 in

Table 5 on page 10).

Chapter 2. Installing and configuring the SAN06B-R 11

Front

Figure 6. Mounting the moving portion of the slide and mounting brackets to the switch

c. Repeat step 3a on page 11 and step 3b on page 11 for the second inner rail

on the other side of the switch chassis.

4. Optional step: Install the right rack mount bracket 2 (see Figure 4 on page 10) and the left rack mount bracket 3 on the switch chassis. Use these brackets to secure the switch to the rack as shown in Figure 6.

Attention: Do not use screws longer than 3/16 in.; they can damage the switch.

a. Position the left rack mount bracket at the left front corner of the switch

chassis. Align the two holes in the bracket with the two threaded holes in the switch chassis.

b. Attach the bracket by using two of the 8-32 x 3/16 in. zinc screws (see 6

in Figure 4 on page 10)

c. Repeat step 4a and step 4b for the right rack mount bracket on the right

front corner of the switch chassis.

5. Attach all four of the 3-hole rack mounting brackets 4 in Figure 7 on page 13. a. Position a 3-hole rack mounting bracket 4 at the end of one of the outer

slides.

b. Attach the bracket by using the 8-32 x 3/8 in. zinc screws 9. Ensure that

the screw heads are inside the slides.

c. Place one each of the following items on the outer end of the screw in the

order listed (see Detail A in Figure 4 on page 10):

1) Washer, flat No. 8 10

2) Washer, lock No. 8 11

3) Nut, hex, 8-32 12

d. Repeat steps 5a through 5c for the three remaining rail ends.

SJ000047

12 SAN06B-R Installation, Service, and User Guide

Figure 7. Mounting the fixed portion of the rail and the locking brackets to the rack

SJ000048

6. Install the outer (larger) slides in the rack, as shown in Figure 7.

a. At the selected height, install the five M5 nut clips 5. Put three M5 nut

clips in the front of the rack and two in the back. The middle clip in the front of the rack is for the locking ears.

Note: Some rack mount kits might use 10-32 nut clips in place of the M5

nut clips for the locking ears.

b. Attach the slides by using four M5 x 12 screws 7 (see Figure 4 on page

10).

c. Repeat step 6a and step 6b for the other rail.

7. Install the switch in the rack. a. Position the switch in front of the rack. Insert the switch into the rack by

sliding the inner slides that are mounted on the switch into the outer slides that are mounted on the rack. See Figure 8 on page 14.

Chapter 2. Installing and configuring the SAN06B-R 13

Figure 8. Inserting slides into the rack rails

b. Check the alignment of the slides by sliding the switch in and out of the

rack. Any difficulty moving the switch indicates lateral stress or misalignment. If this situation occurs, adjust the slide positions until the movement is smooth.

8. Optional step: If the right and left rack mount brackets are installed on the front corners of the switch, attach both brackets to the cabinet rack by using M5 x 12 screws 7. See step 4 on page 12 and Figure 4 on page 10. The screws should pass through the front of each bracket and the slide rail.

Note: Some rack mount kits might use 10-32 nut clips in place of the M5 nut

clips for the locking ears.

9. Continue with initial setup of the switch by following the procedures in “Cabling and setting up the switch.”

Attention: Do not connect the switch to the network until you perform one of the following steps:

v Set the internet protocol (IP) address. v Verify that the default IP address does not conflict with the existing IP

addresses in the same network.

Cabling and setting up the switch

SJ000049

You must configure the switch before it can operate within a network and fabric. This section provides the basic steps required for the initial setup of the switch. For instructions on configuring the switch to operate in a network containing switches from other vendors, refer to the Fabric OS Administrator's Guide.

If you are going to use the switch in a single-switch setup, you can use EZSwitchSetup to complete the basic configuration. See the EZSwitchSetup CD, included with the switch, for more information. If you do not want to use EZSwitch Setup, follow the instructions in the rest of this section.

For more information about the commands used in these procedures, refer to the Fabric OS Command Reference.

14 SAN06B-R Installation, Service, and User Guide

Planning for cable management

Attention: The minimum bend radius for Cat5 and Cat6 copper cables and 50 micron cable is 51 mm (2 in.) under full tensile load and 30.5 mm (1.2 in.) with no tensile load. Because they can be easily overtightened, tie wraps are not recommended for use with optical cables.

Cables can be organized and managed in a variety of ways: for example, using cable channels on the sides of the cabinet or patch panels to minimize cable management. A list of best practices follows:

v Plan for rack space required for cable management before installing the switch. v Leave at least 1 meter (3.28 ft) of slack for each port cable. This provides room

to remove and replace the switch, allows for inadvertent movement of the rack, and helps prevent the cables from being bent to less than the minimum bend radius.

v For easier maintenance, label the fiber optic cables and record the devices to

which they are connected.

v Keep LEDs visible by routing port cables and other cables away from the LEDs. v Do not use tie wraps on fiber optic cables, because wraps can be easily

overtightened and can damage the optic fibers.

Items required for setup

The following items are required for configuring and connecting the switch for use in a network and fabric:

v The switch, installed and connected to a power source v Workstation with an installed terminal emulator, such as HyperTerminal v Available IP address and corresponding subnet mask and gateway address v Serial cable (provided) v Ethernet cable v SFP transceivers and compatible fiber and copper cables, as required v Access to an FTP server for backing up or downloading the switch configuration

Setting up the switch

Follow the steps described in the next sections to set up your switch.

v “Providing power to the switch” on page 16 v “Creating a serial connection” on page 16 v “Setting the switch IP address” on page 17 v “Creating an Ethernet connection and logging in” on page 18 v “Changing the switch name and chassis name” on page 18 v “Connecting cables” on page 21 v “Setting the switch date and time” on page 19 v “Setting the switch domain ID” on page 18 v “Configuring FCIP and Fibre Channel routing services” on page 20 v “Installing SFPs” on page 21 v “Connecting cables” on page 21 v “Verifying correct operation of the switch” on page 22 v “Backing up the configuration” on page 23

Chapter 2. Installing and configuring the SAN06B-R 15

Attention: Do not connect the switch to the network until the IP address is correctly set.

Providing power to the switch

DANGER

Follow these steps to provide power to the switch.

1. Connect the power cords to the receptacles on the two power supplies on the back of the switch.

Attention: Ensure that the power cables are routed so that they are not pinched or exposed to stress when the switch is moved on the slide-rails. Ensure that the cords have a minimum service loop of 15 cm (6 in.) available at the connection to the switch.

2. Connect the other end of the power cords to the two power sources. Attention: To protect against AC failure, connect the power cords to outlets

on separate circuits.

3. Press the "|” area of the power switch. The power supply LEDs display amber, and the switch begins running the power on self-test (POST). The switch requires one to three minutes to boot and complete the POST process. The LED will then change to green.

Note: Power is supplied to the switch as soon as the first power supply is

connected and turned on.

4. After POST is complete, verify that the System Status and Power Status LEDs display steady green (see Figure 1 on page 3).

For more information about the LEDs and their status during POST, refer to “LED activity” on page 25.

Creating a serial connection

All basic configuration tasks in this guide are performed using a serial connection. To create a serial connection to the switch, complete the following steps:

1. Remove the plug from the serial port and insert the serial cable provided with the switch.

2. Connect the serial cable to the console port on the switch and to an RS-232 serial port on the workstation. If the serial port on the workstation is RJ-45 instead of RS-232, remove the adapter on the end of the serial cable and insert the exposed RJ-45 connector into the RJ-45 serial port on the workstation.

3. Disable any serial communication programs running on the workstation.

4. Open a terminal emulator application (such as HyperTerminal on a PC, or

TERM, TIP, or Kermit in a UNIX environment), and configure the application as follows:

v In a Windows environment:

Bits per second 9600

16 SAN06B-R Installation, Service, and User Guide

Databits 8

Parity None

Stop bits 1

Flow control None

v In a UNIX environment, enter the following string at the prompt:

tip /dev/ttyb -9600

If ttyb is already in use, use ttya instead and enter the following string at the prompt:

tip /dev/ttya -9600

Connecting to the switch using the serial connection

Perform the following steps to log in to the switch through the serial connection.

1. Verify that the switch has completed POST. When POST is complete, the port status and power and status LEDs return to a standard healthy state; for information about LED patterns, see “LED activity” on page 25.

2. When the terminal emulator application stops reporting information, press Enter to display the login prompt.

3. Log in to the switch as admin, using the default password: password. You will be prompted to change the default passwords at initial login.

Setting the switch IP address

You can configure the switch with a static IP address, or you can use a DHCP (Dynamic Host Configuration Protocol) server to set the IP address of the switch. DHCP is enabled by default. The switch supports both IPv4 and IPv6.

Using DHCP to set the IP address: When using DHCP, the switch obtains its IP address, subnet mask, and default gateway address from the DHCP server. The DHCP client can only connect to a DHCP server that is on the same subnet as the switch. If your DHCP server is not on the same subnet as the switch, use a static IP address.

Setting a static IP address:

1. Log into the switch using the default password, which is password.

2. Use the ipaddrset command to set the Ethernet IP address.

v To use an IPv4 IP address, enter the IP address in dotted decimal notation as

prompted.

Ethernet IP Address: [192.168.74.102]

v To use an IPv6 address, enter the network information in colon-separated

notation as prompted.

switch:admin> ipaddrset -ipv6 --add 1080::8:800:200C:417A/64 IP address is being changed...Done.

3. Complete the rest of the network information as prompted (IPv4 format shown).

Ethernet Subnetmask: [255.255.255.0] Ethernet IP Address: [192.168.74.102] Ethernet Subnetmask: [255.255.255.0]

4. Enter off to Disable DHCP when prompted.

DHCP [OFF]: off

Chapter 2. Installing and configuring the SAN06B-R 17

Changing the switch name and chassis name

Changing the switch and chassis names are important for accurate tracking of errors in the RASlog. The messages that appear in the log will be labelled with the switch or chassis name, which makes tracking the errors much easier. Choose an easily understandable and meaningful name for each.

Perform the following steps to change the chassis name and then the switch name.

1. Log on to the switch through Telnet, using the admin account.

2. Change the chassis name by using the chassisName command.

switch:admin> chassisname my7800chassis switch:admin> chassisname my7800chassis

3. Change the switch name by using the switchName command.

switch:admin> switchname my7800switch switch:admin> switchname my7800switch

Creating an Ethernet connection and logging in

Create an Ethernet connection to the switch by completing the following steps:

1. Remove the plug from the Ethernet port (see Figure 1 on page 3).

2. Insert one end of an Ethernet cable into the Ethernet port.

3. Connect the other end to the workstation (or to an Ethernet network containing

the workstation).

Note: The switch can now be accessed remotely using command line or Web

Tools. Ensure that the switch is not being modified from any other connections during the configuration process.

Setting the switch domain ID

Perform the following steps to set the switch domain ID.

1. Log on to the switch through Telnet, using the admin account.

2. Modify the domain ID if required.

The default domain ID is 1. If the switch is not powered on until after it is connected to the fabric and the default domain ID is already in use, the domain ID for the new switch is automatically reset to a unique value. If the switch is connected to the fabric after it has been powered on and the default domain ID is already in use, the fabric will segment. To find the domain IDs that are currently in use, run the fabricShow command on another extension switch in the fabric.

a. Disable the switch by entering the switchDisable command. b. Enter the configure command. The command prompts will display

sequentially; enter a new value or press Enter to accept each default value.

c. Enter y after the "Fabric param" prompt:

Fabric param (yes, y, no, n): [no] y

d. Enter a unique domain ID (such as the domain ID used by the previous

extension switch, if still available):

Domain: (1..239) [1] 3

e. Complete the remaining prompts or press Ctrl+D to accept the remaining

settings without completing all the prompts.

f. Re-enable the switch by entering the switchEnable command.

18 SAN06B-R Installation, Service, and User Guide

Setting the switch date and time

The date and time switch settings are used for logging events. Switch operation does not depend on the date and time; a switch with incorrect date or time values still functions properly. You can synchronize the local time of the principal or primary fabric configuration server (FCS) switch to that of an external Network Time Protocol (NTP) server.

Perform the following steps to set the date and time of the switch.

Setting the date and time

1. Log in to the switch as admin.

2. Enter the date command, using the following syntax:

date "MMDDhhmm[CC]YY"

The values represent the following:

v MM is the month (01-12) v DD is the date (01-31) v hh is the hour (00-23) v mm is minutes (00-59) v CC is the century (19-20) v YY is the year (00-99)

Year values greater than 69 are interpreted as 1970-1999; year values less than 70 are interpreted as 2000-2069. The date function does not support Daylight Savings Time or time zones, so changes will have to be reset manually.

switch:admin> date Fri Sep 29 17:01:48 UTC 2007 switch:admin> date "0927123007" Thu Sep 27 12:30:00 UTC 2007 switch:admin>

Synchronizing local time with an external source

Perform the following steps to synchronize the local time of the principal or primary FCS switch with that of an external NTP server.

1. Log in as admin.

2. Enter the tsClockServer ipaddr command.

The ipaddr variable represents the IP address of the NTP server that the switch can access. This argument is optional; by default the value is LOCL.

sw7800:admin> tsclockserver 192.168.126.60 Updating Clock Server configuration...done. Updated with the NTP servers sw7800:admin>

Correcting the time zone of the switch

If the time of your switch is off by hours (and not minutes), use the following procedure to set the time zone. This needs to be done only once, because the value is stored in nonvolatile memory.

1. Log in as admin.

2. You can use the tstimezone -interactive command and follow the prompts or

enter the tsTimeZone command as follows:

tstimezone [houroffset [, minuteoffset]]

Chapter 2. Installing and configuring the SAN06B-R 19

The values of houroffset and minuteoffset are determined by your time zone. The default time zone for switches is universal time conversion (UTC). For U.S. time zones, use Table 6 to determine the correct values.

Note: The values in Table 6 do not apply if the time zone of the switches has

already been changed from the default.

Table 6. tsTimeZone command parameter values

Time zone houroffset minuteoffset

Atlantic Standard -4 0

Atlantic Daylight -3 0

Eastern Standard -5 0

Eastern Daylight -4 0

Central Standard -6 0

Central Daylight -5 0

Mountain Standard -7 0

Mountain Daylight -6 0

Pacific Standard -8 0

Pacific Daylight -7 0

Alaskan Standard -9 0

Alaskan Daylight -8 0

Hawaiian Standard -10 0

For more detailed information about the parameters of the tsTimeZone command, refer to the Fabric OS Command Reference.

Configuring FCIP and Fibre Channel routing services

The ports on the switch are initially set to persistently disabled. Once the switch is powered on, the port LEDs will flash amber until they are enabled. This is normal. If you want to enable the FC ports as a standard E_Port or F_port, use the portCfgPersistentEnable command to enable the ports. If you are using the FC ports as EX_Ports you must configure the Fibre Channel Routing Services feature prior to enabling the ports. The GbE ports can only be used after you have configured FCIP and enabled the VE_Ports. See the “Using the FC-FC Routing Service” and “Using the FCIP Tunneling Service” chapters of the Fabric OS Administrator’s Guide for detailed instructions on configuring the Fibre Channel Router ports and GbE ports on the switch.

20 SAN06B-R Installation, Service, and User Guide

Installing SFPs

| | | | | | |

| |

Attention: With increasing speeds of optical connections, the cleanliness of the connections assumes greater importance in ensuring maximum performance and error free transmission. Due to the tighter tolerances associated with state of the art optics, levels of contamination that were acceptable at lower speeds may not be at higher speeds. While IEC Standard 61300-3-35 specifies a set of guidelines for trouble free performance, most issues can be avoided by adhering to the following best practices:

v When cables or connectors are not in use for extended periods of time, use the

dust covers provided.

v Ensure that the cable length and type that is used are suitable for the speed and

application.

v Inspect and clean optical connections and fiber cables before you connect or

reconnect components.

v Ensure that cables are properly seated within the connector.

Kits are commercially available for cleaning and inspecting these connections. IBM also offers services that will ensure optimal condition of the network.

Perform the following steps to install SFPs and cable the switch.

1. Install the SFP transceivers in the Fibre Channel ports, as required. The ports selected for use in trunking groups must meet specific requirements. For a list of these requirements, see the Fabric OS Administrator’s Guide.

a. Remove the plugs from the ports to be used. b. Ensure that both cable and transceiver are clean prior to installation. c. Position a transceiver so that it is oriented correctly and insert it into a port

until it is firmly seated and the latching mechanism clicks. For instructions specific to the type of transceiver, see the transceiver manufacturer’s documentation.

Note: The transceivers are keyed to ensure correct orientation. If a

transceiver does not install easily, ensure that it is correctly oriented.

d. Repeat steps 1a through1c for the remaining ports, as required.

2. If you have chosen to use the optical ports for ge0 and ge1, install those SFPs.

If you have licensed the additional GbE ports, install the SFP transceivers in GbE ports ge2 through ge5.

a. Remove the plugs from the ports to be used.

b. Ensure that both cable and transceiver are clean prior to installation. c. Position a transceiver so that it is oriented correctly and insert it into a port

until it is firmly seated and the latching mechanism clicks. Be sure that you are using Brocade-branded 4 Gbps SFPs in the GbE ports.

d. Use the portcfggemediatype command to configure ge0 and ge1 to either

copper or optical. For instance, to select the optical option for port ge0, use the following command.

switch:admin> portcfggemediatype ge0 optical

Connecting cables

Attention: A 50-micron cable should not be bent to a radius less than 5 cm (2 in.) under full tensile load and 3 cm (1.2 in.) with no tensile load. Tie wraps are not recommended for optical cables because they can be easily overtightened.

Chapter 2. Installing and configuring the SAN06B-R 21

1. Orient a cable connector so that the key (the ridge on one side of connector) aligns with the slot in the transceiver. Then, insert the cable into the transceiver until the latching mechanism clicks. For instructions specific to cable type, see the cable manufacturer's documentation.

Note: The cable connectors are keyed to ensure correct orientation. If a cable

does not install easily, ensure that it is correctly oriented.

2. Repeat for the remaining cables as required.

3. If you have chosen the copper option for GbE ports ge0 and ge1, install those

cables now.

4. Check the LEDs to verify that all components are functional. For information about LED patterns, see “LED activity” on page 25.

5. Verify the correct operation of the switch by entering the switchShow command from the workstation.

Verifying correct operation of the switch

To verify the correct operation of the switch, complete these steps:

1. Check the LEDs to verify that all components are functional. For information about LED patterns, refer to “LED activity” on page 25.

2. Run the portCfgPersistntEnable command to activate the FC ports for FC operation.

3. Verify the correct operation of the switch by entering the switchShow command from the workstation. This command provides information about the switch and its port status, such as in the example below.

sw7800:admin> switchshow switchName: sw7800 switchType: 83.3 switchState: Online switchMode: Native switchRole: Principal switchDomain: 220 switchId: fffcdc switchWwn: 10:00:00:05:1e:55:a2:00 zoning: ON (DEFAULT_CFG_LSAN) switchBeacon: OFF FC Router: ON FC Router BB Fabric ID: 1 Index Port Address Media Speed State Proto ============================================== 0 0 dc0000 id N8 No_Light FC 1 1 dc0100 id N8 No_Light FC 2 2 dc0200 id N8 No_Light FC 3 3 dc0300 id N8 No_Light FC 4 4 dc0400 -- N8 No_Module FC 5 5 dc0500 -- N8 No_Module FC 6 6 dc0600 -- N8 No_Module FC 7 7 dc0700 -- N8 No_Module FC 8 8 dc0800 id N8 No_Light FC 9 9 dc0900 -- N8 No_Module FC 10 10 dc0a00 id N8 No_Light FC 11 11 dc0b00 id N8 No_Light FC 12 12 dc0c00 id N8 No_Light FC 13 13 dc0d00 id N8 No_Light FC 14 14 dc0e00 id N8 No_Light FC 15 15 dc0f00 id N8 No_Light FC 16 16 dc1000 -- -- Offline VE 17 17 dc1100 -- -- Offline VE 18 18 dc1200 -- -- Offline VE 19 19 dc1300 -- -- Offline VE

22 SAN06B-R Installation, Service, and User Guide

20 20 dc1400 -- -- Offline VE 21 21 dc1500 -- -- Offline VE 22 22 dc1600 -- -- Offline VE 23 23 dc1700 -- -- Offline VE ge0 id 1G No_Light FCIP ge1 id 1G No_Light FCIP ge2 id 1G No_Light FCIP ge3 id 1G No_Light FCIP ge4 id 1G No_Light FCIP ge5 id 1G No_Light FCIP sw7800:admin>

4. Verify the correct operation of the switch in the fabric by entering the

fabricShow command from the workstation. This command provides general information about the fabric.

Backing up the configuration

You should save all key configuration data for the switch (including license key information) and upload it to a FTP server for emergency reference. Back up the configuration on a routine basis to ensure that a complete and current configuration is available if needed.

After configurations are complete, back up the configuration by entering the configUpload command and following the prompts.

sw7800:admin> configupload Protocol (scp, ftp, local) [ftp]: Server Name or IP Address host: 192.168.0.100 User Name user: anonymous Path/Filename [home dir/config.txt]: Section (all|chassis|switch [all]): all configUpload complete: All selected config parameters are uploaded sw7800:admin>

The configUpload command uploads the switch configuration to the server so that it is available for downloading to a replacement switch, if necessary. For specific instructions about how to back up and restore the configuration, see the “Maintaining Configurations” chapter in the Fabric OS Administrator's Guide. The switchShow, fabricShow, and configUpload commands are described in detail in the Fabric OS Command Reference.

Managing license keys (optional)

Depending on what has been ordered, certain licenses are factory-installed on the switch. Feature licenses might be included as a paperpack item in the switch shipping carton. This paperpack provides you with keys to unlock the features. You can also purchase licenses separately from IBM.

Attention: Retain this paperpack in a safe place. The transaction keys in the paperpack are required for activation of optional features on the switch. After a feature is activated, its activation key is associated with a specific product WWN and serial number.

Refer to the following sections for information about viewing the current licenses, adding a license, or removing a license. For more information on the following procedures, see the Fabric OS Administrator's Guide and the Fabric OS Command Reference.

Chapter 2. Installing and configuring the SAN06B-R 23

Viewing current license keys

To view the licenses that are currently enabled on the switch, complete the following steps.

1. Log in as admin.

2. Enter the licenseShow command. A list of the enabled licenses and their

features is displayed, as in the following example.

APswitch:admin> licenseshow License Key: bQebzeRdScRfc0iK

License Key: SybbzQQ9edTzcd0X

APswitch:admin>

Web license

Zoning license

Adding a license key

Licenses for additional functionality may be purchased as feature codes through IBM. Contact your IBM representative for more information. You will need to supply IBM with the WWN to obtain a transaction key, which is sent in a paperpack. To obtain the license key, follow the instructions included in the paperpack. The transaction key and the switch WWN or product serial number are required to obtain the license key.

To add a license to the switch, complete the following steps.

1. Log in as admin.

2. Enter the switchShow command to obtain the WWN of your switch. The

license key is a string of approximately 16 uppercase and lowercase letters and digits. Case is significant. The key is an encrypted form of the system WWN and the products licensed to run on this system.

3. Enter the licenseAdd command, followed by the license key enclosed in quotation marks, as shown in the following example.

APswitch:admin> licenseadd "aBcDeFGh12345K" License key aBcDeFGh12345 added

Enter the license key into the system exactly as issued. If you enter it incorrectly, the license might be accepted, but it will not function.

4. After entering the license key, use the licenseShow command to verify that it is valid. If a licensed product is not displayed, the license is invalid.

Note: After you enter a license, the licensed product is available immediately;

the system does not need to be rebooted.

Removing a license key

To remove a license from the switch, complete the following steps.

1. Log in as admin.

2. Enter the licenseRemove command, followed by the license key enclosed in

quotation marks, as in the following example.

APswitch:admin> licenseremove "bQebzbRdScRfc0iK" removing license key "bQebzbRdScRfc0iK"

3. Save the license key information in case you want to reinstall it in the future.

4. After removing the license key, the switch must be rebooted.

5. Use the licenseShow command to verify that the license key has been

removed.

24 SAN06B-R Installation, Service, and User Guide

Chapter 3. Operating the SAN06B-R

The switch is engineered for reliability and requires no routine operational maintenance. However, this chapter provides information about determining the overall status of the system and each of its components using LEDs and CLI commands.

This chapter provides the following information:

v “LED activity” v “Interpreting POST results” on page 30 v “Diagnostics and troubleshooting” on page 31

LED activity

System activity and status can be determined through the activity of the LEDs on the switch.

There are three possible LED states:

v No light v Flashing v Steady light

Active lights are either green or amber. The status LEDs might display solid amber or flash during boot, POST, or other diagnostic tests. This is normal; it does not indicate a problem unless the LEDs do not indicate a healthy state after all boot processes and diagnostic tests are complete.

LEDs on the port side of the switch

The port side of the switch has the following LEDs:

v One system status LED (above) on the left side. v One power status LED (below) on the left side. v Management Ethernet port speed and activity LEDs. v One port status LED for each Fibre Channel port on the switch. The port LEDs

are located in the array in the same relative positions as the ports.

v One port status LED for each optical GbE port. v Two LEDs for each copper GbE port, one activity/status LED and one fault

LED.

Figure 9 on page 26 shows the port side of the switch.

2 3 94 65 8

710 111

r06b004

13 12 14 15 16

Figure 9. LEDs on port side

1System status LED 9Port 0 status LED

2System power LED 10Port 4 status LED

3Console port 11Port 8 status LED

4Ethernet link LED 12GbE copper port

5Ethernet status LED 13GbE port 0 fault (FLT) LED

6Ethernet port 14GbE port 0 status/activity LED

7IP address pull-out tab 15GbE optical port

8USB port 16GbE dual-color optical port LED

Power status LED patterns

The power status LED on the front of the switch (see 2 in Figure 9) indicates the status of the power supplied to the switch. Table 7 on page 27 describes the meaning of different displays of the power supply LED and recommended action, if any.

26 SAN06B-R Installation, Service, and User Guide

Table 7. Power status LED patterns

LED color Status of hardware Recommended action

No light (off) System is off or there is an

internal power supply failure.

Steady green System is on and power

supplies are functioning properly

Verify that system is powered on (power supply switches to "|"), the power cables attached, and your power source is live. If the system power LED is not green, the unit may be faulty. Contact your IBM representative.

No action required.

System status LED patterns

The system status LED (1 in Figure 9 on page 26) indicates the overall system status. Table 8 describes the meaning of different displays of the system status LED and recommended action, if any.

Table 8. System status LED patterns

LED color Status of hardware Recommended action

No light System is off or there is no

power.

Steady green System is on and functioning

properly

Steady amber (for more than 5 seconds)

Flashing amber/green

Unknown state, boot failed, or the system is faulty. Note: This LED displays steady amber during POST, this is normal and does not indicate a fault.

Attention is required. A number of variables can cause this status including a single power supply failure, a fan failure, or one or more environmental ranges has been exceeded.

Verify that the system is on and has completed booting and POST.

No action required.

Perform the following steps:

1. Connect a serial cable to the system.

2. Reboot the system.

3. Check the failure indicated on the system console.

If the problem does not resolve, contact your IBM representative.

Check the management interface and the error log for details on the cause of status. Contact your IBM representative.

Ethernet management port LED patterns

The Ethernet management port has two LEDs to indicate Ethernet link (4 Figure 9 on page 26) and Ethernet status/activity (5). Table 9 describes the meaning of different displays of the Ethernet LEDs and recommended action, if any.

Table 9. Management port LED patterns

LED name LED color Status of hardware Recommended action

Ethernet link No light No link Verify that the Ethernet cable is

Steady green Link exists No action required.

Ethernet status/activity

No light No activity No action required.

Flashing green Activity (traffic). No action required.

connected correctly.

Chapter 3. Operating the SAN06B-R 27

Fibre Channel port status LED patterns

The switch has one LED below each Fibre Channel port (9, 10, 11in Figure 9 on page 26) to indicate how that particular port is functioning. Table 10 describes the meaning of different displays of the port LEDs and recommended action, if any.

Table 10. FC port status LED patterns

LED color Status of hardware Recommended action

No light Indicates one of the following:

v No signal or light carrier (SFP or

cable) detected

v Switch may be initializing v Connected device is configured in an

offline status

Steady green Port is online (connected to external

device) but has no traffic.

Slow-flashing green (on 1 second; then off 1 second)

Fast-flashing green (on 1/4 second; then off 1/4 second)

Flickering green Port is online and data is flowing

Steady amber Port is receiving light or signal carrier,

Slow-flashing amber (on 2 seconds; then off 2 seconds)

Fast-flashing amber (on 1/2 second; then off 1/2 second)

Port is online but segmented because of a loopback cable or incompatible switch connection.

Port is online and an internal loopback diagnostic test is running.

through the port.

but it is not online yet.

Port is disabled because of diagnostics or the portdDisable command.

SFP or port is faulty. Reset the port. Replace the SFP. If the problem does

1. Verify that power LED is on.

2. Check the transceiver and cable.

3. Verify the switch has completed booting and

POST.

4. Verify the status of the connected device.

No action required.

Verify that the correct device is attached to the switch.

No action required.

Reset the port. Note: The portCfgPersistentDisable command is persistent across reboots. Use the portCfgDefault command to return the port to its default (enabled) status.

not resolve, contact IBM.

GbE optical port status LED patterns

The switch has one LED below each GbE optical port (16 in Figure 9 on page 26) to indicate how that particular port is functioning. Table 11 describes the meaning of different displays of the port LEDs and recommended action, if any.

Table 11. GbE optical port status LED patterns

LED color Status of hardware Recommended action

No light Port is offline

Steady green Port is online (connected to external

device) but has no traffic.

Flickering green Port is online and data is flowing

through the port.

Steady amber Port is faulty Change the transceiver or reset the switch from the

28 SAN06B-R Installation, Service, and User Guide

v Verify that power LED is on. v Check the transceiver and cable.

No action required.

workstation.

GBE copper port status LED patterns

The switch has two LEDs (one green and one amber) above each GBE copper port (13 and 14 in Figure 9 on page 26) to indicate how that particular port is functioning. Table 12 describes the meaning of different displays of the port LEDs and recommended action, if any.

Table 12. GBE copper port status LED patterns

LED color Status of hardware Recommended action

No lights (both LEDs are off)

Steady green, amber off

Flickering green, amber off

Green off, steady amber

Port is offline

Port is online (connected to external device) but has no traffic.

Port is online and data is flowing through the port.

Port is faulty Reset the switch from the workstation. If the fault

v Verify that power LED is on. v Check the transceiver and cable.

No action required.

persists, use the other copper port or the optical ports, or contact IBM.

LEDs on the nonport side of the switch

The LEDs on the nonport side of the switch provide status information for the two power supply/fan assemblies. Figure 10 shows the location of these LEDs and other components on the nonport side of the switch.

111 12

3 4

Figure 10. Nonport side components

1 Fan and power

supply assembly 2

2 Fan and power

supply assembly 1

3 Fan assembly 2 9 Power supply 1

4 FRU LED 10 Fan assembly 1

5 Power supply 2 11 FRU handle

6 Fan assembly 2 12 FRU handle

5 6

7 Fan assembly 1

8 FRU LED

Power supply/fan status LED patterns

Each power supply/fan assembly has one LED (4 and 8 in Figure 10) next to the AC power switch. This LED indicates the status of the power supply and the fan. Table 13 on page 30 describes the meaning of different displays of the LEDs and recommended action, if any.

r06b003

Chapter 3. Operating the SAN06B-R 29

Table 13. Power supply/fan status LED patterns

LED color Status of hardware Recommended action

No light Power supply/fan assembly is not seated

correctly.

Steady green Power supply/fan assembly is operating

normally.

Flashing green Power supply/fan assembly fault for one of

the following reasons:

v The power cable is disconnected v Power supply/fan assembly is switched off v The power supply has failed

Reseat power supply.

No action required.

1. Check the power cable connection.

2. Verify that the power supply/fan assembly is

powered on.

3. Run psShow and fanShow commands to determine the source of the fault.

If the actions above do not resolve the problem, replace the power supply/fan assembly.

Interpreting POST results

POST is a system check that is performed each time the switch is powered on, rebooted, or reset, and during which the LEDs flash different colors.

To determine whether POST completed successfully and whether any errors were detected:

1. Verify that the LEDs on the switch indicate that all components are healthy (see “LED activity” on page 25). If one or more LEDs do not display a healthy state:

a. Verify that the LEDs are not set to “beacon” (this can be determined

through the switchShow command or Web Tools). For information about how to turn beaconing on and off, see the Fabric OS Administrator's Guide or the Web Tools Administrator's Guide.

b. Follow the recommended action for the observed LED behavior, as listed in

the tables in “LED activity” on page 25.

2. Verify that diagShow command displays that the diagnostic status for all ports in the switch is OK.

3. Review the system log for errors. Errors detected during POST are written to the system log, which is viewed using the errShow command. For more information about this command, see the Fabric OS Command Reference. For information about specific error messages, see the Fabric OS Message Reference.

30 SAN06B-R Installation, Service, and User Guide

Diagnostics and troubleshooting

The switch is designed for high availability and low failure. It does not require any regular physical maintenance. It includes diagnostic tests and field-replaceable units, described in the following sections.

Diagnostic tests

In addition to POST, Fabric OS includes diagnostic tests to help you troubleshoot the hardware and firmware. This includes tests of internal connections and circuitry, fixed media, and the transceivers and cables in use. The tests are implemented by command, either through a Telnet session or through a terminal set up for a serial connection to the switch. Some tests require the ports to be connected by external cables, to allow diagnostics to verify the serializer/deserializer interface, transceiver, and cable. Some tests require loopback plugs.

Diagnostic tests are run at link speeds of 1 Gbps, 2 Gbps, 4 Gbps, and 8 Gbps. For information about specific diagnostic tests, see the Fabric OS Administrator's Guide.

Note: Diagnostic tests might temporarily lock the transmit and receive speed of

the links during diagnostic testing. After completing offline diagnostics tests, power-cycle the switch.

CRU status

The power supply/fan assemblies are customer replaceable units (CRUs), which can be replaced without the use of special tools. To determine the status of these CRUs, use the following diagnostic procedures. Follow the procedures in “Replacing a power supply/fan assembly” on page 32 if you determine that any CRUs are defective.

Power supply/fan assemblies

The two power supply/fan assemblies, #1 (1 in Figure 11 on page 32) and #2 (2), are hot-swappable. They are identical and fit into either power supply/fan slot. They are keyed to prevent being inserted upside down.

Fabric OS identifies the power supply/fan assemblies as follows (viewing the switch from the nonport side):

v Power supply #1 on the right v Power supply #2 on the left

Fabric OS identifies the fan asemblies as follows (viewing the switch from the nonport side):

v Fan assembly #1 on the right v Fan assembly #2 on the left

The FRUs are cross-connected so that if one power supply fails, the fans will continue to run on power from the other power supply.

Use any of the following methods to determine whether a power supply needs to be replaced:

v Check the power supply status LED next to the On/Off switch (see “Power

status LED patterns” on page 26).

v In Web Tools, click the Power Status or Fan Status icons.

Chapter 3. Operating the SAN06B-R 31

v Enter the psShow (or fanShow) command at the command prompt to display

power supply status as shown in the example below:

sw7800:admin> psshow Power Supply #1 is OK V10529, TQ2H0000118 ,60-0300031-01,X2, ,SP640 ,2X,TQ2H0000 Power Supply #2 is OK V10529, TQ2H0000121 ,60-0300031-01,X2, ,SP640 ,2X,TQ2H0000 sw7800:admin>

See “Replacing a power supply/fan assembly” for information on how to remove and replace the CRU.

Replacing a power supply/fan assembly

This section describes how to remove and replace the power supply/fan assemblies. Although these CRUs can be removed and replaced without special tools, qualified personnel should perform the installation and service procedures. The switch can continue operating during the CRU replacement if you adhere to the conditions specified in the procedures.

Attention: Before installing, removing, or replacing any component, read and follow the “Safety notices and labels” on page xiii.

The switch has two power supply/fan assemblies, #1 (1 in Figure 11) and #2 (2). The power supply/fan assemblies are hot-swappable as long as one of them remains operating during the procedure. Each power supply/fan is identical and fits into either power supply/fan slot. Refer to “Power supply/fan status LED patterns” on page 29 to help diagnose problems with a power supply/fan. You can also use the switchStatusShow command to verify the status of the power supply/fan assemblies. Refer to the Fabric OS Command Reference for more information on this command.

2 1

Figure 11. Power supply/fan locations

1 Power supply/fan #1 3 On/Off switch

2 Power supply/fan #2 4 LED

Time required: Less than 2 minutes

Items required:

v New power supply v Phillips screwdriver

r06b005

32 SAN06B-R Installation, Service, and User Guide

DANGER

Hazardous voltage, current, or energy levels are present inside any component that has this label attached. (L001)

Do not service, there are no serviceable parts.

Attention: Disassembling any part of the power supply/fan assembly voids the part warranty and regulatory certifications. There are no user-serviceable parts inside the power supply/fan assembly. Because the cooling system relies on pressurized air, do not leave either of the power supply/fan slots empty longer than 2 minutes while the switch is operating. If a power supply/fan fails, leave it in the switch until it can be replaced. This will ensure proper airflow for cooling. Maintain both power supply/fan assemblies in operational condition to provide redundancy.

Procedure: Complete the following steps to remove and replace a power supply/fan assembly.

1. To leave the switch in service while you replace a power supply/fan assembly, verify that the other power supply/fan (the one not being replaced) has been powered on for at least four seconds and has a green LED.

2. Power off the power supply/fan being replaced by pressing the AC power switch to “O”.

3. Unplug the power cord from the power supply/fan that you are replacing.

4. Unscrew the captive screw, using a Phillips screwdriver.

5. Remove the power supply/fan from the chassis by pulling the handle on the

power supply/fan out, away from the chassis.

6. Install the new power supply/fan in the chassis: Attention: Do not force the installation. If the power supply/fan does not

slide in easily, ensure that it is correctly oriented before continuing. a. Verify that the AC switch on the new power supply/fan is in the “O” (off)

position.

b. Orient the power supply/fan as shown in Figure 12, with the ac switch on

the left.

Figure 12. Orientation of the power supply and fan assembly

c. Using the handle, gently push the power supply/fan into the chassis until it

is firmly seated. Attention: Do not force the installation. If the FRU does not slide in easily,

ensure that it is correctly oriented before continuing.

d. Tighten the captive screw.

r06b006

Chapter 3. Operating the SAN06B-R 33

7. Connect the power cord to the power supply/fan and then press the AC power switch to “O” (on).

8. Verify that the LED on the new power supply/fan displays a steady green light while the switch is operating. If the LED is not green, ensure that the power supply is securely installed, the power plug is secure, and the primary power is available.

9. Optionally, enter psShow at the command line prompt to view the power supply status. For more information about this command, refer to the Fabric OS Command Reference.

Powering off the switch

To power off the switch:

1. Run the sysShutDown command.

Note: This command shuts down the key processors and powers off the

switch. All LEDs go dark.

2. Set each ac power switch to “O”.

Removing the battery

CAUTION: The battery contains lithium. To avoid possible explosion, do not burn or charge the battery. Do not:

v Throw or immerse into water

v Heat to more than 100°C (212°F)

v Repair or disassemble

Exchange only with the IBM-approved part. Recycle or discard the battery as instructed by local regulations. In the United States, IBM has a process for the collection of this battery. For information, call 1-800-426-4333. Have the IBM part number for the battery unit available when you call. (C003)

Local regulations may require removing the battery prior to disposing of or recycling this product. Complete these steps to remove the battery.

1. Disconnect all power and communication cables.

2. Remove all transceivers.

3. Unscrew fasteners and remove the power supply/fan assemblies.

4. Unscrew the fasteners and remove the sheetmetal cover.

5. On the circuit board, go to the B2 location (1 in Figure 13 on page 35) and

remove the BR1225 battery from the holder.

34 SAN06B-R Installation, Service, and User Guide

R16

C17

C16

R41

R42

R40

C27

R39

C28 R38

C37 R54

C38 R55

C39

R77

C74

C40

R2483

R78

C75

R56

R2482

C54

C60

R66

R60

C49

C69

R72

R79

C76

R61

C50

C61

C55

R67

C65

C70

R73

R80

C77

R62

C51

C62

C56

R68

C71

C66

R74

R81

C78

R63

C52

C63

C57

R69

C72

C67

R75

R82

C79

C53

C64

C58

R64

R70

R76

C73

C68

R83

C80

C59

R71R65

R84

C81

R101

C105

C107

R102

C106

R103

C132

R135

R133

R134

C133

R155

C158

C159

R195

R196

C213

R197

R194

C214

R192

C215

R193

R2485

C231 R230 R247

R231

R258

R248

C230

R249

R259

C235

C276

C232 R250

R260

C277

R251

R232

C278

C236

R261

R2484

C279

C233

R233

C237

C234

R262

C286

C281

R252

C300

C291

C287

C282

R253

C301

C292

C288

C283

R254

C302

C293

C289

C284

R255

C303

C294

C285

R256

C304

C295

C305

R234

C296

R235

C297

R263 R264

R257

C298

C290

C280

R265

C299

R283

R266 R267

R268 C342 R284

C343

R286 R285

R310 C368

R311 C369

C379

C381

C380

TP16

U112

U120

R333

CR4

C390

J17

R385

R386

R387

U129

U128

U135

C442

C440

J26

C441

C439

J27

HDR1

C19

C18

C29

C30

C108

L8 R964 R104 R105 R136 R137 R138 R139 R140 R141 R142

C20

TP4

U15

R47

C31

R43

R45

U16

C32

R46

R44

U42

J11

C188

C185

U79

U80

R200

C216

R201

C187

C186

R198

C217

R199

U101

U100

L11

C344

L12

R287 R288 R289 R290 R291 R312 R313 R314 R315

U113

TP23

TP24

C443

CR5

U130

J28

TP15

TP14

U24

TP17

R334

R336

R335

R337

L19

C394

C391

L17

C392

C393

L18

J18

U131

U132

R388

R405

1810

U18U17

U43 U45

U44

U66

C160

U87U86

U108

C398

C395

L20

C396

C397

U37

CR1

U47

U164

U67

C2635

C2631

C2630

C2634

U72

R1656

R2469

U73

C161

U114

R2455

R2502

U81

C2643

C2642

C2639

C2638

TP11

Q19 Q21Q20Q18

U57

U89

R270 R271 R272

C2607

U109

C2608

C2606 C2605

C2604 C2603

R292

C347 C348

C345

CR2

C346

TP12

CR3

R319

R316

U102

R317 R318

U115

C2678

C382

C2685

TP18

R340

R341

R338

R339

R2510

U121

R359

R357

R358

R361

C402

C406

C403

C404

C405

C399

L23

L22

C400

C401

L21

R360

L24

J21J19

J20

J51

R57 R58 R59 R85

TP6

C2390

C2659 C2658

C2391

U75

R2456

R342

U122

R18

U10

76100

TP1

U19

U48

910

RP1

U171

26 50

R50

U20

R49

R51

R48

U29

U30

U31

Q15

U49

U50

U59

R2000

R2001

R1999

C138

U68

U69

C2386

C162

C2387

U82

TP10

J15

R165

R1211

R166

R1212

R206

R1330

U96

R205

U103

C314

C310 C311

C312 C313

C355

C356 C351 C352

C353 C354

L13

TP19

R346

R362

R344

R347

R364

U123

R366

R365

R343

R345

R363

U23

R19

R20

J47

R30

Q10

C21

C2676

U11

R31

R2492

C2674

C2677

R2490

TP2

U174

U21

C33

C34

U173

U22

Q48

R52 R53

D22

U35

U34

U32

U36

Q13

U33

U53

U52

U51

U60

C2617

R2148

C139

C141

C140

C144

C143

C142

C164 C165

C166 C167

C163 C189 C190

C193 C194

R167

C195 C196

R168

C191 C192

R207

C220

R2223

C221 C222 C223

C218

C219

Q22U90

C239

C250

C243

C244

C246

C247

C245

C249

C248

C242

C241

C240

R2151

R273

R2150

C2618

R274

R2152

R2153

C357

C358

L14

C375

C374

C384

C383

R322

R325

R326

R324 R323

TP22

U116

TP20

U38

L16

C2C1

R10

C10

R21

C9C8

R33R32 Q11

C22

U12

R35 R34

U25

U39

R2486

U40

R2487

U61

U55

U62

C148

R2149

C147

C146

C153

C150

C149

C151

C152

C145

C255

C254

C251

C259

C258

C253

C252

C260

C256

C257

R239

U104

C359

L15

U26

U27

Q16 Q17

TP7

R106

C109

R107

C155

C154

C172

C168

C169 C170 C171

C173

C201

C197 C198 C199 C200

R169

C202

C203

R209 C224 C225 C226 C227

C228

C266 C267

U83

C268

C263

C264

C265

C262

C261

C385

U166

P1_9

D21

HDR2

U13

U28

Q14

U41

TP5

C82

C112

C110

U63

TP8

R111

R109

R108 C111

R146 R147 R148

R149 R150 R151

TP9

R2316

R174

R170

R172 R173

R171

R175 R176

R1315 R2479

R2476

R2474

U105

R2333

R2313

C377

C376

R320

R328 R329

C388

R327

U117

C386

C387

R350

R349

R348

U126

P2_10

P1_10

P1_2

Q9Q6 Q8

R24

R23

R25

R26

C11

R22

C12

Q12

C23

R36

R37

U14

C35

C41

U56

C85

C83 C84

C116

U64

C114

R86

R114

C86 C87

C115

R115

R87 C117

C113

R113

C118

R203

R202

U70

U71

R152

C156

R160

C175

C174

C176 C177

J13

R161

C178

R2317

R162

C179

U76

C180

2910

C181 C182

R159

R158

R157

R156

C183 C205 C206 C207

C204

C208

U84

C209 C210

C211 R177 R178

U92

R216

R214

R215

R213

R212

R211

R210

R208

U91

R2475

U97

R2315

R2335 R2493

R321

R217 R218 R219

C229

C2388

U98

R2478

R2477

C2389

U106

L10

U107

R275

C315

TP13

C316

J16

R276 C317 C318

U111Q23

R351

C2225

L174

C2222

C2226

C2227

C2219

C389

R330

C2220

R331

R375 R376 R377

R353

R378 R379

R352

U127

R367 R368

R389

R392

R390

R391

P2_2

P2_1

R15

R14

R13

R17

R11

R12

1810

C36

C42

C119

C157

C184

C269

R1711

R1708

R1714

R1710

R1709

R1712

R1713

C2221

U124

R369 R370

R393

R396

R394

R395

C15

C14

C13

R29

R27

R28

C25

C24

C48

C43

C44

C45

C46

C47

R91

R89

R97

R93

R95

R983

C101

C98

C95

C92

C89

C91

R982

C121

C123

C125

C127

C129

R121

R119

R117

R127

R125

R123

C275

C270

C272

C271

C273

C274

R282

R278

R281

R280

R279

R277

C337

C334

C329

C325

C321

C324

C338

C330

C326

C333

C319

C322

R304

R300

R302

R298

R294

R296

C2201

R1704

R1701

R1703

R1705

R1702

R1707

R1706

R355

R354

R383

R356

R384

TP21

R382

R381 R380

C2359

C2357

C2358

C2356

C2382

C2354

R1814

C2353

C2383

R371 R372

R398

R401

R397

R402

R400

R399

TP3

C26

J10

13 14

R88

R90

R94

R92

C90

C88

C96

C93

C100

C97

C94

R116

R118

R124

R122

R120

C124

C122

C120

C126

U176

R241

R240

R242

C323

C327

C331

C320

C328

C332

C336

R299

R297

R293

R295

C360

C361

C362

C363

R373 R374

R404

R403

R100

R98

R96

C104

U65

C103

C102

C99

R129 R130 R131

R128

R132

C131

C130

C128

R153 R154 R163 R164

R967

R968

R969

R973C813

C812

C814

C811

R1092

U77

U138

R1093

C885

C884

R1165

R1166

R1161

R1163

C1126

R185

R184

R179 R180 R181

C212

R191

R189

R190

R188

R186

R187 R182 R183 R220 R221

U94

U93 R222 R223 R224 R225 R226

R227

R228

R229

R246

R245

R244

R243

C341

C340

C339

C335

R303

R301

C365

C364

U99

R306

R305

R307 R308 R309

U110

C367

C366

C378

R2507

C2684

U118

U119

U175

R2508

C2683

U54

R332

U125

R2138

R2136

R2137

R2135

R2145

R2144

R2143

R2133

R2142

R2141

R2140

R2134

r06b007

Figure 13. Location of battery holder

6. Recycle the battery as appropriate.

Refer to the Environmental Notices and User Guide shipped with the product for more information on battery recycling and disposal.

Chapter 3. Operating the SAN06B-R 35

36 SAN06B-R Installation, Service, and User Guide

Appendix A. Product specifications

Summary of switch components

The switch includes the following components: v Cabinet-mountable 1U chassis designed to be mounted in a 19-in. cabinet space,

with forced-air cooling that flows from the nonport side of the switch to the port side

v 16 active Fibre Channel ports, compatible with short wavelength (SWL), long

wavelength (LWL), and extended long wavelength (ELWL) SFP transceivers

v One Ethernet management port with 10/100/1000 Mbps autonegotiating

capability

v 6 optical GbE ports, compatible with short wavelength (SWL), long wavelength

(LWL), and extended long wavelength (ELWL) SFP transceivers.

v One IEEE-compliant RJ-45 serial cable cable, 10-ft (approximately 3 m) long. An

RJ-45 to DB9 adaptor is also provided with the switch.

v One IEEE-compliant RJ-45 connector on the port side of the switch for use with

a serial console and 10/100 MB/sec Ethernet

v Switch status and management LEDs: 1 switch power LED, 1 switch status LED,

2 Ethernet LEDs, 2 power supply/fan LEDs

v Port status LEDs: 16 Fibre Channel port status LEDs, 6 optical GbE port status

LEDs, and 2 LEDs (one each for fault and status/activity) per copper-capable GbE port (total of 4 LEDs).

v 2 universal AC input and redundant power supplies with AC switches and

built-in fans

Weight and physical dimensions

Table 14 lists the weight and physical dimensions of the switch.

Table 14. Switch dimensions

Dimension Value

Height 4.45 cm (1.75 in.)

Depth 64.14 cm (25.25 in.)

Width 43.18 cm (17 in.)

Weight (with two power supplies and no SFPs installed)

10.9 kg (24 lb)

Power supply

The power supplies are universal and capable of functioning worldwide without voltage jumpers or switches. They meet IEC 61000-4-5 surge voltage requirements and are autoranging in terms of accommodating input voltages and line frequencies. Each power supply has a built-in fan for cooling, pushing air towards the port side of the switch. Table 15 lists the power supply specifications for the switch.

Table 15. Power supply specifications

Specification Value

Maximum output 150 Watts

System DC power consumption (excluding power supply/fan units)

Input system power (including power supply/fan units)

Input voltage 85-264 V ac, Universal

Input line frequency 47-63 Hz

BTU rating 590 BTU/hr

Inrush current Maximum of 60 amps for period between 10-150 ms

Input line protection Both AC lines are fused

Idle: 95 W Maximum: 116 W

Idle: 145 W Maximum: 173 W

Environmental requirements

Table 16 lists the acceptable environmental ranges for both operating and non-operating (such as during transportation or storage) conditions.

Table 16. Environmental requirements

Condition Acceptable range during operation Acceptable range during

Ambient temperature

Humidity 10% to 85% RH non-condensing, at 40°C

Altitude 0 to 3 km (9,842 ft) above sea level 0 to 12 km (39,370 ft) above sea

Shock 20 G, 6 ms, half-sine wave 15 G, 12-18 milliseconds,

Vibration 0.5 G sine, 5-500 Hz 2.0 G sine, 5-500 Hz

Air flow Maximum: 101.94 cmh (60 cfm)

0° to + 40°C (32° to 104°F) -25° to 70°C (-13° to 158°F)

(104°F)

Nominal: 74.76 cmh (44 cfm)

non-operation

10% to 90% RH non-condensing, at 70°C (158°F)

level

trapezoid

38 SAN06B-R Installation, Service, and User Guide

Data transmission ranges

Table 17 provides the data transmission ranges for different cable types and port speeds for Fibre Channel. Up to 500km at 1G is supported when using a long distance transport system such as DWDM.

Table 17. Fibre channel data transmission ranges by cable type and port speed

Cable size

Port speed

1 Gbps 50 500 m (1,640 ft) (OM2)

2 Gbps 50 300 m (984 ft) (OM2)

4 Gbps 50 150 m (492 ft) (OM2)

8 Gbps 50 50 m (164 ft) (OM2)

(microns) Short wavelength (SWL) Long wavelength (LWL)

NA NA

860 m (2,821 ft) (OM3)

62.5 300 m (984 ft) NA NA

9 NA 10 km (6.2 mi) 80 km (50 mi)

NA NA

500 m (1,640 ft) (OM3)

62.5 150 m (492 ft) NA NA

9 NA 10 km (6.2 mi) 80 km (50 mi)

NA NA

380 m (1,246 ft) (OM3)

62.5 70 m (230 ft) NA NA

9 NA 10 km (6.2 mi) NA

NA NA

150 m (492 ft) (OM3)

62.5 21 m (69 ft) NA NA

9 NA 10 km (6.2 miles) NA

Extended long wavelength (ELWL)

Table 18 provides the data transmission ranges for different cable types for Gigabit Ethernet (GbE).

Table 18. Gigabit Ethernet data transmission ranges

Cable size

Port speed

1 Gbps 50 500 m (1,640 ft) (OM2)

(microns) Short wavelength (SWL)

860 m (2,821 ft) (OM3)

62.5 300 m (984 ft) NA

9 NA 4 km (2.48 miles)

Long wavelength (LWL)

Table 19 provides the data transmission ranges for different cable types for copper-cabled Ethernet and GbE RJ-45 ports.

Table 19. Copper cabling and RJ-45 data transmission ranges

Port speed Cable type Range

1 Gbps Cat-5 100m

Appendix A. Product specifications 39

Memory specifications

The switch has three types of memory devices with the following capacities:

v Boot flash: 4 MB v Compact flash: 1 GB v Main memory (SDRAM): 2 GB

Port specifications

Fibre Channel port specifications

The Fibre Channel ports in the switch are compatible with SWL, LWL, and ELWL SFP transceivers. The strength of the signal is determined by the type of transceiver in use. The ports are capable of operating at 1 Gbps, 2 Gbps, or 4 Gbps and are able to auto-negotiate to the maximum link speed.

GbE port specifications

The GbE ports in the switch are compatible with short range (SR) and long range (LR) SFP transceivers. The strength of the signal is determined by the type of transceiver in use. These ports are capable of operating at up to 1 Gbps. The 8 virtual FCIP Fibre Channel links over each physical Ethernet connection share this bandwidth.

Serial port specifications

The serial port is located on the port side of the switch. The switch uses an RJ-45 connector for the serial port. An RJ-45 to DB9 adaptor is also provided with the switch.

Note: To protect the serial port from damage, keep the cover on the port when not

in use.

The serial port can be used to connect to a workstation to configure the switch IP address before connecting the switch to a fabric or IP network. The serial port parameters are fixed at 9600 baud, 8 data bits, and no parity, with flow control set to None.

Table 20 lists the serial cable pinouts.

Table 20. Serial cable pinouts

PIN Signal Description

1 Not supported NA

2 Not supported NA

3 UART1_TXD Transmit data

4 GND Logic ground

5 GND Logic ground

6 UART1_RXD Receive data

7 Not supported NA

8 Not supported NA

40 SAN06B-R Installation, Service, and User Guide

Parts list (CRUs)

The parts in listed Table 21 can be replaced by a customer. Refer to Chapter 3, “Operating the SAN06B-R,” on page 25 for information on interpreting LED patterns and diagnostics and troubleshooting procedures to determine the status of components. Refer to Figure 1 on page 3 and Figure 3 on page 4 for the location of the parts listed below. Part numbers are subject to change, particularly for SFP transceivers. Contact your IBM representative for current information on part numbers for SFPs to meet your needs.

| | | |

| |

Attention: Use only transceivers that are supported for this product. Only transceivers purchased from IBM are supported. The use of transceivers that are not supported may cause data loss or cause the product to malfunction. For a listing of transceivers compatible with this product:

v Go to the IBM Support Portal www.ibm.com/supportportal. v In the Search field, enter b-type supported transceiver. v Alternatively, use this direct link: http://www-01.ibm.com/support/

docview.wss?uid=ssg1S1004421.

Table 21. CRU part numbers

Part number Description

45W5481 Switch chassis assembly (replacement of chassis is required if internal circuitry

fails)

45W0319 Power supply/fan assembly

Appendix A. Product specifications 41

42 SAN06B-R Installation, Service, and User Guide

Appendix B. Link troubleshooting

| | | | | | | |

| |

Fault isolation

| | |

IBM SAN b-type directors and switches use the latest high bandwidth Fibre Channel technology and auto-negotiate to 16 Gbps, 8 Gbps, 4 Gbps, or 2 Gbps based on the link data rate capability of the attached transceiver and the speed supported by the switches and directors. Negotiation to 1 Gbps is not supported unless 4 Gbps FC transceivers are used. As the 8 and 16 Gbps channel is more sensitive to the condition of the existing multimode and single mode cable plant, it is very important to minimize connector reflections and maintain an acceptable link loss budget.

This section provides link troubleshooting advice on fault isolation and provides guidance in the following areas:

v Dust and dirt contamination v Link loss v Attenuation on LWL connections

Since a job loss issue can be caused by a variety of problems, it is important to employ a systematic fault isolation process to remedy the issue. Note that job losses do not necessarily result from link errors. They may also be due to:

v Configuration issues v Networking overload v Failures on storage device, switch, or server

| | |

| | | |

Assume for these procedures that the observed errors originate from link errors and are not the result of configuration issues, network overload or network equipment failures.

Whenever CRC errors are discovered on a particular link, it is easy to jump to the conclusion that the link is causing the network issue. This might not be the case. Since CRC errors are just symptoms of a link issue, we need to trace the propagated error to where it originated.

Figure 14 shows a simplified network involving a server, a switch, and a storage device. In this example, assume that the server experienced an error at port 1. This observable error can potentially originate from links 1, 2, 3, or 4 and/or SFP 1, 2, 3, or 4.

| |

Server

Port 1

SFP 1

Link 1

| |

Figure 14. Identifying the origin of failure

Link 4

SFP 2

Switch

Port 5

Storage

Port 6

SFP 3

Link 2

Link 3

Port 9

SFP 4

b965036

| | |

To determine the original failing link, the observable CRC error needs to be tracked back to the first occurrence of the CRC error. By following this process, it

| |

is discovered in this example that CRC errors observed in link 4 were propagated from link 3, which in turn originated from link 2.

| |

| | |

Dust, dirt, or other contaminants

| | |

| | | |

| | | | |

Once the original failing link (link 2) has been determined, the two connecting ports of that link need to be checked for the following errors:

v Encoder errors v Disparity errors v Invalid transmission words

The port that displays any of the above errors is the cause of the link issue, which can be caused by dust or dirt in the connectors or fiber, an insufficient link loss budget, and/or incompatible SFPs.

One of the most common optical link problems is caused by dust, dirt, or oil in the connectors and fiber. 8 and 16 Gbps links are more prone to such issues while lower link data rates, such as 1, 2, or 4 Gbps may be unaffected.

Once the failing port has been identified by following the above fault isolation process, the receive power of the transceiver sitting in that port needs to be determined. An abnormally low receive power usually means that the physical link is dirty.

The receive power can be checked by querying the SFP diagnostics data via the command line interface. This information will provide a rough gauge whether the receive power is abnormally lower than the minimum receive specification of the transceiver. It is also prudent to compare this receive power with those of neighboring transceivers.

| | |

Best practices for minimizing link loss

| | |

| |

For better accuracy, it is advisable to use a power meter to measure the actual receive power of the link. If you are experiencing excessive bit errors and the receive power of the transceiver is abnormally low, it is recommended that you:

v Re-seat the transceivers for the failing link v Clean the connector and optical fiber

Most link issues are solved by completing these steps.

The "link margin" or the "power budget" of the link is a measure of signal power gain or loss expressed in decibels (dB). Maintaining a healthy link budget is critical to establishing a reliable and stable network.

Follow these best practices for minimizing link loss:

v Stay well within the maximum cable distance calculated for the link. v Apply typical or worst-case values during loss calculations. v Use the highest grade cabling components for the application to be supported. v Match the cable type with the wavelength, bandwidth, and distance to be

supported; do not mix cable types within a link.

v Inspect loss ratings of all cabling components during the selection process. v Record loss measurements for horizontal and vertical cable runs during

installation.

44 SAN06B-R Installation, Service, and User Guide

| |

v Become familiar with how to quickly determine the link budget and link loss of

selected sections of the cabling.

v Account for power loss associated with future repairs and expansion. v Do not stress the cables. v Prototype a link with anticipated maximum cable distance and selected

components—and then take measurements to calculate the actual link loss

Attenuation on LWL connections

| | | | |

| |

| | | |

||||

| | |

In the datacenter environment, there may be 8 Gbps or 4 Gbps LWL transceivers that are connected to 2 Gbps LWL transceivers using single-mode fiber over short distances. Such connections need to be optically engineered because there is a possibility that the transmit power of the 8 Gbps / 4 Gbps LWL transceivers may saturate the receiver of 2 Gbps LWL transceivers and cause CRC errors.

Attention: This discussion does not apply to 16 Gbps transceivers since connections between 16 Gbps and 2 Gbps transceivers is not supported.

Refer to Table 22 for the typical specifications of maximum transmit and receive power of LWL transceivers. This information is also available in the information technology industry standard "Fibre Channel – Physical Interface-4 (FC-PI-4)" document.

Table 22. Specifications of LWL 10km transceivers

LWL SFP/SFP+ 2GFC 4GFC 8GFC

Power, Tx (max) dB -3 -1 +0.5

Power, Rx (max) dB 0 or -3

The maximum receive power specifications of some 2 Gbps LWL 10km transceivers can vary from 0dB to -3dB. However, most 2 Gbps 10km transceivers specify a maximum receive power of 0dB.

N/A N/A

| |

It is important to check the maximum receive power of the 2 Gbps LWL transceiver in the manufacturer's datasheet.

| | | | | | |

Best Practice for LWL connections – Optically engineer a long-distance connection

| | |

2G LWL SFP maximum receive power

| | |

Without taking into account connector and fiber losses, the transmit power of 8 Gbps / 4 Gbps LWL transceivers may be observed to overdrive the -3dB maximum receive power of 2 Gbps LWL transceivers. If the maximum receive power of the 2 Gbps LWL transceiver is 0dB, a 4 Gbps LWL transceiver with a -1dB transmit power will not overdrive the 2 Gbps transceiver. Although some 8 Gbps LWL transceivers may reduce their transmit power to 4 Gbps levels, this may still overdrive a 2 Gbps LWL transceiver.

It is always a good practice to optically engineer a long-distance connection. Most link issues caused by SFP incompatibility can be solved either by use of 4 Gbps LWL transceivers or use of 8 Gbps LWL transceivers that employ rate select.

The IBM SAN b-type 8 Gbps and 16 Gbps directors and switches use the latest high bandwidth Fibre Channel technology and auto-negotiate to 16 Gbps, 8 Gbps, 4 Gbps, or 2 Gbps based on the link data rate capability of the attached transceiver.

Appendix B. Link troubleshooting 45

| | | | | | |

Negotiation to 1 Gbps is not supported. Since 8 and 16 Gbps equipment is more sensitive, the existing cable plant may require additional attention to cable care after upgrading from 2 or 4 Gbps fibre. In a few cases, the Tx power of the switch can be higher than the connected equipment. In nearly all of those cases, there is enough attenuation in the existing cable plant so as not to require additional attenuation. The common 2 Gbps SFP Rx maximum power levels are listed in Table 23 and can be used as a quick method to relieve concerns of over saturation.

|||||

||||

Table 23. Maximum receive power of 2 Gbps LWL SFPs

Max Receive Power

Vendor Part number Description

Avago AFCT-57M5ATPZ 2 Gbps 10 km SFP -3 dB

Finisar FTLF1319P1xTL 2 Gbps 10 km SFP 0 dB

Finisar FTRJ1319P1xTL 2 Gbps 10 km SFP 0 dB

JDSU JSH-12L1DD1 2 Gbps 10 km SFP 1 dB

Hitachi Cable HTR6517 2 Gbps 10 km SFP -3 dB

Optoway SPS-9110FG 2 Gbps 10 km SFP -3 dB

Optoway SPS-9110AFG 2 Gbps 10 km SFP -3 dB

JDSU JSH-21L3AR3 2 Gbps 10 km SFP 1 dB

E20 ES212-LP3TA 2 Gbps 10 km SFP -3 dB

(dB)

46 SAN06B-R Installation, Service, and User Guide

Notices

This information was developed for products and services offered in the USA.

IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe on any IBM intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM product, program, or service.

IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing to:

IBM Director of Licensing IBM Corporation North Castle Drive Armonk, N.Y. 10504-1785 U.S.A.

For additional information, visit the web at: http://www.ibm.com/ibm/licensing/contact/

The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law:

INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION “AS IS” WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you.

This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice.

Any references in this information to non-IBM web sites are provided for convenience only and do not in any manner serve as an endorsement of those web sites. The materials at those web sites are not part of the materials for this IBM product and use of those web sites is at your own risk.

IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you.

Any performance data contained herein was determined in a controlled environment. Therefore, the results obtained in other operating environments may vary significantly. Some measurements may have been made on development-level

systems and there is no guarantee that these measurements will be the same on generally available systems. Furthermore, some measurement may have been estimated through extrapolation. Actual results may vary. Users of this document should verify the applicable data for their specific environment.

Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.

If you are viewing this information in softcopy, the photographs and color illustrations may not appear.

48 SAN06B-R Installation, Service, and User Guide

Trademarks

IBM, the IBM logo, and ibm.com®are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. A complete and current list of other IBM trademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.

Java and all Java-based trademarks and logos are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.

Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.

Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both.

UNIX is a registered trademark of The Open Group in the United States and other countries.

Other product and service names might be trademarks of IBM or other companies.

Notices 49

Electronic emission notices

The following statements apply to this product. The statements for other products intended for use with this product will appear in their accompanying manuals.

Federal Communications Commission (FCC) Class A Statement

This equipment has been tested and complies with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case the user will be required to correct the interference at his own expense.

Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits. IBM is not responsible for any radio or television interference caused by using other than recommended cables and connectors or by unauthorized changes or modifications to this equipment. Unauthorized changes or modifications could void the user's authority to operate the equipment.

This device complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: (1) this device may not cause harmful interference, and (2) this device must accept any interference received, including interference that may cause undesired operation.

Industry Canada Class A Emission Compliance Statement

This Class A digital apparatus complies with Canadian ICES-003.

Avis de conformité à la réglementation d'Industrie Canada

Cet appareil numérique de la classe A est conform à la norme NMB-003 du Canada.

European Union EMC Directive Conformance Statement

This product is in conformity with the protection requirements of EU Council Directive 2004/108/EC on the approximation of the laws of the Member States relating to electromagnetic compatibility. IBM cannot accept responsibility for any failure to satisfy the protection requirements resulting from a non-recommended modification of the product, including the fitting of non-IBM option cards.

Attention: This is an EN55022 Class A product. In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures.

Responsible manufacturer: International Business Machines Corp. New Orchard Road Armonk, New York 10504 Tel: 919-499-1900

European community contact: IBM Technical Regulations, Department M456

50 SAN06B-R Installation, Service, and User Guide

IBM-Allee 1, 71137 Ehningen, Germany Tel: +49 7032 15-2937 E-mail: tjahn@de.ibm.com

Germany Electromagnetic Compatibility Directive

Deutschsprachiger EU Hinweis:

Hinweis für Geräte der Klasse A EU-Richtlinie zur Elektromagnetischen Verträglichkeit

Dieses Produkt entspricht den Schutzanforderungen der EU-Richtlinie 2004/108/EG zur Angleichung der Rechtsvorschriften über die elektromagnetische Verträglichkeit in den EU-Mitgliedsstaaten und hält die Grenzwerte der EN 55022 Klasse A ein.

Um dieses sicherzustellen, sind die Geräte wie in den Handbüchern beschrieben zu installieren und zu betreiben. Des Weiteren dürfen auch nur von der IBM empfohlene Kabel angeschlossen werden. IBM übernimmt keine Verantwortung für die Einhaltung der Schutzanforderungen, wenn das Produkt ohne Zustimmung der IBM verändert bzw. wenn Erweiterungskomponenten von Fremdherstellern ohne Empfehlung der IBM gesteckt/eingebaut werden.

EN 55022 Klasse A Geräte müssen mit folgendem Warnhinweis versehen werden: "Warnung: Dieses ist eine Einrichtung der Klasse A. Diese Einrichtung kann im Wohnbereich Funk-Störungen verursachen; in diesem Fall kann vom Betreiber verlangt werden, angemessene Maßnahmen zu ergreifen und dafür aufzukommen."

Deutschland: Einhaltung des Gesetzes über die elektromagnetische Verträglichkeit von Geräten

Dieses Produkt entspricht dem "Gesetz über die elektromagnetische Verträglichkeit von Geräten (EMVG)". Dies ist die Umsetzung der EU-Richtlinie 2004/108/EG in der Bundesrepublik Deutschland.

Zulassungsbescheinigung laut dem Deutschen Gesetz über die elektromagnetische Verträglichkeit von Geräten (EMVG) (bzw. der EMC EG Richtlinie 2004/108/EG) für Geräte der Klasse A

Dieses Gerät ist berechtigt, in Übereinstimmung mit dem Deutschen EMVG das EG-Konformitätszeichen - CE - zu führen.

Verantwortlich für die Einhaltung der EMV Vorschriften ist der Hersteller: International Business Machines Corp. New Orchard Road Armonk, New York 10504 Tel: 919-499-1900

Der verantwortliche Ansprechpartner des Herstellers in der EU ist: IBM Deutschland Technical Regulations, Department M456 IBM-Allee 1, 71137 Ehningen, Germany Tel: +49 7032 15-2937 E-mail: tjahn@de.ibm.com

Notices 51

Generelle Informationen:

Das Gerät erfüllt die Schutzanforderungen nach EN 55024 und EN 55022 Klasse A.

People's Republic of China Class A Electronic Emission Statement

Japan VCCI Council Class A Statement

Translation: This is a Class A product based on the standard of the VCCI Council. If this equipment is used in a domestic environment, radio interference may occur, in which case, the user may be required to take corrective actions.

Japan Electronics and Information Technology Industries Association (JEITA) Statement

Japanese Electronics and Information Technology Industries Association (JEITA) Confirmed Harmonics Guideline (products less than or equal to 20 A per phase).

jjieta1

Korea Communications Commission (KCC) Statement

Please note that this equipment has obtained EMC registration for commercial use. In the event that it has been mistakenly sold or purchased, please exchange it for equipment certified for home use.

52 SAN06B-R Installation, Service, and User Guide

Russia Electromagnetic Interference (EMI) Class A Statement

Australia and New Zealand Class A Statement

Attention: This is a Class A product. In a domestic environment this product might cause radio interference in which case the user might be required to take adequate measures.

rusemi

Notices 53

54 SAN06B-R Installation, Service, and User Guide

Index

accessibility

IBM commitment v keyboard navigation iv vendor software iv

address

IBM v

attention notices

definition xviii example xviii

backing up switch configuration 23 battery removal 34 Brocade

documents xxiii

cables

connecting 21 management 15 optical 15 planning 15 routing 15 SFPs 21

caution notices

definition xvi

examples xvi chassis name 18 comments, sending to IBM v components

monitoring 25

summary 37 configuration, backing up 23 configuring

FCIP 20

Fibre Channel routing services 20

switch 7, 15 creating a serial connection 16 CRUs

power supply/fan assembly 31, 41

status 31

switch chassis assembly 41

danger notices xiii data transmission ranges 39 date, setting 19 DHCP 17 diagnostic tests 31 dimensions 37 director of licensing, address 47 disposal xxi documentation

Brocade xxiii

IBM xxiii

domain ID 18

edition notice ii electrical requirements 8 electronic emission notices 50 environmental

notices xiii, xxi product recycling and disposal xxi

requirements 8, 38 error log 5 Ethernet

connection

creating 18 logging in 18

Gigabit ports

copper 29 location 3 optical 28 specifications 40

management port

LED patterns 27 location 3

fan assembly

LED patterns 29

location 4

replacing 32

status 31 FCIP, configuring 20 features 2 Fibre Channel ports

configuring routing services 20

location 3

specifications 40

status LEDs 28 functions 2

getting help iii Gigabit Ethernet

copper port status 29

optical port status 28

ports, location 3

help iii

IBM

accessibility commitment v

address v

documentation xxiii

IBM (continued)

notices 47 trademarks 49

installation

electrical requirements 8 environmental requirements 8 instructions 9 SFPs 21 slide-rail rack 9 stand-alone unit 8

switch 7, 8 intellectual property 47 IP address

dynamic 17

setting 17

static 17 items included with switch 7

keyboard navigation iv

labels, safety xviii LEDs

activity 25

Ethernet management port 27

fan status 29

Fibre Channel port status 28

GbE copper port status 29

GbE optical port status 28

location 25, 29

nonport side 29

port side 25

power status 26

power supply status 29

system status 27 license

agreement iv

keys

adding 24 backup 23 managing 23 optionally licensed features 3, 23 paperpack 8, 23 removing 24

viewing 24 optionally licensed features 2 upgrade 2

license, for patents 47 local time 19

management functions 5 managing

license keys 23 switch 25

memory 40

monitoring

components 25 CRU status 31 device status 31

name

chassis 18

switch 18 network time protocol 19 nonport side of the switch

components 4

LEDs 29 notices

attention xviii

caution xvi

danger xiii

edition ii

environmental xiii, xxi

general 47

IBM 47

patents 47

safety xiii

types xiii NTP time synchronization 19

optical cables 15

parts supplied with rack-mount kit 10 patents 47 physical dimensions 37 port side of the switch

components 3

LEDs 25 ports

Ethernet management 3

Fibre Channel 3, 40

Gigabit Ethernet 3, 40

illustration 3

serial 3, 40

USB 3 POST 5, 30 power

battery removal 34

cord 4

providing to switch 16

status LEDs 4, 26

supply

LED patterns 29 location 4 replacing 32 specifications 38

status 31 switch 4 turning off switch 34

power-on self-test 5, 30 preparing site for installation 8 product specifications 37 pull-out tab 3

rack safety xix, xx rack-mount kit 9, 10 read this first iii recycling xxi renaming

chassis 18 switch 18

safety

labels xiii notices xiii pre-installation 8 rack xix, xx

serial connection

creating 16 UNIX 16 Windows 16

serial ports

location 3

specifications 40 SFPs 21 site preparation 8 slide-rail rack 9 stand-alone unit 8 switch

components 37

configuration 7

configuration backup 23

diagnostics 31

dimensions 37

domain ID 18

features 2

functions 2

installation 7

items included 7

library xxiii

managing 25

name 18

nonport side 4

port side 3

powering off 34

providing power 16

troubleshooting 31

verifying correct operation 22

weight 37 synchronizing local time 19 system status LEDs 27

terminal emulator 16 time

required for installation 9

synchronization 19

zone 19 trademarks 49 troubleshooting 31

USB port 3

vendor software iv

Web sites iii weight 37

56 SAN06B-R Installation, Service, and User Guide



Part Number: 98Y5370

Printed in USA

GC27-2270-02

(1P) P/N: 98Y5370

Service information: 2498

/R06

Spine information:

 IBM System Storage SAN06B-R SAN06B-R Installation, Service, and User Guide

IBM SAN06B-R Installation, Service And User Manual

Specifications and Main Features

Frequently Asked Questions

User Manual