IBM System Storage SAN384B-2 Installation, Service And User Manual

IBM System Storage SAN384B-2



Installation, Service, and User Guide

Service information: 2499-416

Read Before Using

This product contains software that is licensed under written license agreements. Your use of such software is subject to the license agreements under which they are provided.

GA32-0894-04

IBM System Storage SAN384B-2



Installation, Service, and User Guide

Service inf ormat ion: 2499-416

GA32-0894-04

Note:

Before using this information and the product it supports, read the information in “Notices” on page 155.

The paragraph does not apply to any country (or region) where such provisions are inconsistent with local law.

INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states (or regions) do not allow disclaimer of express or implied warranties in certain transactions; therefore, this statement may not apply to you.

US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

Read this first

Summary of changes

| |

Fifth edition

This is the fifth edition of the IBM System Storage SAN384B-2 Installation, Service, and User Guide. The content changes since the last edition of this publication are

noted by a vertical line placed in the left margin beside each change. Minor edits are not identified by this mark. A summary of the changes for each edition are listed below.

The changes were made in this edition: v Addition of information regarding the need for clean optics with higher

transmission speeds.

v Addition of information for tuning the system. v Link troubleshooting information added.

Fourth edition

The changes were made in this edition:

v Addition of Enhanced 8 Gbps 32-port blade–Feature code 3633 v Addition of Enhanced 8 Gbps 48-port blade–Feature code 3649 v Addition of FIPS tamper-proof seals–Feature code 7230 v Enhanced inter-chassis link (ICL) capability–Feature code 7872 v Updated Fabric OS version to 7.0.1 or higher

Third edition

Second edition

Getting help

The changes were made in this edition: v Addition of FICON Accelerator and FICON with CUP Activation optional

features

v Updated FOS version to 7.0.0c v Added port speed to Encryption blade information

The changes were made in the second edition:

v The addition of 16 Gbps long wave length (LWL) SFP feature v The addition of encryption, including the Encryption Blade (FS8-18) v Updated instructions on ordering the lift tool load plate (now included with the

lift tool)

v Other minor content updates

For the latest version of your product documentation, visit the web at www.ibm.com/shop/publications/order. Search by form number or title.

For more information about IBM www.ibm.com/servers/storage/san/

SAN products, see the website:

IBM Redbooks®often provide in depth information about product best practices, configurations, and more technical information. For redbooks associated with this product, enter search terms on the website: www.redbooks.ibm.com/.

For support information for this and other IBM products, see the IBM Support Portal, www.ibm.com/supportportal. Search for the product Machine type or product name.

For Fabric OS Release Notes and access to Fabric OS firmware downloads, go to the IBM Support Portal, www.ibm.com/supportportal. Search for the product Machine type or product name, and then follow links for Downloads. More detailed instructions are available through the Accessing firmware updates and OS documentation updates link on the product documentation CD that is shipped with this product.

You can also contact IBM Service within the United States at 1-800-IBMSERV (1-800-426-7378). For support outside the United States, you can find the service number at: www.ibm.com/planetwide/. To expedite your call, before contacting IBM Service, please have the information available:

v Machine type and model (2499-416) v Product serial number v License ID (you can use the licenseIdShow command to display the license ID) v World Wide Name (WWN) v FOS version installed v Error numbers and messages received v supportSave command output v Detailed description of the problem and specific questions v Description of any troubleshooting steps already performed and the results v Serial console and Telnet session logs v Syslog message logs

Visit www.ibm.com/contact for the contact information for your country or region.

For detailed information about the Fibre Channel standards, see the Fibre Channel Industry Association (FCIA) website at: www.fibrechannel.org/

For information about storage industry standards, see the Storage Networking Industry Association (SNIA) website at: www.snia.org/

Taiwan Contact Information

IBM Taiwan Product Service Contact Info: IBM Taiwan Corporation 3F, No 7, Song Ren Rd., Taipei Taiwan Tel: 0800-016-888

iv SAN384B-2 Installation, Service, and User Guide

f2c00790

How to send your comments

Your feedback is important in helping us provide the most accurate and high-quality information. If you have comments or suggestions for improving this document, send us your comments by email to starpubs@us.ibm.com . Be sure to include the information:

v Exact publication title v Publication form number (for example, GC26-1234-02) v Page, table, or illustration numbers v A detailed description of any information that should be changed

Read this first v

vi SAN384B-2 Installation, Service, and User Guide

Read this first ............iii

Summary of changes ...........iii

Fifth edition .............iii

Fourth edition ............iii

Third edition .............iii

Second edition ............iii

Getting help ..............iii

Taiwan Contact Information ........iv

How to send your comments .........v

Figures ...............xi

Tables ...............xiii

Safety notices ...........xv

Safety notices and labels ..........xv

Danger notices ............xv

Caution notices ...........xviii

Safety labels .............xx

Attention notices ...........xxi

Rack safety ..............xxii

Rack installation ...........xxii

Rack relocation (19" rack) ........xxiii

Safety inspections ...........xxiv

Removing AC power .........xxiv

External machine checks ........xxiv

Internal machine checks ........xxiv

Product recycling and disposal .......xxv

About this document .......xxvii

Who should read this document ......xxvii

Product documents ...........xxvii

Brocade documents ...........xxvii

IBM and Brocade product matrix .....xxviii

Accessibility features for SAN384B-2 ....xxviii

Chapter 1. Introduction ........1

Overview of the SAN384B-2 .........1

Hardware components ...........2

SAN384B-2 blades ............5

High availability .............7

Reliability ...............8

Serviceability ..............8

Software features .............9

Security ...............9

Network Manageability .........10

Chapter 2. Installing a SAN384B-2 in a

cabinet...............11

Items included with the SAN384B-2 ......11

Ordering the lift tool ...........12

World trade locations ..........12

United States locations .........12

Installation guidelines ...........13

Installing a SAN384B-2 in a 2109 C36 cabinet . . . 14

Time required ............14

Unpacking and assembling the lift tool ....16

Unpacking the SAN384B-2 ........17

Installing the port-side exhaust kit ......18

Torque requirements ..........21

Installing the exhaust kit hardware .....21

Installing the SAN384B-2 into the cabinet . . . 25

Port numbering .............29

Chassis slots ..............31

Cable organization ............31

Chapter 3. Starting and configuring the

SAN384B-2 .............33

Providing power to the SAN384B-2 ......35

Connecting the SAN384B-2 and host with a serial

cable ................35

Logging in to the serial console port ......36

Configuring the IP addresses ........36

Logging off the serial console port and

disconnecting the serial cable .......37

Establishing an Ethernet connection ......38

Customizing the switch name ........38

Customizing a chassis name.........38

Setting the Domain ID...........39

Setting the date and time ..........39

Setting the date ............39

Setting the time zone ..........40

Synchronizing local time .........40

Verifying the persistent PID feature ......41

Determining installed software licenses .....41

Installing transceivers and attaching cables ....42

Managing cables.............44

Planning for encryption (optional).......45

Configuring for encryption (optional)......46

Summary of procedure .........46

Avoid double encryption .........47

Verifying correct operation and backing up the

configuration ..............47

Fabric OS firmware updates .........48

Downloading and installing firmware ....49

Powering off the SAN384B-2 ........49

Chapter 4. Monitoring system

components ............51

Port, application, or encryption blade status . . . 55

Control processor blade (CP8) status ......59

Core switch blade (CR16-4) status .......61

Power supply status ...........63

Blower assembly status ..........63

WWN card status ............65

Chapter 5. Removing and installing

components ............67

Removing and installing the chassis door ....67

Time and items required .........67

Removing the chassis door ........67

Removing and installing cable management finger

assemblies ...............68

Time and items required .........68

Removing a cable management finger assembly 68

Installing a cable management finger assembly 69 Removing and installing port, application, and

encryption blades ............70

Time and items required .........70

Removing a port or application blade ....70

Installing a blade ...........72

Removing and installing blade filler panels ....72

Removing a filler panel .........72

Installing a filler panel..........73

Removing and installing a CP8 control processor

blade ................73

Time and items required .........74

Verifying the need for replacement .....74

Recording critical SAN384B-2 information . . . 75

Removing a control processor blade (CP8) . . . 76

Installing a control processor blade (CP8) . . . 77

Verifying operation of the new CP blade....78

Downloading firmware from an FTP server. . . 78

Downloading firmware from a USB device . . . 80

Completing the CP8 blade replacement ....81

Removing and installing a CR16-4 core switch blade 82

Verifying the necessity of replacement ....82

Time and items required .........82

Removing a CR16-4 core switch blade ....83

Installing a CR16-4 core switch blade .....83

Removing and installing a power supply ....84

Time and items required .........84

Removing a power supply ........84

Installing a power supply ........86

Removing and installing a blower assembly . . . 86

Time and items required .........86

Removing a blower assembly .......87

Installing a blower assembly........87

Removing and installing a WWN bezel and WWN

card.................88

Time and items required .........88

Verifying necessity of replacement ......88

Removing the WWN bezel and WWN card. . . 88

Installing the WWN bezel and WWN card . . . 89

Removing and installing transceivers ......90

Time required ............90

Items required ............90

Removing and installing an SFP+ optical

transceiver..............90

Removing and installing an mSFP optical

transceiver..............92

Removing and replacing inter-chassis link (QSFP)

cables ................93

Time and items required .........94

Removing an inter-chassis link (QSFP) cable . . 95

Installing an ICL cable ..........95

Possible ICL configurations ........96

Removing and replacing a SAN384B-2 chassis . . . 98

Time required ............99

Items required ............99

Verifying need for replacement .......99

Recording critical SAN384B-2 and SAN

information .............99

Disconnecting from the network and fabric . . 102 Removing components from the chassis . . . 103 Removing a SAN384B-2 from the cabinet . . . 104

Installing the replacement chassis .....105

Installing components into the new chassis . . 105

Downloading the configuration ......106

Verifying correct operation of system ....107

Reconnecting the system to the network and

fabric ...............108

Verifying correct configuration of the fabric . . 108

Cable routing table template .......110

Removing the batteries ..........111

Chapter 6. Installing new features . . 115

FC3632, FC3648- Installing a 16-Gb port blade (32

or 48 ports) ..............115

Time required ............115

Items required ............116

Procedures .............116

FC3633, FC3649- Installing an Enhanced 8-Gb port

blade (32 or 48 ports) ...........117

Time required ............117

Items required ............117

Procedures .............117

FC3864 - Installing an 8-Gb 64-port port blade . . 118

Time required ............118

Items required ............118

Procedures .............119

FC3890 - Installing an 8 Gbps Extension Blade

(FX8-24) ...............120

Time required ............120

Items required ............120

Procedures .............120

FC3895 - Installing an Encryption Blade (FS8-18) 121

Time required ............121

Items required ............122

Procedures .............122

Avoid double encryption ........123

FC7230 - Installing FIPS 140-2 Level 2 tamper proof

seals ................123

FC7871 - Installing a QSFP and inter-chassis license 123

Time required ............123

Items required ............123

Procedures .............123

FC7872 - Installing a QSFP and Enterprise

inter-chassis license ...........124

Time required ............124

Items required ............124

Procedures .............124

Appendix A. Product specifications 125

General specifications ..........125

System architecture ...........125

System size and weights..........127

viii SAN384B-2 Installation, Service, and User Guide

System blade and FRU weights ......128

Facility requirements ...........128

Environmental requirements ........129

Fibre Channel port specifications .......129

Power specifications ...........130

Data transmission ranges .........132

Power cords..............132

Appendix B. Application and

encryption blades .........133

FS8-18 blade..............133

FX8-24 blade .............133

Appendix C. Diagnostics and

troubleshooting ..........135

Obtaining chassis and component status ....135

Interpreting POST and boot results ......136

POST ...............136

Boot ...............137

Diagnostics ..............137

General troubleshooting ..........137

Link troubleshooting ...........140

Fault isolation ............140

Dust, dirt, or other contaminants ......141

Best practices for minimizing link loss ....141

Attenuation on LWL connections ......142

Appendix E. Port numbering .....151

Notices ..............155

Trademarks ..............156

Electronic emission notices .........156

Federal Communications Commission (FCC)

Class A Statement ...........156

Industry Canada Class A Emission Compliance

Statement .............157

Avis de conformité à la réglementation

d'Industrie Canada ..........157

European Union EMC Directive Conformance

Statement .............157

Germany Electromagnetic Compatibility

Directive ..............157

People's Republic of China Class A Electronic

Emission Statement ..........158

Japan Voluntary Control Council for Interference

(VCCI) Class A Statement ........159

Japan Electronics and Information Technology Industries Association (JEITA) Statement . . . 159 Korea Communications Commission (KCC)

Class A Statement ...........159

Russia Electromagnetic Interference (EMI) Class

A Statement .............159

Australia and New Zealand Class A Statement 159 Taiwan Class A Electronic Emission Statement 160

Appendix D. Tuning the system . . . 145

Identifying whether you need to tune your system 145

Before tuning ............147

Index ...............161

Contents ix

x SAN384B-2 Installation, Service, and User Guide

Figures

1. Port side of the SAN384B-2 (sample

configuration) ............3

2. Port side of the SAN384B-2 with the exhaust kit

installed (sample configuration) ......4

3. Blower (non-port) side of the SAN384B-2 5

4. Assembled lift tool with 24-inch load plate 17

5. Lift tool positioned next to the chassis on the

shipping tray ............18

6. Port-side exhaust kit assembly for 27 to 31 in.

(68.58 to 78.74 cm) cabinets .......20

7. Clip and retainer nut locations on exhaust side cabinet rails (example showing relative

positions) .............22

8. Shelf installed in cabinet ........23

9. Air duct installed into side slot in shelf 23

10. Installing the top rail assembly to the duct

assembly and cabinet rails .......24

11. Lift tool and chassis positioned at rear of

cabinet ..............25

12. Load plate extended inside the cabinet to the

exhaust kit shelf ...........26

13. Chassis half way into cabinet on load plate 27

14. Location of screws to attach the chassis to the

cabinet rails ............28

15. Attaching the vertical cable management

finger assemblies to the cabinet rails ....29

16. Cable design for the mSFP patch cables for the

FC8-64 high density port blade ......32

17. Flow of configuration tasks for the SAN384B-2 34

18. Encryption configuration ........47

19. FC16-32 port blade ..........55

20. FC16-48 port blade ..........56

21. FC8-32E port blade ..........56

22. FC8-48E port blade ..........56

23. FC8-64 port blade ..........57

24. FS8-18 encryption blade ........57

25. FX8-24 extension blade.........58

26. Control processor blade (CP8) ports and LEDs 60

27. Core switch blade (CR16-4) .......61

28. Power supply ............63

29. Blower assembly LEDs .........64

30. WWN bezel ............66

31. Chassis door ............68

32. Cable management finger assemblies ....69

33. Port, application, and encryption blade removal and installation (FC16-48 port blade

shown) ..............71

34. Filler panel removal and installation ....73

35. Removing the control processor (CP8) blade 77

36. Removing and replacing the core switch blade 83

37. Location of the two power supplies ....85

38. Removing and installing a power supply 86

39. Blower assembly removal and replacement 87

40. WWN bezel and card removal and installation 89

41. Optical transceiver (SFP+) extraction tool 91

42. Installing and removing a 16 Gbps SFP+ with pull tab (shown without cable attached) . . . 91

43. Removing and replacing an SFP+ optical

transceiver .............92

44. Optical mSFP transceiver ........93

45. QSFP cable and transceiver .......94

46. QSFP cable and transceiver (bail open) 95

47. QSFP cable connections for two SAN768B-2

chassis (sample configuration) ......96

48. Core/edge ICL topology for SAN384B-2 and

SAN768B-2 chassis ..........97

49. full mesh ICL topology for SAN384B-2 and

SAN768B-2 chassis ..........98

50. Battery locations on the CP8 blade ....112

51. Encryption blade battery location .....113

52. Identifying the origin of failure .....140

53. CR16-4 core blade ..........151

54. FC16-32 port blade..........152

55. FC16-48 port blade..........152

56. FC8-32E port blade .........152

57. FC8-48E port blade .........153

58. FC8-64 port blade ..........153

59. FS8-18 encryption blade ........153

60. FX8-24 extension blade ........153

xii SAN384B-2 Installation, Service, and User Guide

Tables

1. Brocade and IBM product and model

number matrix ..........xxviii

2. Blades available for the SAN384B-2 .....5

3. Installation tasks, time, and items required 15

4. Parts list for port-side exhaust kit for C36

cabinets ..............19

5. Torque requirements for mounting screws 21

6. Port and application blades available on the

SAN384B-2.............29

7. Configuration parameters ........36

8. Port, application, and encryption blade LED

descriptions ............58

9. CP blade LED descriptions .......60

10. CR16-4 blade LED descriptions ......62

11. Power supply LED descriptions ......63

12. Blower assembly LED descriptions .....64

13. Messages that may indicate WWN card failure 65

14. Steps for upgrading through multiple versions

of Fabric OS ............78

15. ICL connector port LEDs ........94

16. Critical information checklist example 100

17. Cable routing table for SAN384B-2 (64 ports

shown)..............110

18. General product specifications ......125

19. System architecture .........125

20. System sizes and weights .......127

21. System FRU weights .........128

22. Environmental requirements ......129

23. Power specifications .........130

24. Power demands per component .....131

25. Supported optics, speeds, cables, and

distances .............132

26. Environmental status and maintenance

commands ............136

27. Troubleshooting...........137

28. Specifications of LWL 10km transceivers 142

29. Maximum receive power of 2 Gbps LWL SFPs 143

30. External port to slotShow port mapping for

CR16-4 core blades..........151

xiv SAN384B-2 Installation, Service, and User Guide

Safety notices

This section contains information about:

v “Safety notices and labels” v “Rack safety” on page xxii v “Safety inspections” on page xxiv

Safety notices and labels

When using this product, observe the danger, caution, and attention notices contained in this guide. The notices are accompanied by symbols that represent the severity of the safety condition. The danger and caution notices are listed in numerical order based on their IDs, which are displayed in parentheses, for example (D004), at the end of each notice. Use this ID to locate the translation of these danger and caution notices in the Safety Notices publication that is shipped with this product.

The notices and statements are used in IBM documents. They are listed below in order of increasing severity of potential hazards. Follow the links for more detailed descriptions and examples of the danger, caution, and attention notices in the sections that follow.

v Note: These notices provide important tips, guidance, or advice. v “Attention notices” on page xxi: These notices indicate potential damage to

programs, devices, or data.

v “Caution notices” on page xviii: These statements indicate situations that can be

potentially hazardous to you.

v “Danger notices”: These statements indicate situations that can be potentially

lethal or extremely hazardous to you. Safety labels are also attached directly to products to warn of these situations.

v In addition to these notices, “Safety labels” on page xx may be attached to the

product to warn of potential hazards.

Danger notices

A danger notice calls attention to a situation that is potentially lethal or extremely hazardous to people. A lightning bolt symbol accompanies a danger notice to represent a dangerous electrical condition. Read and comply with the danger notices before installing or servicing this device.

DANGER

To prevent a possible shock from touching two surfaces with different protective ground (earth), use one hand, when possible, to connect or disconnect signal cables. (D001)

DANGER

Overloading a branch circuit is potentially a fire hazard and a shock hazard under certain conditions. To avoid these hazards, ensure that your system electrical requirements do not exceed branch circuit protection requirements. Refer to the information that is provided with your device or the power rating label for electrical specifications. (D002)

DANGER

If the receptacle has a metal shell, do not touch the shell until you have completed the voltage and grounding checks. Improper wiring or grounding could place dangerous voltage on the metal shell. If any of the conditions are not as described, STOP. Ensure the improper voltage or impedance conditions are corrected before proceeding. (D003)

DANGER

An electrical outlet that is not correctly wired could place hazardous voltage on metal parts of the system or the devices that attach to the system. It is the responsibility of the customer to ensure that the outlet is correctly wired and grounded to prevent an electrical shock. (D004)

A general electrical danger notice provides instructions on how to avoid shock hazards when servicing equipment. Unless instructed otherwise, follow the procedures in the danger notice.

xvi SAN384B-2 Installation, Service, and User Guide

DANGER

When working on or around the system, observe the precautions:

Electrical voltage and current from power, telephone, and communication cables are hazardous. To avoid a shock hazard:

v Connect power to this unit only with the IBM provided power

cord. Do not use the IBM provided power cord for any other product.

v Do not open or service any power supply assembly.

v Do not connect or disconnect any cables or perform installation,

maintenance, or reconfiguration of this product during an electrical storm.

v The product might be equipped with multiple power cords. To

remove all hazardous voltages, disconnect all power cords.

v Connect all power cords to a properly wired and grounded

electrical outlet. Ensure that the outlet supplies proper voltage and phase rotation according to the system rating plate.

v Connect any equipment that will be attached to this product to

properly wired outlets.

v When possible, use one hand only to connect or disconnect

signal cables.

v Never turn on any equipment when there is evidence of fire,

water, or structural damage.

v Disconnect the attached power cords, telecommunications

systems, networks, and modems before you open the device covers, unless instructed otherwise in the installation and configuration procedures.

v Connect and disconnect cables as described below when

installing, moving, or opening covers on this product or attached devices.

To disconnect:

1. Turn off everything (unless instructed otherwise).

2. Remove the power cords from the outlets.

3. Remove the signal cables from the connectors.

4. Remove all cables from the devices.

To connect:

1. Turn off everything (unless instructed otherwise).

2. Attach all cables to the devices.

3. Attach the signal cables to the connectors.

4. Attach the power cords to the outlets.

5. Turn on the devices.

(D005)

The weight of the SAN cabinet (2109-C36) with two SAN384B-2s is greater than 227 kg (500 lb), and has a fully loaded capacity of 816 kg (1795 lb). Under these conditions, the statement and notice apply.

Safety notices xvii

Delivery and subsequent transportation of the equipment

The customer should prepare his environment to accept the new product based on the installation planning information provided, with assistance from an IBM Installation Planning Representative (IPR) or IBM authorized service provider. In anticipation of the equipment delivery, the final installation site should be prepared in advance such that professional movers/riggers can transport the equipment to the final installation site within the computer room. If for some reason, this is not possible at the time of delivery, the customer will need to make arrangements to have professional movers/riggers return to finish the transportation at a later date. Only professional movers/riggers should transport the equipment. The IBM authorized service provider will only perform minimal frame repositioning within the computer room, as needed, to perform required service actions. The customer is also responsible for using professional movers/riggers in the case of equipment relocation or disposal.

>(>)500 lbs. 227 kg.

Caution notices

A caution notice calls attention to a situation that is potentially hazardous to people because of some existing condition. A caution notice can be accompanied by different symbols, as in the examples below:

DANGER

Heavy equipment—personal injury or equipment damage might result if mishandled. (D006)

a69i0333

If the symbol

is... It means....

A hazardous electrical condition with less severity than electrical danger.

A generally hazardous condition not represented by other safety symbols.

A specification of product weight that requires safe lifting practices. The weight range of the product is listed below the graphic, and the wording of the caution varies, depending on the weight of the device.

55 kg ( 121.2 lbs)

svc00169

>55kg (121.2 lb)

A potential hazard of pinching the hand or other body parts between parts.

P/N 18P5850-B

SJ000752

A hazardous condition due to moving parts nearby.

A hazardous condition due to the use of a laser in the product. Laser symbols are always accompanied by the classification of the laser as defined by the U.S. Department of Health and Human Services (for example, Class I, Class II, and so forth).

xviii SAN384B-2 Installation, Service, and User Guide

Read and comply with the caution notices before installing or servicing this device.

CAUTION: Energy hazard present. Shorting may result in system outage and possible physical injury. Remove all metallic jewelry before servicing. (C001)

CAUTION: The weight of this part or unit is more than 55 kg (121.2 lb). It takes specially trained persons, a lifting device, or both to safely lift this

55 kg ( 121.2 lbs)

>55kg (121.2 lb)

part or unit. (C011)

svc00169

CAUTION: The system contains circuit cards, assemblies, or both that may contain lead solder. To avoid the release of lead (Pb) into the environment, do not burn. Discard the circuit card as instructed by local regulations. (C014)

CAUTION: This product is equipped with a 3-wire (two conductors and ground) power cable and plug. Use this power cable with a properly grounded electrical outlet to avoid electrical shock. (C018)

CAUTION: This product might contain one or more of the devices: CD-ROM drive, DVD-ROM drive, DVD-RAM drive, or laser module, which are Class 1 laser products. Note the information:

v Do not remove the covers. Removing the covers of the laser product

could result in exposure to hazardous laser radiation. There are no serviceable parts inside the device.

v Use of the controls or adjustments or performance of procedures

other than those specified herein might result in hazardous radiation exposure.

(C026)

CAUTION: The power-control button on the device does not turn off the electrical current supplied to the device. The device might also have more than one connection to dc power. To remove all electrical current from the device, ensure that all connections to dc power are disconnected at the dc power input terminals. (C031)

CAUTION: Servicing of this product or unit is to be performed by trained service personnel only. (C032)

CAUTION: For CA residents only: IBM recommends installing this product in a room size of 62 cubic meters (2190 cubic feet) or larger at 0.4 ACH ventilation rate to reduce the concentrations of any chemicals emitted by the product.

Safety notices xix

Safety labels

As an added precaution, safety labels are often installed directly on products or product components to warn of potential hazards. These can be either danger or caution notices, depending upon the level of the hazard.

The actual product safety labels may differ from these sample safety labels:

DANGER

Hazardous voltage, current, or energy levels are present inside any component that has this label attached. Do not open any cover or barrier that contains this label. (L001)

DANGER

Rack-mounted devices are not to be used as a shelf or work space. (L002)

DANGER

Multiple power cords. The product might be equipped with multiple power cords. To remove all hazardous voltages, disconnect all power cords. (L003)

P/N 18P5850-B

DANGER

Hazardous voltage present. Voltages present constitute a shock hazard, which can cause severe injury or death. (L004)

CAUTION: Hazardous energy present. Voltages with hazardous energy might cause heating when shorted with metal, which might result in splattered metal, burns, or both. (L005)

CAUTION: Hazardous moving parts nearby (L008)

CAUTION: Pinch hazard. (L012)

SJ000752

xx SAN384B-2 Installation, Service, and User Guide

Attention notices

An attention notice indicates the possibility of damage to a program, device, or system, or to data. An exclamation point symbol may accompany an attention notice, but is not required. A sample attention notice follows:

Attention: Do not bend a fibre cable to a radius less than 5 cm (2 in.); you can damage the cable. Tie wraps are not recommended for optical cables because they can be easily overtightened, causing damage to the cable.

ESD precautions

Attention: Many of the field replaceable units (FRUs) are sensitive to electrostatic discharge (ESD), and can potentially be damaged by improper handling. Wear a wrist grounding strap connected to chassis ground (if the SAN384B-2 is plugged in) or a bench ground. Store all ESD-sensitive components in antistatic packaging.

Safety notices xxi

Rack safety

Rack installation

DANGER

Observe the precautions when working on or around your IT rack system:

v Heavy equipment—personal injury or equipment damage might result if

mishandled.

v Always lower the leveling pads on the rack cabinet.

v Always install stabilizer brackets on the rack cabinet.

v To avoid hazardous conditions due to uneven mechanical loading, always install the

heaviest devices in the bottom of the rack cabinet. Always install servers and optional devices starting from the bottom of the rack cabinet.

v Rack-mounted devices are not to be used as shelves or work spaces. Do not place

objects on top of rack-mounted devices.

v Each rack cabinet might have more than one power cord. Be sure to disconnect all

power cords in the rack cabinet when directed to disconnect power during servicing.

v Connect all devices installed in a rack cabinet to power devices installed in the

same rack cabinet. Do not plug a power cord from a device installed in one rack cabinet into a power device installed in a different rack cabinet.

v An electrical outlet that is not correctly wired could place hazardous voltage on the

metal parts of the system or the devices that attach to the system. It is the responsibility of the customer to ensure that the outlet is correctly wired and grounded to prevent an electrical shock.

(R001 part 1 of 2)

CAUTION:

v Do not install a unit in a rack where the internal rack ambient temperatures will

exceed the manufacturer’s recommended ambient temperature for all your rack-mounted devices.

v Do not install a unit in a rack where the air flow is compromised. Ensure that air flow

is not blocked or reduced on any side, front, or back of a unit used for air flow through the unit.

v Consideration should be given to the connection of the equipment to the supply circuit

so that overloading of the circuits does not compromise the supply wiring or overcurrent protection. To provide the correct power connection to a rack, refer to the rating labels located on the equipment in the rack to determine the total power requirement of the supply circuit.

v (For sliding drawers) Do not pull out or install any drawer or feature if the rack stabilizer

brackets are not attached to the rack. Do not pull out more than one drawer at a time. The rack might become unstable if you pull out more than one drawer at a time.

v (For fixed drawers) This drawer is a fixed drawer and must not be moved for servicing

unless specified by the manufacturer. Attempting to move the drawer partially or completely out of the rack might cause the rack to become unstable or cause the drawer to fall out of the rack.

(R001 part 2 of 2)

xxii SAN384B-2 Installation, Service, and User Guide

Rack relocation (19" rack)

CAUTION: Removing components from the upper positions in the rack cabinet improves rack stability during relocation. Follow these general guidelines whenever you relocate a populated rack cabinet within a room or building:

v Reduce the weight of the rack cabinet by removing equipment starting at the

top of the rack cabinet. When possible, restore the rack cabinet to the configuration of the rack cabinet as you received it. If this configuration is not known, you must do the :

– Remove all devices in the 32U position and above.

– Ensure that the heaviest devices are installed in the bottom of the rack

cabinet.

– Ensure that there are no empty U-levels between devices installed in the

rack cabinet below the 32U level.

– If the rack cabinet you are relocating is part of a suite of rack cabinets,

detach the rack cabinet from the suite.

– Inspect the route that you plan to take when moving the rack to eliminate

potential hazards.

– Verify that the route that you choose can support the weight of the loaded

rack cabinet. Refer to the documentation that came with your rack cabinet for the weight of a loaded rack cabinet.

– Verify that all door openings are at least 760 x 2030 mm (30 x 80 in.).

– Ensure that all devices, shelves, drawers, doors, and cables are secure.

– Ensure that the four leveling pads are raised to their highest position.

– Ensure that there is no stabilizer bracket installed on the rack cabinet

during movement.

– Do not use a ramp inclined at more than 10 degrees.

– Once the rack cabinet is in the new location, do the :

- Lower the four leveling pads.

- Install stabilizer brackets on the rack cabinet.

- If you removed any devices from the rack cabinet, repopulate the rack cabinet from the lowest position to the highest position.

– If a long distance relocation is required, restore the rack cabinet to the

configuration of the rack cabinet as you received it. Pack the rack cabinet in the original packaging material, or equivalent. Also, lower the leveling pads to raise the casters off of the pallet and bolt the rack cabinet to the pallet.

(R002)

Safety notices xxiii

Safety inspections

Perform the safety checks to identify unsafe conditions. Be cautious of potential safety hazards that are not covered in the safety checks. If unsafe conditions are present, determine how serious the hazards are and whether you should continue before you correct the problem.

Removing AC power

Perform the steps to remove the alternating current (ac) power:

1. Perform a controlled system shutdown.

2. Set the power switch to the off position.

3. Disconnect the power cables from the power source.

External machine checks

Perform the external machine checks:

1. Verify that all external covers are present and are not damaged.

2. Ensure that all latches and hinges are in correct operating condition.

3. Check the power cable for damage.

4. Check the external signal cable for damage.

5. Check the cover for sharp edges, damage, or alterations that expose the internal

6. Check that any unused serial ports are covered for dust and ESD protection.

7. Correct any problems that you find.

DANGER

Multiple power cords. (L003)

parts of the device.

The cover should be kept on the serial port whenever it is not being used.

Internal machine checks

Perform the internal machine checks:

1. Check for any non-IBM changes that might have been made to the machine. If any are present, obtain the “Non-IBM Alteration Attachment Survey” form, number R009, from the IBM branch office. Complete the form and return it to the branch office.

2. Check the condition of the inside of the machine for:

v Metal or other contaminants v Indications of water or other fluid v Fire or smoke damage

3. Check for any obvious mechanical problems, such as loose components.

4. Check any exposed cables and connectors for wear, cracks, or pinching.

xxiv SAN384B-2 Installation, Service, and User Guide

Product recycling and disposal

Refer to the IBM Systems Environmental Notices and User Guide (Z125-5823) shipped with the product for translated environmental statements and information regarding product recycling and disposal. This document may be provided either in printed version or on a CD-ROM. See “Removing the batteries” on page 111 for battery removal instructions, if needed to meet environmental regulations.

Safety notices xxv

xxvi SAN384B-2 Installation, Service, and User Guide

About this document

This document describes how to install and service the IBM System Storage SAN384B-2 fabric backbone product (Machine type 2499-416). Throughout this document, the product is referred to as the SAN384B-2, or more generically as system, device,orchassis, where appropriate. This document includes information

| |

specific to the SAN384B-2 running Fabric OS version 7.1.1 and later. For information about a Fabric OS version other than 7.1.1, refer to the documentation specific to your Fabric OS version.

Note: 7.0.0c is the latest FICON supported release.

The sections that follow provide information about:

v “Who should read this document” v “Product documents” v “Brocade documents” v “Accessibility features for SAN384B-2” on page xxviii

Who should read this document

This document is intended for trained service representatives who are responsible for installing and servicing the SAN384B-2, and for network administrators responsible for maintaining and using the SAN384B-2.

Product documents

The documents contain information related to this product. The documentation may be printed material, on the documentation CD that is shipped with the product, or available on the web through the IBM Support Portal or IBM Publications Center.

v IBM System Storage SAN384B-2 Installation, Service, and User Guide, GA32-0894

(this document, which is also available in accessible HTML format on the documentation CD)

v Safety Notices v IBM Systems Environmental Notices and User Guide, Z125-5823 v IBM Warranty v Implementing an IBM/Brocade SAN with 8 Gbps Directors and Switches, (an IBM

Redbook), SG24-6116

Note: This publication was written for earlier products, but many of the

v IBM System Storage FIPS 140-2 Security Seal Application Procedures (GA32-2220-00),

available online only for this optional feature.

Brocade documents

IBM switches and directors use software licensed from Brocade Communications Systems, Inc. You can find information related to the software that supports the SAN384B-2 in the documents on the CD-ROM supplied with this product. More recent versions of the Fabric Operating System (FOS) documentation may be

practices still apply.

available to match the version of FOS that you have installed. The publication CD includes information on how to locate and download the latest versions of FOS documentation and firmware updates.

Brocade Fabric OS

v Fabric OS Administrator's Guide

v Fabric OS Command Reference

v Fabric OS MIB Reference

v Fabric OS Message Reference

v Fabric OS Troubleshooting and Diagnostics Guide

v Fabric OS FCIP Administrator's Guide

v Fabric OS Encryption Administrator’s Guide Supporting Tivoli Key Lifecycle Manager

(TKLM) Environments

v FICON Administrator's Guide

Brocade Fabric OS optional features

v Fabric Watch Administrator's Guide

v Web Tools Administrator's Guide

IBM and Brocade product matrix

When you use any of the Brocade documents, such as Fabric Operating System (FOS) publications, you will notice that the model numbers reflect the corresponding Brocade products. Table 1 provides a product matrix for you to use to correlate the Brocade products and models to the IBM product names and machine types and model numbers. Products withdrawn from marketing are not listed.

Table 1. Brocade and IBM product and model number matrix

Brocade product name IBM product name

Brocade 6520 SAN96B-5 2498 Models F96 and N96

Brocade 6505 SAN24B-5 2498 Model F24, 249824G

Brocade 6510 SAN48B-5 2498 Model F48

Brocade DCX 8510-4 SAN384B-2 2499 Model 416

Brocade DCX 8510-8 SAN768B-2 2499 Model 816

Brocade DCX-4S SAN384B 2499 Model 192

Brocade DCX SAN768B 2499 Model 384

Brocade Encryption Switch SAN32B-E4 2498 Model E32

Brocade 7800 SAN06B-R 2498 Model R06

Brocade 5300 SAN80B-4 2498 Model B80

Brocade 300 SAN24B-4 2498 Models B24 and 24E

Accessibility features for SAN384B-2

Accessibility features help users with restricted mobility or limited vision successfully use information technology products. IBM strives to provide products with usable access for everyone, regardless of age or ability. This product uses standard Windows navigation keys.

IBM machine type and model number

xxviii SAN384B-2 Installation, Service, and User Guide

Accessibility features

Use and operation of this device is accomplished primarily through external devices which may provide different accessibility features.

The list includes the major accessibility features in the SAN384B-2 either directly or through external devices or interfaces:

v Keyboard-only operation v Interfaces that are commonly used by screen readers v Keys that are discernible by touch but do not activate just by touching them v Industry-standard devices for ports and connectors v The attachment of alternative input and output devices

Keyboard navigation

This product uses standard Microsoft Windows navigation keys. You can navigate the software and the product documentation from the keyboard by using the shortcut keys for your browser or screen-reader software. See your browser or screen-reader software Help for a list of shortcut keys that it supports.

Vendor software

The SAN384B-2 includes certain vendor software that is not covered under the IBM license agreement. IBM makes no representation about the accessibility features of these products. Contact the vendor for the accessibility information about its products.

Related accessibility information

You can view the publications for the SAN384B-2 in Adobe Portable Document Format (PDF) using the Adobe Reader. The PDFs are provided on a CD that is packaged with the product. An accessible HTML version of this document is also included on the documentation CD for this product.

IBM and accessibility

See the IBM Human Ability and Accessibility Center for more information about the commitment that IBM has to accessibility: www.ibm.com/able.

About this document xxix

xxx SAN384B-2 Installation, Service, and User Guide

Chapter 1. Introduction

This chapter introduces the features and components of the IBM System Storage SAN384B-2 fabric backbone. Throughout this document, the product is referred to as the SAN384B-2, or more generically as system, device,orchassis, where appropriate. This chapter contains the information:

v “Overview of the SAN384B-2” v “Hardware components” on page 2 v “High availability” on page 7 v “Reliability” on page 8 v “Serviceability” on page 8 v “Software features” on page 9

Overview of the SAN384B-2

The SAN384B-2 is part of IBM's industry-leading backbone-class product line, a highly robust class of network switching platform that combines breakthrough performance, scalability, and energy efficiency with long-term investment. Supporting open systems and System z the data growth and application demands of evolving enterprise data centers, achieve server, SAN, and data center consolidation, and reduce infrastructure and administrative costs. The IBM backbone-class product line provides the most reliable, scalable, high performance foundation for private cloud storage and highly virtualized environments. They are designed to increase business agility by adapting to dynamic growth and change, providing non-stop access to information, and reducing infrastructure and administrative costs.

, SAN backbones are designed to address

Key features of the SAN384B-2 include: v Up to 192 16-Gbps external ports in a single chassis, enabling high density SAN

configurations with reduced footprint.

v Support for 2, 4, 8, and 16 Gbps auto-sensing Fibre Channel ports. Trunking

technology groups up to eight ports to create high performance 64-Gbps ISL trunks between switches.

v The chassis also supports 10 Gbps FC-type SFPs in 16 Gbps port blades only and

also supports 10 GbE SFPs in the FX8-24 extension blades. These two types of SFPs are not interchangeable.

v The 10 Gbps ports can be configured manually on only the first eight ports of

the 16 Gbps port blades.

v Support for all of the application, port blade, and control processor (CP) blades

supported in the SAN768B-2 (with the exception of the Core Switch Blade), providing flexible system configurations and fewer types of new blades.

v Beginning with Fabric OS v7.0.1, up to nine chassis can be connected with the

use of 4x16 Gbps quad SFP (QSFP) inter-chassis links (ICLs). Fabric OS v7.0.0 permits up to six chassis to be linked.

v Support for high-performance port blades running at 2, 4, 8, 10, or 16 Gbps,

enabling flexible system configuration.

v Redundant and hot-swappable control processor and core switch blades, power

supplies, blower assemblies, and WWN cards that enable a high availability platform and enable nondisruptive software upgrades for mission-critical SAN applications.

v Universal ports that self-configure as E_Ports, F_Ports, EX_Ports and M_Ports

(mirror ports). 10 Gbps ports are E_Ports only.

v Diagnostic port (D_Port) functionality. v In-flight data cryptographic (encryption/decryption) and data compression

capabilities through the 16 Gbps port blades.

v Fibre Channel over IP (FCIP) functionality through the FX8-24 blade.

Attention: This product is not intended to be connected directly or indirectly by any means whatsoever to interfaces of public telecommunications networks.

Hardware components

The SAN384B-2 features a modular and scalable mechanical construction that allows a wide range of flexibility in installation, fabric design, and maintenance. The chassis may be mounted with the cables facing the front of the equipment rack or to the rear, and consists of the components:

v Up to four hot-swappable port blade assemblies can be configured in a single

chassis, delivering up to 192 16-Gbps Fibre Channel ports

v Two slots for control processor blades (CP8):

– A single active CP8 blade can control all 192 ports in the chassis. – The standby CP8 blade assumes control of the SAN384B-2 if the active CP

fails

v Two slots for core switch blades (CR16-4):

– CR16-4 blade interconnects all port blades – Inter-chassis link (ICL) connectors to connect to as many as nine neighboring

chassis (with FOS 7.0.1). Six chassis can be connected with FOS v7.0.0.

– Both CR16-4 blades are active

v Modular hot-swappable port blades:

– 64-port, 8-Gbps blades (FC8-64) – 32-port, 8-Gbps blades (FC8-32E) – 48-port, 8-Gbps blades (FC8-48E) – 32-port, 16-Gbps blades (FC16-32) – 48-port, 16-Gbps blades (FC16-48)

v Modular hot-swappable application blades:

– FX8-24: 24-port (12 FC, 10 GbE, 2 10GbE) FCIP extension blade enabling long

distance communication over existing IP infrastructure.

v Modular hot-swappable encryption blades:

– FS8-18: 16-port, 8 Gbps, up to 4 blades per chassis, supporting in-flight data

cryptographic (encryption/decryption) and data-compression capabilities.

v Modular hot-swappable field replaceable units (FRUs):

– Two blower assemblies – Two power supplies (100-240 VAC auto-sensing). 220 VAC (nominal) is

recommended for efficiency. A second power supply, connected to a separate power source is needed to support high availability

– Two WWN cards

2 SAN384B-2 Installation, Service, and User Guide

– Blades use small form-factor pluggable (SFP+, and mSFP) optical transceivers.

SFP+ and mSFP transceivers support speeds of 2, 4, 8, 10, or 16 Gbps.

Note: The 8-Gbps SFP+s and mSFPs auto-negotiate at 2, 4, and 8 Gbps. The

16-Gbps SFP+s auto-negotiate at 4, 8, and 16 Gbps. The 10 Gbps speeds must be manually set and require special 10 Gbps SFP+ transceivers.

– QSFP-based inter-chassis link (ICL) cabling running at 64 Gbps (four 16 Gbps

clustered in a single quad connector and cable).

v Port-side exhaust kit (standard), which directs the exhaust airflow to the cabinet

service aisle

v All blades are serviced from the port side of the SAN384B-2. Blowers, power

supplies, and power cables are serviced from the nonport side

v World Wide Name (WWN) cards on the nonport side, with WWN status LEDs

located under the bezel

v Two vertical cable management finger assemblies and a chassis door provide for

efficient cable management.

Note: Airflow in the SAN384B-2 is from the non-port (non-cable) side to the left

side and port side of the chassis. With the port-side exhaust kit installed (see

Figure 2 on page 4, all air flows out the vents on the port side of the chassis. Figure 1 shows a sample configuration of the port side of the SAN384B-2 with four FC8-48 port blades installed.

Figure 1. Port side of the SAN384B-2 (sample configuration)

1 Port blade (example, 4x) 3 Control processor blade (2x)

2 Core switch blade (2x) 4 Exhaust vent

384b071

Chapter 1. Introduction 3

Figure 2 shows the SAN384B-2 with the port-side exhaust kit installed over the chassis exhaust vent (sample configuration). The exhaust is routed from the chassis exhaust vent through the port-side exhaust kit. The exhaust from the left side exits through the vent grill below the chassis.

Figure 2. Port side of the SAN384B-2 with the exhaust kit installed (sample configuration)

Figure 3 on page 5 shows the non-port side of the SAN384B-2.

384b072

4 SAN384B-2 Installation, Service, and User Guide

Figure 3. Blower (non-port) side of the SAN384B-2

1 WWN bezel 3 Blower assembly (2x)

2 Power supply (2x) 4 Label with serial number and WWN

384b003

SAN384B-2 blades

Table 2 summarizes the port, application, control processor, and core switch blades that are available for the SAN384B.

Table 2. Blades available for the SAN384B-2

Description Feature Code Name Function

Control processor blade N/A CP8 The CP8 blade contains the

control plane for the chassis. There are two CP8 blades for redundancy. This control processor blade is compatible with the SAN768B-2, SAN384B-2, SAN768B, and SAN384B.

Chapter 1. Introduction 5

Table 2. Blades available for the SAN384B-2 (continued)

Description Feature Code Name Function

Core switch blade N/A CR16-4 The CR16-4 blade contains

the ASICs for switching between port blades. There can be up to 192 16-Gbps (256 8 Gbps) total ports for port blades. Each core switch blade connects to 128 backplane ports. Core switch blades have additional front port connectivity to connect multiple chassis and backplane connections for the storage server blade. This core switch blade is compatible only with the SAN384B-2.

32-port 16-Gbps port blade FC3632 FC16-32 A 32-port port blade

supporting 2, 4, 8, 10, and 16 Gbps Fibre Channel port speeds. The blade also supports port-based in-flight encryption / decryption and compression / decompression. This port blade is compatible with the SAN384B-2 and SAN768B-2.

48-port 16-Gbps port blade FC3648 FC16-48 A 48-port port blade

32-port 8-Gbps port blade FC3633 FC8-32E A 32-port port blade

supporting 2, 4, and 8 Gbps Fibre Channel port speeds. This port blade is compatible with the SAN384B-2 and SAN768B-2. This blade requires Fabric OS v7.0.1 or later to run in this chassis.

6 SAN384B-2 Installation, Service, and User Guide

Table 2. Blades available for the SAN384B-2 (continued)

Description Feature Code Name Function

48-port 8-Gbps port blade FC3649 FC8-48E A 48-port port blade

supporting 2, 4, and 8 Gbps Fibre Channel port speeds. This port blade is compatible with the SAN384B-2 and SAN768B-2. This blade requires Fabric OS v7.0.1 or later to run in this chassis.

64-port 8-Gbps port blade FC3864 FC8-64 A 64-port port blade

supporting 2, 4, and 8 Gbps port speeds with mSFPs. This port blade is compatible with the SAN768B-2, SAN384B-2, SAN768B, and SAN384B

FCIP extension blade FC3890 8 Gbps Extension Blade

(FX8-24)

Encryption blade FC3895 FS8-18 The FS8-18 blade enables

The FX8-24 blade enables FCIP functionality over existing IP infrastructure. It has 12 FC ports, ten 1 GbE ports, and two 10 GbE ports available. This application blade is compatible with the SAN768B-2, SAN384B-2, SAN768B, and SAN384B

data cryptographic (encryption/decryption) and data-compression capabilities for data-at-rest. It has 16 Fibre Channel 8 Gbps optical SFP ports. This application blade is compatible with the SAN768B-2, SAN384B-2, SAN768B, and SAN384B.

High availability

The features contribute to the SAN384B-2 high-availability design: v Redundant, hot-swappable FRUs, including blades, power supplies, fan

assemblies, and WWN cards

v Enhanced data integrity on all data paths v Fabric Shortest Path First (FSPF) rerouting around failed links v Integration with Simple Network Management Protocol (SNMP) managers v Automatic control processor failover v Nondisruptive "hot" software code loads and activation v Easy configuration, save, and restore v Hot-swappable World Wide Name (WWN) cards

Chapter 1. Introduction 7

Reliability

The high-availability software architecture of the SAN384B-2 provides a common framework for all applications that reside on the system, allowing global and local status to be maintained through any component failure. High-availability elements consist of the High Availability Manager, the heartbeat, the fault/health framework, the replicated database, initialization, and software upgrade.

The High Availability Manager controls access to the standby control processor, facilitates software upgrades, prevents extraneous CP failover activity, closes and flushes streams, provides flow control and message buffering, and supports a centralized active and standby state.

The SAN384B-2 uses the error detection and correction mechanisms to ensure reliability of data:

v Error Detection and Correction over main control processor memory. v Error Detection and Correction mechanism, which checks for encoder errors and

fault isolation (EDFI), such as cyclic redundancy checking (CRC), parity checking, checksum, and illegal address checking.

v Power-on self test (POST) v Dual control processors that enable hot, nondisruptive fast firmware upgrades v Each control processor contains one serial port and two Ethernet ports, for

management and for service. The standby control processor monitors diagnostics to ensure the system is operational should a failover be necessary.

v Bus monitoring and control of blades and other field-replaceable units (FRUs).

Serviceability

The SAN384B-2 provides the features to enhance and ensure serviceability:

v Modular design with hot-swappable components v Flash memory that stores two firmware images per control processor v USB port on control processor blades for most tasks that formerly required an

FTP/SCP server, including software and firmware upgrades.

v Nonvolatile random-access memory (NVRAM), containing the OEM serial

number, IBM serial number, revision information, and part number information

v Background health-check daemon v Memory scrubber, self test, and bus ping to determine if a bus is not functioning v RASlog messages v SMI-S compliant v Hardware and software watchdog timers v Status LEDs v Predictive diagnostics analysis through Fabric Watch v SNMP (including version 3) integration with higher-layer managers v Vertical cable management finger assemblies to accommodate the horizontal

orientation of the blades

8 SAN384B-2 Installation, Service, and User Guide

Software features

The Fabric OS allows any Fibre Channel-compliant device to attach to the switches as long as it conforms to the device login, name service, and related Fibre Channel standards. Each operating environment requires that a Fibre Channel host bus adapter (HBA) be available with a standards-compliant driver for correct interface to the fabric.

Fabric OS consists of a set of embedded applications running on top of an embedded Linux operating system kernel. These applications include:

v Name server v Alias server v Zone server v Simple Network Management Protocol (SNMP) agent v SMI-S compliant API v Syslog auditing v RCS (Reliable Commit Service) v NTP v Tasks to manage address assignment, routing, link initialization, fabric

v FICON

v FICON Accelerator (optional feature), which is designed to support secure

initialization, link shutdown, chassis shutdown, and the user interface.

with CUP Activation (optional feature), providing in-band management of the supported SAN b-type switch and director products by system automation for z/OS from IBM System z10 EC, z10 BC, z9 EC, z9 BC, zSeries 990, 900, 890, and 880 servers.

high-speed data movement between multiple locations

Security

The list below highlights some of the key security features available for the SAN384B-2 and for other enterprise-class products running Fabric OS 7.0.1 or later.

v DH-CHAP v SSHv2 (using AES, 3DES, RSA) v HTTPS (using AES) v SNPMv3 v FC-SP v Secure RPC v Secure file copy (SCP) v Telnet disable v Telnet timeout v IP filters (block listeners) v Secure passwords (centralized control through RADIUS/CHAP) v Multiple user accounts (MUAs). Up to 255. v Role-based access controls (RBACs) v Administrative domains/Virtual fabrics v Boot PROM password reset v Password hardening policies v Upfront login in Web Tools v Login banner

Chapter 1. Introduction 9

v Monitoring of attempted security breaches (through audit logging) v Monitoring of attempted security breaches (through Fabric Watch Security Class) v Fibre Channel security policies: DCC and SCC v Trusted Switch (FCS) for central security management v Management access controls (SNMPv3, Telnet, FTP, serial port, front panel) v Hardware-enforced zoning by WWN, domain/port ID, or both v Default zoning v RSCN suppression and aggregation v Configurable RSCN suppression by port v NTPv3 (to synchronize timestamps) v Event auditing v Change tracking v Firmware change alerts in Fabric Manager v Persistent port disable v Persistent domain ID v E_Port disable

Installation of the optional Federal Information Processing Standards 140-2 (FIPS 140-2) security seals to the SAN384B-2 chassis, blades, and other components is available through Feature Code 7230. The IBM System Storage FIPS 140-2 Security Seal Application Procedures (GA32-2220-00) publication provides complete instructions for installing this feature on this and other models. The publication is available through the IBM Support Portal, www.ibm.com/supportportal or the IBM Publications Center www.ibm.com/shop/publications/order. Search by title or publication form number on either site.

Network Manageability

The SAN384B-2 has a single domain and is managed as a single element with the Network Advisor. The SAN384B-2 responds to its own IP address and appears as a separate entity to the Telnet protocol and SNMP.

All management interfaces, such as Telnet, Web Tools, standards compliant SMI-S, and Management Server, support a "port N within blade M" naming scheme.

The SAN384B-2 supports SNMPv1 and SNPMv3. When SNMP devices send SNMP messages to a management console running SAN management software, the information is stored in a management information base (MIB). Fabric OS 7.0 and later supports the latest Fibre Alliance Fibre Channel Management (FCMGMT) and Storage Management Initiative (SMI) MIBs, which allow common information necessary for management software to provide information to a SAN administrator. Refer to the Fabric OS MIB Reference for additional MIB information.

10 SAN384B-2 Installation, Service, and User Guide

Chapter 2. Installing a SAN384B-2 in a cabinet

The SAN384B-2 is only available for installation in the IBM TotalStorage 2109 SAN Switch Cabinet C36. This product is to be installed and serviced only by qualified IBM service representatives. The SAN384B-2 can be ordered pre-installed in the cabinet, or it can be added to an existing C36 cabinet. The cabinet is designed to support a total of three SAN384B-2s. Each installation of the SAN384B-2 requires the port-side exhaust vent kit, which directs the exhaust to the service aisle and also serves as the rack installation kit. If three SAN384B-2 products are ordered, two will be pre-installed in the C36 cabinet, and the third will be installed in the cabinet at the customer site.

This chapter describes how to install a SAN384B-2 into a C36 cabinet, and how to remove the SAN384B-2 from the cabinet in the event you need to move or replace the system. If all SAN384B-2 units are already installed in the cabinet, continue on to Chapter 3, “Starting and configuring the SAN384B-2,” on page 33. The installation requires a minimum of two people for a safe installation.

Attention: Refer to “Safety notices” on page xv for general safety instructions “Safety notices and labels” on page xv, and “Rack safety” on page xxii before performing any installation or service procedures.

CAUTION: The weight of this part or unit is more than 55 kg (121.2 lb). It takes specially trained persons with a lifting device to safely lift this part or unit. (C011)

55 kg ( 121.2 lbs)

svc00169

CAUTION: A fully populated SAN384B-2 weighs approximately 68 kg (150 lb). Before you install it, verify that the additional weight of the chassis does not exceed the cabinet's weight limit or unbalance the cabinet. When you calculate the additional weight, include the weights of all components that can potentially be added, to avoid overloading in the future.

Items included with the SAN384B-2

Each SAN384B-2 ships with the components: v One SAN384B-2 chassis populated with:

– Control processor blades (CP8) – Core switch blades (CR16-4) – Port blades and application blades specified on customer order – SFP+, mSFP, and QSFP optical transceivers as specified on the customer order – Blade slot filler panels (for slots not filled by blades) – Port side exhaust kit, which also functions as the rack mount kit

– WWN cards and WWN bezel – Power supplies – Blower assemblies – Cable management finger assemblies – Chassis door

v Accessory kit containing:

– Documentation CD (contains documents related to the product and Fabric

OS)

– ESD grounding strap – USB device – RS-232 serial cable. The RS-232 cable has an adapter at one end that can be

removed to provide an RJ-45-style connector.

– Warranty – Safety notices

Ordering the lift tool

Important

The lift tool is required only when you install an additional SAN384B-2 or when you install or remove the SAN384B-2 from the cabinet. Ensure that the lift tool will be available on location at the time of the installation.

The ordering procedures for the lift tool vary depending on your location. You should direct questions about these procedures to your regional representative.

World trade locations

The ordering procedures are for world trade locations:

v Order the lift tool by using the parts order system, like any other part. v Use the part numbers when you order:

– Lift tool: PN 09P2481 – The lift tool will include the required 24–inch load plate: PN 11P4369

v You do not record parts usage. v Return the lift tool and the 24–inch load plate to the parts center after you

complete the installation or removal of the SAN384B-2.

United States locations

In the United States, call UPS Logistics at 800–528–6070 to order the lift tool and the 24–inch load plate.

Note: For the SSR branch and territory, the United States cannot order the lift tool

or 24–inch load plate through the parts order system. UPS Logistics are used to ship and return the lift tool and 24–inch load plate.

Use the part number when you order: v Lift tool: PN 09P2481 (order includes 24–inch load plate: PN 11P4369 )

12 SAN384B-2 Installation, Service, and User Guide

Attention: When you order the lift tool, you will receive an 18–inch load plate

and a 24-inch load plate. Do not use the 18–inch load plate. You must use the 24–inch load plate when you install the SAN384B-2 to be able to safely install this product. The 24-inch load plate includes a platform with a middle section that can slide out to extend across the gap between the lift tool and the mounting position inside the C36 cabinet.

You must provide the information when you order the lift tool. This information is necessary to ensure that the lift tool is delivered when you need it. Failure to provide this information might delay the completion of the order request and the shipping request. It might also result in a time and date to return the tool that is different from what you need.

v Phone number and customer contact v Account code: 98577 v Time and date of delivery v Accurate destination address with ZIP code v Time and date of return pickup

You must return the lift tool at the time that was scheduled with UPS Logistics. If you need to change the scheduled return time or date, contact UPS Logistics.

You are responsible for ensuring that all of the paperwork and components are packed and restored in the arbocrate (shipping container) of the lift tool. Ensure that the lift tool is functioning properly before you release the tool to UPS Logistics for return. You are accountable for the lift tool until UPS Logistics picks up the lift tool for return delivery to their parts storage facility.

Contact your branch office tools coordinator or your region specialist if you have any questions or concerns.

Installation guidelines

Follow these general installation guidelines:

1. Provide a space that is 9 rack units (9U) high, 61.19 cm (24.09 in.) deep, and

43.74 cm (17.22 in.) wide. 1U is equal to 4.45 cm (1.75 in.).

2. Ensure that dedicated electrical branch circuits with the requirements are met:

Note: See “Power specifications” on page 130 in the “Specifications” appendix

v 200–240 VAC, 50–60 Hz (two branch circuits) v Two cables for the 200–240 VAC service v Protected by a circuit breaker in accordance with local electrical codes v Supply circuit, line fusing, and wire size adequate to the electrical rating on

the chassis nameplate

v Location close to the chassis and easily accessible v Grounded outlets installed by a licensed electrician and compatible with the

power cords Attention: To maximize fault tolerance, connect each power cord to a

separate power source.

3. To ensure adequate cooling, plan to install the chassis with the port side facing the aisle where exhaust air is released (usually called the service aisle). This prevents the fans from pulling in heated exhaust air.

for specific requirements depending on your chassis configuration.

Chapter 2. Installing a SAN384B-2 in a cabinet 13

4. Plan for managing the cables before you install the chassis. A fully populated SAN384B-2 will have a large number of cables that must be carefully routed to minimize problems with installation and replacement of components, and in order to maintain the minimum bend radius required for optical cables. Due to port density and the potentially large number of cables, if cables are not routed to the sides, then removal and replacement of blades and other components may be difficult to accomplish. Refer to “Managing cables” on page 44 for more specific information. You can manage the cables in a variety of ways, such as:

v Routing the cables through the vertical cable management finger assemblies

installed on either side of the chassis

v Routing the cables out to either side of the chassis v Routing the cables through the cable channels on the sides of the cabinet v Using patch panels

5. Ensure that the are available for configuration:

v Workstation with an installed terminal emulator, such as HyperTerminal v Serial cable (provided) v Three Ethernet cables (including one spare) v Access to an FTP server for backing up the switch configuration or collecting

supportsave output data (optional)

v Brocade USB drive for collecting supportsave output data (optional) v SFPs and compatible cables

6. Ensure that the air intake vents have a minimum of 2 inches of airspace.

7. Ensure that the air temperature on the air intake side is less than 40°C (104°F )

during operation.

Installing a SAN384B-2 in a 2109 C36 cabinet

This section describes how to install the SAN384B-2 in the Model C36 cabinet. These procedures use parts that are included in the hardware accessory kit and the port-side exhaust kit, which also functions as a lower supporting shelf. No rack-mount rail kit is required for this installation.

To safely complete the installation, a minimum of two people are required.

Time required

Allow approximately 3 hours to complete this entire procedure. This total includes unpacking, assembling, disassembling, and repacking the lift tool. The time estimate is for the physical installation of the SAN384B-2 only. It does not include installing Ethernet cables, transceivers, attaching and routing the fiber optic cables, or completing the initial configuration.

The SAN384B-2 and the lift tool should be delivered to a location near to the final installation, with clear aisles for maneuvering the lift tool loaded with the chassis. Since the lift tool can be used to move the chassis the short distance from the delivery location to the installation, it is recommended that you assemble the lift tool before starting the installation steps.

14 SAN384B-2 Installation, Service, and User Guide

Attention: If optional feature FC 7230, FIPS 140-2 Level 2 Tamper Proof Seals is

also ordered, be sure to sequence the installation steps to allow for application of the FIPS seals on the chassis and port side exhaust kit prior to installing the chassis in a rack. These locations may be difficult to access once the chassis is installed. Refer to the IBM System Storage FIPS 140-2 Security Seal Application Procedures (GA32-2220-00) publication for complete instructions.

Note: Brief assembly instructions for the lift tool are attached to the back of the lift

tool. Additional instructions are included below in “Unpacking and assembling the lift tool” on page 16.

Table 3 provides a summary of time estimates for the different installation tasks and the tools required for each task.

Table 3. Installation tasks, time, and items required

Installation task Time estimate Items required

Unpacking and assembling the lift tool

Site preparation and unpacking the SAN384B-2

Installing the port-side exhaust kit

Mounting and securing the SAN384B-2 in the rack

Installing power cables and powering on the SAN384B-2

Establishing serial connection, logging on to the SAN384B-2, and configuring IP addresses.

Installing an Ethernet cable, opening a Telnet session, and configuring the SAN384B-2 domain ID, date and time, and additional system parameters. Verifying and backing up the configuration.

Installing transceivers as needed

Attaching fiber optic cables, cable wraps, and cable guides

15 minutes No special tools required.

30 minutes #2 Phillips screwdriver (for

cable management comb) Pallet jack (if the shipment has not been positioned near the installation site)

30 minutes Torque wrench with #2

Phillips screwdriver tip Flathead screwdriver

30 minutes Torque wrench with #2

Phillips screwdriver tip Lift tool and load plate

20 minutes Power cables

20 minutes Serial cable (provided in the

accessory kit). Workstation computer with a serial port or terminal server port and a terminal emulator application (such as HyperTerminal). Ethernet IP addresses for the chassis and for both control processor blades (total of 3 IP addreses).

20 minutes Ethernet cable for Telnet

access. Refer to the Fabric OS Administrator’s Guide.

20 minutes (longer if using high density port blades)

2-3 hours Fiber optic cables and cable

SFP+, mSFP, and QSFP optical transceivers as needed.

wraps.

Chapter 2. Installing a SAN384B-2 in a cabinet 15

Table 3. Installation tasks, time, and items required (continued)

Installation task Time estimate Items required

Disassembling and packing the lift tool

20 minutes No special tools required.

Unpacking and assembling the lift tool

Assembling the lift tool before starting the installation will simplify the installation.

The lift tool consists of several parts, including: v The fully assembled main vertical section of the lift tool with wheels, wheel lock,

cables and winch attached

v Attachable lift forks, which slide onto the front of the lift tool and are secured in

place by spring-loaded pins and ring pins

v 24-inch load plate with sliding middle section (do not use the 18-inch solid

single-piece load plate)

v Anti-tip bars v Retention straps v Wheel chocks

Assembly instructions are attached to the back of the main vertical section of the lift tool. The supplemental information may help with the assembly.

1. With one person at either end, lift the main section of the lift tool out of the shipping crate.

2. Review the assembly instructions attached to the back of the lift tool, if necessary.

3. With the lift tool still horizontal, insert the two legs with caster wheels into the holes in the front of the lift tool.

4. Pull up on the spring-loaded leg lock pins, sliding the legs in until the pins snap into place through the holes in the legs, securing them in place.

5. Tilt the lift tool upright, resting on all four wheels. Set the wheel brake by stepping down on the brake pedal. (Note the brake release on the left side of the brake pedal.)

6. Attach the two forks to the lift tool, sliding the two holes in each over the ends of the two bars. If the winch is in the lowest position, you may need to raise it to provide enough clearance to slide the forks into position. Secure each lifting fork in place with two ring-pins.

7. Attach the 24-inch load plate, by slipping the top curved portion under the horizontal bar, and resting the load plate on the forks.

8. Attach the anti-tip bars (recommended to provide additional stability when the loaded lift tool is raised more than 45 cm (18 in) high). Install these from the rear of the lift tool, by sliding them inside the horizontal legs, pulling up on the leg lock pins to allow the pins to engage the holes in the legs and the anti-tip bars.

9. Secure the anti-tip brackets to the lift tool with the supplied brackets and bolts.

10. The lift plate has a middle section that can be extended to the right (when viewed from the back of the lift tool). This middle section is secured in place by two spring-loaded pins. Familiarize yourself with releasing the pins and sliding this section. There are two stops: half-way extended and fully

16 SAN384B-2 Installation, Service, and User Guide

extended. This middle section will need to be fully extended during the installation to safely span the gap between the lift tool and the cabinet mounting position.

11. Move the assembled lift tool and retention straps near the equipment to be installed. Figure 4 shows the assembled lift tool with the 24-inch load plate installed.

Figure 4. Assembled lift tool with 24-inch load plate

Unpacking the SAN384B-2

CAUTION: The weight of this part or unit is more than 55 kg (121.2 lb). It takes specially trained persons with a lifting device to safely lift this part or unit. (C011)

55 kg ( 121.2 lbs)

To unpack the SAN384B-2, follow these steps:

1. If the product needs to be transported a long distance, or if there are uneven floors to cross, keep the product in its original packaging, and relocate the entire shipment close to the installation location, using a pallet jack to lift and move it.

Note: The standard packaging does not incorporate a wood pallet and pallet

brackets. The chassis sits on top of a plastic shipping tray.

2. Once the shipment is in a location close to the installation, cut the bands that encircle the packaging.

3. Lift the cardboard box off the chassis. Installation kits are packed within this outer carton, so you may need to open the top of the box to remove the kits or to press down on them as you lift the outer carton. Save the packing materials if you are returning an old chassis.

svc00169

Chapter 2. Installing a SAN384B-2 in a cabinet 17

4. Remove the port side exhaust kit, hardware accessory kit, chassis door, cable management finger assemblies, and foam from the top of the chassis. Remove the loose foam blocks from the corners of the chassis. Remove the anti-static plastic from the chassis.

5. Place the kits and other installation pieces near the installation.

6. Move the lift tool next to the plastic shipping tray at the blower and power

supply end of the chassis. Position the lift tool with its left side next to the shipping tray (see Figure 5).

Figure 5. Lift tool positioned next to the chassis on the shipping tray

7. Using the lift tool winch mechanism, adjust the height of top of the load plate to slightly below the bottom surface of the chassis.

8. Set the lift tool brake.

9. Carefully slide the chassis across the foam blocking in the shipping tray and

onto the center of the load plate. Do not use any of the handles on the blowers or power supplies to move the chassis.

10. Attach the lift tool retention straps to secure the chassis to the load plate. This is particularly important if you will be moving the chassis across any uneven floor, or will be raising the chassis more than 45 cm (18 inches).

11. For safety considerations during moving, lower the load platform to its lowest

position.

12. Release the lift tool brake, and carefully move the chassis near the cabinet for installation.

Installing the port-side exhaust kit

Complete the instructions to install the port-side exhaust kit in a 2109-C36 cabinet before installing the SAN384B-2 chassis.

18 SAN384B-2 Installation, Service, and User Guide

Exhaust kit parts list

Table 4 lists items illustrated in Figure 6 on page 20.

Table 4. Parts list for port-side exhaust kit for C36 cabinets

Item Description Quantity

A Top rail 1

B Duct 1

C Shelf 1

D 10-32 x .5 in. (1.27 cm)

Phillips screw (blue Loctite on threads)

E 10-32 x .63 in.(1.60 cm)

Phillips screw with square cone washer

F 10-32 clip nut for cabinets

that have rails with round holes

G 10-32 retainer nut for

cabinets that have rails with square holes

H Alignment washer for

cabinets that have rails with square holes

I 6-32 x .25 in. (.635 cm)

Phillips screw

Chapter 2. Installing a SAN384B-2 in a cabinet 19

I-1

I-3

I-2

I-4

I-5

I-6

I-7

Port Side

(Exhaust)

DEF

10-32 x .5" 10-32 x .63"

10-32 Clip Nut

GH I

10-32 Retainer Nut Alignment Washer

Figure 6. Port-side exhaust kit assembly for 27 to 31 in. (68.58 to 78.74 cm) cabinets

20 SAN384B-2 Installation, Service, and User Guide

6-32 x .25"

384b032

Torque requirements

Use the torque settings when tightening screws that secure the port-side exhaust kit and SAN384B-2 to the equipment cabinet.

Table 5. Torque requirements for mounting screws

Screw size Torque

6-32 x .25 in. (.635 cm) Phillips screw 8.75 in.-lbs (10 cm-kg)

10-32 x .63 in.(1.60 cm) Phillips screw 32 in.-lbs (36.86 cm-kg)

Installing the exhaust kit hardware

1. Remove the rear door (exhaust side) from the C36 cabinet. Set the door aside, away from the installation.

2. The exhaust side of the port side exhaust kit will be installed facing the rear of the C36 cabinet, and the port side of the SAN384B-2 chassis will also face this direction.

3. Install 10 clip nuts (F in Figure 6 on page 20) or retainer nuts (G) in the rear vertical cabinet rail locations shown in Figure 7 on page 22, and 4 clip nuts or retainer nuts in the front vertical cabinet rails. Eight clip nuts and retainer nuts are provided with the exhaust kit, and six are provided with the hardware accessory kit. Install the lower two nuts at the same relative locations on all four cabinet vertical rails, to provide a level mounting of the shelf. The fourteen nuts will secure the eight 10-32 screws that mount the port side exhaust kit shelf (position 23 in Figure 7 on page 22) and the six that are used to attach the SAN384B-2 chassis to the cabinet (positions 25, 28, and 30 in Figure 7 on page

22).

Note: For rails with round holes, use clip nuts. For rails with square holes, use

retainer nuts. Figure 7 on page 22 is only an example showing relative positions for these nuts in the cabinet rails to mount the shelf and chassis. You can mount the shelf and chassis in9Uofcabinet space higher or lower in the cabinet than shown.

Note: Screws, clip nuts, and retainer nuts for attaching the SAN384B-2 to the

cabinet are provided in the SAN384B-2 hardware accessory kit.

Chapter 2. Installing a SAN384B-2 in a cabinet 21

clip nut attachment for round-hole rails

Setup for Rails

with Square Holes

clip or retainer

nut locations

for chassis

clip or retainer

nut locations

for shelf

rail

384b046

retainer nut

(Item G)

Rail

Figure 7. Clip and retainer nut locations on exhaust side cabinet rails (example showing relative positions)

4. Install the shelf (C in Figure 6 on page 20), using these steps: a. The shelf can be adjusted to a length of between 27 and 31 inches (68.58

and 78.74 cm) to match the cabinet size. To lengthen or shorten the shelf, loosen by approximately 1/2 turn the four 6-32 screws in the four slots on the shelf (I-4 through I-7 Figure 6 on page 20) and adjust the shelf to the required length.

Note: We recommend two people for the installation of the shelf, one at

either end of the cabinet to support and align it correctly while attaching it to the cabinet.

b. Tilt the shelf at an angle to fit it between the rails, and then position it

horizontally and level with the shelf mounting tabs on the outside of the cabinet vertical rails, and aligned with the clip nuts you installed earlier.

c. Secure the shelf to the cabinet with eight 10-32 screws with washers (E in

Figure 6 on page 20), two screws in each corner of the shelf (see Figure 8 on page 23). Tighten screws according to specifications under “Torque requirements” on page 21.

22 SAN384B-2 Installation, Service, and User Guide

Port Side

(Exhaust)

384b034

Figure 8. Shelf installed in cabinet

d. Tighten the four 6-32 screws on the top of the shelf, which were loosened

to adjust the shelf length.

5. Install the air-duct assembly (B in Figure 6 on page 20) by inserting it down into the side slot on left side of the shelf (see Figure 9). Ensure that the tabs of the duct align and engage with the slots in the shelf, with the open side of the duct facing towards the center of the cabinet.

384b036

Figure 9. Air duct installed into side slot in shelf

6. Attach the top-rail assembly (A in Figure 6 on page 20) to the air-duct assembly. a. The top-rail assembly can be adjusted to a length of between 27 and 31

inches (68.58 to 78.74 cm) to fit on the inside of the cabinet rails. To lengthen or shorten the top-rail assembly, loosen, by approximately 1/2 turn, the two

Chapter 2. Installing a SAN384B-2 in a cabinet 23

6-32 screws (I-3 in Figure 6 on page 20) and adjust the top-rail assembly to the required length. The length will be approximately the length of the adjustable shelf.

b. Insert the top-rail assembly down into the air-duct assembly and then

secure the top-rail assembly to the air-duct assembly with two 6-32 screws, one screw on each side of the air-duct assembly (I-1 and I-2 in Figure 6 on page 20). Tighten screws according to specifications under “Torque requirements” on page 21.

7. Secure the top-rail assembly to the cabinet with four 10-32 screws, two screws on each end of the top-rail assembly (see Figure 10).

Figure 10. Installing the top rail assembly to the duct assembly and cabinet rails

a. For rails with round holes:

Use two 10-32 screws with washers (E in Figure 6 on page 20) on each end of the top rail assembly. Tighten screws according to specifications under “Torque requirements” on page 21.

b. For rails with square holes:

Use the two standard 10-32 screws (D in Figure 6 on page 20) with blue Loctite on the threads and alignment washers (H in Figure 6 on page 20) on each end of the top rail assembly. Tighten screws according to specifications under “Torque requirements” on page 21.

8. Tighten the two 6-32 screws (I-3 in Figure 6 on page 20) that were loosened in step 6a to adjust the top rail length.

24 SAN384B-2 Installation, Service, and User Guide

384b037

Installing the SAN384B-2 into the cabinet

CAUTION: A fully populated SAN384B-2 weighs approximately 68 kg (150 lb) and requires a minimum of two people and a lift tool to install it. (C011)

55 kg ( 121.2 lbs)

svc00169

Now that the port-side exhaust kit is securely installed, the SAN384B-2 chassis can be safely installed into the C36 cabinet. Perform the steps to install the chassis.

Note: The cabinet should already be fully installed, with leveling legs lowered to

prevent it from moving during the chassis installation.

1. Move the lift tool to a position as close as possible to the rear of the cabinet. Position the lift tool so that the blower assemblies are facing towards the inside of the cabinet and the port side of the chassis facing away from the cabinet (see Figure 11).

Figure 11. Lift tool and chassis positioned at rear of cabinet

2. Set the wheel brake by pressing down on the wheel brake pedal.

3. Remove the lift tool retention straps from the chassis and the lift tool.

4. Carefully center the chassis over the middle section of the lift tool load plate.

5. Turn the lift tool winch handle clockwise to raise the load plate and chassis to

approximately 2 cm (3/4 in.) above the height of the port side exhaust kit shelf.

6. Rotate the winch handle 1/4 turn counter clockwise to lock the winch.

7. Release the two spring-loaded pins on the under side of the load plate and

slide the middle section as far as possible into the cabinet until it stops. The chassis should not move with the middle section.

Chapter 2. Installing a SAN384B-2 in a cabinet 25

Note: If the chassis is not carefully centered over the middle section, the

weight of the chassis may prevent the middle section from sliding. Adjust the alignment if needed.

8. Release the spring-loaded pin closest to the cabinet one more time, and slide the middle section to its full extension. Make sure the spring-loaded pin snaps back into place. The gap between the end of the load plate middle section and the port side exhaust kit shelf should be no more than 2.5 cm (1 in.). If the gap is larger than this, either the lift tool is not positioned close enough to the cabinet, or the load plate middle section is not fully extended. Adjust as needed. Figure 12 shows a view from inside the cabinet, with the middle section of the lift tool load plate extended, and the chassis centered on the load plate.

Figure 12. Load plate extended inside the cabinet to the exhaust kit shelf

9. Carefully slide the chassis into the cabinet between the shelf and the upper edge of the exhaust kit duct assembly until the chassis rests securely on the shelf. Figure 13 on page 27 shows a view from outside the cabinet with the middle of the load plate fully extended and the chassis pushed approximately half way into the cabinet. Reposition the nut clips installed earlier if necessary. Push the chassis all the way into the cabinet until the flanges on the port side of the chassis are firmly against the cabinet vertical rails.

Note: If necessary, adjust the height of the load plate to allow a smooth

transfer of the chassis from the extended load plate to the top of the shelf.

26 SAN384B-2 Installation, Service, and User Guide

Figure 13. Chassis half way into cabinet on load plate

Note: For rails with round holes, use the clip nuts (F in Figure 6 on page 20)

on the rails for securing the 10-32 screws. For rails with square holes, use the retainer nuts (G Figure 6 on page 20). Also refer to Figure 7 on page 22.

10. Release the spring-loaded pins under the load plate, and slide the middle section of the load plate back into load plate.

11. Lower the lift plate to its lowest position, release the wheel brake on the lift

tool, and move the lift tool away from the cabinet.

12. If necessary, adjust the rubber strips on the exhaust kit duct to ensure a good seal against the chassis.

13. The chassis will be secured to the cabinet with six 10-32 screws with washers (see Figure 14 on page 28). Four of these screws will also be used to attach the cable management finger assemblies. Do not install the screws until you determine the position of the cable management fingers.

Note: Screws, clip nuts, and retainer nuts to secure the chassis to the cabinet

are provided in the SAN384B-2 hardware accessory kit.

Chapter 2. Installing a SAN384B-2 in a cabinet 27

Install screws

Figure 14. Location of screws to attach the chassis to the cabinet rails

Install screws

384b038

14. Attach the two cable management finger assemblies to the cabinet vertical rails, using two screws each. The two assemblies are identical and can be installed on either side. The screws will extend through the chassis flange used to attach the chassis to the cabinet rails, and into the clip nuts you have installed. Select the holes on the cable management assemblies that match two of the holes on the chassis flange. You will be able to position the cable management finger assemblies either towards the top of the chassis or towards the bottom of the chassis, depending on your requirements for routing cables. The third screw for each side is used to secure the chassis to the rails, directly through the chassis flange into the clip nuts. These screws do not attach the cable management assemblies to the chassis or rack. Figure 15 on page 29 shows the cable management fingers positioned towards the top of the chassis.

28 SAN384B-2 Installation, Service, and User Guide

Port numbering

384b016

Figure 15. Attaching the vertical cable management finger assemblies to the cabinet rails

15. Disassemble and pack the lift tool into the shipping crate. Follow the return instructions provided.

Note: For turning on the power and for the configuration instructions, see

Chapter 3, “Starting and configuring the SAN384B-2,” on page 33.

Attention: Do not connect the SAN384B-2 to the network until the IP addresses are correctly set.

Table 6 provides a list of available port and application blades for the SAN384B-2.

Table 6. Port and application blades available on the SAN384B-2

Blade label IBM blade name Feature code

FC16-32 32 port 16Gbps Switch Blade 3632

FC8-32E 32 port 8Gbps Enhanced Port Blade 3633

FC16-48 48 port 16Gbps Switch Blade 3648

FC8-48E 48 port 8Gbps Enhanced Port Blade 3649

FC8-64 64 port 8Gbps Switch Blade 3864

FX8-24 FCIP 8 Gbps extension blade 3890

Chapter 2. Installing a SAN384B-2 in a cabinet 29

Table 6. Port and application blades available on the SAN384B-2 (continued)

Blade label IBM blade name Feature code

FS8-18 16 port 8 Gbps encryption blade 3895

The SAN384B-2 uses the port numbering for each of the blades that can be installed in the chassis. See illustrations of the different blades in Appendix E, “Port numbering,” on page 151. Refer to Implementing an IBM/Brocade SAN with 8 Gbps Directors and Switches, (an IBM Redbook), SG24-6116 for more details on port numbering and other technical information.

Note: This publication was written for earlier products, but many of the practices

still apply.

Note: Blades are installed in a horizontal orientation in the SAN384B-2 chassis, so

the normal top of the blade is oriented to the left, and the normal bottom of the blade is oriented to the right when the blades are installed in the chassis.

v CR16-8 core blade - Inter-chassis link connectors are numbered from 0 through 7

from bottom to top on the left set of ports and 8 through 15 from bottom to top on the right set of ports. Each connector is actually a group of four 16 Gbps ports.

v FC16-32 port blade - Ports are numbered from 0 through 15 from right to left on

the lower row of ports and 16 through 31 from right to left on the upper row of ports.

v FC8-32E port blade - Ports are numbered from 0 through 15 from right to left on

the lower row of ports and 16 through 31 from right to left on the upper row of ports.

v FC16-48 port blade - Ports are numbered from 0 through 23 from right to left on

the lower row of ports and 24 through 47 from right to left on the upper row of ports.

v FC8-48E port blade - Ports are numbered from 0 through 23 from right to left on

the lower row of ports and 24 through 47 from right to left on the upper row of ports.

v FC8-64 port blade - Ports are numbered from 0 through 31 from right to left on

the lower row of ports and 32 through 63 from right to left on the upper row of ports. See Figure 58 on page 153 for an illustration of the blade. Trunking groups are permitted with up to eight ports per group. Trunking groups are as follows: 0-7, 8-15, 16-23, 24-31, 32-39, 40-47, 48-55, and 56-63.

v FX8-24 FCIP extension blade - The port numbering scheme is fairly complex for

this blade, but is displayed for reference on the blade itself in a diagram towards the right end of the blade (see Figure 60 on page 153). There are twenty-four physical ports. Twelve FC ports are located towards the right end of the blade, with ports 0 through 5 in the lower row, and ports 6 through 11 in the upper row. Two 10 Gigabit Ethernet (10GbE or XGE) ports are located in the lower row of ports and are numbered 0 and 1, from right to left. Ten GbE ports are located towards the left end of the blade, with eight clustered to the far left, and the remaining two located above the two 10GbE ports. The GbE ports 0 through 3, numbered from right to left are located in the lower row to the far left side of the blade. Ports 4 and 5 are located above the two 10GbE ports, and ports 6 through 9 (numbered right to left) are in the top row above ports 0 through 3. Up to three FC trunking groups. The three groups are defined as:

– Trunk group 0: FC ports 0, 1 – Trunk group 1: FC ports 6, 7

30 SAN384B-2 Installation, Service, and User Guide

– Trunk group 2: FC ports 2, 3, 4, 5, 8, 9, 10, 11

v FS8-18 blade - The 16 physical Fibre Channel ports on this blade are numbered 0

through 15 from right to left. The two 10/100/1000 BaseT ports are numbered GE0 and GE1 from right to left.

Chassis slots

Slots are numbered 1 through 8, from bottom to top of the chassis when facing the port side of the SAN384B-2. Control processor blades (CP8) can be installed only in slots 4 and 5. Core switch blades (CR16-4) can be installed only in slots 3 and 6. Port, application, or encryption blades can be installed only in slots 1, 2, 7, and 8. Unused slots must be filled with blade filler panels to maintain adequate cooling.

See Appendix E, “Port numbering,” on page 151 for different SAN384B-2 port blades. Also refer to the IBM Redbook, Implementing an IBM/Brocade SAN with 8 Gbps Directors and Switches, SG24-6116, for more comprehensive information on port numbering and area port numbering, and other technical information. This publication is available through www.redbooks.ibm.com/. Search by title or publication number.

Note: This publication was written for earlier products, but many of the practices

Cable organization

apply to this product.

Two vertical cable management finger assemblies (shown in Figure 32 on page 69) are attached to the rack vertical rails. They are not attached directly to the SAN384B-2 chassis. This pair of cable management finger assemblies can be used to keep the cables from hanging down in front of other blades, and to route them away from the exhaust vent of the port-side exhaust kit, which is located below the SAN384B-2 chassis.

Use these guidelines in planning for cable management:

v Plan for rack space required for cable management before installing the chassis v Leave at least 1 m (3.28 ft) of slack for each port cable. This provides room to

remove and replace the switch, allows for inadvertent movement of the rack, and helps prevent the cables from being bent to less than the minimum bend radius.

v If you are using ISL Trunking, consider grouping cables by trunking groups. The

cables used in trunking groups must meet specific requirements, as described in the Fabric OS Administrator’s Guide.

v For easier maintenance, label the fiber optic cables and record the devices to

which they are connected.

v Keep LEDs visible by routing port cables and other cables away from the LEDs. v Use hook and loop type straps to secure and organize fiber optic cables.

Attention: The minimum radius to which a cable can be bent under full tensile load is 5.1 cm (2 in). For a cable under no tensile load, that minimum is 3 cm (1.2 in).

Attention: Do not route the cables in front of the air exhaust vents, located at the top and bottom of the port side of the chassis.

Chapter 2. Installing a SAN384B-2 in a cabinet 31

The FC8-64 high density port blade cannot use the standard LC cables because the pitch between optics in the new mSFP transceiver is smaller than in standard SFPs. Patch cables and panels can be used to attach standard size cabling to the blade if necessary. Figure 16 illustrates the mSFP to SFP patch cable. The mSFP transceivers are used only with the FC8-64 port blade. Narrower OM-3 LC cables are used to connect the FC8-64. These cables are offered by several major manufacturers. Contact your IBM representative for options regarding different cable and patch panel configurations to simplify cable management with higher density FC8-64 port blades.

2 3

Figure 16. Cable design for the mSFP patch cables for the FC8-64 high density port blade

1 mini-SFP connector 3 1.6 mm cable

2 Duplex clip (black) 4 SFP connector

Note that the duplex clip on the mSFP end of the cable is black for easier recognition.

If ISL Trunking is in use, group the cables by trunking group. The ports are color-coded to indicate which ports can be used in the same ISL Trunking group: eight ports marked with solid black ovals alternate with eight ports marked with oval outlines. See Table 25 on page 132 for a listing of supported cable speeds and distances.

Optional inter-chassis link cables (ICL) can also be installed between SAN384B-2 chassis. See “Removing and replacing inter-chassis link (QSFP) cables” on page 93 for instructions on installing these cables.

b768ig045

32 SAN384B-2 Installation, Service, and User Guide

Chapter 3. Starting and configuring the SAN384B-2

Attention: Refer to the latest Fabric OS Release Notes or Interoperability Matrix for information regarding Fabric OS compatibility. This is particularly important for fabrics with 1-Gbps switches using earlier Fabric OS versions. To access the appropriate matrix:

v Go to the IBM SAN web page www.ibm.com/systems/storage/san v Select the IBM System Storage SAN768B-2 and SAN384B-2 product link v On the displayed product page, click the Interoperability Matrix link in the

Learn more section.

The SAN384B-2 must be configured before it is connected to the fabric, and all of the configuration commands must be entered through the active CP blade. The SAN384B-2 configuration includes the parameters:

v IP address and subnet mask for the SAN384B-2 v IP addresses, host names, subnet masks, and gateway addresses for both CP

blades

v Switch name v Domain ID (optional) v WWN for the chassis

Note: The SAN384B-2 WWN is initially set by the factory to match the license

ID (which is based on the chassis serial number). The WWN can be changed, but the license ID cannot be modified.

The configuration information is mirrored to the standby CP blade, which allows the most current configuration to remain available even if the active CP blade fails. The configuration information for the SAN384B-2 is stored in the WWN cards and the flash memory of the CP blades. The configuration can be backed up to a workstation (uploaded) and then downloaded to the active CP blade if necessary.

Note: If the FS8-18 encryption blade is installed, refer to the Fabric OS Encryption

Administrator’s Guide Supporting Tivoli Environments for the procedures to configure the encryption functions.

Figure 17 on page 34 provides an overview of the sequence of tasks to configure the SAN384B-2.

Key Lifecycle Manager (TKLM)

Configuration Tasks

Connect Serial Cable

between Switch and Host

Set IP Address

Log off Serial Console Port

and Disconnect Serial Cable

Connect Ethernet Cable

and Open Telnet Session

Set Domain ID

Set Date and Time

Install SFPs and

Attach Cables

Manage Cables

Verify Operation and

Back Up Configuration

Figure 17. Flow of configuration tasks for the SAN384B-2

384b004

The initial physical hardware installation continues with the steps:

v “Providing power to the SAN384B-2” on page 35 v “Connecting the SAN384B-2 and host with a serial cable” on page 35 v “Logging in to the serial console port” on page 36 v “Configuring the IP addresses” on page 36 v Installing optical transceivers and cables (see “Removing and installing

transceivers” on page 90 and “Managing cables” on page 44)

The additional steps are customer responsibilities required for the initial configuration:

1. Establish an Ethernet connection. See “Establishing an Ethernet connection” on page 38.

2. Specify a switch name. See “Customizing the switch name” on page 38.

3. Specify a domain ID for the SAN384B-2. See “Setting the Domain ID” on page

39.

4. Set the date and time. See “Setting the date and time” on page 39.

5. Connect to the fabric. See “Verifying the persistent PID feature” on page 41

34 SAN384B-2 Installation, Service, and User Guide

6. Enable software licenses. See “Determining installed software licenses” on page

41.

7. Configure the optional FS8-18 encryption blade. See “Configuring for encryption (optional)” on page 46.

8. Back up the configuration. See “Verifying correct operation and backing up the configuration” on page 47.

Providing power to the SAN384B-2

DANGER

An electrical outlet that is not correctly wired could place hazardous voltage on the metal parts of the system or the devices that attach to the system. It is the responsibility of the customer to ensure that the outlet is correctly wired and grounded to prevent an electrical shock. (D004)

Attention: Use only the supplied power cords.

To provide power to the SAN384B-2:

1. Connect the two AC power cords to each of the two power supplies.

2. Connect the power cords to a power source with a voltage of 200 to 240 VAC,

47 to 63 Hz..

3. Turn the AC power switches on the power supplies to ON ( |). The AC power switches light green when switched on and power is supplied.

4. The SAN384B-2 performs a power-on self-test (POST) each time it is powered on. POST takes approximately 10 minutes and is complete when indicator light activity displays the operational state. For information about LED patterns, see Chapter 4, “Monitoring system components,” on page 51.

You can bypass POST by using the fastBoot command. You can also disable POST for successive reboots on the SAN384B-2 using the diagDisablePost command.

Attention: To prevent a potential IP address conflict, do not connect the SAN384B-2 to the network until the IP addresses are configured.

Note: To power off the SAN384B-2, see “Powering off the SAN384B-2” on page

49.

Connecting the SAN384B-2 and host with a serial cable

To establish a serial connection to the console port on the CP blade, complete the steps.

1. Verify that the SAN384B-2 is powered on and that POST is complete by confirming that all power LED indicators on the port, control processor, and core switch blades display a steady green light.

2. Remove the shipping cap from the CONSOLE port on the active CP blade. Use the serial cable provided with the product to connect the CONSOLE port on the active CP blade to a computer workstation. The active CP blade is indicated by an illuminated blue LED.

Attention: The CONSOLE port is intended primarily for the initial setting of the IP address and for service purposes.

3. Access the SAN384B-2 using a terminal emulator application (such as HyperTerminal in a Windows environment or TIP in a UNIX environment).

Chapter 3. Starting and configuring the SAN384B-2 35

4. Disable any serial communication programs running on the workstation (such as synchronization programs).

5. Open the terminal emulator application and configure as follows: v In a Windows environment:

Table 7. Configuration parameters

Parameter Value

Bits per second 9600

Data bits 8

Parity None

Stop bits 1

Flow control None

v In a UNIX environment, enter the string at the prompt:

term /dev/ttyb -9600

If ttyb is already in use, use ttya instead and enter the string at the prompt:

term /dev/ttya -9600

When the terminal emulator application stops reporting information, press Enter. You will receive the login prompt: CP0 Console Login:

Continue to the next task.

Logging in to the serial console port

To log in to the SAN384B-2 through the serial connection, follow these steps.

1. Log in to the SAN384B-2 as admin. The default password is "password." At the initial login, you are prompted to change the default passwords. Record the new passwords and keep this information in a secure location. The example below shows the login without changing the password.

swDir login: admin Password: Please change your passwords now. Use Control-C to exit or press ’Enter’ key to proceed.

Password was not changed. Will prompt again at next login until password is changed. swDir:admin>

2. (Optional) Modify passwords. To skip modifying the password, press Ctrl+C .Passwords can be 8 to 40 characters long. They must begin with an alphabetic character. They can include numeric characters, the dot (.), and the underscore (_). Passwords are case-sensitive, and they are not displayed when you enter them on the command line. For more information on passwords, refer to the Fabric OS Administrator’s Guide.

Configuring the IP addresses

The SAN384B-2 requires three IP addresses, which are configured using the ipAddrSet command. IP addresses are required for both CP blades (CP0 and CP1) and for the chassis management IP (displayed under SWITCH with the

ipAddrShow command).

Note: The default IP addresses and host names for the SAN384B-2 are as follows:

v 10.77.77.75 for CP0 (the CP blade in slot 4 at the time of configuration)

36 SAN384B-2 Installation, Service, and User Guide

v 10.77.77.74 for CP1 (the CP blade in slot 5 at the time of configuration)

Attention: Resetting an IP address while the SAN384B-2 has active IP traffic such as Fabric Manager, Fabric Watch, SNMP, or other applications can cause traffic to be interrupted or stopped. Changing the IP address causes a domain address format RSCN to be issued.

Follow these steps to configure the IP addresses for both CP blades (from the active CP blade):

1. Log in to the active CP as admin using the serial cable connection.

2. Set up the SAN384B-2 IP address by entering the ipaddrset -chassis command

at the prompt.

swDir:admin> ipAddrSet -chassis

Enter the information at the prompts. Specify the -chassis IP address. The -sw 0 IP address is not valid on this chassis.

Note: The addresses 10.0.0.0 through 10.0.0.255 are reserved and used

internally by the SAN384B-2. External IPs must not use these addresses.

3. Set up the CP0 blade IP address by entering the ipaddrset -cp 0 command at the prompt.

swDir:admin> ipAddrSet -cp 0

Enter the requested information at the prompts.

4. Set up the CP1 IP address by entering the ipaddrset -cp 1 command:swDir:admin> ipAddrSet -cp 1

Enter the requested information at the prompts. The is a sample IP configuration, for the SAN384B-2 (sw -0) and the two CP

blades (cp0 and cp1):

swDir:admin> ipaddrset -chassis Ethernet IP Address [0.0.0.0]: 192.168.1.1 Ethernet Subnetmask [0.0.0.0]: 255.255.255.0 Fibre Channel IP Address [0.0.0.0]: Fibre Channel Subnetmask [0.0.0.0]: Issuing gratuitous ARP...Done. Committing configuration...Done. swDir:admin> ipaddrset -cp 0 Host Name [cp0]: Ethernet IP Address [10.77.77.75]: 192.168.1.2 Ethernet Subnetmask [0.0.0.0]: 255.255.255.0 Gateway IP Address [0.0.0.0]: 192.168.1.254 IP address is being changed...Done. Committing configuration...Done. swDir:admin> ipaddrset -cp 1 Host Name [cp1]: Ethernet IP Address [10.77.77.74]: 192.168.1.3 Ethernet Subnetmask [0.0.0.0]: 255.255.255.0 Gateway IP Address [0.0.0.0]: 192.168.1.254 IP address of remote CP is being changed...Done. Committing configuration...Done.

Logging off the serial console port and disconnecting the serial cable

You can use the serial port to monitor error messages through the serial connection, however it is generally used for initial configuration and service

Chapter 3. Starting and configuring the SAN384B-2 37

purposes. If the serial port is no longer required, use the logout command to log out of the serial console, remove the serial cable, and replace the plug in the serial port.

Establishing an Ethernet connection

After using a serial connection to configure the IP addresses for the SAN384B-2, you can connect the active CP blade to the local area network (LAN).

Note: Connecting the CP blades to a private network/VLAN is recommended.

By establishing an Ethernet connection, you can complete the SAN384B-2 configuration using a serial session, Telnet , or through a management application such as Web Tools or Network Advisor.

To establish an Ethernet connection to the SAN384B-2, follow these steps:

1. Remove the shipping plug from the Ethernet port on the active CP blade.

2. Insert one end of an Ethernet cable into the Ethernet port.

3. Connect the other end to an Ethernet 10/100/1000 BaseT LAN.

The SAN384B-2 can now be accessed by remote connection using the command line through Telnet or any of the management tools, such as Web Tools or Network Advisor.

4. To complete any additional SAN384B-2 configuration procedures through a

Telnet session, log in to the SAN384B-2 by Telnet, using the admin login. The default password is password.

Customizing the switch name

The switch name of the SAN384B-2 can be up to 30 characters long; can include letters, numbers, and underscore characters; and must begin with a letter.

Note: Changing the name causes a domain address format RSCN to be issued.

To customize the name, follow these steps:

1. Enter the switchName command followed by the new name in quotes.

swDir:admin> switchName "ModularSwitch5" Committing configuration... Done. ModularSwitch5:admin

2. Record the new name for future reference.

Customizing a chassis name

The chassis name of the SAN384B-2 can be up to 15 characters long; can include letters, numbers, hyphens, and underscore characters; and must begin with a letter.

1. Enter chassisName followed by the new name in double quotation marks.

switch:admin> chassisname "SAN384B2_chassis_1" Committing configuration... Done.

2. To display the new chassis name, enter the chassisName command.

switch:admin> chassisname SAN384B2_chassis_1

38 SAN384B-2 Installation, Service, and User Guide

3. Record the new name for reference.

Setting the Domain ID

Each switch in the fabric must have a unique Domain ID. The Domain ID can be set using the configure command or can be automatically set. The default Domain ID for the SAN384B-2 is "1". Use the fabricShow command to view the already assigned domain IDs.

To set the Domain ID, follow these steps:

1. Enter the switchDisable command to disable the SAN384B-2.

2. Enter the configure command.

3. Enter y at the "Fabric parameters" prompt:

Fabric parameters (yes, y, no, n): [no] y

4. Enter a unique Domain ID:

Domain: (1.239) [1] 3

5. Complete the remaining prompts or press Ctrl+D to accept the settings and to exit.

6. Enter the switchEnable command to re-enable the SAN384B-2.

Setting the date and time

The date and time settings are used for logging events. Switch operation does not depend on the date and time; a switch with an incorrect date and time value still functions properly. However, because the date and time are used for logging, error detection, and troubleshooting, they should be set correctly.

Setting the date

To set the date, follow these steps.

1. If necessary, log on to the SAN384B-2 by Telnet, using the admin account. The default password is password.

2. Enter the date command, using the syntax:date "mmddHHMMyy" Where:

v mm is the month; valid values are 01 through 12. v dd is the date; valid values are 01 through 31. v HH is the hour; valid values are 00 through 23 v MM is minutes; valid values are 00 through 59. v yy is the year; valid values are 00 through 99 (values greater than 69 are

interpreted as 1970 through 1999, and values less than 70 are interpreted as 2000-2069).

switch:admin> date Fri Sep 24 17:01:48 UTC 2010 switch:admin> date "0927123010" Mon Sep 27 12:30:00 UTC 2010 switch:admin>

Chapter 3. Starting and configuring the SAN384B-2 39

Setting the time zone

You must perform the procedure on all chassis for which the time zone must be set. However, you only need to set the time zone once on each switch, because the value is written to nonvolatile memory. Use one of the two procedures to set the time zone.

The procedure describes how to set the current time zone using timezone_fmt mode to Central Standard time.

1. Log on to the chassis using the admin account. The default password is

password

2. Enter the tsTimeZone command as follows:

switch:admin> tstimezone [--interactive]/ [, timezone_fmt]

Use timezone_fmt to set the time zone by Country/City or by time zone ID, such as PST. The example shows how to change the time zone to US/Central.

switch:admin> tstimezone Time Zone : US/Pacific switch:admin> tstimezone US/Central switch:admin> tstimezone Time Zone : US/Central

The procedure describes how to set the current time zone using interactive mode to Pacific Standard Time.

1. Enter the tsTimeZone command as follows:

switch:admin> tstimezone --interactive

2. You are prompted to select a general location.

Please identify a location so that time zone rules can be set correctly.

3. Enter the appropriate number or Ctrl+D to quit.

4. At the prompt, select a country location.

5. At the prompt, enter the appropriate number to specify the time zone region or

Ctrl+D to quit.

Synchronizing local time

To synchronize the local time of the principal or primary switch with that of an external NTP server, follow these steps.

1. If necessary, log on to the switch by Telnet, using the admin account.

2. Enter the tsClockServer command:

switch:admin> tsclockserver "<ntp1;ntp2>"

where ntp1 is the IP address or DNS name of the first NTP server, which the switch must be able to access. The variable ntp2 is the second NTP server and is optional. The operand "<ntp1;ntp2>" is optional; by default, this value is LOCL, which uses the local clock of the principal or primary switch as the clock server.

The tsClockServer command accepts multiple server addresses in either IPv4, IPv6, or DNS name formats. When multiple NTP server addresses are passed, tsclockserver sets the first obtainable address as the active NTP server. The rest will be stored as backup servers that can take over if the active NTP server fails. The principal or primary FCS switch synchronizes its time with the NTP server every 64 seconds.

40 SAN384B-2 Installation, Service, and User Guide

switch:admin> tsclockserver LOCL switch:admin> tsclockserver "132.163.135.131" switch:admin> tsclockserver

132.163.135.131 switch:admin>

The example shows how to set up more than one NTP server using a DNS name:

switch:admin> tsclockserver "10.32.170.1;10.32.170.2;ntp.localdomain.net" Updating Clock Server configuration...done. Updated with the NTP servers

Changes to the clock server value on the principal or primary FCS switch are propagated to all switches in the fabric

Verifying the persistent PID feature

Before connecting the SAN384B-2 to the fabric, verify that the WWN Based persistent port identifier (PID) feature on the SAN384B-2 matches the other switches in the fabric. This parameter must be identical for all switches in the fabric and is set using the configure command as shown below:

switch:admin>configure Configure... Fabric parameters (yes, y, no, n): [no] y Domain: (1..239) [1] Enable a 256 Area Limit

(0 = No,

1 = Zero Based Area Assignment, 2 = Port Based Area Assignment): (0..2) [0] 1

WWN Based persistent PID (yes, y, no, n): [no] yes <command output truncated>

You can check the PID setting using the configshow command as in the example. You can use the | grep -i pid qualifier to pinpoint the PID information.

switch:admin> configshow | grep -i pid fabric.ops.mode.pidFormat:1 fabric.wwnPidMode:1

The 1 indicates that the WWN Based persistent PID feature is enabled. The default value is 0 for disabled.

Determining installed software licenses

Certain licenses may be factory installed on the SAN384B-2. To determine which licenses are currently enabled, use the licenseShow command.

swDir:admin> licenseshow AAbbccDDeeFFeeGG:

In the example above, the license key is AAbbccDDeeFFeeGG. Keep a copy of the license key for reference.

Web license Zoning license Extended Fabric license Fabric Watch license Performance Monitor license Trunking license Security license

The 64-bit chassis ID is required to obtain and activate licenses for the SAN384B-2. The chassis ID is available through the licenseIdShow command.

Chapter 3. Starting and configuring the SAN384B-2 41

The licenseShow and licenseIdShow commands must be entered on the active CP blade.

Refer to the Fabric OS Administrator's Guide for more information.

Installing transceivers and attaching cables

The two sets of steps cover the installation of transceivers and cables for most SFPs and for QSFPs.

Attention: Use only transceivers that are supported for this product. Only transceivers purchased from IBM are supported. The use of transceivers that are not supported may cause data loss or cause the product to malfunction. For a listing of transceivers compatible with this product:

v Go to the IBM Support Portal www.ibm.com/supportportal. v In the Search field, enter b-type supported transceiver. v Alternatively, use this direct link: http://www-01.ibm.com/support/

docview.wss?uid=ssg1S1004421.

Note:

Follow the first set of steps to install SFP+s and mSFPs (FC8-64 port card only) and cables to the SAN384B-2 (see “Removing and installing transceivers” on page 90 for more details). Follow the second set of steps to install the QSFP transceivers and cables in the core blades for inter-chassis link connections (see “Removing and replacing inter-chassis link (QSFP) cables” on page 93 for more details).

Attention: mSFP transceivers are compatible only with the FC8-64 port blade. While they will fit in other blades, this configuration is unsupported and will generate an error.

| | | | | | |

| |

Attention: With increasing speeds of optical connections, the cleanliness of the connections assumes greater importance in ensuring maximum performance and error free transmission. Due to the tighter tolerances associated with state of the art optics, levels of contamination that were acceptable at lower speeds may not be at higher speeds. While IEC Standard 61300-3-35 specifies a set of guidelines for trouble free performance, most issues can be avoided by adhering to the best practices:

v When cables or connectors are not in use for extended periods of time, use the

dust covers provided.

v Ensure that the cable length and type that is used are suitable for the speed and

application.

v Inspect and clean optical connections and fiber cables before you connect or

reconnect components.

v Ensure that cables are properly seated within the connector.

Kits are commercially available for cleaning and inspecting these connections. IBM also offers services that will ensure optimal condition of the network.

The ports are color-coded to indicate which can be used in the same port group for trunking (trunking port groups can be up to eight ports). The ports and cables used in trunking groups must meet specific requirements. Refer to the Fabric OS Administrator’s Guide for more information.

42 SAN384B-2 Installation, Service, and User Guide

Follow these steps to add the optical transceivers and cables to the Fibre Channel ports.

1. Ensure that both cable and transceiver are clean prior to installation.

2. Position one of the optical transceivers so that the key is oriented correctly to

the port. Insert the transceiver into the port until it is firmly seated and the latching mechanism clicks.

Transceivers are keyed so that they can only be inserted with the correct orientation. If a transceiver does not slide in easily, ensure that it is correctly oriented.

3. Position a cable so that the key (the ridge on one side of the cable connector) is aligned with the slot in the transceiver; then, insert the cable into the transceiver until the latching mechanism clicks.

Cables are keyed so that they can only be inserted with the correct orientation. If a cable does not slide in easily, ensure that it is correctly oriented.

4. Repeat steps 1 and 2 for the remaining ports.

5. Organize the cables as required. For recommendations regarding cable

management, refer to “Managing cables” on page 44.

6. Verify the chassis and port status using the switchShow command.

7. Verify fabric connectivity using the fabricShow command.

Follow these steps to install the QSFPs and cables in the 16 Gbps core blades. These transceivers and cables are used to form the inter-chassis links (ICL) with neighboring SAN384B-2 and SAN768B-2 backbones. The transceivers should be installed in the blades before connecting the cables. Because each QSFP contains four 16 Gbps ports, be aware that any problems with one port could affect all four ports in the quad if the QSFP has to be replaced.

1. Position one of the QSFP transceivers so that the key is oriented correctly to the port. Insert the transceiver into the port until it is firmly seated. Transceivers are keyed so that they can only be inserted with the correct orientation. If a transceiver does not slide in easily, ensure that it is correctly oriented. When the transceiver is correctly seated, the status LED will flash amber several times and then turn solid amber.

2. Remove the protective cap from the special QSFP cable and insert it into the transceiver until it is firmly seated. The cables are also keyed to fit into the transceivers correctly. When the cable is correctly seated, the status LED will change from amber to green.

3. Repeat steps 1 and 2 for the remaining ICLs.

4. Organize the cables (see “Managing cables” on page 44).

5. Verify the chassis and connector and port status using the switchShow -qsfp

command. A sample of the command output is shown below. The example is from a SAN384B-2 with a core blade installed in slot 3. Note that the state reported for an unconnected QSFP (shown QSFP 0 and Ports 0-3 below) is No_SigDet. This is different from the State of No_Synch that is reported for regular SFPs that are unconnected. QSFP 7 (ports 3/28-3/31, Index 748-751) in the example shows the results for a connected QSFP.

switch:FID128:admin> switchshow -qsfp switchName: switch_name switchType: 121.3 switchState: Online switchMode: Native switchRole: Subordinate switchDomain: 75 switchId: fffc4b switchWwn: 10:00:00:05:1e:4f:eb:00

Chapter 3. Starting and configuring the SAN384B-2 43

zoning: ON (zoning_name) switchBeacon: OFF FC Router: OFF Allow XISL Use: OFF LS Attributes: [FID: 128, Base Switch: No, Default Switch: Yes, Address Mode 0] Index Slot Port QSFP Address Media Speed State Proto ============================================================= 256300------ id 16G No_SigDet FC 257310------ id 16G No_SigDet FC 258320------ id 16G No_SigDet FC 259330------ id 16G No_SigDet FC 260341------ -- 16G No_Module FC 261351------ -- 16G No_Module FC 262361------ -- 16G No_Module FC 263371------ -- 16G No_Module FC 264382------ -- 16G No_Module FC 265392------ -- 16G No_Module FC 266 3 10 2 ------ -- 16G No_Module FC 267 3 11 2 ------ -- 16G No_Module FC 268 3 12 3 ------ -- 16G No_Module FC 269 3 13 3 ------ -- 16G No_Module FC 270 3 14 3 ------ -- 16G No_Module FC 271 3 15 3 ------ -- 16G No_Module FC 736 3 16 4 ------ -- 16G No_Module FC 737 3 17 4 ------ -- 16G No_Module FC 738 3 18 4 ------ -- 16G No_Module FC 739 3 19 4 ------ -- 16G No_Module FC 740 3 20 5 ------ -- 16G No_Module FC 741 3 21 5 ------ -- 16G No_Module FC 742 3 22 5 ------ -- 16G No_Module FC 743 3 23 5 ------ -- 16G No_Module FC 744 3 24 6 ------ -- 16G No_Module FC 745 3 25 6 ------ -- 16G No_Module FC 746 3 26 6 ------ -- 16G No_Module FC 747 3 27 6 ------ -- 16G No_Module FC 748 3 28 7 ------ id 16G Online FC E-Port 10:00:00:05:1e:39:e4:5a trunk master_name (Trunk master) 749 3 29 7 ------ id 16G Online FC E-Port 10:00:00:05:1e:39:e4:5a trunk master_name (Trunk master) 750 3 30 7 ------ id 16G Online FC E-Port 10:00:00:05:1e:39:e4:5a trunk master_name (Trunk master) 751 3 31 7 ------ id 16G Online FC E-Port 10:00:00:05:1e:39:e4:5a trunk master_name (Trunk master)

Managing cables

Attention: The minimum bend radius should be no smaller than 10x the cable radius. The minimum bend radius for a 50 micron cable is 5.1 cm (2 in.) under full tensile load and 3 cm (1.2 in.) with no tensile load.

Note: Contact your IBM representative for options regarding different cable and

patch panel configurations to simplify cable management with higher density FC8-64 port blades.

Cable management recommendations: v Leave at least 1 m (3.28 ft) of slack for each port cable. This provides room to

remove and replace blades in the chassis, allows for inadvertent movement of the rack, and helps prevent the cables from being bent to less than the minimum bend radius.

44 SAN384B-2 Installation, Service, and User Guide

v If ISL Trunking is in use, group the cables by trunking group. The ports are

color-coded to indicate which ports can be used in the same ISL Trunking group: eight ports marked with solid black ovals alternate with eight ports marked with oval outlines.

v Use only hook-and-loop fasteners for securing optical cables. Do not use cable

ties. They can be easily overtightened and can damage the optical cables.

v For easier maintenance, label the fiber optic cables and record the devices to

which they are connected.

v Use the cable management fingers attached to the rack rails to organize the

cables off to the side of the chassis, and away from the chassis exhaust vents.

v Keep LEDs visible by routing port cables and other cables away from the LEDs.

For the procedure to install the ICL cables see “Removing and replacing inter-chassis link (QSFP) cables” on page 93.

Planning for encryption (optional)

Encryption is an optional feature available on the SAN384B-2 through the installation and use of the FS8-18 encryption blade. Advance planning is essential to achieve a successful implementation of encryption.

Attention: Setup of the FS8-18 blade for encryption requires the use of this document for the physical installation of the blade. Critical information required for enabling and managing encryption is contained in the Fabric OS Encryption Administrator’s Guide Supporting Tivoli Key Lifecycle Manager (TKLM) Environments, which is included on the documentation CD-ROM that is shipped with the product. You must use both documents in order to successfully set up the switch for encryption.

Careful attention to details of setup and configuration are essential to enabling a secure encryption functionality. The guidelines should be followed when planning for encryption with the 16-port encryption blade (FS8-18), which is available for the SAN768B, SAN768B-2, SAN384B, and SAN384B-2 products, or the SAN32B-E4.

v Redundancy of hardware is essential because if the encryption path is disrupted,

access to the encrypted data will be lost with a single encryption device. You must have two encryption devices to ensure backup and access in the event that one of the devices goes down. If one of the devices in the encryption pair is not functioning, you will only have read access to the encrypted data on the functioning device until the non-functioning device is restored. Redundancy of hardware for encryption can be accomplished with the :

– Two Key Vault locations on different devices – Two encryption devices in any combination of encryption switches

(SAN32B-E4) and FS8-18 encryption blades (in SAN768B, SAN768B-2, SAN384B, or SAN384B-2 chassis)

v Cable planning for the encryption switch and its backup and for a primary and

secondary key vault manager is critical. These devices can be separated by distance as long as they can maintain constant communication contact. One device must back up the other to ensure access to encrypted data. Refer to the

Fabric OS Encryption Administrator’s Guide Supporting Tivoli Key Lifecycle Manager (TKLM) Environments for more information on Master Keys (MK).

v Begin with a limited application of encryption in a test environment and once an

expanded encryption test is successful, move the encryption into production

v Avoid dual encryption (Fabric encryption and device encryption). While this

should not cause any encryption errors, it will degrade performance.

Chapter 3. Starting and configuring the SAN384B-2 45

v There is no support of Cisco switches at this time by IBM. The section in the

Fabric OS Encryption Administrator’s Guide Supporting Tivoli Key Lifecycle Manager (TKLM) Environments related to Cisco Fabric connectivity does not currently

apply.

v The use of Smart Cards provides additional encryption security management,

and is highly recommended. Smart cards can be ordered as FRUs through IBM.

v The Top Talker feature is not compatible with redirection zones. The Top Talker

feature should not be enabled when an encryption switch or blade is present in the fabric.

v Alias zoning is not supported in encryption environments. You must use the real

WWPN.

v Refer to the "Steps for connecting to a TKLM appliance" section of the Fabric OS

Encryption Administrator’s Guide Supporting Tivoli Key Lifecycle Manager (TKLM) Environments for detailed information on initial setup. That section includes the

information: – All switches you plan to include in an encryption group must have a secure

connection to the Tivoli Key Lifecycle Manager (TKLM). A local LINUX host must be available to transfer certificates.

– Be sure that the clock time on the TKLM server and on the Brocade

encryption nodes are the same. A difference of only a few minutes can cause the TLS connectivity to fail.

– Repeat the same steps for configuring both the primary and the secondary

key vault.

– Both the primary and secondary key vaults should be registered before

exporting MK or encrypting LUNs. If the secondary key vault is registered midway after encryption is done for some of the LUNs, then the key database should be backed up and restored on the secondary TKLM from the already registered primary TKLM before registering the secondary TKLM.

– The is a suggested order for the initial steps needed to create a secure

connection to TKLM. (Refer to the "Steps for connecting to a TKLM appliance" section of the Fabric OS Encryption Administrator’s Guide Supporting Tivoli Key Lifecycle Manager (TKLM) Environments for additional steps.)

1. Initialize all encryption nodes to generate Key authentication center (KAC) certificates and export the signed KAC certificates to a local LINUX host.

2. Obtain the necessary user credentials and log in to the TKLM server appliance from the TKLM management web console.

Configuring for encryption (optional)

Summary of procedure

The optional FS8-18 encryption blade requires configuration to enable the configuration functions. This section provides a brief overview of those configuration steps. Refer to the Fabric OS Encryption Administrator’s Guide (TKLM Key Management) for the detailed procedures to configure the encryption functions.

Note:

If the encryption blade (FS8-18) is being configured for the first time for encryption services, you will need to perform several pre-initialization tasks related to configuring the encryption node (switch), including:

v Generating the Critical Security Parameters (CSPs) and certificates v Loading and setting up the certificates

46 SAN384B-2 Installation, Service, and User Guide

v Establishing a trusted link (LKM Appliance) v Configuring the global parameters and policies of the encryption group v Generating and backing up the master key in RSA environments v Handling key-vault high-availability v Configuring cluster interconnect

After completing the pre-initialization tasks, you may need to perform several tasks related to configuring the encryption group. Figure 18 summarizes the flow of the encryption-configuration tasks.

Encryption Configuration

Pre-initialization setup

Generate critical security parameters and certificates

Load and set up certificates

Establish Trusted Link (LKM

Node (switch)

level

appliance) Configure global parameters and

policies of encryption group Generate and back-up master key in

RSA environments Key Vault high availability handling

Configure cluster interconnect

Encryption group configuration

Crypto target container configuration

Encryption

group level

Crypto LUN (disk) configuration

Crypto tape configuration

Other configuration

b32e4009

Figure 18. Encryption configuration

Avoid double encryption

Encryption and decryption at the storage device level does not affect the encryption switch or blade capabilities, and does not cause problems with decrypting the data. However, double encryption adds the unnecessary need to manage two sets of encryption keys, increases the risk of losing data, may reduce performance, and does not add security.

Verifying correct operation and backing up the configuration

To verify correct operation and to back up the system, follow these steps.

1. Check the LEDs to verify that all components are functional. For information about LED patterns, see Chapter 4, “Monitoring system components,” on page

51.

2. If necessary, log on to the switch by Telnet, using the admin account.

Chapter 3. Starting and configuring the SAN384B-2 47

3. Verify the correct operation of the system by entering the switchShow command from the workstation. This command provides information about switch and port status.

4. Verify the correct operation of the SAN384B-2 in the fabric by entering the fabricShow command from the workstation. This command provides general information about the fabric.

5. To back up the configuration, run the two steps: a. Enter the configupload -vf command. This command uploads the system

virtual fabric data.

b. Enter the configupload command. This command uploads the system

configuration.

6. Run the commands to see additional configuration information that you can then copy to a file to save:

v configShow

v ipAddrShow

v licenseShow

v switchShow

Alternatively, you can save the configuration file to the USB device by using the usbstorage command.

Note: Passwords are not saved in the configuration file, and are not uploaded

during a configUpload. Password information should be saved in hardcopy in a secure location for reference, subject to your security and password management policy.

Note: It is recommended that the configuration be backed up on a regular basis to

ensure that a complete configuration is available for downloading to a replacement device.

Fabric OS firmware updates

To ensure optimum functioning of your system, IBM recommends operating your system with the latest Fabric OS version and firmware updates. Refer to the latest Fabric OS Release Notes and Interoperability Matrix for information regarding Fabric OS compatibility. This is particularly important for fabrics with 1-Gbps switches using earlier Fabric OS versions. Detailed information on downloading and installing firmware are provided in “Downloading firmware from an FTP server” on page 78 and “Downloading firmware from a USB device” on page 80. More information can also be found in the Fabric OS Administrator's Guide.

To access the appropriate matrix:

v Go to the IBM SAN web page www.ibm.com/systems/storage/san v Select the SAN768B-2 and SAN384B-2 product link v On the displayed product page, click the Interoperability Matrix link in the

Learn more section.

Firmware release notes and download files are available through the IBM Support Portal.

To view release notes and to download firmware: v Go to the IBM Support Portal www.ibm.com/supportportal.

48 SAN384B-2 Installation, Service, and User Guide

v Search for the product Machine type, 2499 or the product name. v On the next page that is displayed, select Download under the Task section. v From the displayed page, select the Release notes link. Review the release notes

of the appropriate release version before installing the firmware update.

v Click the Release Firmware link and follow the online prompts to navigate to

the Brocade Downloads for IBM End Users page.

v Follow the links and instructions on the Brocade pages. Note that associated

FOS documentation can also be downloaded from this site.

Downloading and installing firmware

See “Downloading firmware from an FTP server” on page 78 and “Downloading firmware from a USB device” on page 80 for detailed steps to download and install firmware on the CP blades.

1. The firmware version on both the active and backup CP blade should match, and should be at the latest level. If High Availability is enabled (haEnable), the system will automatically update the firmware level on both CP blades.

Attention: Firmware downloads require Ethernet connections to both CP blades. Procedures for downloading and installing firmware are fully described in the Fabric OS Administrator's Guide.

2. When you have navigated to the appropriate download site, follow the online instructions on the displayed Fabric OS download pages, referring to the Fabric OS Administrator's Guide as needed.

3. Enter firmwareDownload -s on your to download the firmware to one of the CP blades from your server.

Powering off the SAN384B-2

If you need to power off the system, follow these steps to avoid loss of data.

1. Shut down the system using the sysShutdown command.

switch::admin> sysshutdown This command will shutdown the operating systems on your switch. You are required to power-cycle the switch in order to restore operation. Are you sure you want to shutdown the switch [y/n]? y HA is disabled Stopping blade 1

Shutting down the blade....

Stopping blade 2

Shutting down the blade....

Stopping blade 8

Shutting down the blade....

Broadcast message from root (pts/1) Tue Aug 23 14:23:06 2011... The system is going down for system halt NOW !!

2. Power off the chassis by flipping the AC power switches on the power supplies to "O". The LEDs inside AC power switches should turn off. To maintain the ground connections, leave the power cords connected to the power supplies and to the electrical outlets.

Chapter 3. Starting and configuring the SAN384B-2 49

50 SAN384B-2 Installation, Service, and User Guide

Chapter 4. Monitoring system components

The SAN384B-2 is engineered for reliability and requires no routine operational steps or maintenance. This chapter provides information about determining the status of the components using LEDs and CLI commands. Refer to the Fabric OS Administrator's Guide and the Web Tools Administrator's Guide for more information on monitoring component status.

There are two commands that can be especially helpful in monitoring the health of the system. These commands are switchShow and chassisShow. Examples of these commands are shown below. Note in the switchShow command the new switchType for the SAN384B-2 as well as the 16 Gbps speed identification for capable ports. The output has been truncated to reduce information duplication.

SAN384B-2_130: admin> switchshow switchName: SAN384B-2 switchType: 121.3 switchState: Online switchMode: Native switchRole: Principal switchDomain: 130 switchId: fffc82 switchWwn: 10:00:00:05:33:03:2c:00 zoning: ON (BB) switchBeacon: OFF FC Router: ON FC Router BB Fabric ID: 10 Address Mode: 0 Index Slot Port Address Media Speed State Proto =======================================================

0 1 0 820000 id N8 Online FC F-Port

10:00:00:05:1e:f8:a0:b4

1 1 1 820100 id N8 Online FC F-Port

10:00:00:05:33:26:0e:65

2 1 2 820200 id N8 Online FC F-Port

10:00:00:05:33:48:5e:f5

3 1 3 820300 id N8 Online FC F-Port

10:00:00:05:1e:f8:a0:b3

4 1 4 820400 id N8 Online FC F-Port

10:00:00:05:33:26:10:15

5 1 5 820500 id N8 Online FC F-Port

10:00:00:05:1e:f8:a0:b1

6 1 6 820600 id N8 Online FC F-Port

10:00:00:05:33:48:5e:d0

7 1 7 820700 id N8 Online FC F-Port

10:00:00:05:33:26:df:6b

8 1 8 820800 id N8 Online FC F-Port

10:00:00:05:33:26:df:6a

9 1 9 820900 id N8 Online FC F-Port

10:00:00:05:33:48:6b:ea

10 1 10 820a00 id N8 Online FC F-Port

10:00:00:05:33:26:10:28

11 1 11 820b00 id N8 Online FC F-Port

10:00:00:05:33:26:10:73

12 1 12 820c00 id N8 Online FC F-Port

10:00:00:05:33:48:5e:d1

13 1 13 820d00 id N8 Online FC F-Port

10:00:00:05:33:26:10:29

14 1 14 820e00 id N8 Online FC F-Port

10:00:00:05:1e:f9:72:47

15 1 15 820f00 id N8 Online FC F-Port

10:00:00:05:33:26:0e:8a

16 1 16 821000 id N8 Online FC F-Port

10:00:00:05:33:26:0e:8b

17 1 17 821100 id N8 Online FC F-Port

10:00:00:05:33:48:6b:eb

18 1 18 821200 id N8 Online FC F-Port

10:00:00:05:1e:f9:72:46

19 1 19 821300 id N8 Online FC F-Port

10:00:00:05:33:26:10:14

20 1 20 821400 id N8 Online FC F-Port

10:00:00:05:33:26:0e:64

21 1 21 821500 id N8 Online FC F-Port

10:00:00:05:33:26:10:72

22 1 22 821600 id N8 Online FC F-Port

10:00:00:05:33:48:5e:f4

23 1 23 821700 id N8 Online FC F-Port

10:00:00:05:1e:f8:a0:b2

24 1 24 821800 -- N16 No_Module FC 25 1 25 821900 -- N16 No_Module FC 26 1 26 821a00 -- N16 No_Module FC 27 1 27 821b00 -- N16 No_Module FC 28 1 28 821c00 id N8 No_Light FC 29 1 29 821d00 id N8 No_Light FC 30 1 30 821e00 id N8 No_Light FC 31 1 31 821f00 id N8 No_Light FC 32 1 32 822000 id N8 No_Light FC 33 1 33 822100 id N8 No_Light FC 34 1 34 822200 id N8 No_Light FC 35 1 35 822300 id N8 No_Light FC 36 1 36 822400 id N8 No_Light FC 37 1 37 822500 id N8 No_Light FC 38 1 38 822600 id N8 No_Light FC 39 1 39 822700 id N8 No_Light FC 40 1 40 822800 id N8 No_Light FC 41 1 41 822900 id N8 No_Light FC 42 1 42 822a00 id N8 No_Light FC 43 1 43 822b00 id N8 No_Light FC 44 1 44 822c00 id N8 No_Light FC 45 1 45 822d00 -- N16 No_Module FC 46 1 46 822e00 -- N16 No_Module FC

47 1 47 822f00 -- N16 No_Module FC 256 3 0 ------ id 16G No_SigDet FC 257 3 1 ------ id 16G No_SigDet FC 258 3 2 ------ id 16G No_SigDet FC 259 3 3 ------ id 16G No_SigDet FC 260 3 4 ------ id 16G No_SigDet FC 261 3 5 ------ id 16G No_SigDet FC 262 3 6 ------ id 16G No_SigDet FC 263 3 7 ------ id 16G No_SigDet FC 264 3 8 ------ id 16G No_SigDet FC 265 3 9 ------ id 16G No_SigDet FC <output truncated> SAN384B-2_130:root

Note in the chassisShow command the Chassis Family designation for the SAN384B-2 along with specific information about every field-replaceable unit (FRU) in the chassis is displayed.

SAN384B-2_130:root> chassisshow

Chassis Family: SAN384B-2 Chassis Backplane Revision: 2

SW BLADE Slot: 1 Header Version: 2 Power Consume Factor: -160 Power Usage (Watts): -106

52 SAN384B-2 Installation, Service, and User Guide

Factory Part Num: 60-1002144-02 Factory Serial Num: BQB0345F00X Manufacture: Day: 19 Month: 11 Year: 2010 Update: Day: 29 Month: 3 Year: 2011 Time Alive: 32 days Time Awake: 0 days

CP BLADE Slot: 4 Header Version: 2 Power Consume Factor: -40 Factory Part Num: 60-1000376-08

Factory Serial Num: AHJ0420F08K Manufacture: Day: 21 Month: 5 Year: 2010 Update: Day: 29 Month: 3 Year: 2011 Time Alive: 229 days Time Awake: 0 days

CP BLADE Slot: 5 Header Version: 2 Power Consume Factor: -40 Factory Part Num: 60-1000376-08 Factory Serial Num: AHJ0420F086 Manufacture: Day: 21 Month: 5 Year: 2010 Update: Day: 29 Month: 3 Year: 2011 Time Alive: 229 days Time Awake: 0 days

CORE BLADE Slot: 3 Header Version: 2 Power Consume Factor: -135 Power Usage (Watts): -88 Factory Part Num: 60-1002142-02 Factory Serial Num: BQD0344F01K Manufacture: Day: 18 Month: 11 Year: 2010 Update: Day: 29 Month: 3 Year: 2011 Time Alive: 47 days Time Awake: 0 days

CORE BLADE Slot: 6 Header Version: 2 Power Consume Factor: -135 Power Usage (Watts): -87 Factory Part Num: 60-1002099-01 Factory Serial Num: BQD0337F00A Manufacture: Day: 16 Month: 9 Year: 2010 Update: Day: 29 Month: 3 Year: 2011 Time Alive: 77 days Time Awake: 0 days

AP BLADE Slot: 7 Header Version: 2 Power Consume Factor: -250 Factory Part Num: 60-1001157-21 Factory Serial Num: ATM0431F008 Manufacture: Day: 20 Month: 9 Year: 2010 Update: Day: 29 Month: 3 Year: 2011 Time Alive: 4 days Time Awake: 0 days

SW BLADE Slot: 8 Header Version: 2 Power Consume Factor: -140 Power Usage (Watts): -95 Factory Part Num: 60-1002145-02 Factory Serial Num: BQA0344F00S Manufacture: Day: 6 Month: 11 Year: 2010 Update: Day: 29 Month: 3 Year: 2011

Chapter 4. Monitoring system components 53

Time Alive: 32 days Time Awake: 0 days

POWER SUPPLY Unit: 1 Header Version: 2 Power Consume Factor: 2000 Factory Part Num: 23-0000067-01 Factory Serial Num: AGC2M03FR4P Manufacture: Day: 7 Month: 6 Year: 2010 Update: Day: 29 Month: 3 Year: 2011 Time Alive: 229 days Time Awake: 0 days

POWER SUPPLY Unit: 2 Header Version: 2 Power Consume Factor: 2000 Factory Part Num: 23-0000067-01 Factory Serial Num: AGC2M03FR7T Manufacture: Day: 7 Month: 6 Year: 2010 Update: Day: 29 Month: 3 Year: 2011 Time Alive: 221 days Time Awake: 0 days

FAN Unit: 1 Header Version: 2 Power Consume Factor: -126 Factory Part Num: 60-1000384-09 Factory Serial Num: AGB0623F0AM Manufacture: Day: 7 Month: 6 Year: 2010 Update: Day: 29 Month: 3 Year: 2011 Time Alive: 229 days Time Awake: 0 days

FAN Unit: 2 Header Version: 2 Power Consume Factor: -126 Factory Part Num: 60-1000384-09 Factory Serial Num: AGB0623F0AK Manufacture: Day: 7 Month: 6 Year: 2010 Update: Day: 29 Month: 3 Year: 2011 Time Alive: 229 days Time Awake: 0 days

WWN Unit: 1 Header Version: 2 Power Consume Factor: -1 Factory Part Num: 60-1000888-05 Factory Serial Num: ANN2524F01N Manufacture: Day: 7 Month: 6 Year: 2010 Update: Day: 29 Month: 3 Year: 2011 Time Alive: 229 days Time Awake: 0 days ID: BRD0000CA Part Num: SLKWRM0000X4S

WWN Unit: 2 Header Version: 2 Power Consume Factor: -1 Factory Part Num: 60-1000888-05 Factory Serial Num: ANQ0417F03P Manufacture: Day: 7 Month: 6 Year: 2010 Update: Day: 29 Month: 3 Year: 2011 Time Alive: 229 days Time Awake: 0 days

Chassis Factory Serial Num: ANP2523F00E SAN384B-2_130:root>

54 SAN384B-2 Installation, Service, and User Guide

The sections provide information on how to determine the status of different chassis components by viewing the LEDs or by entering commands.

v “Port, application, or encryption blade status” v “Control processor blade (CP8) status” on page 59 v “Core switch blade (CR16-4) status” on page 61 v “Power supply status” on page 63 v “Blower assembly status” on page 63 v “WWN card status” on page 65

Port, application, or encryption blade status

To determine the status of a port or application blade:

1. Check the LEDs on the blade. The illustrations show the blades oriented

horizontally, as they are installed in the SAN384B-2 chassis.

v Figure 19 illustrates the FC16-32 port blade v Figure 20 on page 56 illustrates the FC16-48 port blade v Figure 21 on page 56 illustrates the FC8-32E port blade v Figure 22 on page 56 illustrates the FC8-48E port blade v Figure 23 on page 57 illustrates the FC8-64 port blade v Figure 24 on page 57 illustrates the FS8-18 encryption blade v Figure 25 on page 58 illustrates the FX8-24 extension blade

2. Check the blade status by typing slotShow.

Figure 19. FC16-32 port blade

1 Status LED 3 Fibre Channel port

2 Power LED 4 Port status LED

The LED patterns may temporarily change during POST and other diagnostic tests. For information about how to interpret the LED patterns, see Table 8 on page 58.

Table 8 on page 58 describes the port blade LED patterns and the recommended actions for those patterns.

384b073

Chapter 4. Monitoring system components 55

Figure 20. FC16-48 port blade

1 Status LED 3 Fibre Channel port

2 Power LED 4 Port status LED

384b074

Figure 21. FC8-32E port blade

1 Status LED 3 Fibre Channel port

2 Power LED 4 Port status LED

384b086

Figure 22. FC8-48E port blade

1 Status LED 3 Fibre Channel port

56 SAN384B-2 Installation, Service, and User Guide

384b087

2 Power LED 4 Port status LED

Note: The FC8-64 port blade requires mSFPs (standard SFPs do not fit) as well as

narrower OM-3 LC cables offered by several major manufacturers.

Figure 23. FC8-64 port blade

1 Status LED 3 Fibre Channel port

2 Power LED 4 Port status LED

Note: The FC8-64 port blade requires mSFPs (standard SFPs do not fit) as well as

narrower OM-3 LC cables offered by several major manufacturers.

384b059

Figure 24. FS8-18 encryption blade

1 Status LED 3 Fibre Channel port

2 Power LED 4 Port status LED

384b069

Chapter 4. Monitoring system components 57

Figure 25. FX8-24 extension blade

1 Status LED 5 10GbE (XGE) port 0

2 Power LED 6 Port status LED for 10GbE port 0

3 GbE port 6 7 Port map

4 Port status LED for GbE port 6

Table 8 describes the port, application, and encryption blade LED patterns and the recommended actions for those patterns.

Table 8. Port, application, and encryption blade LED descriptions

LED purpose Color Status Recommended Action

Blade power LED Steady green Blade is enabled. No action required.

No light (LED is off) Blade is not powered on. Ensure that the blade is firmly

Blade status LED No light (LED is off) Blade is either healthy or does

Steady amber Blade is faulty. Ensure blade is firmly seated

Slow-flashing amber (on 2 seconds, then off 2 seconds)

Fast-flashing amber (on 1/2 second, then off 1/2 second)

not have power.

Blade is not seated correctly or is faulty.

Environmental range exceeded. Check for out-of-bounds

seated and either the thumbscrew is fully engaged or the slider is pushed up and the ejectors are fully engaged.

Verify that the power LED is on.

and check the status with the slotShow command. If the LED remains amber, contact IBM.

Pull blade out and reseat it. If the LED continues to flash, replace the blade.

environmental condition and correct it.

384b075

58 SAN384B-2 Installation, Service, and User Guide

Table 8. Port, application, and encryption blade LED descriptions (continued)

LED purpose Color Status Recommended Action

FC port status No light (LED is off) Port has no incoming power,

Steady green Port is online (connected to an

Slow-flashing green (on 1 second, then off 1 second)

Fast-flashing green (on 1/4 second, then off 1/4 second

Flickering green Port is online, with traffic

Steady amber Port is receiving light or signal

Slow-flashing amber (on 2 seconds, then off 2 seconds)

Fast-flashing amber (on 1/2 second, then off 1/2 second)

Alternating green/amber Port is bypassed Reset the port from the

GbE port status (FX8-24) - both GbE and 10 GbE ports

No light (LED is off) Port has no incoming power,

Steady green Port is online but has no

Slow-flashing green (on 1 second, then off 1 second)

Flickering green Port is online, with traffic

Fast-flashing amber (on 1/4 second, then off 1/4 second)

or there is no light or signal carrier detected.

Polling is in progress. Allow 60 seconds for polling to

Connected device is configured in an offline state.

external device) but has no traffic.

Port is online but segmented, indicating a loopback plug or cable or an incompatible switch.

Port is in internal loopback (diagnostic).

flowing through port.

carrier, but it is not online yet.

Port is disabled due to diagnostic tests or portDisable or portCfgPersistentEnable command.

Transceiver or port is faulty. Change the transceiver or reset

or there is no light or signal carrier detected.

traffic.

Beacon. Used to identify specific ports.

flowing through port.

Transceiver or port is faulty. Change the transceiver or reset

Verify that the power LED is on, check the transceiver and cable.

complete.

Verify the status of the connected device.

No action required.

Verify that the correct device is attached to the SAN384B-2.

No action required.

Reset the port from the workstation using the

portEnable or portCfgPersistentEnable

command.

Reset the port from the workstation using the

portEnable or portCfgPersistentEnable

command.

the switch from the workstation.

workstation using the

portEnable or portCfgPersistentEnable

command.

Verify that the power LED is on, check the transceiver and cable.

No action required.

the switch from the workstation.

Control processor blade (CP8) status

To determine the status of a CP blade:

1. Check the LED indicators on the CP blade (see Figure 26 on page 60). The LED

patterns may temporarily change during POST and other diagnostic tests. For information about how to interpret the LED patterns, see Table 9 on page 60.

Chapter 4. Monitoring system components 59

2. Check port blade status by entering theslotShow and haShow commands.

Figure 26 shows the control processor blade (CP8) and component parts.

Figure 26. Control processor blade (CP8) ports and LEDs

1 Blade power LED 5 Console serial port (IOIOI)

2 Blade status LED 6 Ethernet port (MGMT)

3 USB LED 7 Ethernet port (SERVICE)

4 USB port 8 Active CP LED

384b010

Table 9. CP blade LED descriptions

Recommended

LED purpose Color Status

Power Steady green CP blade is on. No action required.

No light (LED is off) CP blade is not on. Ensure that the blade

Status No light (LED is off) CP blade is either

healthy or does not have power.

Steady amber CP blade is faulty or

the switch is still booting.

Slow-flashing amber (on 2 seconds; then off 2 seconds)

Fast-flashing amber (on 1/2 second; then off 1/2 second)

CP blade is not seated correctly or is faulty.

Environmental range exceeded.

Action

is firmly seated and has power.

Verify that the power LED is on.

Ensure that the blade is firmly seated and the switch has completed booting. If the LED remains amber, contact IBM.

Pull the blade out and reseat it. If the LED continues to flash, replace the blade.

Check for out-of-bounds environmental condition and correct it.

60 SAN384B-2 Installation, Service, and User Guide

Table 9. CP blade LED descriptions (continued)

Recommended

LED purpose Color Status

Ethernet link status No light (LED is off) Either an Ethernet

link is not detected, or it does not have incoming power.

Flickering green/amber

Ethernet link speed No light (LED is off) Ethernet link speed is

Steady green Ethernet link speed is

USB Status LED is on USB device enabled No action required.

LED is off USB device not

Active CP Steady blue Active CP blade. No action required.

No light (LED is off) Standby CP blade. No action required.

Ethernet link is healthy and traffic is flowing through port.

10 Mbps or CP blade does not have incoming power.

100/1000 Mbps.

present or disabled

Action

Ensure that the blade has power, the Ethernet cable is firmly seated, and the connected device is functioning.

No action required.

Ensure that the CP has power. Note: To force a persistent Ethernet link speed, type the

ifModeSet

command.

No action required.

Core switch blade (CR16-4) status

To determine the status of a CR16-4 core switch blade:

1. Check the LED indicators on the core switch blade (Figure 27). The LED

patterns may temporarily change during POST and other diagnostic tests; for information about how to interpret the LED patterns, see Table 10 on page 62.

2. Check core switch blade status by entering slotShow and haShow.

Figure 27 shows the CR16-4 core switch blade and its components.

Figure 27. Core switch blade (CR16-4)

1 Power LED 3 QSFP port map and trunking

2 Status LED 4 QSFP connectors

384b076

diagram

Chapter 4. Monitoring system components 61

Table 10. CR16-4 blade LED descriptions

Recommended

LED purpose Color Status

Power Steady green CR16-4 blade is on. No action required.

No light (LED is off) CR16-4 blade is not

on.

Status No light (LED is off) CR16-4 is either

healthy or does not have power.

Steady amber CR16-4 blade is

faulty or the switch is still booting.

QSFP connector status LED

Slow-flashing amber (on 2 seconds; then off 2 seconds)

Fast-flashing amber (on 1/2 second; then off 1/2 second)

No light (LED is off) No QSFP module, all

Steady amber QSFP module is in,

Blinking amber Port is disabled or

Steady green QSFP module is in

CR16-4 blade is not seated correctly or is faulty.

Environmental range exceeded.

four QSFP ports are disabled

all four ports have no signal/no sync.

faulted, FC link activity, segmented, loopback mode, also during transition between cable plug in and all four ports online.

and all ports are online.

Action

Ensure blade is firmly seated and has power.

Verify that the power LED is on.

Ensure that the blade is firmly seated and the switch has completed booting. If the LED remains amber, contact IBM.

Pull the blade out and reset it. If the LED continues to flash, replace the blade.

Check for out-of-bounds environmental condition and correct it.

No action needed if the QSFP is not installed or verify that the QSFP is fully inserted.

Ensure that the cable is properly connected. If the LED remains amber, contact IBM.

Check for console messages or wait for all four ports to come online.

No action needed.

Refer to Figure 53 on page 151 for an illustration of the physical ports on the CR16-4 core blade and Table 30 on page 151 for a table mapping the external ports to internal ports as shown in the slotShow command

62 SAN384B-2 Installation, Service, and User Guide

Power supply status

To determine the status of a power supply:

1. Check the LED indicators on each power supply (see Figure 28). The LED

patterns may temporarily change during POST and other diagnostic tests; for information about how to interpret the LED patterns, see Table 11. Be sure to check both power supplies.

2. Check the power supply status by entering psShow.

The power supply status displays OK, Absent,orFaulty. If a power supply displays absent or faulty, contact IBM to order a replacement. Both "absent" or "faulty" could also be the result of the power supply being turned off or not being properly seated.

Figure 28. Power supply

384b012

1 Power LED

Table 11. Power supply LED descriptions

LED purpose Color Status

Power No light (LED is off) Power supply does

Blower assembly status

To determine the status of a blower assembly:

1. Check the LED indicators on each blower assembly (see Figure 29 on page 64).

The LED patterns may temporarily change during POST and other diagnostic tests; for information about how to interpret the LED patterns, see Table 12 on page 64. Be sure to check both blower assemblies.

not have incoming power and is not providing power to the SAN384B-2.

Steady green Power supply has

incoming power and is providing power to the SAN384B-2.

Flashing green Power supply is

about to fail.

Recommended Action

Ensure that the power supply is firmly seated, the SAN384B-2 has incoming power, both power cables are connected, and AC power switches are on.

No action required.

Replace the power supply.

Chapter 4. Monitoring system components 63

2. Check the blower assembly status using the fanShow command. The status for each blower assembly displays OK, Absent,orFaulty. The RPM

of each fan in the assembly is also provided. If a blower assembly displays absent or faulty, contact IBM to order a replacement. Both "absent" or "faulty" could also be the result of the blower assembly not being properly seated.

Figure 29 shows the blower assembly.

Figure 29. Blower assembly LEDs

1 Power LED 2 Fault LED

Table 12. Blower assembly LED descriptions

LED purpose Color Status

Power No Light (LED is off) Blower assembly

does not have power.

Steady green Blower assembly has

power.

384b013

Recommended action

Ensure that the blower assembly is firmly seated and has power.

No action required.

64 SAN384B-2 Installation, Service, and User Guide

Table 12. Blower assembly LED descriptions (continued)

LED purpose Color Status

Fault No Light (LED is off) Blower assembly is

either healthy or does not have power.

Steady amber Blower assembly has

a failure (full or partial).

Slow-flashing amber (on 2 sec, then off 2 sec)

Flashing amber (on 1/2 sec, then off 3.5 sec)

Fast-flashing amber (on 1/2 sec, then off 1/2 sec)

Blower assembly is not seated correctly or is faulty.

Fan is disabled. Run fanEnable to

Environmental range exceeded.

Recommended action

Ensure that the blower assembly has power.

Replace the blower assembly.

Pull the unit out and reseat it. If the LED continues to flash, replace the unit.

enable the fan.

Check for out-of-bounds environmental condition, resolve any problems, and reseat the unit. If the LED continues to flash, replace the unit.

WWN card status

Note: The WWN bezel (see Figure 30 on page 66) covers the WWN cards. The

To determine the status of the WWN card, enter the chassisShow command to display information about the WWN card. (WWN units correspond to information specific to the WWN card.) Error messages that may indicate problems with a WWN card are summarized in Table 13.

Table 13. Messages that may indicate WWN card failure

Type of Message Sample error message

WWN unit fails its FRU (field replaceable unit) header access.

WWN unit fails to power on <timestamp>, [EM-1004],

LEDs on the WWN cards are not visible unless the bezel is removed.

0x24c (fabos): Switch: switchname, error EM-I2C_TIMEOUT, 2, WWN 1 I2C timed out: state 0x4

<sequence-number>,,CRITICAL, <system-name>, WWN # failed to power on or <timestamp>, [EM-1043], <sequence-number>,, WARNING, <system-name>, Can’t power <FRU Id> <state (on or off)>

Chapter 4. Monitoring system components 65

Table 13. Messages that may indicate WWN card failure (continued)

Type of Message Sample error message

WWN unit is being faulted. 0x24c (fabos): Switch: switchname,

Critical EM-WWN_UNKNOWN, 1, Unknown WWN #2 is being faulted or <timestamp>, [EM-1003], 40, SLOT 7 | FFDC | CHASSIS, CRITICAL, SAN384B-2, WWN 2 has unknown hardware identifier: FRU faulted or <timestamp>, [EM-1034], <sequence-number>,, ERROR, <system-name>, WWN # set to faulty, rc=<return code>

WWN unit is not present or is not accessible.

Writing to the FRU history log (hilSetFruHistory) has failed.

WWN unit insertion was detected <timestamp> [EM-1049],

WWN unit removal was detected <timestamp> [EM-1050],

0x24c (fabos): Switch: switchname, Error EM-WWN_ABSENT, 2, WWN #1 not present or <timestamp>, [EM-1036], <sequence-number>,, WARNING, <system-name>, <FRU Id> is not accessible.

0x24c (fabos): Switch: switchname, Error EM-HIL_FAIL, 2, HIL Error: hilSetFruHistory failed, rc=-3 for SLOT 3

<sequence-number>,, INFO, <system-name>, FRU WWN # insertion detected.

<sequence-number>,, INFO, <system-name>, FRU WWN # removal detected.

Figure 30 displays the WWN bezel. The WWN bezel must be removed to reveal the WWN cards and LEDs. See “Removing and installing a WWN bezel and WWN card” on page 88 for removal instructions.

384b014

Figure 30. WWN bezel

66 SAN384B-2 Installation, Service, and User Guide

Chapter 5. Removing and installing components

Attention: Read the safety notices before servicing (see “Safety notices and labels” on page xv).

The field replaceable units (FRUs) in the SAN384B-2 can be removed and installed without special tools. The SAN384B-2 can continue operating during many of the FRU replacements if the conditions specified in the procedures are followed.

Attention: The system contains electrostatic discharge (ESD) sensitive FRUs. When working with any FRU, follow ESD precautions (see “ESD precautions” on page xxi).

The sections contain FRU removal and installation procedures.

v “Removing and installing the chassis door” v “Removing and installing cable management finger assemblies” on page 68 v “Removing and installing port, application, and encryption blades” on page 70 v “Removing and installing blade filler panels” on page 72 v “Removing and installing a CP8 control processor blade” on page 73 v “Removing and installing a CR16-4 core switch blade” on page 82 v “Removing and installing a power supply” on page 84 v “Removing and installing a blower assembly” on page 86 v “Removing and installing a WWN bezel and WWN card” on page 88 v “Removing and installing transceivers” on page 90 v “Removing and replacing inter-chassis link (QSFP) cables” on page 93 v “Removing and replacing a SAN384B-2 chassis” on page 98

Removing and installing the chassis door

Note: The chassis door must be installed to ensure the SAN384B-2 meets EMI and

other regulatory certifications. Additionally, if ICL cables are not used, EMI plugs must be inserted in the ICL cable ports to meet certification standards.

Time and items required

The replacement procedure for the chassis door takes less than 5 minutes.

Removing the chassis door

Complete the steps to remove a chassis door.

1. Support the door to prevent it from falling.

2. Pull and remove the door. It will pop off the ball studs.

Complete the steps to install a chassis door.

1. Align the holes on the back of the door with the ball studs on the chassis

2. Push the door into place. It will snap onto the studs. See Figure 31 on page 68.

Figure 31. Chassis door

Removing and installing cable management finger assemblies

The SAN384B-2 comes equipped with two vertical cable management finger assemblies. It can continue to operate during the replacement of the cable management assemblies. Due to the horizontal orientation of the blades, the cable management assemblies are attached to the uprights of the mounting rack.

Time and items required

The replacement procedure for the cable management fingers takes less than five minutes. A #1 Phillips screwdriver is required.

Removing a cable management finger assembly

Complete the steps to remove the cable management finger assembly.

1. Remove the chassis door.

2. Remove the cables from the cable management finger assembly and rearrange

the cables around the assembly.

3. Unscrew and save the two screws that attach the cable management assembly to the rack upright (see Figure 32 on page 69). Support the assembly to prevent it from falling.

4. Remove the cable management assembly.

5. If necessary, repeat steps 2-4 for the other cable management assembly.

384b015

68 SAN384B-2 Installation, Service, and User Guide

IBM System Storage SAN384B-2 Installation, Service And User Manual

Specifications and Main Features

Frequently Asked Questions

User Manual

Read this first

Summary of changes

Fifth edition

Fourth edition

Third edition

Second edition

Getting help

Taiwan Contact Information

How to send your comments

Contents

Figures

Tables

Safety notices

Safety notices and labels

Danger notices

Delivery and subsequent transportation of the equipment

Caution notices

Safety labels

Attention notices

ESD precautions

Rack safety

Rack installation

Rack relocation (19" rack)

Safety inspections

Removing AC power

External machine checks

Internal machine checks

Product recycling and disposal

About this document

Who should read this document

Product documents

Brocade documents

IBM and Brocade product matrix

Accessibility features for SAN384B-2

Accessibility features

Keyboard navigation

Vendor software

Related accessibility information

IBM and accessibility

Chapter 1. Introduction

Overview of the SAN384B-2

Hardware components

SAN384B-2 blades

High availability

Reliability

Serviceability

Software features

Security

Network Manageability

Chapter 2. Installing a SAN384B-2 in a cabinet

Items included with the SAN384B-2

Ordering the lift tool

World trade locations

United States locations

Installation guidelines

Installing a SAN384B-2 in a 2109 C36 cabinet

Time required

Unpacking and assembling the lift tool

Unpacking the SAN384B-2

Installing the port-side exhaust kit

Exhaust kit parts list

Torque requirements

Installing the exhaust kit hardware

Installing the SAN384B-2 into the cabinet

Port numbering

Chassis slots

Cable organization

Chapter 3. Starting and configuring the SAN384B-2

Providing power to the SAN384B-2

Connecting the SAN384B-2 and host with a serial cable

Logging in to the serial console port

Configuring the IP addresses

Logging off the serial console port and disconnecting the serial cable

Establishing an Ethernet connection

Customizing the switch name

Customizing a chassis name