IBM SAN768B Installation, Service And User Manual

IBM System Storage SAN768B
Installation, Service, and User’s Guide
Service information: 2499-384
Read Before Using
This product contains software that is licensed under written license agreements. Your use of such software is subject to the license agreements under which they are provided.
GA32-0574-01
IBM System Storage SAN768B
Installation, Service, and User’s Guide
Service information: 2499-384
GA32-0574-01
Note:
Before using this information and the product it supports, read the information in “Notices” on page 117.
The following paragraph does not apply to any country (or region) where such provisions are inconsistent with local law.
INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION “AS IS” WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states (or regions) do not allow disclaimer of express or implied warranties in certain transactions; therefore, this statement may not apply to you.
© Copyright International Business Machines Corporation 2008. All rights reserved.
US Government Users Restricted Rights Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

Read this first

Summary of changes

| | | | |

Second edition

|
|
|
| |
|
|
|

Getting help

This is the second edition of the IBM System Storage SAN768B Installation, Service, and User's Guide. The content changes since the last edition of this
publication are noted by a vertical line placed in the left margin beside each change. Minor edits are not identified by this mark. A summary of the changes for each edition are listed below.
The following changes were made in the second edition:
v The section on power cords was corrected. v The rack installation instructions were modified to reflect a new rack installation
kit.
v The Integrated Routing feature was added. v Minor changes were made to the environmental, safety, and other notices. v Minor changes to Fabric OS publication titles.
For the latest version of your product documentation, visit the web at http://www.elink.ibmlink.ibm.com/public/applications/publications/cgibin/pbi.cgi. Search by form number or title.
For more information about IBM® SAN products, see the following Web site: http://www.ibm.com/servers/storage/san/
For support information for this product and other SAN products, see the following Web site: http://www.ibm.com/servers/storage/support/san
You can also contact IBM within the United States at 1-800-IBMSERV (1-800-426-7378). For support outside the United States, you can find the service number at: http://www.ibm.com/planetwide/.
Visit www.ibm.com/contact for the contact information for your country or region.
For detailed information about the Fibre Channel standards, see the Fibre Channel Industry Association (FCIA) Web site at: www.fibrechannel.org/
For information about storage industry standards, see the Storage Networking Industry Association (SNIA) Web site at: http://www.snia.org/

Taiwan Contact Information

IBM Taiwan Product Service Contact Info: IBM Taiwan Corporation 3F, No 7, Song Ren Rd., Taipei Taiwan Tel: 0800-016-888
© Copyright IBM Corp. 2008 iii

How to send your comments

Your feedback is important in helping us provide the most accurate and high-quality information. If you have comments or suggestions for improving this document, send us your comments by e-mail to starpubs@us.ibm.com or use the Readers’ Comments form at the back of this publication. Be sure to include the following:
v Exact publication title v Form number (for example, GC26-1234-02) v Page numbers to which you are referring
the Reader Comment Form in the back of this manual is missing, you can direct
If your mail to:
International Business Machines Corporation Information Development Department GZW 9000 South Rita Road Tucson, Arizona 85744-0001 U.S.A.
When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you.
iv SAN768B Installation, Service, and User’s Guide

Contents

||
Read this first . . . . . . . . . . . . . . . . . . . . . . . . . iii
Summary of changes . . . . . . . . . . . . . . . . . . . . . . . iii
Second edition . . . . . . . . . . . . . . . . . . . . . . . . iii
Getting help . . . . . . . . . . . . . . . . . . . . . . . . . . iii
Taiwan Contact Information . . . . . . . . . . . . . . . . . . . . iii
How to send your comments . . . . . . . . . . . . . . . . . . . .iv
Figures . . . . . . . . . . . . . . . . . . . . . . . . . . . .ix
Tables . . . . . . . . . . . . . . . . . . . . . . . . . . . .xi
Safety and environmental notices . . . . . . . . . . . . . . . . . xiii
Safety notices and labels . . . . . . . . . . . . . . . . . . . . . xiii
Danger notices . . . . . . . . . . . . . . . . . . . . . . . . xiii
Caution notices . . . . . . . . . . . . . . . . . . . . . . . . xvi
Safety labels . . . . . . . . . . . . . . . . . . . . . . . . xvii
Attention notices . . . . . . . . . . . . . . . . . . . . . . . xviii
Rack safety . . . . . . . . . . . . . . . . . . . . . . . . . . xix
Rack installation . . . . . . . . . . . . . . . . . . . . . . . xix
Rack relocation (19 rack) . . . . . . . . . . . . . . . . . . . .xx
Safety inspections . . . . . . . . . . . . . . . . . . . . . . . xxi
Removing ac power . . . . . . . . . . . . . . . . . . . . . . xxi
External machine checks . . . . . . . . . . . . . . . . . . . . xxi
Internal machine checks . . . . . . . . . . . . . . . . . . . . xxi
Product recycling and disposal . . . . . . . . . . . . . . . . . . . xxii
Battery return program . . . . . . . . . . . . . . . . . . . . . xxiii
For the European Union: . . . . . . . . . . . . . . . . . . . . xxiii
About this document . . . . . . . . . . . . . . . . . . . . . xxv
Who should read this document . . . . . . . . . . . . . . . . . . xxv
Product documents . . . . . . . . . . . . . . . . . . . . . . . xxv
Brocade documents . . . . . . . . . . . . . . . . . . . . . . . xxv
IBM and Brocade product matrix . . . . . . . . . . . . . . . . . xxv
Chapter 1. Introduction . . . . . . . . . . . . . . . . . . . . . .1
Overview of the SAN768B . . . . . . . . . . . . . . . . . . . . .1
Hardware components . . . . . . . . . . . . . . . . . . . . . .2
SAN768B blades . . . . . . . . . . . . . . . . . . . . . . . .4
High availability . . . . . . . . . . . . . . . . . . . . . . . . .6
Reliability . . . . . . . . . . . . . . . . . . . . . . . . . . .6
Serviceability . . . . . . . . . . . . . . . . . . . . . . . . . .6
Software features . . . . . . . . . . . . . . . . . . . . . . . .7
Security . . . . . . . . . . . . . . . . . . . . . . . . . . .7
Network Manageability . . . . . . . . . . . . . . . . . . . . .8
Port numbering . . . . . . . . . . . . . . . . . . . . . . . . .8
Managing cables . . . . . . . . . . . . . . . . . . . . . . . . .9
Chapter 2. Installing and removing a SAN768B . . . . . . . . . . . .11
Ordering the lift tool . . . . . . . . . . . . . . . . . . . . . . .12
World trade locations . . . . . . . . . . . . . . . . . . . . .12
United States locations . . . . . . . . . . . . . . . . . . . . .12
Installation guidelines . . . . . . . . . . . . . . . . . . . . . .13
Installing a SAN768B in a cabinet . . . . . . . . . . . . . . . . . .14
© Copyright IBM Corp. 2008 v
Time required . . . . . . . . . . . . . . . . . . . . . . . .14
Tools required . . . . . . . . . . . . . . . . . . . . . . . .14
|| || || ||
Parts list . . . . . . . . . . . . . . . . . . . . . . . . . .14
Unpacking the SAN768B . . . . . . . . . . . . . . . . . . . .15
Attaching the shelf brackets . . . . . . . . . . . . . . . . . . .16
Removing the chassis door . . . . . . . . . . . . . . . . . . .17
Using the lift tool, the 24–inch load plate, and the bridge tool . . . . . . .17
Removing a SAN768B from the cabinet . . . . . . . . . . . . . . . .23
Chapter 3. Starting and configuring the SAN768B . . . . . . . . . . .25
Providing power to the SAN768B . . . . . . . . . . . . . . . . . .26
Establishing a serial connection and logging on to the SAN768B . . . . . .26
Configuring the SAN768B IP addresses . . . . . . . . . . . . . . . .27
Establish an Ethernet connection . . . . . . . . . . . . . . . . . .29
Customize a switch name . . . . . . . . . . . . . . . . . . . . .30
Set the Domain ID . . . . . . . . . . . . . . . . . . . . . . .30
Verifying the PID mode and connecting to the fabric . . . . . . . . . . .30
Enabling software licenses . . . . . . . . . . . . . . . . . . . .31
Backing up the configuration . . . . . . . . . . . . . . . . . . . .32
Chapter 4. Monitoring system components . . . . . . . . . . . . .33
Control processor blade (CP8) . . . . . . . . . . . . . . . . . . .33
Core switch blade (CR8) . . . . . . . . . . . . . . . . . . . . .35
FR4-18i router blade . . . . . . . . . . . . . . . . . . . . . . .37
Port or application blades . . . . . . . . . . . . . . . . . . . . .40
Power supply . . . . . . . . . . . . . . . . . . . . . . . . .45
Blower assembly . . . . . . . . . . . . . . . . . . . . . . . .46
WWN bezel and WWN card . . . . . . . . . . . . . . . . . . . .48
Chapter 5. Removing and installing components . . . . . . . . . . .51
Removing and installing the chassis door . . . . . . . . . . . . . . .51
Time and items required . . . . . . . . . . . . . . . . . . . .51
Removing the chassis door . . . . . . . . . . . . . . . . . . .51
Removing and installing a cable management comb . . . . . . . . . . .52
Time and items required . . . . . . . . . . . . . . . . . . . .52
Removing a cable management comb . . . . . . . . . . . . . . .52
Installing a cable management comb . . . . . . . . . . . . . . . .53
Removing and installing port blades . . . . . . . . . . . . . . . . .53
Time and items required . . . . . . . . . . . . . . . . . . . .54
Removing a port blade . . . . . . . . . . . . . . . . . . . . .54
Installing a port blade . . . . . . . . . . . . . . . . . . . . .55
Removing and installing port blade filler panels . . . . . . . . . . . . .56
Removing a filler panel . . . . . . . . . . . . . . . . . . . . .56
Installing a filler panel . . . . . . . . . . . . . . . . . . . . .57
Removing and installing a control processor blade (CP8) . . . . . . . . .57
Time and items required . . . . . . . . . . . . . . . . . . . .58
Verifying the necessity of installation . . . . . . . . . . . . . . . .58
Recording critical SAN768B information . . . . . . . . . . . . . . .58
Removing a control processor blade (CP8) . . . . . . . . . . . . .60
Installing a control processor blade (CP8) . . . . . . . . . . . . . .61
Verifying operation of the new CP blade . . . . . . . . . . . . . .62
Removing and installing a core switch blade (CR8) . . . . . . . . . . .63
Time and items required . . . . . . . . . . . . . . . . . . . .64
Verifying the necessity of installation . . . . . . . . . . . . . . . .64
Removing a core switch blade (CR8) . . . . . . . . . . . . . . . .64
Installing a core switch blade (CR8) . . . . . . . . . . . . . . . .65
vi SAN768B Installation, Service, and User’s Guide
Removing and installing an FR4-18i router blade . . . . . . . . . . . .66
Time required . . . . . . . . . . . . . . . . . . . . . . . .66
Items required . . . . . . . . . . . . . . . . . . . . . . . .66
Removing a router blade . . . . . . . . . . . . . . . . . . . .66
Installing a router blade . . . . . . . . . . . . . . . . . . . . .67
Configuring FCIP and Fibre Channel routing services and enabling the ports 68
Cabling the FR4-18i router blade . . . . . . . . . . . . . . . . .68
Removing and installing a power supply . . . . . . . . . . . . . . .69
Time and items required . . . . . . . . . . . . . . . . . . . .69
Removing a power supply . . . . . . . . . . . . . . . . . . . .69
Installing a power supply . . . . . . . . . . . . . . . . . . . .70
Removing and installing a blower assembly . . . . . . . . . . . . . .71
Time and items required . . . . . . . . . . . . . . . . . . . .71
Removing a blower assembly . . . . . . . . . . . . . . . . . .71
Installing a blower assembly . . . . . . . . . . . . . . . . . . .72
Removing and installing a WWN bezel and WWN card . . . . . . . . . .72
Time and items required . . . . . . . . . . . . . . . . . . . .72
Verifying necessity of installation . . . . . . . . . . . . . . . . .73
Removing the WWN bezel and WWN card . . . . . . . . . . . . .74
Installing the WWN bezel and WWN card . . . . . . . . . . . . . .75
Installing and removing FC transceivers in a port blade . . . . . . . . . .76
Chapter 6. Installing new features . . . . . . . . . . . . . . . . .79
FC3816, FC3832, FC3848 - Installing a 8-Gb port blade (16, 32, or 48 ports) 79
Time required . . . . . . . . . . . . . . . . . . . . . . . .79
Items required . . . . . . . . . . . . . . . . . . . . . . . .79
Procedures . . . . . . . . . . . . . . . . . . . . . . . . .79
FC3850 - Installing an FR4-18i routing blade . . . . . . . . . . . . . .80
Time required . . . . . . . . . . . . . . . . . . . . . . . .81
Items required . . . . . . . . . . . . . . . . . . . . . . . .81
Procedures . . . . . . . . . . . . . . . . . . . . . . . . .81
FC3870 - Installing an FC10-6 10 Gb blade . . . . . . . . . . . . . .82
Time required . . . . . . . . . . . . . . . . . . . . . . . .82
Items required . . . . . . . . . . . . . . . . . . . . . . . .82
Procedures . . . . . . . . . . . . . . . . . . . . . . . . .82
Chapter 7. Installing the chassis . . . . . . . . . . . . . . . . . .83
Verifying necessity of replacement . . . . . . . . . . . . . . . . . .83
Preparing for a chassis installation . . . . . . . . . . . . . . . . . .84
Time required . . . . . . . . . . . . . . . . . . . . . . . .84
Items required . . . . . . . . . . . . . . . . . . . . . . . .84
Recording critical SAN768B and SAN information . . . . . . . . . . .84
Chassis critical information checklist . . . . . . . . . . . . . . . .87
Disconnecting the SAN768B from the network and fabric . . . . . . . . .88
Removing components from the chassis . . . . . . . . . . . . . . .88
Removing and replacing the chassis . . . . . . . . . . . . . . . . .89
Installing components into the new chassis . . . . . . . . . . . . . .90
Verifying the correct operation of hardware . . . . . . . . . . . . . .90
Verifying the correct operation of the system . . . . . . . . . . . . . .91
Reconnecting the system to the network and fabric . . . . . . . . . . .92
Verifying the correct configuration of the fabric . . . . . . . . . . . . .93
Cable routing tables . . . . . . . . . . . . . . . . . . . . . . .93
Appendix A. Product specifications . . . . . . . . . . . . . . . .95
System architecture . . . . . . . . . . . . . . . . . . . . . . .95
Physical dimensions . . . . . . . . . . . . . . . . . . . . . . .97
Contents vii
Facility requirements . . . . . . . . . . . . . . . . . . . . . . .97
Power specifications . . . . . . . . . . . . . . . . . . . . . . .98
Environmental requirements . . . . . . . . . . . . . . . . . . . .99
Data transmission ranges . . . . . . . . . . . . . . . . . . . . .99
Fibre channel port specifications . . . . . . . . . . . . . . . . . . 100
FR4-18i router Fibre channel port specifications . . . . . . . . . . . . 100
FR4-18i router GbE port specifications . . . . . . . . . . . . . . . . 100
Power cords . . . . . . . . . . . . . . . . . . . . . . . . . 101
Appendix B. Diagnostics and troubleshooting . . . . . . . . . . . . 103
Obtaining chassis and component status . . . . . . . . . . . . . . . 103
Interpreting POST and boot results . . . . . . . . . . . . . . . . . 104
POST . . . . . . . . . . . . . . . . . . . . . . . . . . . 104
Boot . . . . . . . . . . . . . . . . . . . . . . . . . . . 105
Diagnostics . . . . . . . . . . . . . . . . . . . . . . . . . . 105
Validating the installation of port blades . . . . . . . . . . . . . . . 105
Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . 106
Powering off the SAN768B . . . . . . . . . . . . . . . . . . . . 109
Appendix C. Port numbering templates . . . . . . . . . . . . . . 111
Notices . . . . . . . . . . . . . . . . . . . . . . . . . . .117
Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . .119
Electronic emission notices . . . . . . . . . . . . . . . . . . . . 120
Federal Communications Commission (FCC) Class A Statement . . . . . 120
Industry Canada Class A Emission Compliance Statement . . . . . . . 120
Avis de conformité à la réglementation d’Industrie Canada . . . . . . . 120
European Union (EU) Electromagnetic Compatibility Directive . . . . . . 120
Germany Electromagnetic Compatibility Directive . . . . . . . . . . . 121
Japan VCCI Class A ITE Electronic Emission Statement . . . . . . . . 122
People’s Republic of China Class A Electronic Emission Statement . . . . 122
Korea Class A Electronic Emission Statement . . . . . . . . . . . . 122
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . 123
viii SAN768B Installation, Service, and User’s Guide

Figures

1. Port side of the SAN768B (sample configuration) . . . . . . . . . . . . . . . . . . .3
2. Blower (non-port) side of the SAN768B (sample configuration) . . . . . . . . . . . . . .4
3. Parts in the 14U rack mount kit . . . . . . . . . . . . . . . . . . . . . . . . .15
||
4. Left and right shelf brackets installed on the cabinet rails . . . . . . . . . . . . . . . .16
||
5. Installing clip or retainer nuts on the vertical cabinet rails . . . . . . . . . . . . . . . .17
||
6. Chassis installation from rear (exhaust aisle side) of the cabinet . . . . . . . . . . . . .19
||
7. Locking the shelf into position . . . . . . . . . . . . . . . . . . . . . . . . . .20
8. Attaching the port side of the chassis to the cabinet rails . . . . . . . . . . . . . . . .21
||
9. Aligning the chassis door with the ball studs on the chassis . . . . . . . . . . . . . . .22
||
10. Details of the chassis and door, showing the ball studs on the chassis and the mounting hardware
| ||
on the door . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .22
11. Control processor blade (CP8) LEDs . . . . . . . . . . . . . . . . . . . . . . .34
12. Core switch blade (CR8) LEDs . . . . . . . . . . . . . . . . . . . . . . . . . .36
13. FR4-18i router blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38
14. FC8-16 port blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .41
15. FC8-32 port blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42
16. FC8-48 port blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43
17. FC10-6 port blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44
18. Power supply LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .46
19. Blower assembly LEDs and other parts . . . . . . . . . . . . . . . . . . . . . .47
20. LEDs on the WWN card and bezel . . . . . . . . . . . . . . . . . . . . . . . .49
21. Chassis door . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .52
22. Cable management comb . . . . . . . . . . . . . . . . . . . . . . . . . . .53
23. Port blade removal and installation (16-port blade shown as example) . . . . . . . . . . .55
24. Port blade removal and installation (16-port blade shown as example) . . . . . . . . . . .57
25. Removing the control processor (CP) blade . . . . . . . . . . . . . . . . . . . . .61
26. Removing the core switch blade . . . . . . . . . . . . . . . . . . . . . . . . .65
27. Removing and installing a power supply . . . . . . . . . . . . . . . . . . . . . .70
28. Blower assembly LEDs and other parts . . . . . . . . . . . . . . . . . . . . . .72
29. WWN bezel and card removal and installation . . . . . . . . . . . . . . . . . . . .75
30. SFP extraction tool . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .77
31. Port side populated with eight FC8-48 port blades, two CR8 blades, and two CP8 blades 112
32. Port side populated with eight FC8-32 port blades, two CR8 blades, and two CP8 blades 113
33. Port side populated with eight FC8-16 port blades, two CR8 blades, and two CP8 blades 114
34. FC10-6 port blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .115
35. FC4-18IP port blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . .116
© Copyright IBM Corp. 2008 ix
x SAN768B Installation, Service, and User’s Guide

Tables

1. Brocade and IBM product and model number matrix . . . . . . . . . . . . . . . . . xxvi
2. Blades available for the SAN768B . . . . . . . . . . . . . . . . . . . . . . . . .4
3. Security features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7
4. Port blades available on the SAN768B . . . . . . . . . . . . . . . . . . . . . . .8
5. Items supplied with the 14U rack mount kit . . . . . . . . . . . . . . . . . . . . .14
||
6. Configuration parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . .27
7. Example login without changing the password . . . . . . . . . . . . . . . . . . . .27
8. Example of viewing enabled licenses . . . . . . . . . . . . . . . . . . . . . . .31
9. CP blade LED descriptions . . . . . . . . . . . . . . . . . . . . . . . . . . .34
10. CR blade LED descriptions . . . . . . . . . . . . . . . . . . . . . . . . . . .36
11. FR4-18i router blade LED patterns during normal operation . . . . . . . . . . . . . . .39
12. Port and application blade LED descriptions . . . . . . . . . . . . . . . . . . . . .45
13. Power supply LED descriptions . . . . . . . . . . . . . . . . . . . . . . . . .46
14. Blower assembly LED descriptions . . . . . . . . . . . . . . . . . . . . . . . .47
15. Messages that may indicate WWN card failure . . . . . . . . . . . . . . . . . . . .48
16. WWN bezel LED descriptions . . . . . . . . . . . . . . . . . . . . . . . . . .49
17. WWN LED patterns . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .73
18. Commands identifying the WWN card status . . . . . . . . . . . . . . . . . . . .73
19. WWN card related system log messages . . . . . . . . . . . . . . . . . . . . . .74
20. Critical information checklist example . . . . . . . . . . . . . . . . . . . . . . .87
21. Sample cable routing table for SAN768B (Switch Name: swDir) . . . . . . . . . . . . .93
22. Cable routing table for SAN768B . . . . . . . . . . . . . . . . . . . . . . . . .93
23. System architecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .95
24. System sizes and weights . . . . . . . . . . . . . . . . . . . . . . . . . . .97
25. System FRU weights . . . . . . . . . . . . . . . . . . . . . . . . . . . . .97
26. Power specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . .98
27. Environmental requirements . . . . . . . . . . . . . . . . . . . . . . . . . . .99
28. Data transmission ranges by cable type and port speed . . . . . . . . . . . . . . . .99
29. Environmental status and maintenance commands . . . . . . . . . . . . . . . . . . 104
30. Commands for validating installation of port blades . . . . . . . . . . . . . . . . . . 106
31. Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106
© Copyright IBM Corp. 2008 xi
xii SAN768B Installation, Service, and User’s Guide

Safety and environmental notices

This section contains information about:
v “Safety notices and labels” v “Rack safety” on page xix v “Safety inspections” on page xxi v “Product recycling and disposal” on page xxii

Safety notices and labels

When using this product, observe the danger, caution, and attention notices contained in this guide. The notices are accompanied by symbols that represent the severity of the safety condition. The danger and caution notices are listed in numerical order based on their IDs, which are displayed in parentheses, for example (D004), at the end of each notice. Use this ID to locate the translation of these danger and caution notices in the IBM Systems Safety Notices (G229–9054) publication, which is on the CD-ROM that accompanies this product.
The following notices and statements are used in IBM documents. They are listed below in order of increasing severity of potential hazards. Follow the links for more detailed descriptions and examples of the danger, caution, and attention notices in the sections that follow.
v Note: These notices provide important tips, guidance, or advice. v “Attention notices” on page xviii: These notices indicate potential damage to
programs, devices, or data.
v “Caution notices” on page xvi: These statements indicate situations that can
be potentially hazardous to you.
v “Danger notices”: These statements indicate situations that can be potentially
lethal or extremely hazardous to you. Safety labels are also attached directly to
products to warn of these situations.
v In addition to these notices, “Safety labels” on page xvii may be attached to the
product to warn of potential hazards.

Danger notices

A danger notice calls attention to a situation that is potentially lethal or extremely hazardous to people. A lightning bolt symbol accompanies a danger notice to represent a dangerous electrical condition. Read and comply with the following danger notices before installing or servicing this device.
© Copyright IBM Corp. 2008 xiii
DANGER
To
prevent a possible shock from touching two surfaces with
different protective ground (earth), use one hand, when possible, to connect or disconnect signal cables. (D001)
DANGER
Overloading
a branch circuit is potentially a fire hazard and a
shock hazard under certain conditions. To avoid these hazards, ensure that your system electrical requirements do not exceed branch circuit protection requirements. Refer to the information that is provided with your device or the power rating label for electrical specifications. (D002)
DANGER
If
the receptacle has a metal shell, do not touch the shell until
you have completed the voltage and grounding checks. Improper wiring or grounding could place dangerous voltage on the metal shell. If any of the conditions are not as described, STOP. Ensure the improper voltage or impedance conditions are corrected before proceeding. (D003)
DANGER
An
electrical outlet that is not correctly wired could place
hazardous voltage on metal parts of the system or the devices that attach to the system. It is the responsibility of the customer to ensure that the outlet is correctly wired and grounded to prevent an electrical shock. (D004)
A general electrical danger notice provides instructions on how to avoid shock hazards when servicing equipment. Unless instructed otherwise, follow the procedures in the following danger notice.
xiv SAN768B Installation, Service, and User’s Guide
DANGER
When
working on or around the system, observe the following
precautions:
Electrical voltage and current from power, telephone, and communication cables are hazardous. To avoid a shock hazard:
v Connect power to this unit only with the IBM provided power
cord. Do not use the IBM provided power cord for any other product.
v Do not open or service any power supply assembly.
v Do not connect or disconnect any cables or perform
installation, maintenance, or reconfiguration of this product during an electrical storm.
v The product might be equipped with multiple power cords. To
remove all hazardous voltages, disconnect all power cords.
v Connect all power cords to a properly wired and grounded
electrical outlet. Ensure that the outlet supplies proper voltage and phase rotation according to the system rating plate.
v Connect any equipment that will be attached to this product to
properly wired outlets.
v When possible, use one hand only to connect or disconnect
signal cables.
v Never turn on any equipment when there is evidence of fire,
water, or structural damage.
v Disconnect the attached power cords, telecommunications
systems, networks, and modems before you open the device covers, unless instructed otherwise in the installation and configuration procedures.
v Connect and disconnect cables as described below when
installing, moving, or opening covers on this product or attached devices.
Disconnect:
To
1. Turn off everything (unless instructed otherwise).
2. Remove the power cords from the outlets.
3. Remove the signal cables from the connectors.
4. Remove all cables from the devices.
Connect:
To
1. Turn off everything (unless instructed otherwise).
2. Attach all cables to the devices.
3. Attach the signal cables to the connectors.
4. Attach the power cords to the outlets.
5. Turn on the devices.
(D005)
The weight of the SAN cabinet (2109-C36) with two SAN768Bs is greater than 227 kg (500 lb), and has a fully loaded capacity of 816 kg (1795 lb). Under these conditions, the following statement and notice apply.
Safety and environmental notices xv
Delivery and subsequent transportation of the equipment
The customer should prepare his environment to accept the new product based on the installation planning information provided, with assistance from an IBM Installation Planning Representative (IPR) or IBM authorized service provider. In anticipation of the equipment delivery, the final installation site should be prepared in advance such that professional movers/riggers can transport the equipment to the final installation site within the computer room. If for some reason, this is not possible at the time of delivery, the customer will need to make arrangements to have professional movers/riggers return to finish the transportation at a later date. Only professional movers/riggers should transport the equipment. The IBM authorized service provider will only perform minimal frame repositioning within the computer room, as needed, to perform required service actions. The customer is also responsible for using professional movers/riggers in the case of equipment relocation or disposal.
>(>)500 lbs. 227 kg.
DANGER
Heavy
equipment—personal injury or equipment damage might
result if mishandled. (D006)
a69i0333

Caution notices

A caution notice calls attention to a situation that is potentially hazardous to people because of some existing condition. A caution notice can be accompanied by different symbols, as in the examples below:
If the symbol
is... It means....
55 kg ( 121.2 lbs)
>55kg (121.2 lb)
P/N 18P5850-B
SJ000752
A hazardous electrical condition with less severity than electrical danger.
A generally hazardous condition not represented by other safety symbols.
A specification of product weight that requires safe lifting practices. The weight range of the product is listed below the graphic, and the wording of the caution varies, depending on the weight of the device.
svc00169
A potential hazard of pinching the hand or other body parts between parts.
A hazardous condition due to moving parts nearby.
A hazardous condition due to the use of a laser in the product. Laser symbols are always accompanied by the classification of the laser as defined by the U. S. Department of Health and Human Services (for example, Class I, Class II, and so forth).
xvi SAN768B Installation, Service, and User’s Guide
Read and comply with the following caution notices before installing or servicing this device.
55 kg ( 121.2 lbs)
>55kg (121.2 lb)
CAUTION: Energy hazard present. Shorting may result in system outage and possible physical injury. Remove all metallic jewelry before servicing. (C001)
CAUTION: The weight of this part or unit is more than 55 kg (121.2 lb). It takes specially trained persons, a lifting device, or both to safely lift this part or unit. (C011)
svc00169
CAUTION: This product is equipped with a 3-wire (two conductors and ground) power cable and plug. Use this power cable with a properly grounded electrical outlet to avoid electrical shock. (C018)
CAUTION: Servicing of this product or unit is to be performed by trained service personnel only. (C032)

Safety labels

As an added precaution, safety labels are often installed directly on products or product components to warn of potential hazards. These can be either danger or caution notices, depending upon the level of the hazard.
The actual product safety labels may differ from these sample safety labels:
DANGER
Hazardous
voltage, current, or energy levels are present inside
any component that has this label attached. Do not open any cover or barrier that contains this label. (L001)
DANGER
Rack-mounted
devices are not to be used as a shelf or work
space. (L002)
Safety and environmental notices xvii
DANGER
Multiple
power cords. The product might be equipped with
multiple power cords. To remove all hazardous voltages, disconnect all power cords. (L003)
DANGER
Hazardous
voltage present. Voltages present constitute a shock
hazard, which can cause severe injury or death. (L004)
CAUTION: Hazardous energy present. Voltages with hazardous energy might cause heating when shorted with metal, which might result in splattered metal, burns, or both. (L005)
P/N 18P5850-B

Attention notices

An attention notice indicates the possibility of damage to a program, device, or system, or to data. An exclamation point symbol may accompany an attention notice, but is not required. A sample attention notice follows:
CAUTION: Hazardous moving parts nearby (L008)
CAUTION: Pinch hazard. (L012)
SJ000752
Attention: Do not bend a fibre cable to a radius less than 5 cm (2 in.); you can
damage the cable. Tie wraps are not recommended for optical cables because they can be easily overtightened, causing damage to the cable.
xviii SAN768B Installation, Service, and User’s Guide

Rack safety

Rack installation

DANGER
Observe
the following precautions when working on or around your IT rack system:
v Heavy equipment—personal injury or equipment damage might result if
mishandled.
v Always lower the leveling pads on the rack cabinet.
v Always install stabilizer brackets on the rack cabinet.
v To avoid hazardous conditions due to uneven mechanical loading, always install
the heaviest devices in the bottom of the rack cabinet. Always install servers and optional devices starting from the bottom of the rack cabinet.
v Rack-mounted devices are not to be used as shelves or work spaces. Do not
place objects on top of rack-mounted devices.
v Each rack cabinet might have more than one power cord. Be sure to disconnect
all power cords in the rack cabinet when directed to disconnect power during servicing.
v Connect all devices installed in a rack cabinet to power devices installed in the
same rack cabinet. Do not plug a power cord from a device installed in one rack cabinet into a power device installed in a different rack cabinet.
v An electrical outlet that is not correctly wired could place hazardous voltage on
the metal parts of the system or the devices that attach to the system. It is the responsibility of the customer to ensure that the outlet is correctly wired and grounded to prevent an electrical shock.
(R001 part 1 of 2) CAUTION:
v Do not install a unit in a rack where the internal rack ambient temperatures will
exceed the manufacturer’s recommended ambient temperature for all your rack-mounted devices.
v Do not install a unit in a rack where the air flow is compromised. Ensure that air
flow is not blocked or reduced on any side, front, or back of a unit used for air flow through the unit.
v Consideration should be given to the connection of the equipment to the supply
circuit so that overloading of the circuits does not compromise the supply wiring or overcurrent protection. To provide the correct power connection to a rack, refer to the rating labels located on the equipment in the rack to determine the total power requirement of the supply circuit.
v (For sliding drawers) Do not pull out or install any drawer or feature if the rack
stabilizer brackets are not attached to the rack. Do not pull out more than one drawer at a time. The rack might become unstable if you pull out more than one drawer at a time.
v (For fixed drawers) This drawer is a fixed drawer and must not be moved for
servicing unless specified by the manufacturer. Attempting to move the drawer partially or completely out of the rack might cause the rack to become unstable or cause the drawer to fall out of the rack.
part 2 of 2)
(R001
Safety and environmental notices xix
Rack relocation (19rack)
CAUTION: Removing components from the upper positions in the rack cabinet improves rack stability during relocation. Follow these general guidelines whenever you relocate a populated rack cabinet within a room or building:
v Reduce the weight of the rack cabinet by removing equipment starting at
the top of the rack cabinet. When possible, restore the rack cabinet to the configuration of the rack cabinet as you received it. If this configuration is not known, you must do the following:
– Remove all devices in the 32U position and above. – Ensure that the heaviest devices are installed in the bottom of the rack
cabinet.
– Ensure that there are no empty U-levels between devices installed in the
rack cabinet below the 32U level.
– If the rack cabinet you are relocating is part of a suite of rack cabinets,
detach the rack cabinet from the suite.
– Inspect the route that you plan to take when moving the rack to
eliminate potential hazards.
– Verify that the route that you choose can support the weight of the
loaded rack cabinet. Refer to the documentation that came with your
rack cabinet for the weight of a loaded rack cabinet. – Verify that all door openings are at least 760 x 2030 mm (30 x 80 in.). – Ensure that all devices, shelves, drawers, doors, and cables are secure. – Ensure that the four leveling pads are raised to their highest position. – Ensure that there is no stabilizer bracket installed on the rack cabinet
during movement. – Do not use a ramp inclined at more than 10 degrees. – Once the rack cabinet is in the new location, do the following:
- Lower the four leveling pads.
- Install stabilizer brackets on the rack cabinet.
- If you removed any devices from the rack cabinet, repopulate the rack cabinet from the lowest position to the highest position.
– If a long distance relocation is required, restore the rack cabinet to the
configuration of the rack cabinet as you received it. Pack the rack cabinet in the original packaging material, or equivalent. Also, lower the leveling pads to raise the casters off of the pallet and bolt the rack cabinet to the pallet.
(R002)
xx SAN768B Installation, Service, and User’s Guide

Safety inspections

Perform the following safety checks to identify unsafe conditions. Be cautious of potential safety hazards that are not covered in the safety checks. If unsafe conditions are present, determine how serious the hazards are and whether you should continue before you correct the problem.

Removing ac power

Perform the following steps to remove the alternating current (ac) power:
1. Perform a controlled system shutdown.
2. Set the power switch on the product to the off position.
3. Disconnect the power cables from the power source.

External machine checks

Perform the following external machine checks:
1. Verify that all external covers are present and are not damaged.
2. Ensure that all latches and hinges are in correct operating condition.
3. Check the power cable for damage.
4. Check the external signal cable for damage.
5. Check the cover for sharp edges, damage, or alterations that expose the internal parts of the device.
6. Check that any unused serial ports are covered for dust and ESD protection. The cover should be kept on the serial port whenever it is not being used.
7. Correct any problems that you find.
DANGER
Multiple power cords. (L003)

Internal machine checks

Perform the following internal machine checks:
1. Check for any non-IBM changes that might have been made to the machine. If any are present, obtain the “Non-IBM Alteration Attachment Survey” form, number R009, from the IBM branch office. Complete the form and return it to the branch office.
2. Check the condition of the inside of the machine for:
v Metal or other contaminants v Indications of water or other fluid v Fire v Smoke damage
3. Check for any obvious mechanical problems, such as loose components.
4. Check any exposed cables and connectors for wear, cracks, or pinching.
Safety and environmental notices xxi

Product recycling and disposal

This unit must be recycled or discarded according to applicable local and national regulations. IBM encourages owners of information technology (IT) equipment to responsibly recycle their equipment when it is no longer needed. IBM offers a variety of product return programs and services in several countries to assist equipment owners in recycling their IT products. Information on IBM product recycling offerings can be found on IBM’s Internet site at http://www.ibm.com/ibm/ environment/products/index.shtml
Esta unidad debe reciclarse o desecharse de acuerdo con lo establecido en la normativa nacional o local aplicable. IBM recomienda a los propietarios de equipos de tecnología de la informacion (TI) que reciclen responsablemente sus equipos cuando éstos ya no les sean utiles. IBM dispone de una serie de programas y servicios de devolucion de productos en varios países, a fin de ayudar a los propietarios de equipos a reciclar sus productos de TI. Se puede encontrar informacion sobre las ofertas de reciclado de productos de IBM en el sitio web de IBM http://www.ibm.com/ibm/environment/products/index.shtml.
Note: This mark applies only to countries within the European Union (EU) and
Norway.
Appliances are labeled in accordance with European Directive 2002/96/EC concerning waste electrical and electronic equipment (WEEE). The Directive determines the framework for the return and recycling of used appliances as applicable throughout the European Union. This label is applied to various products to indicate that the product is not to be thrown away, but rather reclaimed upon end of life per this Directive.
In accordance with the European WEEE Directive, electrical and electronic equipment (EEE) is to be collected separately and to be reused, recycled, or recovered at end of life. Users of EEE with the WEEE marking per Annex IV of the WEEE Directive, as shown above, must not dispose of end of life EEE as unsorted municipal waste, but use the collection framework available to customers for the return, recycling and recovery of WEEE. Customer participation is important to minimize any potential effects of EEE on the environment and human health due to
xxii SAN768B Installation, Service, and User’s Guide
the potential presence of hazardous substances in EEE. For proper collection and treatment, contact your local IBM representative.

Battery return program

This product may contain sealed lead acid, nickel cadmium, nickel metal hydride, lithium, or lithium ion battery. Consult your user manual or service manual for specific battery information. The battery must be recycled or disposed of properly. Recycling facilities may not be available in your area. For information on disposal of batteries outside the United States, go to http://www.ibm.com/ibm/environment/ products/index.shtml
In the United States, IBM has established a return process for reuse, recycling, or proper disposal of used IBM sealed lead acid, nickel cadmium, nickel metal hydride, and other battery packs from IBM equipment. For information on proper disposal of these batteries, contact IBM at 1-800-426-4333. Please have the IBM part number listed on the battery available prior to your call.
For Taiwan:
or contact your local waste disposal facility.
Please recycle batteries.

For the European Union:

Note: This mark applies only to countries within the European Union (EU).
Batteries or packaging for batteries are labeled in accordance with European Directive 2006/66/EC concerning batteries and accumulators and waste batteries and accumulators. The Directive determines the framework for the return and recycling of used batteries and accumulators as applicable throughout the European Union. This label is applied to various batteries to indicate that the battery is not to be thrown away, but rather reclaimed upon end of life per this Directive.
Les batteries ou emballages pour batteries sont étiquetés conformément aux directives européennes 2006/66/EC, norme relative aux batteries et accumulateurs en usage et aux batteries et accumulateurs usés. Les directives déterminent la marche à suivre en vigueur dans l’Union Européenne pour le retour et le recyclage des batteries et accumulateurs usés. Cette étiquette est appliquée sur diverses batteries pour indiquer que la batterie ne doit pas être mise au rebut mais plutôt récupérée en fin de cycle de vie selon cette norme.
Safety and environmental notices xxiii
In accordance with the European Directive 2006/66/EC, batteries and accumulators are labeled to indicate that they are to be collected separately and recycled at end of life. The label on the battery may also include a chemical symbol for the metal concerned in the battery (Pb for lead, Hg for mercury and Cd for cadmium). Users of batteries and accumulators must not dispose of batteries and accumulators as unsorted municipal waste, but use the collection framework available to customers for the return, recycling and treatment of batteries and accumulators. Customer participation is important to minimize any potential effects of batteries and accumulators on the environment and human health due to the potential presence of hazardous substances. For proper collection and treatment, contact your local IBM representative.
This notice is provided in accordance with Royal Decree 106/2008 of Spain: The retail price of batteries, accumulators and power cells includes the cost of the environmental management of their waste.
xxiv SAN768B Installation, Service, and User’s Guide

About this document

This document describes how to install and service the IBM System Storage SAN768B fabric backbone. Throughout this document, the product is referred to as the SAN768B.
The sections that follow provide information about:
v “Who should read this document” v “Product documents” v “Brocade documents”

Who should read this document

This document is intended for trained service representatives who are responsible for installing and servicing the SAN768B, and for network administrators responsible for maintaining and using the SAN768B.

Product documents

The following documents contain information related to this product: v IBM System Storage SAN768B Installation, Service, and User’s Guide,
GA32-0574 (this document)
v IBM Systems Safety Notices, G229–9054 v IBM System Storage SAN 2499 Statement of Limited Warranty, GA32-0575
®

Brocade documents

IBM switches use software licensed from Brocade Communications Systems, Inc. You can find information related to the software that supports the SAN768B in the following documents on the CD-ROM supplied with this product:
Brocade Fabric OS
v Fabric OS Administrator’s Guide
v Fabric OS Command Reference Manual
v Fabric OS MIB Reference Manual
v Fabric OS Message Reference Manual
v Fabric OS Troubleshooting and Diagnostics Guide
v SAN Glossary
Brocade Fabric OS optional features
v Fabric Watch Administrator’s Guide
v Web Tools Administrator’s Guide

IBM and Brocade product matrix

When you use any of the Brocade documents, you will notice that the model numbers reflect the original Brocade products. Table 1 on page xxvi provides a product matrix for you to use to correlate the Brocade model numbers to the IBM product names and machine types and model numbers.
© Copyright IBM Corp. 2008 xxv
Table 1. Brocade and IBM product and model number matrix
IBM machine type and
Brocade product name IBM product name
model number
Brocade DCX SAN768B 2499 Model 384 Brocade 48000 SAN256B Director 2109 Model M48 Brocade 5300 SAN80B-4 2498 Model B80 Brocade 5100 SAN40B-4 2498 Models B40 and 40E Brocade 300 SAN24B-4 2498 Models B24 and 24E Brocade 7500E SAN04B–R 2005 Model R04 Brocade 5000 SAN32B-3 2005 Models B5K and 5KB Silkworm 7500 SAN18B-R 2005 Model R18 Silkworm 200E SAN16B-2 2005 Models B16 and 16B Silkworm 4900 SAN64B-2 2005 Model B64
xxvi SAN768B Installation, Service, and User’s Guide

Chapter 1. Introduction

This chapter introduces the features and components of the IBM System Storage SAN768B fabric backbone. Throughout the remainder of this document, the product will be referred to as the SAN768B. This chapter contains the following information:
v “Overview of the SAN768B” v “Hardware components” on page 2 v “High availability” on page 6 v “Reliability” on page 6 v “Serviceability” on page 6 v “Software features” on page 7

Overview of the SAN768B

The SAN768B represents the next generation of advanced Fibre Channel directors used to intelligently interconnect storage devices, hosts, and servers in a Storage Area Network (SAN). It satisfies the most demanding Reliability, Availability, and Serviceability (RAS), performance, and scalability requirements, while delivering investment protection, interoperability, and fabric-based intelligence advantages found only in the IBM SAN product family.
Key features of the SAN768B include:
v Up to 384 ports in a single chassis, providing high port density for a scalable
solution to drive high-port-count SAN configurations.
v Support for high-performance port blades running at 1-, 2-, 4-, 8-, or 10-Gbps,
enabling flexible system configuration.
v Supports 1-, 2-, 4-, and 8-Gbps auto-sensing Fibre Channel ports. Trunking
technology groups up to eight ports to create high performance 64-Gbps ISL trunks between switches. (10 Gbps ports (FC10-6) are 10 Gbps only.)
v Dual-redundant control processor blades (CP8) and core switch blades (CR8)
provide high availability and enable nondisruptive software upgrades.
v Redundant and hot-swappable CP8 and CR8 blades, power supplies, blower
assemblies, and WWN cards enable a high availability platform for mission critical SAN applications.
v Inter-chassis linking (ICL) through CR8 blades. v Universal ports self-configure as E_ports, F_ports, FL_ports, Ex_ports, and
M_ports (mirror ports). 10 Gbps ports (FC10-6) are E-Ports only. Ex_ports are supported only on the FR4-18i application blade. FL_ports are not supported on the FC8-48 port blade.
© Copyright IBM Corp. 2008 1

Hardware components

The SAN768B features a modular and scalable mechanical construction that allows a wide range of flexibility in installation, fabric design, and maintenance. The chassis may be mounted with the cables facing the front of the equipment rack or to the rear, and consists of the following:
v Up to eight hot-swappable port blade assemblies can be configured in a single
chassis, delivering up to 384 Fibre Channel ports.
v Two slots for control processor blades (CP8):
A single active CP8 blade can control all 384 ports in the chassis. The standby CP8 blade assumes control of the SAN768B if the active CP
Two slots for core switch blades (CR8):
v
CR8 blade interconnects all port blades Two inter-chassis link (ICL) connectors per blade to connect to another
Both CR8 blades are active
Modular hot-swappable port blades:
v
16-port, 8-Gbps blades (FC8-16) 32-port, 8-Gbps blades (FC8-32) 48-port, 8-Gbps blades (FC8-48) 6-port, 10-Gbps blades (FC10-6)
v Modular hot-swappable application blades:
FR4-18i: 18-port (16 FC + 2 GbE), up to 4 blades per chassis, supporting
v Modular hot-swappable field replaceable units (FRUs):
Three blower assemblies Up to four power supplies Two WWN cards Small Form-factor Pluggable (SFP) optical transceivers (4- and 8-Gbps) Extended Form-factor Pluggable (XFP) optical transceivers (10-Gbps)
|
1 GbE copper SFP transceivers for the IP ports on the routing blade
v All blades are serviced from the port side of the SAN768B. Blowers, power
supplies, and power cables are serviced from the nonport side.
v Improved cable management using a redesigned cable management comb and
chassis door
v Constant intake and FRU temperature monitoring v World Wide Name (WWN) cards on the nonport side, to maintain chassis-specific
information such as WWNs, IP addresses, and summary status information of each port blade and power supply through LEDs
v Redundant AC primary power connections to ensure high availability. Each power
supply has its own connector
fails.
chassis
Fibre Channel Routing Services and FCIP
Airflow in the SAN768B is from the non-port (non-cable) side to the port
Note:
(cable) side and out the exhaust vent.
1 on page 3 shows a sample configuration of the port side of the SAN768B.
Figure
2 SAN768B Installation, Service, and User’s Guide
Loading...
+ 131 hidden pages