IBM System Storage SAN768B
Installation, Service, and User’s Guide
Service information: 2499-384
Read Before Using
This product contains software that is licensed under written license agreements. Your use of such software is subject to
the license agreements under which they are provided.
GA32-0574-01
IBM System Storage SAN768B
Installation, Service, and User’s Guide
Service information: 2499-384
GA32-0574-01
Note:
Before using this information and the product it supports, read the information in “Notices” on page 117.
The following paragraph does not apply to any country (or region) where such provisions are inconsistent with local
law.
INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION “AS IS” WITHOUT
WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states (or regions) do
not allow disclaimer of express or implied warranties in certain transactions; therefore, this statement may not apply
to you.
© Copyright International Business Machines Corporation 2008. All rights reserved.
US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.
Read this first
Summary of changes
|
|
|
|
|
Second edition
|
|
|
|
|
|
|
|
Getting help
This is the second edition of the IBM System Storage SAN768B Installation,
Service, and User's Guide. The content changes since the last edition of this
publication are noted by a vertical line placed in the left margin beside each
change. Minor edits are not identified by this mark. A summary of the changes for
each edition are listed below.
The following changes were made in the second edition:
v The section on power cords was corrected.
v The rack installation instructions were modified to reflect a new rack installation
kit.
v The Integrated Routing feature was added.
v Minor changes were made to the environmental, safety, and other notices.
v Minor changes to Fabric OS publication titles.
For the latest version of your product documentation, visit the web at
http://www.elink.ibmlink.ibm.com/public/applications/publications/cgibin/pbi.cgi.
Search by form number or title.
For more information about IBM® SAN products, see the following Web site:
http://www.ibm.com/servers/storage/san/
For support information for this product and other SAN products, see the following
Web site: http://www.ibm.com/servers/storage/support/san
You can also contact IBM within the United States at 1-800-IBMSERV
(1-800-426-7378). For support outside the United States, you can find the service
number at: http://www.ibm.com/planetwide/.
Visit www.ibm.com/contact for the contact information for your country or region.
For detailed information about the Fibre Channel standards, see the Fibre Channel
Industry Association (FCIA) Web site at: www.fibrechannel.org/
For information about storage industry standards, see the Storage Networking
Industry Association (SNIA) Web site at: http://www.snia.org/
Taiwan Contact Information
IBM Taiwan Product Service Contact Info:
IBM Taiwan Corporation
3F, No 7, Song Ren Rd., Taipei Taiwan
Tel: 0800-016-888
© Copyright IBM Corp. 2008 iii
How to send your comments
Your feedback is important in helping us provide the most accurate and high-quality
information. If you have comments or suggestions for improving this document,
send us your comments by e-mail to starpubs@us.ibm.com or use the Readers’
Comments form at the back of this publication. Be sure to include the following:
v Exact publication title
v Form number (for example, GC26-1234-02)
v Page numbers to which you are referring
the Reader Comment Form in the back of this manual is missing, you can direct
If
your mail to:
International Business Machines Corporation
Information Development
Department GZW
9000 South Rita Road
Tucson, Arizona 85744-0001 U.S.A.
When you send information to IBM, you grant IBM a nonexclusive right to use or
distribute the information in any way it believes appropriate without incurring any
obligation to you.
iv SAN768B Installation, Service, and User’s Guide
Contents
||
Read this first . . . . . . . . . . . . . . . . . . . . . . . . . iii
Summary of changes . . . . . . . . . . . . . . . . . . . . . . . iii
Second edition . . . . . . . . . . . . . . . . . . . . . . . . iii
Getting help . . . . . . . . . . . . . . . . . . . . . . . . . . iii
Taiwan Contact Information . . . . . . . . . . . . . . . . . . . . iii
How to send your comments . . . . . . . . . . . . . . . . . . . .iv
Figures . . . . . . . . . . . . . . . . . . . . . . . . . . . .ix
Tables . . . . . . . . . . . . . . . . . . . . . . . . . . . .xi
Safety and environmental notices . . . . . . . . . . . . . . . . . xiii
Safety notices and labels . . . . . . . . . . . . . . . . . . . . . xiii
Danger notices . . . . . . . . . . . . . . . . . . . . . . . . xiii
Caution notices . . . . . . . . . . . . . . . . . . . . . . . . xvi
Safety labels . . . . . . . . . . . . . . . . . . . . . . . . xvii
Attention notices . . . . . . . . . . . . . . . . . . . . . . . xviii
Rack safety . . . . . . . . . . . . . . . . . . . . . . . . . . xix
Rack installation . . . . . . . . . . . . . . . . . . . . . . . xix
Rack relocation (19″ rack) . . . . . . . . . . . . . . . . . . . .xx
Safety inspections . . . . . . . . . . . . . . . . . . . . . . . xxi
Removing ac power . . . . . . . . . . . . . . . . . . . . . . xxi
External machine checks . . . . . . . . . . . . . . . . . . . . xxi
Internal machine checks . . . . . . . . . . . . . . . . . . . . xxi
Product recycling and disposal . . . . . . . . . . . . . . . . . . . xxii
Battery return program . . . . . . . . . . . . . . . . . . . . . xxiii
For the European Union: . . . . . . . . . . . . . . . . . . . . xxiii
About this document . . . . . . . . . . . . . . . . . . . . . xxv
Who should read this document . . . . . . . . . . . . . . . . . . xxv
Product documents . . . . . . . . . . . . . . . . . . . . . . . xxv
Brocade documents . . . . . . . . . . . . . . . . . . . . . . . xxv
IBM and Brocade product matrix . . . . . . . . . . . . . . . . . xxv
Chapter 1. Introduction . . . . . . . . . . . . . . . . . . . . . .1
Overview of the SAN768B . . . . . . . . . . . . . . . . . . . . .1
Hardware components . . . . . . . . . . . . . . . . . . . . . .2
SAN768B blades . . . . . . . . . . . . . . . . . . . . . . . .4
High availability . . . . . . . . . . . . . . . . . . . . . . . . .6
Reliability . . . . . . . . . . . . . . . . . . . . . . . . . . .6
Serviceability . . . . . . . . . . . . . . . . . . . . . . . . . .6
Software features . . . . . . . . . . . . . . . . . . . . . . . .7
Security . . . . . . . . . . . . . . . . . . . . . . . . . . .7
Network Manageability . . . . . . . . . . . . . . . . . . . . .8
Port numbering . . . . . . . . . . . . . . . . . . . . . . . . .8
Managing cables . . . . . . . . . . . . . . . . . . . . . . . . .9
Chapter 2. Installing and removing a SAN768B . . . . . . . . . . . .11
Ordering the lift tool . . . . . . . . . . . . . . . . . . . . . . .12
World trade locations . . . . . . . . . . . . . . . . . . . . .12
United States locations . . . . . . . . . . . . . . . . . . . . .12
Installation guidelines . . . . . . . . . . . . . . . . . . . . . .13
Installing a SAN768B in a cabinet . . . . . . . . . . . . . . . . . .14
© Copyright IBM Corp. 2008 v
Time required . . . . . . . . . . . . . . . . . . . . . . . .14
Tools required . . . . . . . . . . . . . . . . . . . . . . . .14
||
||
||
||
Parts list . . . . . . . . . . . . . . . . . . . . . . . . . .14
Unpacking the SAN768B . . . . . . . . . . . . . . . . . . . .15
Attaching the shelf brackets . . . . . . . . . . . . . . . . . . .16
Removing the chassis door . . . . . . . . . . . . . . . . . . .17
Using the lift tool, the 24–inch load plate, and the bridge tool . . . . . . .17
Removing a SAN768B from the cabinet . . . . . . . . . . . . . . . .23
Chapter 3. Starting and configuring the SAN768B . . . . . . . . . . .25
Providing power to the SAN768B . . . . . . . . . . . . . . . . . .26
Establishing a serial connection and logging on to the SAN768B . . . . . .26
Configuring the SAN768B IP addresses . . . . . . . . . . . . . . . .27
Establish an Ethernet connection . . . . . . . . . . . . . . . . . .29
Customize a switch name . . . . . . . . . . . . . . . . . . . . .30
Set the Domain ID . . . . . . . . . . . . . . . . . . . . . . .30
Verifying the PID mode and connecting to the fabric . . . . . . . . . . .30
Enabling software licenses . . . . . . . . . . . . . . . . . . . .31
Backing up the configuration . . . . . . . . . . . . . . . . . . . .32
Chapter 4. Monitoring system components . . . . . . . . . . . . .33
Control processor blade (CP8) . . . . . . . . . . . . . . . . . . .33
Core switch blade (CR8) . . . . . . . . . . . . . . . . . . . . .35
FR4-18i router blade . . . . . . . . . . . . . . . . . . . . . . .37
Port or application blades . . . . . . . . . . . . . . . . . . . . .40
Power supply . . . . . . . . . . . . . . . . . . . . . . . . .45
Blower assembly . . . . . . . . . . . . . . . . . . . . . . . .46
WWN bezel and WWN card . . . . . . . . . . . . . . . . . . . .48
Chapter 5. Removing and installing components . . . . . . . . . . .51
Removing and installing the chassis door . . . . . . . . . . . . . . .51
Time and items required . . . . . . . . . . . . . . . . . . . .51
Removing the chassis door . . . . . . . . . . . . . . . . . . .51
Removing and installing a cable management comb . . . . . . . . . . .52
Time and items required . . . . . . . . . . . . . . . . . . . .52
Removing a cable management comb . . . . . . . . . . . . . . .52
Installing a cable management comb . . . . . . . . . . . . . . . .53
Removing and installing port blades . . . . . . . . . . . . . . . . .53
Time and items required . . . . . . . . . . . . . . . . . . . .54
Removing a port blade . . . . . . . . . . . . . . . . . . . . .54
Installing a port blade . . . . . . . . . . . . . . . . . . . . .55
Removing and installing port blade filler panels . . . . . . . . . . . . .56
Removing a filler panel . . . . . . . . . . . . . . . . . . . . .56
Installing a filler panel . . . . . . . . . . . . . . . . . . . . .57
Removing and installing a control processor blade (CP8) . . . . . . . . .57
Time and items required . . . . . . . . . . . . . . . . . . . .58
Verifying the necessity of installation . . . . . . . . . . . . . . . .58
Recording critical SAN768B information . . . . . . . . . . . . . . .58
Removing a control processor blade (CP8) . . . . . . . . . . . . .60
Installing a control processor blade (CP8) . . . . . . . . . . . . . .61
Verifying operation of the new CP blade . . . . . . . . . . . . . .62
Removing and installing a core switch blade (CR8) . . . . . . . . . . .63
Time and items required . . . . . . . . . . . . . . . . . . . .64
Verifying the necessity of installation . . . . . . . . . . . . . . . .64
Removing a core switch blade (CR8) . . . . . . . . . . . . . . . .64
Installing a core switch blade (CR8) . . . . . . . . . . . . . . . .65
vi SAN768B Installation, Service, and User’s Guide
Removing and installing an FR4-18i router blade . . . . . . . . . . . .66
Time required . . . . . . . . . . . . . . . . . . . . . . . .66
Items required . . . . . . . . . . . . . . . . . . . . . . . .66
Removing a router blade . . . . . . . . . . . . . . . . . . . .66
Installing a router blade . . . . . . . . . . . . . . . . . . . . .67
Configuring FCIP and Fibre Channel routing services and enabling the ports 68
Cabling the FR4-18i router blade . . . . . . . . . . . . . . . . .68
Removing and installing a power supply . . . . . . . . . . . . . . .69
Time and items required . . . . . . . . . . . . . . . . . . . .69
Removing a power supply . . . . . . . . . . . . . . . . . . . .69
Installing a power supply . . . . . . . . . . . . . . . . . . . .70
Removing and installing a blower assembly . . . . . . . . . . . . . .71
Time and items required . . . . . . . . . . . . . . . . . . . .71
Removing a blower assembly . . . . . . . . . . . . . . . . . .71
Installing a blower assembly . . . . . . . . . . . . . . . . . . .72
Removing and installing a WWN bezel and WWN card . . . . . . . . . .72
Time and items required . . . . . . . . . . . . . . . . . . . .72
Verifying necessity of installation . . . . . . . . . . . . . . . . .73
Removing the WWN bezel and WWN card . . . . . . . . . . . . .74
Installing the WWN bezel and WWN card . . . . . . . . . . . . . .75
Installing and removing FC transceivers in a port blade . . . . . . . . . .76
Chapter 6. Installing new features . . . . . . . . . . . . . . . . .79
FC3816, FC3832, FC3848 - Installing a 8-Gb port blade (16, 32, or 48 ports) 79
Time required . . . . . . . . . . . . . . . . . . . . . . . .79
Items required . . . . . . . . . . . . . . . . . . . . . . . .79
Procedures . . . . . . . . . . . . . . . . . . . . . . . . .79
FC3850 - Installing an FR4-18i routing blade . . . . . . . . . . . . . .80
Time required . . . . . . . . . . . . . . . . . . . . . . . .81
Items required . . . . . . . . . . . . . . . . . . . . . . . .81
Procedures . . . . . . . . . . . . . . . . . . . . . . . . .81
FC3870 - Installing an FC10-6 10 Gb blade . . . . . . . . . . . . . .82
Time required . . . . . . . . . . . . . . . . . . . . . . . .82
Items required . . . . . . . . . . . . . . . . . . . . . . . .82
Procedures . . . . . . . . . . . . . . . . . . . . . . . . .82
Chapter 7. Installing the chassis . . . . . . . . . . . . . . . . . .83
Verifying necessity of replacement . . . . . . . . . . . . . . . . . .83
Preparing for a chassis installation . . . . . . . . . . . . . . . . . .84
Time required . . . . . . . . . . . . . . . . . . . . . . . .84
Items required . . . . . . . . . . . . . . . . . . . . . . . .84
Recording critical SAN768B and SAN information . . . . . . . . . . .84
Chassis critical information checklist . . . . . . . . . . . . . . . .87
Disconnecting the SAN768B from the network and fabric . . . . . . . . .88
Removing components from the chassis . . . . . . . . . . . . . . .88
Removing and replacing the chassis . . . . . . . . . . . . . . . . .89
Installing components into the new chassis . . . . . . . . . . . . . .90
Verifying the correct operation of hardware . . . . . . . . . . . . . .90
Verifying the correct operation of the system . . . . . . . . . . . . . .91
Reconnecting the system to the network and fabric . . . . . . . . . . .92
Verifying the correct configuration of the fabric . . . . . . . . . . . . .93
Cable routing tables . . . . . . . . . . . . . . . . . . . . . . .93
Appendix A. Product specifications . . . . . . . . . . . . . . . .95
System architecture . . . . . . . . . . . . . . . . . . . . . . .95
Physical dimensions . . . . . . . . . . . . . . . . . . . . . . .97
Contents vii
Facility requirements . . . . . . . . . . . . . . . . . . . . . . .97
Power specifications . . . . . . . . . . . . . . . . . . . . . . .98
Environmental requirements . . . . . . . . . . . . . . . . . . . .99
Data transmission ranges . . . . . . . . . . . . . . . . . . . . .99
Fibre channel port specifications . . . . . . . . . . . . . . . . . . 100
FR4-18i router Fibre channel port specifications . . . . . . . . . . . . 100
FR4-18i router GbE port specifications . . . . . . . . . . . . . . . . 100
Power cords . . . . . . . . . . . . . . . . . . . . . . . . . 101
Appendix B. Diagnostics and troubleshooting . . . . . . . . . . . . 103
Obtaining chassis and component status . . . . . . . . . . . . . . . 103
Interpreting POST and boot results . . . . . . . . . . . . . . . . . 104
POST . . . . . . . . . . . . . . . . . . . . . . . . . . . 104
Boot . . . . . . . . . . . . . . . . . . . . . . . . . . . 105
Diagnostics . . . . . . . . . . . . . . . . . . . . . . . . . . 105
Validating the installation of port blades . . . . . . . . . . . . . . . 105
Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . 106
Powering off the SAN768B . . . . . . . . . . . . . . . . . . . . 109
Appendix C. Port numbering templates . . . . . . . . . . . . . . 111
Notices . . . . . . . . . . . . . . . . . . . . . . . . . . .117
Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . .119
Electronic emission notices . . . . . . . . . . . . . . . . . . . . 120
Federal Communications Commission (FCC) Class A Statement . . . . . 120
Industry Canada Class A Emission Compliance Statement . . . . . . . 120
Avis de conformité à la réglementation d’Industrie Canada . . . . . . . 120
European Union (EU) Electromagnetic Compatibility Directive . . . . . . 120
Germany Electromagnetic Compatibility Directive . . . . . . . . . . . 121
Japan VCCI Class A ITE Electronic Emission Statement . . . . . . . . 122
People’s Republic of China Class A Electronic Emission Statement . . . . 122
Korea Class A Electronic Emission Statement . . . . . . . . . . . . 122
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . 123
viii SAN768B Installation, Service, and User’s Guide
Figures
1. Port side of the SAN768B (sample configuration) . . . . . . . . . . . . . . . . . . .3
2. Blower (non-port) side of the SAN768B (sample configuration) . . . . . . . . . . . . . .4
3. Parts in the 14U rack mount kit . . . . . . . . . . . . . . . . . . . . . . . . .15
||
4. Left and right shelf brackets installed on the cabinet rails . . . . . . . . . . . . . . . .16
||
5. Installing clip or retainer nuts on the vertical cabinet rails . . . . . . . . . . . . . . . .17
||
6. Chassis installation from rear (exhaust aisle side) of the cabinet . . . . . . . . . . . . .19
||
7. Locking the shelf into position . . . . . . . . . . . . . . . . . . . . . . . . . .20
8. Attaching the port side of the chassis to the cabinet rails . . . . . . . . . . . . . . . .21
||
9. Aligning the chassis door with the ball studs on the chassis . . . . . . . . . . . . . . .22
||
10. Details of the chassis and door, showing the ball studs on the chassis and the mounting hardware
|
||
on the door . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .22
11. Control processor blade (CP8) LEDs . . . . . . . . . . . . . . . . . . . . . . .34
12. Core switch blade (CR8) LEDs . . . . . . . . . . . . . . . . . . . . . . . . . .36
13. FR4-18i router blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38
14. FC8-16 port blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .41
15. FC8-32 port blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42
16. FC8-48 port blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43
17. FC10-6 port blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44
18. Power supply LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .46
19. Blower assembly LEDs and other parts . . . . . . . . . . . . . . . . . . . . . .47
20. LEDs on the WWN card and bezel . . . . . . . . . . . . . . . . . . . . . . . .49
21. Chassis door . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .52
22. Cable management comb . . . . . . . . . . . . . . . . . . . . . . . . . . .53
23. Port blade removal and installation (16-port blade shown as example) . . . . . . . . . . .55
24. Port blade removal and installation (16-port blade shown as example) . . . . . . . . . . .57
25. Removing the control processor (CP) blade . . . . . . . . . . . . . . . . . . . . .61
26. Removing the core switch blade . . . . . . . . . . . . . . . . . . . . . . . . .65
27. Removing and installing a power supply . . . . . . . . . . . . . . . . . . . . . .70
28. Blower assembly LEDs and other parts . . . . . . . . . . . . . . . . . . . . . .72
29. WWN bezel and card removal and installation . . . . . . . . . . . . . . . . . . . .75
30. SFP extraction tool . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .77
31. Port side populated with eight FC8-48 port blades, two CR8 blades, and two CP8 blades 112
32. Port side populated with eight FC8-32 port blades, two CR8 blades, and two CP8 blades 113
33. Port side populated with eight FC8-16 port blades, two CR8 blades, and two CP8 blades 114
34. FC10-6 port blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .115
35. FC4-18IP port blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . .116
© Copyright IBM Corp. 2008 ix
x SAN768B Installation, Service, and User’s Guide
Tables
1. Brocade and IBM product and model number matrix . . . . . . . . . . . . . . . . . xxvi
2. Blades available for the SAN768B . . . . . . . . . . . . . . . . . . . . . . . . .4
3. Security features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7
4. Port blades available on the SAN768B . . . . . . . . . . . . . . . . . . . . . . .8
5. Items supplied with the 14U rack mount kit . . . . . . . . . . . . . . . . . . . . .14
||
6. Configuration parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . .27
7. Example login without changing the password . . . . . . . . . . . . . . . . . . . .27
8. Example of viewing enabled licenses . . . . . . . . . . . . . . . . . . . . . . .31
9. CP blade LED descriptions . . . . . . . . . . . . . . . . . . . . . . . . . . .34
10. CR blade LED descriptions . . . . . . . . . . . . . . . . . . . . . . . . . . .36
11. FR4-18i router blade LED patterns during normal operation . . . . . . . . . . . . . . .39
12. Port and application blade LED descriptions . . . . . . . . . . . . . . . . . . . . .45
13. Power supply LED descriptions . . . . . . . . . . . . . . . . . . . . . . . . .46
14. Blower assembly LED descriptions . . . . . . . . . . . . . . . . . . . . . . . .47
15. Messages that may indicate WWN card failure . . . . . . . . . . . . . . . . . . . .48
16. WWN bezel LED descriptions . . . . . . . . . . . . . . . . . . . . . . . . . .49
17. WWN LED patterns . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .73
18. Commands identifying the WWN card status . . . . . . . . . . . . . . . . . . . .73
19. WWN card related system log messages . . . . . . . . . . . . . . . . . . . . . .74
20. Critical information checklist example . . . . . . . . . . . . . . . . . . . . . . .87
21. Sample cable routing table for SAN768B (Switch Name: swDir) . . . . . . . . . . . . .93
22. Cable routing table for SAN768B . . . . . . . . . . . . . . . . . . . . . . . . .93
23. System architecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .95
24. System sizes and weights . . . . . . . . . . . . . . . . . . . . . . . . . . .97
25. System FRU weights . . . . . . . . . . . . . . . . . . . . . . . . . . . . .97
26. Power specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . .98
27. Environmental requirements . . . . . . . . . . . . . . . . . . . . . . . . . . .99
28. Data transmission ranges by cable type and port speed . . . . . . . . . . . . . . . .99
29. Environmental status and maintenance commands . . . . . . . . . . . . . . . . . . 104
30. Commands for validating installation of port blades . . . . . . . . . . . . . . . . . . 106
31. Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106
© Copyright IBM Corp. 2008 xi
xii SAN768B Installation, Service, and User’s Guide
Safety and environmental notices
This section contains information about:
v “Safety notices and labels”
v “Rack safety” on page xix
v “Safety inspections” on page xxi
v “Product recycling and disposal” on page xxii
Safety notices and labels
When using this product, observe the danger, caution, and attention notices
contained in this guide. The notices are accompanied by symbols that represent the
severity of the safety condition. The danger and caution notices are listed in
numerical order based on their IDs, which are displayed in parentheses, for
example (D004), at the end of each notice. Use this ID to locate the translation of
these danger and caution notices in the IBM Systems Safety Notices (G229–9054)
publication, which is on the CD-ROM that accompanies this product.
The following notices and statements are used in IBM documents. They are listed
below in order of increasing severity of potential hazards. Follow the links for more
detailed descriptions and examples of the danger, caution, and attention notices in
the sections that follow.
v Note: These notices provide important tips, guidance, or advice.
v “Attention notices” on page xviii: These notices indicate potential damage to
programs, devices, or data.
v “Caution notices” on page xvi: These statements indicate situations that can
be potentially hazardous to you.
v “Danger notices”: These statements indicate situations that can be potentially
lethal or extremely hazardous to you. Safety labels are also attached directly to
products to warn of these situations.
v In addition to these notices, “Safety labels” on page xvii may be attached to the
product to warn of potential hazards.
Danger notices
A danger notice calls attention to a situation that is potentially lethal or extremely
hazardous to people. A lightning bolt symbol accompanies a danger notice to
represent a dangerous electrical condition. Read and comply with the following
danger notices before installing or servicing this device.
© Copyright IBM Corp. 2008 xiii
DANGER
To
prevent a possible shock from touching two surfaces with
different protective ground (earth), use one hand, when possible,
to connect or disconnect signal cables. (D001)
DANGER
Overloading
a branch circuit is potentially a fire hazard and a
shock hazard under certain conditions. To avoid these hazards,
ensure that your system electrical requirements do not exceed
branch circuit protection requirements. Refer to the information
that is provided with your device or the power rating label for
electrical specifications. (D002)
DANGER
If
the receptacle has a metal shell, do not touch the shell until
you have completed the voltage and grounding checks. Improper
wiring or grounding could place dangerous voltage on the metal
shell. If any of the conditions are not as described, STOP. Ensure
the improper voltage or impedance conditions are corrected
before proceeding. (D003)
DANGER
An
electrical outlet that is not correctly wired could place
hazardous voltage on metal parts of the system or the devices
that attach to the system. It is the responsibility of the customer
to ensure that the outlet is correctly wired and grounded to
prevent an electrical shock. (D004)
A general electrical danger notice provides instructions on how to avoid shock
hazards when servicing equipment. Unless instructed otherwise, follow the
procedures in the following danger notice.
xiv SAN768B Installation, Service, and User’s Guide
DANGER
When
working on or around the system, observe the following
precautions:
Electrical voltage and current from power, telephone, and
communication cables are hazardous. To avoid a shock hazard:
v Connect power to this unit only with the IBM provided power
cord. Do not use the IBM provided power cord for any other
product.
v Do not open or service any power supply assembly.
v Do not connect or disconnect any cables or perform
installation, maintenance, or reconfiguration of this product
during an electrical storm.
v The product might be equipped with multiple power cords. To
remove all hazardous voltages, disconnect all power cords.
v Connect all power cords to a properly wired and grounded
electrical outlet. Ensure that the outlet supplies proper voltage
and phase rotation according to the system rating plate.
v Connect any equipment that will be attached to this product to
properly wired outlets.
v When possible, use one hand only to connect or disconnect
signal cables.
v Never turn on any equipment when there is evidence of fire,
water, or structural damage.
v Disconnect the attached power cords, telecommunications
systems, networks, and modems before you open the device
covers, unless instructed otherwise in the installation and
configuration procedures.
v Connect and disconnect cables as described below when
installing, moving, or opening covers on this product or
attached devices.
Disconnect:
To
1. Turn off everything (unless instructed otherwise).
2. Remove the power cords from the outlets.
3. Remove the signal cables from the connectors.
4. Remove all cables from the devices.
Connect:
To
1. Turn off everything (unless instructed otherwise).
2. Attach all cables to the devices.
3. Attach the signal cables to the connectors.
4. Attach the power cords to the outlets.
5. Turn on the devices.
(D005)
The weight of the SAN cabinet (2109-C36) with two SAN768Bs is greater than 227
kg (500 lb), and has a fully loaded capacity of 816 kg (1795 lb). Under these
conditions, the following statement and notice apply.
Safety and environmental notices xv
Delivery and subsequent transportation of the equipment
The customer should prepare his environment to accept the new product based on
the installation planning information provided, with assistance from an IBM
Installation Planning Representative (IPR) or IBM authorized service provider. In
anticipation of the equipment delivery, the final installation site should be prepared
in advance such that professional movers/riggers can transport the equipment to
the final installation site within the computer room. If for some reason, this is not
possible at the time of delivery, the customer will need to make arrangements to
have professional movers/riggers return to finish the transportation at a later date.
Only professional movers/riggers should transport the equipment. The IBM
authorized service provider will only perform minimal frame repositioning within the
computer room, as needed, to perform required service actions. The customer is
also responsible for using professional movers/riggers in the case of equipment
relocation or disposal.
>( >) 500 lbs. 227 kg.
DANGER
Heavy
equipment—personal injury or equipment damage might
result if mishandled. (D006)
a69i0333
Caution notices
A caution notice calls attention to a situation that is potentially hazardous to people
because of some existing condition. A caution notice can be accompanied by
different symbols, as in the examples below:
If the symbol
is... It means....
55 kg ( 121.2 lbs)
>55kg (121.2 lb)
P/N 18P5850-B
SJ000752
A hazardous electrical condition with less severity than electrical danger.
A generally hazardous condition not represented by other safety symbols.
A specification of product weight that requires safe lifting practices. The
weight range of the product is listed below the graphic, and the wording
of the caution varies, depending on the weight of the device.
svc00169
A potential hazard of pinching the hand or other body parts between
parts.
A hazardous condition due to moving parts nearby.
A hazardous condition due to the use of a laser in the product. Laser
symbols are always accompanied by the classification of the laser as
defined by the U. S. Department of Health and Human Services (for
example, Class I, Class II, and so forth).
xvi SAN768B Installation, Service, and User’s Guide
Read and comply with the following caution notices before installing or servicing this
device.
55 kg ( 121.2 lbs)
>55kg (121.2 lb)
CAUTION:
Energy hazard present. Shorting may result in system outage and
possible physical injury. Remove all metallic jewelry before
servicing. (C001)
CAUTION:
The weight of this part or unit is more than 55 kg (121.2 lb). It takes
specially trained persons, a lifting device, or both to safely lift this
part or unit. (C011)
svc00169
CAUTION:
This product is equipped with a 3-wire (two conductors and ground)
power cable and plug. Use this power cable with a properly
grounded electrical outlet to avoid electrical shock. (C018)
CAUTION:
Servicing of this product or unit is to be performed by trained
service personnel only. (C032)
Safety labels
As an added precaution, safety labels are often installed directly on products or
product components to warn of potential hazards. These can be either danger or
caution notices, depending upon the level of the hazard.
The actual product safety labels may differ from these sample safety labels:
DANGER
Hazardous
voltage, current, or energy levels are present inside
any component that has this label attached. Do not open any
cover or barrier that contains this label. (L001)
DANGER
Rack-mounted
devices are not to be used as a shelf or work
space. (L002)
Safety and environmental notices xvii
DANGER
Multiple
power cords. The product might be equipped with
multiple power cords. To remove all hazardous voltages,
disconnect all power cords. (L003)
DANGER
Hazardous
voltage present. Voltages present constitute a shock
hazard, which can cause severe injury or death. (L004)
CAUTION:
Hazardous energy present. Voltages with hazardous energy might
cause heating when shorted with metal, which might result in
splattered metal, burns, or both. (L005)
P/N 18P5850-B
Attention notices
An attention notice indicates the possibility of damage to a program, device, or
system, or to data. An exclamation point symbol may accompany an attention
notice, but is not required. A sample attention notice follows:
CAUTION:
Hazardous moving parts nearby (L008)
CAUTION:
Pinch hazard. (L012)
SJ000752
Attention: Do not bend a fibre cable to a radius less than 5 cm (2 in.); you can
damage the cable. Tie wraps are not recommended for optical cables because they
can be easily overtightened, causing damage to the cable.
xviii SAN768B Installation, Service, and User’s Guide
Rack safety
Rack installation
DANGER
Observe
the following precautions when working on or around your IT rack system:
v Heavy equipment—personal injury or equipment damage might result if
mishandled.
v Always lower the leveling pads on the rack cabinet.
v Always install stabilizer brackets on the rack cabinet.
v To avoid hazardous conditions due to uneven mechanical loading, always install
the heaviest devices in the bottom of the rack cabinet. Always install servers and
optional devices starting from the bottom of the rack cabinet.
v Rack-mounted devices are not to be used as shelves or work spaces. Do not
place objects on top of rack-mounted devices.
v Each rack cabinet might have more than one power cord. Be sure to disconnect
all power cords in the rack cabinet when directed to disconnect power during
servicing.
v Connect all devices installed in a rack cabinet to power devices installed in the
same rack cabinet. Do not plug a power cord from a device installed in one rack
cabinet into a power device installed in a different rack cabinet.
v An electrical outlet that is not correctly wired could place hazardous voltage on
the metal parts of the system or the devices that attach to the system. It is the
responsibility of the customer to ensure that the outlet is correctly wired and
grounded to prevent an electrical shock.
(R001 part 1 of 2)
CAUTION:
v Do not install a unit in a rack where the internal rack ambient temperatures will
exceed the manufacturer’s recommended ambient temperature for all your
rack-mounted devices.
v Do not install a unit in a rack where the air flow is compromised. Ensure that air
flow is not blocked or reduced on any side, front, or back of a unit used for air flow
through the unit.
v Consideration should be given to the connection of the equipment to the supply
circuit so that overloading of the circuits does not compromise the supply wiring or
overcurrent protection. To provide the correct power connection to a rack, refer to
the rating labels located on the equipment in the rack to determine the total power
requirement of the supply circuit.
v (For sliding drawers) Do not pull out or install any drawer or feature if the rack
stabilizer brackets are not attached to the rack. Do not pull out more than one
drawer at a time. The rack might become unstable if you pull out more than one
drawer at a time.
v (For fixed drawers) This drawer is a fixed drawer and must not be moved for
servicing unless specified by the manufacturer. Attempting to move the drawer
partially or completely out of the rack might cause the rack to become unstable or
cause the drawer to fall out of the rack.
part 2 of 2)
(R001
Safety and environmental notices xix
Rack relocation (19″ rack)
CAUTION:
Removing components from the upper positions in the rack cabinet improves
rack stability during relocation. Follow these general guidelines whenever you
relocate a populated rack cabinet within a room or building:
v Reduce the weight of the rack cabinet by removing equipment starting at
the top of the rack cabinet. When possible, restore the rack cabinet to the
configuration of the rack cabinet as you received it. If this configuration is
not known, you must do the following:
– Remove all devices in the 32U position and above.
– Ensure that the heaviest devices are installed in the bottom of the rack
cabinet.
– Ensure that there are no empty U-levels between devices installed in the
rack cabinet below the 32U level.
– If the rack cabinet you are relocating is part of a suite of rack cabinets,
detach the rack cabinet from the suite.
– Inspect the route that you plan to take when moving the rack to
eliminate potential hazards.
– Verify that the route that you choose can support the weight of the
loaded rack cabinet. Refer to the documentation that came with your
rack cabinet for the weight of a loaded rack cabinet.
– Verify that all door openings are at least 760 x 2030 mm (30 x 80 in.).
– Ensure that all devices, shelves, drawers, doors, and cables are secure.
– Ensure that the four leveling pads are raised to their highest position.
– Ensure that there is no stabilizer bracket installed on the rack cabinet
during movement.
– Do not use a ramp inclined at more than 10 degrees.
– Once the rack cabinet is in the new location, do the following:
- Lower the four leveling pads.
- Install stabilizer brackets on the rack cabinet.
- If you removed any devices from the rack cabinet, repopulate the rack
cabinet from the lowest position to the highest position.
– If a long distance relocation is required, restore the rack cabinet to the
configuration of the rack cabinet as you received it. Pack the rack
cabinet in the original packaging material, or equivalent. Also, lower the
leveling pads to raise the casters off of the pallet and bolt the rack
cabinet to the pallet.
(R002)
xx SAN768B Installation, Service, and User’s Guide
Safety inspections
Perform the following safety checks to identify unsafe conditions. Be cautious of
potential safety hazards that are not covered in the safety checks. If unsafe
conditions are present, determine how serious the hazards are and whether you
should continue before you correct the problem.
Removing ac power
Perform the following steps to remove the alternating current (ac) power:
1. Perform a controlled system shutdown.
2. Set the power switch on the product to the off position.
3. Disconnect the power cables from the power source.
External machine checks
Perform the following external machine checks:
1. Verify that all external covers are present and are not damaged.
2. Ensure that all latches and hinges are in correct operating condition.
3. Check the power cable for damage.
4. Check the external signal cable for damage.
5. Check the cover for sharp edges, damage, or alterations that expose the
internal parts of the device.
6. Check that any unused serial ports are covered for dust and ESD protection.
The cover should be kept on the serial port whenever it is not being used.
7. Correct any problems that you find.
DANGER
Multiple power cords. (L003)
Internal machine checks
Perform the following internal machine checks:
1. Check for any non-IBM changes that might have been made to the machine. If
any are present, obtain the “Non-IBM Alteration Attachment Survey” form,
number R009, from the IBM branch office. Complete the form and return it to
the branch office.
2. Check the condition of the inside of the machine for:
v Metal or other contaminants
v Indications of water or other fluid
v Fire
v Smoke damage
3. Check for any obvious mechanical problems, such as loose components.
4. Check any exposed cables and connectors for wear, cracks, or pinching.
Safety and environmental notices xxi
Product recycling and disposal
This unit must be recycled or discarded according to applicable local and national
regulations. IBM encourages owners of information technology (IT) equipment to
responsibly recycle their equipment when it is no longer needed. IBM offers a
variety of product return programs and services in several countries to assist
equipment owners in recycling their IT products. Information on IBM product
recycling offerings can be found on IBM’s Internet site at http://www.ibm.com/ibm/
environment/products/index.shtml
Esta unidad debe reciclarse o desecharse de acuerdo con lo establecido en la
normativa nacional o local aplicable. IBM recomienda a los propietarios de equipos
de tecnología de la informacion (TI) que reciclen responsablemente sus equipos
cuando éstos ya no les sean utiles. IBM dispone de una serie de programas y
servicios de devolucion de productos en varios países, a fin de ayudar a los
propietarios de equipos a reciclar sus productos de TI. Se puede encontrar
informacion sobre las ofertas de reciclado de productos de IBM en el sitio web de
IBM http://www.ibm.com/ibm/environment/products/index.shtml.
Note: This mark applies only to countries within the European Union (EU) and
Norway.
Appliances are labeled in accordance with European Directive 2002/96/EC
concerning waste electrical and electronic equipment (WEEE). The Directive
determines the framework for the return and recycling of used appliances as
applicable throughout the European Union. This label is applied to various products
to indicate that the product is not to be thrown away, but rather reclaimed upon end
of life per this Directive.
In accordance with the European WEEE Directive, electrical and electronic
equipment (EEE) is to be collected separately and to be reused, recycled, or
recovered at end of life. Users of EEE with the WEEE marking per Annex IV of the
WEEE Directive, as shown above, must not dispose of end of life EEE as unsorted
municipal waste, but use the collection framework available to customers for the
return, recycling and recovery of WEEE. Customer participation is important to
minimize any potential effects of EEE on the environment and human health due to
xxii SAN768B Installation, Service, and User’s Guide
the potential presence of hazardous substances in EEE. For proper collection and
treatment, contact your local IBM representative.
Battery return program
This product may contain sealed lead acid, nickel cadmium, nickel metal hydride,
lithium, or lithium ion battery. Consult your user manual or service manual for
specific battery information. The battery must be recycled or disposed of properly.
Recycling facilities may not be available in your area. For information on disposal of
batteries outside the United States, go to http://www.ibm.com/ibm/environment/
products/index.shtml
In the United States, IBM has established a return process for reuse, recycling, or
proper disposal of used IBM sealed lead acid, nickel cadmium, nickel metal hydride,
and other battery packs from IBM equipment. For information on proper disposal of
these batteries, contact IBM at 1-800-426-4333. Please have the IBM part number
listed on the battery available prior to your call.
For Taiwan:
or contact your local waste disposal facility.
Please recycle batteries.
For the European Union:
Note: This mark applies only to countries within the European Union (EU).
Batteries or packaging for batteries are labeled in accordance with European
Directive 2006/66/EC concerning batteries and accumulators and waste batteries
and accumulators. The Directive determines the framework for the return and
recycling of used batteries and accumulators as applicable throughout the European
Union. This label is applied to various batteries to indicate that the battery is not to
be thrown away, but rather reclaimed upon end of life per this Directive.
Les batteries ou emballages pour batteries sont étiquetés conformément aux
directives européennes 2006/66/EC, norme relative aux batteries et accumulateurs
en usage et aux batteries et accumulateurs usés. Les directives déterminent la
marche à suivre en vigueur dans l’Union Européenne pour le retour et le recyclage
des batteries et accumulateurs usés. Cette étiquette est appliquée sur diverses
batteries pour indiquer que la batterie ne doit pas être mise au rebut mais plutôt
récupérée en fin de cycle de vie selon cette norme.
Safety and environmental notices xxiii
In accordance with the European Directive 2006/66/EC, batteries and accumulators
are labeled to indicate that they are to be collected separately and recycled at end
of life. The label on the battery may also include a chemical symbol for the metal
concerned in the battery (Pb for lead, Hg for mercury and Cd for cadmium). Users
of batteries and accumulators must not dispose of batteries and accumulators as
unsorted municipal waste, but use the collection framework available to customers
for the return, recycling and treatment of batteries and accumulators. Customer
participation is important to minimize any potential effects of batteries and
accumulators on the environment and human health due to the potential presence
of hazardous substances. For proper collection and treatment, contact your local
IBM representative.
This notice is provided in accordance with Royal Decree 106/2008 of Spain: The
retail price of batteries, accumulators and power cells includes the cost of the
environmental management of their waste.
xxiv SAN768B Installation, Service, and User’s Guide
About this document
This document describes how to install and service the IBM System Storage
SAN768B fabric backbone. Throughout this document, the product is referred to as
the SAN768B .
The sections that follow provide information about:
v “Who should read this document”
v “Product documents”
v “Brocade documents”
Who should read this document
This document is intended for trained service representatives who are responsible
for installing and servicing the SAN768B, and for network administrators responsible
for maintaining and using the SAN768B.
Product documents
The following documents contain information related to this product:
v IBM System Storage SAN768B Installation, Service, and User’s Guide ,
GA32-0574 (this document)
v IBM Systems Safety Notices, G229–9054
v IBM System Storage SAN 2499 Statement of Limited Warranty, GA32-0575
®
Brocade documents
IBM switches use software licensed from Brocade Communications Systems, Inc.
You can find information related to the software that supports the SAN768B in the
following documents on the CD-ROM supplied with this product:
Brocade Fabric OS
v Fabric OS Administrator’s Guide
v Fabric OS Command Reference Manual
v Fabric OS MIB Reference Manual
v Fabric OS Message Reference Manual
v Fabric OS Troubleshooting and Diagnostics Guide
v SAN Glossary
Brocade Fabric OS optional features
v Fabric Watch Administrator’s Guide
v Web Tools Administrator’s Guide
IBM and Brocade product matrix
When you use any of the Brocade documents, you will notice that the model
numbers reflect the original Brocade products. Table 1 on page xxvi provides a
product matrix for you to use to correlate the Brocade model numbers to the IBM
product names and machine types and model numbers.
© Copyright IBM Corp. 2008 xxv
Table 1. Brocade and IBM product and model number matrix
IBM machine type and
Brocade product name IBM product name
model number
Brocade DCX SAN768B 2499 Model 384
Brocade 48000 SAN256B Director 2109 Model M48
Brocade 5300 SAN80B-4 2498 Model B80
Brocade 5100 SAN40B-4 2498 Models B40 and 40E
Brocade 300 SAN24B-4 2498 Models B24 and 24E
Brocade 7500E SAN04B–R 2005 Model R04
Brocade 5000 SAN32B-3 2005 Models B5K and 5KB
Silkworm 7500 SAN18B-R 2005 Model R18
Silkworm 200E SAN16B-2 2005 Models B16 and 16B
Silkworm 4900 SAN64B-2 2005 Model B64
xxvi SAN768B Installation, Service, and User’s Guide
Chapter 1. Introduction
This chapter introduces the features and components of the IBM System Storage
SAN768B fabric backbone. Throughout the remainder of this document, the product
will be referred to as the SAN768B. This chapter contains the following information:
v “Overview of the SAN768B”
v “Hardware components” on page 2
v “High availability” on page 6
v “Reliability” on page 6
v “Serviceability” on page 6
v “Software features” on page 7
Overview of the SAN768B
The SAN768B represents the next generation of advanced Fibre Channel directors
used to intelligently interconnect storage devices, hosts, and servers in a Storage
Area Network (SAN). It satisfies the most demanding Reliability, Availability, and
Serviceability (RAS), performance, and scalability requirements, while delivering
investment protection, interoperability, and fabric-based intelligence advantages
found only in the IBM SAN product family.
Key features of the SAN768B include:
v Up to 384 ports in a single chassis, providing high port density for a scalable
solution to drive high-port-count SAN configurations.
v Support for high-performance port blades running at 1-, 2-, 4-, 8-, or 10-Gbps,
enabling flexible system configuration.
v Supports 1-, 2-, 4-, and 8-Gbps auto-sensing Fibre Channel ports. Trunking
technology groups up to eight ports to create high performance 64-Gbps ISL
trunks between switches. (10 Gbps ports (FC10-6) are 10 Gbps only.)
v Dual-redundant control processor blades (CP8) and core switch blades (CR8)
provide high availability and enable nondisruptive software upgrades.
v Redundant and hot-swappable CP8 and CR8 blades, power supplies, blower
assemblies, and WWN cards enable a high availability platform for mission
critical SAN applications.
v Inter-chassis linking (ICL) through CR8 blades.
v Universal ports self-configure as E_ports, F_ports, FL_ports, Ex_ports, and
M_ports (mirror ports).
– 10 Gbps ports (FC10-6) are E-Ports only.
– Ex_ports are supported only on the FR4-18i application blade.
– FL_ports are not supported on the FC8-48 port blade.
© Copyright IBM Corp. 2008 1
Hardware components
The SAN768B features a modular and scalable mechanical construction that allows
a wide range of flexibility in installation, fabric design, and maintenance. The
chassis may be mounted with the cables facing the front of the equipment rack or
to the rear, and consists of the following:
v Up to eight hot-swappable port blade assemblies can be configured in a single
chassis, delivering up to 384 Fibre Channel ports.
v Two slots for control processor blades (CP8):
– A single active CP8 blade can control all 384 ports in the chassis.
– The standby CP8 blade assumes control of the SAN768B if the active CP
Two slots for core switch blades (CR8):
v
– CR8 blade interconnects all port blades
– Two inter-chassis link (ICL) connectors per blade to connect to another
– Both CR8 blades are active
Modular hot-swappable port blades:
v
– 16-port, 8-Gbps blades (FC8-16)
– 32-port, 8-Gbps blades (FC8-32)
– 48-port, 8-Gbps blades (FC8-48)
– 6-port, 10-Gbps blades (FC10-6)
v Modular hot-swappable application blades:
– FR4-18i: 18-port (16 FC + 2 GbE), up to 4 blades per chassis, supporting
v Modular hot-swappable field replaceable units (FRUs):
– Three blower assemblies
– Up to four power supplies
– Two WWN cards
– Small Form-factor Pluggable (SFP) optical transceivers (4- and 8-Gbps)
– Extended Form-factor Pluggable (XFP) optical transceivers (10-Gbps)
|
– 1 GbE copper SFP transceivers for the IP ports on the routing blade
v All blades are serviced from the port side of the SAN768B. Blowers, power
supplies, and power cables are serviced from the nonport side.
v Improved cable management using a redesigned cable management comb and
chassis door
v Constant intake and FRU temperature monitoring
v World Wide Name (WWN) cards on the nonport side, to maintain chassis-specific
information such as WWNs, IP addresses, and summary status information of
each port blade and power supply through LEDs
v Redundant AC primary power connections to ensure high availability. Each power
supply has its own connector
fails.
chassis
Fibre Channel Routing Services and FCIP
Airflow in the SAN768B is from the non-port (non-cable) side to the port
Note:
(cable) side and out the exhaust vent.
1 on page 3 shows a sample configuration of the port side of the SAN768B.
Figure
2 SAN768B Installation, Service, and User’s Guide