IBM System Storage DS4000 EXP420
Storage Expansion Enclosure
Installation, User’ s an d Maintenance Guid e
GC27-2050-02
IBM System Storage DS4000 EXP420
Storage Expansion Enclosure
Installation, User’ s an d Maintenance Guid e
GC27-2050-02
Note:
Before using this information and the product it supports, be sure to read the general information in “Notices” on page 137.
Third Edition (December 2007)
© Copyright International Business Machines Corporation 2006, 2007. All rights reserved.
US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.
Contents
Figures . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
Tables . . . . . . . . . . . . . . . . . . . . . . . . . . . .ix
Safety . . . . . . . . . . . . . . . . . . . . . . . . . . . .xi
About this document . . . . . . . . . . . . . . . . . . . . . xvii
Who should read this document . . . . . . . . . . . . . . . . . . xvii
How this document is organized . . . . . . . . . . . . . . . . . . xvii
DS4000 Storage Subsystem installation tasks - General overview . . . . . . xviii
Getting information, help, and service . . . . . . . . . . . . . . . . xxii
Before you call . . . . . . . . . . . . . . . . . . . . . . . . xxii
Using the documentation . . . . . . . . . . . . . . . . . . . . xxii
Finding DS4000 readme files . . . . . . . . . . . . . . . . . . xxiii
Web sites . . . . . . . . . . . . . . . . . . . . . . . . . xxiii
Software service and support . . . . . . . . . . . . . . . . . . xxiv
Hardware service and support . . . . . . . . . . . . . . . . . . xxiv
Fire suppression systems . . . . . . . . . . . . . . . . . . . xxv
How to send your comments . . . . . . . . . . . . . . . . . . xxv
Chapter 1. Introduction . . . . . . . . . . . . . . . . . . . . . .1
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . .1
Operating system support . . . . . . . . . . . . . . . . . . . .2
Fibre channel defined . . . . . . . . . . . . . . . . . . . . . .2
SATA defined . . . . . . . . . . . . . . . . . . . . . . . . .2
Inventory checklist . . . . . . . . . . . . . . . . . . . . . . . .2
EXP420 components . . . . . . . . . . . . . . . . . . . . . . .3
Enhanced Value Disk Drive Modules (EV-DDMs) . . . . . . . . . . . .3
Environmental Service Modules (ESMs) . . . . . . . . . . . . . . .4
Connectors, switch, and enclosure ID . . . . . . . . . . . . . . .5
Rear drive channel ports . . . . . . . . . . . . . . . . . . . .6
Power supply and fan units . . . . . . . . . . . . . . . . . . . .6
Small Form-Factor Pluggable (SFP) modules . . . . . . . . . . . . .8
Software and hardware compatibility and upgrades . . . . . . . . . . . .9
Software and firmware support code upgrades . . . . . . . . . . . . .9
EXP420 hardware and software compatibility . . . . . . . . . . . . .10
Determining firmware levels . . . . . . . . . . . . . . . . . . .10
Product updates and support notifications . . . . . . . . . . . . . .12
Best practices guidelines . . . . . . . . . . . . . . . . . . . .12
Specifications . . . . . . . . . . . . . . . . . . . . . . . . .13
Area requirements . . . . . . . . . . . . . . . . . . . . . .13
Dimensions . . . . . . . . . . . . . . . . . . . . . . . .13
Weight . . . . . . . . . . . . . . . . . . . . . . . . . .14
Shipping dimensions . . . . . . . . . . . . . . . . . . . . .14
Environmental requirements and specifications . . . . . . . . . . . .14
Temperature and humidity . . . . . . . . . . . . . . . . . . .15
Altitude . . . . . . . . . . . . . . . . . . . . . . . . . .15
Airflow and heat dissipation . . . . . . . . . . . . . . . . . .15
Acoustic noise . . . . . . . . . . . . . . . . . . . . . . .16
Electrical requirements . . . . . . . . . . . . . . . . . . . . .16
Site wiring and power . . . . . . . . . . . . . . . . . . . .17
Power recovery after ac power failure . . . . . . . . . . . . . .17
Power cords and receptacles . . . . . . . . . . . . . . . . . .17
© Copyright IBM Corp. 2006, 2007 iii
Heat output, airflow, and cooling . . . . . . . . . . . . . . . . .17
Chapter 2. Installing the EXP420 . . . . . . . . . . . . . . . . . .19
Installation overview . . . . . . . . . . . . . . . . . . . . . . .19
Handling static-sensitive devices . . . . . . . . . . . . . . . . . .20
Preparing for installation . . . . . . . . . . . . . . . . . . . . .21
Tools and hardware required . . . . . . . . . . . . . . . . . . .21
Preparing the site . . . . . . . . . . . . . . . . . . . . . . .22
Preparing the rack . . . . . . . . . . . . . . . . . . . . . .22
Installing the support rails . . . . . . . . . . . . . . . . . . . . .23
Installing the EXP420 . . . . . . . . . . . . . . . . . . . . . .26
Removing the CRUs . . . . . . . . . . . . . . . . . . . . . .26
Removing an ESM . . . . . . . . . . . . . . . . . . . . .27
Removing a power supply and fan unit . . . . . . . . . . . . . .28
Removing an EV-DDM . . . . . . . . . . . . . . . . . . . .29
Installing the EXP420 into a rack . . . . . . . . . . . . . . . . .30
Replacing the EXP420 CRUs . . . . . . . . . . . . . . . . . .32
Replacing an ESM . . . . . . . . . . . . . . . . . . . . .32
Replacing a power supply and fan unit . . . . . . . . . . . . . .33
Replacing an EV-DDM . . . . . . . . . . . . . . . . . . . .34
Chapter 3. Cabling the EXP420 . . . . . . . . . . . . . . . . . .37
Enclosure ID settings . . . . . . . . . . . . . . . . . . . . . .37
Fibre-channel loop and ID settings . . . . . . . . . . . . . . . . . .38
Cabling the EXP420 . . . . . . . . . . . . . . . . . . . . . . .38
Installing SFP modules . . . . . . . . . . . . . . . . . . . . . .39
Removing SFP modules . . . . . . . . . . . . . . . . . . . . .41
Handling fibre-optic cables . . . . . . . . . . . . . . . . . . . .42
Using LC-LC fibre-channel cables . . . . . . . . . . . . . . . . . .43
Connecting an LC-LC cable to an SFP module . . . . . . . . . . . .44
Removing an LC-LC fibre-channel cable . . . . . . . . . . . . . .45
Cabling the EXP420 to a storage subsystem . . . . . . . . . . . . . .46
EXP420 loop redundancy . . . . . . . . . . . . . . . . . . . . .48
Example of a correct redundant drive loop . . . . . . . . . . . . . .48
Example of an incorrect redundant drive loop . . . . . . . . . . . . .50
Cabling the power supply . . . . . . . . . . . . . . . . . . . . .52
Chapter 4. Operating the EXP420 . . . . . . . . . . . . . . . . .53
Performing the DS4000 Health Check process . . . . . . . . . . . . .53
Web pages . . . . . . . . . . . . . . . . . . . . . . . . .54
Hardware responsibilities . . . . . . . . . . . . . . . . . . . .54
Powering on the EXP420 . . . . . . . . . . . . . . . . . . . . .55
Turning on the EXP420 . . . . . . . . . . . . . . . . . . . .55
Firmware updates . . . . . . . . . . . . . . . . . . . . . . . .57
Finding controller, storage expansion enclosure, and drive information . . . .58
Troubleshooting the storage expansion enclosure . . . . . . . . . . . .59
Checking the LEDs . . . . . . . . . . . . . . . . . . . . . . .59
Power supply and fan unit LEDs . . . . . . . . . . . . . . . . .60
Front LEDs . . . . . . . . . . . . . . . . . . . . . . . . .60
Rear LEDs . . . . . . . . . . . . . . . . . . . . . . . . .61
Seven-segment numeric display . . . . . . . . . . . . . . . . .62
Powering off the storage expansion enclosure . . . . . . . . . . . . .64
Turning off the EXP420 . . . . . . . . . . . . . . . . . . . .64
Performing an emergency shutdown . . . . . . . . . . . . . . . .67
Restoring power after an unexpected shutdown . . . . . . . . . . . .67
Recovering from an overheated power supply and fan unit . . . . . . . . .68
iv IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Chapter 5. Installing and replacing devices . . . . . . . . . . . . .73
Handling static-sensitive devices . . . . . . . . . . . . . . . . . .73
Service Action Allowed Status LED . . . . . . . . . . . . . . . . .73
Adding the EXP420 to an existing and configured redundant drive channel/loop
pair . . . . . . . . . . . . . . . . . . . . . . . . . . . .74
Working with hot-swap EV-DDMs . . . . . . . . . . . . . . . . . .76
Installing hot-swap EV-DDMs . . . . . . . . . . . . . . . . . . .78
Replacing hot-swap EV-DDMs . . . . . . . . . . . . . . . . . .80
Replacing multiple EV-DDMs . . . . . . . . . . . . . . . . . . .81
Replacing all EV-DDMs at the same time . . . . . . . . . . . . .82
Replacing the EV-DDMs one at a time . . . . . . . . . . . . . .84
Verifying the Link Rate setting . . . . . . . . . . . . . . . . . . .86
Replacing a power supply and fan unit . . . . . . . . . . . . . . . .89
Replacing an Environmental Service Module (ESM) . . . . . . . . . . .94
Replacing an SFP module . . . . . . . . . . . . . . . . . . . .96
Replacing a midplane . . . . . . . . . . . . . . . . . . . . . .98
Chapter 6. Hardware maintenance . . . . . . . . . . . . . . . . 101
General checkout . . . . . . . . . . . . . . . . . . . . . . . 101
Solving problems . . . . . . . . . . . . . . . . . . . . . . . 101
Parts listing . . . . . . . . . . . . . . . . . . . . . . . . . . 107
Appendix A. Records . . . . . . . . . . . . . . . . . . . . . 109
Identification numbers . . . . . . . . . . . . . . . . . . . . . . 109
Storage subsystem and controller information record . . . . . . . . . .110
Sample information record . . . . . . . . . . . . . . . . . . . 111
Installed device records . . . . . . . . . . . . . . . . . . . . .112
Appendix B. Rack mounting template . . . . . . . . . . . . . . .113
Appendix C. Power cords . . . . . . . . . . . . . . . . . . . .117
Appendix D. Additional DS4000 documentation . . . . . . . . . . . 121
DS4000 Storage Manager Version 10 library . . . . . . . . . . . . . 121
DS4800 Storage Subsystem library . . . . . . . . . . . . . . . . . 122
DS4700 Storage Subsystem library . . . . . . . . . . . . . . . . . 123
DS4500 Storage Subsystem library . . . . . . . . . . . . . . . . . 124
DS4400 Storage Subsystem library . . . . . . . . . . . . . . . . . 125
DS4300 Storage Subsystem library . . . . . . . . . . . . . . . . . 126
DS4200 Express Storage Subsystem library . . . . . . . . . . . . . 127
DS4100 Storage Subsystem library . . . . . . . . . . . . . . . . . 128
DS4000 Storage Expansion Enclosure documents . . . . . . . . . . . 129
Other DS4000 and DS4000-related documents . . . . . . . . . . . . 130
Appendix E. Accessibility . . . . . . . . . . . . . . . . . . . . 131
Appendix F. Product Recycling and Disposal . . . . . . . . . . . . 133
Appendix G. Battery Return Program . . . . . . . . . . . . . . . 135
Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . 137
Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . 137
Important notes . . . . . . . . . . . . . . . . . . . . . . . . 138
Product recycling and disposal . . . . . . . . . . . . . . . . . . 138
Battery return program . . . . . . . . . . . . . . . . . . . . . 139
Contact Information . . . . . . . . . . . . . . . . . . . . . . . 140
Contents v
Electronic emission notices . . . . . . . . . . . . . . . . . . . . 140
Federal Communications Commission (FCC) statement . . . . . . . . 140
Chinese class A compliance statement . . . . . . . . . . . . . . . 140
Industry Canada Class A emission compliance statement . . . . . . . . 141
Australia and New Zealand Class A statement . . . . . . . . . . . . 141
United Kingdom telecommunications safety requirement . . . . . . . . 141
European Union EMC Directive conformance statement . . . . . . . . 141
Taiwan Class A warning statement . . . . . . . . . . . . . . . . 141
Japanese Voluntary Control Council for Interference (VCCI) statement 142
Glossary . . . . . . . . . . . . . . . . . . . . . . . . . . 143
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
vi IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Figures
1. EXP420 hot-swap drive bays . . . . . . . . . . . . . . . . . . . . . . . . . . .3
2. Back view; power switch, enclosure ID, and connectors . . . . . . . . . . . . . . . . .5
3. Rear view of drive channel ports . . . . . . . . . . . . . . . . . . . . . . . . .6
4. Power supply and fan unit components . . . . . . . . . . . . . . . . . . . . . . .7
5. Power supply and fan unit and airflow . . . . . . . . . . . . . . . . . . . . . . .8
6. SFP module and fibre optic cable . . . . . . . . . . . . . . . . . . . . . . . . .9
7. EXP420 dimensions . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14
8. EXP420 airflow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16
9. Example of cold aisle/hot aisle rack configuration . . . . . . . . . . . . . . . . . . .18
10. Example of EXP420 serial number, machine type, and model number location . . . . . . . .20
11. Front rack mounting template . . . . . . . . . . . . . . . . . . . . . . . . . .23
12. Rear rack mounting template . . . . . . . . . . . . . . . . . . . . . . . . . .24
13. Installing the support rails . . . . . . . . . . . . . . . . . . . . . . . . . . .26
14. Removing and replacing an Environmental Service Module (ESM) . . . . . . . . . . . .28
15. Removing a power supply and fan unit . . . . . . . . . . . . . . . . . . . . . . .29
16. Removing a EV-DDM CRU . . . . . . . . . . . . . . . . . . . . . . . . . . .30
17. Installing the EXP420 . . . . . . . . . . . . . . . . . . . . . . . . . . . . .31
18. Securing the storage expansion enclosure to the rack . . . . . . . . . . . . . . . . .32
19. Removing and replacing an Environmental Service Module (ESM) . . . . . . . . . . . .33
20. Replacing a power supply and fan unit . . . . . . . . . . . . . . . . . . . . . . .34
21. Replacing an EV-DDM . . . . . . . . . . . . . . . . . . . . . . . . . . . . .35
22. Storage expansion enclosure seven-segment enclosure ID . . . . . . . . . . . . . . .38
23. SFP module and protective cap . . . . . . . . . . . . . . . . . . . . . . . . .40
24. Installing an SFP module into the host port . . . . . . . . . . . . . . . . . . . . .41
25. Unlocking the SFP module latch - plastic variety . . . . . . . . . . . . . . . . . . .41
26. Unlocking the SFP module latch - wire variety . . . . . . . . . . . . . . . . . . . .42
27. Recommended bending and looping specifications for fibre-optic cables . . . . . . . . . .43
28. LC-LC fibre-channel cable . . . . . . . . . . . . . . . . . . . . . . . . . . .43
29. Removing fibre-optic cable protective caps . . . . . . . . . . . . . . . . . . . . .44
30. Inserting an LC-LC fibre-channel cable into an SFP module . . . . . . . . . . . . . . .45
31. LC-LC fibre-channel cable lever and latches . . . . . . . . . . . . . . . . . . . . .45
32. Removing the LC-LC fibre-channel cable . . . . . . . . . . . . . . . . . . . . . .46
33. Installing an SFP module and LC-LC cable in a supported DS4000 storage subsystem . . . . .47
34. Installing an SFP module and connecting an LC-LC cable to the EXP420 . . . . . . . . . .48
35. Correct EXP420 redundant drive loop configuration . . . . . . . . . . . . . . . . . .49
36. Incorrect EXP420 redundant drive loop configuration . . . . . . . . . . . . . . . . .51
37. Power supply switches and connectors . . . . . . . . . . . . . . . . . . . . . . .56
38. Power supply and fan unit LEDs . . . . . . . . . . . . . . . . . . . . . . . . .60
39. Front LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .61
40. Rear LEDs, controls, and connectors . . . . . . . . . . . . . . . . . . . . . . .62
41. Numeric display LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . .63
42. Power supply switches . . . . . . . . . . . . . . . . . . . . . . . . . . . . .70
43. Cabling the EXP420 to an existing and configured drive loop . . . . . . . . . . . . . .75
44. Hot-swap EV-DDM LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . .79
45. EV-DDM CRU handle . . . . . . . . . . . . . . . . . . . . . . . . . . . . .80
46. Link rate LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .88
47. Link rate switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .88
48. Replacing a power supply and fan unit . . . . . . . . . . . . . . . . . . . . . . .93
49. Removing and replacing an Environmental Service Module (ESM) . . . . . . . . . . . .95
50. Replacing an SFP module . . . . . . . . . . . . . . . . . . . . . . . . . . .97
51. Replacing a midplane . . . . . . . . . . . . . . . . . . . . . . . . . . . . .99
52. EXP420 storage expansion enclosure parts list . . . . . . . . . . . . . . . . . . . 108
53. Front rack mounting template . . . . . . . . . . . . . . . . . . . . . . . . . .114
© Copyright IBM Corp. 2006, 2007 vii
54. Rear rack mounting template . . . . . . . . . . . . . . . . . . . . . . . . . .115
viii IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Tables
1. Where to find DS4000 installation and configuration procedures . . . . . . . . . . . . . xviii
2. Description of Figure 2 on page 5 . . . . . . . . . . . . . . . . . . . . . . . . .5
3. Description of Figure 3 on page 6 . . . . . . . . . . . . . . . . . . . . . . . . .6
4. Description of Figure 4 on page 7 . . . . . . . . . . . . . . . . . . . . . . . . .7
5. Software and firmware levels for the EXP420 . . . . . . . . . . . . . . . . . . . . .9
6. EXP420 hardware and software compatibility . . . . . . . . . . . . . . . . . . . .10
7. EXP420 weights . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14
8. EXP420 component weights . . . . . . . . . . . . . . . . . . . . . . . . . .14
9. EXP420 shipping carton dimensions . . . . . . . . . . . . . . . . . . . . . . . .14
10. Temperature and humidity requirements . . . . . . . . . . . . . . . . . . . . . .15
11. EXP420 altitude ranges . . . . . . . . . . . . . . . . . . . . . . . . . . . .15
12. EXP420 power and heat dissipation . . . . . . . . . . . . . . . . . . . . . . . .16
13. EXP420 sound levels . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16
14. EXP420 ac power requirements . . . . . . . . . . . . . . . . . . . . . . . . .17
15. Description of Figure 37 on page 56 . . . . . . . . . . . . . . . . . . . . . . . .57
16. Power supply and fan unit LEDs . . . . . . . . . . . . . . . . . . . . . . . . .60
17. Front LEDs and controls . . . . . . . . . . . . . . . . . . . . . . . . . . . .61
18. Rear LEDs, controls, and connectors . . . . . . . . . . . . . . . . . . . . . . .62
19. Numeric display diagnostic codes . . . . . . . . . . . . . . . . . . . . . . . . .64
20. Description of Figure 42 on page 70 . . . . . . . . . . . . . . . . . . . . . . . .70
21. Drive LED activity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .78
22. Data transfer rates for drive modules . . . . . . . . . . . . . . . . . . . . . . .87
23. Symptom-to-FRU index . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102
24. Parts listing (EXP420 storage expansion enclosure) . . . . . . . . . . . . . . . . . 108
25. Storage subsystem and controller information record . . . . . . . . . . . . . . . . .110
26. Sample information record . . . . . . . . . . . . . . . . . . . . . . . . . . . 111
27. Hard disk drive record . . . . . . . . . . . . . . . . . . . . . . . . . . . .112
28. IBM power cords . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .117
29. DS4000 Storage Manager Version 10 titles by user tasks . . . . . . . . . . . . . . . 121
30. DS4800 Storage Subsystem document titles by user tasks . . . . . . . . . . . . . . . 122
31. DS4700 Storage Subsystem document titles by user tasks . . . . . . . . . . . . . . . 123
32. DS4500 Storage Subsystem document titles by user tasks . . . . . . . . . . . . . . . 124
33. DS4400 Storage Subsystem document titles by user tasks . . . . . . . . . . . . . . . 125
34. DS4300 Storage Subsystem document titles by user tasks . . . . . . . . . . . . . . . 126
35. DS4200 Express Storage Subsystem document titles by user tasks . . . . . . . . . . . 127
36. DS4100 Storage Subsystem document titles by user tasks . . . . . . . . . . . . . . . 128
37. DS4000 Storage Expansion Enclosure document titles by user tasks . . . . . . . . . . . 129
38. DS4000 and DS4000–related document titles by user tasks . . . . . . . . . . . . . . 130
39. DS4000 Storage Manager alternate keyboard operations . . . . . . . . . . . . . . . 131
© Copyright IBM Corp. 2006, 2007 ix
x IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Safety
The caution and danger statements that this document contains can be referenced
in the multilingual IBM ® Safety Information document that is provided with your IBM
System Storage™ EXP420 storage expansion enclosure. Each caution and danger
statement is numbered for easy reference to the corresponding statements in the
translated document.
v Danger: These statements indicate situations that can be potentially lethal or
extremely hazardous to you. A danger statement is placed just before the
description of a potentially lethal or extremely hazardous procedure, step, or
situation.
v Caution: These statements indicate situations that can be potentially hazardous
to you. A caution statement is placed just before the description of a potentially
hazardous procedure step or situation.
v Attention: These notices indicate possible damage to programs, devices, or
data. An attention notice is placed just before the instruction or situation in which
damage could occur.
Before installing this product, read the following danger and caution notices.
© Copyright IBM Corp. 2006, 2007 xi
Statement 1:
DANGER
Electrical
current from power, telephone, and communication cables is
hazardous.
To avoid a shock hazard:
v Do not connect or disconnect any cables or perform installation,
maintenance, or reconfiguration of this product during an electrical
storm.
v Connect all power cords to a properly wired and grounded electrical
outlet.
v Connect to properly wired outlets any equipment that will be attached to
this product.
v When possible, use one hand only to connect or disconnect signal
cables.
v Never turn on any equipment when there is evidence of fire, water, or
structural damage.
v Disconnect the attached power cords, telecommunications systems,
networks, and modems before you open the device covers, unless
instructed otherwise in the installation and configuration procedures.
v Connect and disconnect cables as described in the following table when
installing, moving, or opening covers on this product or attached
devices.
To Connect: To Disconnect:
1. Turn everything OFF.
2. First, attach all cables to devices.
3. Attach signal cables to connectors.
4. Attach power cords to outlet.
1. Turn everything OFF.
2. First, remove power cords from outlet.
3. Remove signal cables from connectors.
4. Remove all cables from devices.
5. Turn device ON.
xii IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Statement 3:
CAUTION:
When laser products (such as CD-ROMs, DVD drives, fibre optic devices, or
transmitters) are installed, note the following:
v Do not remove the covers. Removing the covers of the laser product could
result in exposure to hazardous laser radiation. There are no serviceable
parts inside the device.
v Use of controls or adjustments or performance of procedures other than
those specified herein might result in hazardous radiation exposure.
DANGER
laser products contain an embedded Class 3A or Class 3B laser
Some
diode. Note the following.
Laser radiation when open. Do not stare into the beam, do not view directly
with optical instruments, and avoid direct exposure to the beam.
Class 1 Laser statement
Class 1 Laser Product
Laser Klasse 1
Laser Klass 1
Luokan 1 Laserlaite
Apparell Laser de Calsse 1 À
IEC 825-11993 CENELEC EN 60 825
Safety xiii
Statement 4:
≥ 18 kg (39.7 lb) ≥ 32 kg (70.5 lb) ≥ 55 kg (121.2 lb)
CAUTION:
Use safe practices when lifting.
Statement 5:
CAUTION:
The power control button on the device and the power switch on the power
supply do not turn off the electrical current supplied to the device. The device
also might have more than one power cord. To remove all electrical current
from the device, ensure that all power cords are disconnected from the power
source.
2
1
xiv IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Statement 8:
CAUTION:
Never remove the cover on a power supply or any part that has the following
label attached.
Hazardous voltage, current, and energy levels are present inside any
component that has this label attached. There are no serviceable parts inside
these components. If you suspect a problem with one of these parts, contact
a service technician.
Cable Warning:
WARNING: Handling the cord on this product or cords associated with accessories
sold with this product, will expose you to lead, a chemical known to the State of
California to cause cancer, and birth defects or other reproductive harm. Wash
hands after handling.
Safety xv
xvi IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
About this document
This document provides instructions for installing and customizing the configuration
of your IBM® System Storage DS4000 EXP420 storage expansion enclosure. It also
provides maintenance procedures and troubleshooting information.
Who should read this document
This document is intended for system operators and service technicians who have
extensive knowledge of Fibre Channel and network technology.
How this document is organized
Chapter 1, “Introduction,” on page 1 describes the IBM System Storage EXP420
storage expansion enclosure. This chapter includes an inventory checklist and an
overview of the storage expansion enclosure features, operating specifications, and
components.
Chapter 2, “Installing the EXP420,” on page 19 contains information on how to
install the EXP420.
Chapter 3, “Cabling the EXP420,” on page 37 contains information on how to cable
the EXP420.
Chapter 4, “Operating the EXP420,” on page 53 contains information on how to
power on and off the storage expansion enclosure, recover from an overheated
power supply and fan unit, troubleshoot the storage expansion enclosure, and
interpret LEDs.
Chapter 5, “Installing and replacing devices,” on page 73 contains step-by-step
instructions about how to install or remove customer replaceable units (CRUs), such
as Enhanced Value Disk Drive Modules (EV-DDMs), power supply and fan units,
environmental service modules (ESMs), midplane, and SFP modules.
Chapter 6, “Hardware maintenance,” on page 101 describes problems and
symptoms that are specific to your storage expansion enclosure. It also provides a
parts list for the EXP420.
Appendix A, “Records,” on page 109 provides a table that you can use to record
and update important information about your EXP420, including serial number and
device records. Whenever you add options to your EXP420, be sure to update the
information in this table.
Appendix B, “Rack mounting template,” on page 113 provides the rack mounting
templates for installation of the EXP420. If you want to tear out the templates from
the document for use during installation, use these copies of the templates.
Appendix C, “Power cords,” on page 117 lists power cord information for the
EXP420.
Appendix D, “Additional DS4000 documentation,” on page 121 lists additional
DS4000 documents.
Appendix E, “Accessibility,” on page 131 details accessibility information.
© Copyright IBM Corp. 2006, 2007 xvii
Appendix F, “Product Recycling and Disposal,” on page 133 details the European
directive about product recycling.
DS4000 Storage Subsystem installation tasks - General overview
Table 1 provides a sequential list of many installation and configuration tasks that
are common to most DS4000 configurations. When you install and configure your
DS4000 storage subsystem, refer to this table to find the documentation that
explains how to complete each task.
Table 1. Where to find DS4000 installation and configuration procedures
Installation task Where to find information or procedures
1 Plan the installation
v DS4000 Storage Manager Concepts Guide
v DS4000 Storage Manager Installation and Host Support
Guide for AIX, HP-UX, Solaris, and Linux on POWER
v DS4000 Storage Manager Installation and Host Support
Guide for Windows 2000/Server 2003/2008, NetWare,
VMWare ESX Server, and Linux
v DS4100 Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4200 Express Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4300 Storage Subsystem Installation, User's, and
Maintenance Guide
v DS4400 Fibre Channel Storage Server Installation and
Support Guide
v DS4500 Storage Subsystem Installation, User's, and
Maintenance Guide
v DS4700 Express Storage Subsystem Installation, User’s, and
Maintenance Guide
v IBM System Storage Quick Start Guide, Quick reference for
the DS4800
v DS4800 Storage Subsystem Installation, User’s, and
Maintenance Guide
v IBM System Storage Quick Start Guide, Quick reference for
the DS4700 and DS4200, Sections 2, 3, and 4 also for
installing the EXP810 and EXP420
2 Mount the DS4000
storage subsystem in
the rack
v DS4800 Storage Subsystem Installation, User’s, and
Maintenance Guide
v IBM System Storage Quick Start Guide, Quick reference for
the DS4800
v DS4700 Express Storage Subsystem Installation, User’s, and
Maintenance Guide
v IBM System Storage Quick Start Guide, Quick reference for
the DS4700 and DS4200, Sections 2, 3, and 4 also for
installing the EXP810 and EXP420
v DS4400 and DS4500 Rack Mounting Instructions
v DS4300 Rack Mounting Instructions
v DS4200 Express Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4100 Storage Subsystem Installation, User’s and
Maintenance Guide
xviii IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Table 1. Where to find DS4000 installation and configuration procedures (continued)
Installation task Where to find information or procedures
3 Mount the DS4000
EXP storage
expansion unit in the
rack
v DS4000 EXP100 Storage Expansion Unit Installation, User’s
and Maintenance Guide
v DS4000 EXP420 Storage Expansion Enclosures Installation,
User’s, and Maintenance Guide
v DS4000 EXP700 and EXP710 Storage Expansion Enclosures
Installation, User’s, and Maintenance Guide
v DS4000 EXP810 Storage Expansion Enclosures Installation,
User’s, and Maintenance Guide
v FAStT EXP500 Installation and User’s Guide
v IBM System Storage Quick Start Guide, Quick reference for
the DS4700 and DS4200, Sections 2, 3, and 4 also for
installing the EXP810 and EXP420
4 Route the storage
expansion unit Fibre
Channel cables
v DS4100 Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4200 Express Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4300 Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4400 Fibre Channel Cabling Instructions
v DS4500 Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4700 Express Storage Subsystem Installation, User’s, and
Maintenance Guide
v IBM System Storage Quick Start Guide, Quick reference for
the DS4700 and DS4200, Sections 2, 3, and 4 also for
installing the EXP810 and EXP420
v DS4800 Storage Subsystem Installation, User’s, and
Maintenance Guide
v IBM System Storage Quick Start Guide, Quick reference for
the DS4800
5 Route the host
server Fibre Channel
cables
v DS4100 Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4200 Express Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4300 Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4400 Fibre Channel Cabling Instructions
v DS4500 Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4700 Express Storage Subsystem Installation, User’s, and
Maintenance Guide
v IBM System Storage Quick Start Guide, Quick reference for
the DS4700 and DS4200, Sections 2, 3, and 4 also for
installing the EXP810 and EXP420
v DS4800 Storage Subsystem Installation, User’s, and
Maintenance Guide
v IBM System Storage Quick Start Guide, Quick reference for
the DS4800
About this document xix
Table 1. Where to find DS4000 installation and configuration procedures (continued)
Installation task Where to find information or procedures
6 Power up the
subsystem
v DS4100 Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4200 Express Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4300 Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4400 Fibre Channel Storage Server Installation and
Support Guide
v DS4500 Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4700 Express Storage Subsystem Installation, User’s, and
Maintenance Guide
v IBM System Storage Quick Start Guide, Quick reference for
the DS4700 and DS4200, Sections 2, 3, and 4 also for
installing the EXP810 and EXP420
v DS4800 Storage Subsystem Installation, User’s, and
Maintenance Guide
v IBM System Storage Quick Start Guide, Quick reference for
the DS4800
7 Configure DS4000
network settings
v DS4100 Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4200 Express Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4300 Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4400 Fibre Channel Storage Server Installation and
Support Guide
v DS4500 Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4700 Express Storage Subsystem Installation, User’s, and
Maintenance Guide
v IBM System Storage Quick Start Guide, Quick reference for
the DS4700 and DS4200, Sections 2, 3, and 4 also for
installing the EXP810 and EXP420
v DS4800 Storage Subsystem Installation, User’s, and
Maintenance Guide
v IBM System Storage Quick Start Guide, Quick reference for
the DS4800
8 Zone the fabric
switch
(SAN-attached only)
v DS4000 Storage Manager Installation and Host Support
Guide for AIX, HP-UX, Solaris, and Linux on POWER
v DS4000 Storage Manager Installation and Host Guide for
Windows 2000/Server 2003/2008, NetWare, VMWare ESX
Server, and Linux
v DS4000 Storage Manager Copy Services Guide (describes
switch zoning for the Remote Mirror Option)
v See also the documentation provided by the switch
manufacturer.
xx IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Table 1. Where to find DS4000 installation and configuration procedures (continued)
Installation task Where to find information or procedures
9 Install DS4000
Storage Manager
software on the
management station
10 Install host software
(failover drivers) on
host server
11 Start DS4000
Storage Manager
12 Set the DS4000
Storage Manager
clock
v DS4000 Storage Manager Installation and Host Support
Guide for AIX, HP-UX, Solaris, and Linux on POWER
v DS4000 Storage Manager Installation and Host Support
Guide for Windows 2000/Server 2003/2008, NetWare,
VMWare ESX Server, and Linux
v IBM System Storage Quick Start Guide, Quick reference for
the DS4700 and DS4200, Sections 2, 3, and 4 also for
installing the EXP810 and EXP420
v IBM System Storage Quick Start Guide, Quick reference for
the DS4800
v DS4000 Storage Manager online help (for post-installation
tasks)
13 Set the DS4000
Storage Manager
host default type
14 Verify DS4000
subsystem health
v DS4100 Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4200 Express Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4300 Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4400 Fibre Channel Storage Server Installation and
Support Guide
v DS4500 Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4700 Express Storage Subsystem Installation, User’s, and
Maintenance Guide
v DS4800 Storage Subsystem Installation, User’s, and
Maintenance Guide
15 Enable DS4000
Storage Manager
premium feature
keys
Copy Services premium features
DS4000 Storage Manager Copy Services Guide
FC/SATA Intermix premium feature
DS4000 Fibre Channel and Serial ATA Intermix
Premium Feature Installation Overview
Storage Partitioning (and general premium features
information)
v DS4000 Storage Manager Concepts Guide
v DS4000 Storage Manager Installation and Host
Support Guide for AIX, HP-UX, Solaris, and Linux on
POWER
v DS4000 Storage Manager Installation and Host
Support Guide for Windows 2000/Server 2003/2008,
NetWare, VMWare ESX Server, and Linux
About this document xxi
Table 1. Where to find DS4000 installation and configuration procedures (continued)
Installation task Where to find information or procedures
16 Configure arrays and
logical drives
17 Configure host
partitions
18 Verify host access to
DS4000 storage
v DS4000 Storage Manager Installation and Host Support
Guide for AIX, HP-UX, Solaris, and Linux on POWER
v DS4000 Storage Manager Installation and Host Support
Guide for Windows 2000/Server 2003/2008, NetWare,
VMWare ESX Server, and Linux
v IBM System Storage Quick Start Guide, Quick reference for
the DS4700 and DS4200, Sections 2, 3, and 4 also for
installing the EXP810 and EXP420
v IBM System Storage Quick Start Guide, Quick reference for
the DS4800
v DS4000 Storage Manager online help
Getting information, help, and service
If you need help, service, or technical assistance or just want more information
about IBM products, you will find a wide variety of sources available from IBM to
assist you. This section contains information about where to go for additional
information about IBM and IBM products, what to do if you experience a problem
with your system, and whom to call for service, if it is necessary.
Before you call
Before you call, take these steps to try to solve the problem yourself:
v Check all cables to make sure that they are connected.
v Check the power switches to make sure that the system is turned on.
v Use the troubleshooting information in your system documentation, and use the
diagnostic tools that come with your system.
v Check for technical information, hints, tips, and new device drivers at the IBM
support Web site pages that are listed in this section.
v Use an IBM discussion forum on the IBM Web site to ask questions.
can solve many problems without outside assistance by following the
You
troubleshooting procedures that IBM provides in the DS4000 Storage Manager
online help or in the documents that are provided with your system and software.
The information that comes with your system also describes the diagnostic tests
that you can perform. Most subsystems, operating systems, and programs come
with information that contains troubleshooting procedures and explanations of error
messages and error codes. If you suspect a software problem, see the information
for the operating system or program.
Using the documentation
Information about your IBM system and preinstalled software, if any, is available in
the documents that come with your system. This includes printed books, online
documents, readme files, and help files. See the troubleshooting information in your
system documentation for instructions for using the diagnostic programs. The
troubleshooting information or the diagnostic programs might tell you that you need
additional or updated device drivers or other software.
xxii IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Finding DS4000 readme files
1. Go to the following Web site:
www.ibm.com/systems/support/storage/disk
2. Click the link for your Storage Subsystem (for example, DS4800 ).
3. When the subsystem support page opens, click the Download tab.
4. Under the Download tab, click Storage Manager, firmware, HBA, tools,
support & pubs (including readmes) .
5. Now, click the appropriate tab for the type of readme file that you are looking
for:
v Firmware
v Storage Mgr
v HBA
v Tools
table displays as you click each tab.
A
6. In the table, click on the appropriate link in the Current version and readmes
column.
7. Click the link for the readme file.
Web sites
The most up-to-date information about DS4000 storage subsystems and DS4000
Storage Manager, including documentation and the most recent software, firmware,
and NVSRAM downloads, can be found at the following Web sites.
DS4000 Midrange Disk Systems
Find the latest information about IBM System Storage disk storage systems,
including all of the DS4000 storage subsystems:
www.ibm.com/servers/storage/disk/ds4000
IBM System Storage products
Find information about all IBM System Storage products:
www.storage.ibm.com
Support for IBM System Storage disk storage systems
Find links to support pages for all IBM System Storage disk storage
systems, including DS4000 storage subsystems and expansion units:
www.ibm.com/systems/support/storage/disk
System Storage DS4000 interoperability matrix
Find the latest information about operating system and HBA support,
clustering support, storage area network (SAN) fabric support, and DS4000
Storage Manager feature support:
www.ibm.com/servers/storage/disk/ds4000/interop-matrix.html
Storage Area Network (SAN) support
Find information about using SAN switches, including links to user guides
and other documents:
www.ibm.com/systems/support/storage/san
DS4000 technical support
Find downloads, hints and tips, documentation, parts information, HBA and
Fibre Channel support:
About this document xxiii
http://www.ibm.com/systems/support/storage/disk
Select your Storage Subsystem (for example, DS4800 ).
Premium feature activation
Activate a DS4000™ premium feature by using the online tool:
www-912.ibm.com/PremiumFeatures/jsp/keyInput.jsp
IBM publications center
Find IBM publications:
www.ibm.com/shop/publications/order/
Support for System p™ servers
Find the latest information supporting System p AIX® and Linux® servers:
www.ibm.com/systems/support/supportsite.wss/
brandmain?brandind=5000025
Support for System x™ servers
Find the latest information supporting System x Intel
servers:
www.ibm.com/systems/support/supportsite.wss/
brandmain?brandind=5000008
Fix delivery center for AIX and Linux on POWER
Find the latest AIX and Linux on POWER information and downloads:
www-912.ibm.com/eserver/support/fixes/fcgui.jsp
In the Product family drop-down menu, select UNIX ® servers. Then select
your product and fix type from the subsequent drop-down menus.
Eserver System p and AIX information center
Find everything you need to know about using AIX with System p and
POWER servers:
publib.boulder.ibm.com/infocenter/pseries/index.jsp?
Software service and support
Through IBM Support Line, for a fee you can get telephone assistance with usage,
configuration, and software problems. For information about which products are
supported by Support Line in your country or region, go to the following Web site:
www.ibm.com/services/sl/products
®
- and AMD-based
™
For more information about the IBM Support Line and other IBM services, go to the
following Web sites:
v www.ibm.com/services
v www.ibm.com/planetwide
Hardware service and support
You can receive hardware service through IBM Integrated Technology Services or
through your IBM reseller, if your reseller is authorized by IBM to provide warranty
service. Go to the following Web site for support telephone numbers:
www.ibm.com/planetwide
xxiv IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
In the U.S. and Canada, hardware service and support is available 24 hours a day,
7 days a week. In the U.K., these services are available Monday through Friday,
from 9 a.m. to 6 p.m.
Fire suppression systems
A fire suppression system is the responsibility of the customer. The customer’s own
insurance underwriter, local fire marshal, or a local building inspector, or both,
should be consulted in selecting a fire suppression system that provides the correct
level of coverage and protection. IBM designs and manufactures equipment to
internal and external standards that require certain environments for reliable
operation. Because IBM does not test any equipment for compatibility with fire
suppression systems, IBM does not make compatibility claims of any kind nor does
IBM provide recommendations on fire suppression systems.
How to send your comments
Your feedback is important to help us provide the highest quality information. If you
have any comments about this document, you can submit them in one of the
following ways:
E-mail
Submit your comments by e-mail to:
Mail
starpubs@us.ibm.com
Be sure to include the name and order number of the document and, if
applicable, the specific location of the text that you are commenting on,
such as a page number or table number.
Fill out the Readers’ Comments form (RCF) at the back of this document
and return it by mail or give it to an IBM representative.
If the RCF has been removed, send your comments to:
International
Business Machines Corporation
Information Development
Department GZW
9000 South Rita Road
Tucson, Arizona
USA
85744-0001
Be sure to include the name and order number of the document and, if
applicable, the specific location of the text that you are commenting on,
such as a page number or table number.
About this document xxv
xxvi IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Chapter 1. Introduction
This chapter describes the operating specifications, features, and components for
the IBM System Storage EXP420 storage expansion enclosure (hereafter referred
to as EXP420 or storage expansion enclosure ). This chapter also includes a list of
hardware that comes with the storage expansion enclosure.
Overview
The IBM System Storage DS4000 EXP420 storage expansion enclosure (Machine
Type 1812, Models 8VA and 8VH) provides high-capacity, SATA disk interface
storage. The storage expansion enclosure delivers fast, high-volume data transfer,
retrieval, and storage functions for multiple drives to multiple hosts. The storage
expansion enclosure provides continuous, reliable service, using hot-swap
technology for easy replacement without shutting down the system and support
redundant, dual-loop configurations. External cables and Small Form-Factor
Pluggable (SFP) modules connect the DS4000 storage subsystem to the storage
expansion enclosure.
The EXP420 is a rack-mountable enclosure that supports up to 16 500 GB S ATA
Enhanced Value Disk Drive Modules (EV-DDMs), offering up to 8.0 TB when using
500 GB SATA EV-DDMs. Coupled with a DS4000 storage subsystem such as the
DS4200 Express, you can configure RAID-protected storage solutions of up to 56
TB, providing economical and scalable storage for your rapidly growing application
needs for limited access, data reference storage capacity.
The EXP420 uses the latest fibre channel and SATA technology and is designed
with redundant 2 or 4 Gbps fibre channel connections to the DS4000 storage
subsystem offering reliability and performance.
In this initial release, you cannot intermix the EXP420 with any other storage
Note:
expansion enclosures in the same DS4000 storage subsystem configuration.
In addition, the only DS4000 storage subsystems that the EXP420 can be
attached to are the DS4200 Express models 7VA and 7VH. Contact your
IBM representative or reseller for information about intermix functionality or
additional DS4000 storage subsystem support in the future.
The EXP420 supports redundant, dual drive channel/loop configurations with the
DS4200 Express Storage Subsystems and other EXP420 storage expansion
enclosures. External cables and small form-factor pluggable (SFP) modules connect
the controller to the storage expansion enclosure. EXP420s attached to supported
DS4000 storage subsystems can be used with storage area networks to satisfy the
needs of various fixed content, data reference applications that require large
amounts of storage capacity but do not have the high utilization and access
characteristics satisfied by Fibre Channel disk drive storage. The storage expansion
enclosure provides continuous, reliable service and uses hot-swap technology for
easy replacement without the need to shut down the system. Up to six EXP420
enclosures can be connected together in a redundant fibre-channel drive
channel/loop pair in a DS4200 Express Storage Subsystem configuration, providing
connections to a maximum of 112 hard drives.
© Copyright IBM Corp. 2006, 2007 1
Operating system support
For supported operating systems, see the latest DS4000 Storage Manager host
software readme file and the IBM DS4000 series products interoperability matrix at
the following Web site for additional host operating system support:
www-1.ibm.com/servers/storage/disk/ds4000/interop-matrix.html
See “Finding DS4000 readme files” on page xxiii to learn how to access the
DS4000 readme files on the Web.
Fibre channel defined
Fibre channel technology is outlined in the SCSI-3 Fibre Channel Protocol
(SCSI-FCP) standard. Fibre channel is a high-speed data transport technology that
is used for mass storage and networking.
Using a fibre-channel arbitrated loop (FC-AL), more than 100 fibre-channel devices
can be supported, compared to 15 small computer system interface (SCSI) devices.
The connection from the DS4000 storage subsystem to the EXP420 is either a 2
Gbps or 4 Gbps fibre-channel interface speed that supports data transfer rates up
to 400 MBps half-duplex and 800 MBps full-duplex on optical interfaces.
SATA defined
The Serial Advanced Technology Attachment (SATA) interface offers increased data
rate performance over Parallel Advanced Technology Attachment (ATA), while
maintaining the benefits of ATA. S ATA is designed to overcome the performance
barriers that have been forecasted for current parallel technologies while
maintaining the cost-efficiency of Parallel ATA . SATA specifications allow for thinner,
more flexible cables, and lower pin counts. It also enables easier, more flexible
cable routing management and the use of smaller connectors than is possible with
the existing Parallel ATA technology.
The Serial ATA Working Group introduced the first SATA specification, Serial ATA
1.0, in 2001. The Web site is:
www.serialata.org.
Inventory checklist
The EXP420 ships with the following items:
v Power cables (2 jumper line cords)
v Rack-mounting hardware kit (1), including:
– Rails (2) (right and left assembly)
– M5 black hex-head slotted screws (12)
– Washers (8)
Blank trays (16) (Your storage expansion enclosure might come with up to 16
v
SATA EV-DDMs.)
v 4 Gbps SFPs (2) (already installed in the EXP420 ESM ports)
v Box ID labels (used to label the enclosure IDs on the front of the EXP420)
A rack mounting template and instructions for installing the support rails and the
storage expansion enclosure are provided in “Installing the support rails” on page
23.
2 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
To connect your EXP420 to DS4000 storage subsystems (such as the DS4200
Express) or other EXP420 storage expansion enclosures, IBM LC-LC fibre-channel
cables are required. Two additional IBM 4 Gbps SFP modules are required to
connect the EXP420 to more than one DS4000 storage expansion enclosure as
part of a multiple DS4000 storage expansion enclosure and storage subsystem
configuration.
Note: You must order these options separately.
EXP420 components
The EXP420 has the following removable components. These components, called
customer replaceable units (CRUs), are accessible from the front or back of the
EXP420.
v Up to 16 S ATA Enhanced Value Disk Drive Modules (EV-DDMs)
v Two environmental service modules (ESMs)
v Two power supply and fan units
Enhanced Value Disk Drive Modules (EV-DDMs)
This section shows the location of EXP420 hot-swappable EV-DDMs. The hot-swap
features of the EXP420 enable you to remove and replace S ATA EV-DDMs, power
supply and fan units, and ESMs without turning off the storage expansion
enclosure. Yo u can maintain the availability of your system while a hot-swap device
is removed, installed, or replaced.
Attention:
v You cannot mix storage expansion enclosures with different fibre channel speed
settings in the same drive channel/loop. All of the enclosures in a redundant drive
channel/loop pair must have the same enclosure speed setting. In addition, the
enclosure speed setting must be set at the lowest operating enclosure speed.
v EV-DDM options and FRUs for the EXP420 and DS4200 Express Storage
Subsystem are not the same as the Enhanced Disk Drive Modules (E-DDMs)
and FRU options for the EXP810 and DS4700 Storage Subsystem. Verify that
the EV-DDM option and FRU part numbers are correct before inserting into the
EXP420 or DS4200 Express drive slots. The disk drive module CRUs for
EXP810 storage expansion enclosures and DS4700 Storage Subsystems appear
as uncertified drives when inserted into EXP420 storage expansion enclosures
and DS4200 Express Storage Subsystems and vice versa.
hot-swap drive bays that are accessible from the front of your storage
The
expansion enclosure are shown in Figure 1.
Figure 1. EXP420 hot-swap drive bays
Chapter 1. Introduction 3
The EXP420 supports up to 16 SATA EV-DDMs. Each SATA hard drive, ATA
translator card (also referred to as interposer card), and carrier assembly (drive
tray) are called EV-DDM CRUs. The ATA translator card converts the fibre channel
protocol interface of the DS4200 Express drive channel/loop into the S ATA protocol
interface. It also provides dual paths to the SATA drive for EV-DDM CRU path
redundancy. Install EV-DDM CRUs in the 16 drive bays on the front of the storage
expansion enclosure from the leftmost (slot 1) to rightmost (slot 16).
The EXP420 storage expansion enclosure drive channel operates at either 2 or 4
Gbps fibre channel interface speed. The EXP420 S ATA EV-DDM CRUs have an
ATA translator card that converts EV-DDM 3 Gbps SATA drive interface protocol to
either 2 Gbps or 4 Gbps fibre channel interface protocol. It is recommended that the
EXP420 enclosure speed is set to 4 Gbps when these S ATA EV-DDM CRUs are
installed and connected to storage expansion enclosures running at 4 Gbps speed.
The Link Rate setting speed must be set accordingly. See “Verifying the Link Rate
setting ” on page 86 for more information. The enclosure speed of the DS4200
Express Storage Subsystem that the EXP420s are connected to must also be set to
4 Gbps.
There are no serviceable parts in a EV-DDM CRU. If it fails, it must be replaced in
its entirety (EV-DDM, ATA translator (interposer) card, bezel, and tray). The EXP420
EV-DDM option/FRU is not interchangeable with the drive tray of other storage
expansion enclosures. When replacing a EV-DDM CRU, be sure to order and install
the correct EV-DDM CRU.
Note: To determine whether you have installed a correct EV-DDM CRU, check its
Product ID. In this release, the EV-DDM's Product ID should be
ST350064INS 42D0392 39M0181 IBMV. See “Finding controller, storage
expansion enclosure, and drive information” on page 58 for details on how to
locate an EV-DDM's Product ID.
Attention:
1. After you remove a EV-DDM CRU, wait 70 seconds before replacing or
reseating the EV-DDM CRU to allow the drive to properly spin down. Failure to
do so may cause undesired events.
2. Never hot-swap a EV-DDM CRU when its associated green Activity LED is
flashing. Hot-swap a EV-DDM CRU only when its associated amber Fault LED
lights is not flashing or when the drive is inactive and its associated green
Activity LED lights is not flashing.
If the EV-DDM you want to remove is not in a failed or bypass state, always
Note:
use the Storage Manager client program either to place the EV-DDM in a
failed state or to place the array that is associated with the EV-DDM (or
EV-DDMs) in an offline state before you remove it from the enclosure.
Environmental Service Modules (ESMs)
The EXP420 has two hot-swappable and redundant ESM units. The ESMs are
located at the back of the storage expansion enclosure. The left ESM is labeled
ESM A, and the right ESM is labeled ESM B. One ESM will continue to operate if
the other ESM fails.
The ESMs contain the storage expansion enclosure control logic, interface ports,
and LEDs. Each ESM has four SFP module ports that you could use to connect the
storage expansion enclosure to the controller. However, only the two ESM SFP
4 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
ports (labeled 1A and 1B) near the center of the storage expansion enclosure are
used. The SFP ports labeled 2A and 2B are reserved for future use.
The EXP420 ESMs support automatic ESM firmware synchronization. This function
allows a new ESM with a different level of ESM firmware to be automatically
synchronized with the ESM firmware version in the existing ESM in the EXP420
chassis. To enable automatic ESM firmware synchronization:
1. Verify that the Storage Manager Event Monitor is installed and running.
2. Verify that the DS4000 storage subsystem that the EXP420 is attached to is
defined in the Enterprise Management window of the Storage Manager client
(SMclient).
Although
both ESM units (A and B) are identical, they are seated in the EXP420
chassis in opposite orientations. See Figure 2. If the ESM can not fully be inserted
in the ESM bay, flip it 180 degrees and reinsert it.
Connectors, switch, and enclosure ID
The ESMs support fibre optic interfaces for both the host channels and drive
channels. The two interface ports located near the enclosure ID are reserved for
future use. Do not plug any SFPs into these ports.
The enclosure ID, comprised of a pair of seven-segment numbers, is located on the
back of each ESM next to the ESM indicator lights. It provides a unique identifier for
each module in the storage array. The storage management software automatically
sets the enclosure ID number. Yo u can only change the enclosure ID setting
through the DS4000 storage management software. There are no switches on the
EXP420 chassis to manually set the enclosure ID. Both ESM enclosure ID numbers
will be identical under normal operating conditions.
Figure 2 shows the ESMs.
7
4 6
5
3 2 1
7
exp81023
1
2 3
6
5
4
Figure 2. Back view; power switch, enclosure ID, and connectors
Table 2. Description of Figure 2
Number Description
1 Power connector
2 Power switch
3 ESM indicator lights
4 Reserved for future use
5 Serial port
Chapter 1. Introduction 5
Table 2. Description of Figure 2 on page 5 (continued)
Number Description
6 SFP interface connectors
7 Enclosure ID
Rear drive channel ports
Figure 3 shows the drive channel ports on the storage expansion enclosure.
1
Figure 3. Rear view of drive channel ports
3
4 5 6
2
exp81025
4
3
5 6
Table 3. Description of Figure 3
Number Description
1 ESM A
2 ESM B
3 Port 1A
4 Port 1B
5 Port 2A (Reserved for future use)
6 Port 2B (Reserved for future use)
Power supply and fan units
The storage expansion enclosure has two removable power supply and fan units.
Each power supply and fan unit contains one power supply and two fans. The four
fans pull air through the drive from front to back across the drives.
The fans provide redundant cooling, which means that if one of the fans in either
fan housing fails, the remaining fans continue to provide sufficient cooling to
operate the storage expansion enclosure. The power supplies provide power to the
internal components by converting incoming voltage to dc voltage.
If one power supply is turned off or malfunctions, the other power supply maintains
electrical power to the storage expansion enclosure and the two fan modules in the
turned off or malfunctioned power supply-fan unit. (All four fan modules function at
all times even if one power supply and fan unit is switched off unless the fan
module malfunctions.) To preserve the optimal airflow, do not remove a failed power
supply and fan unit CRU from the EXP420 chassis until you are ready to replace it
with a new CRU.
Figure 4 on page 7 shows power supply and fan unit components.
6 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Note: Although both power supply and fan units (left and right) are identical, they
are seated in the EXP420 chassis in opposite orientations. If the power
supply and fan unit cannot fully be inserted in the power supply and fan unit
bay, flip it 180 degree and reinsert it.
1
3
4
Figure 4. Power supply and fan unit components
4
3
exp81024
2
Table 4. Description of Figure 4
Number Description
1 Power supply and fan unit A
2 Power supply and fan unit B
3 Power connector
4 Power switch
Figure 5 on page 8 shows a power supply and fan unit and the airflow through the
storage expansion enclosure.
Chapter 1. Introduction 7
Latch
Lever
Figure 5. Power supply and fan unit and airflow
Small Form-Factor Pluggable (SFP) modules
The storage expansion enclosure supports fibre optic host interface cables. Yo u
must install a Small Form-factor Pluggable (SFP) module in each interface
connector on the controller where a fibre optic cable is to be installed.
Attention: The speed of the SFP module determines the maximum operating
speed of the fibre channel port in which the SFP is installed. For example, a
2-Gbps SFP that is plugged into a 4-Gbps-capable port will limit the speed of that
port to a maximum of 2 Gbps. Carefully check the SFP’s IBM part number, option
number, and FRU part number to identify its speed. There are no physical features
that distinguish a 4 Gbps from a 2 Gbps SFP.
Figure 6 on page 9 shows an SFP module with fibre optic cable.
Note: The SFP module shown might look different from those shipped with your
storage expansion enclosure. The differences does not affect transceiver
performance.
8 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
SFP
Module
Fiber-optic
cable
Figure 6. SFP module and fibre optic cable
Software and hardware compatibility and upgrades
The latest DS4000 controller firmware and NVSRAM, drive enclosure ESM
firmware, and the fibre channel drive CRUs firmware must be installed to ensure
optimal functionality, manageability, and reliability.
Unless stated otherwise, you can find the latest DS4000 publications, firmware, and
host software at the IBM DS4000 System Storage Support Web site:
www.ibm.com/servers/storage/support/disk/
Software and firmware support code upgrades
To enable support for the EXP420, you must ensure that your system's software
and firmware are at the levels shown in Table 5:
|
|
|
Table 5. Software and firmware levels for the EXP420
Software/firmware Level
DS4000 Storage Manager
10.10
software
DS4200 Express controller
firmware and NVSRAM
06.16.86.xx or later. This controller firmware does not
support EXP100 attachment.
Note: The EXP100 is generally not supported with the
EXP420.
ESM firmware 986x or later
Drive firmware You can find the latest software and firmware at the
IBM DS4000 System Storage Support Web site:
www.ibm.com/servers/storage/support/disk/
To manage the DS4200 Express with controller firmware 06.16.86.xx installed, the
DS4000 Storage Manager version 9.16 Release 2 or later software packages are
included on the DS4000 Storage Manager host software for the appropriate OS CD
or on the IBM Support Web site.
Chapter 1. Introduction 9
You can also find the latest software and firmware at the IBM DS4000 System
Storage Support Web site:
www.ibm.com/servers/storage/support/disk/
|
|
|
|
See the IBM System Storage DS4000 Storage Manager Version 10 Installation and
Host Support Guide for your operating system for instructions that describe how to
install the DS4000 Storage Manager host software and refer to the following Web
site:
www.ibm.com/servers/storage/support/disk/
The DS4200 Express Storage Subsystem that supports EXP420 attachment is
shipped with controller firmware version 06.16.86.xx or higher.
If you need further assistance, please contact IBM technical support, your IBM
reseller, or IBM representative to find out which controller firmware to use for
EXP420 attachment.
For more information about the EXP420 ESM replacement procedure and problem
troubleshooting, please refer to “Replacing an Environmental Service Module
(ESM)” on page 94 and “Solving problems” on page 101.
EXP420 hardware and software compatibility
Table 6 lists the EXP420 hardware and software compatibility. Currently, the only
DS4000 storage subsystem that supports EXP420 attachment is the DS4200
Express Storage Subsystem. Please contact IBM resellers or representatives for
other DS4000 storage subsystem support in the future.
For the latest information about supported servers and operating systems for
Note:
the EXP420, refer to the interoperability matrix at this Web site:
www-1.ibm.com/servers/storage/disk/ds4000/interop-matrix.html
Table 6. EXP420 hardware and software compatibility
Storage server Storage management software Firmware
System Storage DS4200 Express Storage
Subsystem
IBM DS4000 Storage Manager Version
10.109.16.xx.62 or later
Controller firmware:
version 06.16.86.xx or
higher
Determining firmware levels
There are two different methods to determine the DS4000 storage subsystem and
the storage expansion enclosure firmware versions. Each method uses the DS4000
Storage Manager client that manages the DS4000 storage subsystem with the
attached storage expansion enclosure.
Method One:
Go to the Subsystem Management window and select View → Storage Subsystem
Profile. When the Storage Subsystem Profile window opens, select the All tab and
scroll through Profile For Storage Subsystem to locate the following information.
10 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Note: The Profile For Storage Subsystem window contains all the profile
information for the entire subsystem. Therefore, it may be necessary to scroll
through a large amount of information to locate the firmware version
numbers.
DS4000
Storage Server
v NVSRAM version
v Appware version
v Bootware version
Drives
v Drive firmware version
v ATA translator card firmware version (SATA E-DDMs only)
The ATA translator card firmware and drive firmware are typically
Note:
packaged together as a single drive firmware upgrade file.
ESM
v ESM card firmware version
Method
Two:
Complete the appropriate procedure to obtain the specified firmware version.
To obtain the controller firmware version:
Right-click the Controller icon in the Physical View pane of the Subsystem
Management window and select Properties . The Controller Enclosure
properties window opens and displays the properties for that controller.
You must perform this step for each individual controller.
To obtain the drive firmware version:
Right-click the Drive icon in the Physical View pane of the Subsystem
Management window and select Properties . The Drive Properties window
opens and displays the properties for that drive.
You must perform this step for each individual drive.
To obtain the ESM firmware version:
1. In the Physical View pane of the Subsystem Management window, click
the Drive Enclosure Component icon (which is the icon furthest to the
right). The Drive Enclosure Component Information window opens.
2. Click the ESM icon in the left pane. The ESM information displays in the
right pane of the Drive Enclosure Component Information window.
3. Locate the firmware version of each ESM in the drive enclosure.
obtain the drive enclosure component firmware version:
To
1. Click the Drive Enclosure Component icon (which is the right most icon)
in the Drive Enclosure frame in the Physical View pane of the
Subsystem Management window. The Drive Enclosure Component
Information window opens.
2. Click the ESM icon in the left pane. The ESM information displays in the
right pane of the Drive Enclosure Component Information window.
3. Locate the firmware version of each ESM in the drive enclosure.
must perform this step for each drive expansion enclosure.
You
Chapter 1. Introduction 11
Product updates and support notifications
Be sure to download the latest versions of the DS4000 Storage Manager host
software, DS4000 storage subsystem controller firmware, DS4000 drive expansion
enclosure ESM firmware, and drive firmware at the time of the initial installation and
when product updates become available.
Important
Keep your system up to date with the latest firmware and other product
updates by subscribing to receive support notifications.
For more information about support notifications or the My Support feature,
including instructions on how to register, see the following IBM Support Web page:
www.ibm.com/systems/support/storage/subscribe/moreinfo.html
You can also check the Stay Informed section of the IBM Disk Support Web site:
www.ibm.com/servers/storage/support/disk/index.html
Best practices guidelines
To ensure optimal operation of your system, always follow these best practices
guidelines:
v Ensure that your system is in an optimal state before you shut it down. Never
turn the power off if any Needs Attention LED is lit; be sure to resolve any error
conditions before you shut down the system.
v Back up the data on your storage drives periodically.
v To maintain power redundancy, plug the EXP420 right and left power supply and
fan units into two independent external power circuits through distribution units
inside a rack cabinet or directly into external receptacles. Similarly, the right and
left power supplies of the DS4000 storage subsystem that the EXP420 storage
expansion enclosures are attached to should be plugged into the same two
independent external power circuits as the EXP420s. This ensures that the
DS4000 storage subsystem and all its attached storage expansion enclosures
will have power in the event that only one power circuit is available. In addition,
having all the right or all the left power cables plugged into the same power
circuit enables the DS4000 devices in the configuration to power on
simultaneously during an unattended restoration of power. See Figure 35 on
page 49 for an example of redundant power connections.
Do not overload the circuits that power your storage subsystem and
Note:
storage expansion enclosures. Use additional pairs of power distribution
units (PDUs) if necessary. Refer to Table 12 on page 16 for information on
storage expansion enclosure power requirements. Contact your IBM
service representative for additional information if needed.
v Before any planned system shutdown or after any system additions, removals, or
modifications (including firmware updates, logical drive creations, storage
partitioning definitions, hardware changes, and so on), complete the following
tasks:
1. Save the storage subsystem profile.
2. Save the storage subsystem configuration.
12 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Make sure that you save the files in a location other than in the logical drives that
were created for the storage subsystem.
For more information on how to complete these tasks, check the DS4000
Storage Manager online help or the Storage Manager guide for your operating
system.
v During any maintenance or attended power-up procedure, carefully follow the
power-up sequence listed in “Powering on the EXP420” on page 55. Check that
each component of the subsystem is powered-on in the proper order during this
entire power-up procedure to ensure the controller will be able to optimally
access all of your storage subsystems.
v The storage subsystem supports simultaneous power-up to the system
components; however, you should always follow the power-up sequence listed in
“Powering on the EXP420” on page 55 during any attended power-up procedure.
v A storage system in an optimal state should recover automatically from an
unexpected shutdown and unattended simultaneous restoration of power to
system components. After power is restored, call IBM support if any of the
following conditions occur:
– The storage subsystem logical drives and subsystems are not displayed in the
DS4000 Storage Manager graphical user interface (GUI).
– The storage subsystem logical drives and subsystems do not come online.
– The storage subsystem logical drives and subsystems seem to be degraded.
Specifications
This section provides site specifications for the storage expansion enclosure. Before
installing a storage expansion enclosure, you must either verify that your planned
installation site meets these requirements, or prepare the site so that it does meet
these requirements. Preparations might involve meeting area requirements,
environmental requirements, and electrical requirements for storage expansion
enclosure installation, service, and operation.
Area requirements
The floor space at the installation site must provide enough strength to support the
weight of the storage subsystem and associated equipment; sufficient space to
install, operate, and service the storage subsystem; and sufficient ventilation to
provide a free flow of air to the unit.
Dimensions
Figure 7 on page 14 shows the dimensions of the EXP420, which conforms to the
19-inch rack standard.
Chapter 1. Introduction 13
44.70 cm (17.60 in.)
12.95 cm (5.1 in.)
48.26 cm (19.00 in.)
57.15 cm (22.5 in.)
77027-03
Figure 7. EXP420 dimensions
Weight
The total weight of the storage expansion enclosure depends on the number of
components installed. Table 7 lists the maximum, empty, and shipping weights for
the storage subsystem in different configurations. Table 8 lists the weight of each
component.
Table 7. EXP420 weights
Weight
Unit
Maximum
1
Empty
2
Shipping
EXP420 38.1 kg (84 lb) 16.4 kg (36.1 lb) 50.5 kg (111.0 lb)
1
Chassis with all CRUs and 16 drives.
2
Chassis without CRUs and drives but with front cage frame and midplane.
Table 8. EXP420 component weights
Unit Weight
Drive 0.75 kg (1.65 lb)
Power supply and fan unit 3.60 kg (7.95 lb)
ESM 1.88 kg (4.15 lb)
Shipping dimensions
Table 9 lists shipping carton dimensions. The height shown includes the height of
the pallet.
Table 9. EXP420 shipping carton dimensions
Height Width Depth
45.7 cm (18.0 in.) 62.6 cm (24.5 in.) 80.7 cm (31.75 in.)
Environmental requirements and specifications
This section describes the environmental conditions that are prerequisite to
installing the unit, and heat and sound conditions that are generated by normal
operation of the storage expansion enclosure.
14 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Temperature and humidity
Table 10 lists the acceptable temperature and humidity ranges in which the storage
subsystem is designed to operate.
Important: The recommended operating environment air temperature is 22° C (72°
F) or lower.
Table 10. Temperature and humidity requirements
Condition Parameter Requirement
Temperature Operating range 10° - 35° C (50° - 95° F)
Maximum rate of change 10° C (18° F) per hour
Storage range -10° - 65° C (14° - 149° F)
Maximum rate of change 15° C (27° F) per hour
Transit range -40° C to 65° C (-40° F to
149° F)
Maximum rate of change 20° C (36° F) per hour
Relative humidity (no
condensation)
Operating range 8% to 80%
Storage range 8% to 90%
Transit range 5% to 95%
Maximum dew point 26° C (79° F)
Maximum gradient 10% per hour
Note: Substantial deviations from the suggested temperature and humidity ranges,
in either direction, if sustained for extended periods of time, will expose the
unit to greater risk of failure from external causes.
Altitude
Table 11 lists the acceptable altitudes for operating, storing, and shipping the
EXP420.
Table 11. EXP420 altitude ranges
Environment Altitude
Operating 30.5 m (100 ft.) below sea level to 3000 m
(9842 ft.) above sea level
Storage 30.5 m (100 ft.) below sea level to 3000 m
(9842 ft.) above sea level
Transit 30.5 m (100 ft.) below sea level to 12,000 m
(40,000 ft.) above sea level
Airflow and heat dissipation
Figure 8 on page 16 shows the intended airflow for the EXP420. Allow at least 30
inches in front of the storage subsystem and at least 24 inches behind the storage
subsystem for service clearance, proper ventilation, and heat dissipation.
Chapter 1. Introduction 15
77027-02
Figure 8. EXP420 airflow
Table 12 lists the KVA, watts, and Btu calculations. These values assume the power
supplies have a 73 percent efficiency and a power factor of 0.99. These tabulated
power and heat dissipation values are typical for the storage subsystem. Maximum
configuration units are typically operated at higher data rates, have larger random
access memory (RAM) capacities, or have different host interface boards.
Table 12. EXP420 power and heat dissipation
Parameter KVA Watts (ac) Btu per hour
EXP420 0.454 443 1516
Acoustic noise
Table 13 lists the maximum sound levels emitted by the storage subsystem.
Table 13. EXP420 sound levels
Measurement Level
Sound power (normal operation) 6.5 bels
Sound pressure (normal operation) 68 dBA
These levels are measured in controlled acoustical environments according to ISO
7779 and are reported in accordance with ISO 9296. The declared sound power
levels indicate an upper limit, below which a large portion of machines operate.
Sound pressure levels in your location might exceed the average 1-meter values
stated because of room reflections and other nearby noise.
Electrical requirements
This section provides information regarding site power and wiring, storage
subsystem ac power requirements, and power cord routing instructions.
Consider the following information when preparing the installation site:
v Protective ground – Site wiring must include a protective ground connection to
the ac power source.
Note: Protective ground is also known as safety ground or chassis ground.
v Circuit overloading – Power circuits and associated circuit breakers must provide
sufficient power and overload protection. To prevent possible damage to the unit,
16 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
isolate its power source from large switching loads (such as air conditioning
motors, elevator motors, and factory loads).
v Power failures – If a total power failure occurs, the unit automatically performs a
power-up recovery sequence without operator intervention after power is
restored.
Table 14. EXP420 ac power requirements
Low Range High Range
Nominal Voltage 90 to 136 VAC 180 to 264 VAC
Frequency (Hertz) 50 to 60 Hz 50 to 60 Hz
Idle Current 3.86 A
Maximum Operating Current 4 A/4.54 A
Maximum Surge Current 5.04 A
a.
Typical voltage: 115 V AC, 60 Hz, assumes 73% power-supply efficiency and 0.99 power
a
a c
a
b
2.05 A
2.12 A/2.41 A
b
2.67 A
b c
factor
b.
Typical voltage: 230 V AC, 60 Hz, assumes 73% power-supply efficiency and 0.99 power
factor
c.
The higher number in this range applies when all of the drives are placed in Selfseek
mode.
Site wiring and power
The storage expansion enclosure uses wide-ranging redundant power supplies that
automatically accommodate voltages to the ac power source. The power supplies
operate within the range of 90 VAC to 264 VAC, at a minimum frequency of 50 Hz
and a maximum frequency of 60 Hz. The power supplies meet standard voltage
requirements for both domestic (inside USA) and international (outside USA)
operation. They use standard industrial wiring with line-to-neutral or line-to-line
power connections.
The agency ratings for the EXP420 storage expansion enclosure are 6 amps at 100
VAC and 2.5 amps at 240 VAC. These are the overall maximum operating currents
for this system.
Power recovery after ac power failure
After normal power is restored after a total ac power failure, the EXP420 storage
expansion enclosure performs power-up recovery procedures automatically without
operator intervention.
Power cords and receptacles
The EXP420 ships with two jumper cords used to connect to the rack PDU. You
must purchase the power cords that are appropriate for use in a typical outlet in the
destination country. See Appendix C, “Power cords,” on page 117 for more
information.
Heat output, airflow, and cooling
See “Airflow and heat dissipation” on page 15 for heat output, airflow, and cooling
specifications.
Note: In general, disk subsystem reliability tends to decrease as the ambient
temperature of the environment in which it is being used increases. The
ambient temperature in the immediate area of the disk enclosure unit should
be kept near 22° C (72° F), or lower, to provide better reliability.
Chapter 1. Introduction 17
When racks that contain many storage expansion enclosures are to be installed
together, the following requirements must be met to ensure that the storage
expansion enclosures are adequately cooled:
v Air enters at the front of the rack and leaves at the back. To prevent the air that
is leaving the rack from entering the intake of another piece of equipment, you
must position the racks in alternate rows, back-to-back and front-to-front. This
arrangement is known as cold aisle and hot aisle and is shown in Figure 9.
v Where racks are in rows, each rack must touch the rack that is next to it to
reduce the amount of hot air that can flow around from the back of the rack into
the intakes of the storage expansion enclosures that are in that rack. You should
use Suite Attach Kits to completely seal any gaps that remain between the racks.
For details about Suite Attach Kits, contact your marketing representative.
v Where racks are in rows front-to-front or back-to-back, a gap of at least 1220 mm
(48 in.) must separate the rows across the cold aisle.
v To ensure correct airflow in each rack, the rack filler plates must be installed in
unused positions. Also, all the gaps in the front of the racks must be sealed,
including the gaps between the storage expansion enclosures.
back
T42 racks
front
1220 mm cold
aisle width
Air
Cold aisle
front
T42 racks
back
conditioner
Hot aisle
back
T42 racks
front
Airflow
Figure 9. Example of cold aisle/hot aisle rack configuration
Perforated tiles
or gratings
2440 mm between
center lines of hot
and cold aisle
18 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Chapter 2. Installing the EXP420
This chapter provides the information that you need to prepare the storage
expansion enclosure for installation into a rack cabinet.
Before you begin the installation, review the safety information in “Safety” on page
xi.
“Installation overview” provides an overview of the storage expansion enclosure
installation process. Read this overview before you begin the installation.
Installation overview
The following sequence summarizes the installation steps you will perform in this
chapter.
1. Prepare the installation site and the rack cabinet. Unpack the EXP420 and other
hardware from the shipping box. See “Preparing for installation” on page 21.
Statement 4:
≥ 18 kg (39.7 lb) ≥ 32 kg (70.5 lb) ≥ 55 kg (121.2 lb)
CAUTION:
Use safe practices when lifting.
Attention: The EXP420 weighs up to 40 kg (88 lb). At least two other people
should help you lift the EXP420 from the shipping box. For safety reasons, IBM
strongly recommends that you open the sides of the shipping box and remove
the CRUs from the EXP420 before you lift it from the shipping box to lighten the
storage expansion enclosure before moving it from the box to its place in the
rack. See “Removing the CRUs” on page 26.
2. Install the support rails in the rack. The rails are placed on the bottom of the
shipping box underneath the storage expansion enclosure. To access the
support rails without removing the storage expansion enclosure from the
shipping box, open the sides of the shipping box. See “Installing the support
rails” on page 23.
3. If necessary, remove the CRUs from the EXP420. See “Removing the CRUs”
on page 26.
4. Record the serial number, machine type, and model number for your EXP420.
The serial number, machine type, and model number are located on the left
edge of the front unit as shown in Figure 10 on page 20.
© Copyright IBM Corp. 2006, 2007 19
Serial number
Machine type
Model number
Figure 10. Example of EXP420 serial number, machine type, and model number location
5. Install the EXP420. See “Installing the EXP420 into a rack” on page 30. If
necessary, replace the CRUs in the EXP420. See “Replacing the EXP420
CRUs” on page 32.
6. Cable the EXP420 to other EXP420s or to a DS4000 storage subsystem such
as the DS4200 Express. See Chapter 3, “Cabling the EXP420,” on page 37.
7. Install the DS4000 Storage Manager host software. See “Software and
hardware compatibility and upgrades” on page 9 for the appropriate version.
Refer to the IBM System Storage DS4000 Storage Manager Version 10
Installation and Host Support Guide for your operating system for instructions on
how to install the DS4000 Storage Manager host software.
8. Turn on the EXP420 (if you have not done so already). See “Powering on the
EXP420” on page 55.
9. Turn on the DS4000 Storage Subsystem and use the DS4000 Storage Manager
host software to verify the configuration and upgrade the controller firmware if
needed. If the controller firmware is not at the correct version, the EXP420
enclosures might be shown in the DS4000 subsystem management window with
empty drive slots and enclosure ID of 99.
ds470042
If your DS4000 storage subsystem shipped preloaded with controller
Note:
firmware 06.16.xx.xx, you do not need to upgrade the firmware, although
it is still recommended that you upgrade to the latest version of the
firmware for your specific storage subsystem model.
Handling static-sensitive devices
Attention: Static electricity can damage electronic devices and your system. To
avoid damage, keep static-sensitive devices in their static-protective packages until
you are ready to install them.
To reduce the possibility of electrostatic discharge, observe the following
precautions:
v Limit your movement. Movement can cause static electricity to build up around
you.
v Handle the device carefully, holding it by its edges or its frame.
v Do not touch solder joints, pins, or exposed printed circuitry.
v Do not leave the device where others can handle and possibly damage the
device.
v While the device is still in its static-protective package, touch it to an unpainted
metal part of the system unit for at least two seconds. This drains static electricity
from the package and from your body.
v Remove the device from its package and install it directly into your system unit
without setting it down. If it is necessary to set the device down, place it in its
static-protective package. Do not place the device on your system unit cover or
on a metal table.
20 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
v Take additional care when handling devices during cold weather because heating
reduces indoor humidity and increases static electricity.
Preparing for installation
Before installing the storage expansion enclosure, create a detailed plan of how this
unit will be used in your storage configuration. The plan should include determining
RAID levels, fallover requirements, operating systems to be used, and total storage
capacity requirements.
Complete the following steps to prepare the storage expansion enclosure for
installation into a rack cabinet.
1. Prepare the site to meet all area, environmental, power, and site requirements.
For more information, see “Specifications” on page 13.
2. Move the storage expansion enclosure to the site.
Statement 4:
≥ 18 kg (39.7 lb) ≥ 32 kg (70.5 lb) ≥ 55 kg (121.2 lb)
CAUTION:
Use safe practices when lifting.
3. Remove the storage expansion enclosure from its shipping container and check
the contents (see “Inventory checklist” on page 2). If any items are missing,
contact your IBM reseller before proceeding.
4. Verify that you have the following software:
v The correct version of the IBM DS4000 Storage Manager software. See
“EXP420 hardware and software compatibility” on page 10.
v DS4000 controller firmware that ships with the storage expansion enclosure.
You use this software to configure the storage subsystems.
Different DS4000 models may have different firmware versions.
Note:
5. Read Storage System Product Release Notes for any updated information about
hardware, software, or firmware products.
6. Continue with “Preparing the site” on page 22.
Tools and hardware required
Gather the tools and equipment you will need for installation. These might include:
v The rack power jumper cords that are shipped with the storage expansion
enclosure
v Number 2 Phillips screwdriver
v 5/16 (8 mm) hex nut driver
Chapter 2. Installing the EXP420 21
v Antistatic protection (such as a grounding wrist strap)
v Fibre Channel (FC) and Ethernet interface cables and cable straps
v SFP modules
v Rack-mounting hardware that ships with the storage expansion enclosure
Preparing the site
This section lists the floor space requirements and weight information for the
storage expansion enclosure. For information on interface cables and connections,
see Chapter 3, “Cabling the EXP420,” on page 37.
Floor space: The floor area at the installation site must provide the following
conditions:
v Enough stability to support the weight of the fully configured storage expansion
v Sufficient space to install the storage expansion enclosure
enclosure and associated systems
Weight:
fibre channel hard disk drives that are installed. A fully configured storage
expansion enclosure with two power supply and fan units, two ESMs, and up to 16
fibre channel hard disk drives installed weighs 40 kg (88 lbs).
Other : Consider these important preparation activities:
v Install uninterruptible power supply (UPS) devices.
v Install host bus adapters (HBAs), switches, or other devices, if applicable.
v Route interface cables from the hosts or switches to the installation area.
v Route main power cords to the installation area.
Continue with “Preparing the rack.”
Preparing the rack
Important: Before you install the storage expansion enclosure in a rack, keep in
mind the following considerations:
v Review the documentation that comes with your rack enclosure for safety and
cabling considerations.
v Install the storage expansion enclosure in a maximum 35° C (95° F)
environment.
v To ensure proper airflow, do not block the air vents; 15 cm (6 in.) of air space is
sufficient.
v To ensure rack stability, load the rack starting at the bottom.
v If you install multiple components in the rack, do not overload the power outlets.
v Always connect the storage expansion enclosure to a properly grounded outlet.
The storage expansion enclosure total weight depends on the number of
Complete
the following steps to prepare the rack before you install the storage
expansion enclosure:
1. Move, unpack, and level the rack at the installation site (if needed).
2. Remove the external rack panels.
3. If necessary, stop all I/O activity to the devices in the rack.
4. If necessary, turn off all drive enclosure and rack power. Disconnect existing
power, network, and other external cables.
5. Install any additional interface cables and power cables.
22 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
After you have completed these steps, continue with “Installing the EXP420” on
page 26.
Installing the support rails
Attention: Duplicate copies of the rack mounting templates are provided in
Appendix B, “Rack mounting template,” on page 113. If you want to tear out the
templates from this document for easier use, use the copies in Appendix B, “Rack
mounting template,” on page 11 3 rather than the copies provided in this section.
Use the following templates (Figure 11 and Figure 12 on page 24) to identify the
proper locations for inserting M5 screws when mounting the support rails and
EXP420 to a rack. The locations for the M5 screws are highlighted in the templates.
The EXP420 is 3 U high. Align the template with the rack at a U boundary. U
boundaries are shown as horizontal dashed lines in the rack mounting templates.
Note: The mounting holes that are shown in the following templates are square.
The holes in your rack might be round, square, or threaded.
3U
3U
EXP420
Install second --->
Install first ---> <--- Install first
2U
Install first --->
1U
Install second --->
0U
Bezel
(Front Left)
Rail assembly
(Front Left)
FRONT
Rack Mounting
Template
Bezel
(Front Right)
Rail assembly
(Front Right)
<--- Install first
exp42006
2U
1U
0U
Figure 11 . Front rack mounting template
Chapter 2. Installing the EXP420 23
3U
2U
1U
Rail mounting guide
Rail assembly
(Rear Left)
3U
EXP420
REAR
Rack Mounting
Template
2U
1U
Rail assembly
(Rear right)
®
0U
Printed in the U.S.A
0U
exp42007
Figure 12. Rear rack mounting template
Before installing the EXP420 in a rack, you must install the rails and rack-mounting
hardware that come with your storage expansion enclosure. The EXP420 requires
an Electronic Industries Association (EIA) 310-D Type A 19-inch rack cabinet. The
distance between EIA rails, from the front to the rear of the rack, is 60.96 cm (24
in.) minimum and 81.28 cm (32 in.) maximum. This rack conforms to the EIA
standard. Where you place the support rails in the rack depends on where you
intend to position the storage expansion enclosure.
Complete the following steps to install the support rails:
Note: Refer to Figure 13 on page 26 while performing these steps.
1. Ensure that the rack has already been installed.
2. Ensure that a stabilizer has been correctly attached to the bottom front of the
rack to prevent the rack from tipping forward while the EXP420 is being
installed.
Refer to the installation and service guide, or equivalent, for the rack as
required.
3. Locate the two support rails, eight of the twelve M5 screws, and eight washers
that are supplied with the EXP420.
24 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Note: The M5 screws and washers may already be attached to the support
rails. If so, remove them from the support rails.
4. The rack-mounted unit is three EIA units high. Decide accordingly where you
are going to install the support rails.
Attention: Use the rack mounting template provided in Figure 11 on page 23
and Figure 12 on page 24 to locate the proper rack mounting holes for
installing the support rails into the rack.
Note the following considerations before you choose where to install the rails:
v If you are installing the EXP420 into an empty rack, install it into the lowest
available position so that the rack does not become unstable.
v If you are installing more than one EXP420 in the rack, start at the lowest
available position, and work upward.
v If appropriate, allow for possible later installation of other units.
v If necessary, remove the rack power distribution unit before you install the
support rails.
v For procedures and more information, refer to the installation and service
guide, or equivalent, for the rack.
5. Using a #2 Phillips screwdriver, loosen the two screws on the left support rail
that hold the two parts of the rail together (5 ).
The support rails are not marked as Left or Right. However, each rail
Note:
can be correctly mounted on only one side of the rack cabinet. The rails
should be mounted with the alignment pins at the back of the rack.
Figure 13 on page 26 shows the installation of the left support rail.
6. Hold the back of the rail against the inside of the rack-mounting flange. Make
sure the rail mounting guide pins are in the correct holes. See Figure 12 on
page 24 for illustration.
7. Using the 5/16 (8 mm) hex nut driver, securely tighten the two M5 screws
(2 ).
Make sure you use a washer when installing an M5 screw through a
Note:
square hole on the rack-mounting flange.
8. Extend the rail to the front of the rack until it makes contact with the front
rack-mounting flange (3 ).
9. Securely tighten the two M5 screws (1 ).
Be sure to install the screws labeled install first in Figure 11 on page 23.
Note:
10. Securely tighten the two screws on the left support rail that hold the two parts
of the rail together (5 ).
11. Repeat step 5 through step 10 for the right support rail.
Because the mounting holes on the rack are not always the same size
Note:
as the mounting screws, the lip (6 ) of each of the support rails may
not line up evenly. Make minor adjustments as needed to ensure that
the lip of the left and right support rails are lined up evenly on the racks.
Failure to do so will cause the storage expansion enclosure to fit
unevenly in the rack.
Chapter 2. Installing the EXP420 25
Figure 13. Installing the support rails
12. Continue with “Removing the CRUs.”
Installing the EXP420
This section provides instructions on installing the EXP420. The installation process
includes:
v “Removing the CRUs”
v “Installing the EXP420 into a rack” on page 30
v “Replacing the EXP420 CRUs” on page 32
1
3
4
5
2
2
6
Rear of Rack
Removing the CRUs
This section describes how to remove the CRUs in order to minimize the weight of
the EXP420 before you install it in the rack. However, if you have three or more
people available to lift and install the EXP420 in a rack, you might not find it
necessary to remove the CRUs before you install the EXP420. If this is the case,
you can skip the CRU removal instructions provided in this section. Instead,
continue with “Installing the EXP420 into a rack” on page 30, and then skip the
CRU replacement instructions provided in “Replacing the EXP420 CRUs” on page
32.
Use the following procedures to remove the CRUs from the EXP420 before
installation. Use these instructions after you have completed all applicable site,
rack, and EXP420 preparations (as discussed in “Preparing for installation” on page
21) and installed the support rails (as discussed in “Installing the support rails” on
page 23). Alternately, if necessary, you can use these instructions to lighten the
EXP420 before removing it from the shipping box. The shipping box opens to
provide access to the storage expansion enclosure CRUs.
The EXP420 comes with a rack-mounting hardware kit for installing it in a rack. It is
easier to lift the EXP420 and install it in a rack cabinet if you remove all the CRUs
first. Yo u will need an antistatic wrist strap and a cart or level surface (to hold the
CRUs). Observe the precautions listed in “Handling static-sensitive devices” on
26 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
page 20
page 20. In the following procedure, you will remove the following CRUs from the
storage expansion enclosure before you install it in the rack:
v ESMs
v Power supply and fan units
v Hot-swap EV-DDMs
do not need to remove the blank trays.
You
Statement 4:
≥ 18 kg (39.7 lb) ≥ 32 kg (70.5 lb) ≥ 55 kg (121.2 lb)
CAUTION:
Use safe practices when lifting.
Attention: The storage expansion enclosure comes with a bezel that is attached
to the front of the unit. The bezel protects the light pipes that are located above the
drive trays. Leave the protective bezel in place until you are instructed to remove it.
Removing an ESM
Complete the following steps to remove an ESM:
Attention: After you remove an ESM, wait 70 seconds before reseating or
replacing the ESM. Failure to do so may cause undesired events.
1. Squeeze the ESM latch and pull the lever open 90° (so that the lever is
horizontal) to release the ESM from the latch. The ESM latch is a coral colored
tab on the lever.
The lever rotates upward or downward 90°, depending on whether the
Note:
ESM you are removing is the right or left ESM CRU.
2. Slowly pull the lever away from the chassis to remove the ESM from the bay, as
shown in Figure 14 on page 28.
Chapter 2. Installing the EXP420 27
Notch
Guide pin
Lever
Figure 14. Removing and replacing an Environmental Service Module (ESM)
3. Place the ESM on a level surface.
4. Repeat step 1 on page 27 through step 3 for the second ESM.
Removing a power supply and fan unit
Statement 5:
CAUTION:
The power control button on the device and the power switch on the power
supply do not turn off the electrical current supplied to the device. The device
also might have more than one power cord. To remove all electrical current
from the device, ensure that all power cords are disconnected from the power
source.
2
1
CAUTION:
Disconnect the power cord before removing the power supply and fan unit.
Complete the following steps to remove a power supply and fan unit:
1. Squeeze the latch and pull the lever open 90° (so that the lever is horizontal) to
release the power supply and fan unit from the latch. The latch is a coral
colored tab on the lever.
28 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
2. Slowly pull the lever away from the chassis to remove the power supply and fan
unit, as shown in Figure 15.
Note: The lever rotates upward or downward 90°, depending on whether the
power supply and fan unit you are removing is in the left or right power
supply and fan unit bay.
Lever
Figure 15. Removing a power supply and fan unit
3. Place the power supply and fan unit on a level surface.
4. Repeat step 1 on page 28 through step 3 for the second power supply and fan
unit.
Removing an EV-DDM
Complete the following steps to remove a hot-swap EV-DDM:
Note: The EV-DDM comes installed in a drive tray. Do not attempt to detach the
EV-DDM from the tray.
Attention: After you remove a EV-DDM CRU, wait 70 seconds before replacing
or reseating it to allow it to properly spin down. Failure to do so may cause
undesired events.
1. Use Table 27 on page 112 to record the location and identify your EV-DDMs.
You must record this information to be able to replace the EV-DDMs in their
original order before they were removed.
2. Release the latch on the EV-DDM CRU by pressing on the inside of the bottom
of the tray handle.
3. Lift the closed latch to its open position. (The latch is at a 90° angle to the front
of the drive when open.)
4. Pull the EV-DDM out of the bay, as shown in Figure 16 on page 30.
Chapter 2. Installing the EXP420 29
exp80018
Figure 16. Removing a EV-DDM CRU
5. Place the EV-DDM CRU horizontally on a level surface.
Attention: Do not stack EV-DDM CRUs on top of one another. Protect the
EV-DDM CRUs from vibrations or sudden shocks.
6. Repeat step 1 on page 29 through step 4 on page 29 for additional EV-DDM
CRUs.
Continue with “Installing the EXP420 into a rack.”
Installing the EXP420 into a rack
Complete the following steps to install the EXP420 in the rack.
CAUTION:
Do not install modules or other equipment in the top half of a rackmount
cabinet while the bottom half is empty. Doing so can cause the cabinet to
become top-heavy and tip over. Always install hardware in the lowest
available position in the cabinet.
Statement 4:
≥ 18 kg (39.7 lb) ≥ 32 kg (70.5 lb) ≥ 55 kg (121.2 lb)
CAUTION:
Use safe practices when lifting.
30 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
1. Put on antistatic protection, and keep it on while performing all of the remaining
procedures in this chapter.
2. Remove the four screws from the rails (two screws in each rail). See 4 in
Figure 13 on page 26. If you do not remove these screws, the storage
expansion enclosure will not fit securely.
3. Place the storage expansion enclosure in the rack.
Note: If you have removed the CRUs from the EXP420, you should be able to
lift the unit into the cabinet with the help of one other person. If you have
not removed the CRUs before the installation, you should have at least
two other people available to help you lift the unit into the rack.
a. Move the storage expansion enclosure to the front of the rackmount cabinet.
b. With help from another person, place the back of the storage expansion
enclosure on the support rails, and then slide the unit into the rack as shown
in Figure 17.
Front of Rack
Figure 17. Installing the EXP420
4. Secure the storage expansion enclosure. Figure 18 on page 32 shows how to
secure the storage expansion enclosure to the rack.
a. Align the front mounting holes on each side of the storage expansion
enclosure with the mounting holes on the front of the support rails.
b. Using the screws that you removed in step 2, secure the sides in the back
of the EXP420 storage expansion enclosure to the rack rails.
c. Secure the front of the storage expansion enclosure using the four M5
screws as shown in Figure 18 on page 32.
Chapter 2. Installing the EXP420 31
Figure 18. Securing the storage expansion enclosure to the rack
5. Continue with one of the following actions:
v If you did remove the EXP420 CRUs before installation (as described in
“Removing the CRUs” on page 26), continue with “Replacing the EXP420
CRUs.”
v If you did not find it necessary to remove the EXP420 CRUs before
installation, continue with “Cabling the EXP420” on page 38.
Replacing the EXP420 CRUs
Use the following procedures to replace the CRUs in the EXP420 after the EXP420
is installed successfully in a rack.
Replacing an ESM
Complete the following steps to replace the ESM that you removed before the
installation:
Attention: After you remove an ESM, wait 70 seconds before reseating or
replacing the ESM. Failure to do so may cause undesired events. The left and right
ESMs are seated in the EXP420 chassis in opposite orientations. If you cannot fully
insert the ESM into the ESM bay, flip it 180° and reinsert it.
1. Slide one ESM into the empty slot in the storage expansion enclosure. Be sure
that the lever is pulled straight out as you slide the ESM in, as shown in
Figure 19 on page 33.
32 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Notch
Guide pin
Lever
Figure 19. Removing and replacing an Environmental Service Module (ESM)
2. As you slide the ESM into the empty slot, make sure the guide pins on the side
of the ESM fit into the notches. After the guide pins fit into the notches and ESM
fits snugly into the bay, push the lever downward or upward 90°, depending on
whether the ESM is inserted in the A or B ESM bay to fully latch it into place.
Attention: Make sure that the levers lock into place in the storage expansion
enclosure chassis.
3. Repeat step 1 on page 32 and step 2 to replace the second ESM.
Replacing a power supply and fan unit
Statement 5:
CAUTION:
The power control button on the device and the power switch on the power
supply do not turn off the electrical current supplied to the device. The device
also might have more than one power cord. To remove all electrical current
from the device, ensure that all power cords are disconnected from the power
source.
2
1
CAUTION:
Disconnect the power cord before replacing the power supply and fan unit.
Chapter 2. Installing the EXP420 33
Complete the following steps to replace the power supply and fan units that you
removed before the installation:
1. Slide one power supply and fan unit into the storage expansion enclosure. Be
sure to replace the power supply and fan units so that the lever on each power
supply and fan unit opens toward the interior of the storage expansion
enclosure, as shown in Figure 48 on page 93.
Attention: Be sure that the lever is pulled straight out as you slide the power
supply and fan unit into the storage expansion enclosure, as shown in
Figure 20. The left and right power supply and fan units are seated in the
EXP420 chassis in opposite orientations. If you cannot fully insert the power
supply and fan unit into the power supply and fan unit bay, flip it 180° and
reinsert it.
Lever
Figure 20. Replacing a power supply and fan unit
2. As you slide the power supply and fan unit into the empty slot, make sure the
guide pins on the side of the power supply and fan unit fit into the notches
along the sides of the power supply and fan unit bay. After the guide pins fit into
the notches and power supply and fan unit fits snugly into the slot, push the
lever upward or downward 90° depending on whether the power supply fan is
inserted in the left or right bay to fully latch it into place. Then gently push the
front of the power supply and fan unit to ensure that it is fully seated.
3. Repeat step 1 and step 2 to replace the second power supply and fan unit.
Replacing an EV-DDM
Complete the following steps to replace the hot-swap EV-DDMs that you removed
before the installation.
Attention: After you remove a EV-DDM CRU, wait 70 seconds before replacing
or reseating it to allow it to properly spin down. Failure to do so may cause
undesired events.
Use Table 27 on page 112 to verify the proper replacement locations of your
Note:
EV-DDMs.
1. Lift up on the handle and gently push the EV-DDM CRU into the empty bay until
the hinge of the tray handle latches beneath the storage expansion enclosure
bezel, as show in Figure 21 on page 35.
34 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
exp80018
Figure 21. Replacing an EV-DDM
2. Push the tray handle down until the latch clicks into place.
3. Repeat step 1 on page 34 and step 2 to replace additional EV-DDMs.
Chapter 2. Installing the EXP420 35
36 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Chapter 3. Cabling the EXP420
After the storage expansion enclosure is installed in its permanent location, you
must cable it to hosts and other storage devices, depending on your hardware
configuration.
This chapter addresses the following cabling and configuration topics:
v “Enclosure ID settings ”
v “Fibre-channel loop and ID settings” on page 38
v “Cabling the EXP420” on page 38
v “Installing SFP modules” on page 39
v “Removing SFP modules” on page 41
v “Handling fibre-optic cables” on page 42
v “Using LC-LC fibre-channel cables” on page 43
v “Cabling the EXP420 to a storage subsystem” on page 46
v “EXP420 loop redundancy” on page 48
v “Cabling the power supply” on page 52
Enclosure ID settings
The enclosure ID, comprised of a pair of seven-segment numbers (referred to x10
and x1 digits), is located on the back of each ESM next to the indicator lights. It
provides a unique identifier for each module in the storage subsystem. Each
storage expansion enclosure (including the DS4000 storage subsystems with
internal drive slots) in the DS4000 storage subsystem configuration must have a
unique storage enclosure ID in the DS4000 subsystem configuration. In addition,
the single digits (x1) of the Enclosure IDs of all enclosures (including the DS4000
storage subsystems with internal drive slots) in the redundant drive channel/loop
pair must be unique.
The DS4000 controller firmware and storage expansion enclosure ESM
automatically set the enclosure ID number. You can change the setting through the
storage management software if necessary. Both ESM enclosure ID numbers are
identical under normal operating conditions.
The allowable ranges for enclosure ID settings are 0-99. However, IBM
recommends that you do not set the enclosure ID to 00 or any number greater than
80 because DS4000 storage subsystem enclosure IDs are set in this range. In
addition, you must ensure that the single-digit (x1) of the enclosure ID for every
enclosure in a redundant drive loop pair is unique. (This also includes any storage
subsystem that has drives installed.)
Figure 22 on page 38 shows the enclosure ID.
© Copyright IBM Corp. 2006, 2007 37
Figure 22. Storage expansion enclosure seven-segment enclosure ID
Fibre-channel loop and ID settings
When you install a hard disk drive in the storage expansion enclosure, the drive
tray plugs into a printed circuit board called the midplane . The midplane sets the
fibre-channel loop ID automatically, based on the enclosure ID switch setting and
the physical location (bay) of the hard disk drive.
Cabling the EXP420
The storage expansion enclosure supports two redundant drive loops. A redundant
storage expansion enclosure drive loop consists of one or more storage expansion
enclosures that are connected to a storage subsystem using two sets of
fibre-channel cables. If one fibre-channel drive loop fails, the storage subsystem
uses the other drive loop to maintain input/output (I/O) to the storage expansion
enclosure drives. Usually, there are two redundant array of independent disks
(RAID) controllers in a storage subsystem. Use the Installation, User's and
Maintenance Guide or System Storage Quick Start Guide that ships with your
storage subsystem for the specific information about cabling the storage expansion
enclosure to a storage subsystem. Before cabling the storage expansion enclosure,
read the following information:
v Fibre-channel loop/channel: A fibre-channel loop (or fibre channel drive channel
as it is called in certain DS4000 storage subsystem documentation) consists of
drive expansion enclosures that are connected to each other and to one or more
RAID controllers. A loop/drive channel can support multiple RAID controllers,
multiple drive expansion enclosures, and other addressable entities such as
system-management logic chips. Refer to your storage subsystem documentation
for information about controller-dependent hardware configuration. Some
controllers might have restrictions on the maximum number of disk drives that
can be supported on a loop, cabling restrictions, and other requirements.
v SFP module ports: The storage expansion enclosure supports large, complex,
and redundant disk drive loop configurations. Each ESM has two SFP module
ports. Each SFP module has an input and output port. A loop is created by
connecting one or more storage expansion enclosures to one or more RAID
controllers.
v Fibre-channel cable restrictions: RAID controllers use specific IBM
fibre-channel options. Refer to the IBM System Storage DS4000 Hardware
Maintenance Manual, Problem Determination Guide, or your IBM representatives
or resellers for the cable option that is required for your configuration.
38 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
v Power cabling: The storage expansion enclosure uses two standard power
cables. Yo u can connect the power cables to a primary power unit inside the
rack, such as a properly grounded ac distribution unit or uninterruptible power
supply. You can also connect the power cable to an external source, such as a
properly grounded electrical outlet.
To ensure maximum availability of power to your storage expansion
Note:
enclosure, do not connect both the left and right power supplies to the
same power circuit or power source.
Installing SFP modules
The storage expansion enclosure requires SFP modules. SFP modules convert
electrical signals to optical signals that are required for fibre channel transmission to
and from RAID controllers. After you install the SFP modules, you use fibre-optic
cables to connect the storage expansion enclosure to a DS4000 storage subsystem
or other storage expansion enclosures.
Before installing SFP modules and fibre-optic cables, read the following information:
v Do not mix long-wave SFPs and short-wave SFPs on a single storage
subsystem. Use either long-wave SFPs or short-wave SFPs. You can use the
DS4000 Storage Manager client to view the Storage Subsystem Profile in order
to verify that you are not mixing long-wave and short-wave SFPs.
Attention: In addition, do not use long-wave SFPs or GBICs in any of the FC
ports in the FC drive loops. (Long-wave SFPs and GBICs are not supported for
use in the drive ports of storage expansion enclosures. Long-wave SFPs and
GBICs are only supported in the host ports of the DS4000 storage subsystem.)
v The SFP module housing has an integral guide key that is designed to prevent
you from inserting the SFP module improperly.
v Use minimal pressure when inserting an SFP module into an SFP port. Forcing
the SFP module into a port could cause damage to the SFP module or to the
port.
v You can insert or remove the SFP module while the port is powered on.
v The operational or redundant loop performance is not affected when you install
or remove an SFP module.
v You must insert the SFP module into a port before you connect the fibre-optic
cable.
v You must remove the fibre-optic cable from the SFP module before you remove
the SFP module from the port. Refer to “Removing SFP modules” on page 41 for
more information.
v The speed of the SFP module determines the maximum operating speed of the
fibre channel port in which the SFP is installed. For example, a 2-Gbps SFP that
is plugged into a 4-Gbps-capable port will limit the speed of that port to a
maximum of 2 Gbps.
Attention: Carefully check the SFP's IBM part number, option number, and
FRU part number to identify its speed. There are no physical features that
distinguish a 4 Gbps from a 2 Gbps SFP.
Statement 3:
Chapter 3. Cabling the EXP420 39
CAUTION:
When laser products (such as CD-ROMs, DVD drives, fibre optic devices, or
transmitters) are installed, note the following:
v Do not remove the covers. Removing the covers of the laser product could
result in exposure to hazardous laser radiation. There are no serviceable
parts inside the device.
v Use of controls or adjustments or performance of procedures other than
those specified herein might result in hazardous radiation exposure.
DANGER
Some laser products contain an embedded Class 3A or Class 3B laser
diode. Note the following.
Laser radiation when open. Do not stare into the beam, do not view directly
with optical instruments, and avoid direct exposure to the beam.
Attention: When you handle static-sensitive devices, take precautions to avoid
damage from static electricity. For details about handling static-sensitive devices,
see “Handling static-sensitive devices” on page 20.
Complete the following steps to install an SFP module:
1. Remove the SFP module from its static-protective package.
2. Remove the protective cap from the SFP module, as shown in Figure 23. Save
the protective cap for future use.
Plastic tab
Protective cap
SFP module
Figure 23. SFP module and protective cap
3. Remove the protective cap from the SFP port. Save the protective cap for future
use.
4. Insert the SFP module into the host port until it clicks into place. See Figure 24
on page 41.
40 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Protective cap
Figure 24. Installing an SFP module into the host port
5. Connect an LC-LC fibre-channel cable. For information about the LC-LC cable,
see “Using LC-LC fibre-channel cables” on page 43.
Removing SFP modules
Complete the following steps to remove the SFP module from the host port:
Attention: To avoid damage to the cable or to the SFP module, make sure that
you unplug the LC-LC fibre-channel cable before you remove the SFP module.
1. Remove the LC-LC fibre-channel cable from the SFP module. For more
information, see “Handling fibre-optic cables” on page 42.
2. Unlock the SFP module latch:
v For SFP modules that contain plastic tabs, unlock the SFP module latch by
pulling the plastic tab outward 10°, as shown in Figure 25.
Plastic tab
SFP module
Plastic tab
Protective cap
o
10
SFP module
Figure 25. Unlocking the SFP module latch - plastic variety
v For SFP modules that contain wire tabs, unlock the SFP module latch by
pulling the wire latch outward 90°, as shown in Figure 26 on page 42.
Chapter 3. Cabling the EXP420 41
Protective
cap
Wire
tab
90
Figure 26. Unlocking the SFP module latch - wire variety
3. With the SFP latch in the unlocked position, extract the SFP module.
v For SFP modules that contain plastic tabs, slide the SFP module out of the
port.
v For SFP modules that contain wire tabs, grasp the wire latch and pull the
SFP module out of the mini-hub port.
Replace the protective cap on the SFP module.
4.
5. Place the SFP module into a static-protective package.
6. Replace the protective cap on the host port.
Handling fibre-optic cables
o
SFP
module
Attention: To avoid damage to your fibre-optic cables, follow these guidelines:
v For devices on slide rails, leave enough slack in the cables so they do not bend
to a diameter of less than 76 mm (3 in.), or a radius less than 38 mm (1.5 in.),
when extended or become pinched when retracted.
v Do not overtighten the cable straps or bend the cables to a diameter of less than
76 mm (3 in.), or a radius less than 38 mm (1.5 in.).
v When storing excess or unused fibre-optic cables, do not bend the cables to a
diameter of less than 76 mm (3 in.), or a radius less than 38 mm (1.5 in.) or wrap
them around themselves. See Figure 27 on page 43.
v Loop diameter of 76 mm (3 in.) and bend radius of 38 mm (1.5 in.) for fibre optic
cable are IBM DS4000 recommended minimums. Loops or bends smaller than
this recommendation may cause damage to your fibre optic cables. It is best
practice to use loop diameters and bend radii that are greater than these
recommended minimums.
v Do not route the cable along a folding cable-management arm.
v Route the cable away from places where it can be damaged by other devices in
the rack cabinet.
v Do not put excess weight on the cable at the connection point. Be sure that the
cable is well supported.
v Do not use plastic cable ties in place of the provided cable straps.
v The following are the supported maximum cable lengths:
– 1 Gbps: 500 meters 50/125 um fibre, 300 meters 62.5/125 um fibre
– 2 Gbps: 300 meters 50/125 um fibre, 150 meters 62.5/125 um fibre
– 4 Gbps: 150 meters 50/125 um fibre, 70 meters 62.5/125 um fibre
42 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
ds470104
1.5 inch
(38 mm)
radius
3.0 inch
(76 mm)
diameter
Figure 27. Recommended bending and looping specifications for fibre-optic cables
Using LC-LC fibre-channel cables
The LC-LC fibre-channel cable is a fibre-optic cable that you use to connect into
one of the following devices:
v An SFP module installed in an IBM storage expansion enclosure
v An SFP module installed in a DS4200 Express, DS4300, DS4500, DS4700, or
DS4800 storage subsystem
Figure 28 for an illustration of the LC-LC fibre-channel cable.
See
For more information about cabling these devices, see the documentation that
comes with the LC-LC fibre-channel cable.
Figure 28. LC-LC fibre-channel cable
Chapter 3. Cabling the EXP420 43
Connecting an LC-LC cable to an SFP module
Complete the following steps to connect an LC-LC fibre-channel cable to an SFP
module:
Statement 3:
CAUTION:
When laser products (such as CD-ROMs, DVD drives, fibre optic devices, or
transmitters) are installed, note the following:
v Do not remove the covers. Removing the covers of the laser product could
result in exposure to hazardous laser radiation. There are no serviceable
parts inside the device.
v Use of controls or adjustments or performance of procedures other than
those specified herein might result in hazardous radiation exposure.
DANGER
Some laser products contain an embedded Class 3A or Class 3B laser
diode. Note the following.
Laser radiation when open. Do not stare into the beam, do not view directly
with optical instruments, and avoid direct exposure to the beam.
1. Read the information in “Handling fibre-optic cables” on page 42.
2. If necessary, remove the protective cap from the SFP module, as shown in
Figure 23 on page 40. Save the protective cap for future use.
3. Remove the two protective caps from one end of the LC-LC cable, as shown in
Figure 29. Save the protective caps for future use.
Fibre-optic
cable
Protective cap
Figure 29. Removing fibre-optic cable protective caps
4. Carefully insert this end of the LC-LC cable into an SFP module that is installed
in the EXP420. The cable connector is keyed to ensure it is inserted into the
SFP module correctly. Holding the connector, push in the cable until it clicks into
44 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
place, as shown in Figure 30.
Figure 30. Inserting an LC-LC fibre-channel cable into an SFP module
5. Remove the two protective caps from the other end of the LC-LC cable. Save
the protective caps for future use.
6. Connect this end of the LC-LC cable to one of the following devices:
v An SFP module that is installed in a separate EXP420
v An SFP module that is installed in a DS4300 or DS4500
Removing an LC-LC fibre-channel cable
Complete the following steps to remove an LC-LC fibre-channel cable:
Attention: To avoid damaging the LC-LC cable or SFP module, make sure that
you observe the following precautions:
v Press and hold the lever to release the latches before you remove the cable from
the SFP module.
v Ensure that the levers are in the released position when you remove the cable.
v Do not grasp the SFP module plastic tab when you remove the cable.
On the end of the LC-LC cable that connects into the SFP module or host bus
1.
adapter, press down and hold the lever to release the latches, as shown in
Figure 31.
Lever
Latches
31. LC-LC fibre-channel cable lever and latches
Figure
2. Carefully pull on the connector to remove the cable from the SFP module, as
shown in Figure 32 on page 46.
Chapter 3. Cabling the EXP420 45
Figure 32. Removing the LC-LC fibre-channel cable
3. Replace the protective caps on the cable ends.
4. Replace the protective cap on the SFP module.
Cabling the EXP420 to a storage subsystem
In this release, you can cable the EXP420 storage expansion enclosure to a
DS4200 Express Storage Subsystem only.
Note: Connections to other storage subsystems might be supported in the future.
To verify your storage subsystems compatibility with the EXP420, check the
Installation, User's, and Maintenance Guide for your storage subsystem and
the IBM DS4000 storage system support Web site: www.ibm.com/servers/
storage/support/disk/
For cabling topologies and specific cabling schemes for the EXP420 and the
DS4200 Express Storage Subsystem, see the IBM System Storage DS4200
Storage Subsystem Installation, User's, and Maintenance Guide .
Complete the following steps to cable the EXP420 to a supported DS4000 storage
subsystem:
1. Install an SFP module in the drive mini hub port on the back of the storage
subsystem.
2. Connect an LC-LC fibre-optic cable into the SFP module, as shown in Figure 33
on page 47.
46 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Attention:
v In a DS4200 Express Storage Subsystem environment, no more than six
EXP420 storage expansion enclosures can be connected to the two ports of
a dual-ported drive channel because of the internal drive slots in the DS4200
Express Storage Subsystem. Failure to observe this limitation might result in
loss of data availability.
v Do not connect more than four EXP420 storage expansion enclosures to
each port of a dual-ported drive channel in the DS4000 storage subsystem
controller.
v It is recommended that you add storage expansion enclosures to the DS4200
Express drive ports in a round-robin fashion. For example, if you have four
EXP420s to be cabled to the DS4200 Express, instead of cabling all four
EXP420s to one drive port of a drive channel, distribute the enclosures to all
drive ports, which results in two enclosures per drive port of a drive channel.
v The controller drive ports of the DS4000 storage subsystem controllers
must always be connected to the ports labeled 1B in both right and left
ESMs of the EXP420s in the redundant drive channel/loop pair that is
connected to the DS4000 storage subsystem. (Figure 35 on page 49
shows the location of the ports.)
v Refer to the IBM System Storage DS4000 Hard Drive and Storage Expansion
Enclosure Installation and Migration Guide and the IBM System Storage
Subsystem Installation, User's, and Maintenance Guide of your particular
DS4000 storage subsystem for any special cabling requirements.
Figure 33 is for illustrative purposes only. The actual SFP module on your
Note:
particular DS4000 storage subsystem might appear differently than the
one shown in the figure.
exp42008
Figure 33. Installing an SFP module and LC-LC cable in a supported DS4000 storage
subsystem
3. Install an SFP module in the SFP port on the back of the EXP420; then,
connect the other end of the LC-LC cable into the SFP module, as shown in
Figure 34 on page 48.
Chapter 3. Cabling the EXP420 47
Note: Figure 34 is for illustrative purposes only. The actual SFP module on your
particular DS4000 storage expansion enclosure might appear differently
than the one shown in the figure.
SFP
module
Fiber-optic
cable
exp81012
Figure 34. Installing an SFP module and connecting an LC-LC cable to the EXP420
EXP420 loop redundancy
Note: The term drive loop or drive loop pair used in this publication might be
referred to as a drive channel or drive channel pair in other DS4000 Storage
Subsystem publications. The terms have identical meanings.
The EXP420 provides redundant loop support when the second ESM is configured,
and when both loops (called A and B) are connected to a DS4000 that supports
redundant loops. If a cable or SFP module fails on drive loop A, drive loop B
provides redundancy, which is an alternate path to your disk drives.
Notes:
1. The EXP420 supports S ATA EV-DDMs.
2. You cannot mix storage expansion enclosures with different speed settings in
the same drive loop.
Example of a correct redundant drive loop
Figure 35 on page 49 shows a redundant drive loop that you might create with a
DS4200 Express Storage Subsystem and four EXP420s. The numbers provided in
Figure 35 on page 49 show the order in which cables should be attached. Note
that the controller port is connected to the port labeled 1B on both the right
and left ESMs.
Note: For specific information about cabling a storage expansion enclosure to a
DS4000 storage subsystem, see the appropriate DS4000 Installation, User's,
and Maintenance Guide.
48 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
EXP420
EXP420
EXP420
Drive Loop A
2A
2B
36
2A
2B
36
2A
2B
36
1
1A
1B
1B
1A
1B
1B
2
1A
3
1A
1A
8
1B
7
2A
2A
5
Drive Loop B
63
2B
63
2B
2A
63
2B
1B
1A
4
6
EXP420
2B
2A
36
1B
1A
1A
1B
2A
63
2B
exp42004
Figure 35. Correct EXP420 redundant drive loop configuration
To create drive loop A (of the DS4200 Express redundant drive loop) shown in
Figure 35, you would perform the following steps:
1. Make a fibre-channel connection from the DS4200 Express Storage Subsystem
to port 1B of the first storage expansion enclosure (connection 1 ).
Chapter 3. Cabling the EXP420 49
2. Make a fibre-channel connection from port 1A of the first storage expansion
enclosure to port 1B of the second storage expansion enclosure (connection
2 ).
3. Make a fibre-channel connection from port 1A of the second storage expansion
enclosure to port 1B of the third storage expansion enclosure (connection 3).
4. Make a fibre-channel connection from port 1A of the third storage expansion
enclosure to port 1B of the fourth storage expansion enclosure (connection 4).
To create drive loop B (of the DS4200 Express redundant drive loop) shown in
Figure 35 on page 49, you would perform the following steps:
1. Make a fibre-channel connection from the DS4200 Express Storage Subsystem
to port 1B of the last storage expansion enclosure (connection 5 ).
2. Make a fibre-channel connection from port 1A of the last storage expansion
enclosure to port 1B of the third storage expansion enclosure (connection 6).
3. Make a fibre-channel connection from port 1A of the third storage expansion
enclosure to port 1B of the second storage expansion enclosure (connection
7 ).
4. Make a fibre-channel connection from port 1A of the second storage expansion
enclosure to port 1B of the first storage expansion enclosure (connection 8).
Example of an incorrect redundant drive loop
Figure 36 on page 51 shows an example of an incorrect redundant drive loop
created with a DS4200 Express Storage Subsystem and four EXP420s. The
redundant drive loop is not correct because the controller port is connected to the
port labeled 1A instead of 1B on both the right and left ESMs. The numbers
provided in Figure 36 on page 51 show the order in which cables were attached.
Note: For specific information about cabling a storage expansion enclosure to a
DS4000 storage subsystem, see the appropriate DS4000 Installation, User's,
and Maintenance Guide.
50 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
EXP420
EXP420
EXP420
EXP420
Drive Loop A
2A
2B
36
2A
2B
36
2A
2B
36
2A
2B
36
1
5
Drive Loop B
1A
1B
1B
1A
2
1A
1B
3
1A
1B
4
1A
1B
8
1B
1A
7
1B
1A
6
63
2B
2A
63
2B
2A
63
2B
2A
1B
1A
63
2B
2A
exp42001
Figure 36. Incorrect EXP420 redundant drive loop configuration
The following list describes the incorrect fibre-channel connections for drive loop A
(of the DS4200 Express redundant drive loop) shown in Figure 36.
1. The fibre-channel connection from the DS4200 Express Storage Subsystem is
incorrectly connected to port 1A of the first storage expansion enclosure
(connection 1 ).
2. The fibre-channel connection from port 1B of the first storage expansion
enclosure is incorrectly connected to port 1A of the second storage expansion
enclosure (connection 2).
3. The fibre-channel connection from port 1B of the second storage expansion
enclosure is incorrectly connected to port 1A of the third storage expansion
enclosure (connection 3).
4. The fibre-channel connection from port 1B of the third storage expansion
enclosure is incorrectly connected to port 1A of the fourth storage expansion
enclosure (connection 4).
Chapter 3. Cabling the EXP420 51
The following list describes the incorrect fibre-channel connections for drive loop B
(of the DS4200 Express redundant drive loop) shown in Figure 36 on page 51, you
would perform the following steps:
1. The fibre-channel connection from the DS4200 Express Storage Subsystem is
incorrectly connected to port 1A of the last storage expansion enclosure
(connection 5 ).
2. The fibre-channel connection from port 1B of the last storage expansion
enclosure is incorrectly connected to port 1A of the third storage expansion
enclosure (connection 6).
3. The fibre-channel connection from port 1B of the third storage expansion
enclosure is incorrectly connected to port 1A of the second storage expansion
enclosure (connection 7).
4. The fibre-channel connection from port 1B of the second storage expansion
enclosure is incorrectly connected to port 1A of the first storage expansion
enclosure (connection 8).
Cabling the power supply
Complete the following steps to connect the power supply cable:
1. Using the supplied strap, tie the power supply cord to the rail to provide strain
relief for the power cord.
2. Attach the power supply nut and tighten it securely.
3. Connect the power cable to the power supply.
4. Plug the supply power cable into a properly grounded electrical outlet. For
maximum protection against power loss, connect each of the two power
supplies to a different power source.
5. Continue with “Powering on the EXP420” on page 55 for the initial startup of the
storage expansion enclosure.
52 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Chapter 4. Operating the EXP420
This chapter describes operating procedures for the storage expansion enclosure.
To ensure optimal operation of your system, see “Best practices guidelines” on
page 12.
Performing the DS4000 Health Check process
The DS4000 Health Check process is a sequence of suggested actions developed
by IBM to help users verify and maintain the optimal performance of their DS4000
storage configurations. The information that you collect in these steps also helps
provide IBM Service with important information needed for problem troubleshooting
during IBM Service calls.
Perform the following Health Check tasks after the initial configuration of your
DS4000 Storage Subsystem, and after all configuration sessions. It is also
recommended that you set a regular schedule of periodic Health Check evaluations
in order to keep your DS4000 code current and to preserve optimal data access
and performance.
1. Monitor the Recovery Guru in the Storage Manager client for any obvious
storage subsystem errors or problem conditions.
2. Gather and save the following DS4000 storage subsystem event logs for review
by IBM Service. These event logs should be gathered periodically for regular
Health Check monitoring regardless of the state of the Recovery Guru. (You can
collect all these logs at once and zip them into a single file by clicking
Advanced Troubleshooting Collect All Support Data in the DS4000
Storage Manager Subsystem Management window.)
v DS4000 storage subsystem management event log (MEL)
v Storage Subsystem Profile or DS4000 Profile
v Read-Link Status (RLS) data
In addition, you should also collect event logs for the host servers that have
mapped logical drives from the storage subsystem.
Attention: Save these event log files to a server disk that will remain
accessible in the event of a DS4000 storage configuration failure. Do not save
these event log files only to a LUN in the DS4000 Storage Subsystem.
3. Use the Storage Subsystem Profile or DS4000 Profile to verify that the following
firmware levels are at the latest versions supported for your DS4000 Storage
Subsystem:
v Controller firmware
v ESM firmware
v Drive firmware
v ATA translator (interposer) firmware
If you discover your firmware is not up-to-date, upgrade the firmware and
software to the latest level appropriate to your DS4000 storage configuration.
See “Web pages” on page 54 for information about where to find the latest
firmware and software.
Attention: You must resolve Recovery Guru errors or problems before
upgrading firmware.
© Copyright IBM Corp. 2006, 2007 53
Save the storage subsystem profile before performing any controller or ESM
firmware upgrades. Save the storage subsystem profile and all *.cfg files to a
server disk that will remain accessible in the event of a DS4000 storage
configuration failure.
When you upgrade firmware, you must upgrade all client package
Note:
components to the same release level. For example, if you are upgrading
your controller firmware from version 5.x to version 6.x, you must also
upgrade your Storage Manager client to version 9.x or higher. If your
host system uses RDAC, upgrading controller firmware from version 5.x
to version 6.x might also require host software updates, such as RDAC
updates and HBA driver updates. Refer to the IBM DS4000 Web site for
detailed instructions.
4. Use the Storage Subsystem Profile or DS4000 Profile to verify that the following
functions are enabled:
v For all DS4000 models, Media Scan should be enabled both at the controller
level and at the LUN level.
v For all DS4000 models, the read/write cache should be enabled. In addition,
use the Storage Subsystem Profile to verify that cache is matched between
the controllers.
Web pages
IBM maintains pages on the World Wide Web where you can get the latest
technical information and download device drivers and updates.
For DS4000 information, go to the following Web site:
www.ibm.com/servers/storage/support/disk/
For the latest information about operating system and HBA support, clustering
support, SAN fabric support, and Storage Manager feature support, see the System
Storage DS4000 Interoperability Matrix at the following Web site:
www-1.ibm.com/servers/storage/disk/ds4000/interop-matrix.html
Hardware responsibilities
In addition to the Health Check steps described above, regular hardware inspection
and maintenance helps to support the optimal performance of your DS4000 storage
configuration. Yo u should periodically inspect the fibre channel components of your
DS4000 storage configuration.
IBM suggests you follow these guidelines:
v Maintain an up-to-date storage subsystem profile for your DS4000 storage
configuration. Save the profile to a server disk that will remain accessible in case
of a DS4000 storage configuration failure. Do not save the profile only to a LUN
in the DS4000 Storage Subsystem.
v Develop a Change Management plan. The plan should include schedules for
updating subsystem firmware and server host software.
Note: Some updates might require storage subsystem downtime.
v Use IBM-approved fibre channel cables for all situations. Note in your
configuration documentation whether any cables are not IBM-approved.
54 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
v Create and maintain a cabling diagram of the current SAN configuration. Keep
this diagram updated as you make configuration changes, and keep the cabling
diagram available for review.
v Create and maintain a list of other components that are being used within the
cabling diagram (such as the host system, fibre channel switches, and other SAN
attachments).
v Ensure that all ESMs are properly seated.
v Ensure that all drives are properly seated.
v Ensure that all SFP modules are properly seated.
v Confirm fibre channel cable loop size. (IBM specifications call for at least 3-inch
cable loops, but it is recommended that you use 6-inch cable loops or longer.)
v Ensure proper fibre channel cable management.
v Ensure proper air flow and temperature for all components in your EXP420
storage configuration.
Note: You can find details on many of these inspection and maintenance
responsibilities in the appropriate sections of this document.
In addition to these inspection and maintenance responsibilities, IBM also strongly
recommends DS4000 training for staff that supports DS4000 storage configurations.
Although training is not a part of the Health Check process, DS4000 training
reduces the potential for configuration problems and contributes to the overall
health of the system.
Powering on the EXP420
When you turn on and turn off the EXP420, be sure to use the startup sequence in
this section.
Turning on the EXP420
This section contains instructions for turning the EXP420 on and off under normal
and emergency situations.
The following procedure covers two situations:
v The entire storage subsystem has been shut down. (The main circuit breakers for
the cabinet are off.)
v Some storage expansion enclosures are being powered on while others remain
online. (The main circuit breakers for the cabinet are on.) Yo u might encounter
this if you are adding an additional storage expansion enclosure to increase
storage capacity.
Attention:
1. Potential damage to EV-DDMs - Repeatedly turning the power off and on
without waiting for the EV-DDMs to spin down can damage them. Always wait
at least 70 seconds from when you turn off the power until you turn it on
again.
2. If you are connecting a power cord to a storage expansion enclosure, turn off
both of its power switches first. If the main circuit breaker is off, be sure both
power switches are off on each storage expansion enclosure in the cabinet
before turning on the main circuit breakers.
Are the main circuit breakers turned on?
1.
v Yes - Turn off both power switches on each storage expansion enclosure that
you intend to connect to the power.
Chapter 4. Operating the EXP420 55
v No - Turn off both power switches on all storage expansion enclosures and
storage subsystems in the DS4000 storage subsystem configuration.
Connect the power cords to the power supplies on each storage expansion
2.
enclosure.
3. If the main circuit breakers are turned off, turn them on.
4. Verify that the link rate setting on the front of the storage expansion enclosure
matches the speed of the drives in the subsystem.
Attention: You must turn on power to each attached storage expansion
enclosure before turning on power to the storage subsystem to ensure that the
controllers complete the startup process. If the controllers do not find any drives
present during the initial power on sequence, the storage subsystem will not
complete the startup process. This will prevent controllers from communicating
with each other, and any factory-installed premium features will not be activated
correctly.
5. Turn on both power switches on the back of each storage expansion enclosure.
Turn on both power switches on each storage expansion enclosure attached to
the storage subsystem. While each storage expansion enclosure powers up, the
green and amber LEDs on the front and back of the storage expansion
enclosure turn on and off intermittently. Depending on your configuration, it can
take several minutes for each storage expansion enclosure to power up.
Check the LEDs on the front and back of all the storage expansion enclosures.
Verify that no Needs Attention or enclosure ID LEDs light on any of the storage
expansion enclosures. To verify the fibre channel connections between the drive
expansion enclosures, make sure that no Port Bypass LEDs for connections to
other storage expansion enclosures are lit. Only the Port Bypass LED of the
ESM port that connects directly to the storage subsystem drive port should be
lit.
6. Turn on both power switches on the back of the DS4000 storage subsystem.
Depending on the number of storage expansion enclosures in the configuration,
the storage subsystem might take several minutes to power up. The battery
self-test might take an additional 15 minutes. The LEDs will blink intermittently
until the storage subsystem powers up and completes the battery self-test.
Before attempting any operations, wait at least five minutes for the storage
subsystem to completely power up. A storage subsystem can take up to 10
minutes to power on and up to 15 minutes to complete its controller battery
self-test. During this time, the indicator lights on the front and back of the
module blink intermittently.
4
3
2
1
exp81024
3
4
Figure 37. Power supply switches and connectors
56 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Table 15. Description of Figure 37 on page 56
Number Description
1 Power supply and fan unit A
2 Power supply and fan unit B
3 Power connector
4 Power switch
7. Determine the status of all storage subsystems and components in the
configuration by completing the following steps:
a. Check all LEDs on each component in the storage expansion enclosures.
Ensure that all the LEDs show normal status. For more information on LED
status for storage expansion enclosures, see “Checking the LEDs” on page
59 or the Installation, User’s, and Maintenance Guide for your DS4000
storage expansion enclosure.
b. Check all LEDs on each component in the storage subsystem. Ensure that
all the LEDs show normal status. For information about LED status, see
“Solving problems” on page 101.
c. Open the DS4000 Storage Manager Subsystem Management Window, and
display the Physical View for the configuration.
The status for each component will be either Optimal or Needs Attention.
d. Review the status of the configuration components shown in the Subsystem
Management Window by selecting the appropriate component button for
each storage subsystem.
8. Are the LEDs indicating normal operation, and is the status Optimal on all the
configuration components?
v Yes — End of procedure.
v No — Go to step 9.
Diagnose and correct the fault by completing the following steps:
9.
a. Run the DS4000 Storage Manager Recovery Guru by selecting the
Recovery Guru toolbar button in the Subsystem Management Window.
b. Complete the recovery procedure.
If the Recovery Guru directs you to replace a failed component, use the
individual LEDs on the storage subsystem to locate the specific failed
component. For troubleshooting procedures, see Chapter 6, “Hardware
maintenance,” on page 101.
c. When the recovery procedure is completed, select Recheck in the Recovery
Guru. This action reruns the Recovery Guru to ensure that the problem has
been corrected.
d. If the problem persists, contact your IBM service representative.
Firmware updates
Attention: Save the storage subsystem profile before performing any controller or
ESM firmware upgrades. Save the DS4000 storage subsystem profile and all
configuration (*.cfg) files to a server disk that will remain accessible in the event of
a DS4000 storage configuration failure. Do not save these files only to a LUN in the
DS4000 Storage Subsystem.
To ensure the optimal operation of the DS4000 storage subsystem and its attached
storage expansion enclosures, the storage expansion enclosure ESM firmware, the
Chapter 4. Operating the EXP420 57
DS4000 controller firmware, the hard drive firmware, and the NVSRAM (for
controllers only) must be up-to-date. Go to the following Web site to get the latest
updates:
www.ibm.com/servers/storage/support/disk/
Refer to “Software and hardware compatibility and upgrades” on page 9 for
software and hardware compatibility information and requirements.
Apply the necessary updates before configuring the storage subsystem arrays and
logical drives. Subscribe to My Support for automatic notifications of firmware or
Storage Manager software updates or any important information about your DS4000
subsystems (see “Product updates and support notifications” on page 12).
Attention: Read the Readme file that is included in each firmware or DS4000
Storage Manager software package for any limitations, subsystem firmware
prerequisites, or download-sequence information. For example, the controller
firmware code might require the storage expansion enclosure ESM firmware to be
upgraded first to a particular version, or the controller firmware download might
require the halting of I/Os to the DS4000’s logical drives. Failure to observe the
limitations, prerequisites, and dependencies in the Readme file might result in a
loss of data access. See “Finding DS4000 readme files” on page xxiii to learn how
to access the DS4000 readme files on the Web.
Unless the Readme file contains special requirements for the sequence in which
you upgrade firmware, you should perform firmware upgrades in the following
sequence:
1. ESM firmware for the storage expansion enclosures
2. Controller firmware
3. Controller NVSRAM
4. Drive firmware and ATA translator card firmware
Finding controller, storage expansion enclosure, and drive information
You can view a Storage Subsystem Profile to find controller, enclosure, and drive
information for the storage expansion enclosure and DS4000 storage subsystems to
which it is attached. To view a Storage System Profile, perform the following steps:
1. Open the DS4000 Storage Subsystem Management window from the DS4000
Storage Manager Enterprise Management window.
2. Select Storage Subsystem → View → Profile .
A Storage Subsystem Profile window opens.
3. Select the Controllers tab.
4. Scroll through the list to find Board ID, Submodel ID, Product ID, and Product
revision for the DS4000 storage subsystem.
5. Select the Enclosures tab.
6. Scroll through the list to find the Product ID for supported storage expansion
enclosures.
7. Select the Drives tab.
8. Scroll through the list to find the drive values such as Product ID.
58 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Troubleshooting the storage expansion enclosure
The DS4000 Storage Manager is the best way to monitor the storage expansion
enclosure, diagnose a problem, and recover from a hardware failure. Yo u should
run the DS4000 Storage Manager continuously, and check the status of the storage
array frequently.
Use the following procedure to check the status of and identify a problem with the
storage expansion enclosure.
1. Open the Subsystem Management Window.
2. Select the component button for each storage expansion enclosure in this
storage subsystem, and view the status of each of the components.
The status for each component is either Optimal or Needs Attention.
3. Does any component have a Needs Attention status?
v Yes - Go to step 4.
v No - All components are Optimal. Go to step 6.
Select the Recovery Guru toolbar button. Perform the procedure in the
4.
Recovery Guru to correct the problem. The Recovery Guru might direct you to
replace the failed component. If so, go to step 5.
Attention: If the fault requires you to power off an attached storage expansion
enclosure, you might need to cycle the power on the DS4000 storage
subsystem and all remaining storage expansion enclosures in the storage
subsystem. Contact IBM Customer and Technical Support before powering off
any attached storage expansion enclosures.
5. Mute the alarm, if needed.
6. Check the indicator LEDs on the front and the back of the storage expansion
enclosure.
A green LED denotes a normal status; an amber LED denotes a hardware fault.
7. Is an amber LED on?
v Yes - Locate and troubleshoot the failed components. See “Checking the
LEDs.”
v No - You are finished with this procedure. If you are still experiencing a
problem with this storage subsystem, create, save, and print a storage
subsystem profile. This information might be helpful when troubleshooting.
Contact IBM Customer and Technical Support for assistance. When the
recovery procedure is completed, select Recheck in the Recovery Guru to
rerun the Recovery Guru and to ensure that the problem has been corrected.
Checking the LEDs
The LEDs display the status of the storage expansion enclosure and components.
Green LEDs indicate a normal operating status; amber LEDs (Needs Attention)
indicate a possible failure; a blue LED indicates that is safe to remove a
component. The blue LED also indicates that the storage expansion enclosure is
being identified or located.
It is important to check all the LEDs on the front and back of the storage expansion
enclosure when you turn on the power. During power up, the indicator LEDs blink
intermittently as the storage expansion enclosure and components complete the
power-up process. In addition to checking for faults, you can use the LEDs on the
front of the storage expansion enclosures to determine if the drives are responding
to I/O transmissions from the host.
Chapter 4. Operating the EXP420 59
Power supply and fan unit LEDs
This section describes the primary LEDs on the storage expansion enclosure power
supply and fan units.
A
ESM
3
4
2
1
1
B
ESM
exp81020
2
3 4
Figure 38. Power supply and fan unit LEDs
Table 16. Power supply and fan unit LEDs
Number LED Normal Status Problem Status
1 Power supply and fan unit
Power
2 Service Action Allowed
(OK to Remove)
3 Service Action Required
(Fault)
4 Direct Current Enabled
On Off
Off On
Off On
On Off
Front LEDs
This section describes the primary LEDs and controls on the front of the storage
expansion enclosure. The front view shows the following components:
v Front Frame - Metal cage frame containing global indicator lights and a link rate
switch.
v Drives - Up to 16 removable drives, which are numbered 1 through 16 from left
to right. When a drive is installed, the drive and tray slot designation is set
automatically. The hardware addresses are based on the enclosure ID switch
setting on the ESM and on the drive’s physical location in the storage expansion
enclosure.
Note: The drives in your storage expansion enclosure might differ slightly in
appearance from those shown. The variation does not affect the function
of the drives.
60 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
exp81021
2
3 4 5 6 1
Figure 39. Front LEDs
Table 17. Front LEDs and controls
Number LED Normal Status Problem Status
1 Drive Activity LED On (not blinking) - No
Off
data is being processed
Blinking - data is being
processed
2 Drive Fault LED Off
On (not blinking)
Note: In certain ESM
Blinking - Drive, volume,
or storage array locate
function
firmware versions, the
Drive Fault LED is lit
when no drive is inserted
in the drive slot.
3 Global Locate
On N/A
Rear LEDs
4 Global Summary Fault
5 Global Power
6 Link Rate Switch The Link Rate switch
Off On
On Off
N/A
should be set to 2 Gbps
or 4 Gbps, depending on
your configuration.
This section describes the primary LEDs, controls, and connectors on the rear of
the storage expansion enclosure. The back view shows the following components:
v Fans and power supplies - Two removable power supply and fan unit CRUs,
each containing one power supply and two fans
v ESMs - Two removable environmental service modules (ESMs)
Chapter 4. Operating the EXP420 61
A
ESM
1
9 4 6 5 3 2 1
8
7
5 6 2 3
4
8
7 9
exp81022
B
ESM
Figure 40. Rear LEDs, controls, and connectors
Table 18. Rear LEDs, controls, and connectors
Number LED Normal Status Problem Status
1 ESM Power
2 ESM Fault
3 ESM Service Action
Allowed (OK to Remove)
On Off
Off On
Off On
4 ESM Port 1 In Bypass
(This port is labeled 1A)
5 ESM Ports 1 & 2
2 or 4 Gbps Data Rate
6 ESM Port 2 In Bypass
(This port is labeled 1B)
7 ESM Port 3 In Bypass
(This port is labeled 2A)
8 ESM Ports 3 & 4
2 or 4 Gbps data rate
9 ESM Port 4 In Bypass
(This port is labeled 2B)
Seven-segment numeric display
The numeric display consists of two seven-segment LEDs that provide information
about enclosure identification and diagnostics. Figure 41 on page 63 shows the
numeric display and the diagnostic LED.
Off - Cable connected
On - No cable connected
One LED is lit if 2 Gbps
Both LEDs are lit if 4
Gbps
Off - Cable connected
On - No cable connected
Off - Cable connected
On - No cable connected
One LED is lit if 2 Gbps
Both LEDs are lit if 4
Gbps
Off - Cable connected
On - No cable connected
On, blinking for 30
seconds
N/A
On, blinking for 30
seconds
On, blinking for 30
seconds
N/A
On, blinking for 30
seconds
62 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Sevensegment
display
ds48042
76041
Diagnostic LED
Figure 41. Numeric display LEDs
When you power on the storage expansion enclosures, the seven-segment LEDs
show 88 before the boot firmware starts to run. After the boot code starts, - - is
displayed.
When the application code starts, the ESMs display either aa or bb depending on
whether it is ESM A or B.
When the storage expansion enclosure is operating normally, the numeric display
shows the enclosure identification (enclosure ID) of the storage expansion
enclosure.
If an error has occurred and the Needs Attention LED is on, the numeric display
shows diagnostic information. The numeric display indicates the information is
diagnostic by illuminating an LED that appears as a decimal point between the
display numbers. The diagnostic LED tuns off when the numeric display shows the
storage subsystem enclosure ID. The numeric display shows various diagnostic
codes as the enclosures perform the startup process after each power cycle or
reset. After diagnostics are complete, the current storage subsystem enclosure ID is
displayed.
Diagnostic codes in the form of Lx or Hx, where x is a hexadecimal digit, indicate
storage expansion enclosure state information. In general, these codes are
displayed only when the storage expansion enclosure is in a non-operational state.
The storage expansion enclosure might be non-operational due to a configuration
problem (such as mismatched types), or it might be non-operational due to
hardware faults. If the storage expansion enclosure is non-operational due to
system configuration, the storage expansion enclosure Needs Attention LED is off.
If the storage expansion enclosure is non-operational due to a hardware fault, the
storage expansion enclosure Needs Attention LED is on. The definitions for Lx
diagnostic codes are listed in Table 19 on page 64.
Chapter 4. Operating the EXP420 63
Table 19. Numeric display diagnostic codes
Storage expansion
Value
L0 Suspend Mismatched ESM
L2 Suspend Persistent memory
L3 Suspend Persistent hardware
L9 Suspend Over temperature
H0 Suspend SOC Fibre Channel
H1 Suspend SFP Speed Mismatch
H2 Suspend Invalid/Incomplete
H3 Suspend Maximum Reboot
H4 Suspend Cannot Communicate
H5 Suspend Midplane Harness
H6 Suspend Firmware Failure Needs Attention
H8 Suspend SFP(s) Present in
88 Reset ESM is held in reset
enclosure State Description SANtricity View
Needs Attention
types
errors
errors
Interface Failure
Configuration
Attempts Exceeded
with other ESM
Failure
Currently
Unsupported Slot
by the other ESMs
condition for board
type mismatch
Needs Attention
condition for offline
ESM
Needs Attention
condition for offline
ESM
Needs Attention
condition for offline
ESM
Needs Attention
condition for offline
ESM
Needs Attention
condition for offline
ESM
Needs Attention
condition for offline
ESM
condition for offline
ESM
Powering off the storage expansion enclosure
The storage expansion enclosure is designed to run continuously. After you turn it
on, do not turn it off. Turn off the power only in the following situations:
v Instructions in a hardware or software procedure require that you turn off the
power.
v An IBM technical support representative instructs you to turn off the power.
v A power outage or emergency situation occurs, see “Restoring power after an
unexpected shutdown” on page 67.
Turning off the EXP420
Use the following procedure to turn off the power for the EXP420. Figure 37 on
page 56 shows the location of the power switches on a storage expansion
enclosure.
64 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
Attention: Except in an emergency, never turn off the power if any Needs
Attention LEDs are on. Correct the fault before you turn off the power. Use the
DS4000 Storage Manager client and the Needs Attention LEDs to check the overall
status of the EXP420. All LEDs should be green on the front of the storage
expansion enclosure. If they are not, use the DS4000 Storage Manager client to
diagnose the problem. This ensures that the EXP420 will power up correctly later.
The EXP420 is designed to run continuously. After you turn on the EXP420, do not
turn it off. Turn off the power only in the following situations:
v Instructions in a hardware or software procedure require that you turn off the
power.
v An IBM technical support representative instructs you to turn off the power.
v A power outage or emergency situation occurs, see “Restoring power after an
unexpected shutdown” on page 67.
Statement 5:
CAUTION:
The power control button on the device and the power switch on the power
supply do not turn off the electrical current supplied to the device. The device
also might have more than one power cord. To remove all electrical current
from the device, ensure that all power cords are disconnected from the power
source.
2
1
Attention: Turning off and turning on power without waiting for the storage
expansion enclosure disk drives to spin down can damage the drives and might
cause data loss. Always let at least 70 seconds elapse from when you turn off the
power until you turn on the power again.
Chapter 4. Operating the EXP420 65
Power-off overview
Review the following information before you continue with the power-off
procedure below.
Turn off the power to each device based on the following shutdown sequence:
1. Turn off power to the host before the storage subsystem. If the host must
stay powered on to support an existing network, see the operating system
documentation for information about disconnecting the storage subsystem
logical drives from the host before the storage subsystem is powered off.
2. Turn off power to the storage subsystem before you turn off power to the
storage expansion enclosures. Turn off both power supply switches on the
back of the storage subsystem.
3. Turn off power to other supporting devices (for example, management
stations, fibre-channel switches, or Ethernet switches).
Note: You do not need to perform this step if you are servicing only the
storage subsystem.
Use the following procedure to turn off power to one or more storage expansion
enclosures for a planned shutdown. To turn off power for an unplanned shutdown,
see “Restoring power after an unexpected shutdown” on page 67.
Before proceeding, use the Storage Manager client to determine the status of the
system components and special instructions. The operating system software might
require you to perform other procedures before you turn off the power.
To turn off the EXP420, perform the following steps:
1. Stop all I/O activity to each storage expansion enclosure.
2. Remove the front cover from the storage expansion enclosure, if applicable.
3. Determine the status of all storage expansion enclosures and components in
the configuration by completing the following steps:
a. Check all LEDs on each component in the storage expansion enclosures.
Ensure that all the LEDs show normal status.
b. Check all LEDs on each component in the storage subsystem. Ensure that
all the LEDs show normal status.
c. Open the Subsystem Management Window for the configuration and
display the Physical View for the configuration.
d. Review the status of the configuration components shown in the
Subsystem Management Window by selecting the appropriate component
button for each storage subsystem.
The status for each component will be either Optimal or Needs Attention.
4. Are the LEDs indicating normal operation, and is the status Optimal on all
configuration components?
v Yes - Go to step 6 on page 67.
v No - Go to step 5.
5. To diagnose and correct the fault, complete the following steps:
a. Run the Recovery Guru by selecting the Recovery Guru toolbar button in
the Subsystem Management Window.
b. Complete the recovery procedure.
66 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
If the Recovery Guru directs you to replace a failed component, use the
individual LEDs to locate the failed component.
c. When the recovery procedure is completed, select Recheck in the
Recovery Guru. This action reruns the Recovery Guru to ensure that the
problem has been fixed.
d. If the problem has not been fixed, contact your IBM service representative.
Do not turn off power until all problems are corrected.
6. Check the Cache Active LED, and verify that it is off.
If the Cache Active LED is on steady, the cache contains data. Wait for the
data to clear from cache memory before turning off the power.
7. Check the LEDs on the storage expansion enclosures to verify that all Drive
Active LEDs are on steady (not blinking).
If one or more LEDs are blinking, data is being written to or from the
EV-DDMs. Wait for all active LEDs to stop blinking.
8. Turn off the ac power switch on the back of each controller in the storage
subsystem.
Note: Until the power switch on each controller is turned off, power still
remains turned on for the both controllers; therefore, the seven-segment
display on each controller stays on until the power switch on each
controller is turned off.
9. Turn off both power switches on the back of each storage expansion enclosure
in the configuration.
10. After you perform the necessary maintenance procedures, turn on the power
using the procedure in “Turning on the EXP420 ” on page 55.
Performing an emergency shutdown
Attention: Emergency situations might include fire, flood, extreme weather
conditions, or other hazardous circumstances. If a power outage or emergency
situation occurs, always turn off all power switches on all computing equipment.
This helps to safeguard your equipment from potential damage due to electrical
surges when power is restored. If the EXP420 loses power unexpectedly, it might
be due to a hardware failure in the power system or in the midplane of the EXP420.
Complete the following steps to shut down the system during an emergency:
1. If you have time, stop all I/O activity to the storage expansion enclosure.
2. Check the LEDs. Make note of any Needs Attention LEDs that are on so you
can correct the problem when you turn on the power again.
3. Turn off all power supply switches, starting with the DS4000 storage subsystem
first, and followed by the storage expansion enclosures. Then, unplug the power
cables from the EXP420.
Restoring power after an unexpected shutdown
Complete the following steps to restart the EXP420 if you turned off the power
supply switches during an emergency shutdown, or if a power failure or power
outage occurred:
1. After the emergency situation is over or power is restored, check the EXP420
for damage. If there is no visible damage, continue with step 2. Otherwise, have
your system serviced.
2. After you check the EXP420 for damage, ensure that the power switches are in
the off position; then plug in the EXP420 power cables, if required.
Chapter 4. Operating the EXP420 67
3. Check the system documentation of the hardware devices that you want to turn
on and determine the proper startup sequence.
Note: Be sure to turn on all of the storage expansion enclosures and verify that
there are not any ESM or power supply and fan unit fault LEDs lit before
you turn on the DS4000 storage subsystem.
In addition, consider the following items:
v The storage subsystem supports simultaneous power-up of the system
components; however, you should always follow the power-up
sequence listed in the “Turning on the storage subsystem section” of
the appropriate DS4000 Storage Subsystem Installation, User’s, and
Maintenance Guide during any attended power-up procedure.
v A storage subsystem in an optimal state should recover automatically
from an unexpected shutdown and unattended simultaneous
restoration of power to system components. After power is restored,
contact IBM technical support if any of the following conditions occur:
– The storage subsystem logical drives and subsystems do not
display in the Storage Manager graphical user interface (GUI).
– The storage subsystem logical drives and subsystems do not come
online.
– The storage subsystem logical drives and subsystems seem to be
degraded.
Turn on the power to each device, based on the startup sequence.
4.
All of the EXP420 storage expansion enclosures must be powered on
Note:
before the DS4000 storage subsystem.
5. The green LEDs on the front and the back of the EXP420 and DS4000 storage
subsystem should remain lit. If other amber Fault LEDs light, see “Solving
problems” on page 101.
Recovering from an overheated power supply and fan unit
Each EXP420 storage expansion enclosure contains two power supply and fan
units. Each power supply and fan unit contains a built-in temperature sensor
designed to prevent it from overheating. Under normal operating conditions, with an
ambient air temperature range of 10° C to 35° C (50° F to 95° F), the fans in the
power supply and fan units maintain a proper operating temperature inside the
module.
If the internal temperature reaches 65° C (149° F), the power supply shuts down
automatically. If both power supplies shut down because of overheating, the module
has no power, and all indicator lights are off.
The following factors can cause the power supplies to overheat:
v An unusually high room temperature
v Fan failures in the power supply and fan units
v Defective circuitry in the power supply
v Blocked air vents
v Failures in other devices in the configuration or cabinet
68 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
If a fan failure causes overheating, the Global Fault LED on the storage expansion
enclosure turns on. The power-fan canister Fault LED on the back of the storage
expansion enclosure also turns on. “Rear LEDs” on page 61 shows the location of
these LEDs.
If the module temperature exceeds 45° C (113° F), the storage management
software displays a Needs Attention icon in the Subsystem Management Window. If
event monitoring is enabled, and event notification is configured, the software
issues the following two critical problem notifications:
v If one power supply shuts down, the storage management software displays a
Needs Attention status in the Subsystem Management Window.
v If both power supplies shut down, the module shuts down, and the storage
management software displays a Not Responding status in the Array
Management Window.
Use the following procedure to resume normal operation after a power supply
shutdown. Figure 42 on page 70 shows the location of the power switches on the
storage expansion enclosure.
Attention: Risk of damage from overheating - The power supplies
automatically shut down when the air temperature inside the cabinet reaches 65°
C (149° F). If the power supplies shut down, immediately remove all cabinet
panels to help cool the cabinet air temperature and to prevent damage to the
DS4000 storage subsystem configuration components.
1. Remove the front cover.
2. If applicable, mute the alarm.
3. Did you use the procedure “Troubleshooting the storage expansion enclosure ”
on page 59 to identify an overheating problem?
v Yes - Go to step 4.
v No - Perform the procedure “Troubleshooting the storage expansion
enclosure ” on page 59 to verify that the power supplies have shut down
because of an overheating problem, and then go to step 4.
4. Stop I/O activity to all attached storage expansion enclosures.
5. Take all or some of the following measures to alleviate the overheating
problem:
v Removing all panels from the cabinet immediately.
v Using external fans to cool the area.
v Shutting down the power to the storage expansion enclosure, using the
procedure described in “Performing an emergency shutdown” on page 67.
6. Wait for the air temperature in and around the storage expansion enclosure to
cool.
After the temperature inside the power supplies cools to below 65° C (149° F),
the storage expansion enclosure is capable of power-up recovery without
operator intervention. After the air has cooled, the power supplies should turn
on automatically. If the power supplies restart automatically, the controllers will
reset and return to normal operation.
7. Did the power supplies restart automatically?
v Yes - Go to step 9 on page 70.
v No - Go to step 8.
8. To cycle the power, turn off both power switches on the back of each storage
expansion enclosure, wait two minutes, and turn on both power switches.
Chapter 4. Operating the EXP420 69
While the storage expansion enclosure powers up, the LEDs on the front and
the back of the module blink intermittently. Depending on your configuration,
the storage expansion enclosure can take between 20 seconds and several
minutes to power on.
9. Turn on both power switches on the back of the storage subsystem.
A storage subsystem can take 10 minutes to power on and up to 15 minutes
for the battery self-test to complete. During this time, the LEDs on the front
and the back of the modules blink intermittently.
1
3
4
Figure 42. Power supply switches
4
3
exp81024
2
Table 20. Description of Figure 42
Number Description
1 Power supply and fan unit A
2 Power supply and fan unit B
3 Power connector
4 Power switch
10. Check the status of each storage expansion enclosure and its components.
a. Note the status of the LEDs on the front and back of each module.
A green LED indicates a normal status; amber LEDs indicate a hardware
fault.
b. Open the Subsystem Management Window for the storage array.
c. Select the appropriate components button for each module in the Physical
View of the Subsystem Management Window to view the status of its
components.
The status for each component is either Optimal or Needs Attention.
Does each module display green LEDs only, and is the status Optimal for each
11.
module component?
v Yes - Go to step 13 on page 71.
v No - Go to step 12.
12. Diagnose and correct the fault:
a. To run the Recovery Guru, select the Recovery Guru toolbar button in the
Subsystem Management Window.
b. Complete the recovery procedure.
If the Recovery Guru directs you to replace a failed component, locate and
troubleshoot that component. See “Checking the LEDs” on page 59.
70 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide
c. When the procedure is completed, rerun the Recovery Guru to ensure that
the problem has been corrected by selecting Recheck in the Recovery
Guru.
d. If the problem persists, contact IBM Customer and Technical Support.
Replace the bezel on the storage expansion enclosure, if applicable.
13.
Chapter 4. Operating the EXP420 71
72 IBM System Storage DS4000 EXP420 Storage Expansion Enclosure: Installation, User’s and Maintenance Guide