IBM DS3500, EXP3500 Installation, User's, And Maintenance Manual

IBM System Storage DS3500 and EXP3500 Storage Subsystem
Installation, User's, and Maintenance Guide

GA32-0952-06
Note
This edition applies to the IBM System Storage DS3500 and EXP3500 Storage Subsystem with controller firmware version 7.70, and to all subsequent releases and modifications until otherwise indicated in new editions.
This edition replaces GA32-0952-05.
© Copyright IBM Corporation 2010, 2013.
US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
Contents
Figures ...............v
Tables ...............vii
Safety ...............ix
Safety statements .............x
Chapter 1. Introduction ........1
What's new in this release ..........2
DS3500 storage subsystem overview ......2
EXP3500 storage enclosure overview ......3
Notices and statements in this document .....4
Features and operating specifications ......4
Models and optional devices .........6
Operating-system support ..........7
Product updates .............8
Best practices guidelines ..........8
DS3500 storage subsystem and EXP3500 storage
enclosure components ...........9
Disk drives and bezels..........10
Controllers .............12
Environmental service modules.......13
AC power supply and fan units ......13
DC power supply and fan units ......14
Battery units .............15
Software and hardware compatibility and upgrades 15
Software and firmware support code upgrades 15
Determining firmware levels .......17
Specifications ..............17
Area requirements ...........17
Temperature and humidity ........19
Electrical requirements .........20
Heat output, airflow, and cooling ......22
Chapter 2. Installing the storage subsystem and storage enclosure . . . 25
Installing the DS3500 storage subsystem .....25
Inventory checklist ...........25
DS3500 installation overview .......26
Handling static-sensitive devices ......27
Preparing for installation .........28
Installing the DS3500 storage subsystem in a rack 29
Installing the EXP3500 storage enclosure.....29
Inventory checklist ...........29
Installing the EXP3500 storage enclosure in a rack 30
Chapter 3. Cabling the storage subsystem and storage enclosure . . . 31
Cabling the DS3500 storage subsystem .....31
Controller connectors (with Fibre Channel host
port adapters) ............31
Controller connectors (with 1 Gbps iSCSI host
port adapters) ............31
Controller connectors (with 10 Gbps iSCSI host
port adapters) ............32
Controller connectors (with SAS host port
adapters) ..............33
Enclosure ID settings ..........33
Working with SAS cables .........33
Working with SFP modules and fiber optic cables 35
Cabling the EXP3500 storage enclosure ....45
Connecting storage enclosures to the DS3500 . . 48 Upgrading a single-controller to a dual-controller when there is no attached EXP3500 enclosure . . 55 Upgrading a single-controller to a dual-controller when there is one or more EXP3500 enclosures
attached to the storage subsystem ......55
Connecting secondary interface cables ....55
Configuring the storage subsystem .....56
Overview of installing an IBM BladeCenter
configuration to connect to a DS3500 .....75
Cabling the DS3500 and EXP3500 ac power supplies 77 Cabling the DS3500 and EXP3500 dc power supplies 78
Chapter 4. Operating the storage subsystem and storage enclosure . . . 81
Performing the health check process ......81
Hardware inspection ...........82
Turning on the storage subsystem .......82
Installing the Storage Manager Client......85
Monitoring status through software ......85
Firmware updates ...........86
Troubleshooting the storage subsystem ....87
Checking the LEDs ............88
AC power-supply LEDs .........88
DC power-supply LEDs .........88
Front LEDs .............89
Controller LEDs ............90
Seven-segment numeric display LEDs ....93
ESM LEDs..............94
Turning off the storage subsystem .......95
Performing an emergency shutdown .....98
Restoring power after an unexpected shutdown 98 Recovering from an overheated power supply. . . 99
Cache memory and cache battery.......101
Cache memory ............101
Controller cache battery .........102
Cache battery learn cycle ........102
Chapter 5. Replacing components . . 105
OK to remove LED ...........105
Working with controllers .........105
Removing a controller .........106
Removing and installing a cover ......107
Installing a controller..........107
Replacing a controller .........109
Removing and disposing of the system-board
lithium battery ............114
© Copyright IBM Corp. 2010, 2013 iii
Installing an optional host port adapter or
replacing a failed host port adapter ......116
Working with hot-swap drives .......121
Removing a hard disk drive .......122
Installing a hard disk drive ........124
Replacing a hot-swap drive........126
Replacing multiple drives ........126
Replacing an ac power supply........132
Replacing a dc power supply ........137
Replacing a power-fan controller in the DS3500
controller-drive enclosure .........142
Replacing a battery ...........148
Replacing the memory cache DIMM ......150
Removing the DIMM..........151
Installing the DIMM ..........152
Turning on the storage subsystem after
replacing components .........153
Replacing an SFP transceiver in the DS3500
storage subsystem controller enclosure
configuration ............154
Replacing the bezels ...........156
Removing the bezels ..........156
Installing the bezels ..........157
Working with environmental service modules . . 157
Installing an additional ESM .......157
Replacing an ESM...........158
Replacing a midplane assembly .......159
Chapter 6. Solving problems .....161
Solving problems in the DS3500 storage subsystem 161 Solving problems in the EXP3500 storage enclosure 167 Seven-segment display sequence codes and their
causes ................169
Chapter 7. Parts listing, DS3500 storage subsystem and EXP3500
storage enclosure .........175
Replaceable components..........175
DS3512 storage subsystem and EXP3512 storage
enclosure parts listing ..........175
DS3524 storage subsystem and EXP3524 storage
enclosure parts listing ..........177
Power cords ..............179
Determining basic information of drive FRUs . . 181
Appendix A. Records ........183
Identification numbers ..........183
Hard disk drive locations .........183
Storage subsystem and controller information
record ................184
Appendix B. Getting help and
technical assistance ........187
Before you call .............187
Using the documentation .........188
Getting help and information from the World Wide
Web................188
Software service and support ........188
Hardware service and support .......188
Taiwan contact information.........189
Notices ..............191
Trademarks ..............192
Important notes ............193
Particulate contamination .........193
Documentation format ..........194
Electronic emission notices .........194
Federal Communications Commission statement 194
Industry Canada compliance statement....195
Australia and New Zealand Class A Statement 195 European Union Electromagnetic Compatibility
Directive ..............195
Germany Electromagnetic compatibility
directive ..............196
Japan Voluntary Control Council for Interference
(VCCI) Class A Statement ........197
Japan Electronics and Information Technology Industries Association (JEITA) Statement (less
than or equal to 20 A per phase) ......197
Korean Communications Commission (KCC)
Class A Statement ...........197
Russia Electromagnetic Interference (EMI) Class
A Statement .............197
People's Republic of China Class A Electronic
Emission statement ..........198
Taiwan Class A compliance statement ....198
Index ...............199
iv
IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Figures
1. Serial number label, and product name, machine type, and model number label
locations ..............2
2. DS3512 storage subsystem and EXP3512 storage enclosure hot-swap drive bays and
bezels ..............10
3. DS3524 storage subsystem and EXP3524 storage enclosure hot-swap drive bays and
bezels ..............10
4. Left-side bezel............11
5. Right-side bezel (DS3512 and EXP3512) 11
6. Bottom shelf (DS3524 and EXP3524) ....11
7. Rear view, single-controller model (shown without an optional host port adapter) . . . 13
8. Rear view, single ESM model storage enclosure 13
9. AC power supply components ......14
10. DC power supply components ......14
11. DC power supply connector - pin positions 14
12. Battery unit ............15
13. DS3512 storage subsystem and EXP3512
storage enclosure dimensions ......18
14. DS3524 storage subsystem and EXP3524
storage enclosure dimensions ......18
15. Example of cold aisle/hot aisle rack
configuration ............23
16. Dual-controller DS3500 storage subsystem ports and controllers (with optional Fibre
Channel host port adapter) .......31
17. Dual-controller DS3500 storage subsystem ports and controllers (with optional iSCSI host
port adapter) ............32
18. Dual-controller DS3500 storage subsystem ports and controllers (with optional 10 iSCSI
host port adapter) ..........32
19. Dual-controller DS3500 storage subsystem ports and controllers (with an optional SAS
host port adapter) ..........33
20. Mini-SAS cable ...........34
21. Connecting a mini-SAS cable.......34
22. Removing a mini-SAS cable .......35
23. SFP module and protective cap ......38
24. Installing an SFP module into the host port 38
25. Unlocking the SFP module latch - plastic
variety ..............39
26. Unlocking the SFP module latch - wire variety 39
27. LC-LC Fibre Channel cable .......40
28. Removing fiber optic cable protective caps 41
29. Inserting an LC-LC Fibre Channel cable into
an SFP module ...........41
30. LC-LC Fibre Channel cable lever and latches 42
31. Removing the LC-LC Fibre Channel cable 42
32. LC-SC Fibre Channel cable adapter ....43
33. Removing the LC-SC cable adapter protective
caps ...............44
34. Connecting an LC-LC cable into the LC-SC
cable adapter ............44
35. LC-LC Fibre Channel cable lever and latches 45
36. Removing the LC-LC Fibre Channel cable from an LC-SC Fibre Channel cable adapter . . . 45
37. ESM connectors ...........45
38. Example of a redundant drive path ....50
39. One single-controller DS3500 and multiple
single-ESM storage enclosures ......51
40. A dual-controller DS3500 and a storage
enclosure .............52
41. A dual-controller DS3500 and two storage
enclosures .............52
42. A dual-controller DS3500 and eight storage
enclosures .............53
43. Ethernet port locations on a dual-controller
DS3500 ..............56
44. Host-agent (in-band) managed storage
subsystems.............57
45. Direct (out-of-band) managed storage
subsystems.............58
46. Single-controller direct-attached SAS
connection to a single-host HBA .....60
47. Single-controller direct-attached SAS connection to dual HBAs in a single-host
(redundant host connection) .......60
48. Single-controller direct-attached SAS connection to single HBAs in multiple hosts . 61
49. Dual-controller direct-attached SAS connection to two HBAs in the same host (redundant host
connection) ............61
50. Dual-controller direct-attached SAS connections to multiple HBAs in multiple
hosts ...............62
51. Dual-controller DS3500 or single-controller DS3500 SAS connection to multiple hosts using
one SAS switch ...........62
52. Dual-controller DS3500 SAS connection to multiple hosts using two separate SAS
switches..............63
53. Multiple dual-controller DS3500s SAS connection to multiple hosts using two using
two separate SAS switches .......63
54. Dual-controller DS3500 SAS connection to multiple hosts using two SAS switches that are connected together via an interlink switch . . 64
55. Location of host connectors on storage
controllers .............65
56. Single-controller direct-attached Fibre Channel
connection to a single host HBA .....65
57. Single-controller direct-attached Fibre Channel connection to dual HBAs (redundant host
connection) ............66
58. Single-controller direct-attached Fibre Channel connection to single HBAs in multiple hosts . 67
59. Dual-controller direct-attached Fibre Channel connection to two HBAs in the same host
(redundant host connection) .......67
© Copyright IBM Corp. 2010, 2013 v
60. Dual-controller direct-attached Fibre Channel connections to multiple HBAs in multiple
hosts ...............68
61. Example of a single Fibre Channel SAN fabric
configuration ............69
62. Example of a dual Fibre Channel SAN fabric
configuration ............69
63. Example of two storage subsystems in a dual
Fibre Channel SAN environment .....70
64. Single-host, single-controller iSCSI
configuration ............71
65. Multiple-port, single-controller iSCSI
configuration ............72
66. Multiple single-port hosts, single-controller
iSCSI configuration ..........72
67. Multiple-host, multiple-port, single-controller, and redundant-path iSCSI configuration . . . 73
68. Multiple-host, multiple-port, multiple-storage-subsystem iSCSI configuration 73
69. Single-host, multiple-port, dual-controller
iSCSI configuration ..........74
70. Multiple-host, multiple-port, dual-controller
iSCSI configuration ..........74
71. Example of a multiple-host, multiple-port, and multiple-fabric (Fibre Channel or iSCSI, and
SAS) configuration ..........75
72. Example of a DS3500 that is connected to a
BladeCenter unit ...........77
73. DC power connector - pin positions ....79
74. DC wiring from DS3500 to disconnect device
and dc power source .........79
75. Power-supply switches and connectors for
DS3500 ac models ..........84
76. Power-supply switches and connectors for
DS3500 dc models ..........84
77. AC power-supply LEDs ........88
78. DC power-supply LEDs ........89
79. DS3512 storage subsystem and EXP3512 storage enclosure front LEDs and controls . . 89
80. DS3524 storage subsystem and EXP3524
storage enclosure front LEDs .......90
81. Controller LEDs ...........91
82. iSCSI host port adapter LEDs ......92
83. Fibre Channel host port adapter LEDs . . . 92
84. SAS host port adapter LEDs .......93
85. 10 Gbps iSCSI port LEDs ........93
86. Numeric display LEDs .........94
87. ESM LEDs .............95
88. Removing a controller ........106
89. Removing the cover .........107
90. Installing a controller .........109
91. Removing and replacing a controller ....111
92. Removing the battery unit from the controller 112
93. Cache backup flash memory device ....113
94. Sequence of removing controller components 117
95. Removing a controller.........118
96. Removing the host port adapter filler panel 119
97. Installing a host port adapter ......120
98. DS3512 storage subsystem and EXP3512
storage enclosure drive LEDs ......122
99. DS3524 storage subsystem and EXP3524
storage enclosure drive LEDs ......122
100. Removing a drive from a DS3512 or EXP3512 123
101. Removing a drive from a DS3524 or EXP3524 124
102. Installing a drive in a DS3512 or EXP3512 125
103. Installing a drive in a DS3524 or EXP3524 125
104. Replacing a power supply .......136
105. Replacing a power supply .......141
106. AC power-supply LEDs ........143
107. Power-supply switches and connectors for
DS3500 AC models .........143
108. Replacing a power supply .......144
109. DC power-supply LEDs ........145
110. DC power connectors for DS3500 DC models 146
111. Power-supply switches and connectors for
DS3500 dc models ..........146
112. Replacing a power supply .......147
113. Removing a controller ........149
114. Removing a battery unit from the controller 149
115. Memory cache DIMM location ......151
116. Removing a controller ........151
117. Removing the DIMM from the controller 152
118. Installing the DIMM in the controller 152
119. DS3524 storage subsystem and EXP3524
storage enclosure front LEDs ......153
120. Controller LEDs...........155
121. Installing an SFP module into the host port 155
122. Removing the bezels .........156
123. Removing an environmental service module 158
124. Replacing the midplane assembly in a DS3512
or EXP3512 ............159
125. Replacing the midplane assembly in a DS3524
or EXP3524 ............160
126. Seven-segment alphanumeric characters 169
127. DS3512 storage subsystem and EXP3512 storage enclosure storage subsystem parts . . 176
128. DS3524 storage subsystem and EXP3524
storage enclosure parts ........178
129. An IBM hologram label example .....182
130. Serial number location on the DS3500 183
vi IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Tables
1. Features and operating specifications ....5
2. DS3500 storage subsystem models and optional
devices ..............6
3. DC power supply connector - pin descriptions 15
4. DS3512 storage subsystem and EXP3512
storage enclosure weights........18
5. DS3524 storage subsystem and EXP3524
storage enclosure weights........19
6. DS3500 component weights .......19
7. Temperature and humidity requirements for storage subsystems in an Information
Technology (IT) or office environment ....20
8. Temperature and humidity requirements for storage subsystems in a NEBS/ETSI compliant
environment ............20
9. DS3500 ac power requirements ......21
10. DS3500 dc power requirements ......21
11. Maximum number of EXP3512 and EXP3524 storage enclosures with controller firmware
level 7.77.xx.xx and later ........48
12. Maximum number of EXP3512 and EXP3524 storage enclosures with controller firmware
level 7.75.xx.xx and earlier .......49
13. DC power supply connector - pin descriptions 79
14. DC power source wiring descriptions ....80
15. Fibre Channel port LEDs ........92
16. Troubleshooting...........162
17. Troubleshooting information ......167
18. Seven-segment display sequence code
definitions ............170
19. Repeating sequences on the seven-segment
display and corresponding errors .....171
20. Controller numeric display diagnostic codes 172
21. ESM numeric display diagnostic codes 173
22. Parts listing for the DS3512 storage subsystem and EXP3512 storage enclosure storage
subsystem ............176
23. Parts listing for the DS3524 storage subsystem and EXP3524 storage enclosure storage
subsystem ............178
24. IBM power cords ..........180
25. Product identification record ......183
26. Drive location information record .....184
27. Storage subsystem and controller information
record ..............184
28. Sample information record .......185
29. Limits for particulates and gases .....194
© Copyright IBM Corp. 2010, 2013 vii
viii IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Safety
Before installing this product, read the Safety Information.
Antes de instalar este produto, leia as Informações de Segurança.
Læs sikkerhedsforskrifterne, før du installerer dette produkt.
Lees voordat u dit product installeert eerst de veiligheidsvoorschriften.
Ennen kuin asennat tämän tuotteen, lue turvaohjeet kohdasta Safety Information.
Avant d'installer ce produit, lisez les consignes de sécurité.
Vor der Installation dieses Produkts die Sicherheitshinweise lesen.
Prima di installare questo prodotto, leggere le Informazioni sulla Sicurezza.
© Copyright IBM Corp. 2010, 2013 ix
Les sikkerhetsinformasjonen (Safety Information) før du installerer dette produktet.
Antes de instalar este produto, leia as Informações sobre Segurança.
Antes de instalar este producto, lea la información de seguridad.
Läs säkerhetsinformationen innan du installerar den här produkten.
Safety statements
These statements provide the caution and danger information used in this documentation.
Important:
Each caution and danger statement in this documentation is labeled with a number. This number is used to cross reference an English-language caution or danger statement with translated versions of the caution or danger statement in the Safety Information document.
For example, if a caution statement is labeled “Statement 1,” translations for that caution statement are in the Safety Information document under “Statement 1.”
Be sure to read all caution and danger statements in this documentation before you perform the procedures. Read any additional safety information that comes with your system or optional device before you install the device.
Statement 1
x IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
DANGER
Electrical current from power, telephone, and communication cables is hazardous.
To avoid a shock hazard:
v Do not connect or disconnect any cables or perform installation,
maintenance, or reconfiguration of this product during an electrical storm.
v Connect all power cords to a properly wired and grounded electrical outlet.
v Connect to properly wired outlets any equipment that will be attached to
this product.
v When possible, use one hand only to connect or disconnect signal cables.
v Never turn on any equipment when there is evidence of fire, water, or
structural damage.
v Disconnect the attached power cords, telecommunications systems,
networks, and modems before you open the device covers, unless instructed otherwise in the installation and configuration procedures.
v Connect and disconnect cables as described in the following table when
installing, moving, or opening covers on this product or attached devices.
To Connect: To Disconnect:
1. Turn everything OFF.
2. First, attach all cables to devices.
3. Attach signal cables to connectors.
4. Attach power cords to outlet.
5. Turn device ON.
1. Turn everything OFF.
2. First, remove power cords from outlet.
3. Remove signal cables from connectors.
4. Remove all cables from devices.
Statement 2
CAUTION: When replacing the lithium battery, use only IBM®Part Number 33F8354 or an equivalent type battery recommended by the manufacturer. If your system has a module containing a lithium battery, replace it only with the same module type made by the same manufacturer. The battery contains lithium and can explode if not properly used, handled, or disposed of.
Do not:
v Throw or immerse into water
v Heat to more than 100°C (212°F)
v Repair or disassemble
Dispose of the battery as required by local ordinances or regulations.
Safety xi
Statement 3
CAUTION: When laser products (such as CD-ROMs, DVD drives, fiber optic devices, or transmitters) are installed, note the following:
v Do not remove the covers. Removing the covers of the laser product could
result in exposure to hazardous laser radiation. There are no serviceable parts inside the device.
v Use of controls or adjustments or performance of procedures other than those
specified herein might result in hazardous radiation exposure.
DANGER
Some laser products contain an embedded Class 3A or Class 3B laser diode. Note the following.
Laser radiation when open. Do not stare into the beam, do not view directly with optical instruments, and avoid direct exposure to the beam.
Class 1 Laser Product Laser Klasse 1 Laser Klass 1 Luokan 1 Laserlaite Appareil A Laser de Classe 1
`
Statement 4
18 kg (39.7 lb) 32 kg (70.5 lb) 55 kg (121.2 lb)
CAUTION: Use safe practices when lifting.
xii IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Statement 5
CAUTION: The power control button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device. The device also might have more than one power cord. To remove all electrical current from the device, ensure that all power cords are disconnected from the power source.
Statement 8
CAUTION: Never remove the cover on a power supply or any part that has the following label attached.
Hazardous voltage, current, and energy levels are present inside any component that has this label attached. There are no serviceable parts inside these components. If you suspect a problem with one of these parts, contact a service technician.
Statement 11
Safety xiii
CAUTION: The following label indicates sharp edges, corners, or joints nearby.
Statement 12
CAUTION: The following label indicates a hot surface nearby.
Statement 13
DANGER
Overloading a branch circuit is potentially a fire hazard and a shock hazard under certain conditions. To avoid these hazards, ensure that your system electrical requirements do not exceed branch circuit protection requirements. Refer to the information that is provided with your device for electrical specifications.
Statement 15
CAUTION: Ensure that the rack is secured properly to avoid tipping when the server unit is extended.
Statement 17
xiv IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
CAUTION: The following label indicates moving parts nearby.
Statement 26
CAUTION: Do not place any object on top of rack-mounted devices.
Statement 29
CAUTION: This equipment is designed to permit the connection of the earthed conductor of the dc supply circuit to the earthing conductor at the equipment. If this connection is made, all of the following conditions must be met:
v This equipment shall be connected directly to the dc supply system earthing
electrode conductor or to a bonding jumper from an earthing terminal bar or bus to which the dc supply system earthing electrode conductor is connected.
v This equipment shall be located in the same immediate area (such as, adjacent
cabinets) as any other equipment that has a connection between the earthed conductor of the same dc supply circuit and the earthing conductor, and also the point of earthing of the dc system. The dc system shall not be earthed elsewhere.
v The dc supply source shall be located within the same premises as this
equipment.
v Switching or disconnecting devices shall not be in the earthed circuit
conductor between the dc source and the point of connection of the earthing electrode conductor.
Statement 34
Safety xv
CAUTION: To reduce the risk of electric shock or energy hazards:
v This equipment must be installed by trained service personnel in a
restricted-access location, as defined by the NEC and IEC 60950-1, First Edition, The Standard for Safety of Information Technology Equipment.
v Connect the equipment to a reliably grounded safety extra low voltage (SELV)
source. An SELV source is a secondary circuit that is designed so that normal and single fault conditions do not cause the voltages to exceed a safe level (60 V direct current).
v Incorporate a readily available approved and rated disconnect device in the
field wiring.
v See the specifications in the product documentation for the required
circuit-breaker rating for branch circuit overcurrent protection.
v Use copper wire conductors only. See the specifications in the product
documentation for the required wire size.
v See the specifications in the product documentation for the required torque
values for the wiring-terminal nuts.
Statement 37
DANGER
When you populate a rack cabinet, adhere to the following guidelines:
v Always lower the leveling pads on the rack cabinet.
v Always install the stabilizer brackets on the rack cabinet.
v Always install the heaviest devices in the bottom of the rack cabinet.
v Do not extend multiple devices from the rack cabinet simultaneously,
unless the rack-mounting instructions direct you to do so. Multiple devices extended into the service position can cause your rack cabinet to tip.
v If you are not using the IBM 9308 rack cabinet, securely anchor the rack
cabinet to ensure its stability.
Attention: This product is suitable for use on an IT power distribution system
whose maximum phase to phase voltage is 240 V under any distribution fault condition.
Power and cabling information for NEBS (Network Equipment-Building System) GR-1089-CORE
The following comments apply to IBM storage devices that have been designated as conforming to NEBS (Network Equipment-Building System) GR-1089-CORE.
The equipment is suitable for installation at:
v Network telecommunications facilities v Locations where the NEC (National Electrical Code) applies.
xvi IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
CAUTION: Intra-building wiring (cabling) must be shielded and grounded at each end when used with the storage device.
Note:
v The intra-building ports of this equipment are suitable for connection to
intra-building or unexposed wiring or cabling only. The intra-building ports of this equipment must not be metallically connected to the interfaces that connect to the OSP (outside plant) or its wiring. These interfaces are designed for use as intra-building interfaces only (Type 2 or Type 4 ports as described in GR-1089-CORE, issue 5 or latest revision) and require isolation from the exposed OSP cabling. The addition of primary protectors is not sufficient protection to connect these interfaces metallically to OSP wiring.
v The ac-powered system does not require the use of an external surge protection
device (SPD).
v The dc-powered system employs an isolated DC return (DC-I) design. The DC
battery return terminal shall not be connected to the chassis or frame ground.
v The storage device (dc power) is intended to be installed in a Common Bonding
Network (or mesh network) as described in GR-1089-CORE, Issue 5 or latest revision.
Safety xvii
xviii IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Chapter 1. Introduction
This section contains information about the operating specifications, features, and components of the IBM System Storage DS3500 storage subsystem and the IBM System Storage EXP3500 storage enclosure.
Note: For Ethernet Interfaces: DS3500 storage subsystem is not intended to be connected directly or indirectly by any means whatsoever to interfaces of public telecommunication networks.
The DS3500 storage subsystem and EXP3500 storage enclosure consist of the following models:
v DS3512 storage subsystem v DS3524 storage subsystem v EXP3512 storage enclosure v EXP3524 storage enclosure
This section also includes an inventory checklist and information about best practices and product updates for your DS3500 storage subsystem and EXP3500 storage enclosure.
If firmware and documentation updates are available, you can download them from the IBM Web site. The DS3500 storage subsystem and EXP3500 storage enclosure might have features that are not described in the documents that are shipped with the device. Documents might be updated occasionally to include information about those features, or technical updates might be available, which are not included in the DS3500 storage subsystem and EXP3500 storage enclosure documents.
To check for updates, complete the following steps:
1. Go to http://www.ibm.com/servers/storage/support/.
®
2. On the “Support for System Storage
and TotalStorage products” page, under
Select your product,intheProduct family field, select Disk systems.
3. In the Product field, select DS3500 or EXP3500.
4. Click Go.
5. Select the following options:
v For firmware updates, click the Download tab. v For documentation updates, click the Install and use tab.
Note: Changes are made periodically to the IBM Web site. Procedures for locating firmware and documentation might vary slightly from what is described in this document.
The DS3500 storage subsystem and EXP3500 storage enclosure have limited warranty. For more information about the terms of warranty, see the Warranty Information document that comes with the device.
Record information about the DS3500 storage subsystem and EXP3500 storage enclosure in “Storage subsystem and controller information record” on page 184. You will need this information if you have to call for service.
© Copyright IBM Corp. 2010, 2013 1
Figure 1 shows the location of the serial number label, product name, machine type, model, and serial number label.
Note: The illustrations in this document might differ slightly from your hardware.
Serial number label
Product name
Figure 1. Serial number label, and product name, machine type, and model number label locations
Use “Hard disk drive locations” on page 183 to keep a record of the drives that are installed in or attached to the DS3500 storage subsystem and EXP3500 storage enclosure. This information can be helpful when you install additional drives or if you have to report a hardware problem. Make a copy of this table before you record information in it, in case you need extra space to write new values later, or when you update the DS3500 storage subsystem and EXP3500 storage enclosure configuration.
What's new in this release
This topic lists the new features available in the current release.
Steps for a few procedures have been added at the following locations:
v Replacing an SFP Transceiver v Replacing a power-fan controller in the DS3500 controller enclosure v Turning on the storage subsystem after replacing components
DS3500 storage subsystem overview
Machine type, model, and serial number label
An overview of the DS3500 storage subsystem is provided here.
With direct-attached Serial Attached SCSI (SAS) connectivity and support for RAID levels 0, 1, 3, 5, and 6, the DS3500 storage subsystem provides an internal physical storage capacity that is scalable up to 36 TB (terabytes) for the DS3512 and 24 TB for the DS3524 storage subsystem.
Note: RAID 6 implements a P+Q design. If RAID level 1 is implemented and the number of drives increases to more than 2, RAID level 10 gets implemented automatically.
2 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
DS3500 is a 2U rack-mountable storage subsystem that supports up to two redundant, dual-active RAID storage controllers. The DS3500 storage subsystem ships with two 6 Gbps x4 SAS host ports and a single 6 Gbps x4 SAS expansion port per controller. Each controller contains 1 GB of cache memory that can be upgraded to 2 GB. Each controller supports installation of the following host port adapters:
v 6 Gbps SAS v 8 Gbps FC v 1 Gbps iSCSI v 10 Gbps iSCSI
When attached to EXP3500 storage enclosures, the DS3500 storage subsystem can be expanded to support 96 drives. This configuration can be expanded to 192 drives when using the 96-192 drive expansion upgrade. The DS3500 storage subsystem and EXP3500 storage enclosures support configurations of 6 Gbps SAS, Near Line (NL) SAS, Solid State Disk (SSD), 6 Gbps SAS Full Disk Encryption (FDE) disk drives, or a mix of disk drives. You must purchase the Full Disk Encryption (FDE) option so that you can use FDE.
Advanced DS3500 storage management, copy service options, and optional advanced disaster recovery functions are available for the DS3500, including FlashCopy
®
, VolumeCopy, and Enhanced Remote Mirroring.
Note: Enhanced Remote Mirroring is supported on the dual-controller DS3500 models only.
Depending on the model, the DS3524 storage subsystems are shipped with either ac or dc (-48V dc) power supply and fan units.
DS3524 storage subsystems that are equipped with dc power supply and fan units (1746 model C4T) supports both NEBS level 3/Telco operating environments and standard Information Technology (IT) and office environments.
DS3512 and DS3524 storage subsystems that are equipped with ac power supply and fan units support both NEBS level 3/Telco operating environments and standard IT and office environments.
The IBM System Storage DS Storage Manager version 10 software is also available for the DS3500 storage subsystem. This storage-management software is designed to help centralize storage management, simplify partitioning of the DS3500 series storage into as many as 128 virtual servers, and strategically allocate storage capacity to maximize storage space.
Using the hot-swap features, you can remove and replace SAS drives, power supplies, and controllers (in a dual-controller storage subsystem).
EXP3500 storage enclosure overview
An overview of the EXP3500 storage subsystem is provided here.
The EXP3500 is a 2U rack-mountable storage enclosure that is equipped with a single environmental services module (ESM), which can be expanded to dual redundant ESM when you install the optional ESM kit. The EXP3512 storage enclosure supports up to 12 drives and the EXP3524 storage enclosure supports up to 24 drives.
Chapter 1. Introduction 3
Depending on the model, the EXP3500 storage enclosures are shipped with either ac or dc (-48V dc) power supply and fan units.
EXP3500 storage enclosures that are equipped with ac power supply and fan units (1746 models E2A and E4A) support both NEBS level 3/Telco operating environments, and standard IT and office environments. EXP3524 storage enclosures that are equipped with dc power supply and fan units (1746 model E4T only) also support both NEBS level 3/Telco operating environments, and standard Information Technology (IT) and office environments.
Notices and statements in this document
The caution and danger statements in this document are also in the multilingual IBM Systems Safety Notices document, which is in the Documentation folder on the IBM System Storage DS3500 Support DVD. Each statement is followed by a reference number that you can use to locate the corresponding statement in your language in the IBM Systems Safety Notices document.
The following notices and statements are used in this document:
v Note: These notices provide important tips, guidance, or advice. v Important: These notices provide information or advice that might help you
avoid inconvenient or problem situations.
v Attention: These notices indicate potential damage to programs, devices, or data.
An attention notice is placed just before the instruction or situation in which damage might occur.
v Caution: These statements indicate situations that can be potentially hazardous
to you. A caution statement is placed just before the description of a potentially hazardous procedure step or situation.
v Danger: These statements indicate situations that can be potentially lethal or
extremely hazardous to you. A danger statement is placed just before the description of a potentially lethal or extremely hazardous procedure step or situation.
Features and operating specifications
The features and operating specifications of the DS3500 storage subsystem are discussed here.
Table 1 on page 5 contains a summary of the features and operating specifications of the DS3500 storage subsystem and EXP3500 storage enclosure. Depending on the model, some features might not be available, or some specifications might not apply.
4 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Table 1. Features and operating specifications
General:
v Modular components
– High-capacity disk drives – (DS3500) RAID storage
controller modules
– (EXP3500) environmental
services modules (ESMs)
– Power supplies with built-in
fans
v Technology
– Supports disk subsystem
technology
– Redundant data storage, power
and cooling system, (DS3500) SAS disk controllers, and (EXP3500) ESMs
– Hot-swap technology for drives,
power supplies, (EXP3500) ESMs, and (DS3500) controllers
– (DS3500) Host port adapter.
Each controller supports one host port adapter. Support for:
- 6 Gbps SAS
- 8 Gbps FC
- 1 Gbps iSCSI
- 10 Gbps iSCSI
v User interface
– Built-in power, activity, and fault
LEDs, identification labeling on components, rear LEDs, and connectors
– Easy-to-replace drives, power
supplies with built-in fans, and controllers
Hard disk drives:
v DS3512 and EXP3512: 12 LFF
3.5–inch 6 Gbps
v DS3524 and EXP3524: 24 SFF
2.5–inch 6 Gbps
Drive type: SAS, NL SAS, and SSD
Storage controllers:
(DS3500) SAS interface: Three 26-pin, mini-SAS connectors per controller
ESMs:
(EXP3500) SAS interface: Three 26-pin, mini-SAS connectors per ESM
Power supply with built-in fans:
v Two hot-swap 585-watt (100 - 240
V ac) standard
v Provides redundant power
Size:
v DS3512 and EXP3512:
– Height: 8.6 cm (3.4 in.) – Depth: 54.0 cm (21.3 in.) – Width: 44.9 cm (17.7 in.) – (DS3512) Weight: Single
controller: 17.2 kg (38.0 lb) Dual controller: 18.5 kg (40.7 lb)
– (EXP3512) Weight: 16.9 kg (37.3
lb)
v DS3524 and EXP3524:
– Height: 8.8 cm (3.5 in.) – Depth: 48.7 cm (19.2 in.) – Width: 44.9 cm (17.7 in.) – (DS3524) Weight: Single
controller: 20.2 kg (44.5 lb) Dual controller: 21.4 kg (47.2 lb)
– (EXP3524) Weight: 19.9 kg (43.8
lb)
Acoustical noise emissions:
v DS3512 and EXP3512 fully
populated with 12 drives – Sound power (idling): 6.2 bels – Sound power (operating): 6.2
bels
– Sound pressure (idling): 62
dBA
– Sound pressure (operating): 62
dBA
v DS3524 and EXP3524 fully
populated with 24 drives – Sound power (idling): 6.4 bels – Sound power (operating): 6.4
bels
– Sound pressure (idling): 64
dBA
– Sound pressure (operating): 64
dBA
Environment:
v Air temperature:
– On: 10° to 35°C (50.0° to 95°F);
altitude: 30.5 (100 ft) below to 3000 m (9840 ft) above sea level; temperature change: 10°C (18°F) per hour
– Off: -10° to 50°C (14.0° to
120.0°F); maximum altitude: 3000 m (9840 ft); temperature change: 15°C (27.0°F) per hour
v Humidity:
– On: 20% to 80% – Off: 10% to 90% – Maximum dew point: 26°C (79°F) – Maximum humidity gradient:
10% per hour
Heat output:
Approximate heat output in British thermal units (Btu) per hour: v Minimum configuration: 205 Btu (60
watts)
v Maximum configuration 1235 Btu
(361 watts)
Electrical input (ac models):
v Sine-wave input (50 - 60 Hz)
required
v Input voltage low range:
– Minimum: 90 V ac – Maximum: 140 V ac
v Input voltage high range:
– Minimum: 200 V ac – Maximum: 264 V ac
v Approximate input kilovolt-amperes
(kVA): – Minimum: 0.06 kVA – Maximum: 0.38 kVA
Electrical input (dc models):
v Input voltage range:
– Minimum: -42 V dc – Nominal: -48 V dc – Maximum: -60 V dc
v Operating current: 16 A to 11.2 A
Chapter 1. Introduction 5
Table 1. Features and operating specifications (continued)
Notes:
1. Power consumption and heat output vary depending on the number and type of optional features that are installed and the optional power-management features that are in use.
2. These levels are measured in controlled acoustical environments according to the procedures specified by the American National Standards Institute (ANSI) S12.10 and ISO 7779, and are reported in accordance with ISO
9296. Actual sound-pressure levels in a given location might exceed the average stated values because of room reflections and other nearby noise sources. The declared sound-power levels indicate an upper limit, below which a large number of computers will operate.
Models and optional devices
The storage subsystem components and configurations are explained in this topic.
The DS3500 storage subsystem controller cache size, partitions, and other features vary depending on the model and optional devices. Table 2 shows the DS3500 models and options available at the time of publication. Contact your IBM marketing representative or authorized reseller for more information about models and options.
Table 2. DS3500 storage subsystem models and optional devices
DS3512 Dual Controller
DS3524 Single Controller
DS3524 Dual Controller
DS3524 Dual Controller - DC power
v Two controllers each with 1 GB cache (2
GB total)
v Four 6 GB SAS ports v Supports two host interface cards (must
be of same type)
v One controller with 1 GB cache v Two 6 GB SAS ports v Supports one host interface card
v Two controllers each with 1 GB cache (2
GB total)
v Four 6 GB SAS ports v Supports two host interface cards (must
be of same type)
v Two controllers each with 1 GB cache (2
GB total)
v Four 6 GB SAS ports v Supports two host interface cards (must
be of same type)
The following optional features apply to all base configurations of the DS3500 storage subsystem:
v Host Interface Cards:
– 6 Gbps SAS 2-port daughter card – 8 Gbps FC 4-port daughter card (includes two 8 GB SFP transceivers) – 1 Gbps iSCSI 4-port daughter card (Copper) – 10 Gbps iSCSI 2-port daughter card (Copper)
v Additional Hardware Options:
– Second controller (for single-controller base system)
6 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
– 8 Gbps FC SFP transceiver pair – 2 GB cache upgrade (quantity one for single controller, two for dual
controller)
v Premium feature options:
– Turbo performance (requires dual controllers) – Full Disk Encryption (FDE) – Can add up to 192 drives in the storage subsystem
(See Note 1)
– FlashCopy Logical Drive – Other Premium key feature options; these premium features can be activated
using IBM DS Storage Manager 10 controller firmware 7.84 and later:
- Performance Read Cache
- Disaster Recovery Option
v Enhanced Global Mirroring v Enhanced Remote Mirroring
- Backup & Restore Option v Enhanced FlashCopy
- Super Key
v Performance Read Cache v Enhanced Global Mirroring v Enhanced Remote Mirroring v Enhanced FlashCopy
Note:
1. To obtain this optional capability, you must purchase a 96 to 192 drive expansion premium feature.
Operating-system support
This topic discusses the operating systems are supported for the DS3500 storage subsystem.
The following operating systems are supported for host servers that have mapped LUNs created in the DS3500 storage subsystem with storage enclosures:
v IBM AIX v IBM Linux on POWER®(LoP) v Microsoft Windows Server 2003 v Microsoft Windows Server 2008 v Microsoft Windows Server 2012 v Red Hat v SuSE Linux Enterprise Server v VMware ESX Server v Oracle Solaris
For additional host operating-system support, see the latest Storage Manager software readme file and the IBM DS3000 series products interoperability matrix at http://www.ibm.com/systems/storage/disk/.
®
®
Enterprise Linux
Chapter 1. Introduction 7
Product updates
If you need to update your DS3500 storage subsystem, follow the steps below.
Important: To keep your storage subsystem up-to-date with the latest firmware and other product updates, register the storage subsystem for technical support notifications. Go to http://www.ibm.com/servers/storage/support/disk/. From the menu at the top of the page, click My IBM and select My Technical Support. On the next page, click register now.
Download the latest version of the Storage Manager software, DS3500 storage subsystem controller firmware, DS3500 series storage enclosure firmware, and drive firmware when you initially install the storage subsystem and when product updates become available.
To receive product updates, complete the following steps:
1. After you have registered, type your user ID and password to log in to the site.
2. From the Subscribe tab, click Storage disk systems.
3. Click the box next to the product you want to receive information about.
4. Click Continue.
5. Under Notify me by, click e-mail.
6. Click the Submit button to complete the notifications process.
The “My notifications for technical support” page opens.
Best practices guidelines
This topic provides guidelines on best practices during the usage of the DS3500 storage subsystem.
To ensure optimal operation of your system, follow these best practices: v Ensure that the storage subsystem is in an optimal state before you shut it
down. Never turn off the power if any amber LED is lit; be sure to resolve any error conditions before you shut down the storage subsystem.
v Back up the data on your storage drives periodically. v To maintain power redundancy, connect the DS3500 storage subsystem and
EXP3500 storage enclosure right and left power supplies to two independent external power circuits through ac power distribution units (PDUs) inside a rack or directly into external receptacles. This ensures that all devices in the configuration have power when only one power circuit is available. In addition, having all the right or all the left power cables connected to the same power circuit enables the devices in the configuration to power-on simultaneously during an unattended restoration of power.
Note: Do not overload the circuits that power your storage subsystem and storage enclosures. Use additional pairs of ac PDUs. See Table 1 on page 5 for information about storage subsystem power requirements. Contact the technical-support representative for additional information.
v Save the storage subsystem profile before any planned system shutdown or after
any system additions, removals, or modifications (including firmware updates, logical drive creations, storage partitioning definitions, hardware changes, and so on). For instructions to save the storage subsystem profile for DS Storage Manager V10.77 or earlier, see the IBM System Storage DS
Version 10 Installation and Host Support Guide. For DS Storage Manager V10.83 or
®
Storage Manager
8 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
later, see IBM System Storage DS Storage Manager Version 10.8 Installation and Host Support Guide. Save the profile in a location other than in the logical drives that
are created for the DS3500 storage subsystem and EXP3500 storage enclosure.
v During any maintenance or attended power-on procedure, carefully follow the
power-on sequence that is described in “Turning on the storage subsystem” on page 82. Ensure that each component of the storage subsystem is powered-on in the correct order during this entire power-on procedure to ensure that the controller will be able to optimally access all of the storage subsystems.
v The storage subsystem supports simultaneous power-on to the system
components. However, you must always follow the power-on sequence that is described in “Turning on the storage subsystem” on page 82 during any attended power-on procedure.
v A storage subsystem in an optimal state should recover automatically from an
unexpected shutdown and unattended simultaneous restoration of power to system components. After power is restored, call your IBM technical-support representative if any of the following conditions occur:
– The storage subsystem logical drives and subsystems do not display in the
Storage Manager graphical user interface. – The storage subsystem logical drives and subsystems are not online. – The storage subsystem logical drives and subsystems seem to be degraded.
v When using dc models equipped with dc power supply and fan units, install the
dc disconnect/breaker device as described in “Cabling the DS3500 and EXP3500 dc power supplies” on page 78.
Attention:
– The disconnect device (circuit breaker) must be rated at 20 A. – Ensure that only 12 AWG or larger copper conductor wires are used for all of
the wiring between the DS3500 or EXP3500 dc power connectors and the dc
power source.
DS3500 storage subsystem and EXP3500 storage enclosure components
The DS3500 storage subsystem and EXP3500 storage enclosures have removable components, as described in this topic.
The DS3500 storage subsystem and EXP3500 storage enclosures have the following removable components. These components, called customer replaceable units (CRUs), are accessible from the front or rear of the storage subsystem.
v (DS3512 and EXP3512) Up to 12 LFF 3.5–inch 6 Gbps SAS or NL SAS drives and
drive filler panels.
v (DS3524 and EXP3524) Up to 24 SFF 2.5–inch 6 Gbps SAS, NL SAS, or SSD
drives and drive filler panels.
v (DS3512 and DS3524) Up to two controllers. Each controller supports the
installation one of the following optional host port adapters: – 6 Gbps SAS – 8 Gbps FC – 1 Gbps iSCSI – 10 Gbps iSCSI
v (EXP3512 and EXP3524) Up to two ESM modules. v Two ac power supply and fan units (machine type 1746 models C2A, E2A, C4A,
and E4A).
Chapter 1. Introduction 9
v Two dc power supply and fan units (machine type 1746 models C4T and E4T).
Disk drives and bezels
An in-depth look at how disk drives and bezels are set up in the DS3500 storage subsystem.
The hot-swap drive bays that are accessible from the front of the DS3512 storage subsystem and EXP3512 storage enclosure are shown in Figure 2. The hot-swap drive bays that are accessible from the front of the DS3524 storage subsystem and EXP3524 storage enclosure are shown in Figure 3.
Hot-swap hard disk drive
Bezels
Figure 2. DS3512 storage subsystem and EXP3512 storage enclosure hot-swap drive bays and bezels
Filler panel
Figure 3. DS3524 storage subsystem and EXP3524 storage enclosure hot-swap drive bays and bezels
Hot-swap drive
You can install up to 12 hot-swap SAS or NL SAS drives in the DS3512 storage subsystem and EXP3512 storage enclosure. You can install up to 24 hot-swap SAS or NL SAS drives in the DS3524 storage subsystem and EXP3524 storage enclosure.
Filler panel
The DS3500 storage enclosure and EXP3500 storage enclosure have filler panels in the empty drive bays. Before you install a disk drive, remove the filler panel and save it for future use. Each of the drive bays must contain either a filler panel or a drive.
Left-side bezel
The left-side bezel contains the LEDs, as shown in the following illustration. For a description of the LEDs, see “Front LEDs” on page 89.
10 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Power-on LED
System locator LED
Overtemperature LED
System error LED
Standby power LED
Figure 4. Left-side bezel
Right-side bezel and bottom shelf
The right-side bezel and bottom shelf contain the drive identification information. Figure 5 shows the right-side bezel of the DS3512 storage subsystem and EXP3512 storage enclosure. Figure 6 shows the bottom shelf of the DS3524 storage subsystem and EXP3524 storage enclosure.
Drives 1 - 4
Drives 5 - 8
Drives 9 - 12
Figure 5. Right-side bezel (DS3512 and EXP3512)
1 2 3 4 5 6 7 8 91011 1213 141516171819 20212223 24
Drives 1 - 24
Figure 6. Bottom shelf (DS3524 and EXP3524)
The drives are preinstalled in drive enclosures. Install drives in the drive bays on the front of the storage subsystem or storage enclosure. When a drive is installed, the drive and enclosure bay designation is set automatically. The hardware addresses are based on the enclosure ID setting on the controller and on the physical locations of the drives.
There are no serviceable parts in a drive assembly. If it fails, the whole drive assembly, along with the drive, bezel, and enclosure, must be replaced. When you
Chapter 1. Introduction 11
replace a drive, ensure that you order the correct drive. Using an unsupported drive can cause the drive to be locked out by the controller firmware.
Attention:
1. After you remove a drive from a bay, wait for 70 seconds to allow the drive to spin down before you replace or reseat the drive. Failure to do so might cause unpredictable results.
2. Never hot-swap a drive when its associated green activity LED or amber fault LED is flashing. Hot-swap a drive only when its associated amber fault LED is lit continuously or when the drive is inactive and its associated green activity LED is not flashing.
Note: If the drive that you want to remove is not in a failed or bypass state, use the Storage Manager software either to place the drive in a failed state or to place the subsystem that is associated with the drive (or drives) in an offline state, before you remove the drive from the enclosure.
Controllers
The DS3500 storage subsystem controllers are discussed in this topic.
The DS3500 storage subsystem comprises one or two controllers. When the DS3500 storage subsystem has two controllers, the controllers are redundant and can be hot-swapped. The controllers contain the storage subsystem control logic, interface ports, and LEDs. Each controller contains the following ports:
v Two 6 Gbps SAS host ports v One SAS drive port to connect EXP3500 storage enclosures v Two Ethernet ports for subsystem management v Support for one optional host port adapter:
– Two-port 6 Gbps SAS – Four-port 8 Gbps FC – Four-port 1 Gbps iSCSI – Two-port 10 Gbps iSCSI
The Ethernet ports consist of the following default IP addresses:
Port 1 on controller A is 192.168.128.101 Port 2 on controller A is 192.168.129.101 Port 1 on controller B is 192.168.128.102 Port 2 on controller B is 192.168.129.102
The subnet mask for both Ethernet ports is 255.255.255.0.
Attention: When a DS3500 storage subsystem has two controllers, the controllers must be identical to each other in hardware (host port adapter and cache size) and firmware. If you install a host port adapter in one controller, you must install an identical host port adapter in the other controller.
The storage management software automatically sets the enclosure ID for the controllers. You can change the enclosure ID through the Storage Manager software only. There are no switches on the DS3500 chassis to manually set the enclosure ID. Both controller enclosure IDs are identical under normal operating conditions.
Figure 7 on page 13 shows a single-controller storage subsystem without an optional host port adapter installed. See “Cabling the DS3500 storage subsystem” on page 31 for illustrations of the storage subsystem with optional host port
12 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
adapters installed in the controllers.
Password reset
Figure 7. Rear view, single-controller model (shown without an optional host port adapter)
RAID controller A
Hot-swap power supplies
Note: IBM DS Storage Manager password reset: Password reset clears the password to log in to the IBM DS Storage Manager. Press this button if you have forgotten the password.
Environmental service modules
The EXP3500 storage enclosure comprises a single environmental service module (ESM). An optional ESM is available for redundant configurations.
If the controller connected to the ESM supports more than one EXP3500 storage enclosure per physical port, you can connect two or more EXP3500 storage enclosures by chaining them together. For information about connecting an EXP3500 storage enclosure to a DS3500 storage subsystem, see “Connecting storage enclosures to the DS3500” on page 48.
Filler panel
dg1fy035
Figure 8 shows an EXP3512 storage enclosure containing one ESM and a filler panel over the blank ESM bay.
ESM
1 2
ESM
Hot-swap power supplies
Figure 8. Rear view, single ESM model storage enclosure
AC power supply and fan units
The DS3500 storage subsystem (models DS3512-C2A and DS3524-C4A) and EXP3500 storage enclosure (models EXP3512-E2A and EXP3524-E4A) each have two removable ac power supplies.
Each ac power supply has two fans. The four fans pull air through the drives from front to back across the drives. The fans provide redundant cooling, which means that if one fan fails, the remaining fans continue to provide sufficient cooling to operate the storage subsystem or storage enclosure. If one power supply is turned
Filler panel
Chapter 1. Introduction 13
off or malfunctions, the other power supply maintains electrical power to the storage subsystem or storage enclosure. To preserve the optimal airflow, do not remove a failed power supply from the chassis until you are ready to replace it with a new power supply.
Figure 9 shows the ac power supply components.
Powe r connector
Figure 9. AC power supply components
Powe r switch
DC power supply and fan units
The DS3524 storage subsystem (model C4T) and EXP3524 storage enclosure (model E4T) each have two removable dc power supplies. Each dc power supply has two fans.
The four fans pull air through the drives from front to back across the drives. The fans provide redundant cooling, which means that if one fan fails, the remaining fans continue to provide sufficient cooling to operate the storage subsystem or storage enclosure. If one power supply is turned off or malfunctions, the other power supply maintains electrical power to the storage subsystem or storage enclosure. To preserve the optimal airflow, do not remove a failed power supply from the chassis until you are ready to replace it with a new power supply.
Figure 10 shows the dc power supply components.
Powe r connector
Powe r switch
Figure 10. DC power supply components
Figure 11 and Table 3 on page 15 below show the location and describe the function of the dc power supply connector pins.
Figure 11. DC power supply connector - pin positions
14 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Powe r connector
Powe r switch
Powe r switch
Powe r connector
Table 3. DC power supply connector - pin descriptions
Number Description
1 Pin1:-48Vdc 2 Pin 2: POS RTN 3 Pin 3: GND
Battery units
Each controller contains 1024 MB of cache memory (minimum). It also contains a sealed, rechargeable lithium ion battery that maintains data in the cache so that it can be transferred to flash memory if power fails.
Figure 12 shows the locations of the battery and memory cache DIMM in the controller.
Host adapter or filler panel
Memory cache DIMM
Battery connector
Memory cache battery
Captive fastener
Figure 12. Battery unit
The battery chargers in the power supplies perform a battery learn test when the storage subsystem is started for the first time and at a scheduled interval thereafter. Data caching starts after the battery tests are completed.
The condition of the battery is indicated by an LED on the rear of the controller (see “Controller LEDs” on page 90 for the location of the battery fault LED and conditions that the LED indicates). You can also check the status of the battery using the Storage Manager client software.
Software and hardware compatibility and upgrades
The latest controller firmware, NVSRAM firmware, ESM firmware, and drive firmware must be installed to ensure optimal functionality, manageability, and reliability.
Software and firmware support code upgrades
To enable support for the DS3500 storage subsystem, you must ensure that the system software and firmware are of the latest versions. To find the latest Storage Manager software, controller firmware, NVSRAM, ESM firmware, and drive firmware, check the firmware readme files.
Chapter 1. Introduction 15
The DS3500 was initially shipped with controller firmware version 7.70.16.01. With controller firmware version 7.77.xx.xx, the following capabilities and support are available:
v Standard feature extended capabilities added with controller firmware version
7.77.xx.xx: – The number of supported logical drives per subsystem is increased to 512
from 256.
– The number of logical drives that can be assigned to a host partition is
increased to 256 from 32.
v Premium feature extended capabilities added with controller firmware version
7.77.xx.xx: – The number of drives per subsystem can be increased to 192 from 96. To
obtain this optional capability, you must purchase a 96 to 192 drive expansion premium feature.
– The number of host partitions supported per subsystem can be increased to
128 from 64. To obtain this optional support, you must purchase the appropriate host partition upgrade premium feature for the currently enabled 4, 8, 16, 32 or 64 host partitions.
– The number of FlashCopy logical drives per subsystem is increased to 256
from 64. To obtain this capability, you must purchase a FlashCopy premium feature. No additional purchase is required.
– The number of VolumeCopy logical drives per subsystem is increased to 256.
To obtain this optional capability, you must purchase a VolumeCopy premium feature. No additional purchase is required.
– The number of remote mirroring logical drives can be increased to 16 from 8.
To obtain this optional support, you must purchase an 8 to 16 mirrors upgrade premium feature in addition to the standard remote mirroring premium feature.
v Hardware support added with controller firmware version 7.77.xx.xx:
– 10 Gbps iSCSI host card – DS3524 model with DC power supplies
v The controller firmware version 7.83.xx.xx supports the following features:
– Dynamic disk pooling – Thin provisioning – Enhanced FlashCopy – ALUA fail-over method
v The controller firmware version 7.84.xx.xx supports the following features:
– Disaster Recovery Option (Enhanced FlashCopy) – Backup & Restore Option (Remote Mirroring and Enhanced Remote
Mirroring) – Performance Read Cache – Super Key (this key activates all features)
v In addition to supporting the above features, controller firmware version
7.86.xx.xx supports the following hard disk feature: – T10 Protection Information (T10 PI or T10PI).
For instructions to install the DS Storage Manager V10.77 or earlier, see the IBM System Storage DS Storage Manager Version 10 Installation and Host Support Guide. For instructions to install the DS Storage Manager V10.83 or later, see the IBM System Storage DS Storage Manager Version 10.8 Installation and Host Support Guide.
16 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Determining firmware levels
To determine the firmware levels of the DS3500 storage subsystem, the connected storage enclosures, and the installed drives, use the Storage Manager software that is used to manage the DS3500 storage subsystem.
1. In the Subsystem Management window, click the Summary tab.
2. In the Status section, click Storage Subsystem Profile. The Storage Subsystem
Profile window opens.
3. Click the All tab and scroll through the Profile For Storage Subsystem to locate the following information:
Note: The Profile For Storage Subsystem contains profile information for the entire subsystem. Therefore, you might have to scroll through a large amount of information to locate the firmware version numbers.
DS3500 Storage Server
v Firmware version v NVSRAM version
Hard Disk Drives
v Firmware version
Drive Enclosure
v ESM firmware version
Specifications
Area requirements
Specifications of the DS3500 storage subsystem are covered in this topic.
The specifications of the DS3500 storage subsystem and EXP3500 storage enclosure are listed in Table 1 on page 5. This section provides additional site specifications for the DS3500 storage subsystem and EXP3500 storage enclosure. Before you install the storage subsystem, you must either check that the planned installation site meets these requirements, or prepare the site so that it meet these requirements. Preparations might include area, environmental, and electrical requirements for DS3500 storage subsystem and EXP3500 storage enclosure installation, service, and operation.
The floor space at the installation site must support the weight of the storage subsystem and associated equipment; provide sufficient space to install, operate, and service the storage subsystem; and provide sufficient ventilation to provide free flow of air to the unit.
Dimensions
The dimensions of the DS3500 storage subsystem is explained in this topic.
Figure 13 on page 18 shows the dimensions of the DS3512 storage subsystem and EXP3512 storage enclosure, which conforms to the 19-inch rack standard.
Chapter 1. Introduction 17
8.6 cm (3.4 in.)
44.9 cm (17.7 in.)
54.0 cm (21.3 in.)
48.2 cm (19 in.)
Figure 13. DS3512 storage subsystem and EXP3512 storage enclosure dimensions
Figure 14 shows the dimensions of the DS3524 storage subsystem and EXP3524 storage enclosure, which conforms to the 19-inch rack standard.
44.9 cm (17.7 in.)
8.8 cm (3.5 in.)
48.7 cm (19.2 in.)
48.2 cm (19 in.)
Figure 14. DS3524 storage subsystem and EXP3524 storage enclosure dimensions
Weight
The weight for each component of the DS3500 storage subsystem is listed here.
The total weight of the storage subsystem and storage enclosure depends on the number of installed components. Table 4 lists the maximum and empty weights for the DS3512 storage subsystem and EXP3512 storage enclosure in different configurations. Table 5 on page 19 lists the maximum and empty weights for the DS3524 storage subsystem and EXP3524 storage enclosure in different configurations. Table 6 on page 19 lists the weight of each component.
Table 4. DS3512 storage subsystem and EXP3512 storage enclosure weights
Model Maximum
DS3512 27.0 kg (59.6 lb) EXP3512 26.3 kg (57.9 lb)
18 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
1
Empty
2
8.4 kg (18.5 lb)
Table 4. DS3512 storage subsystem and EXP3512 storage enclosure weights (continued)
Model Maximum
1
Chassis with dual controller or ESMs and 12 drives.
2
Chassis without power supplies, controllers or ESMs, and drive filler panels.
1
Empty
2
Table 5. DS3524 storage subsystem and EXP3524 storage enclosure weights
Model Maximum
DS3524 with ac power
25.9 kg (57.1 lb)
1
Empty
2
supply and fan units DS3524 with dc power
supply and fan units EXP3524 with ac power
25.85 kg (56.99 lb)
25.2 kg (55.5 lb)
10.7 kg (23.6 lb)
supply and fan units EXP3524 with dc power
25.15 kg (55.45 lb)
supply and fan units
1
Chassis with dual controller or ESMs and 24 drives.
2
Chassis without power supplies, controllers or ESMs, and drive filler panels.
Table 6. DS3500 component weights
Unit Weight
2.5–inch drive 0.25 kg (0.55 lb)
3.5–inch drive 0.78 kg (1.72 lb)
AC power supply with fan 2.50 kg (5.31 lb) DC power supply with fan 2.36 kg (5.21 lb) Controller (including cache battery backup
2.05 kg (4.52 lb)
and no host port adapter) Fibre channel host daughter card .08 kg (.18 lb) iSCSI host daughter card .05 kg (.11 lb) SAS host daughter card .07 kg (.15 lb) Battery .15 kg (.33 lb) ESM 1.75 kg (3.86 lb)
Temperature and humidity
The temperature and humidity requirements to operate the DS3500 storage subsystem are specified in this topic.
Table 7 on page 20 lists the acceptable temperature and humidity ranges for the storage subsystem in typical Information Technology (IT) or office environments.
Chapter 1. Introduction 19
Table 7. Temperature and humidity requirements for storage subsystems in an Information Technology (IT) or office environment
Condition Parameter Requirement
Temperature (storage subsystem On)
Operating range 10° to 35°C (50.0° to 95°F) Altitude 30.5 (100 ft) below to 3000 m
(9840 ft) above sea level
Maximum rate of change 10°C (18°F) per hour
Relative humidity (storage subsystem On)
Operating range 20% to 80% Maximum dew point 26°C (79°F) Maximum humidity gradient 10% per hour
Temperature (storage subsystem Off)
Operating range -10° to 50°C (14.0° to 120.0°F) Maximum altitude 3000 m (9840 ft) Maximum rate of change 15°C (27.0°F) per hour
Relative humidity (storage subsystem Off)
Operating range 10% to 90% Maximum dew point 26°C (79°F) Maximum humidity gradient 10% per hour
Note:
1. The non-operating environment must not exceed the environment limits for more than 60 days.
2. The storage environment must not exceed the environment limits for more than one year.
3. Substantial deviations from the suggested operating range, in either direction, if sustained for extended periods of time, will expose the unit to greater risk of failure from external causes.
Table 8 lists temperature and humidity ranges for the storage subsystem in a NEBS/ETSI compliant environment.
Table 8. Temperature and humidity requirements for storage subsystems in a NEBS/ETSI compliant environment
Condition Parameter Requirement
Temperature
Relative humidity
1
1
(no
condensation)
Note:
1. In a NEBS/ETSI compliant environment, conditions are measured at a location 1.5 m (59 in.) above the floor and 400 mm (15.8 in.) in front of the equipment.
2. Short-term refers to a period of not more than 96 consecutive hours and a total of not more than 15 days in one year. (This refers to a total of 360 hours in any given year, but no more than 15 occurrences during that one-year period.)
Electrical requirements
The electrical requirements to operate the DS3500 storage subsystem are specified in this topic.
Operating range 5° - 40° C (41° - 104° F) Short-term
2
-5° - 50° C (23° - 122° F) Maximum rate of change 30° C (54° F) per hour Operating range 5% to 85% Short-term
2
5% to 90% (not to exceed
0.024 kg water/kg of dry air)
20 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Consider the following information when you prepare the installation site: v Protective ground: Site wiring must include a protective ground connection to
the ac power source.
Note: Protective ground is also known as safety ground or chassis ground.
v Circuit overloading: Power circuits and associated circuit breakers must provide
sufficient power and overload protection. To prevent possible damage to the unit, isolate its power source from large switching loads (such as air conditioning motors, elevator motors, and factory loads).
v Power failures: If a total power failure occurs, the unit automatically performs a
power-on recovery sequence without operator intervention after power is restored.
Site wiring and power
The site wiring and power requirements to operate the DS3500 storage subsystem are specified in this topic.
The DS3500 storage subsystem (models DS3512-C2A and DS3524-C4A) and EXP3500 storage enclosure (models EXP3512-E2A and EXP3524-E4A) are equipped with redundant ac power supply and fan units. The storage subsystem ac power supplies are wide-ranging units that automatically accommodate voltages to the ac power source. The power supplies operate within the range of 90 V ac to 264 V ac, at a minimum frequency of 50 Hz and a maximum frequency of 60 Hz. The power supplies meet standard voltage requirements for operation both inside the U.S.A. and outside the U.S.A. They use standard industrial wiring with line-to-neutral or line-to-line power connections. The ac power supplies have C14 power inlets.
Power requirements for models equipped with ac power supplies are shown in Table 9.
Table 9. DS3500 ac power requirements
Low range High range
Nominal voltage 90 V ac to 140 V ac 200 V ac to 264 V ac Frequency (Hz) 50 to 60 Hz 50 to 60 Hz Approximate input
kilovolt-amperes (kVA)
Minimum 0.06 kVA to maximum 0.38 kVA
The DS3524 model C4T storage subsystem and EXP3524 model E4T storage enclosure are equipped with redundant dc power supply and fan units. The storage subsystem dc power supplies are wide-ranging units that automatically accommodate voltages to the dc power source. The dc power supplies operate within the range of -42 V dc to -60 V dc. The dc power supplies require a reliably grounded safety extra-low voltage SELV source and an approved and rated 20 A disconnect device for the -48 V line.
Power requirements for models equipped with dc power supplies are shown in Table 10.
Table 10. DS3500 dc power requirements
Requirement
Operating voltage -42 V to -60 V Nominal voltage -48 V
Chapter 1. Introduction 21
Table 10. DS3500 dc power requirements (continued)
Requirement
Operating current 16 A to 11.2 A Rated disconnect device (circuit-breaker) 20 A
Power recovery
After normal power is restored after a total ac or dc power failure, the storage subsystem performs power-on recovery procedures automatically without operator intervention.
Power cords and receptacles
The specifications of power cords and receptacles required to operate the DS3500 storage subsystem are listed in this topic.
Storage subsystems equipped with ac power supply and fan units come with two ac jumper cords that are used to connect to the rack PDU. You must purchase the power cords that are applicable for use in a typical receptacle in your country. See “Power cords” on page 179 for more information.
Storage subsystems equipped with dc power supply and fan units come with two dc jumper cables that are used to connect to the site -48 V dc power source. The supplied dc jumper cables have 10 AWG copper conductor wires. 12 AWG or larger copper conductor wires must be used for all of the wiring between the DS3500 or EXP3500 dc power connectors and the dc power source. See the “DS3524 storage subsystem and EXP3524 storage enclosure parts listing” on page 177 for more information.
Heat output, airflow, and cooling
The heat output, airflow, cooling configurations requirements, and best practices to operate the DS3500 storage subsystem are specified in this topic.
Air enters at the front of the DS3500 storage subsystem and EXP3500 storage enclosure and leaves at the back. Allow at least 30 inches in front of the DS3500 storage subsystem and EXP3500 storage enclosure and at least 24 inches at the rear for service clearance, proper ventilation, and heat dissipation.
When racks that contain many DS3500 storage subsystems and EXP3500 storage enclosures are to be installed together, the following requirements must be met to ensure that the devices are adequately cooled:
v Air enters at the front of the rack and leaves at the back. To prevent the air that
is leaving the rack from entering the intake of another piece of equipment, you must position the racks in alternate rows, back-to-back and front-to-front. This arrangement is known as “cold aisle/hot aisle” and is shown in Figure 15 on page 23.
v Where racks are in rows, each rack must touch the rack that is next to it to
reduce the amount of hot air that can flow around from the back of the rack into the intakes of the storage enclosures that are in that rack. Use Suite Attach Kits to completely seal any gaps that remain between the racks. For details about Suite Attach Kits, contact your IBM marketing representative or authorized reseller.
v Where racks are in rows front-to-front or back-to-back, gaps of at least 122 cm
(48 in.) must separate the rows across the cold aisle (see Figure 15 on page 23).
22 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
v To correct airflow in each rack, the rack filler plates must be installed in unused
positions. Also, all the gaps in the front of the racks must be sealed, including the gaps between the storage subsystems.
back
T42 racks
front
120 cm (48 in.)
cold aisle width
Air
Cold aisle
front
T42 racks
back
conditioner
Hot aisle
back
T42 racks
front
Airflow
Figure 15. Example of cold aisle/hot aisle rack configuration
Perforated tiles or gratings
244 cm (96 in.) between
center lines of hot
and cold aisle
Chapter 1. Introduction 23
24 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Chapter 2. Installing the storage subsystem and storage enclosure
This section provides instructions for installing the DS3500 storage subsystem and the EXP3500 storage enclosure in a rack.
To install the DS3500 storage subsystem in a rack, see Chapter 2, “Installing the storage subsystem and storage enclosure.” To install the EXP3500 storage enclosure in a rack, see “Installing the EXP3500 storage enclosure” on page 29.
Before you begin the installation, review the safety information in “Safety” on page ix and “Handling static-sensitive devices” on page 27.
Installing the DS3500 storage subsystem
This section provides instructions for installing the DS3500 storage subsystem in a rack.
Inventory checklist
Guidelines on verifying the inventory checklist is listed here.
After you unpack the DS3500 storage subsystem, ensure that you have the following items. Depending on your order, your shipping box might contain additional items that are not on the list.
v Hardware
– Hard disk drives or drive filler panels:
- DS3512 (12)
- DS3524 (24) – Storage controllers (up to 2) – AC power supply and fan units (2) (models C2A, E2A, C4A, and E4A) – DC power supply and fan units (2) (models C4T and E4T) – AC power cables (2 jumper line cords) (models C2A, E2A, C4A, and E4A) – DC power jumper cables (2) (models C4T and E4T) – Rack installation hardware kit:
- Support rails (2) (right and left assembly)
- M5 black hex-head slotted screws (8)
- M5 Washers (6)
- Small diameter spacers (8) (these come installed, four in each rail)
- Large diameter spacers (8)
- M4 pan-head screws (2)
Attention: The DS3500 storage subsystem ac power models do not have region-specific power cords. You must obtain the IBM-approved ac power cords for your region. The DS3500 and EXP3500 dc power models do not have the 20 A rated disconnect device (circuit-breaker) that is required for the -48V DC power connection. See “Power cords” on page 179 for the IBM-approved ac power cords for your region.
v Software and documentation
© Copyright IBM Corp. 2010, 2013 25
– IBM System Storage DS3500 Support DVD
The support DVD contains the IBM Storage Manager host software. The DVD also includes online help, and the following documentation in Adobe Acrobat Portable Document Format (PDF):
- IBM System Storage DS3500 and EXP3500 Storage Subsystem Installation,
User's, and Maintenance Guide (this document)
- IBM System Storage DS Storage Manager Version 10 Installation and Host
Support Guide (for DS Storage Manager V10.77 or earlier) and IBM System Storage DS Storage Manager Version 10.8 Installation and Host Support Guide
(for DS Storage Manager V10.83 or later)
- IBM Systems Safety Notices
IBM System Storage DS3500 and EXP3500 Rack Installation and Quick Start Guide The box will contain Premium features activation or entitlement kits if you
ordered for them.
If an item is missing or damaged, contact your IBM marketing representative or authorized reseller.
DS3500 installation overview
Certain guidelines need to be followed during the installation of the DS3500 storage subsystem and the EXP3500 storage enclosures. Refer to the following guidelines for better understanding of the procedure.
CAUTION:
>18 kg (39.7 lb)
or
The weight of this part or unit is between 18 and 32 kg (39.7 and 70.5 lb). At least two people should lift this component (C009).
Attention: A fully configured DS3500 storage subsystem weighs up to 27 kg (60
lb). At least two people should lift the DS3500 storage subsystem from the shipping box. Before you lift it out of the box, you might want to open the sides of the shipping box and remove the components from the DS3500 storage subsystem, so that the storage subsystem is lighter and easier to remove.
Complete the following steps to install the storage subsystem:
1. Review the preparation recommendations. See “Preparing for installation” on page 28.
2. Prepare the installation site. See “Preparing the site” on page 29.
3. Prepare the rack. See the DS3500 and EXP3500 Rack Installation and Quick Start
Guide.
4. Record the serial number, machine type and model number, and controller MAC addresses for your DS3500 storage subsystem in “Storage subsystem and controller information record” on page 184. See Figure 1 on page 2 for the location of the serial number.
The MAC addresses are labeled near the Ethernet port on each controller.
18-32 kg (39.7-70.5 lb)
or
26 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
5. Install and secure the DS3500 chassis and components in the rack. See the
DS3500 and EXP3500 Rack Installation and Quick Start Guide.
6. Install the storage enclosure in the rack, if you are installing one or more storage enclosures. Follow the instructions in the DS3500 and EXP3500 Rack Installation and Quick Start Guide.
7. Cable the DS3500 storage subsystem to the storage enclosures. See “Connecting storage enclosures to the DS3500” on page 48.
8. Complete one of the following cabling tasks to enable management of the DS3500 configuration:
v If you are using out-of-band management, cable the DS3500 Ethernet ports
to either the management workstation or the host.
v If you are using in-band management, cable the DS3500 hosts to the host
bus adapters (HBAs) in the hosts. See “Connecting iSCSI hosts to the DS3500” on page 70.
9. Connect the power cables. See “Cabling the DS3500 and EXP3500 ac power supplies” on page 77 for models equipped with ac power supply and fan units or “Cabling the DS3500 and EXP3500 dc power supplies” on page 78 for models equipped with dc power supply and fan units.
10. Power on the storage enclosure and the DS3500 storage subsystem, using the procedure in “Turning on the storage subsystem” on page 82.
11. Install the DS Storage Manager host software on the management workstation
(for out-of-band management) or on the host (for in-band management). For instructions to install the DS Storage Manager V10.77 or earlier, see the
IBM System Storage DS Storage Manager Version 10 Installation and Host Support Guide. For instructions to install the DS Storage Manager V10.83 or later, see the IBM System Storage DS Storage Manager Version 10.8 Installation and Host Support Guide.
12. Check configuration using the Storage Manager host software.
13. Review and complete the procedures in “Performing the health check process”
on page 81.
Handling static-sensitive devices
Guidelines for the handling of static-sensitive devices, such as the DS3500 storage subsystem and the EXP3500 storage enclosures is provided.
Attention: Static electricity can damage the storage subsystem and other electronic devices. To avoid damage, keep static-sensitive devices in their static-protective packages until you are ready to install them.
To reduce the possibility of electrostatic discharge, observe the following precautions:
v Limit movement, so that static electricity does not build up around you. v Handle the device carefully, holding it by its edges or its frame. v Do not touch solder joints, pins, or exposed printed circuitry. v Do not leave the device in a place where other devices can cause damage. v While the device is still in its static-protective package, touch it to an unpainted
metal part of the system unit for at least 2 seconds. This drains static electricity from the package and from your body.
Chapter 2. Installing the storage subsystem and storage enclosure 27
v Remove the device from its package and install it directly into the system unit
without setting it down. If it is necessary to set down the device, put it back into its static-protective package. Do not place the device on the system unit cover or on a metal surface.
v Take additional care when you handle devices during cold weather. Heating
reduces indoor humidity and increases static electricity.
Preparing for installation
This topic prepares you for the DS3500 storage subsystem and the EXP3500 storage enclosure installation.
Before you install the DS3500 storage subsystem, create a detailed plan of how the device will be used in the storage configuration. The plan should include RAID levels, failover requirements, operating systems that are to be used, and total storage capacity requirements.
To prepare the DS3500 storage subsystem for installation in a rack, complete the following steps:
1. Prepare the site for installation. For more information, see “Specifications” on page 17.
2. Move the shipping box that contains the DS3500 to the site.
CAUTION:
>18 kg (39.7 lb)
or
The weight of this part or unit is between 18 and 32 kg (39.7 and 70.5 lb). At least two individuals are required to safely lift this part or unit. (C009)
3. Ensure that you have the correct host software for your operating system.
The support DVD that is shipped with the DS3500 has the correct Storage Manager host software. The DVD also includes the storage subsystem controller firmware. For the latest controller firmware, see http://www.ibm.com/servers/storage/ support/disk/.
4. Read the applicable readme files that are included in the Storage Manager host software or DS3500 controller firmware packages for any updated information about hardware, software, or firmware products.
5. Continue with “Required tools and hardware.”
18-32 kg (39.7-70.5 lb)
or
Required tools and hardware
The tools and hardware that are required to install the DS3500 storage subsystem are listed here.
Keep the following tools and equipment ready:
v Region-specific power cords v 5/16 (8 mm) hex nut driver v #0 and #1 Phillips screwdrivers v Electrostatic-discharge protection (such as a grounding wrist strap)
28 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
v Rack power jumper cords v Rack-mounting hardware v Ethernet interface cables and cable straps (depending on configuration) v SAS cables (depending on configuration) v Fibre Channel cables, interface cables, and cable straps (depending on
configuration)
v SFP modules (depending on configuration)
Preparing the site
This section lists the floor space requirements and weight information for the DS3500. For information about interface cables and connections, see Chapter 3, “Cabling the storage subsystem and storage enclosure,” on page 31.
The floor area at the installation site must have:
v Sufficient space to install the DS3500 storage subsystem v Enough stability to support the weight of the fully configured DS3500 storage
subsystem and associated devices (see “Weight” on page 18).
Ensure that all requirements, such as floor space, air conditioning, and electrical service, are met. Other site preparation activities include:
v Ensuring that there is enough room to move around the rack and install the
modules.
v Installing uninterruptible-power-supply devices. v Installing, if applicable, host servers with host bus adapters (HBAs), switches, or
other devices.
v Routing interface cables from the HBA ports in the hosts or switches to the
installation area.
v Routing main power cords to the installation area.
Continue with “Installing the DS3500 storage subsystem in a rack.”
Installing the DS3500 storage subsystem in a rack
To install the DS3500 in a rack, follow the instructions in the DS3500 and EXP3500 Rack Installation and Quick Start Guide. Then, continue with Chapter 3, “Cabling the
storage subsystem and storage enclosure,” on page 31.
Installing the EXP3500 storage enclosure
This section provides instructions for installing the EXP3500 storage enclosure in a rack. The EXP3500 connects to a DS3500 storage subsystem.
Inventory checklist
After you unpack the EXP3500 storage enclosure, ensure that you have the following items. Depending on your order, the shipping box might contain additional materials that are not in the following list.
v Hardware:
– Hard disk drives or drive filler panels:
- EXP3512 (12)
- EXP3524 (24)
– ESMs (up to 2)
Chapter 2. Installing the storage subsystem and storage enclosure 29
– Power supplies (2) – Power cables (2 jumper line cords) – Rack installation hardware kit:
- Support rails (2) (right and left assembly)
- M5 black hex-head slotted screws (8)
- M5 Washers (6)
- Small diameter spacers (8) (these come installed, four in each rail)
- Large diameter spacers (8)
- M4 pan-head screws (2)
v Printed documents:
IBM System Storage DS3500 and EXP3500 Rack Installation and Quick Start Guide
v Online documents:
– IBM System Storage DS3500 and EXP3500 Storage Subsystem Installation, User's,
and Maintenance Guide (this document)
IBM Systems Safety Notices
All documents are available on the IBM Documentation CD or from the IBM support Web site at http://www.ibm.com/servers/storage/support/.
Installing the EXP3500 storage enclosure in a rack
You can install the EXP3500 storage subsystem in an Electronic Industries Association (EIA) 310 standard rack. For complete rack installation instructions, see IBM System Storage DS3500 and EXP3500 Rack Installation and Quick Start Guide.
30 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Chapter 3. Cabling the storage subsystem and storage enclosure
This section provides information and instructions for cabling the DS3500 storage subsystem and the EXP3500 storage enclosure.
To cable the DS3500 storage subsystem, see “Cabling the DS3500 storage subsystem.” To cable the EXP3500 storage enclosure, see “Cabling the EXP3500 storage enclosure” on page 45.
Cabling the DS3500 storage subsystem
The section provides information and instructions for cabling the DS3500 storage subsystem. After the storage subsystem is installed in its permanent location, you must cable it to hosts, drives, and other external devices, depending on the hardware configuration.
Controller connectors (with Fibre Channel host port adapters)
Figure 16 shows the optional Fibre Channel host port adapter installed in both controllers on the rear panel of the DS3500 storage subsystem.
Password Reset
SAS host port 2
SAS host port 1
Ethernet ports
Serial port
Controller A
Fibre channel host port 3
Fibre channel host port 4
Fibre channel host port 5
Fibre channel host port 6
Drive expansion port
Password Reset
Controller B
Figure 16. Dual-controller DS3500 storage subsystem ports and controllers (with optional Fibre Channel host port adapter)
Fibre Channel host ports
Drive expansion port
Controller connectors (with 1 Gbps iSCSI host port adapters)
Figure 17 on page 32 shows the optional 1 Gbps iSCSI host port adapter installed in both controllers on the rear panel of the DS3500 storage subsystem.
© Copyright IBM Corp. 2010, 2013 31
Seven-segment numeric display
dg1fy065
Each Fibre Channel host port supports a small-form-factor pluggable (SFP) transceiver and is capable of operating at 8 Gbps, 4 Gbps, or 2 Gbps.
The drive expansion port is an x4 multilane SAS port. Connect a SAS cable to this port and to a drive storage enclosure.
Password Reset
SAS host port 2
SAS host port 1
Ethernet ports
Serial port
Controller A
iSCSI host port 3
iSCSI host port 4
iSCSI host port 5
iSCSI host port 6
Drive expansion port
Password Reset
Controller B
Seven-segment numeric display
dg1fy070
Figure 17. Dual-controller DS3500 storage subsystem ports and controllers (with optional iSCSI host port adapter)
1 Gbps iSCSI host ports
The 1 Gbps iSCSI host ports are auto-negotiated 100/1000 Mbps Ethernet ports that support iSCSI offload. The host ports also provide support for both Internet Protocol version 4 (IPv4) and IPv6, and have the advanced networking functions of jumbo frames, IEEE 802.1p, and virtual local area network (VLAN) support.
Drive expansion port
The drive expansion port is an x4 multilane SAS port. Connect a SAS cable to this port and to a drive storage enclosure.
Controller connectors (with 10 Gbps iSCSI host port adapters)
Figure 18 shows the optional 10 Gbps iSCSI host port adapter installed in both controllers on the rear panel of the DS3500 storage subsystem.
SAS host port 2 10 Gbps iSCSI port 3
SAS host port 1
Ethernet ports
Serial port
Controller A
Seven-segment numeric display
Password reset
Figure 18. Dual-controller DS3500 storage subsystem ports and controllers (with optional 10 iSCSI host port adapter)
10 Gbps iSCSI port 4
Drive expansion port
Power connector
Power switch
Password reset
Power connector
Controller B
Power switch
e35i0010
10 Gbps iSCSI host ports
The 10 Gbps iSCSI host ports are auto-negotiated 1/10Gbps Ethernet ports that support iSCSI offload. The host ports also provide support for both
32 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Internet Protocol version 4 (IPv4) and IPv6, and have the advanced networking functions of jumbo frames, IEEE 802.1p, and virtual local area network (VLAN) support.
Drive expansion port
The drive expansion port is an x4 multilane SAS port. Connect a SAS cable to this port and to a drive storage enclosure.
Controller connectors (with SAS host port adapters)
Figure 19 shows the optional SAS host port adapter installed in both controllers on the rear panel of the DS3500 storage subsystem.
SAS host port 2
SAS host port 1
Ethernet ports
Serial port
Controller A
Seven-segment numeric display
Figure 19. Dual-controller DS3500 storage subsystem ports and controllers (with an optional SAS host port adapter)
SAS host ports
The DS3500 SAS host ports are each a x4 multilane, 6 Gbps universal mini-SAS port. Connect a SAS cable from your host system SAS host bus adapter to a host port on each controller.
Drive expansion port
The drive expansion port is an x4 multilane SAS port. Connect a SAS cable to this port and to a drive storage enclosure.
Enclosure ID settings
The enclosure ID is a unique two-digit identifier for each enclosure in the storage subsystem configuration. In a dual controller or ESM configuration, both enclosure IDs are identical under normal operating conditions. Each EXP3500 storage storage enclosure and DS3500 storage subsystem in the storage subsystem configuration must have a unique storage enclosure ID.
SAS host port 3
SAS host port 4
Drive expansion port
Controller B
The controller automatically sets the enclosure ID. You can change the setting through the Storage Manager software, if necessary. The range of supported enclosure ID settings is 0 through 99. The enclosure ID is normally set to a value of 00 at the factory.
The enclosure ID is displayed on the seven-segment numeric display located on the back of each controller and ESM.
Working with SAS cables
Each DS3500 storage controller has up to four x4 multilane SAS host ports and a single x4 multilane SAS port for drive channel connections.
Chapter 3. Cabling the storage subsystem and storage enclosure 33
Use a 1M or 3M (1-meter or 3-meter) SAS cable with a mini-SAS 4x multilane SAS connector on each end to connect a controller host port to a host HBA and to connect the drive expansion port to a storage enclosure.
The following illustration shows the 1M and 3M mini-SAS cable.
Mini-SAS connectors
Figure 20. Mini-SAS cable
The 1M and 3M SAS cables have a universal key connector that enables the cable to be used in all mini-SAS ports.
Attention: To avoid damage to the SAS cables: v Leave enough slack in the cable when you route the cable along a folding
cable-management arm.
v Route the cable away from places where it can be damaged by other devices in
the rack.
v Do not put excess weight on the cable at the connection point. Ensure that the
cable is well supported.
To connect a mini-SAS cable, insert the mini-SAS connector into a mini-SAS port. Ensure that it locks into place.
Figure 21. Connecting a mini-SAS cable
34 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
To remove a mini-SAS cable, complete the following steps:
1. Hold the blue plastic tab on the mini-SAS connector and gently pull the tab to release the locking mechanism.
Blue plastic tab
Figure 22. Removing a mini-SAS cable
2. As you pull the tab, pull out the connector to remove it from the port.
Working with SFP modules and fiber optic cables
Each storage controller can have up to four Fibre Channel host ports. Use a small-form-factor pluggable (SFP) module to connect a host port to a host. Insert the SFP module into the port and a fiber optic cable into the SFP module. Connect the other end of the fiber optic cable to an optical interface connector in a Fibre Channel HBA on a host. SFP modules are laser products.
CAUTION: This product might contain one or more of the following devices: CD-ROM drive, DVD-ROM drive, DVD-RAM drive, or laser module, which are Class 1 laser products. To avoid exposure to hazardous laser radiation, do not remove the covers of the laser product, or use the controls, or adjust procedures other than the specifications in this guide. There are no serviceable parts inside the device (C026).
CAUTION: Data processing environments can contain equipment transmitting on system links with laser modules that operate at greater than Class 1 power levels. For this reason, never look into the end of an optical fiber cable or open receptacle (C027).
Chapter 3. Cabling the storage subsystem and storage enclosure 35
Handling fiber optic cables
Attention: To avoid damage to the fiber optic cables:
v Do not route the cable along a folding cable-management arm. v For devices on slide rails, leave enough slack in the cables so that they do not
bend to a diameter of less than 76 mm (3 in), or a radius less than 38 mm (1.5 in) when extended, or become pinched when retracted.
v Route the cable away from places where it can be damaged by other devices in
the rack cabinet.
v Do not use plastic cable ties instead of the provided cable straps. v Do not overtighten the cable straps or bend the cables to a diameter of less than
76 mm (3 in) or a radius less than 38 mm (1.5 in).
v Do not put excess weight on the cable at the connection point. Ensure that the
cable is well supported.
v The recommended maximum cable lengths are as follows:
– 2 Gbps: 300 m (984 ft.) of 50/125 um fiber, 150 m (492 ft.) of 62.5/125 um
fiber – 4 Gbps: 150 m (492 ft.) of 50/125 um fiber, 70 m (230 ft.) of 62.5/125 um fiber – 8 Gbps: 50 m (164 ft.) of 50/125 um fiber, 35 m (115 ft.) of 62.5/125 um fiber
v Recommended maximum lengths of OM2 category Fibre Channel cable are as
follows: – 4 Gbps: 150 m (492 ft.) of 50/125 um fiber, 300 m (984 ft.) of 62.5/125 um
fiber – 8 Gbps: 50 m (164 ft.) of 50/125 um fiber, 150 m (492 ft.) of 62.5/125 um fiber
Installing SFP modules
The storage subsystem requires SFP modules. SFP modules convert electrical signals to optical signals that are required for Fibre Channel transmission to and from controllers. After you install the SFP modules, you use fiber optic cables to connect the storage subsystem to other Fibre Channel devices.
Review the following information before installing SFP modules and fiber optic cables:
v Use only short-wave SFP modules. Do not mix long-wave and short-wave SFP
modules on a single storage subsystem. Use the Storage Manager Client to view the Storage Subsystem Profile to ensure that you are not mixing long-wave and short-wave SFP modules.
Attention: Do not use long-wave SFP modules or Gigabit Interface Converters (GBICs) in any of the Fibre Channel ports in the storage subsystem controllers. (Long-wave SFP modules and GBICs are not supported in the storage subsystem or any of the attached storage enclosures.
v The SFP module housing has an integral guide key that is designed to prevent
you from inserting the SFP module incorrectly.
v Use minimal pressure when inserting an SFP module into a Fibre Channel port.
Forcing the SFP module into a port could cause damage to the SFP module or to the port.
v You can insert or remove the SFP module while the port is powered on. v The operational or redundant loop performance is not affected when you install
or remove an SFP module.
v You must insert the SFP module into a port before you connect the fiber optic
cable.
36 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
v You must remove the fiber optic cable from the SFP module before you remove
the SFP module from the port. See “Removing SFP modules” on page 38 for
more information.
v The speed of the SFP module determines the maximum operating speed of the
Fibre Channel port in which the SFP module is installed. For example, a 2-Gbps
SFP module that is connected to a 4-Gbps-capable port will limit the speed of
that port to a maximum of 2 Gbps.
Attention: Check the IBM part number, option number, and FRU part number
of the SFP module to identify its speed. There are no physical features that
distinguish an 8 Gbps, 4 Gbps, or 2 Gbps SFP module from each other.
CAUTION: This product might contain one or more of the following devices: CD-ROM drive, DVD-ROM drive, DVD-RAM drive, or laser module, which are Class 1 laser products. To avoid exposure to hazardous laser radiation, do not remove the covers of the laser product, or use the controls, or adjust procedures other than the specifications in this guide. There are no serviceable parts inside the device (C026).
CAUTION: Data processing environments can contain equipment transmitting on system links with laser modules that operate at greater than Class 1 power levels. For this reason, never look into the end of an optical fiber cable or open receptacle (C027).
Attention: When you handle static-sensitive devices, take precautions to avoid
damage from static electricity. For details about handling static-sensitive devices, see “Handling static-sensitive devices” on page 27.
To install an SFP module, complete the following steps:
1. Remove the SFP module from its static-protective package.
2. Remove the protective cap from the SFP module, as shown in Figure 23 on
page 38. Save the protective cap for future use.
Chapter 3. Cabling the storage subsystem and storage enclosure 37
Plastic tab
Protective cap
SFP module
Figure 23. SFP module and protective cap
3. Remove the protective cap from the SFP port. Save the protective cap for future use.
4. Insert the SFP module into the host port until it clicks into place. See Figure 24.
Fiber optic cable
SFP module
dg1fy115
Figure 24. Installing an SFP module into the host port
5. Connect an LC-LC Fibre Channel cable. For information about the LC-LC cable, see “Using LC-LC Fibre Channel cables” on page 39.
Removing SFP modules
To remove the SFP module from the host port, complete the following steps:
Attention: To avoid damage to the cable or to the SFP module, ensure that you disconnect the LC-LC Fibre Channel cable before you remove the SFP module.
1. Remove the LC-LC Fibre Channel cable from the SFP module. For more information, see “Removing an LC-LC Fibre Channel cable” on page 41.
2. Unlock the SFP module latch: v For SFP modules that contain plastic tabs, unlock the SFP module latch by
pulling the plastic tab as shown in Figure 25 on page 39.
38 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Plastic tab
Protective cap
10
SFP module
Figure 25. Unlocking the SFP module latch - plastic variety
v For SFP modules that contain wire tabs, unlock the SFP module latch by
pulling the wire latch as shown in Figure 26.
Wire
tab
Protective
cap
90
Figure 26. Unlocking the SFP module latch - wire variety
SFP
module
3. With the SFP module latch in the unlocked position, remove the SFP module.
v For SFP modules that contain plastic tabs, slide the SFP module out of the
port.
v For SFP modules that contain wire tabs, grasp the wire latch and pull the
SFP module out of the port.
4. Replace the protective cap on the SFP module.
5. Place the SFP module into a static-protective package.
6. Replace the protective cap on the host port.
Using LC-LC Fibre Channel cables
The LC-LC Fibre Channel cable is a fibre optic cable that you use to connect Fibre Channel ports to one of the following devices:
v An SFP module installed in a Fibre Channel switch port v A Fibre Channel host bus adapter port (optical interface connector)
See Figure 27 on page 40 for an illustration of the LC-LC Fibre Channel cable.
For more information, see the documentation that was shipped with the LC-LC Fibre Channel cable.
Chapter 3. Cabling the storage subsystem and storage enclosure 39
Figure 27. LC-LC Fibre Channel cable
Connecting an LC-LC cable to an SFP module:
To connect an LC-LC Fibre Channel cable to an SFP module, complete the following steps.
CAUTION: This product might contain one or more of the following devices: CD-ROM drive, DVD-ROM drive, DVD-RAM drive, or laser module, which are Class 1 laser products. To avoid exposure to hazardous laser radiation, do not remove the covers of the laser product, or use the controls, or adjust procedures other than the specifications in this guide. There are no serviceable parts inside the device (C026).
CAUTION: Data processing environments can contain equipment transmitting on system links with laser modules that operate at greater than Class 1 power levels. For this reason, never look into the end of an optical fiber cable or open receptacle (C027).
1. Read the information in “Handling fiber optic cables” on page 36.
2. If necessary, remove the protective cap from the SFP module, as shown in
Figure 23 on page 38. Save the protective cap for future use.
3. Remove the two protective caps from one end of the LC-LC cable, as shown in Figure 28 on page 41. Save the protective caps for future use.
40 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Fiber-optic cable
Protective cap
Figure 28. Removing fiber optic cable protective caps
4. Carefully insert the open end of the LC-LC cable into an SFP module that is installed in the storage subsystem. The cable connector is keyed for correct installation. Holding the connector, push in the cable until it clicks into place, as shown in Figure 29.
Figure 29. Inserting an LC-LC Fibre Channel cable into an SFP module
5. Remove the two protective caps from the other end of the LC-LC cable. Save the protective caps for future use.
6. Connect this end of the LC-LC cable to one of the following devices:
v An SFP module that is installed in a Fibre Channel switch port v A Fibre Channel host bus adapter port
Removing an LC-LC Fibre Channel cable:
To remove an LC-LC Fibre Channel cable, complete the following steps.
Attention: To avoid damaging the LC-LC cable or SFP module, ensure that you observe the following precautions:
v Press and hold the lever to release the latches before you remove the cable from
the SFP module.
v Ensure that the levers are in the released position when you remove the cable. v Do NOT grasp the SFP module plastic tab when you remove the cable.
1. At the end of the LC-LC cable that connects into the SFP module or host bus adapter, press down and hold the lever to release the latches, as shown in
Chapter 3. Cabling the storage subsystem and storage enclosure 41
Figure 30.
Lever
Latches
Figure 30. LC-LC Fibre Channel cable lever and latches
2. While pressing down the cable lever, carefully pull the connector to remove the cable from the SFP module, as shown in Figure 31.
Figure 31. Removing the LC-LC Fibre Channel cable
3. Replace the protective caps on the cable ends.
4. Replace the protective cap on the SFP module.
Using LC-SC Fibre Channel cable adapters
The LC-SC Fibre Channel cable adapter is a fiber optic cable that is used to connect an LC connector to one of the following devices that require SC connectors:
v 1-Gbps Fibre Channel switch v Fibre Channel host bus adapter
For more information, see the documentation that is shipped with the LC-SC Fibre Channel cable adapter.
42 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
LC connector
SC connector
Figure 32. LC-SC Fibre Channel cable adapter
The following sections include the procedures for correctly connecting and removing an LC-SC Fibre Channel cable.
CAUTION: This product might contain one or more of the following devices: CD-ROM drive, DVD-ROM drive, DVD-RAM drive, or laser module, which are Class 1 laser products. To avoid exposure to hazardous laser radiation, do not remove the covers of the laser product, or use the controls, or adjust procedures other than the specifications in this guide. There are no serviceable parts inside the device (C026).
CAUTION: Data processing environments can contain equipment transmitting on system links with laser modules that operate at greater than Class 1 power levels. For this reason, never look into the end of an optical fibre cable or open receptacle (C027).
Connecting an LC-SC cable adapter to a device:
To connect an LC-SC Fibre Channel cable adapter to a device, complete the following steps:
1. Read the information in “Handling fiber optic cables” on page 36.
2. Connect one end of an LC-LC cable to an SFP module in the DS3500. For
instructions, see “Using LC-LC Fibre Channel cables” on page 39.
3. Remove the two protective caps from the LC connector end of the LC-SC cable adapter as shown in Figure 33 on page 44. Save the protective caps for future use.
Chapter 3. Cabling the storage subsystem and storage enclosure 43
Figure 33. Removing the LC-SC cable adapter protective caps
4. Carefully insert the other end of the LC-LC cable into the LC connector end of the LC-SC cable adapter as shown in Figure 34. Push in the connector until it clicks into place.
Figure 34. Connecting an LC-LC cable into the LC-SC cable adapter
5. If you are connecting the storage subsystem to a 1-Gbps Fibre Channel switch or Fibre Channel host bus adapter, connect the SC connector end of the LC-SC cable adapter to a Gigabit Interface Converter (GBIC) that is installed in the 1-Gbps Fibre Channel switch or Fibre Channel host bus adapter. For more information about connecting to these devices, see the documentation that is shipped with the device.
Removing an LC-LC cable from an LC-SC cable adapter:
To remove an LC-LC cable from an LC-SC cable adapter, complete the following steps.
Attention: To avoid damaging the LC-LC cable, ensure that you press and hold the lever to release the latches before you remove the cable from an LC-SC cable adapter. When removing the cable from the SFP module, ensure that you do not grasp the SFP module plastic tab.
1. At the end of the cable that connects into the LC connector end of the LC-SC cable adapter, press down and hold the lever to release the latches. Figure 35 on page 45 shows the location of the lever and latches.
44 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Lever
Latches
Figure 35. LC-LC Fibre Channel cable lever and latches
2. Carefully pull the connector to remove it. Ensure that you grasp the connector and not the cable when removing the LC-LC cable from the LC-SC cable adapter as shown in Figure 36.
Figure 36. Removing the LC-LC Fibre Channel cable from an LC-SC Fibre Channel cable adapter
3. Replace the protective caps on the cable ends.
Cabling the EXP3500 storage enclosure
The EXP3500 storage enclosure contains an ESM that enables you to connect the EXP3500 storage enclosure to a DS3500 storage subsystem. If you are attaching the EXP3500 to a dual controller DS3500 storage subsystem, you must add a second ESM to the EXP3500 storage enclosure to provide a redundant drive path.
ESM connectors
Figure 37 shows the connectors on the ESM.
SAS in connector 1 SAS in connector 2 SAS out connector
1 2
ESM
Figure 37. ESM connectors
SAS In 1
Connect a SAS cable to this connector and to either an IBM SAS controller or the SAS Out () connector of another EXP3500.
Chapter 3. Cabling the storage subsystem and storage enclosure 45
SAS In 2
Connect a SAS cable to this connector and to either an IBM SAS controller or the SAS Out () connector of another EXP3500.
SAS Out
Connect a SAS cable to this connector and to the SAS In () connector of another EXP3500.
Note: Each ESM contains two SAS In connectors. You can use either SAS In connector, but only one SAS In connector can be used at a time.
Single-ESM configuration
The DS3500 storage controller supports more than one EXP3500 storage enclosure per drive expansion port. You can connect two or more EXP3500 storage enclosures by chaining them together. To connect a controller to one or more EXP3500 storage enclosures that have one ESM each, complete the following steps:
1. Connect one EXP3500 storage enclosure to the controller: a. Connect one end of a SAS cable to the drive expansion port on the
controller.
b. Connect the other end to one of the In () SAS connectors on the ESM in
the EXP3500 storage enclosure.
2. Connect a second EXP3500 storage enclosure to the first EXP3500 storage enclosure:
a. Connect one end of a SAS cable to the Out () SAS connector on the ESM of
the EXP3500 storage enclosure that you just connected.
b. Connect the other end of the SAS cable to one of the In () SAS connectors
on the ESM on the next EXP3500 storage enclosure.
c. Repeat steps 2a and 2b for each EXP3500 storage enclosure that you add.
Dual-ESM configuration
The EXP3500 storage enclosure comes with one ESM. If your DS3500 storage subsystem is a dual controller configuration, it supports redundant drive paths. You must install a second ESM. See “Installing an additional ESM” on page 157 before attaching any EXP3500 storage enclosures.
Dual-ESM configuration with a single EXP3500 storage enclosure:
46 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
To connect controllers A and B to one EXP3500 storage enclosure that has two ESMs, complete the following steps:
1. Connect the EXP3500 storage enclosure to controller A: a. Connect one end of a SAS cable to controller A. b. Connect the other end of the SAS cable to one of the In () SAS connectors
on the left ESM in the EXP3500 storage enclosure.
2. Connect the EXP3500 storage enclosure to controller B: a. Connect one end of a SAS cable to controller B. b. Connect the other end of the SAS cable to one of the In () SAS connectors
on the right ESM in the EXP3500 storage enclosure.
Dual-ESM configuration with two or more EXP3500 storage enclosures:
The DS3500 controllers support more than one EXP3500 storage enclosure per physical port, so multiple EXP3500 storage enclosures can be connected by chaining them together.
To connect DS3500 controllers A and B to multiple EXP3500 storage enclosures that have two ESMs each, complete the following steps:
1. Connect one EXP3500 storage enclosure to controller A: a. Connect one end of a SAS cable to the drive expansion port on the DS3500
controller A.
Chapter 3. Cabling the storage subsystem and storage enclosure 47
b. Connect the other end of the SAS cable to one of the In () SAS connectors
on the left ESM in the EXP3500 storage enclosure.
2. Connect the left ESM of the EXP3500 storage enclosure to the next EXP3500 storage enclosure in the chain:
a. Connect one end of a SAS cable to the Out () SAS connector on the left
ESM of the EXP3500 storage enclosure that you just connected.
b. Connect the other end of the SAS cable to one of the In () SAS connectors
on the left ESM in the next EXP3500 storage enclosure in the chain.
c. Repeat steps 2a and 2b for each EXP3500 storage enclosure that you add.
3. Connect the last EXP3500 storage enclosure in the chain to controller B: a. Connect one end of a SAS cable to the drive expansion port on the DS3500
controller B.
b. Connect the other end of the SAS cable to one of the In () SAS connectors
on the right ESM in the last EXP3500 storage enclosure of the chain that you created.
4. In reverse order (last in chain to first in chain), connect the right ESMs in the EXP3500 storage enclosures in the chain:
a. Connect one end of a SAS cable to the Out () SAS connector on the right
ESM of the EXP3500 storage enclosure that you just connected.
b. Connect the other end of the SAS cable to one of the In () SAS connectors
on the right ESM of the previous EXP3500 storage enclosure in the chain.
c. Repeat steps 2a and 2b until you connect the right ESM of the first EXP3500
storage enclosure in step 2 to the right ESM of the EXP3500 storage enclosure in step 1 on page 47.
Connecting storage enclosures to the DS3500
The DS3500 supports either the EXP3512 or the EXP3524 storage enclosure. The DS3500 supports up to 192 drives (with controller firmware 7.77.xx.xx and later) or 96 drives (with controller firmware 7.75.xx.xx and earlier).
The total number of storage enclosures supported varies depending on the model of DS3500 storage subsystem and EXP3500 storage enclosure. See the following tables Table 11 and Table 12 on page 49.
Table 11 shows the maximum number of EXP3512 and EXP3524 storage enclosures that can be attached to either a DS3512 or a DS3524 storage subsystem, and not exceed 192 total disk drives with controller firmware level 7.77.xx.xx and later. Any combination of EXP3512 or EXP3524 storage enclosures can be attached to a DS3512 or a DS3524 as long as the total number of disk drives does not exceed
192.
Table 11. Maximum number of EXP3512 and EXP3524 storage enclosures with controller firmware level 7.77.xx.xx and later
DS3512 DS3524
Storage enclosures
EXP3512 15 14 13 12 EXP3524 7654 EXP3524 0011 EXP3512 0256 or or
Quantity Storage
enclosures
Quantity
48 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Table 11. Maximum number of EXP3512 and EXP3524 storage enclosures with controller firmware level 7.77.xx.xx and later (continued)
DS3512 DS3524
EXP3512 11 10 9 8 EXP3524 3 2 1 EXP3524 2233 EXP3512 8 10 12 or EXP3512 7654 EXP3524 4455 or EXP3512 3 2 1 EXP3524 6 6 7
Table 12 shows the maximum number of EXP3512 and EXP3524 storage enclosures that can be attached to either a DS3512 or a DS3524 storage subsystem and not exceed the 96 total disk drives with controller firmware level 7.75.xx.xx and earlier. Any combination of EXP3512 or EXP3524 storage enclosures can be attached to a DS3512 or a DS3524 as long as the total number of disk drives does not exceed 96.
Table 12. Maximum number of EXP3512 and EXP3524 storage enclosures with controller firmware level 7.75.xx.xx and earlier
DS3512 DS3524
Storage enclosures
EXP3512 7 5 3 1 EXP3524 3 2 1 0 EXP3524 0 1 2 3 EXP3512 0 2 4 6
Quantity Storage
enclosures
Quantity
Redundant drive channel pair
Each storage controller on the DS3500 has a drive expansion channel that contains an x4 SAS port. The storage enclosures that are connected to this connector form a drive channel. You can install a maximum of 96 drives in one drive channel. In a dual-controller DS3500, one drive channel from each controller combines to form a redundant drive-channel pair.
Figure 38 on page 50 shows an example of a redundant drive-channel pair. If any component of the drive channel fails, the controllers can still access the storage enclosures in the redundant drive-channel pair.
Note: In storage enclosures that are connected to a dual-controller storage subsystem, you must install the optional second ESM to support dual redundant drive paths.
Chapter 3. Cabling the storage subsystem and storage enclosure 49
Figure 38. Example of a redundant drive path
Connecting storage enclosures to a storage subsystem
To connect storage enclosures to the storage subsystem, complete the following steps:
1. Follow the instructions in the IBM System Storage DS3500 and EXP3500 Rack Installation and Quick Start Guide for the storage enclosure and the rack
installation instructions to set up and mount the storage enclosures.
2. Select a cabling topology applicable to the number of ESMs in the storage enclosures that you will connect to the DS3500. “DS3500 storage subsystem drive cabling topologies” describes the recommended schemes for cabling storage enclosures with one ESM or two ESMs to the DS3500 and to each other (if you are connecting more than one storage enclosure).
3. Follow the cabling diagram for the selected topology.
4. If required, set unique enclosure IDs for all storage enclosures that are cabled to
the DS3500. For information about setting the enclosure ID, see the IBM System Storage DS Storage Manager Version 10 Installation and Host Support Guide (for DS Storage Manager V10.77 or earlier) and IBM System Storage DS Storage Manager Version 10.8 Installation and Host Support Guide (for DS Storage Manager V10.83
or later).
The DS3500 storage subsystem locates the drives in the storage enclosures after you power-on the configuration. Always turn on the storage enclosures first and then turn on the DS3500. After you have powered-on the configuration, use the Storage Manager software to check the status of the new drives, correct any errors, and configure the new drives.
DS3500 storage subsystem drive cabling topologies
This section contains the preferred cabling topologies for cabling storage enclosures to the DS3500 storage subsystem:
50 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
v “One single-controller DS3500 and one or more storage enclosures” v “One dual-controller DS3500 and one storage enclosure” v “One dual-controller DS3500 and two storage enclosures” on page 52 v “One dual-controller DS3500 and up to eight storage enclosures” on page 52
If one of these topologies is suitable for the hardware and application in your business setup, complete the cabling connections as shown in the illustrations. If you have a setup other than the ones shown in these examples, use these examples as a starting point for creating your specific topology.
Note: In storage enclosures that are connected to a dual-controller storage subsystem, you must install the optional second ESM to support dual redundant drive paths.
One single-controller DS3500 and one or more storage enclosures:
To cable one single-controller DS3500 to one or more single-ESM storage enclosures, connect them as shown in Figure 39.
Figure 39. One single-controller DS3500 and multiple single-ESM storage enclosures
Note: In storage enclosures that are connected to a dual-controller storage subsystem, you must install the optional second ESM to support dual redundant drive paths, and must use one of the dual-controller topologies that are described in this section.
One dual-controller DS3500 and one storage enclosure:
To cable a dual-controller DS3500 to a storage enclosure, connect them as shown in Figure 40 on page 52.
Chapter 3. Cabling the storage subsystem and storage enclosure 51
Figure 40. A dual-controller DS3500 and a storage enclosure
One dual-controller DS3500 and two storage enclosures:
To cable a dual-controller DS3500 and two storage enclosures, connect them as shown in Figure 41.
Figure 41. A dual-controller DS3500 and two storage enclosures
One dual-controller DS3500 and up to eight storage enclosures:
To cable a dual-controller DS3500 and up to eight storage enclosures, connect them as shown in Figure 42 on page 53.
52 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Figure 42. A dual-controller DS3500 and eight storage enclosures
Adding a storage enclosure to a running dual-controller configuration
Complete the following steps to add storage enclosures to a running dual-controller DS3500 storage subsystem.
Note: Ensure that each storage enclosure has two ESMs before you connect it to a dual-controller DS3500 storage subsystem. The second ESM must be purchased separately. Contact your IBM marketing representative or authorized reseller for more information about purchasing a second ESM. For more information about installing a second ESM, see the Installation Guide that is shipped with the storage enclosure.
1. Ensure that the DS3500 storage subsystem status is Optimal in the Storage Manager software.
Chapter 3. Cabling the storage subsystem and storage enclosure 53
2. Use the storage enclosure Rack Installation Instructions document to install the new storage enclosure in the rack.
3. Connect the power cables to the new storage enclosure.
4. Power on the storage enclosure.
5. Connect one end of a Serial Attached SCSI (SAS) cable to the Drive expansion
port on Controller A in the DS3500 storage subsystem.
6. Connect the other end of the SAS cable to either of the In ports on the left ESM in the storage enclosure.
7. Connect one end of a second SAS cable to the Drive expansion port on Controller B in the DS3500 storage subsystem.
8. Connect the other end of the second SAS cable to the In port on the right ESM in the storage enclosure.
9. Wait until the storage subsystem status is Optimal in the Storage Manager software before proceeding to step 10.
10. Add the drives to the storage enclosure. Ensure that you wait for at least 30 seconds for the Storage Manager software to recognize each newly added drive before you install another drive.
To add additional storage enclosures after the first storage enclosure is connected to a dual-controller DS3500 storage subsystem, complete the following steps:
a. Ensure that the storage subsystem status is Optimal in the Storage
Manager software.
b. Use the storage enclosure Rack Installation Instructions document to install
the new storage enclosure in the rack.
c. Connect the power cables to the new storage enclosure. d. Power on the storage enclosure. e. Connect one end of a Serial Attached SCSI (SAS) cable to the In port on
the left ESM in the storage enclosure that is being added to the configuration.
f. Connect the other end of the SAS cable to the Out port on the left ESM in
the last storage enclosure in the configuration (this storage enclosure is directly connected to the Drive expansion port on controller A of the DS3500).
Note: The above step is true only for the configuration of the EXP3500 storage subsystem expansion unit. For DS3500 storage subsystem dual-controller connections go to the next step.
g. On the last storage enclosure in the configuration, disconnect the SAS
cable from the In port on the right ESM and connect it to the In port on the right ESM on the new storage enclosure that is being added to the configuration.
Note: When the SAS cable is disconnected in step 7, a loss of path redundancy occurs and an error message is displayed in the Storage Manager Recovery Guru. Ignore this error message. The redundant path is restored in step h after the SAS cable is connected.
h. Connect a SAS cable to the Out port on the right ESM of the new storage
enclosure and connect the other end to either of the In port on the right ESM in the storage enclosure that was previously connected to controller B of the DS3500.
54 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
i. Wait until the storage subsystem status is Optimal in the Storage Manager
software before proceeding to step 10.
j. Add the drives to the storage enclosure. Make sure that you wait for at
least 30 seconds for the Storage Manager software to recognize each newly added drive before you install another drive.
Upgrading a single-controller to a dual-controller when there is no attached EXP3500 enclosure
If you are upgrading a single-controller DS3500 storage subsystem to a dual-controller DS3500 storage subsystem and there are no EXP3500 storage enclosures attached to the DS3500 storage subsystem, see “Installing a controller” on page 107.
Upgrading a single-controller to a dual-controller when there is one or more EXP3500 enclosures attached to the storage subsystem
Before you upgrade the DS3500 storage subsystem from a single-controller to a dual-controller, ensure that you purchase:
v a second environmental services module (ESM) for each EXP3500 storage
enclosure that is attached to the DS3500 storage subsystem. You will install the second ESM during this procedure.
v the SAS cables that are required to create a redundant drive enclosure path.
To upgrade a single-controller DS3500 storage subsystem to a dual-controller DS3500 storage subsystem when there are EXP3500 storage enclosures attached to the DS3500, complete the following steps:
1. Turn off the DS3500 storage subsystem and all attached EXP3500 storage enclosures.
2. Install a second controller in the DS3500 storage subsystem by using the instructions in “Installing a controller” on page 107.
3. Install a second ESM in each EXP3500 that is connected to the DS3500 storage subsystem:
a. Read the safety information on page “Safety” on page ix and “Best practices
guidelines” on page 8.
b. Remove the ESM filler panel from the rightmost ESM bay of the EXP3500.
On the left side of the ESM filler panel, press the orange release tab to the right just enough to release the handle (no more than 6 mm [0.25 in.]) as you turn the handle upward. Using the handle, gently slide the ESM filler panel out of the EXP3500. Save the ESM filler panel for future use.
c. Hold the new ESM so that the handle is fully extended. d. Gently slide the ESM into the bay until it stops. Turn the handle downward
into the closed position until it clicks.
4. For dual-controller models, connect SAS cables to create a redundant drive-channel path from the DS3500 controllers to the EXP3500 ESMs using the information provided in “DS3500 storage subsystem drive cabling topologies” on page 50,
Connecting secondary interface cables
This section applies to direct (out-of-band) management configurations only. If your configuration uses host-agent (in-band) management, skip this section.
Chapter 3. Cabling the storage subsystem and storage enclosure 55
Connect the Ethernet management port on the rear panel of the storage subsystem to the controllers for direct management of the storage subsystems (see “Direct (out-of-band) management method” on page 57).
Important:
1. To minimize security risks, do not connect the DS3500 to a public LAN or public subnet. Use a local private network for the DS3500 and the storage management station Ethernet connectors.
2. For proper EMI shielding, use good-quality braided and shielded serial cables.
Connect an Ethernet cable from the management station to the Ethernet connector on controller A on the rear of the storage subsystem. For a dual-controller storage subsystem, you must connect a second Ethernet cable from the management station to the Ethernet connector on controller B. Figure 43 shows the locations of the Ethernet management connectors on the DS3500 storage subsystem.
Ethernet ports
Controller A
Figure 43. Ethernet port locations on a dual-controller DS3500
Ethernet ports
Configuring the storage subsystem
You must configure the storage subsystem after you install the storage subsystem in a rack. Use the information in the following sections to configure the storage subsystem.
Storage subsystem management methods
Before you configure the storage subsystem, determine which method of storage subsystem management you want to use. You can manage the storage subsystem in either of two ways: host-agent (in-band) management or direct (out-of-band) management.
Note: See the Storage Manager readme file for information about in-band limitations or restrictions that are associated with particular combinations of controllers and host bus adapters.
Controller B
For more information about setting up in-band or out-of-band management connections, see the IBM System Storage DS Storage Manager Version 10 Installation
and Host Support Guide (for DS Storage Manager V10.77 or earlier) or IBM System Storage DS Storage Manager Version 10.8 Installation and Host Support Guide (for DS
Storage Manager V10.83 or later) for the operating system of the host server that you will use to manage the DS3500 storage subsystem. The document is in the Documentation folder on the IBM System Storage DS3500 Support DVD.
Important: If the operating system of the host server that the storage subsystem logical drives are mapped to is not Microsoft Windows Server 2003 or Windows Server 2008, you must make a direct (out-of-band) management connection to the
56 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
storage subsystem to set the correct host type first. The server will then be able to recognize the storage subsystem correctly for host-agent (in-band) management.
Host-agent (in-band) management method:
To use this method, host-agent software must be installed on the host server. Using the host-agent software, you can manage the storage subsystem through the Storage Manager software client program by using the same connections between the host server and the storage subsystem. You must install at least one management station and a software agent host. The management station can be the host or a workstation on the Ethernet network. The client software is installed on the management station. Figure 44 shows the host-agent (in-band) management method.
Host computer
Controller
Controller
Figure 44. Host-agent (in-band) managed storage subsystems
I/O Path
Ethernet
Management Station
dcsi0023
Direct (out-of-band) management method:
This method contains information about Ethernet connections from a management station to each controller in the storage subsystem. You must install at least one management station. The management station can be the host or a workstation on the Ethernet network. The client software is installed on the management station. Attach Ethernet cables to each management station (one pair per storage subsystem). You will connect the cables to each storage subsystem controller later when you install the storage subsystem. Figure 45 on page 58 shows the direct (out-of-band) management method.
Note: Do not connect the DS3500 storage subsystem Ethernet ports to a public network or public subnet. To minimize security risks, create a private network between the DS3500 storage subsystem and the management station.
Chapter 3. Cabling the storage subsystem and storage enclosure 57
Figure 45. Direct (out-of-band) managed storage subsystems
Installing the storage subsystem configuration
Before attempting to attach hosts to the storage subsystem, ensure that the host systems and host bus adapters (HBAs) are installed correctly and updated with the latest firmware and drivers.
Note: Use the correct HBA firmware and device driver. For the latest supported HBAs and device drivers, consult the readme that is shipped with the DS3500 controller firmware. See the documentation that is shipped with the HBA for installation requirements and procedures.
For a SAS attached host, attach a SAS cable to each HBA. Continue with “Connecting SAS hosts to the DS3500” on page 59 to connect the other end of each cable to a controller.
58 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
For a Fibre Channel attached host, attach a fibre channel cable to each HBA. Continue with “Connecting Fibre Channel hosts to the DS3500” on page 64 to connect the other end of each cable to the controller.
For an iSCSI attached host, attach an Ethernet cable to each host. Continue with “Connecting iSCSI hosts to the DS3500” on page 70 to connect the other end of each cable to the controller.
Connecting SAS hosts to the DS3500
The DS3500 can support up to 28 hosts when attached to the SAS Connectivity Module for IBM BladeCenter®, and up to four hosts in a direct attached host environment. The number of supported hosts depends on the number of host ports installed on the controller. To protect against the loss of any one path from the host servers to the DS3500 storage subsystem, use redundant host connections.
Note: In a single-controller storage subsystem, the DS3500 ships with four storage partitions by default. For additional storage partitions, purchase an optional Storage Partition Premium Feature upgrade. Contact your IBM reseller or marketing representative for more information.
To connect a SAS host bus adapter (HBA) to the storage subsystem, complete the following steps:
1. Connect a SAS cable from the controller host port to the SAS HBA that is in the host. Figure 19 on page 33 shows the location of the host ports.
2. Create a redundant host connection: v If the storage subsystem is a single-controller storage subsystem, connect a
SAS cable from the second SAS HBA to another host port on the controller. You can create a maximum of one redundant host connection to a single-controller storage subsystem.
v If the storage subsystem is a dual-controller storage subsystem, connect a
SAS cable from the second SAS HBA to a host port on the other controller. You can create a maximum of three redundant host connections to a dual-controller storage subsystem.
See “Direct-attached single-controller connections” on page 65 and “Direct-attached dual-controller connections” on page 67 for illustrations of host connections.
Starting with controller firmware version 7.77.xx.xx and later, the DS3500 also supports host connections via SAS switch. See “Single-controller and dual-controller connections via SAS switch” on page 62 for illustrations of host connections to the DS3500 SAS host port via SAS switch.
Note: For information about supported SAS switch models, SAS HBAs, and operating-system version requirements for SAS switch connection environments, see the interoperability matrix at http://www.ibm.com/systems/support/storage/ ssic/.
Direct-attached single-controller connections:
The following illustration shows a direct-attached SAS connection to a single host HBA.
Chapter 3. Cabling the storage subsystem and storage enclosure 59
Host system
with single host
adapter
DS3500
Figure 46. Single-controller direct-attached SAS connection to a single-host HBA
The following illustration shows a direct-attached SAS connection to dual HBAs in a single-host (redundant host connection).
Host system
with dual host
adapters
DS3500
Figure 47. Single-controller direct-attached SAS connection to dual HBAs in a single-host (redundant host connection)
The following illustration shows a direct-attached SAS connection to single HBAs in multiple hosts.
60 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Host system
with single host
adapter
DS3500
Host system
with single host
adapter
Figure 48. Single-controller direct-attached SAS connection to single HBAs in multiple hosts
Direct-attached dual-controller connections:
The following illustration shows a direct-attached SAS connection from each controller to a single HBA in the same host (redundant host connection).
Host system
with dual host
adapters
DS3500
dg1fy403
Figure 49. Dual-controller direct-attached SAS connection to two HBAs in the same host (redundant host connection)
The following illustration shows multiple redundant direct-attached SAS host connections. This configuration is also the configuration to use for a dual-node host configuration.
Chapter 3. Cabling the storage subsystem and storage enclosure 61
Host system
with dual host
adapters
DS3500
Host system
with dual host
adapters
Figure 50. Dual-controller direct-attached SAS connections to multiple HBAs in multiple hosts
Single-controller and dual-controller connections via SAS switch:
The illustration Figure 51 shows the connections from the host server to the dual-controller or single-controller DS3500 using one SAS switch. This figure also illustrates the use of the SAS switch to allow the host server connected to multiple DS3500s.
Host system with one SAS host adapter
Host system with one SAS host adapter
SAS switch
DS3500 with Dual­controller
DS3500 with Single­controller
e35i0011
Figure 51. Dual-controller DS3500 or single-controller DS3500 SAS connection to multiple hosts using one SAS switch
The illustration Figure 52 on page 63 shows the connections from the host server to the dual-controller DS3500 using two SAS switches that are not connected together.
62 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Each switch forms its own group of connections. This is also the configuration to use for dual-node host configuration. The illustration Figure 53 shows the host server connects to multiple DS3500s via two separate SAS switches.
Host system with two SAS host adapter
Host system with two SAS host adapter
SAS switch SAS switch
DS3500 with Dual­controller
e35i0012
Figure 52. Dual-controller DS3500 SAS connection to multiple hosts using two separate SAS switches
Host system with two SAS host adapter
Host system with two SAS host adapter
SAS switch SAS switch
DS3500 with Dual­controller
DS3500 with Dual­controller
e35i0013
Figure 53. Multiple dual-controller DS3500s SAS connection to multiple hosts using two using two separate SAS switches
Chapter 3. Cabling the storage subsystem and storage enclosure 63
The illustration Figure 54 shows the connections from the host server to the dual-controller DS3500 using two SAS switches that are connected together via an inter-switch link.
Host system with two SAS host adapter
SAS switch SAS switch
Figure 54. Dual-controller DS3500 SAS connection to multiple hosts using two SAS switches that are connected together via an interlink switch
Inter­switch Link
DS3500
DS3500
with Dual-
with Dual-
controller
controller
Host system with two SAS host adapter
e35i0014
Connecting Fibre Channel hosts to the DS3500
Using Fibre Channel switches, up to 64 hosts can be redundantly attached to the DS3500 storage subsystem in a Fibre Channel storage area network (SAN) fabric.
Note: The DS3500 ships with four storage partitions by default. For additional storage partitions, purchase an optional Storage Partition Premium Feature upgrade. Contact your IBM reseller or marketing representative for more information.
To connect a host to the controllers, complete the following steps:
1. Install SFP modules in the host ports on controllers A and B.
2. Connect the Fibre Channel cables to the SFP modules in the controller host
ports and to either the SFP modules in the Fibre Channel switch or the optical interface connector on the host bus adapters. Figure 55 on page 65 shows the location on the controllers of the storage subsystem ports where the host-system cables connect.
64 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Password Reset
SAS host port 2
SAS host port 1
Ethernet ports
Serial port
Controller A
Fibre channel host port 3
Fibre channel host port 4
Fibre channel host port 5
Fibre channel host port 6
Drive expansion port
Password Reset
Controller B
Seven-segment numeric display
Figure 55. Location of host connectors on storage controllers
dg1fy065
3. Repeat steps 1 on page 64 and 2 on page 64 for an additional redundant host connection. In a direct connection configuration, you can create a maximum of two redundant host connections for the storage subsystem.
See “Direct-attached single-controller connections” and “Direct-attached dual-controller connections” on page 67 for illustrations of host connections.
For examples of redundant, partially-redundant, and non-redundant host and drive loop configurations, see “Fibre Channel host loop configurations” on page 68.
Direct-attached single-controller connections:
The following illustration shows a direct-attached connection to a single host HBA.
Host system
with single host
adapter
DS3500
Figure 56. Single-controller direct-attached Fibre Channel connection to a single host HBA
Chapter 3. Cabling the storage subsystem and storage enclosure 65
The following illustration shows a direct-attached connection to dual HBAs in a single host (redundant host connection).
Host system
with dual host
adapters
DS3500
Figure 57. Single-controller direct-attached Fibre Channel connection to dual HBAs (redundant host connection)
The following illustration shows a direct-attached connection to single HBAs in multiple hosts.
66 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Host system
with single host
adapter
DS3500
Host system
with single host
adapter
Figure 58. Single-controller direct-attached Fibre Channel connection to single HBAs in multiple hosts
Direct-attached dual-controller connections:
The following illustration shows a direct-attached connection from each controller to a single HBA in the same host (redundant host connection).
Host system
with dual host
adapters
DS3500
dg1fy403
Figure 59. Dual-controller direct-attached Fibre Channel connection to two HBAs in the same host (redundant host connection)
The following illustration shows multiple redundant direct-attached host connections.
Chapter 3. Cabling the storage subsystem and storage enclosure 67
Host system
with dual host
adapters
DS3500
Figure 60. Dual-controller direct-attached Fibre Channel connections to multiple HBAs in multiple hosts
Host system
with dual host
adapters
Fibre Channel connections:
The storage subsystem Fibre Channel connection consists of up to two host Fibre Channel loops. The host Fibre Channel loops provide the fibre path for host attachment. They can consist of Fibre Channel cables, SFP modules, host bus adapters, Fibre Channel switches, and controllers.
Fibre Channel host loop configurations:
You must determine how the host systems will connect to the storage subsystem. You can connect up to four host systems directly to the storage subsystem. The illustrations in the following sections show common host system configurations.
Redundant host loops:
This section provides examples of host Fibre Channel configurations.
Host Fibre Channel configurations:
This section provides the following examples of host Fibre Channel configurations.
v Single SAN fabric configuration, as shown in Figure 61 on page 69 v Dual SAN fabric configuration, as shown in Figure 62 on page 69 v Two storage subsystems in a dual SAN fabric configuration, as shown in
Figure 63 on page 70
Note: These configurations have host and drive path failover protection and are recommended for high availability.
In Figure 61 on page 69, the Fibre Channel switches are connected together through the Inter-Switch Link (ISL) to form a single SAN fabric.
68 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Host system
with two host
adapters
Host system
with two host
adapters
Fibre Channel switch
Inter-Switch Link
DS3500
Fibre Channel switch
Figure 61. Example of a single Fibre Channel SAN fabric configuration
In Figure 62, the Fibre Channel switches are not connected together through an ISL. Each switch forms its own SAN fabric. This configuration is also the configuration to use for a dual-node host configuration.
Host system
with two host
adapters
Host system
with two host
adapters
Fibre Channel switch
Figure 62. Example of a dual Fibre Channel SAN fabric configuration
In Figure 63 on page 70, the Fibre Channel switches are not connected together. Each switch forms its own SAN fabric.
Fibre Channel switch
DS3500
Chapter 3. Cabling the storage subsystem and storage enclosure 69
Host system
with two host
adapters
Fibre Channel switch
DS3500 DS3500
Figure 63. Example of two storage subsystems in a dual Fibre Channel SAN environment
Host system
with two host
adapters
Fibre Channel switch
Connecting iSCSI hosts to the DS3500
The DS3500 can support up to 64 hosts, depending on the number of host ports and host partitions that are used on the controller. To protect against the loss of any one path from the host servers to the storage subsystem, use redundant host connections.
To connect a hardware or software iSCSI initiator to the storage subsystem, complete the following steps:
1. Connect Ethernet cables from the controller host port to the 1 gigabit or 10 gigabit Ethernet switch:
v For a 1 gigabit Ethernet switch, connect a Category 5e or Category 6 Ethernet
cable from the controller host port to a gigabit Ethernet switch, and then connect an Ethernet cable from the switch to the host iSCSI initiator port.
v For a 10 gigabit Ethernet switch, connect a Category 6 (shielded or
unshielded), Category 6A (shielded or unshielded), or Category 7 Ethernet cable from the controller host port to a gigabit Ethernet switch, and then connect an Ethernet cable from the switch to the host iSCSI initiator port. For these cables, the following cable lengths are supported:
– Cat 6 unshielded - 30m – Cat 6 shielded - 100m – Cat 6A unshielded - 55m – Cat 6A shielded - 100m – Cat 7 - 100m
Note: These cables must be customer-supplied and are not available with the DS3500. IBM recommends using Category 6A or Category 7 cables to obtain the highest signal quality and reliability when operating at 10 Gbps, because these cables are designed to support 10 Gbps and minimize alien crosstalk.
70 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
The quality of Category 6 cables can vary between different manufacturers and even different manufactured lots. Please contact your IBM representative or reseller if you require any clarifications.
Figure 17 on page 32 shows the host ports.
2. Create a redundant host connection: v If the storage subsystem is a single-controller storage subsystem, connect an
Ethernet cable from the second host port on the controller to a gigabit Ethernet switch.
v If the storage subsystem is a dual-controller storage subsystem, connect an
Ethernet cable from the host port on the other controller on the storage subsystem to a gigabit Ethernet switch.
Note: Do not configure any two interfaces on the same subnet. If you are using DHCP on more than one interface, multiple interfaces can end up on the same subnet. Direct iSCSI connections from the host to the storage subsystem are not supported.
For illustrations of host connections, see “Single-controller iSCSI connections” and “Dual-controller iSCSI configurations” on page 73.
Single-controller iSCSI connections:
The following illustration shows a single controller storage subsystem that is attached to a single host. This configuration has no redundancy.
Host system
with one iSCSI
connector
1 Gigabit/10 Gigabit
Ethernet switch
DS3500
e35i0001
Figure 64. Single-host, single-controller iSCSI configuration
A system with dual iSCSI ports can provide enhanced performance compared to a system that uses only one iSCSI port.
The following illustration is an example of a host that uses multiple ports attached to a single-controller configuration. This configuration provides some path redundancy.
Chapter 3. Cabling the storage subsystem and storage enclosure 71
Host system
with two iSCSI
connectors
1 Gigabit/10 Gigabit
Ethernet switch
DS3500
e35i0002
Figure 65. Multiple-port, single-controller iSCSI configuration
The following illustration is an example of multiple single-port host systems that are connected to a single-controller DS3500 using multiple connections.
Host system
with one iSCSI
connector
1 Gigabit/10 Gigabit
Ethernet switch
DS3500
Host system
with one iSCSI
connector
e35i0003
Figure 66. Multiple single-port hosts, single-controller iSCSI configuration
For host configurations, the following illustration is an example of a multiple-host, multiple-port, single-controller, and redundant-path configuration.
72 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Host system
with two iSCSI
connectors
Host system
with two iSCSI
connectors
1 Gigabit/10 Gigabit
Ethernet switch
DS3500
1 Gigabit/10 Gigabit
Ethernet switch
e35i0004
Figure 67. Multiple-host, multiple-port, single-controller, and redundant-path iSCSI configuration
You can replace the two gigabit Ethernet switches that are shown in Figure 67 and Figure 68 with one large gigabit Ethernet switch that has the required number of ports. Virtual local area network (VLAN) can also be used to isolate the two iSCSI networks, instead of a single switch.
Host system
with two iSCSI
connectors
Host system
with two iSCSI
connectors
1 Gigabit/10 Gigabit
Ethernet switch
DS3500
DS3500
1 Gigabit/10 Gigabit
Ethernet switch
e35i0005
Figure 68. Multiple-host, multiple-port, multiple-storage-subsystem iSCSI configuration
Dual-controller iSCSI configurations:
The following illustration is an example of a multiple port, single-host configuration. A system that uses multiple iSCSI ports can provide enhanced performance compared to a single-port iSCSI connection.
Chapter 3. Cabling the storage subsystem and storage enclosure 73
Host system
with two iSCSI
connectors
1 Gigabit/10 Gigabit
Ethernet switch
DS3500
e35i0006
Figure 69. Single-host, multiple-port, dual-controller iSCSI configuration
For host configurations, the following illustration is an example of a multiple-host, multiple-port, and redundant path and controller configuration.
You can replace the two gigabit Ethernet switches that are shown in Figure 70 with one large gigabit Ethernet switch that has the required number of ports. Virtual local area network (VLAN) can also be used to isolate the two iSCSI networks, instead of a single switch.
Host system
with two iSCSI
connectors
1 Gigabit/10 Gigabit
Ethernet switch
DS3500
Host system
with two iSCSI
connectors
1 Gigabit/10 Gigabit
Ethernet switch
e35i0007
Figure 70. Multiple-host, multiple-port, dual-controller iSCSI configuration
Figure 71 on page 75 shows an example of a multiple-host, multiple-port, and multiple-fabric (Fibre Channel or iSCSI, and SAS) configuration.
74 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Fibre Channel
or
1 Gigabit/10 Gigabit
Ethernet switch
Host with dual
fibre shannel or
iSCSI ports
Host with dual
SAS HBAs
Fibre Channel or iSCSI ports
SAS ports
DS3500
Figure 71. Example of a multiple-host, multiple-port, and multiple-fabric (Fibre Channel or iSCSI, and SAS) configuration
SAS ports
Fibre Channel or iSCSI ports
e35i0008
Overview of installing an IBM BladeCenter configuration to connect to a DS3500
This section contains an overview of and guidelines for installing an IBM BladeCenter configuration to connect to a DS3500.
Before you install the BladeCenter configuration: v Ensure that the BladeCenter chassis, blade server, SAS connectivity module, and
SAS expansion card are supported. Go to http://www.ibm.com/servers/ storage/support/disk/, select the link for the DS3500, and see the interoperability matrix.
v Ensure that an Advanced Management Module is installed in the BladeCenter
chassis. The latest level of management-module firmware is available at http://www.ibm.com/bladecenter/.
v For the latest SAS connectivity module firmware, SAS expansion card firmware,
blade server BIOS code, and device drivers, see http://www.ibm.com/systems/ support/.
Installing the BladeCenter configuration
To install the IBM BladeCenter SAS Expansion Card (CFFv), IBM BladeCenter SAS Connectivity Module, and blade server, complete the following steps:
1. Install an IBM BladeCenter SAS Expansion Card (CFFv) in each blade server that you want to connect to the DS3500. See the documentation that is shipped with the SAS expansion card for installation requirements and procedures.
2. Install the blade servers in the BladeCenter chassis. See the documentation that is shipped with the blade server for installation requirements and procedures.
Chapter 3. Cabling the storage subsystem and storage enclosure 75
3. Install the IBM BladeCenter SAS Connectivity Modules in the I/O bays in BladeCenter unit. See the documentation that comes with the SAS connectivity modules for installation requirements and procedures.
4. Go to “Connecting BladeCenter hosts to the DS3500.”
Connecting BladeCenter hosts to the DS3500
The dual-controller DS3500 comes with two SAS host connectors on each controller, enabling up to 28 blade servers in two BladeCenter units to be redundantly connected to the storage subsystem.
To protect against the loss of any one path from the host blade servers to the DS3500, use redundant host connections.
To connect a SAS expansion card that is installed in a blade server to the DS3500, complete the following steps:
1. Connect a SAS cable from the SAS host connector on the DS3500 storage controller to any SAS port on an IBM BladeCenter SAS Connectivity Module, which is installed in a BladeCenter unit (port 3 is recommended).
2. To create a redundant host connection, connect a SAS cable from a second SAS connectivity module to a host connector on the other controller in the DS3500. You can create a maximum of two redundant host connections in a dual-controller DS3500, one connection each from the blade center to the DS3500 controller host port as shown in Figure 72 on page 77.
Attention: You can connect only one DS3500 to the BladeCenter SAS Connectivity Module. No other external devices can be connected to the SAS connectivity module.
3. (Optional) For additional storage, connect EXP3500 storage enclosures to the DS3500. See the illustration to configure storage enclosures inFigure 38 on page
50.
Figure 72 on page 77 shows an example of a DS3500 that is connected to one BladeCenter unit.
76 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Figure 72. Example of a DS3500 that is connected to a BladeCenter unit
Cabling the DS3500 and EXP3500 ac power supplies
To connect the DS3500 and EXP3500 ac power-supply cords, complete the following steps:
1. Connect a power cord to a power supply in the DS3500 or EXP3500.
2. Attach the power cord to the strain relief guide.
3. Repeat steps 1 and 2 for the second power supply.
4. Connect the other end of each power cord to a correctly grounded electrical
receptacle. For maximum protection against power loss, connect each of the two power supplies to a different power source.
Chapter 3. Cabling the storage subsystem and storage enclosure 77
Cabling the DS3500 and EXP3500 dc power supplies
Statement 29
CAUTION: This equipment is designed to enable the connection of the earthed conductor of the dc supply circuit to the earthing conductor at the equipment. If this connection is made, all of the following conditions must be met:
v This equipment must be connected directly to the dc supply system earthing
electrode conductor or to a bonding jumper from an earthing terminal bar or bus to which the dc supply system earthing electrode conductor is connected.
v This equipment must be located in the same immediate area (such as adjacent
cabinets) as any other equipment that has a connection between the earthed conductor of the same dc supply circuit and the earthing conductor, and also the point of earthing of the dc system. The dc system shall not be earthed elsewhere.
v The dc supply source must be located within the same premises as this
equipment.
v Switching or disconnecting devices must not be in the earthed circuit
conductor between the dc source and the point of connection of the earthing electrode conductor.
Statement 34
CAUTION: To reduce the risk of electric shock or energy hazards:
v This equipment must be installed by trained service personnel in a
restricted-access location, as defined by the NEC and IEC 60950-1, First Edition, The Standard for Safety of Information Technology Equipment.
v Connect the equipment to a reliably grounded safety extra low voltage (SELV)
source. An SELV source is a secondary circuit that is designed so that normal and single fault conditions do not cause the voltages to exceed a safe level (60 V direct current).
v Incorporate a readily available approved and rated disconnect device in the
field wiring.
v See the specifications in the product documentation for the required
circuit-breaker rating for branch circuit overcurrent protection.
v Use copper wire conductors only. See the specifications in the product
documentation for the required wire size.
v See the specifications in the product documentation for the required torque
values for the wiring-terminal nuts.
To connect the DS3500 and EXP3500 dc power-supply cables, complete the following steps:
1. Ensure that the power on-off switch on both of the dc power supply and fan units in the chassis are in the off position.
78 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
2. Using the supplied strap, tie the dc power supply cable to the rail to provide strain relief for the power cable.
Note: The supplied dc power cable uses 10 AWG copper conductors.
3. Connect the dc power cable to the power supply. See Figure 73 for the dc power supply connector PIN positions.
Figure 73. DC power connector - pin positions
Table 13. DC power supply connector - pin descriptions
Number Function DC power cable wire color
1 Pin 1: - 48 V dc Brown 2 Pin 2: POS RTN Blue 3 Pin 3: GND Green/yellow
4. Connect the - 48V wire (brown) of the dc power cable to an approved disconnect device (circuit breaker) rated at 20 A. The disconnect device must be easily accessible from the back of the DS3500 unit.
Attention:
v The disconnect device (circuit breaker) must be rated at 20 A. Ensure that at
least 12 AWG or larger copper conductor wires are used for all of the wiring between the DS3500 or EXP3500 dc power connectors and the dc power source.
v
5. Complete the wiring from the disconnect device to the terminal marked -48V of the Reliably grounded safety extra low voltage (SELV) dc power source. Connect the POS RTN wire (blue) and the ground wire (green/yellow) of the dc power cable to the terminals marked POS RTN and GND on the dc power source, as shown in Figure 74.
Figure 74. DC wiring from DS3500 to disconnect device and dc power source
Chapter 3. Cabling the storage subsystem and storage enclosure 79
Table 14. DC power source wiring descriptions
Number Description
1 Pin1:-48Vdc 2 Pin 2: POS RTN 3 Pin 3: GND 4 DC power source 5 Disconnect device
80 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Chapter 4. Operating the storage subsystem and storage enclosure
This section describes operating procedures for the storage subsystem and storage enclosure.
To ensure optimal operation of the storage subsystem and storage enclosure, see “Best practices guidelines” on page 8.
Performing the health check process
Use the health check process to help you verify and maintain the optimal performance of the storage configuration. The information that you collect in these steps also helps provide IBM Service with important information that is needed during a service call.
Perform the following health check tasks after the initial configuration of the storage subsystem and after all configuration sessions.
1. Monitor the Recovery Guru in the Storage Manager software for any obvious storage subsystem errors or problem conditions.
2. Gather and save the following storage subsystem event logs for review by IBM Service. These event logs should be gathered periodically for regular health check monitoring regardless of the state of the Recovery Guru. (You can collect all these logs at once and compress them into a single file by clicking the Support tab and then Gather Support Information in the Subsystem Management window.)
v DS3500 storage subsystem management event log (MEL) v Storage Subsystem Profile or DS3500 Profile v SAS PHY error log
In addition, you should also collect event logs for the host servers that have mapped logical drives from the storage subsystem.
Attention: Save these event-log files to a server disk that will remain accessible in the event of a DS3500 storage configuration failure. Do not save these event log files only to a LUN in the DS3500 storage subsystem.
3. Use the Storage Subsystem Profile or DS3500 Profile to ensure that the following firmware levels are at the latest versions:
v Controller firmware v ESM firmware v Drive firmware
If the firmware is not up-to-date, upgrade the firmware and software to the latest level that is applicable to the storage configuration. See “Software and hardware compatibility and upgrades” on page 15 for information about where to find the latest firmware and software.
Attention: You must resolve Recovery Guru errors or problems before you upgrade firmware.
Save the storage subsystem profile before you perform any controller or ESM firmware upgrades. Save the storage subsystem profile and all .cfg files to a server disk that will remain accessible in the event of a DS3500 storage configuration failure.
© Copyright IBM Corp. 2010, 2013 81
4. Use the Storage Subsystem Profile or DS3500 Profile to ensure that the following functions are enabled:
v For all DS3500 models, enable Media Scan both at the controller level and at
the LUN level.
v For all DS3500 models, enable the read/write cache. In addition, use the
Storage Subsystem Profile to ensure that cache is matched between the controllers.
Set a regular schedule of periodic health check evaluations to keep the firmware levels current and to preserve optimal data access and performance.
Hardware inspection
In addition to the health check process, regular hardware inspection and maintenance helps to support the optimal performance of the storage configuration. Periodically inspect the components of the storage configuration.
For best results, follow these guidelines: v Maintain an up-to-date storage subsystem profile for the storage configuration.
Save the profile to a server disk that will remain accessible in case of a DS3500 storage configuration failure. Do not save the profile only to a LUN in the storage subsystem.
v Develop a change-management plan. The plan should include schedules for
updating subsystem firmware and server host software.
Note: Some updates might require storage subsystem downtime.
v Use applicable IBM-approved cables for all situations. Note in the configuration
documentation whether any cables are not IBM-approved.
v Create and maintain a cabling diagram of the current configuration. Keep this
diagram updated as you make configuration changes, and keep the cabling diagram available for review.
v Create and maintain a list of other components that are being used within the
cabling diagram (such as the host system and other attached devices).
v Ensure that all controllers and ESMs are correctly seated. v Ensure that all drives are correctly seated. v Ensure that cables are managed correctly. v Ensure proper air flow and temperature for all components in the storage
configuration.
You can find details about many of these inspection and maintenance responsibilities in other sections of this document.
In addition to these inspection and maintenance responsibilities, conduct training for staff that support storage configurations. Although training is not a part of the health check process, training reduces the potential for configuration problems and contributes to the correct operation of the system.
Turning on the storage subsystem
This section contains instructions for turning on the storage subsystem under normal situations. “Turning off the storage subsystem” on page 95 contains instructions for turning off the storage subsystem under normal and emergency situations. When you turn on and turn off the storage subsystem, be sure to use
82 IBM System Storage DS3500 and EXP3500 Storage Subsystem: Installation, User's, and Maintenance Guide
Loading...