graphic, electronic, or mechanical, including photocopying, recording, taping, or storage in an
electronic retrieval system—without prior written permission of the copyright owner.
NetApp reserves the right to change any products described herein at any time, and without notice.
NetApp assumes no responsibility or liability arising from the use of products described herein,
except as expressly agreed to in writing by NetApp. The use or purchase of this product does not
convey a license under any patent rights, trademark rights, or any other intellectual pr operty rights of
NetApp. The product described in this manual may be protected by one or more U.S.A. patents,
foreign patents, or pending applications.
RESTRICTED RIGHTS LEGEND: Use, duplication, or disclosure by the government is subject to
restrictions as set forth in subparagraph (c)(1)(ii) of the Rights in Technical Data and Computer
Software clause at DFARS 252.277-7103 (October 1988) and FAR 52-227-19 (June 1987).
NetApp, the NetApp logo, Network Appliance, the Network Appliance logo, Akorri,
ApplianceWatch, ASUP, AutoSupport, BalancePoint, BalancePoint Predictor, Bycast, Campaign
Express, ComplianceClock, Cryptainer, CryptoShred, Data ONTAP, DataFabric, DataFort, Decru,
Decru DataFort, FAServer, FilerView, FlexCache, FlexClone, FlexScale, FlexShare, FlexSuite,
FlexVol, FPolicy, GetSuccessful, gFiler, Go further, f aster, Imagine Virtually Anything, Lifetime Ke y
Management, LockVault, Manage ONTAP, MetroCluster, MultiStore, NearStore, NetCache, NOW
(NetApp on the Web), ONTAPI, OpenKey, RAID-DP, ReplicatorX, SANscreen, SecureAdmin,
SecureShare, Select, Shadow Tape, Simulate ONTAP, SnapCopy, SnapDirector, SnapDrive,
SnapFilter, SnapLock, SnapManager, SnapMigrator, SnapMirror, SnapMover, SnapRestore,
Snapshot, SnapSuite, SnapValidator, SnapVault, StorageGRID, StoreVault, the StoreVault logo,
SyncMirror, Tech OnTap, The evolution of storage, Topio, vFiler, VFM, Virtual File Manager,
VPolicy, WAFL, and Web Filer are trademarks or registered trademarks of NetApp, Inc. in the United
States, other countries, or both.
IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business
Machines Corporation in the United States, other countries, or both. A complete and current list of
other IBM trademarks is available on the Web at www.ibm.com/legal/copytrade.shtml.
Apple is a registered trademark and QuickTime is a trademark of Apple, Inc. in the U.S.A. and/or
other countries. Microsoft is a registered trademark and Windows Media is a trademark of Microsoft
Corporation in the U.S.A. and/or other countries. RealAudio, RealNetworks, RealPlayer,
RealSystem, RealText, and RealVideo are registered trademarks and RealMedia, RealProxy, and
SureStream are trademarks of RealNetworks, Inc. in the U.S.A. and/or other countries.
All other brands or products are trademarks or registered trademarks of their respective holders and
should be treated as such.
NetApp, Inc. is a licensee of the CompactFlash and CF Logo trademarks. NetApp, Inc. NetCache is
certified RealSystem compatible.
Safety rulesAll products are Class 1 laser devices, except the NVRAM5 cluster media
converter, which is Class 1M. You must follow these safety rules when
working with this equipment:
DANGER
Failure to follow these directions could result in bodily harm or death.
◆When using an NVRAM5 cluster media converter, the system must be
installed in a restricted access location.
◆Switzerland only—for FA S900, GF900, R200, and C6200 systems:
This equipment relies on fuses/circuit breakers in the building installation
for overcurrent protection. Each power supply must receiv e po wer from a
separately dedicated outlet with a 10A fuse/circuit breaker.
◆When installing disk shelves and a system into a movable cabinet or rack,
install from the bottom up for best stability.
◆DC-based systems must be installed in a restricted access location and the
two input power terminals for the DC power supply must be connected to
separate isolated branch circuits.
◆T o reduce the risk of personal injury or equipment damage, allow internal
components time to cool before touching them and ensure that the
equipment is properly supported or braced when installing options.
◆This equipment is designed for connection to a grounded outlet. The
grounding type plug is an important safety feature. To avoid the risk of
electrical shock or damage to the equipment, do not disable this feature.
◆This equipment has one or more replaceable batteries. There is danger of
explosion if the battery is incorrectly replaced. Replace the battery only
with the same or equivalent type recommended by the manufacturer.
Dispose of used batteries according to the manufacturer’s instructions.
For units with multiple
power cords
If your system or disk shelf has multiple power cords and you need to turn the
unit off, heed the following warning:
DANGER
This unit has more than one power supply cord. To reduce the risk of
electrical shock, disconnect all power supply cords before servicing.
Safety Information (Sicherheitshinweise)v
SicherheitsvorgabenAlle Produkte sind Lasergeräte der Klasse 1, mit Ausnahme des NVRAM5
Cluster-Medienkonverters, der in Klasse 1M fällt. Beim Einsatz dieser Geräte
sind die Sicherheitsvorschriften zu beachten:
Vorsicht
Nichtbeachtung dieser Vorschriften kann zu Verletzungen oder T od führen.
◆Bei der Verwendung eines NVRAM5 Clust e r-Medienkonverters muss
das Speichersystem an einem Standort mit beschränktem Zugriff
installiert werden.
◆Nur für die Schweiz - Systeme FAS900, GF900, R200 und C6200:
Diese Geräte erfordern den Festeinbau von Sicherungen zum
Überstromschutz. Jeder Netzanschluss muss mit Strom aus getrennten,
speziell für diesen Zweck vorgesehenen Steckdosen versorgt werden, die
jeweils mit einer 10A-Sicherung geschützt sind.
◆Werden die Plattenregale und das Speichersystem in einen beweglichen
Schrank oder Turm eingebaut, ist wegen der höheren Stabi lität der
Einbau von unten nach oben vorzunehmen.
◆Gleichstrom-Systeme müssen an Betriebsstaette mit beschraenktem
Zutritt installiert sein und die beiden Eingangsstromklemmen für das
Gleichstrom-Netzteil müssen an separate und isolierte Abzweigleitungen
angeschlossen sein.
◆Zum Schutz vor Körperverletzung oder Sachschäden am Gerät lassen Sie
die inneren Bauteile stets vor dem Berühren abkühlen. Sorgen Sie dafür,
dass das Gerät richtig abgestützt ist oder fest aufrecht steht, bevor Sie
neues Zubehör einbauen.
◆Dieses Gerät ist für die Einspeisung aus einer geerdeten Netzverbindung
ausgelegt. Der Netzstecker mit Erdungsvorrichtung ist ein wichtiger
Sicherheitsschutz. Zum Schutz vor elektrischem Schlag oder
Sachschäden am Gerät die Erdung nicht abschalten.
◆Das Gerät ist mit einer oder mehreren auswechselbaren Batterien
ausgestattet. Bei unsachgemäßem Auswechseln der Batterie besteht
Explosionsgefahr. Batterien nur mit dem vom Hersteller empfohlenen
Typ oder entsprechenden Typen ersetzen. Gebrauchte Batterien sind
gemäß den Anweisungen des Herstellers zu entsorgen.
Für Geräte mit mehrfachen Netzan-
Wenn Ihr Speichersystem oder Plattenregal über mehrere Stromkabel verfügt
und Sie die Einheit ausschalten müssen, folgenden Warnhinweis beachten:
schlussleitungen
ACHTUNG
Gerät besitzt zwei Netzanschlussleitungen. Vor Wartung alle Anschlüsse
vom Netz trennen.
viSafety Information (Sicherheitshinweise)
Installation Roadmap for the Disk Shelf
About this chapterThis chapter provides a roadmap for installing the DS14mk2 FC and DS14mk4
FC disk shelf.
1
Topics in this
chapter
This chapter discusses the following topics:
◆“Differences between the various disk shelf models” on page 2
◆“Before you begin your installation” on page 4
◆“The installation process” on page 9
Chapter 1: Installation Roadmap for the Disk Shelf1
Differences between the various disk shelf models
Differences
between the disk
shelves
The following table lists the differences between the various disk shelf models.
Note
See the System Configuration Guide at http://now.netapp.com for information
about the system supporting the disk shelf configuration. Not all disk shelves or
shelf modules are supported by all systems or operating systems.
FeaturesDS14 mk2 FCDS14mk4 FC
Shelf
chassis
Front: Driv e bays are keyed
to prevent the use of
unsupported drives.
Back: Power supply bays
are keyed to prevent the use
of older power supplies that
are incompatible.
Existence of a 1-Gb/2-Gb
loop-speed switch.
◆The 1-Gb loop speed
setting must be used if
the disk shelf is
connected to the
F AS270.
◆The 2-Gb loop speed
setting must be used if
there is any component
on any part of the loop
that is only capable of 2Gb operation. Examples
of these components are
this disk shelf model,
SFPs, or HBAs.
Front: Drive bays are keyed to
prevent the use of unsupported
drives.
Back: Power supply bays are
keyed to prevent the use of older
power supplies that are
incompatible.
Existence of a 1-Gb/2-Gb/
4-Gb loop-speed switch.
◆The 1-Gb loop speed setting
must be used if there is any
component on any part of the
loop that is only capable of
1-Gb operation. Examples of
these components are the
FAS270 or the DS14..
◆The 2-Gb loop speed setting
must be used if there is any
component on any part of the
loop that is only capable of
2-Gb operation. Examples of
these components are the
DS14mk2FC, SFPs, HBAs,
or drives.
2Differences between the various disk shelf models
FeaturesDS14 mk2 FCDS14mk4 FC
◆
For the 4-Gb loop speed
setting to be used, all
components on any part of
the loop must be of 4-Gb
capable. Examples of these
components are this disk
shelf model, SFPs, HBAs, or
drives.
Drives in
drive
carriers
Power
supplies
ESH4
ESH2
Drive carriers are keyed and
can be used with all shelf
models.
Power supplies are keyed
and can be used with all
shelf models.
◆ESH4 functions at 1-Gb
or 2-Gb loop speed,
depending on the
system configuration.
◆Does not have a
terminate switch.
◆ESH2 functions at 1-Gb
or 2-Gb loop speed,
depending on the
system configuration.
◆Does not have a
terminate switch.
Drive carriers are keyed and can
be used with all shelf models.
Power supplies are keyed and can
be used with all shelf models..
◆ESH4 functions at 1-Gb, 2-
Gb, or 4-Gb loop speed,
depending on the system
configuration.
◆Does not have a terminate
switch.
Does not support the use of
ESH2.
Chapter 1: Installation Roadmap for the Disk Shelf3
Before you begin your installation
About disk shelf
installation
Disk shelf
numbering
Before you install one or more disk shelves in a rack, you need to understand the
following information:
◆Disk shelf numbering
◆Loop IDs
◆Supported disk drives
◆Drive bay requirements
Each disk shelf in a loop must have a unique ID. A valid shelf ID is from 1
through 7, with disk shelf 1 connected to the system. If you install a second or
third loop of disk shelves, the disk shelf IDs in each loop must start at 1. The ID
of a single disk shelf must be 1.
Each disk shelf is shipped with its assigned ID set on its back panel. You must
ensure that the disk shelf has the correct ID number on the label. The ID label is
on the right side of the disk shelf, as shown in the following illustration.
Shelf 1
Drive Bays
013
0
456789101112133 2 1 0
Loop ID
29 - 16
NetApp sets the disk shelf IDs at the factory on configured systems, using an ID
switch on the back panel. If you order additional disk shelves, you must set the
disk shelf ID.
Attention
If you change a disk shelf ID, you must power-cycle the disk shelf for the new ID
to take effect. The disk shelf ID display on the front of the disk shelf blinks until
you power-cy cle the disk shelf.
4Before you begin your installation
1
Shelf ID switch
Note
If you enter a shelf ID that is not from 1 through 7, the drive addresses default to
those of a shelf with the ID switch set to 7 even though the Shelf ID indicator in
the front operation panel displays a dash (-).
The example in the following illustration shows a DS14mk2 FC with the disk
shelf ID set to 1.
1
Loop IDsIn addition to identifying the disk shelf ID and the direction of the drive bays, the
ID label on the right side of the disk shelf includes the loop ID. The loop ID
identifies the disks in the disk shelf. The last sheets of the quick reference cards
that come with your disk shelf shows the seven disk shelf IDs and their
corresponding loop IDs.
Chapter 1: Installation Roadmap for the Disk Shelf5
For DS14mk2 FC:
6Before you begin your installation
For DS14mk4 FC:
Supported disk
drives
Drive bay
requirements
See the System Configuration Guide at http://now.netapp.com for more
information on supported drives and platforms.
For enclosure services monitoring to work, driv e bays 0 and 1 must contain a
disk.
This requirement is posted on the label on the left flange of the disk shelf. The 14
drive bays in the disk shelf are numbered 0 through 13 from right to left, as
shown in the following illustration.
Chapter 1: Installation Roadmap for the Disk Shelf7
Label
POPULATE
BAYS 0 & 1
FOR
ENCLOSURE
SERVICES
456789101112133 2 1 0
The system uses the enclosure services monitoring method to monitor
environmental conditions of the disk shelf. Enclosure services conditions are
communicated to the system through the ESH2 or ESH4 module.
The following table describes the three stages of enclosure services monitoring.
StageDeviceWhat it does...
1System Uses a subset of SCSI-3 commands to monitor the
disk shelf for data related to disk presence,
temperature, power supply units, and fan status.
0
2SystemSends the commands through its Fibre Channel
interface to drive bays 0 and 1 on the disk shelf.
3Drive bays 0
and 1
ESH2 or ESH4
module
8Before you begin your installation
Communicate the request to the ESH2 or ESH4
module and send the data to the system.
Collects the requested data and sends it to drive
bays 0 and 1.
The installation process
The installation
The following table provides a guide to the disk shelf installation process.
process
StageProcedureIs the procedure required?For instructions, go to...
1Install the system in a
freestanding rack.
Only if the disk shelf installation
is part of a new system
Installation and Setup
Instructions for your system.
installation.
2Install the disk shelves in
the rack.
Yes, if the disk shelf is an addition
to your existing system or if your
Installation and Setup
Instructions for your system.
new system was not shipped in a
system cabinet.
3Connect the disk shelf to
the system.
Only in the following scenarios:
◆If the disk shelf installation is
part of a new system
Installation and Setup
Instructions for your system.
installation.
◆If the disk shelf is the first in
an additional loop to your
existing system.
“Hot-adding a disk shelf to
an existing adapter in your
system” on page 62
4Connect the disk shelves.Only in the following scenarios:
5Ground the Fibre Channel
disk shelves and system.
◆If the new system installation
has multiple disk shelves.
◆If the disk shelf is an addition
to your existing system.
Yes.Installation and Setup
Installation and Setup
Instructions for your system.
“Hot-adding a disk shelf to
an existing loop” on page 57
Instructions for your system,
“Installing a disk shelf in a
rack” on page 38, or
Appendix A, “Hot-adding a
Disk Shelf to an Existing
System, ” on page 55.
Chapter 1: Installation Roadmap for the Disk Shelf9
StageProcedureIs the procedure required?For instructions, go to...
6Connect the disk shelves
Yes.Installation and Setup
to a power source.
If the system was shipped in a
system cabinet, you must connect
the system cabinet to a power
source.
7Configure the system.Yes, if the disk shelf installation is
part of a new system installation.
Instructions for your system,
“Installing a disk shelf in a
rack” on page 38, or
Appendix A, “Hot-adding a
Disk Shelf to an Existing
System, ” on page 55.
See the System Cabinet Guide.
See the Data ONTAP Software Setup Guide.
10The installation process
Monitoring the Disk Shelf
About this chapterThis chapter describes how to monitor the disk shelf from the error messages
displayed on the console that is connected to the system and identifies the
location of the various LEDs on the disk shelf.
Note
The quick reference cards in the slide-out tray at the base of the disk shelf
describe the functions of each LED on the disk shelf and the suggested course of
action.
2
Topics in this
chapter
This chapter discusses the following topics:
◆“Monitoring the front operation panel” on page 12
◆“Monitoring the ESH2 or ESH4 modules” on page 15
◆“Monitoring the ESH2/ESH4” on page 20
◆“Monitoring the Fibre Channel disk” on page 28
Chapter 2: Monitoring the Disk Shelf11
Monitoring the front operation panel
About monitoring
the front operation
panel
The front operation panel has five LEDs and a disk shelf ID display. Th e LEDs
indicate whether your disk shelf is functioning normally or there are problems
with the hardware. You can also identify any hardware failure associated with the
front operation panel of the disk shelf from the error messages displayed on your
system console.
Location of LEDsThe following illustration shows the location of the disk shelf ID display and the
front panel LEDs.
DS14
Power
Fault
Loop A
Loop B
System
1
Disk shelf ID display
Note
The Fault and System LEDs are amber. The other three LEDs are green. See
“LED status on the front operation panel” on page 13 for an illustrated
explanation of how the LEDs function.
Monitoring the disk
shelf ID
When you use the thumbwheel switch on the back of the disk shelf to change the
disk shelf ID, the disk shelf ID display on the front panel blinks until you powercycle the disk shelf to make the change take effect.
12Monitoring the front operation panel
LED status on the
front operation
panel
The following illustrations are of the first sheets of the quick reference cards that
come with your disk shelf. They shows the normal and fault conditions that the
LEDs indicate and recommends a corrective action.
For DS14mk2 FC:
Chapter 2: Monitoring the Disk Shelf13
For DS14mk4 FC:
Front operation
panel console error
messages
The following error messages appear on your system console if an SES element
on the front operation panel fails. For information about replacing a disk shelf,
see “Replacing a disk shelf” on page 32.
Error messageAction required
Temperature sensor
Element 1: failed
The temperature sensor on the front operation panel
failed. Contact technical support to replace the disk
shelf.
Alarm
Element 1: failed
Display
Element 1: failed
14Monitoring the front operation panel
The alarm on the front operation panel failed. Contact
technical support to replace the disk shelf.
The alarm on the front operation panel failed. Contact
technical support to replace the disk shelf.
Monitoring the ESH2 or ESH4 modules
About monitoring
the modules
All the modules have LEDs that indicate whether it is functioning normally or if
there are any problems with the hardware. The following table identifies the type
of LED that is available for each type of module.
Note
The Fault LED is amber. The input and output LEDs are green. See “LED status
on the modules” on page 16 for an illustrated explanation of the LED functions.
On ESH4, the appropriate loop speed LED lights up to indicate the speed of
operation.
You can also identify any hardware failure associated with the module from the
error messages displayed on your system console.
This section also describes the different types of messages that appear on the
system console in response to a command monitoring the ESH2 or ESH4.
Location of the
module LEDs
Chapter 2: Monitoring the Disk Shelf15
The modules are in the middle of the back of the disk shelf. Because module A is
inverted, the location of the module A LEDs is the inverse of what is shown in
some of the illustrations.
The following illustration shows the location of the LEDs for an ESH2.
The following illustration shows the location of the LEDs for an ESH4. The LED
for ELP is for future functionality.
ELP
LED status on the
modules
The following illustrations are of the second sheets of the quick reference cards
that come with your disk shelf. The rest of the second sheet of the quick reference
card identifies the LED status conditions for the power supply and the integrated
fan module.
16Monitoring the ESH2 or ESH4 modules
For DS14mk2 FC:
Chapter 2: Monitoring the Disk Shelf17
For DS14mk4 FC:
Console error
messages for the
modules
The following error messages appear on your system console if an SES element
on the module fails. For information about replacing the module, see “Replacing
an ESH2/ESH4 module” on page 48.
Error messageAction required
SES electronics
Element 1: component
is from a different
product family
Module A was replaced and the shelf has the
unsupported configuration of ESH2 and ESH4.
This error message occurs during the process of
hot-upgrading.
18Monitoring the ESH2 or ESH4 modules
Error messageAction required
SES electronics
Element 2: component
is from a different
product family
SES electronics
Element 1: failed
SES electronics
Element 2: failed
Temperature sensor
Element 2: not
installed or failed
Temperature sensor
Element 3: not
installed or failed
SES electronics
Element 1: not
installed or failed
Vendor-specific
Element 1: not
installed or failed
Module B was replaced and the shelf has the
unsupported configuration of ESH2 and ESH4.
This error message occurs during the process of
hot-upgrading.
Module A on the top back of the disk shelf failed.
Contact technical support to replace the module.
Module B on the bottom back of the disk shelf
failed. Contact technical support to replace the
module.
Communication was possible with the temperature
sensor on ESH2/ESH4 module A at one point, but
it is not possible now. Even if traffic is flowing
through the Fibre Channel loop, contact technical
support to replace the ESH2/ESH4.
Communication was possible with the temperature
sensor on ESH2/ESH4 module B at one point, but
it is not possible now. Even if traffic is flowing
through the Fibre Channel loop, contact technical
support to replace the ESH2/ESH4.
Communication was possible with ESH2/ESH4
module A at one point, but it is not possible now.
Even if traffic is flo wing through the Fibre Channel
loop, contact technical support to replace the
ESH2/ESH4.
SES electronics
Element 2: not
installed or failed
Vendor-specific
Element 2: not
installed or failed
Chapter 2: Monitoring the Disk Shelf19
Communication was possible with ESH2/ESH4
module B at one point, but it is not possible now.
Even if traffic is flo wing through the Fibre Channel
loop, contact technical support to replace the
ESH2/ESH4.
Monitoring the
ESH2/ESH4
Command to use: Use the following commands to enable you to monitor the
ESH2/ESH4.
If the disk shelf connects to a...Use the commands...
◆
System with Data ONTAP 7.x or
earlier installed
System with Data ONTAP 10.x
installed
storage show hub
◆
environ shelf
◆
storage show hub
◆
environ shelf
But you must do the following before
you can use the above commands:
1. Log into the system and enter the
following command at the
console to go to the shell
command mode:
ngsh
2. Enter the following command at
the console to go to the
command line interface:
dbladecli
Sample output: The following is an example of the output from the
show hub
command. The exact messages that appear on your system console
storage
depend on your system configuration.
Note
For the ESH2/ESH4, the following output shows the Term switch status as N/A or
not applicable because the ESH2/ESH4 does not have a terminate switch.
Hub name: 9.shelf2
Channel: 9
Loop: B
Shelf id: 2
Shelf UID: 50:05:0c:c0:02:00:24:02
Term switch: ON
Shelf state: ONLINE
ESH state: OK
OK
TERM
OK
OK
OK
OK
OK
OK
OK
OK
BYP/TBI
OK
OK
EMPTY
OK
OK
Description of hub
status information
Loop
up
Count
8
8
10
8
10
10
10
10
10
10
10
8
8
8
8
10
Invalid
CRC
Count
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Invalid
Word
Count
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Clock
Delta
0
-8
0
-8
-8
0
0
-16
0
16
0
-8
0
0
8
16
Inser
t
Count
20
6
6
9
6
8
9
7
6
16
8
6
6
15
4
8
Stall
Count
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
Uti
l %
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
LIP
Count
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
You might receive some of the following status reports in response to the
storage show hub
command.
Shelf state: The following table lists and describes the shelf status responses.
Shelf stateDescription
ONLINEShelf is fully configured and operational.
INIT REQDShelf needs to configure one or both ESH2/ESH4 modules.
OFFLINEContact was lost with shelf (SES drive access is down).
MISSINGShelf was removed from the system entirely (all paths).
FAILEDFailure occurred on the shelf.
ESH2/ESH4 state: The following table lists and describes the ESH2/ESH4
status responses.
Shelf stateDescription
OKESH2/ESH4 is fully operational.
Chapter 2: Monitoring the Disk Shelf21
Shelf stateDescription
MISSINGESH2/ESH4 is missing from the specified slot.
XPORT ERRORCommunication with the ESH2/ESH4 is not possible.
Terminate (Term) switch state: The following table lists and describes the
terminate switch status.
Note
The information in the following table is not applicable to the ESH2 because it
does not have a terminate switch.
Shelf stateDescription
OKT erminate switch is in the Off position. This DS14mk2 FC is
connected to another DS14mk2 FC in the loop.
TERMTermin ate switch is in th e On position. This DS14mk2 FC is
the last shelf in the loop.
TERM-ERRForced terminate event. The terminate switch is in the On
position even though this DS14mk2 FC is connected to
another DS14mk2 FC in the loop. The output port LED
flashes to indicate this configuration error.
AUTO-TERMTerminate switch is in the Off position. The output port is no
longer connected to another DS14mk2 FC in the loop, but it
once was. The output port LED flashes to indicate this
configuration error.
ESH2/ESH4 port state: The following table lists and describes the
ESH2/ESH4 status responses.
Shelf stateDescription
OKPort is fu ncti oning normally.
EMPTYNo drive is present in bay.
BYP/TBIPort failed loop test before insert and was not allowed into
loop.
22Monitoring the ESH2 or ESH4 modules
Shelf stateDescription
BYP/XMITPort bypassed due to transmitter default.
BYP/LIPF8Port bypassed due to drive generating LIP F8s.
BYP/DTOPort bypassed due to data timeout errors.
BYP/RLOSPort bypassed due to receiver loss of signal.
BYP/CLOSPort bypassed due to comma loss of signal.
BYP/RPRTPort bypassed due to redundant port connection.
BYP/STALLPort bypassed due to excessive stall errors.
BYP/WRDPort bypassed due to excessiv e word errors.
BYP/CRCPort bypassed due to excessive CRC errors.
BYP/CLKPort bypassed due to excessive clock delta.
BYP/MIRPort bypassed due to cluster mirror bit being set (check
partner).
BYP/LIPF7Port bypassed due to drive transmitting LIP F7s.
BYP/GENPort bypassed due to a “generic” error.
BYP/MANPort was manually bypassed (Manufacturing test only).
BYP/LIPPort bypassed due to drive generating excessive LIP
requests.
BYP/OSCPort bypassed due to excessive port state changes.
BYP/INITPort bypassed as part of ESH Power-On Self-Test.
///:0xXXESH Admin unable to decode port state XX.
Chapter 2: Monitoring the Disk Shelf23
Hub statistic: The following table lists and describes the hub statistic
responses.
Hub statisticDescriptionCommon valuesFailure?
Loop up CountNumber of times this port saw
the loop come up or transition
to up.
Invalid CRC CountNumber of times this port saw
a CRC error.
Invalid Word CountNumber of times this port saw
invalid FC-AL words
transmitted.
Depends on the number of
insertions and removals of disks
and LIPs that occur in the loop.
Is zero under normal operation.
Removal and addition of disks,
and a reset of the adapter, might
generate some CRC errors. CRC
errors on a port pinpoint the
failure location. Excessive CRC
errors for a continuous time
period cause the ESH2/ESH4
firmware to bypass this port.
Is zero under normal operation.
Removal and addition of disks,
and a reset of the adapter, might
generate some word errors. Word
errors on a port pinpoint the
failure location. Excessive word
errors for a continuous time
period causes the ESH2/ESH4
firmware to bypass this port.
No
Yes, if
drive was
bypassed.
Yes, if
drive was
bypassed.
Clock DeltaThe clock delta between this
port in respect to the
ESH2/ESH4 clock and seven
other ports.
It is normal for the FC-AL sync
clocks to drift with respect to each
other. This is a signed drift value.
A value exceeding 6,400 PPM
Yes, if
drive was
bypassed.
causes the ESH2/ESH4 firmware
to bypass this port.
Insert CountNumber of times this port was
inserted into the loop.
Depends on the number of
insertions and removals of disks
No
and LIPs that occur in the loop.
24Monitoring the ESH2 or ESH4 modules
Hub statisticDescriptionCommon valuesFailure?
Stall CountNumber of times this port
exceeded the open/close
(OPN/CLS) maximum
threshold.
Utilization %Relative use of this port versus
other ports in the ESH2/ESH4.
LIP CountNumber of loop initializations
on any ESH2 or ESH4 port
only.
Is zero under normal operation.
Removal and addition of disks,
and a reset of the adapter, might
generate some stall errors.
Excessive stall errors for a
continuous time period cause the
ESH2/ESH4 firmware to b y p a ss
this port.
This value does not reflect the
real-time use of what the ports are
currently achieving and is only
obtained when extended status is
available from the ESH/ESH2. It
indicates the relative use from the
last time extended status was
available.
Is zero under normal operation on
the drive ports.
Yes, if
drive was
bypassed.
No
No
Chapter 2: Monitoring the Disk Shelf25
Monitoring the power supply
LEDs on the power
supply
The power supply has four LEDs. The LEDs indicate whether the power supply
or the integrated fan module is functioning normally or there are problems with
the hardware. You can also identify any hardware failure associated with the
power supplies from the error messages displayed on your system console.
Location of LEDsEach power supply, which contains two LEDs, is encased in a device carrier and
housed at the rear of the disk shelf. The following illustration shows the location
of the power supply LEDs.
Power
Fan LED
AC LED
PSU status normal
Note
The PSU status LED is green. The other three LEDs are amber. See “LED status
on the modules” on page 16 for an illustrated explanation of how the LEDs
function.
26Monitoring the power supply
Power supply
console error
messages
The following error messages appear on your system console if an SES element
on the power supply fails. For information about replacing the power supply, see
“Replacing a power supply in a disk shelf” on page 44.
Error messageAction required
Power supply
Element 1: failed
The power supply unit on the left at the back of the
disk shelf failed. Contact technical support to replace
the power supply.
Power supply
Element 2: failed
The power supply unit on the right at the back of the
disk shelf failed. Contact technical support to replace
the power supply.
Cooling element
Element 1: failed
The integrated fan module in the power supply unit
on the left at the back of the disk shelf failed. Contact
technical support to replace the power supply.
Cooling element
Element 2: failed
The integrated fan module in the power supply unit
on the right at the back of the disk shelf failed.
Contact technical support to replace the power
supply.
Chapter 2: Monitoring the Disk Shelf27
Monitoring the Fibre Channel disk
About monitoring
the Fibre Channel
The Fibre Channel disk has two LEDs. The LEDs indicate whether the disk is
functioning normally or there are problems with the hardware.
disk
Location of LEDsThe following illustration shows the Fibre Channel disk, which has two LED
indicators on the front.
LED 2
LED 1
28Monitoring the Fibre Channel disk
LED status on the
Fibre Channel disks
The following illustrations are of the third sheets of the quick reference cards that
come with your disk shelf.
Note
As of Data ONTAP 6.4.2 and later, drives that are idle perform a media scan in
the background resulting in the LEDs pulsing every half second.
For DS14mk2 FC: The following illustration is a correction of the third sheet
of the quick reference cards that come with your disk shelf.
21
20NNN
20
21
- SES device identification set - - SES device identification set -
- SES device fault bit set - - SES device fault bit set -
22
- Disk port is bypassed by ESH (either port A or B) - - Disk port is bypassed by ESH (either port A or B) -
23
Reinsert drive.
Replace drive.
23
22
3
Find a physical drive identified by software.
Check console messages
Chapter 2: Monitoring the Disk Shelf29
For DS14mk4 FC:
30Monitoring the Fibre Channel disk
Replacing Disk Shelf Devices
About this chapterThis chapter describes how to replace disk shelves in a rack, disks in a disk shelf,
and other devices.
3
Topics in this
chapter
This chapter discusses the following topics:
◆“Replacing a disk shelf” on page 32
◆“Replacing a disk in a disk shelf” on page 40
◆“Replacing a power supply in a disk shelf” on page 44
◆“Replacing an ESH2/ESH4 module” on page 48
Chapter 3: Replacing Disk Shelf Devices31
Replacing a disk shelf
About this sectionThis section discusses how to disconnect a disk shelf from a system, how to
remove a disk shelf from a loop, and how to install a disk shelf. It does not
discuss how to hot-add a disk shelf to a system. For information about hot-adding
a disk-shelf, see Appendix A, “Hot-adding a Disk Shelf to an Existing System,”
on page 55.
Attention
Hot removal of disk shelves is not supported. Shutdown of system is required to
remove shelves from system.
Disk shelf cabling
The following table lists the cabling requirements for the disk shelves.
requirements
Cable type and connectorWhere usedAdditional requirements
LC-to-LC:To connect system optical
adapters to the ESH2 or ESH4
module
Requires optical SFP connector
in the input port of the following
modules:
◆ESH2
◆ESH4
◆FAS270/FAS270c, if
applicable
32Replacing a disk shelf
Cable type and connectorWhere usedAdditional requirements
SFP-to-SFPTo connect disk shelves with
ESH2 and ESH4 modules
For detailed
information
For detailed information about removing a disk shelf from a rack, see the
following topics:
◆“Removing a disk shelf from a single disk shelf configuration” on page 34
◆“Removing a disk shelf from a loop” on page 36
◆“Installing a disk shelf in a rack” on page 38
None
Chapter 3: Replacing Disk Shelf Devices33
Replacing a disk shelf in a rack
Removing a disk shelf from a single disk shelf configuration
Removing a disk
shelf
To remove a disk shelf from a single disk shelf configuration, complete the
following steps.
StepAction
1Ground yourself to the system chassis using the grounding leash.
2
If the disk shelf connects
to a...Then...
System with Data ONT AP
7.x or earlier installed
Shut down the system by entering the
following command at the console
halt
Attention
Always use the
halt
command to
perform a clean shutdown.
System with Data ONT AP
10.x installed
1. Log into the system and enter the
following command at the console
to go to the shell command mode:
ngsh
2. Enter the following command at the
console to go to the command line
interface:
dbladecli
3. Shut down the system by entering
the following command at the
console:
halt
Attention
Always use the
halt
command to
perform a clean shutdown.
34Replacing a disk shelf
StepAction
3Verify that the LCD display at the front of your system displays the
following message:
Halted
4
If the disk shelf has...Then...
AC power suppliesTurn off the power switch on the disk
shelf.
DC power suppliesTurn off and unplug the cables from the
power source.
5Disconnect the two disk shelf power cords from the disk shelf.
6Disconnect the Fibre Channel cable connecting the disk shelf and
system.
7Disconnect the grounding strap connecting the di sk shelf and system.
8Use a Phillips screwdriver to remove the screws securing the disk
shelf to the telco tray, the mid-mount bracket, or the four-post rack.
9With the help of another person, remove the disk shelf from the rack.
CAUTION
The disk shelf is very heavy when fully loaded and requires at least
two people to remove.
Chapter 3: Replacing Disk Shelf Devices35
Replacing a disk shelf in a rack
Removing a disk shelf from a loop
Removing a daisychained disk shelf
To remove a disk shelf from a loop of disk shelves, complete the following steps.
StepAction
1Ground yourself to the system chassis using the grounding leash.
2
If the disk shelf connects
to a...Then...
System with Data ONT AP
7.x or earlier installed
Shut down the system by entering the
following command at the console
halt
Attention
Always use the
halt
command to
perform a clean shutdown.
System with Data ONT AP
10.x installed
1. Log into the system and enter the
following command at the console
to go to the shell command mode:
ngsh
2. Enter the following command at the
console to go to the command line
interface:
dbladecli
3. Shut down the system by entering
the following command at the
console
halt
Attention
Always use the
halt
command to
perform a clean shutdown.
36Replacing a disk shelf
StepAction
3Verify that the LCD display at the front of your system displays the
following message:
Halted
4
If the disk shelf has...Then...
AC power suppliesTurn off the power switch on the disk
shelf.
DC power suppliesTurn off and unplug the cables from the
power source.
5Disconnect the two disk shelf power cords from the disk shelf that
you are going to remove.
6Disconnect the Fibre Channel cables connecting the disk shelf to the
other disk shelves or the system.
7Disconnect the grounding strap connecting the di sk shelf to the other
disk shelves or the system.
8Use a Phillips screwdriver to remove the screws from the flanges of
the disk shelf retention bracket.
9With the help of another person, remove the disk shelf from the rack.
CAUTION
Because the disk shelf is very heavy when fully loaded, it is advised
that at least two people remove the disk shelf.
10
If you are...Then...
Not installing a
replacement disk shelf for
the disk shelf you
removed and it is the first
Reestablish the loop by connecting the
disconnected disk shelves or by
connecting the unconnected disk shelf
to the system.
in the loop or in the
middle of the loop
Installing replacement
disk shelf
Chapter 3: Replacing Disk Shelf Devices37
See “Installing a disk shelf in a rack” on
page 38.
Replacing a disk shelf in a rack
Installing a disk shelf in a rack
Installing a disk
shelf
To install the disk shelf in a rack, complete the following steps.
DANGER
You must install each disk shelf with either the two-post telco tray kit or the fourpost rail kit that came in your shipment package. If you choose to mid-mount the
disk shelf, use the mid-mount brackets with the two-post telco tray kit. Do not
ear-mount the disk shelf into a telco-type rack; the disk shelf will collapse from
the rack under its own weight.
StepAction
1Verify that your system meets the minimum software requirements to
support the disk shelf. See the System Configuration Guide at
http://now.netapp.com for more information.
2Verify that you received the envelope with the disk shelf ID labels.
3Ground yourself to the system chassis using the grounding leash.
4Use the rail kit installation flyer in the rail kit box to inst all the
appropriate rail kits on the rack.
5Install and secure the disk shelf onto the support brackets and rack.
6Change the disk shelf ID with the following procedure:
1. Press the thumbwheel switch on the rear of the disk shelf and use
the + button to raise the number and the - button to lower the
number to a valid ID from 1 through 7.
2. Power-cycle the disk shelf for the new ID to take effect. The disk
shelf ID display on the front of the disk shelf blinks until you
power-cycle the disk shelf.
3. Select the correct label from the env elope identif ied in Step 2 and
attach it to the right flange of the new disk shelf.
7If you are adding multiple disk shelves on the same loop, repeat Step 5
and Step 6 to install the remaining disk shelves.
38Replacing a disk shelf
StepAction
8Set the loop speed:
◆The 1-Gb loop speed setting must be used if the loop is connected
to a FAS270.
◆The 2-Gb loop speed setting must be used if there is any
component on any part of the loop that is only capable of 2-Gb
operation. Examples of these components are the DS14mk2FC,
SFPs, HBAs, or drives.
◆For the 4-Gb loop speed setting to be used, all components on any
part of the loop must be of 4-Gb capable. Examples of these
components are this disk shelf model, SFPs, HBAs, or drives.
Attention
An incorrectly set loop speed causes the system to panic.
9Use the appropriate cable to connect both modules of the disk shelf to
the other disk shelves or to your system. See “Disk shelf cabling
requirements” on page 32 for additional requirements.
10Connect the two disk shelf power cords to each disk shelf that you are
adding.
11Turn on the power first to the disk shelves and then to the system.
12Reboot the system.
Chapter 3: Replacing Disk Shelf Devices39
Replacing a disk in a disk shelf
Reasons to replace
a disk
Preparing to
replace a disk
About replacing a
disk in a disk shelf
You can replace a disk in a disk shelf for any reason. However , the most common
reason is disk failure. If a disk fails, the system logs a warning message to the
system console indicating which disk on which loop failed.
In addition, a disk shelf with an ESH2/ESH4 module identifies any one of the
following situations as disk failure:
◆A disk is bypassed.
◆The system boots with the presence of bypassed disks.
◆The system detects an eminent threshold bypass.
The following autosupport warning message is then sent:
DISK FAIL!! - Bypassed by ESH
Before you replace a disk in a disk shelf, you must first check the disk shelf to
ensure that after you remove the disk you still have enough disks installed to meet
the enclosure services requirements. For information about these requirements,
see “Drive bay requirements” on page 7.
Replacing a disk in a disk shelf consists of the following procedures:
◆“Removing a disk” on page 41
◆“Installing a disk” on page 43
Note
If you are replacing several disks in a disk shelf or if you are installing
several disks into a half-empty disk shelf, replace or install the disks one at a
time to allow your system to recognize the existence of each new disk.
40Replacing a disk in a disk shelf
Removing a diskTo remove a disk, complete the following steps.
StepAction
1
If the disk shelf connects
to a...Then...
System with Data ONTAP
7.x or earlier installed
If you are removing disk that is a
member of a volume, enter:
disk fail disk_name
Or:
If you are removing disk that is a spare
disk, enter:
disk remove disk_name
Either command causes the amber fault
LED on the disk to illuminate.
For more information about LEDs, see
“Monitoring the Fibre Channel disk” on
page 28.
For more information about disk
commands, see the Data ONTAP
System Administrator’s Guide.
Chapter 3: Replacing Disk Shelf Devices41
StepAction
System with Data ONTAP
10.x installed
1. Log into the system and enter the
following command at the console
to go to the shell command mode:
ngsh
2. Enter the following command at the
console to go to the command line
interface:
dbladecli
3. If you are removing disk that is a
member of a volume, enter:
disk fail disk_name
Or:
If you are removing disk that is a
spare disk, enter:
disk remove disk_name
Either command causes the amber fault
LED on the disk to illuminate.
For more information about LEDs, see
“Monitoring the Fibre Channel disk” on
page 28.
2Put on the antistatic wrist strap and grounding leash.
3To remove the disk, press down on its release mechanism with one
hand while grasping the top flange of the disk shelf with the other
hand.
4Gently slide the disk until it disengages. Wait 30 seconds for the disk
to stop spinning; then continue removing the disk from the chassis.
CAUTION
When removing a disk, always use two hands to support its weight.
5If you are removing another disk, repeat Step 1 through Step 4.
42Replacing a disk in a disk shelf
Installing a diskTo install a disk in a disk shelf, complete the following steps.
StepAction
1Put on the antistatic wrist strap and grounding leash.
2Orient the device carrier so that the release mechanism is at the top.
3Insert the device carrier into the guide slot in the disk shelf and
firmly push it in until it engages the backplane and you see the
release mechanism click into place.
Attention
Do not slam the device carrier into place.
4If you are installing another disk, rep eat Step 1 through Step 3.
5Make sure that disks are installed in drive bays 0 and 1 for Enclosure
Services to work.
Chapter 3: Replacing Disk Shelf Devices43
Replacing a power supply in a disk shelf
About this sectionReplacing a power supply in a disk shelf consists of the following procedures:
◆“Removing a power supply” on page 44
◆“Installing a power supply” on page 46
Rules for replacing
power supplies
When replacing the power supply on your disk shelf, observe the following rules:
◆You do not need to turn off the power when you replace one power supply.
◆If you are replacing both power supplies in the same disk shelf, replace them
one at a time to avoid powering down the disk shelf.
Removing a power
To remove a power supply, complete the following steps.
supply
StepAction
1Put on the antistatic wrist strap and grounding leash.
2
If you have a disk shelf
with...Then...
An AC power supply1. Turn off the switch on the power supply that you are
replacing.
2. Lift up the clip lock and unplug the power cord from the
system power supply.
A DC power supply1. Turn off and unplug the cable to the power supply you are
replacing from the power source.
2. Using a #2 Phillips screwdriver, remove and save the
screws securing the connections to the power supply in the
following order:
❖For positive ground installations: first negative (–),
then positive (+), then ground ( )
❖For negative ground installations: first positive (+),
then negative (–), then ground ( )
44Replacing a power supply in a disk shelf
StepAction
3
If the CAM mechanism on
the power supply is...Then...
In the middle of the rear of the
unit
Using the thumb and index finger of both hands, press the
CAM mechanism levers in the middle of the power supply to
release it.
The following figure shows how to release the CAM mechanism.
At the top of the rear of the
unit
Using your thumb and index finger, press the CAM mechanism
levers toward each other to release the power supply handle.
The following figure shows how to press the levers on the CAM mechanism and release the
power supply handle.
OPENOPEN
Chapter 3: Replacing Disk Shelf Devices45
StepAction
4Use the handle to pull the power supply out of the disk shelf.
CAUTION
When removing a power supply, always use two hands to support its weight.
Installing a power
supply
To install a power supply in a disk shelf, complete the following steps.
Attention
Do not use excessive force when sliding the power supply into the disk shelf.
You can damage the connector.
StepAction
1Put on the antistatic wrist strap and grounding leash.
2
If the power supply
CAM mechanism is...
In the middle of the rear
of the unit
At the top of the rear of
the unit
Then slide the power supply in the
power supply bay...
And push the CAM mechanism levers
into place.
1. Until you hear the power supply
connect with the connector inside
the disk shelf chassis.
2. Raise the handle and push it into
place.
3. Using your thumb and index finger,
press the CAM mechanism levers
toward each other to engage the
power supply into place.
46Replacing a power supply in a disk shelf
StepAction
The following figure shows how to raise the handle into place.
3
If the disk shelf has...Then...
An AC power supply1. Plug the power cord into the power
receptacle and fasten it with the
clamp.
2. Plug the other end of the power
cord into a grounded AC power
source.
A DC power supply1. Connect the positive, negative, and
ground wires to the power supply.
2. Plug the other end of each power
cord into a power source.
4Turn on the power switch.
Chapter 3: Replacing Disk Shelf Devices47
Replacing an ESH2/ESH4 module
About a moduleThe ESH2/ESH4 module in a DS14mk2 FC or DS14mk4 FC includes a SCSI-3
Enclosure Services Processor. It maintains the integrity of the loop when disks
are swapped and provides signal retiming for enhanced loop stability. There are
two modules in the middle of the rear of the disk shelf, one for Channel A and
one for Channel B.
Note
The Input and Output ports on module A on the disk shelves are inverted from
module B.
Connectors in a module: The modules have the following connectors.
Module connectorFunction
InputProvides the interface between the disk shelf and the
system.
OutputProvides the interface between two disk shelves to
create a loop of daisy-chained disk shelves.
For detailed
information
48Replacing an ESH2/ESH4 module
This section provides information about the following topics:
◆“Removing a module” on page 49
◆“Installing a module” on page 51
◆“Hot-swapping a module” on page 52
◆“Hot-adding a Disk Shelf to an Existing System” on page 55
Replacing an ESH2/ESH4 module
Removing a module
Assumption about
this procedure
This procedure is based on the assumption that the disk shelf is in a configuration
which fulfils one or all of the following requirements:
◆It has a single path connection
◆It is not in a cluster
◆It does not use synchronous mirroring
Removing a moduleTo remove a module that is connected to the Fibre Channel loop, complete the
following steps.
StepAction
1Put on the antistatic wrist strap and grounding leash.
2
If the disk shelf
connects to a...Then...
System with Data
ONTAP 7.x or earlier
installed
Shut down the system by entering the
following command at the console
halt
Attention
Always use the
halt
command to perform
a clean shutdown.
Chapter 3: Replacing Disk Shelf Devices49
StepAction
System with Data
ONTAP 10.x installed
1. Log into the system and enter the
following command at the console to
go to the shell command mode:
ngsh
2. Enter the following command at the
console to go to the command line
interface:
dbladecli
3. Shut down the system by entering the
following command at the console
halt
Attention
Always use the
halt
command to perform
a clean shutdown.
3Verify that the LCD display at the front of your system displays the
following message:
Halted
4Disconnect the module from the Fibre Channel cabling.
5Using the thumb and index finger of both hands, press the levers on
the CAM mechanism on the module to release it.
6Pull the module out of the disk shelf.
7Go to “Installing a module” on page 51.
50Replacing an ESH2/ESH4 module
Replacing an ESH2/ESH4 module
Installing a module
Installing an
module
To install a module into the disk shelf, complete the following steps.
Attention
Observe the “Disk shelf cabling requirements” on page 32 and do not mix
ESH2/ESH4 modules within a shelf.
StepAction
1V erify that your system meets the minimum software requirements to
support the disk shelf and module combination. See the System
Configuration Guide at http://now.netapp.com for more information.
2Put on the antistatic wrist strap and grounding leash.
3Push apart the levers on the CAM mechanism and slide the module
into the slot at the rear of the disk shelf, then push the levers of the
CAM mechanism into place.
Attention
Do not use excessive force when sliding the module into the disk
shelf; you might damage the connector.
4Reconnect the Fibre Channel cabling.
5Turn on the power to the disk shelves.
6Reboot the system.
Chapter 3: Replacing Disk Shelf Devices51
Replacing an ESH2/ESH4 module
Hot-swapping a module
Assumptions about
this procedure
Hot-swapping a
module
The assumptions about this procedure are that you are replacing either one or
both modules of a single disk shelf, that the modules on the disk shelf have
multipath connections to the system, and that you are hot-swapping one of the
following:
◆An ESH2 with another ESH2
◆An ESH2 with an ESH4
◆An ESH4 with another ESH4
Note
A hot-swap of an ESH2 with an ESH4 requires that you perform a minimum
upgrade to Data ONT AP 6.4.4 or later and replace both modules in the disk shelf.
Depending on the module or modules you are hot-swapping and their position in
the loop, you might need to order additional cables appropriate to the modules.
See “Disk shelf cabling requirements” on page 32 for additional requirements.
Attention
If you attempt to hot-swap the module on a disk shelf that does not have
multipath connections, you lose all access to the drives on this disk shelf as well
as those below it.
To hot-swap a module, complete the following steps.
Note
To hot-swap a module on a disk shelf in a cluster, see the High-Availability
Configuration Guide or the Active/Active Configuration Guide.
StepAction
1Verify that your system meets the minimum software requirements to support the disk shelf and
module combination. See the System Configuration Guide at http://now.netapp.com for more
information.
2Ground yourself to the system chassis using the grounding leash.
52Replacing an ESH2/ESH4 module
StepAction
3
If the disk shelf connects to a...Then...
System with Data ONTAP 7.x or earlier
installed
From the system console, enter the following
command to disable the loop in which the failed
module is a connection:
storage disable adapter adaptername
The Data ONTAP System Administrator’s Guide
(7.0.1 or later) provides more information about
these commands.
System with Data ONTAP 10.x installed1. Log into the system and enter the following
command at the console to go to the shell
command mode:
ngsh
2. Enter the following command at the console to
go to the command line interface:
dbladecli
3. Enter the following command to disable the
loop in which the failed module is a
connection:
storage disable adapter adaptername
4If you are hot-swapping like modules, disconnect the module that you are removing from the
Fibre Channel cabling.
5Using the thumb and index finger of both hands, press the levers on the CAM mechanism on the
module to release it and pull it out of the disk shelf.
6Slide the module into the slot at the rear of the disk shelf and push the levers of the CAM into
place.
Attention
Do not use excessive force when sliding the module into the disk shelf; you might damage the
connector.
7Use the appropriate cable to reconnect both modules of the disk shelf to the other disk shelves or
to your system. See “Disk shelf cabling requirements” on page 32 for additional requirements.
Chapter 3: Replacing Disk Shelf Devices53
StepAction
8
If the disk shelf connects to a...Then...
System with Data ONTAP 7.x or earlier
installed
From the system console, enter the following
command to enable the loop in which the
replacement module is a connection:
storage enable adapter adaptername
System with Data ONTAP 10.x installed1. Log into the system and enter the following
command at the console to go to the shell
command mode:
ngsh
2. Enter the following command at the console to
go to the command line interface:
dbladecli
3. Enter the following command to enable the
loop in which the replacement module is a
connection:
storage enable adapter adaptername
9Repeat Step 3 through Step 8 for Loop B.
54Replacing an ESH2/ESH4 module
Hot-adding a Disk Shelf to an Existing System
About this appendixThis appendix provides information about how to hot-add a DS14mk2 FC/
DS14mk4 FC to an existing system. It also tabulates the error messages that
appear on your system console if the attempt at hot-adding was unsuccessful.
Note
Only hot-add disk shelves that your system supports.
NetApp recommends that you hot-add one disk shelf at a time.
Attention
Failure to follow this recommendation may cause the loop to crash.
Error messagesThe following error messages appear on your system console if your attempt at
hot-adding the DS14mk2 FC is unsuccessful.
Error messageExplanation
A
Speed mismatch
termination
Open loop panic
Soft address
panic
For detailed
information
Appendix A: Hot-adding a Disk Shelf to an Existing System55
For detailed information about hot-adding a disk shelf, see the following topics:
◆“Hot-adding a disk shelf to an existing loop” on page 57
The modules on the disk shelf detected a speed
mismatch between the preceding disk shelf and this disk
shelf and is reporting them as automatic terminate errors.
One of three reasons cause this error message to appear:
◆The shelf-to-shelf cable between the now second-to-
last disk shelf and the newly added disk shelf is
defective or is not securely fastened.
◆The speed of the newly added DS14mk2 FC/
DS14mk4 FC disk shelf is incorrectly set.
One of two reasons cause this error message to appear:
◆There is an invalid disk shelf ID.
◆The power was turned on before the disk shelf ID
was changed and the disk shelf was not powercycled after the disk shelf ID was changed.
“Hot-adding a disk shelf to an existing adapter in your system” on page 62
◆
56Hot-adding a Disk Shelf to an Existing System
Hot-adding a disk shelf to an existing loop
Hot-adding a disk
shelf to an existing
loop
To hot-add a disk shelf to an existing loop, complete the following steps.
Note
To hot-add disk shelves to a High availability or Active/active configuration, see
the High-Availability Configuration Guide or the Active/Active Configuration Guide.
StepAction
1V erify that your system meets the minimum software requirements to
support the disk shelf and module combination. See the System
Configuration Guide at http://now.netapp.com for more information.
2Verify that you received the en velope with the disk shelf ID labels.
3Ground yourself to the system chassis using the grounding leash.
4Use the rail kit installation flyer in the rail kit box to install the
appropriate rail kits on the rack.
5Install and secure the disk shelf onto the support brackets and rack.
6If you are adding multiple disk shelves on the same loop, repeat Step
4 and Step 5 to install the remaining disk shelves in ascending
numerical order, according to the IDs on their labels.
7Connect the grounding strap connecting the disk shelf to the other
disk shelves or your system.
Appendix A: Hot-adding a Disk Shelf to an Existing System57
StepAction
8Set the loop speed:
◆The 1-Gb loop speed setting must be used if the system is an
F AS270.
◆The 2-Gb loop speed setting must be used if there is any
component on any part of the loop that is only capable of 2-Gb
operation. Examples of these components are the DS14mk2FC,
SFPs, HBAs, or drives.
◆For the 4-Gb loop speed setting to be used, all components on
any part of the loop must be of 4-Gb capable. Examples of these
components are this disk shelf model, SFPs, HBAs, or drives.
Attention
An incorrectly set loop speed causes the system to panic.
9Connect the two disk shelf power cords of each disk shelf that you
are adding to a power source.
Attention
Do not turn on the power to the disk shelf yet.
58Hot-adding a disk shelf to an existing loop
StepAction
10
If the disk shelf connects
to a...
Then change the disk shelf ID with
the following procedur e...
System with Data ONT AP
7.x or earlier installed
1. Verify that the disk shelf ID is not
being used in the loop by entering
the following command at the
console
fcstat device_map
adaptername
Attention
An invalid disk shelf ID causes the
system to panic.
2. Press the thumbwheel switch on
the rear of the disk shelf and use
the + button to raise the number
and the - button to lower the
number to a valid ID from 1
through 7.
3. Select the correct label from the
envelope identified in Step 2 and
attach it to the right flange of the
new disk shelf.
Appendix A: Hot-adding a Disk Shelf to an Existing System59
StepAction
System with Data ONT AP
10.x installed
1. Log into the system and enter the
following command at the console
to go to the shell command mode:
ngsh
2. Enter the following command at
the console to go to the command
line interface:
dbladecli
3. Verify that the disk shelf ID is not
being used in the loop by entering
the following command at the
console
fcstat device_map
adaptername
Attention
An invalid disk shelf ID causes the
system to panic.
4. Press the thumbwheel switch on
the rear of the disk shelf and use
the + button to raise the number
and the - button to lower the
number to a valid ID from 1
through 7.
5. Select the correct label from the
envelope identified in Step 2 and
attach it to the right flange of the
new disk shelf.
11Turn on the power to the disk shelf and you must wait 30 seconds for
the shelf electronics to finish initializing.
12Connect one end of the provided cable to the module A Output on the
last disk shelf in the existing loop.
13Connect the other end of the cable to the module A Input on the new
disk shelf.
14Connect one end of the provided cable to the module B Output on the
last disk shelf in the existing loop.
60Hot-adding a disk shelf to an existing loop
StepAction
15Connect the other end of the cable to the module B Input on the new
disk shelf.
16Verify that all the cables are securely fastened.
Attention
Poorly secured cables cause the system to panic over an open loop.
Result: In 60 seconds, the system recognizes the hot-added disk
shelf.
Appendix A: Hot-adding a Disk Shelf to an Existing System61
Hot-adding a disk shelf to an existing adapter in your system
Requirements for
this procedure
Hot-adding a disk
shelf to an existing
adapter
The following requirements must be met for this procedure:
◆Your system must have Data ONTAP 7.2 or later.
◆There must be an available but unused adapter on your system to do this
procedure.
❖If you have an available dual-port and an available quad-port adapter,
the dual-port adapter should be used first.
❖If you only have an available quad-port adapter and you are hot-adding a
single loop of disk shelves, then Ports A and B are defined as a port pair
and Ports C and D are defined as a port pair. For the purposes of
incorporating redundancy, Module A connects to Port A or Port B and
Module B connects to Port C or Port D.
To hot-add a disk shelf to an existing loop, complete the following steps.
Note
To hot-add disk shelves to a High availability or Active/active configuration, see
the High-Availability Configuration Guide or the Active/Active Configuration Guide.
StepAction
1V erify that your system meets the minimum software requirements to
support the disk shelf and module combination. See the System
Configuration Guide at http://now.netapp.com for more information.
2Verify that you received the en velope with the disk shelf ID labels.
3Ground yourself to the system chassis using the grounding leash.
4Use the rail kit installation flyer in the rail kit box to install the
appropriate rail kits on the rack.
5Install and secure the disk shelf onto the support brackets and rack.
6If you are adding multiple disk shelves on the same loop, repeat Step
4 and Step 5 to install the remaining disk shelves in ascending
numerical order, according to the IDs on their labels.
62Hot-adding a disk shelf to an existing adapter in your system
StepAction
7Connect the grounding strap connecting the disk shelf to the other
disk shelves or your system.
8Set the loop speed:
◆The 1-Gb loop speed setting must be used if the system is an
F AS270.
◆The 2-Gb loop speed setting must be used if there is any
component on any part of the loop that is only capable of 2-Gb
operation. Examples of these components are the DS14mk2FC,
SFPs, HBAs, or drives.
◆For the 4-Gb loop speed setting to be used, all components on
any part of the loop must be of 4-Gb capable. Examples of these
components are this disk shelf model, SFPs, HBAs, or drives.
Attention
An incorrectly set loop speed causes the system to panic.
9
If the disk shelf connects
to a...
Then change the disk shelf ID with
the following procedur e...
System with Data ONT AP
7.x or earlier installed
1. Verify that the disk shelf ID is not
being used in the loop by entering
the following command at the
console
fcstat device_map
adaptername
Attention
An invalid disk shelf ID causes the
system to panic.
2. Press the thumbwheel switch on
the rear of the disk shelf and use
the + button to raise the number
and the - button to lower the
number to a valid ID from 1
through 7.
3. Select the correct label from the
envelope identified in Step 2 and
attach it to the right flange of the
new disk shelf.
Appendix A: Hot-adding a Disk Shelf to an Existing System63
StepAction
System with Data ONT AP
10.x installed
1. Log into the system and enter the
following command at the console
to go to the shell command mode:
ngsh
2. Enter the following command at
the console to go to the command
line interface:
dbladecli
3. Verify that the disk shelf ID is not
being used in the loop by entering
the following command at the
console
fcstat device_map
adaptername
Attention
An invalid disk shelf ID causes the
system to panic.
4. Press the thumbwheel switch on
the rear of the disk shelf and use
the + button to raise the number
and the - button to lower the
number to a valid ID from 1
through 7.
5. Select the correct label from the
envelope identified in Step 2 and
attach it to the right flange of the
new disk shelf.
10Turn on the power to the disk shelf and you must wait 30 seconds for
the shelf electronics to finish initializing.
11Connect one end of the provided cable to the adapter in your system.
12Connect the other end of the cable to the module A Input on the new
disk shelf.
13Connect one end of the provided cable to the adapter in your system.
64Hot-adding a disk shelf to an existing adapter in your system
StepAction
14Connect the other end of the cable to the module B Input on the new
disk shelf.
15Verify that all the cables are securely fastened.
Attention
Poorly secured cables cause the system to panic over an open loop.
Result: In 60 seconds, the system recognizes the hot-added disk
shelf.
Appendix A: Hot-adding a Disk Shelf to an Existing System65
66Hot-adding a disk shelf to an existing adapter in your system
Recommended Power Line Sizes
About this appendixThis appendix describes how to determine the power line lengths running from
the system to the power source.
B
Topics in this
appendix
This appendix discusses the following information:
◆“Recommended AC power line sizes” on page 68
◆“Calculating the length of DC wires” on page 69
Appendix B: Recommended Power Line Sizes67
Recommended AC power line sizes
About AC power
feeds
Longer AC power feeds need to be properly designed to preserve voltage levels
to the equipment. The wiring from the breaker panel to the power strip, which
supplies power to the system and disk shelves, can often exceed 50 feet.
Note
Total AC wire length = breaker to wall or ceiling outlet + extension cable or
ceiling drop.
The following table lists the recommended conductor size for 2% voltage drop
for a particular distance in feet (taken from the Radio Engineer’s Handbook).
The following table list the approximate equivalent wire gauge (American Wire
Gauge (AWG ) to Harmonized Cordage).
AWG
Harmonized, mm-mm
mm-mm = millimeter
squared
68Recommended AC power line sizes
81012
4.02.51.5
Calculating the length of DC wires
Use these variable
definitions
To calculate the maximum combined length of the positive and negative wires
between the DC source and DC power supplies, use the following variable
definitions:
◆ V
SOURCE
Voltage across the internal source
resistance
◆ V
Voltage across an open circuit of the
OC
input source
◆ V
Voltage across a load, R
LOAD
TEST
,
connected to the input source
◆ R
Test resistor of known value, that is,
TEST
10Ω at 300W
◆ R
DC resistance of the cable at a given
CABLE
length
◆ R
◆ R
SOURCE
TOTAL
DC resistance of the source
Combined DC resistance of the cable
and DC source:
R
TOTAL
= R
SOURCE
+ R
CABLE
◆ V = IR Ohm’s Law
How to calculate the
length
◆ V
The following two examples show how to calculate the maximum combined
length of the positive and negative wires that connect the DC power supply to the
OC
= V
SOURCE
+ V
LOAD
Kirchoff’s Voltage Law
DC source.
Example 1: This example uses the following given values.
Appendix B: Recommended Power Line Sizes69
Given
V
= 2V Maximum voltage drop through input source and cable
DROP
V
I
MAX
V
V
R
= 40V Minimum input voltage
MIN
= 8.6V Maximum input current at 40V
= 48V Measured
OC
= 47.5V Measured
LOAD
= 10Ω (300W)
TEST
70Calculating the length of DC wires
Solution
V
DROP
2
R
TOTAL
R
TOTAL
V
LOAD
I = V
V
OC
V
OC
R
S
R
S
R
S
= I
MAXRTOTAL
= 8.6 R
TOTAL
= 2/8.6
= .233Ω
= I R
= V
= IR
= V
TEST
LOAD/
SOURCE + VLOAD
S + VLOAD
OC - VLOAD
I
= (V
OC - VLOAD
V
LOAD/RTEST
= V
OC - VLOAD
V
LOAD
48V - 47.5V
=
R
TEST
47.5V
x
)
x
10Ω
R
TEST
= 0.105Ω
R
TOTAL
R
CABLE
R
CABLE
= R
= R
CABLE
TOTAL
+ R
- R
SOURCE
SOURCE
= 0.233Ω - 0.105Ω
= 0.128Ω
For example, if you have a 12 gauge wire, solid strand, at room temperature, use
the following calculation.
If you need a longer run for your combined positive and negative DC wires,
choose a wire with a lower resistance and calculate the total cable length. For
example, a solid #10 AWG has a lower DC resistance than a solid #12 AWG.
74Calculating the length of DC wires
Feature Update Record
C
Feature update
history
The following table lists and describes the history of changes made to this
manual. When a change is implemented, it applies to the release in which it was
implemented and all subsequent releases, unless otherwise specified.
Feature release
Feature updatesFeature firs t implemented in
◆Initial release of this manualData ONTAP 6.0.2March 2001
◆Update to include support for NetCache
NetCache 5.1April 2001
date
appliances
◆Hot-adding of disk shelves to NetCache
appliances is not supported
◆Updates to multiloop cabling sectionData ONTAP 6.1.1July 2001
◆Update to include hot-adding of disk
NetCache 5.2August 2001
shelves to NetCache appliances
◆Update to include FAS900 seriesData ONTAP 6.3August 2002
◆Update to include DS14mk2FC
◆Update to include ESH
◆Update to specify ESH support for C6200
◆Address BURT on hot-adding disk shelves
Data ONTAP 6.4.1
Data ONTAP 6.2
NetCache 5.5
Data ONTAP 6.5
May 2003
December 2003
◆Update to include ESH2
◆Connecting an ESH2 to a NetCache
Data ONTAP 6.4.4 and 6.5.1May 2004
appliance is not supported.
◆Fix for BURT 140959
◆Support for DC power supplies on
N.A.
March 2005
DS14mk2FC disk shelves.
◆Support for 300-GB drives
◆Address BURT on hot-swapping, hot-
Data ONTAP 6.5.4 and 7.0.1
Data ONTAP 7.2March 2006
adding drives one at a time
◆Address BURT on hot-adding disk shelves
one at a time
◆Hot-adding to an existing adapter
Appendix C: Feature Update Record75
Feature updatesFeature firs t implemented in
Feature release
date
Update to include DS14mk4 FC
◆
◆Update to include ESH4
◆Update to specify loop speed usage
requirements
◆Update to include support for FlexCache
appliances
◆Update to include support for V30xx,
V31xx, and V60xx systems
◆Update to include Data ONTAP 10.0.x
commands for procedures
◆Update to remove obsolete hardware
references
Data ONTAP 6.4.4 and later
February 2007
for selected platforms. See the
System Configuration Guide
at http://now.netapp.com for
information.
Data ONTAP 6.4.4 and later
May 2007
for selected platforms. See the
System Configuration Guide
at http://now.netapp.com for
information.
Data ONTAP 7.2.5.1 and
November 2008
later.
Data ONTAP 7.3 and later for
selected platforms.
Data ONTAP 10.0.x and later
for selected platforms.
N.A.April 2011
76Feature Update Record
Communications Regulations
About this appendixThis appendix lists the regulatory notices you need to be aware of when installing
and operating your NetApp equipment.
D
Appendix D: Communications Regulations77
Regulatory notices
FCC notices
(U.S. only)
Compliance with
Part 15 of CFR 47
NetApp devices are designed for a CFR 47 (Code Federal Regulations) Part 15
Class A environment.
The FCC and NetApp guarantee the user’s rights to operate this equipment only
if the user complies with the following rules and regulations:
◆Install and operate this equipment in accordance with the specifications and
instructions in this guide.
◆Modify this equipment only in the ways specified by NetApp.
◆Use shielded cables with metallic RFI/EMI connector hoods to maintain
compliance with applicable emissions standards.
◆If the system has nine or more Fibre Channel disk shelves, install the system
in two or three NetApp System Cabinets to maintain performance within
Part 15 of CFR 47 regulations.
This equipment has been tested and found compliant with Part 15 of the CFR 47
rules for Class A digital devices. These rules are designed to provide reasonable
protection from interference to electronics equipment operated in a commercial
environment.
Operation of this device is subject to the following two conditions:
◆This device cannot cause harmful interference.
◆This device must accept any interference received, including interference
that may cause undesired operation.
Compliance with
This Class A digital apparatus complies with Canadian ICES-003.
ICES-003
Cet appareil numérique de la classe A conforme à la norme NMB-003 du
Canada.
Compliance with EN
regulations
Marking by the symbol in dicates compliance of this NetApp device to the
EMC Directive and the Low Voltage Directive of the European Union. Such
marking is indicative that this NetApp device meets the technical standards listed
in “Declaration of Conformity,” later in this append ix.
78Regulatory notices
Bureau of
Standards,
Metrology, and
Inspections notice
(BSMI, Taiwan only)
Voluntary Control
Council for
Interference by
Information
Technology
Equipment (VCCI,
Japan)
Attention
This is a Class A product. In a domestic environment this product may cause
radio interference, in which case the user may be required to take adequate
measures.
Translation of the BSMI notice:
Warning: This is a Class A product. In a domestic environment this product may
cause radio interference, in which case the user may be required to take adequate
measures.
Translation of the VCCI-A notice:
This is a Class A product based on the standard of the Voluntary Control Council
for Interference by Information Technology Equipment (VCCI). If this
equipment is used in a domestic environment, radio disturbance may arise. If
such trouble occurs, the user may be required to take corrective actions.
Appendix D: Communications Regulations79
Declaration of Conformity
Declaration of Conformity
NetApp, Inc.
495 East Java Drive
Sunnyvale, CA 94089, U .S.A,
declare under our sole responsibility that the products
Type of equipmentDescriptionModel numberYear of manufacture
Disk drive storage shelfFibre Channel disk shelfDS142001
DS14mk2 FC2003
to which this declaration relates conform to the following standards:
EN 60950:2002, Information Technology Equipment (Safety)
EN 55022:1998, Emissions Requirements for Information T echnology Equipment
EN 50024:1998, Immunity Requirements for Information Technology Equipment
EN 60825-1, Safety of Laser/LED Equipment
EN 61000-3-2:2002 Limits for Harmonic Current Emissions
EN 61000-3-3:1995/A1:2001 Limitation of Voltage Fluctuations and Flicker in Low-Voltage Supply
Systems
following the provisions of the directives listed below:
environ shelf 20
fcstat device_map 59, 60, 63, 64
halt 34, 36, 49, 50
storage disable 53
storage enable 54
storage show hub 20
console error messages
Alarm element 1 14
cooling element, element 1 and 2 27
Display element 1 14
front operation panel 14
LRC/ESH/ESH2 18
Open loop panic 55
power supply 27
power supply element 1 and 2 27
SES electronics element 1 and 2 18, 19
Soft address panic 55
Speed mismatch termination 55
Temperature sensor element 1, 2, and 3 14, 19
Vendor-specific element 1 and 2 19
D
DC wires, calculating the length of 69
differences between the disk shelves
drives in drive carriers 3
ESH2 3
ESH4 3
power supplies 3
shelf chassis 2
disk drive compatibility 7
disk shelf ID 4
disk shelves
installing 38
removing from a single configuration 34
replacing 32
disks
location of LEDs 28
reasons to replace 40
replacing 40
drive bay requirements 7
DS14 and DS14mk2 FC, differences 2
E
element 18
Enclosure Services, drive bays required for 7
ESH/ESH2 error messages
SES electronics element 1 and 2 18, 19
Temperature sensor element 2 and 3 19
Vendor-specific element 1 and 2 19
ESH/ESH2 state messages
MISSING 22
OK 21
XPORT ERROR 22
ESH/ESH2, command to monitor 20
F
front operation panel
Alarm element 1 14
console error messages 14
Display element 1 14
interpreting LEDs 20
location of LEDs 12
monitoring the disk shelf ID 12
Temperature sensor element 1 14
H
hot-adding error message
Open loop panic 55
Soft address panic 55
hot-swap of LRC/ESH/ESH2 modules 52
I
IDs, disk shelf 4
installation
Index81
before you begin 4
disk shelves 38
LRC/ESH/ESH2 modules 51
power supply 46
L
labels
drive bay population 4
on the disk shelf 8
labels on the disk shelf 38, 57, 62
LED interpretation
installing in a disk shelf 46
interpreting LEDspower supply 16
location of LEDs 26
power cord with 47
power switch for 47
removing from a disk shelf 44
replacing 44
power supply error messages
cooling element, element 1 and 2 27
power supply element 1 and 2 27
Q
quad-port connections, defined 62
R
removal of
disk shelf from daisy-chain 36
disk shelves 34
LRC/ESH/ESH2 modules 49