HP 6400 User Manual
HP Smart Array 6400 Series Controllers
User Guide
June 2003 (Second Edition)
Part Number 309135-002
© 2003 Hewlett-Packard Development Company, L.P.
®
Microsoft
, Windows®, and Windows NT® are U.S. registered trademarks of Microsoft Corporation.
Hewlett-Packard Company shall not be liable for technical or editorial errors or omissions contained
herein. The information in this document is provided “as is” without warranty of any kind and is subject to
change without notice. The warranties for HP products are set forth in the express limited warranty
statements accompanying such products. Nothing herein should be construed as constituting an additional
warranty.
June 2003 (Second Edition)
Part Number 309135-002
Audience Assumptions
This guide is for the person who installs, administers, and troubleshoots servers. HP assumes you
are qualified in the servicing of computer equipment and trained in recognizing hazards in
products with hazardous energy levels.
3
Contents
Hardware Features 7
Board Components...............................................................................................................................7
Controller Board Runtime LEDs .............................................................................................. 8
Cache Module LEDs.................................................................................................................9
Expansion Module Components............................................................................................. 10
Controller Specifications and Attributes............................................................................................ 11
Determining the Correct Installation Procedure for the Server 13
Never-Used, Autoconfigurable Server............................................................................................... 13
Never-Used, Non-Autoconfigurable ProLiant Server........................................................................ 14
Integrity Servers................................................................................................................................. 14
Previously Configured ProLiant Server............................................................................................. 15
Installing the Controller Hardware 17
Before Beginning the Installation ...................................................................................................... 17
Preparing the Server........................................................................................................................... 17
Installing the Controller Board...........................................................................................................18
Connecting Storage Devices ..............................................................................................................19
Connecting Internal Storage ...................................................................................................19
Connecting External Storage .................................................................................................. 20
SCSI Cable Part Numbers ......................................................................................................21
Updating the Firmware 23
Using the Smart Components.............................................................................................................23
Using the CD or DVD........................................................................................................................ 23
Configuring the Server 25
ProLiant Servers.................................................................................................................................25
Using RBSU ...........................................................................................................................25
Using SCU..............................................................................................................................26
Integrity Servers................................................................................................................................. 27
Configuring an Array 29
Introduction........................................................................................................................................ 29
Comparing the Utilities...................................................................................................................... 30
Using ACU.........................................................................................................................................31
4 HP Smart Array 6400 Series Controllers User Guide
Using ORCA...................................................................................................................................... 31
Configuration Procedure.........................................................................................................32
Installing the Device Drivers 35
ProLiant Servers.................................................................................................................................35
Integrity Servers................................................................................................................................. 36
Installing the Management Agents 37
ProLiant Servers.................................................................................................................................37
Integrity Servers................................................................................................................................. 38
Upgrading or Replacing Controller Options 39
Cache Module ....................................................................................................................................39
Controller Battery Pack...................................................................................................................... 40
Expansion Module ............................................................................................................................. 41
Replacing, Moving, or Adding Hard Drives 43
Identifying the Status of a Hard Drive ............................................................................................... 43
Hot-Plug SCSI Hard Drive LED Combinations ..................................................................... 44
Recognizing Hard Drive Failure ........................................................................................................45
Effects of a Hard Drive Failure...............................................................................................45
Compromised Fault Tolerance................................................................................................46
Recovering from Compromised Fault Tolerance....................................................................46
Replacing Hard Drives....................................................................................................................... 47
Factors to Consider Before Replacing Hard Drives................................................................47
Automatic Data Recovery (Rebuild) ......................................................................................49
Upgrading Hard Drive Capacity............................................................................................. 50
Moving Drives and Arrays................................................................................................................. 51
Adding Drives.................................................................................................................................... 53
Diagnosing Array Problems 55
Diagnostic Tools ................................................................................................................................55
Probability of Logical Drive Failure 57
Factors Involved in Logical Drive Failure......................................................................................... 57
Probability of Logical Drive Failure vs. Number of Drives in Array ..................................... 59
Drive Arrays and Fault-Tolerance Methods 61
Drive Arrays.......................................................................................................................................61
Fault-Tolerance Methods ...................................................................................................................64
Hardware-Based Fault-Tolerance Methods ............................................................................ 64
Alternative Fault-Tolerance Methods..................................................................................... 71
Contents 5
Electrostatic Discharge 73
Preventing Electrostatic Discharge ....................................................................................................73
Grounding Methods to Prevent Electrostatic Discharge .................................................................... 74
Regulatory Compliance Notices 75
Federal Communications Commission Notice................................................................................... 75
FCC Rating Label................................................................................................................... 75
Class A Equipment .................................................................................................................76
Class B Equipment .................................................................................................................76
Declaration of Conformity for Products Marked with the FCC Logo, United States Only.... 77
Modifications.......................................................................................................................... 77
Cables ..................................................................................................................................... 77
Canadian Notice (Avis Canadien)...................................................................................................... 78
European Union Notice...................................................................................................................... 78
BSMI Notice ......................................................................................................................................79
Japanese Notice.................................................................................................................................. 79
Korean Class A Notice....................................................................................................................... 80
Korean Class B Notice....................................................................................................................... 80
Battery Replacement Notice ..............................................................................................................81
Acronyms and Abbreviations 83
Index 85
7
Hardware Features
In This Section
Board Components ...................................................................................................................7
Controller Specifications and Attributes ................................................................................11
Board Components
Item ID Description
1 Internal SCSI connector, port A1*
2 Internal SCSI connector, port A2*
3 External SCSI connector, port A1*
4 External SCSI connector, port A2*
5 Controller battery
6 Battery-backed cache module
7 Connector for expansion board
*Do not use both connectors on a port simultaneously.
8 HP Smart Array 6400 Series Controllers User Guide
Controller Board Runtime LEDs
LED ID Color LED Name and Interpretation
0 Amber CR100: Diagnostics Error LED.
1 Amber CR101: Drive Failure LED. A physical drive connected to the controller has
failed.
2 Blue CR102: SCSI Bus Active LED. At least one of the SCSI buses on the controller
is active.
3 Green CR103: XOR Active LED. The controller is calculating parity data.
4 Green CR104: Command Outstanding LED. The controller is working on a command.
5 Blue CR105: Heartbeat LED. This LED flashes every 2.0 seconds, unless the
controller is malfunctioning.
6 Green CR106: Gas Pedal LED. This LED illuminates when the controller gets very
busy.
7 Green CR107: Idle Task LED. Under normal circumstances, this LED flashes every 1.0
seconds. When the controller is busy, the LED glows steadily.
8 Amber CR11: Status Charging LED. The controller battery is being charged.
NOTE: During server power up, each runtime LED illuminates randomly until POST has finished.
Hardware Features 9
Cache Module LEDs
Item ID 1
Green LED
Steady glow -- The cache batteries are being charged.
Fast blink -- The cache microcontroller is waiting for the
-- Steady glow One of these conditions is present:
-- Fast blink There is an open circuit across the battery
-- Slow blink
Item ID 2
Amber LED
(once every
16 seconds)
Interpretation
host controller to communicate.
• • There is a short circuit across the battery
terminals or within the battery pack.
The host controller is updating the cache
microcontroller firmware.
terminals or within the battery pack.
This display pattern may occur after the
system is powered down. It indicates that the
cache contains data that has not yet been
written to the drives. Restore system power
within four days to prevent data loss.
10 HP Smart Array 6400 Series Controllers User Guide
Expansion Module Components
Item ID Description
0–7 Runtime LEDs (CR10–CR17). These are
identical to the controller board runtime LEDs
(on page 8).
8 VHDCI connector, port B2
9 VHDCI connector, port B1
10 Connector to controller board
Hardware Features 11
Controller Specifications and Attributes
Dimensions (excluding bracket) 31.2 cm x 10.7 cm x 1.8 cm (12.3 in x 4.2 in x 0.7 in)
Power required Typically 12-18 W
Ambient room temperature range Operating: 10° to 35°C (50° to 95°F)
Storage: -20° to 55°C (-4° to 131°F)
Relative humidity (noncondensing) Operating: 10% to 70%
Storage: 5% to 90%
RAID levels supported 0, 1+0, 5, ADG
Processor type PowerPC 405 at 266 MHz
DDR SDRAM bus transfer rate Up to 2.0 GB/s at 266 MHz (DDR, 72-bit)
PCI-X bus:
Connector type 3.3-V, 64-bit, Wide PCI-X or PCI slot
Transfer rate Up to 1.0 GB/s at 133 MHz (64-bit)
SCSI bus:
Number of channels 2 LVD-only (on 6402 model) or 4 LVD-only (on 6404 model)
Maximum number of drives per
channel
Connector type 68-pin Wide internal, VHDCI external
Termination Required, but provided on Compaq and newer HP systems
Transfer rate Up to 320 MB/s (160 MHz DDR) per channel
15 (14 in an external enclosure)
The 2-channel expansion module is a controller in its own right. Thus, the Smart
Array 6404 Controller is actually two 2-channel controllers sharing one PCI-X
connector. This arrangement is referred to as a dual (or twin) controller
configuration.
During POST, each component controller loads its own instance of the required
driver and sets its own configuration using ORCA.
12 HP Smart Array 6400 Series Controllers User Guide
This dual controller is displayed in both Insight Manager and ACU as two
separate entities in one slot. In these utilities, the slot number label for the
expansion module has a lowercase b suffix, while the slot number label for the
main controller has no suffix.
For more information about the controller features and specifications and for
information about system requirements, refer to the HP website
(http://www.hp.com/products/smartarray
).
13
Determining the Correct Installation Procedure for the Server
In This Section
Never-Used, Autoconfigurable Server ...................................................................................13
Never-Used, Non-Autoconfigurable ProLiant Server ............................................................ 14
Integrity Servers .....................................................................................................................14
Previously Configured ProLiant Server..................................................................................15
Never-Used, Autoconfigurable Server
Some new HP ProLiant server models self-configure when they are powered up
for the first time. During the autoconfiguration process, the system language is
set to English by default, and Microsoft
®
Windows® 2000 is selected as the
default operating system. (However, the operating system must still be installed.
This is done later in the overall controller installation procedure.) If a different
system language or operating system is needed, press the F9 key to open RBSU,
which enables manual configuration of the server.
Also, if the server has fewer than seven physical drives installed, ORCA
automatically configures the drives into an array, builds a logical drive, and sets a
RAID level suitable for the number of drives.
To determine if the server is autoconfigurable, refer to the server-specific setup
and installation guide.
IMPORTANT: Do not power up the server until the hardware
configuration is satisfactory, as described in the procedure given in this
section.
If the server is autoconfigurable:
1. Install the controller hardware ("Installing the Controller Hardware" on page
17).
14 HP Smart Array 6400 Series Controllers User Guide
2. Install physical drives if necessary. (The number of drives present determines
the RAID level that is autoconfigured. For details, refer to the server-specific
setup and installation guide.)
3. Power up the server.
4. Use the CD that is supplied in the controller kit to install the operating
system and device drivers. Instructions are provided with the CD.
5. Create and format additional logical drives if desired ("Configuring an
Array" on page 29).
The server is now ready to use.
Never-Used, Non-Autoconfigurable ProLiant Server
1. Install the controller hardware ("Installing the Controller Hardware" on page
17).
2. Update the system firmware ("Updating the Firmware" on page 23).
3. Update the controller firmware ("Updating the Firmware" on page 23).
4. Configure the server.
5. Create and format at least one logical drive ("Configuring an Array" on page
29).
6. Use the CD that is supplied in the controller kit to install the operating
system and device drivers. Instructions are provided with the CD.
7. Create and format additional logical drives if desired ("Configuring an
Array" on page 29).
The server is now ready to use.
Integrity Servers
1. Install the controller hardware ("Installing the Controller Hardware" on page
17).
2. Update the controller firmware ("Updating the Firmware" on page 23).
3. Configure an array ("Configuring an Array" on page 29).
Determining the Correct Installation Procedure for the Server 15
4. Configure the server ("Integrity Servers" on page 27).
5. Install the operating system.
6. If you are installing additional Smart Array controllers, install the device
drivers ("Integrity Servers" on page 36).
7. Install the Management Agents ("Integrity Servers" on page 38).
8. Create and format additional logical drives if desired ("Configuring an
Array" on page 29).
The server is now ready to use.
Previously Configured ProLiant Server
1. Back up any data on the system. (This step is required if you are moving
drives from a non-array controller to a Smart Array controller.)
2. Update the system firmware ("Updating the Firmware" on page 23).
3. If the new controller is to be the boot device, install the device drivers for the
operating system. Otherwise, continue with step 4.
4. Install the controller hardware ("Installing the Controller Hardware" on page
17).
5. Set the controller order.
6. Update the controller firmware ("Updating the Firmware" on page 23).
7. If the server uses SCU:
a. Update the system partition ("Using SCU" on page 26).
b. Confirm that the controller order is unchanged, and reset it if necessary
("Using SCU" on page 26).
8. If the controller is not going to be the boot device, install the device drivers
for the operating system.
9. Update the Management Agents ("Installing the Management Agents" on
page 37) if new versions are available.
10. Create and format additional logical drives if desired ("Configuring an
Array" on page 29).
11. If migrating from a non-array controller, restore data from backup.
16 HP Smart Array 6400 Series Controllers User Guide
The server is now ready to use.
17
Installing the Controller Hardware
In This Section
Before Beginning the Installation........................................................................................... 17
Preparing the Server ...............................................................................................................17
Installing the Controller Board ...............................................................................................18
Connecting Storage Devices................................................................................................... 19
Before Beginning the Installation
Before beginning the installation procedure, visit the HP website
(http://www.hp.com/support
) to confirm that you have the latest version of each
driver and utility file needed. Compare the version numbers of the files there
with those of the same files on the software CD or DVD that is supplied in the
controller kit.
Preparing the Server
Before installing the controller in the server, back up all data. This step is
required if you are moving non-arrayed SCSI drives to a Smart Array controller,
because data is not preserved during a move between array controllers and nonarray controllers.
If the server supports hot-pluggable devices, you can install the controller board
without any further preparation ("Installing the Controller Board" on page 18).
To prepare a server that does not support hot-pluggable devices:
1. Close all applications.
2. Power down the server.
18 HP Smart Array 6400 Series Controllers User Guide
CAUTION: In systems that use external data storage, be sure
that the server is the first unit to be powered down and the last to be
powered back up. Taking this precaution ensures that the system does
not erroneously mark the drives as failed when the server is powered
up.
3. Power down all peripheral devices that are attached to the server.
4. Unplug the AC power cord from the outlet and then from the server.
5. Disconnect all peripheral devices from the server.
Installing the Controller Board
WARNING: To reduce the risk of personal injury or
damage to the equipment, consult the safety information and user
documentation provided with the server before attempting the
installation.
Many servers are capable of providing energy levels that are
considered hazardous and are intended to be serviced only by
qualified personnel who have been trained to deal with these
hazards. Do not remove enclosures or attempt to bypass any
interlocks that may be provided for the purpose of removing these
hazardous conditions.
1. Remove or open the access panel.
2. Select an available 3.3-V PCI or PCI-X slot.
NOTE: In Integrity servers, the ID number of the slot in which you insert
the controller determines the boot controller order. Follow the
recommendations in the server-specific documentation to obtain the
required controller order.
3. Remove the slot cover or open the hot-plug latch. Save the retaining screw if
one is present.
4. Slide the controller board along the slot alignment guide, and press the board
firmly into the slot so that the contacts on the board edge are properly seated
in the system board connector.
5. Secure the controller board in place with the hot-plug latch or retaining
screw. If there is a guide latch on the rear of the board, close the latch.
Installing the Controller Hardware 19
6. To finish installing the hardware, connect the internal and external drives
("Connecting Storage Devices" on page 19).
Connecting Storage Devices
The controller supports Ultra2, Ultra160 (Ultra3), and Ultra320 drives.
Each peripheral that is connected to the controller must have a unique SCSI ID
value within the range of 0 to 15 (except ID 7, which is reserved for controller
use). This value determines the priority that is given to the device when it
attempts to use the SCSI bus.
The system automatically sets the SCSI IDs for hot-pluggable devices if they are
supported. For non-hot-pluggable devices, you must set the ID values manually
by using switches or jumpers on the device itself.
SCSI buses require termination on both ends to prevent signal degradation. In HP
ProLiant and Integrity servers, however, the controller, SCSI cable, and
backplane already provide this termination.
Connecting Internal Storage
1. If the storage device that you are adding is not hot-pluggable, power down
the system.
2. Install drives in the removable media bays on the server.
CAUTION: Do not use hot-pluggable drives on the same SCSI
bus as non-hot-pluggable drives.
NOTE: Drives that are to be grouped in the same array should all have
comparable capacity for efficient use of total storage capacity.
For additional information about drive installation, refer to the appropriate
section in this guide ("Replacing, Moving, or Adding Hard Drives" on page
43) and consult the documentation that accompanied the drives.
When you have finished installing drives, continue with the next step.
− If the drives are hot-pluggable, go to step 3.
20 HP Smart Array 6400 Series Controllers User Guide
− If the drives are not hot-pluggable, go to step 4.
3. Attach the internal point-to-point SCSI cable (provided with the server) from
the internal connector of the controller to the hot-plug drive cage.
Installation of the hot-pluggable drives is complete.
4. For each SCSI bus, manually set the SCSI ID on each drive to a unique value
in the range of 0 to 15, except 7 (which is reserved for controller use). For
detailed instructions, consult the documentation that is provided with the
drive.
5. Attach a multi-device SCSI cable from the internal connector of the
controller to the non-hot-pluggable hard drives. (The cable may have been
provided with the server.)
6. Replace the access panel, and secure it with the thumbscrews if any are
present.
CAUTION: Do not operate the server for long periods without
the access panel. Operating the server without the access panel results
in improper airflow and improper cooling that can lead to thermal
damage.
Connecting External Storage
1. On the rear of the server, connect the external cable to the VHDCI connector
on the controller, and tighten the lock screws on the cable connector.
2. Attach the other end of the cable to the storage enclosure, and tighten the
lock screws on the cable connector.
Installing the Controller Hardware 21
SCSI Cable Part Numbers
Cable type* Cable Length Option Kit Number Cable Assembly Number
External Cables
VHDCI to VHDCI
(all server models)
Internal Cables
ProLiant, multi-device -- 166389-B21 148785-001
Integrity servers
rx5670
— Single port
— Dual port
rx2600
— Single port
— Dual port
*If additional cables are required, order by the option kit number.
1.8 m (6 ft)
3.7 m (12 ft)
7.3 m (24 ft)
11.9 m (39 ft)
18 cm (7 in.)
20 cm (8 in.)
49 cm (19 in.)
58 cm (23 in.)
341174-B21
341175-B21
164604-B21
150214-B21
A9828A
--
--
A9827A
--
--
313374-001
313374-002
313374-004
313374-005
--
A9828-63001
A9828-63002
--
A7231-63024
A7231-63025
23
Updating the Firmware
In This Section
Using the Smart Components .................................................................................................23
Using the CD or DVD ............................................................................................................ 23
Using the Smart Components
To update the firmware, you can use the Smart Components (also known as
Online ROM Flash Components) that are available on the HP website
(http://www.hp.com/support/proliantstorage
).
1. Locate the Smart Components for the operating system and controller that
the server is using.
2. Follow the instructions for installing the components. These instructions are
given on the same Web page as the components.
3. Follow the additional instructions that describe how to use the components to
flash the ROM. These instructions are provided with each component.
Alternatively, you can use the software CD (for ProLiant servers) or DVD (for
Integrity servers) that is provided in the controller kit.
Using the CD or DVD
Because the Smart Components may be more recent than the firmware upgrade
files on the CD, check the Smart Components on the website before using the
updates on the CD.
For a ProLiant server, printed instructions are provided with the CD.
24 HP Smart Array 6400 Series Controllers User Guide
IMPORTANT: If you are updating the firmware on a system that was
configured using SCU, you must update the system partition ("Using
SCU" on page 26) immediately after you have finished updating the
firmware.
For an Integrity server using a supported Microsoft® Windows® operating system:
1. Insert the HP Smart Setup DVD into the DVD-ROM drive.
2. Double-click the icon for the Windows-based configuration utility on the
DVD. The utility opens, and automatically updates the firmware.
3. Reboot the server for the firmware updates to take effect.
For more information about Integrity servers, for technical support, or for
updated firmware, drivers, and utilities, refer to the HP website
(http://www.hp.com/support/itaniumservers
).
25
Configuring the Server
In This Section
ProLiant Servers .....................................................................................................................25
Integrity Servers .....................................................................................................................27
ProLiant Servers
After installing the controller hardware and updating the firmware, configure the
server by using either RBSU or SCU. For more information, refer to the HP
ROM-Based Setup Utility User Guide or the server setup and installation guide.
NOTE: The 2-channel expansion module is a controller in its own right.
Thus, the Smart Array 6404 Controller is actually two 2-channel
controllers sharing one PCI-X connector. During POST, each
component controller loads its own instance of the required driver and
sets its own configuration using ORCA.
Using RBSU
RBSU is a system configuration utility that is embedded in the system ROM. It is
customized for the server on which it is installed.
To use RBSU:
1. Power up the server.
2. Press the F9 key when prompted during system startup.
CAUTION: Not all servers support RBSU. Do not flash an
RBSU-ROM image onto a server that is already configured with SCU
unless the update instructions specifically state that upgrading from
SCU to RBSU is supported. If the upgrade is not supported, the
consequences of upgrading are unpredictable, and you may lose data.
The main RBSU screen is displayed.
26 HP Smart Array 6400 Series Controllers User Guide
3. Configure the system. (For more information, refer to the ROM-Based Setup
Utility User Guide.)
4. Select Boot Controller Order on the main RBSU screen, and follow the on-
screen prompts to set the boot controller.
5. When you have finished using RBSU, press the Esc key, and then press the
F10 key to confirm that you want to exit.
The server reboots with the new configuration.
Using SCU
If you updated the firmware in a used system that was not configured using
RBSU, you must use SCU immediately afterward to update the system partition.
1. Locate the page on the HP website (http://www.hp.com/support
) that
contains SCU, and then follow the on-screen instructions to create four SCU
diskettes.
2. Insert SCU diskette #1 into the server diskette drive.
3. Restart the system.
4. Select System Configuration Utility from the menu or list of icons that is
displayed.
5. Follow the on-screen instructions to update or create and populate a system
partition.
6. Exit from SCU. If the server does not reboot or a CD error message is
displayed, press the Ctrl+Alt+Del keys to reboot the server manually.
When you have finished using SCU to configure the system, use ORCA
immediately afterward to confirm that the controller order is unchanged, as
follows:
1. Reboot the server. The POST sequence begins, and an ORCA prompt
message is briefly displayed.
2. Press the F8 key to start ORCA.
Loading...