This document is preliminary. As such, it contains data derived from functional
simulations and performance estimates. LSI Logic has not verified either the
functional descriptions, or the electrical and mechanical specifications using
production parts.
This document contains proprietary information of LSI Logic Corporation. The
information contained herein is not to be used by or disclosed to third parties
without the express written permission of an officer of LSI Logic Corporation.
LSI Logic products are not intended for use in life-support appliances, devices,
or systems. Use of any LSI Logic product in such applications without written
consent of the appropriate LSI Logic officer is prohibited.
Document DB15-000292-00, Version 1.0 (July 2003)
This document describes LSI Logic Corporation’s Integrated RAID (IR) software
product and will remain the official reference source for all revisions/releases of
this product until rescinded by an update.
LSI Logic Corporation reserves the right to make changes to any products herein
at any time without notice. LSI Logic does not assume any responsibility or
liability arising out of the application or use of any product described herein,
except as expressly agreed to in writing by LSI Logic; nor does the purchase or
use of a product from LSI Logic convey a license under any patent rights,
copyrights, trademark rights, or any other of the intellectual property rights of
LSI Logic or third parties.
LSI Logic, the LSI Logic logo design, Fusion-MPT, Integrated Mirroring, and
Integrated Striping are trademarks or registered trademarks of LSI Logic
Corporation. ARM is a registered trademark of ARM Ltd., used under license.
Windows and Windows NT are registered trademarks of Microsoft Corporation.
Linux is a registered trademark of Linus Torvalds. SuSE is a registered trademark
of SuSE Linux AG. RED HAT is a registered trademark of Red Hat, Inc. All other
brand and product names may be trademarks of their respective companies.
KL
To receive product literature, visit us at http://www.lsilogic.com.
For a current list of our distributors, sales offices, and design resource
centers, view our web page located at
http://www.lsilogic.com/contacts/index.html
This user’s guide explains how to configure and use the components of
the LSI Logic Integrated RAID (IR) software product.
This user’s guide assumes that you have some familiarity with installing
and configuring software programs and that you are familiar with
computer storage devices in general. The people who benefit from this
document are:
•VARs and OEMs who are evaluating the LSI Logic IR software
components or who are using the IR software product in their
computer systems
•End users who are using the IR software product to configure
mirrored or striped volumes.
Organization
This document has the following chapters and appendixes:
•Chapter 1, Introduction to Integrated RAID, provides an overview
of Integrated RAID, its features, and its benefits.
•Chapter 2, Integrated Mirroring (IM) Overview, This chapter
provides an overview of the LSI Logic Integrated Mirroring™ (IM)
feature.
•Chapter 3, Setting Up Integrated Mirroring, describes how to set
up Integrated Mirroring (IM) using the BIOS-based configuration
utility.
•Chapter 4, Integrated Striping (IS) Overview, provides an overview
of the LSI Logic Integrated Striping™ (IS) feature.
•Chapter 5, Setting Up Integrated Striping, describes how to set up
Integrated Striping (IS) using the BIOS-based configuration utility.
•Chapter 6, CIM Solution, describes the Fusion-MPT™ Common
Information Model (CIM) Solution and explains how it is used to
monitor storage components, including mirrored and striped
volumes, in multiple systems on a network.
•Appendix A, Using the DOS-Based Configuration Utility,
describes how to set up Integrated Mirroring or Integrated Striping
volumes using the DOS-based configuration utility (for manufacturing
use only).
Related Publications
LSI Logic Documents
Fusion-MPT Device Management User’s Guide, Version 2.0,
DB15-000186-02
LSI Logic World Wide Web Home Page
www.lsilogic.com
Conventions Used in This Manual
The first time a word or phrase is defined in this manual, it is italicized.
Hexadecimal numbers are indicated by the prefix “0x” —for example,
0x32CF. Binary numbers are indicated by the prefix “0b” —for example,
0b0011.0010.1100.1111.
This chapter provides an overview of Integrated RAID, its features, and
its benefits. The chapter includes these sections:
•Section 1.1, “Introduction,” page 1-1
•Section 1.2, “Integrated RAID Benefits and Features,” page 1-2
•Section 1.3, “Using this Manual,” page 1-2
1.1Introduction
The LSI Logic Integrated RAID solution provides cost benefits for the
server or workstation market where the extra performance, storage
capacity, and/or redundancy of a RAID configuration are required. The
two components of Integrated RAID are:
•Integrated Mirroring (IM), which provides features of RAID 1 and
RAID 1E
•Integrated Striping (IS), which provides features of RAID 0
By simplifying the IM and IS configuration options and by providing
firmware support in its host adapters, LSI Logic can offer the Integrated
RAID solution at a lower cost than a full-blown RAID implementation.
LSI Logic CIM interface software is used to continuously monitor IM
volumes and IS volumes and to report status and error conditions as they
arise.
IM and IS are supported by different versions of Fusion-MPT firmware.
Therefore, either IM or IS can be implemented on a system with a
Fusion-MPT based controller, but IM and IS cannot be used concurrently
on the same system.
As a result of the shift towards Network Attached Storage (NAS), ISPs
need a cost effective, fault-tolerant solution to protect the operating
systems on small form factor, high-density, rack-mountable servers. The
LSI Logic Integrated Mirroring (IM) feature provides data protection for
the system boot volume to safeguard critical information such as the
operating system on servers and high performance workstations. This
new Integrated Mirroring feature gives customers a robust, highperformance, fault-tolerant solution that is less expensive than a
dedicated RAID controller.
The IM feature provides simultaneous mirroring on configurations of two
to six disk disks, to assure fault tolerant, high availability data. If a disk
fails, the hot swap capability allows the system to be easily restored by
simply swapping disks. The system then automatically re-mirrors the
swapped disk. Additionally, the hot spare feature keeps one disk ready
to automatically replace a failed disk in the volume, making the system
even more fault-tolerant.
The IM feature uses the same device drivers as the standard FusionMPT based controllers, providing seamless and transparent fault
tolerance. This eliminates the need for complex backup software or
expensive RAID hardware. The IM feature operates independently from
the operating system, in order to conserve system resources. The BIOSbased configuration utility makes it easy to configure a mirrored volume.
The IM feature is currently available as an optional component of the new
Fusion-MPT architecture on all LSI Logic Ultra320 SCSI integrated I/O
controller products.
This section lists the key features of Integrated Mirroring.
•Supports configurations of two to six mirrored disks on the same
channel
•Mirrored volume runs in optimal mode or degraded mode (that is, if
one mirrored disk fails)
•(Optional) Supports configuration of a hot spare
•Hot swap capability
•Presents a single virtual drive to the OS
•Support for disks of different types and capacities
•Automatic background resynchronization while host I/Os continue
•Media verification
2.3Description
The LSI Logic Integrated Mirroring (IM) feature provides mirroring for the
boot volume, as shown in Figure 2.1. This is accomplished through the
firmware of an LSI Logic controller that supports the standard FusionMPT interface. The runtime mirroring of the boot disk is transparent to
the BIOS, drivers, and operating system. Host-based status software
monitors the state of the mirrored disks and reports any error conditions.
In Figure 2.1 the system is configured with a second disk as a mirror of
the first (primary) disk.
Figure 2.1Typical Mainboard Implementation
Internal
SCSI
Two Disk Drives
OSMirrored
OS
NVSRAM
(For Write Journaling)
LSI Logic
Fusion-MPT
Controller
MemoryExternal
BusSCSI
EEPROM
(For Configuration)
Figure 2.2 shows the logical view and physical view of the mirroring
configuration when there are two disks in the mirrored volume.
Mirroring can also be configured with up to 6 mirrored disks, or 5
mirrored disks and a hot spare. Figure 2.3 shows the logical view and
physical view of the mirroring configuration with more than two disks in
the mirrored volume. Each “mirrored stripe” is written to a disk and is
mirrored to an “adjacent” disk. This is commonly referred to as RAID 1E.
Figure 2.3Integrated Mirroring with More than Two Disks
Logical ViewPhysical View
Mirrored Stripe 1
Mirrored Stripe 2
Mirrored Stripe 1
Mirrored Stripe 3’
Mirrored Stripe 2
Mirrored Stripe 1’
Mirrored Stripe 3
Mirrored Stripe 2’
Mirrored Stripe 3
Mirrored Stripe 4
Mirrored Stripe 5
Mirrored Stripe 6
Mirrored Stripe n
Mirrored Stripe 4
Mirrored Stripe 6’
Mirrored Stripe n-2
Mirrored Stripe n’
Mirrored Stripe 5
+
Mirrored Stripe 4’
Mirrored Stripe n-1
Mirrored Stripe (n-2)’
LSI Logic provides the BIOS-based configuration utility to enable the
user to configure the mirroring attributes during initial setup and to
reconfigure them in response to hardware failures or changes in the
environment. (A DOS-based configuration utility is also provided for
manufacturing use only.)
2.4Integrated Mirroring Firmware
This section describes features of the LSI Logic Integrated Mirroring (IM)
firmware.
2.4.1 Host Interface
The IM host interface uses the “Message Passing Interface” as described
in the Fusion-MPT specification, including Integrated Mirroring of SCSI
host adapters. Through the Fusion-MPT interface, the host OS has
access to the logical IM drive as well as the physical disks. This allows
support for domain validation and Ultra320 SCSI expander configuration.
2.4.2 Resynchronization with Concurrent Host I/O Operation
The IM firmware uses queue tagged I/Os to allow SCSI I/Os to continue
on the IM volume while the volume is being re-synchronized in the
background. The host driver may optionally suspend the
resynchronization operation while performing domain validation or while
configuring Ultra320 SCSI expanders. Resynchronization is attempted
after the firmware has been reset, or after a “hot swap” has occurred to
one of the physical IM disks.
The IM volume can be partially resynchronized, if the logging information
in NVSRAM indicates that this is necessary. It usually takes less than a
second for the firmware to complete a partial resynchronization. Like full
synchronization, partial resynchronization is performed in the
background.
2.4.3 Meta Data Support
The firmware supports Meta data describing the IM logical drive
configuration stored on each member disk. When the firmware is
initialized, each member disk is queried to read the stored Meta data for
consistency checking. The usable disk space for each IM member disk
is adjusted down to leave room for this data.
The IM firmware supports hot swapping. The hot-swapped disk is
automatically resynchronized in the background, without any host or user
intervention. The hot-swapped disk must be at the same physical SCSI
ID as one of the physical disks configured in the IM volume. The firmware
detects “Hot Swap” removal and disk insertion.
Following a “hot swap” event, the firmware readies the new physical disk
by spinning it up and verifying that it has enough capacity for the IM
volume. The IM firmware resynchronizes all hot-swapped disks that have
been removed, even if the same disk is re-inserted. In a two-disk
mirrored volume, the IM firmware marks the hot-swapped disk as the
secondary disk and marks the other mirrored disk as the primary disk.
The firmware resynchronizes all data from the primary disk onto the new
secondary disk.
2.4.5 SMART Support
The IM firmware enables Mode 6 SMART on the IM member disks.
Mode 6 SMART requires each physical disk to be polled once per
minute. If a SMART ASC/ASCQ code is detected on a physical IM disk,
the firmware processes the SMART data, and the last received SMART
ASC/ASCQ is stored in non-volatile memory. The IM volume does not
support SMART directly, since it is just a logical representation of the
physical disks in the volume.
2.4.6 Floating Hot Spare
One disk can be configured as the floating hot spare disk. If the IM
firmware fails one of the mirrored disks, the firmware automatically
replaces it with the hot spare disk. The IM firmware then resynchronizes
the mirrored data. The SCSI ID of the failed disk is periodically polled to
determine if the disk has been replaced. If so, the firmware automatically
establishes that disk as the new “floating hot spare.”
The IM firmware supports a background media verification feature that
runs once per minute when the IM volume is in optimal mode. The media
verification feature issues a SCSI Verify command to a segment of the
disk. If the command fails for any reason, the other disk’s data for this
segment is read and written to the failing disk in an attempt to refresh
the data. The current Media Verification Logical Block Address is written
to non-volatile memory occasionally to allow Media Verification to
continue approximately where it left off prior to a power-cycle.
2.4.8 SCSI ID Assignment
A single logical drive is presented as the combination of a set of physical
member disks. Each individual member disk is hidden and returns a
“selection timeout” when accessed. The SCSI Target ID of the IM logical
drive is assigned when the logical drive is created. The lowest SCSI ID
of the selected disks is used.
2.4.9 Disk Write Caching
The IM firmware disables disk write caching. This is done to increase
data integrity, so that the disk write log stored in NVSRAM is always
valid. If disk write caching were enabled (not recommended), the disk
write log could be invalid.
2.4.10 NVSRAM Usage
IM firmware requires a 32 Kbyte NVSRAM in order to perform write
journaling. Write journaling is used to verify that the mirrored disks in the
IM volume are synchronized with each other. The NVSRAM also stores
additional code and data used for error and exception handling, and it
stores IM configuration information during serial EEPROM updates. The
disk write log uses approximately 4 Kbytes of the NVSRAM.
The LSI Logic Fusion-MPT architecture provides the interface to the
SCSI chip/firmware to allow Integrated Mirroring.
2.5.1 BIOS ROM
The BIOS uses the Fusion-MPT interface to communicate to the SCSI
chip/firmware to allow Integrated Mirroring. This includes reading the
Fusion-MPT configuration to gain access to the SCSI parameters that
are used to define behavior between the adapter and its devices.
2.5.2 OS Drivers
The Fusion-MPT drivers for all supported operating systems implement
the Fusion-MPT interface to communicate with the SCSI chip/firmware.
To allow Integrated Mirroring, the host OS driver implements domain
validation and supports Ultra320 expander configurations.
This chapter describes how to set up Integrated Mirroring (IM) using the
BIOS-based configuration utility (CU). The chapter includes these topics:
•Section 3.1, “IM Configuration Overview”
•Section 3.2, “Configuring IM with the BIOS-Based CU”
•Section 3.3, “Troubleshooting,” page 3-14
3.1IM Configuration Overview
The following constraints were made in order to simplify the IM
configuration.
•The BIOS-based CU allows you to create one mirrored volume per
Fusion-MPT controller.
•The mirrored volume can have two to six disks, or two to five disks
if an optional hot spare disk is used.
•Disks in a mirrored volume must be connected to the same channel
of the same Fusion-MPT controller, and the controller must be in the
BIOS boot order.
•Disks in an IM volume must be non-removable, single-LUN disks that
support 512-byte sectors, wide synchronous transfers, Qtag’d I/Os,
and a unit serial number. The disks must support SMART, and they
must be minimally compliant with the SCSI-2 standard.
•Disks of different size are allowed in mirrored volumes, but the
smallest disk determines the “logical” size of each disk in the volume.
The excess space of larger member disks is not used.
The BIOS-based configuration utility (CU) is part of the Fusion-MPT
BIOS. When the BIOS loads during boot and you see the message about
the LSI Logic Configuration Utility, press Ctrl-c to start the utility. After
you do this, the message changes to:
Follow the steps below to configure an Integrated Mirroring (IM) volume
with the BIOS-based CU. For a more complete explanation of this
procedure, including detailed descriptions of the configuration screens,
see Section 3.2.3, “Detailed IM Configuration Procedure,” page 3-5.
The configuration procedure assumes that the system already has the
required SCSI controller(s) and disks. You can configure one IM volume
per Fusion-MPT controller.
1.On the Main menu screen of the BIOS-based CU, use the arrow keys
to select an adapter.
2.Press Enter to go to the Adapter Properties screen.
3.On the Adapter Properties screen, use the arrow keys to select RAIDProperties on the screen.
4.Press Enter to go to the RAID Properties screen. Continue withstep 5 to configure a two-disk mirrored volume. Skip to step 6 to
configure a mirrored volume with three to six disks.
5.To configure a two-disk mirrored volume, with an optional hot spare
disk:
a.In the RAID Properties screen, use the arrow keys to select the
primary disk for the IM volume (the disk with the data you want
to mirror).
b.Use the arrow keys to move to the Array Disk column for this
disk, and use the + and - keys to select Yes as the value.
c.When the “Keep Data/Erase Disk” message appears, press F3
to keep the data that is currently on this disk. The value in the
Array Disk column changes to Primary.
d.Use the arrow keys to select the secondary (mirrored) disk for
the IM volume. Select Yes as the value for the Array Disk
column.
If partitions are defined on this disk, a message warns you that
data on the disk will be lost when the mirrored volume is created.
Press Delete to confirm erasing data from the disk, or press any
other key to deselect the disk. Continue with step 7.
6.To configure a mirrored volume with three to six disks, or three to five
disks with an optional hot spare disk:
a.In the RAID Properties screen, use the arrow keys to select the
first disk for the IM volume.
b.Use the arrow keys to move to the Array Disk column for this
disk, and use the + and - keys to select Yes as the value.
c.When the “Keep Data/Erase Disk” message appears, press
Delete to erase the disk.
d.Use the arrow keys to select the next disk for the IM volume.
Select Yes as the value for the Array Disk column.
If partitions are defined on this disk, a message warns you that
data on the disk will be lost when the mirrored volume is created.
Press Delete to confirm erasing data from the disk, or press any
other key to deselect the disk.
e.Repeat the previous step to select up to four more disks for the
IM volume. (Or select up to three more disks if you want to
configure a hot spare disk for the volume.)
7.(Optional) Use the arrow keys to select a hot spare disk for the IM
volume. Select Yes as the value for the Hot Spare column.
8.When you have selected all disks for the IM volume, press Esc and
select Save changes, then exit this menu. (If you do not want to
create the IM volume, select Discard changes, then exit thismenu.)
The IM volume exists as soon as you save the changes. The RAID
Properties screen now displays the IM volume properties and status.