HP Hitachi Dynamic Link Manager Software User Manual

Hitachi Dynamic Link Manager Software User's Guide (for Linux(R))

3000-3-F04-60(E)

 Relevant program products

Hitachi Dynamic Link Manager version 6.6.2

For details about applicable OSs, see the Release Notes.

 Trademarks

AIX is a trademark of International Business Machines Corporation in the United States, other countries, or both.

AMD, AMD Opteron, and combinations thereof, are trademarks of Advanced Micro Devices, Inc.

Brocade is a trademark or a registered trademark of Brocade Communications Systems, Inc. in the United States and/or in other countries.

Emulex is a registered trademark of Emulex Corporation.

HP-UX is a product name of Hewlett-Packard Company.

HP StorageWorks is a trademark of Hewlett-Packard Company.

Intel Xeon is a trademark of Intel Corporation in the United States and other countries.

Itanium is a trademark of Intel Corporation in the United States and other countries.

Java is a registered trademark of Oracle and/or its affiliates.

JDK is either a registered trademark or a trademark of Oracle and/or its affiliates.

Linux(R) is the registered trademark of Linus Torvalds in the U.S. and other countries.

Microsoft is either a registered trademark or a trademark of Microsoft Corporation in the United States and/or other countries.

Oracle and Oracle9i are either registered trademarks or trademarks of Oracle and/or its affiliates.

Oracle and Oracle Database 10g are either registered trademarks or trademarks of Oracle and/or its affiliates.

Oracle and Oracle Database 11g are either registered trademarks or trademarks of Oracle and/or its affiliates.

Pentium is a trademark of Intel Corporation in the United States and other countries.

QLogic is a registered trademark of QLogic Corporation.

Red Hat is a trademark or a registered trademark of Red Hat Inc. in the United States and other countries.

Solaris is either a registered trademark or a trademark of Oracle and/or its affiliates.

SteelEye Technology, SteelEye and LifeKeeper are registered trademarks of SteelEye Technology, Inc.

Sun Microsystems is either a registered trademark or a trademark of Oracle and/or its affiliates.

SUSE is a registered trademark of Novell, Inc. in the United States and other countries.

UNIX is a registered trademark of The Open Group in the United States and other countries.

Veritas is a trademark or registered trademark of Symantec Corporation in the U.S. and other countries.

Windows is either a registered trademark or a trademark of Microsoft Corporation in the United States and/or other countries.

Throughout this document Hitachi has attempted to distinguish trademarks from descriptive terms by writing the name with the capitalization used by the manufacturer, or by writing the name with initial capital letters. Hitachi cannot attest to the accuracy of this information. Use of a trademark in this document should not be regarded as affecting the validity of the trademark.

 Restrictions

Information in this document is subject to change without notice and does not represent a commitment on the part of Hitachi. The software described in this manual is furnished according to a license agreement with Hitachi. The license agreement contains all of the terms and conditions governing your use of the software and documentation, including all warranty rights, limitations of liability, and disclaimers of warranty.

Material contained in this document may describe Hitachi products not available or features not available in your country.

No part of this material may be reproduced in any form or by any means without permission in writing from the publisher.

 Edition history

3000-3-F04-60(E): August 2011

 Copyright

Summary of Amendments

The following table lists changes in this manual (3000-3-F04-60(E)) and product changes related to this manual.

Changes Location in this manual

Systems that use an IP-SAN are now supported. 2.2, 2.2.2, 3.1.1, 3.1.2, 3.1.4, 3.1.5, 3.6.3, 3.6.6, 3.22.1,

The following messages have been added:

KAPL04053-W, KAPL05712-I, KAPL10948-W, KAPL10949-E, KAPL15001-I, KAPL15002-E, KAPL15064-I, KAPL15065-E

Red Hat Enterprise Linux AS 4.9 and Red Hat Enterprise Linux ES 4.9 are now supported.

It is now possible to specify the number of times the same path can be used for I/O operations when the Round Robin ( Blocks (

lbk) algorithm is used for load balancing.

rr), Least I/Os (lio), or Least

3.22.2, 4.6.4, 6.7.2, 7.2.3, 7.10.3, Appendix D

2.12.1, 8.4, 8.5, 8.10, 8.14

3.1.1, 3.1.3

4.3.7, 6.6.1, 6.6.2, 6.7.1, 6.7.2, 7.2.3, 7.10.3

In addition to the above changes, minor editorial corrections have been made.

Preface

This manual describes the functions and use of the following program products:

• Hitachi Dynamic Link Manager

Intended Readers

This manual is intended for system administrators who use Hitachi Dynamic Link Manager (HDLM) to operate and manage storage systems. The readers of this manual must have a basic knowledge of the following areas:

• Linux and its management functionality

• Storage system management functionality

• Cluster software functionality

• Volume management software functionality

Organization of This Manual

This manual is organized as follows:

1. Overview of HDLM

Chapter 1 gives an overview of HDLM, and describes its features.

2. HDLM Functions

Chapter 2 describes management targets and the system configuration of HDLM, and the basic terms and functions for HDLM.

3. Creating an HDLM Environment

Chapter 3 describes the procedures for building an HDLM environment (including installing and setting up HDLM), and describes for canceling the settings.

4. HDLM Operation

Chapter 4 describes how to use HDLM by using both the HDLM commands, and how to manually start and stop the HDLM manager. This chapter also describes how to configure an environment to properly operate HDLM, such as changing the HDLM management-target devices that connect paths or replacing the hardware that makes up a path.

5. Troubleshooting

Chapter 5 explains how to troubleshoot a path error, HDLM failure, or any other

problems that you might encounter.

6. Command Reference

Chapter 6 describes all the HDLM commands.

7. Utility Reference

Chapter 7 describes the HDLM utilities.

8. Messages

Chapter 8 provides information for all the possible messages that could be output by HDLM. It also lists and explains the HDLM messages and shows the actions to be taken in response to each message.

A. Notes on Linux Commands and Files

Appendix A gives notes on Linux commands and files.

B. Troubleshooting Products That Use the Weak-Modules Script

Appendix B explains how to deal with errors that are caused by installing or uninstalling products that use the weak-modules script.

C. Functional Differences Between Versions of HDLM

Appendix C explains the differences in functionality between HDLM versions.

D. Glossary

This glossary explains terms used in this manual.

Related Publications

Manuals related to this manual are listed below. See these manuals when necessary:

• Hitachi Global Link Manager Software Installation and Configuration Guide

• Hitachi Global Link Manager Software Messages

• Hitachi Adaptable Modular Storage Series User's Guide

• Hitachi Simple Modular Storage Series User's Guide

• Hitachi USP Series User's Guide

• Hitachi Workgroup Modular Storage Series User's Guide

• Thunder9580V Series Disk Array Subsystem User's Guide

• Universal Storage Platform V Series User's Guide

• Universal Storage Platform VM Series User's Guide

• Virtual Storage Platform Series User's Guide

• HITACHI Gigabit Fibre Channel Board User's Guide

• ServerConductor/DeploymentManager User's Guide

Conventions: Abbreviations

This manual uses the following abbreviations for product names.

Abbreviation Full name or meaning

Device Manager Agent Device Manager Agent included in Hitachi Device Manager

Hitachi Global Link Manager Global Link Manager

HDLM Hitachi Dynamic Link Manager

Hitachi AMS A generic term for:

• Hitachi Adaptable Modular Storage 1000

• Hitachi Adaptable Modular Storage 500

• Hitachi Adaptable Modular Storage 200

Hitachi AMS/WMS series A generic term for:

• Hitachi Adaptable Modular Storage 1000

• Hitachi Adaptable Modular Storage 500

• Hitachi Adaptable Modular Storage 200

• Hitachi Workgroup Modular Storage series

Hitachi AMS2000/AMS/WMS/SMS series A generic term for:

• Hitachi Adaptable Modular Storage 2000 series

• Hitachi Adaptable Modular Storage 1000

• Hitachi Adaptable Modular Storage 500

• Hitachi Adaptable Modular Storage 200

• Hitachi Workgroup Modular Storage series

• Hitachi Simple Modular Storage series

Hitachi AMS2000 series Hitachi Adaptable Modular Storage 2000 series

Hitachi NSC55 Hitachi Network Storage Controller NSC55

Hitachi Simple Modular Storage series Hitachi SMS

Hitachi USP A generic term for:

• Hitachi NSC55

• Hitachi Universal Storage Platform 100

• Hitachi Universal Storage Platform 600

• Hitachi Universal Storage Platform 1100

• HP XP10000

• HP XP12000

• SVS

Hitachi WMS Hitachi Workgroup Modular Storage series

iii

Abbreviation Full name or meaning

HP XP128 HP StorageWorks XP128 Disk Array

HP XP1024 HP StorageWorks XP1024 Disk Array

HP XP10000 HP StorageWorks XP10000 Disk Array

HP XP12000 HP StorageWorks XP12000 Disk Array

HP XP20000 HP StorageWorks XP20000 Disk Array

HP XP24000 HP StorageWorks XP24000 Disk Array

HP XP series A generic term for:

• HP XP128

• HP XP1024

• HP XP10000

• HP XP12000

• HP XP20000

• HP XP24000

HVM Hitachi Virtualization Manager

JDK

JRE

JavaTM 2 SDK, Standard Edition

2 Runtime Environment, Standard Edition

Java

Lightning 9900V series A generic term for:

• Lightning 9900V series

• HP XP128

• HP XP1024

Linux Linux(R)

LUKS Linux Unified Key Setup

Oracle9i RAC Oracle9i Real Application Clusters

Oracle Enterprise Linux 4 A generic term for:

• Oracle Enterprise Linux 4 Update 5

• Oracle Enterprise Linux 4 Update 6

Oracle Enterprise Linux 5 A generic term for:

• Oracle Enterprise Linux 5 Update 1

• Oracle Enterprise Linux 5 Update 4

• Oracle Enterprise Linux 5 Update 5

Oracle RAC 10g Oracle Real Application Clusters 10g

Oracle RAC 11g Oracle Real Application Clusters 11g

Abbreviation Full name or meaning

Oracle RAC A generic term for:

• Oracle9i Real Application Clusters

• Oracle Real Application Clusters 10g

• Oracle Real Application Clusters 11g

P9500 HP StorageWorks P9500 Disk Array

Red Hat Enterprise Linux A generic term for:

• Red Hat Enterprise Linux(R) AS4/ES4

• Red Hat Enterprise Linux(R) 5

• Red Hat Enterprise Linux(R) 6

Red Hat Enterprise Linux AS4/ES4 A generic term for:

• Red Hat Enterprise Linux(R) AS 4

• Red Hat Enterprise Linux(R) AS 4.5

• Red Hat Enterprise Linux(R) AS 4.6

• Red Hat Enterprise Linux(R) AS 4.7

• Red Hat Enterprise Linux(R) AS 4.8

• Red Hat Enterprise Linux(R) AS 4.9

• Red Hat Enterprise Linux(R) ES 4

• Red Hat Enterprise Linux(R) ES 4.5

• Red Hat Enterprise Linux(R) ES 4.6

• Red Hat Enterprise Linux(R) ES 4.7

• Red Hat Enterprise Linux(R) ES 4.8

• Red Hat Enterprise Linux(R) ES 4.9

Red Hat Enterprise Linux 5 A generic term for:

• Red Hat Enterprise Linux(R) 5

• Red Hat Enterprise Linux(R) 5 Advanced Platform

• Red Hat Enterprise Linux(R) 5.1

• Red Hat Enterprise Linux(R) 5.1 Advanced Platform

• Red Hat Enterprise Linux(R) 5.2

• Red Hat Enterprise Linux(R) 5.2 Advanced Platform

• Red Hat Enterprise Linux(R) 5.3

• Red Hat Enterprise Linux(R) 5.3 Advanced Platform

• Red Hat Enterprise Linux(R) 5.4

• Red Hat Enterprise Linux(R) 5.4 Advanced Platform

• Red Hat Enterprise Linux(R) 5.5

• Red Hat Enterprise Linux(R) 5.5 Advanced Platform

• Red Hat Enterprise Linux(R) 5.6

• Red Hat Enterprise Linux(R) 5.6 Advanced Platform

Red Hat Enterprise Linux 6 A generic term for:

• Red Hat Enterprise Linux(R) 6

• Red Hat Enterprise Linux(R) 6 Advanced Platform

RHCM Red Hat(R) Cluster Manager

Abbreviation Full name or meaning

SUSE LINUX Enterprise Server A generic term for:

• SUSE LINUX(R) Enterprise Server 9

• SUSE LINUX(R) Enterprise Server 10

• SUSE LINUX(R) Enterprise Server 11

SVS HP StorageWorks 200 Storage Virtualization System

Thunder 9200 Hitachi Freedom Storage Thunder 9200

Universal Storage Platform V/VM A generic term for:

• Hitachi Universal Storage Platform V

• Hitachi Universal Storage Platform VM

• HP XP20000

• HP XP24000

UNIX A generic term for:

• AIX

• Solaris

• Linux

• HP-UX

VCS Veritas Cluster Server

Virtual Storage Platform A generic term for:

• Hitachi Virtual Storage Platform

• HP StorageWorks P9500 Disk Array

VxFS Veritas File System

VxVM Veritas Volume Manager

Note that if descriptions include the term Red Hat Enterprise Linux or Red Hat Enterprise Linux AS4/ES4, and there is no specific explanation about Oracle Enterprise Linux 4, read them as Oracle Enterprise Linux 4 when necessary. Similarly, note that if descriptions include the term Red Hat Enterprise Linux or Red Hat Enterprise Linux 5, and there is no specific explanation about Oracle Enterprise Linux 5, read them as Oracle Enterprise Linux 5 when necessary.

This manual also uses the following abbreviations.

Abbreviation Full name or meaning

API Application Programming Interface

BIOS Basic Input / Output System

CFQ Complete Fair Queuing

CHA Channel Adapter

Abbreviation Full name or meaning

CLPR Cache Logical Partition

CPU Central Processing Unit

CU Control Unit

DBMS Database Management System

Dev Device

DMI Desktop Management Interface

DNS Domain Name Server

DRBD Distributed Replicated Block Device

ELILO Extensible Firmware Interface Linux Loader

EM64T Extended Memory 64 Technology

EVMS Enterprise Volume Management System

ext Extended File System

FC Fibre Channel

FC-SP Fibre Channel Security Protocol

FO Failover

GMT Greenwich Mean Time

GRUB GRand Unified Bootloader

GUI Graphical User Interface

HBA Host Bus Adapter

HDev Host Device

HLU Host Logical Unit

HTTP Hypertext Transfer Protocol

I/O Input/Output

IA32 Intel Architecture 32

IDE Integrated Drive Electronics

IP Internet Protocol

IPC Inter Process Communication

vii

Abbreviation Full name or meaning

IPF Itanium(R) Processor Family

IRQ Interrupt ReQuest

iSCSI Internet Small Computer System Interface

KVM Kernel-based Virtual Machine

LAN Local Area Network

LDAP Lightweight Directory Access Protocol

LDEV Logical Device

LILO Linux Loader

LU Logical Unit

LUN Logical Unit Number

LVM Logical Volume Manager

md Multiple Devices

NAS Network Attached Storage

NIC Network Interface Card

NTP Network Time Protocol

OS Operating System

PPort

PCI Peripheral Component Interconnect

RADIUS Remote Authentication Dial in User Service

SAN Storage Area Network

SCSI Small Computer System Interface

SLPR Storage Logical Partition

SMTP Simple Mail Transfer Protocol

SNMP Simple Network Management Protocol

SP Service Pack

SSL Secure Sockets Layer

SVP Service Processor

viii

Abbreviation Full name or meaning

UUID Universally Unique Identifier

VG Volume Group

WWN World Wide Name

Conventions: Diagrams

This manual uses the following conventions in diagrams:

Conventions: Fonts and Symbols

Font and symbol conventions are classified as:

• General font conventions

• Conventions in syntax explanations

These conventions are described below.

General Font Conventions

The following table lists the general font conventions:

Font Convention

Bold Bold type indicates text on a window, other than the window title. Such text includes menus,

Italics Italics are used to indicate a placeholder for some actual text provided by the user or system.

Code font A code font indicates text that the user enters without change, or text (such as messages) output

menu options, buttons, radio box options, or explanatory labels. For example, bold is used in sentences such as the following:

• From the File menu, choose Open.

• Click the Cancel button.

• In the Enter name entry box, type your name.

Italics are also used for emphasis. For example:

• Write the command as follows:

copy source-file target-file

• Do not delete the configuration file.

by the system. For example:

• At the prompt, enter

• Use the

• The following message is displayed:

send command to send mail.

The password is incorrect.

dir.

Code examples and messages appear as follows (though there may be some exceptions, such as when the code is part of a diagram):

MakeDatabase ... StoreDatabase temp DB32

In examples of coding, an ellipsis (...) indicates that one or more lines of coding are not shown for purposes of brevity.

Conventions in Syntax Explanations

Syntax definitions appear as follows:

StoreDatabase [temp|perm] (database-name ...)

The following table lists the conventions used in syntax explanations:

Example font or symbol Convention

StoreDatabase Code-font characters must be entered exactly as shown.

database-name This font style marks a placeholder that indicates where appropriate characters are

SD Bold code-font characters indicate the abbreviation for a command.

perm Underlined characters indicate the default value.

to be entered in an actual command.

Example font or symbol Convention

[ ] Square brackets enclose an item or set of items whose specification is optional. An

item that is underlined is specified when all items are omitted.

{ } One of the options enclosed in { } must be specified.

| Only one of the options separated by a vertical bar can be specified at the same

time.

... An ellipsis (...) indicates that the item or items enclosed in ( ) or [ ] immediately

() Parentheses indicate the range of items to which the vertical bar (|) or ellipsis (...)

# A prompt on a command-execution window when the OS is UNIX

preceding the ellipsis may be specified as many times as necessary.

is applicable.

Conventions: KB, MB, GB, and TB

This manual uses the following conventions:

• 1 KB (kilobyte) is 1,024 bytes.

• 1 MB (megabyte) is 1,024

• 1 GB (gigabyte) is 1,024

• 1 TB (terabyte) is 1,024

bytes.

Contents

Preface i

Intended Readers........................................................................................................i

Organization of This Manual .....................................................................................i

Related Publications..................................................................................................ii

Conventions: Abbreviations.................................................................................... iii

Conventions: Diagrams............................................................................................ix

Conventions: Fonts and Symbols.............................................................................ix

Conventions: KB, MB, GB, and TB ........................................................................xi

1. Overview of HDLM 1

1.1 What is HDLM? .........................................................................................................2

1.2 HDLM Features..........................................................................................................4

2. HDLM Functions 5

2.1 Devices Managed by HDLM......................................................................................6

2.2 System Configuration.................................................................................................7

2.2.1 System Configuration Using an FC-SAN .......................................................7

2.2.2 System Configuration Using an IP-SAN ........................................................9

2.3 LU Configuration .....................................................................................................12

2.4 Program Configuration.............................................................................................14

2.5 Position of the HDLM Driver and HDLM Device...................................................16

2.6 Logical Device Files for HDLM Devices.................................................................17

2.7 Distributing a Load Using Load Balancing..............................................................19

2.7.1 Paths To Which Load Balancing Is Applied .................................................21

2.7.2 Load Balancing Algorithms ..........................................................................23

2.8 Performing Failovers and Failbacks Using Path Switching.....................................25

2.8.1 Automatic Path Switching.............................................................................25

2.8.2 Manual Path Switching .................................................................................28

2.8.3 Path Status Transition....................................................................................29

2.9 Monitoring Intermittent Errors (Functionality When Automatic Failback Is Used)32

2.9.1 Checking Intermittent Errors.........................................................................32

2.9.2 Setting Up Intermittent Error Monitoring .....................................................32

2.9.3 Intermittent Error Monitoring Actions..........................................................33

2.9.4 When a User Changes the Intermittent Error Information...........................35

2.10 Detecting Errors by Using Path Health Checking..................................................38

2.11 Error Management ..................................................................................................39

2.11.1 Types of Collected Logs..............................................................................41

2.11.2 Filtering of Error Information .....................................................................42

xiii

2.11.3 Collecting Error Information Using the Utility for Collecting HDLM Error

Information (DLMgetras)............................................................................. 43

2.11.4 Utility for Collecting HDLM Installation Error Information

(installgetras)................................................................................................ 43

2.12 Collecting Audit Log Data..................................................................................... 44

2.12.1 Categories and Audit Events that HDLM Can Output to the Audit Log ... 45

2.12.2 Requirements for Outputting Audit Log Data............................................ 49

2.12.3 Destination and Filtering of Audit Log Data.............................................. 50

2.12.4 Audit Log Data Formats............................................................................. 51

2.13 Integrated HDLM management using Global Link Manager................................ 54

2.14 Cluster Support ...................................................................................................... 56

3. Creating an HDLM Environment 57

3.1 HDLM System Requirements.................................................................................. 58

3.1.1 Hosts and OSs Supported by HDLM ........................................................... 58

3.1.2 Storage Systems Supported by HDLM......................................................... 71

3.1.3 Related Products When Using Red Hat Enterprise Linux AS4/ES4............ 72

3.1.4 Related Products When Using Red Hat Enterprise Linux 5......................... 96

3.1.5 Related Products When Using Red Hat Enterprise Linux 6....................... 109

3.1.6 Related Products When Using SUSE LINUX Enterprise Server 9.............110

3.1.7 Related Products When Using SUSE LINUX Enterprise Server 10...........111

3.1.8 Related Products When Using SUSE LINUX Enterprise Server 11 ...........118

3.1.9 Related Products When Using Oracle Enterprise Linux 4 ......................... 120

3.1.10 Related Products When Using Oracle Enterprise Linux 5 ....................... 121

3.1.11 Memory and Disk Capacity Requirements............................................... 124

3.1.12 Number of Paths Supported in HDLM..................................................... 127

3.1.13 Virtual Environments Supported by HDLM ............................................ 127

3.2 Flow for Creating an HDLM Environment ........................................................... 129

3.3 HDLM Installation Types ...................................................................................... 131

3.4 Knowledge Required Before You Install HDLM .................................................. 132

3.5 Notes on Creating an HDLM Environment........................................................... 133

3.5.1 Notes on Hardware Settings ....................................................................... 133

3.5.2 Notes on Linux ........................................................................................... 134

3.5.3 Notes on Installing HDLM......................................................................... 135

3.5.4 Notes on an Upgrade Installation or Re-installation of HDLM ................. 137

3.5.5 Notes on a Device Manager Agent............................................................. 137

3.6 Installing HDLM................................................................................................... 139

3.6.1 Preparations for a New Installation of HDLM ........................................... 139

3.6.2 Performing a New Installation of HDLM................................................... 144

3.6.3 Preparations for an Upgrade Installation or Re-installation of HDLM...... 151

3.6.4 Performing a Re-installation of HDLM...................................................... 152

3.6.5 Performing an Upgrade Installation of HDLM .......................................... 159

3.6.6 Unattended Installation of HDLM.............................................................. 165

3.7 Installing HDLM for Managing Boot Disks.......................................................... 172

xiv

3.7.1 Notes on Installing HDLM in a Boot Disk Environment............................172

3.7.2 Overview of the Procedure for Installing HDLM in a Boot Disk

Environment................................................................................................175

3.7.3 Settings for Using an HDLM Device as a Boot Disk .................................177

3.7.4 Upgrade Installation in an Environment Where an HDLM Device Is Used as

a Boot Disk .................................................................................................188

3.7.5 Settings for Using a Logical Volume (LVM2) on an HDLM Device as a Boot

Disk .............................................................................................................197

3.7.6 Upgrade Installation in an Environment Where a Logical Volume (LVM2) on

an HDLM Device Is Used as a Boot Disk..................................................209

3.7.7 Countermeasures for Unsuccessful Startup of the OS from an HDLM

Device .........................................................................................................226

3.8 Settings for LUKS ..................................................................................................229

3.8.1 Notes on Using LUKS.................................................................................229

3.8.2 Using HDLM in an LUKS Environment ....................................................229

3.9 Settings for md Devices..........................................................................................232

3.9.1 Notes on Setting Up md Devices ................................................................232

3.9.2 Creating an md Device................................................................................233

3.9.3 Using HDLM in an md Device Environment .............................................237

3.10 Settings for LVM2 ................................................................................................246

3.10.1 Notes on Using LVM2 ..............................................................................246

3.10.2 When Using an HDLM Device to Create a New Logical Volume ...........246

3.10.3 When Moving a Logical Volume Created on a SCSI Device in a Single-Path

Environment to an HDLM Device..............................................................253

3.11 Settings for Xen....................................................................................................258

3.12 Settings for KVM .................................................................................................260

3.13 Settings for Heartbeat...........................................................................................262

3.14 Settings for Oracle RAC.......................................................................................263

3.15 Settings for the RHCM.........................................................................................266

3.15.1 Notes on Using RHCM .............................................................................266

3.15.2 When Using Red Hat Enterprise Linux AS4/ES4.....................................266

3.15.3 When Using Red Hat Enterprise Linux 5, or Red Hat Enterprise Linux

6...................................................................................................................267

3.16 Settings for VCS...................................................................................................268

3.17 Checking the Path Configuration .........................................................................269

3.18 Setting Up HDLM ................................................................................................271

3.18.1 Checking the Current Settings...................................................................271

3.18.2 Setting Up the HDLM Functions ..............................................................271

3.18.3 Checking the Updated Settings .................................................................280

3.19 The Process-specific-trace Information File.........................................................281

3.19.1 Notes on Using the Hitachi Network Objectplaza Trace Library .............281

3.20 Creating a Character-Type Device File for an HDLM Device.............................282

3.20.1 When Using Red Hat Enterprise Linux 5 or Red Hat Enterprise Linux 6 282

3.20.2 When Using Red Hat Enterprise Linux AS4/ES4 or SUSE LINUX Enterprise

Server ......................................................................................................... 282

3.21 Creating File Systems for HDLM (When Volume Management Software Is Not

Used)..................................................................................................................... 284

3.21.1 Mounting a File System............................................................................ 284

3.21.2 Creating a File System.............................................................................. 284

3.22 Settings for Automatic Mounting ........................................................................ 286

3.22.1 Setting the HDLM Device for the First Time........................................... 286

3.22.2 Migrating from an Environment Where a SCSI Device Is Already Set... 287

3.23 Canceling the Settings for HDLM....................................................................... 290

3.23.1 Operations on HDLM-Managed Devices................................................. 290

3.23.2 Canceling the Heartbeat Settings.............................................................. 292

3.23.3 Canceling the Settings for Oracle RAC.................................................... 292

3.23.4 Canceling the Settings for RHCM............................................................ 293

3.23.5 Canceling the Settings for VCS................................................................ 295

3.23.6 Canceling the Xen Settings....................................................................... 295

3.23.7 Canceling the KVM Settings.................................................................... 297

3.23.8 Canceling the Settings for LVM2 ............................................................. 298

3.23.9 Canceling the md Device Settings............................................................ 302

3.23.10 Canceling the LUKS Settings................................................................. 310

3.23.11 Uninstalling HDLM.................................................................................311

3.23.12 Uninstalling Hitachi Network Objectplaza Trace Library (HNTRLib2) 326

4. HDLM Operation 329

4.1 Notes on Using HDLM.......................................................................................... 330

4.1.1 Notes Common to OSs ............................................................................... 330

4.1.2 Notes When Using Red Hat Enterprise Linux AS4/ES4, or Oracle Enterprise

Linux 4 ....................................................................................................... 332

4.1.3 Notes When Using Red Hat Enterprise Linux 5, Red Hat Enterprise Linux 6,

or Oracle Enterprise Linux 5...................................................................... 333

4.1.4 Notes When Using SUSE LINUX Enterprise Server 9.............................. 334

4.1.5 Notes When Using SUSE LINUX Enterprise Server 10............................ 335

4.1.6 Notes When Using SUSE LINUX Enterprise Server 11............................ 336

4.2 Updating Kernel Packages and Applying OS Update Packages ........................... 339

4.2.1 Environment Where an HDLM Device Is not Used as the Boot Disk....... 339

4.2.2 Environment Where an HDLM Device Is Used as the Boot Disk ............. 339

4.2.3 Environment Where a Logical Volume (LVM2) on an HDLM Device Is Used

as the Boot Disk ......................................................................................... 340

4.3 HDLM Operations Using Commands ................................................................... 341

4.3.1 Notes on Using Commands ........................................................................ 341

4.3.2 Viewing Path Information .......................................................................... 341

4.3.3 Changing the Status of Paths ...................................................................... 341

4.3.4 Viewing LU Information ............................................................................ 343

xvi

4.3.5 Displaying Corresponding Information About an HDLM Device, SCSI

Device, and LDEV......................................................................................344

4.3.6 Initializing Statistical Information for Paths ...............................................345

4.3.7 Viewing and Setting Up the Operating Environment..................................346

4.3.8 Viewing License Information......................................................................348

4.3.9 Updating the License...................................................................................348

4.3.10 Viewing HDLM Version Information .......................................................349

4.3.11 Viewing HDLM Component Information .................................................350

4.4 Starting and Stopping the HDLM Manager............................................................352

4.4.1 Starting the HDLM Manager ......................................................................352

4.4.2 Stopping the HDLM Manager.....................................................................353

4.5 HDLM Resident Processes.....................................................................................355

4.6 Reconfiguring the HDLM Operating Environment................................................356

4.6.1 Replacing HBAs..........................................................................................356

4.6.2 Replacing a Fiber Cable..............................................................................364

4.6.3 Replacing the Fibre Channel Switch...........................................................367

4.6.4 Changing the HDLM Device Configuration...............................................369

4.6.5 About Creating a New HDLM Device........................................................383

4.6.6 Note on adding a BladeSymphony I/O drawer ...........................................385

5. Troubleshooting 387

5.1 Information Collected by the DLMgetras Utility for Collecting HDLM Error

Information............................................................................................................388

5.2 Checking Error Information in Messages...............................................................389

5.3 What To Do for a Path Error ..................................................................................391

5.3.1 Examining the Messages.............................................................................392

5.3.2 Obtain Path Information..............................................................................392

5.3.3 Identifying the Error Path............................................................................393

5.3.4 Narrowing Down the Hardware That Might Have Caused the Error .........393

5.3.5 Identifying the Error Location and Correcting any Hardware Error...........393

5.3.6 Placing the Path Online...............................................................................393

5.4 What To Do for a Program Error............................................................................394

5.4.1 Examining the Messages.............................................................................394

5.4.2 Obtaining Program Information..................................................................394

5.4.3 What To Do for the Program Error .............................................................395

5.4.4 Contacting your HDLM Vendor or Maintenance Company .......................395

5.5 What To Do for Other Errors..................................................................................396

6. Command Reference 397

6.1 Overview of the HDLM Command dlnkmgr .........................................................398

6.2 clear (Returns the Path Statistics to the Initial Value) ............................................400

6.2.1 Format .........................................................................................................400

6.2.2 Parameters ...................................................................................................400

6.3 help (Displays the Operation Format) ....................................................................402

xvii

6.3.1 Format......................................................................................................... 402

6.3.2 Parameter.................................................................................................... 402

6.4 offline (Places Paths Offline)................................................................................. 404

6.4.1 Format......................................................................................................... 404

6.4.2 Parameters .................................................................................................. 404

6.5 online (Places Paths Online).................................................................................. 409

6.5.1 Format......................................................................................................... 409

6.5.2 Parameters .................................................................................................. 409

6.6 set (Sets Up the Operating Environment) .............................................................. 414

6.6.1 Format......................................................................................................... 414

6.6.2 Parameters .................................................................................................. 414

6.7 view (Displays Information).................................................................................. 431

6.7.1 Format......................................................................................................... 431

6.7.2 Parameters (To display program information)............................................ 432

7. Utility Reference 463

7.1 Overview of the Utilities........................................................................................ 464

7.2 DLMgetras Utility for Collecting HDLM Error Information................................ 466

7.2.1 Format......................................................................................................... 466

7.2.2 Parameters .................................................................................................. 466

7.2.3 List of Collected Error Information............................................................ 468

7.3 dlmcfgmgr Utility for Managing the HDLM Configuration ................................. 489

7.3.1 Format......................................................................................................... 489

7.3.2 Parameters .................................................................................................. 489

7.4 dlmmkinitrd Utility for Supporting a Boot Disk ................................................... 500

7.4.1 Format......................................................................................................... 500

7.4.2 Parameters .................................................................................................. 500

7.5 dlmpr Utility for Clearing HDLM Persistent Reservation..................................... 503

7.5.1 Format......................................................................................................... 503

7.5.2 Parameters .................................................................................................. 503

7.6 dlmsetopt Utility for Setting HDLM Driver Options ............................................ 506

7.6.1 Format......................................................................................................... 506

7.6.2 Parameters .................................................................................................. 506

7.7 dlmstart Utility for Starting HDLM....................................................................... 510

7.7.1 Format......................................................................................................... 510

7.8 dlmupdatesysinit Utility for Updating System Scripts ...........................................511

7.8.1 Format..........................................................................................................511

7.9 installgetras Utility for Collecting HDLM Installation Error Information............ 512

7.9.1 Format......................................................................................................... 512

7.9.2 Parameters .................................................................................................. 512

7.9.3 Error Information To Be Collected............................................................. 512

7.10 installhdlm Utility for Installing HDLM ............................................................. 514

7.10.1 Format....................................................................................................... 514

7.10.2 Parameters ................................................................................................ 514

xviii

7.10.3 Editing an Installation-Information Settings File......................................514

7.11 installux.sh Utility for HDLM Common Installer................................................521

7.11.1 Format .......................................................................................................521

7.11.2 Parameters .................................................................................................521

7.11.3 Log file ......................................................................................................521

8. Messages 523

8.1 Before Viewing the List of Messages.....................................................................524

8.1.1 Format and Meaning of Message IDs .........................................................524

8.1.2 Terms Used in Messages and Message Explanations .................................524

8.1.3 Components That Output Messages to syslog ............................................524

8.2 KAPL01001 to KAPL02000 ..................................................................................526

8.3 KAPL03001 to KAPL04000 ..................................................................................548

8.4 KAPL04001 to KAPL05000 ..................................................................................551

8.5 KAPL05001 to KAPL06000 ..................................................................................560

8.6 KAPL06001 to KAPL07000 ..................................................................................567

8.7 KAPL07001 to KAPL08000 ..................................................................................571

8.8 KAPL08001 to KAPL09000 ..................................................................................572

8.9 KAPL09001 to KAPL10000 ..................................................................................575

8.10 KAPL10001 to KAPL11000 ................................................................................602

8.11 KAPL11001 to KAPL12000 ................................................................................640

8.12 KAPL12001 to KAPL13000 ................................................................................644

8.13 KAPL13001 to KAPL14000 ................................................................................662

8.14 KAPL15001 to KAPL16000 ................................................................................677

8.15 Return Codes for Hitachi Command Suite Common Agent Component.............684

Appendixes 691

A. Notes on Linux Commands and Files......................................................................692

A.1 Notes on the /proc/partitions File..................................................................692

A.2 Notes on Linux Commands...........................................................................692

A.3 Notes on the iostat Command .......................................................................693

A.4 Notes on the mkfs Command ........................................................................694

A.5 Notes on the fdisk Command ........................................................................694

A.6 Notes on the sar Command ...........................................................................695

A.7 Notes on the fdisk and parted Commands.....................................................695

A.8 Notes on the parted Command ......................................................................695

A.9 Notes on the vgrename and lvrename Commands ........................................696

B. Troubleshooting Products That Use the Weak-Modules Script...............................697

B.1 Installing Products That Use the Weak-Modules Script................................697

B.2 Uninstalling Products That Use the Weak-Modules Script ...........................702

C. Functional Differences Between Versions of HDLM..............................................703

C.1 Functional Differences Between Version 6.2.1 and Versions Earlier Than

6.2.1...............................................................................................................703

C.2 Functional Differences Between Version 6.1 and Versions Earlier Than 6.1703

xix

C.3 Functional Differences Between Version 6.0 or Later and Versions Earlier Than

6.0................................................................................................................. 703

C.4 Functional Differences Between Version 5.9.4 or Later and Versions Earlier

Than 5.9.4..................................................................................................... 703

C.5 Functional Differences Between Version 5.9.1 or Later and Versions Earlier

Than 5.9.1..................................................................................................... 704

C.6 Functional Differences Between Version 5.9 or Later and Versions Earlier Than

5.9................................................................................................................. 704

C.7 Functional Differences Between Version 5.8 or Later and Versions Earlier Than

5.8................................................................................................................. 704

C.8 Functional Differences Between Version 5.7.1 or Later and Versions Earlier

Than 5.7.1..................................................................................................... 705

C.9 Functional Differences Between Version 5.7.0-01 or Later and Versions Earlier

Than 5.7.0-01 ............................................................................................... 705

C.10 Functional Differences Between Version 5.7 or Later and Versions Earlier

Than 5.7........................................................................................................ 705

C.11 Functional Differences Between Version 5.6.3 or Later and Versions Earlier

Than 5.6.3..................................................................................................... 706

C.12 Functional Differences Between Version 5.4 or Later and Versions Earlier

Than 5.4........................................................................................................ 706

D. Glossary .................................................................................................................. 707

Index 715

Chapter

1. Overview of HDLM

HDLM is a software package that manages paths between a host and a storage system. HDLM is designed to distribute loads across multiple paths and will switch a given load to another path if there is a failure in the path that is currently being used, thus improving system reliability.

This chapter gives an overview of HDLM and describes its features.

1.1 What is HDLM?

1.2 HDLM Features

1. Overview of HDLM

1.1 What is HDLM?

With the widespread use of data warehousing and increasing use of multimedia data, the need for high-speed processing of large volumes of data on networks has rapidly grown. To satisfy this need, networks dedicated to the transfer of data, such as SANs, are now being used to provide access to storage systems.

HDLM manages the access paths to these storage systems. HDLM provides the ability to distribute loads across multiple paths and switch to another path if there is a failure in the path that is currently being used, thus improving system availability and reliability.

Figure 1-1: Between Hosts and Storage Systems illustrates the connections between various hosts and storage systems. A server on which HDLM is installed is called a

host.

Figure 1-1: Between Hosts and Storage Systems

HDLM supports the following storage systems:

• Hitachi AMS2000/AMS/WMS/SMS series

• Hitachi USP

• Lightning 9900 series

• Lightning 9900V series

• Thunder 9500V series

• Universal Storage Platform V/VM

• Virtual Storage Platform

1. Overview of HDLM

1.2 HDLM Features

HDLM features include the following:

The ability to distribute a load across multiple paths. This is also known as load balancing.

When a host is connected to a storage system via multiple paths, HDLM can distribute the load across all the paths. This prevents one, loaded down path from affecting the processing speed of the entire system.

For details on load balancing, see 2.7 Distributing a Load Using Load Balancing.

The ability to continue running operations between a host and storage system, even if there is a failure. This is also known as performing a failover.

When a host is connected to a storage system via multiple paths, HDLM can automatically switch to another path if there is some sort of failure in the path that is currently being used. This allows operations to continue between a host and a storage system.

For details on performing failovers, see 2.8 Performing Failovers and Failbacks Using Path Switching.

The ability to bring a path that has recovered from an error back online. This is also known as performing a failback.

If a path is recovered from an error, HDLM can bring that path back online. This enables the maximum possible number of paths to always be available and online, which in turn enables HDLM to better distribute the load across multiple paths.

Failbacks can be performed manually or automatically. In an automatic failback, HDLM will automatically restore the path to an active state after the user has corrected the problem that exists on the physical path.

For details on performing failbacks, see 2.8 Performing Failovers and Failbacks Using Path Switching.

The ability to automatically check the status of any given path at regular intervals. This is also known as path health checking.

HDLM can easily detect errors by checking the statuses of paths at user-defined time intervals. This allows you to check for any existing path errors and to resolve them promptly and efficiently.

For details on setting up and performing path health checking, see 2.10 Detecting Errors by Using Path Health Checking.

Chapter

2. HDLM Functions

This chapter describes the various functions that are built into HDLM. Before the function specifications are explained though, this chapter will go into detail about the HDLM management targets, system configuration, and basic terms that are necessary to know to effectively operate HDLM. After that, the rest of the chapter focus on describing all the HDLM functions, including the main ones: load distribution across paths and path switching.

2.1 Devices Managed by HDLM

2.2 System Configuration

2.3 LU Configuration

2.4 Program Configuration

2.5 Position of the HDLM Driver and HDLM Device

2.6 Logical Device Files for HDLM Devices

2.7 Distributing a Load Using Load Balancing

2.8 Performing Failovers and Failbacks Using Path Switching

2.9 Monitoring Intermittent Errors (Functionality When Automatic Failback Is Used)

2.10 Detecting Errors by Using Path Health Checking

2.11 Error Management

2.12 Collecting Audit Log Data

2.13 Integrated HDLM management using Global Link Manager

2.14 Cluster Support

2. HDLM Functions

2.1 Devices Managed by HDLM

Below is a list of devices that can or cannot be managed by HDLM. The devices that can be managed by HDLM are called HDLM management-target devices.

HDLM management-target devices:

The following devices of the storage systems listed in Section 1.1 What is HDLM?:

• SCSI devices

• Boot disks

Non-HDLM management-target devices:

• SCSI devices other than those of the storage systems listed in Section

1.1 What is HDLM?

• Devices other than disks (such as tape devices)

• Command devices of the storage systems listed in Section 1.1 What is

HDLM? (For example, Hitachi RAID Manager command devices.)

+ 716 hidden pages