IBM DS3000, DS4000, DS5000 User Manual

IBM System Storage™ Digital Media Storage Solution

Installation Guide

Selling and Deploying DS3000/DS4000/DS5000 in Apple and StorNext Environments

Digital Media Storage Solution Installation Guide

Con Rice

Modular Storage Product Specialist

LSI Corporation

12007 Sunrise Valley Drive, Suite 325

Reston, VA 20191

Cell: 703-867-0012 Tel: 703-262-5418

e-mail: con.rice@lsi.com

Contents

INTRODUCTION ....................................................................................................................... 4

File Sharing Environments ..................................................................................................... 4

THREE CURRENT SOLUTIONS .............................................................................................. 5

Apple Homogenous................................................................................................................ 5

Apple Xsan Clients with Linux MDC (Meta Data Controller) ............................................... 5

Linux Homogenous ................................................................................................................ 5

Linux StorNext Clients with Linux MDC .............................................................................. 5

Heterogeneous ...................................................................................................................... 6

Apple Xsan Clients, Linux StorNext Clients, Windows Clients (June) and Linux MDC ....... 6

COMPONENT DESCRIPTIONS ............................................................................................... 6

Apple Clients .......................................................................................................................... 6

Linux StorNext Clients and MDC‟s ......................................................................................... 6

SAN Architecture must meet RPQ criteria ............................................................................. 7

IBM Storage ........................................................................................................................... 7

PLANNED SUPPORT ROLLOUT ............................................................................................. 8

Apple Homogenous................................................................................................................ 8

Apple Xsan Clients with Linux MDC (Meta Data Controller) ............................................... 8

Linux Homogenous ................................................................................................................ 9

Linux StorNext Clients with Linux MDC .............................................................................. 9

Heterogeneous .................................................................................................................... 10

Apple Xsan Clients, Linux StorNext Clients, Windows Clients (June) and Linux MDC ..... 10

Planned Future Enhancements ............................................................................................ 11

Additional Linux HBA choices and Windows Server 200x Meta data Controller ............... 11

APPLE, WINDOWS, and STORNEXT SUPPORT MATRIX .................................................... 11

SOLUTION RESTRICTIONS AND RECOMMENDATIONS .................................................... 12

RECOMMENDED RAID CONFIGURATIONS ......................................................................... 13

SOLUTION INSTALLATION .................................................................................................... 14

QUANTUM / APPLE JOINT PRODUCT SUPPORT PROGRAM ............................................ 16

Overview .......................................................................................................................... 16

Xsan Controlled SAN File System .................................................................................... 16

StorNext Controlled SAN File System .............................................................................. 16

Cooperation Effort Between Apple and QUANTUM ......................................................... 16

Closing a Case ................................................................................................................. 16

MIGRATING FROM XSAN MDC TO STORNEXT MDC ...................................................... 17

ATTO ....................................................................................................................................... 18

ATTO HBA INSTALLATION .................................................................................................... 19

ATTO Config Tool Features ................................................................ ................................ . 20

ATTO OS X Driver Installation ............................................................................................. 20

ATTO OS X Configuration Tool Installation .......................................................................... 21

Viewing multipathing information ......................................................................................... 22

Paths Tab ............................................................................................................................. 22

Path Status at Target Level .................................................................................................. 23

Path Status at LUN Level ..................................................................................................... 23

Additional Path Information .................................................................................................. 24

Detailed Info ......................................................................................................................... 25

Load Balancing Policies ....................................................................................................... 26

Configuring Multipathing ...................................................................................................... 26

Collecting Celerity Host Adapter Info ................................................................................... 27

FC Host Adapter Configuration ............................................................................................ 27

Useful OS X Applications ..................................................................................................... 28

ATTO Problems? ................................................................................................................. 28

Escalation Checklist ......................................................................................................... 28

APPENDIX: CONFIGURATION SCRIPTS Setting TPGS On ................................................. 29

Turning AVT Off ................................................................................................................... 29

APPENDIX: EXAMPLE CONFIGURATIONS .......................................................................... 30

Large Heterogeneous StorNext configuration ................................................................ ...... 30

Mid to large -sized “MAC Homogenous” StorNext configuration .......................................... 32

Mid-sized “MAC Homogenous” StorNext configuration ....................................................... 33

Mid-sized “MAC Homogenous” StorNext configuration ........................................................ 34

Small “MAC Homogenous” StorNext configuration .............................................................. 35

Mid to large -sized Heterogeneous StorNext configuration .................................................. 36

Additional Reference Links ...................................................................................................... 37

Notices ..................................................................................................................................... 37

Trademarks ............................................................................................................................. 38

INTRODUCTION

StorNext Environment

There has long been a desire to support Apple servers and work stations with IBM DS series storage, and now we have that capability. But due to confusion in the past, we will be approving a very specific set of known, quality configurations. There are two basic aspects of these solutions: One is basic hardware connectivity, the second is the support for file sharing. It‟s important not to confuse the two. Basic hardware connectivity to Apple is supported via RPQ. File sharing is also supported, but because of the added complexity requires very specific configuration and a more restrictive RPQ process.

File Sharing Environments

Apple installations typically use a shared file system called Xsan. Xsan is in reality a lite version of Quantum‟s StorNext File System. StorNext is very popular in the media market because it allows shared block-level file system access while offering integrated archive management. However, Apple offers very limited support outside very specific configurations. A 100% apple configuration must be used.

There are three components to the StorNext solution: Clients, Meta Data Controller (MDCs), and the storage. There are also ancillary components such as the SAN, the TCP/IP network, and archive storage such as tape libraries. However, for selling and support purposes the components are software, support, and implementations services.

The announced support for the IBM Digital Media Storage Solution is the result of efforts between ATTO (HBA‟s), Quantum (StorNext), LSI (Storage Subsystems), and IBM. We have identified a set of hardware, firmware, and configuration parameters that will be supported. The set of configurations will be expanded in a logical manner over the next few months as additional choices are available and tested.

THREE CURRENT SOLUTIONS

Apple Homogenous

Apple Xsan Clients with Linux MDC (Meta Data Controller)

(Apple can also be connected without Xsan/StorNext support)

Linux Homogenous

Linux StorNext Clients with Linux MDC

Heterogeneous

Apple Xsan Clients, Linux StorNext Clients, Windows Clients (June) and Linux MDC

COMPONENT DESCRIPTIONS

Apple Clients

• Apple connection without StorNext/Xsan support, or

• May use Apple Xsan Client software

o If you use the Xsan clients and Xsan Meta Data Controller (MDC), then your

support comes from Apple. However, if you use the StorNext MDC from Quantum, then Quantum will support the entire solution including the Xsan clients loaded on the Mac‟s. As you can see, this is a much more flexible solution.

• Must use Linux StorNext Meta Data Controllers

• Must use ATTO HBA and Multipath driver

o ATTO Celerity 8GB FC HBAs:

 FC-84EN [Quad Port]  FC-82EN [Dual Port]  FC-81EN [Single Port]

Linux StorNext Clients and MDC’s

• Must buy Quantum StorNext software

• Must buy Installation services from StorNext

• Must buy support contract from Quantum

• Supported Qlogic or Emulex HBA‟s

• RDAC MPP Multipath diver

• Servers must run approved versions of SLES or RHEL

SAN Architecture must meet RPQ criteria

DS3400

DS4700

DS5020

DS5100

base

performance

DS5300

enhanced

performance

Burst I/O rate cache reads (IOPS)

110,000

120,000

200,000

650,000

700,000

Sustained I/O rate disk reads

21,000

39,250

50,000

76,000

170,000

Sustained I/O rate disk writes

4,500

9,350

9,500

20,000

38,000

Drives

48 SAS/SATA

112 FC/SATA

112

FC/SATA/FDE

256

FC/SATA/FDE

448

FC/SATA/FDE

/SSD*

(480) SATA*

Burst throughput cache read

1,600

1,550MB/s

3,700 MB/s

1,600MB/s

6,400 MB/s

Sustained throughput disk read

925

980MB/s

1,600 MB/s

1,600MB/s

6,400 MB/s

Sustained throughput disk write

720

850 MB/s

1,400 MB/s

1,300 MB/s

5,300 MB/s

Host ports

4 4 4 8 16

• Limit number of paths for Xsan/StorNext clients to four

• This is to limit both complexity and the amount of time required to initialize clients

on the SAN

• Redundant Meshed Fibre Channel SAN (cross-connected)

• RDAC MPP supports this configuration

• Some IBM documentation may seem to preclude this, but those documents are based on an old non-“mpp” version of RDAC

• Limits cause for failover to Controller failure

• Specific Firmware, software, and Operating System Levels

IBM Storage

• DS5100/DS5300

• DS5020

• DS4700

• DS3400

• Future

PLANNED SUPPORT ROLLOUT

There are very specific capabilities that are being added and they are tied to specific hardware, software, and driver availability. Support will be added in this order:

Apple Homogenous

Apple Xsan Clients with Linux MDC (Meta Data Controller)

(Apple can also be connected without Xsan/StorNext support)

1. Single Host Client connected to DS3000/DS4000/DS5000 Storage (NOW) a. Apple Leopard and Snow Leopard

i. Using ATTO HBA‟s and multipathing driver b. Without StorNext or Xsan support c. This is basic host connectivity support.

2. Multiple Apple Host Client connected to DS3000/DS4000/DS5000 Storage (NOW) a. Apple Leopard and Snow Leopard using Xsan Client software

i. Using ATTO HBA‟s and multipathing driver

b. With StorNext MDC‟s running on RHEL/SLES

i. Using previously supported QLogic and/or Emulex HBA‟s

Linux Homogenous

Linux StorNext Clients with Linux MDC

3. Multiple Linux Host Client connected to DS3000/DS4000/DS5000 Storage (NOW) a. RHEL/SLES using StorNext Client software

i. Using previously supported QLogic and/or Emulex HBA‟s

b. With StorNext MDC‟s running on RHEL/SLES

i. Using previously supported QLogic and/or Emulex HBA‟s

Heterogeneous

Apple Xsan Clients, Linux StorNext Clients, Windows Clients (June) and Linux MDC

4. Mixed Host Apple and Linux Client connected to DS3000/DS4000/DS5000 Storage

(NOW)

a. Apple Leopard and Snow Leopard using Xsan Client software

i. Using ATTO HBA‟s and multipathing driver

b. RHEL/SLES systems using StorNext CLIENT software

i. Using previously supported QLogic and/or Emulex HBA‟s

c. With StorNext MDC‟s running on RHEL/SLES

i. Using previously supported QLogic and/or Emulex HBA‟s

5. Single Host Windows Client connected to DS3000/DS4000/DS5000 Storage a. Windows client (XP, Vista, Windows 7) (June)

i. Using ATTO HBA‟s and multipathing driver b. Without StorNext or XSAN support c. This is basic host connectivity support.

6. Add Windows Host Client in mixed environments support connected to DS3000/DS4000/DS5000 Storage

a. Windows client (XP, Vista, Windows 7) (June)

i. Using ATTO HBA‟s and multipathing driver

b. With StorNext MDC‟s running on RHEL/SLES

i. Using previously supported QLogic and/or Emulex HBA‟s

ii. Using ATTO HBA‟s with either RDAC MPP or ATTO multipathing driver

Planned Future Enhancements

O/S

Architecture

HBA

MPF

Supported

Meta Data Controller

Linux

RHEL 5.3

x64

As currently supported (Qlogics/Emulex)

RDAC (MPP)

Yes

Linux

RHEL 5.3

x64

ATTO

Planned

Linux

SLES 10.2

x64

As currently supported (Qlogics/Emulex)

RDAC (MPP)

Yes

Linux

RHEL 5.3

x64

ATTO

Planned

Client

Apple OSX

Leopard

x64

ATTO

Yes

Apple OSX

Snow Leopard

x64

ATTO

Yes Linux

RHEL 5.3

x86, x64

As currently supported (Qlogics/Emulex)

RDAC (MPP)

Yes

Linux

RHEL 5.3

x86, x64

ATTO

Yes

Linux

SLES 10.2

x86, x64

As currently supported (Qlogics/Emulex)

RDAC (MPP)

Yes

Linux

SLES 10.2

x86, x64

ATTO

Yes

Windows

2003 SP2

x86, x64

As currently supported (Qlogics/Emulex)

MPIO/DSM

Planned

Windows

2008 SP2

x86, x64

As currently supported

(Qlogics/Emulex)

MPIO/DSM

Planned

Windows

2008 R2

x86, x64

As currently supported

(Qlogics/Emulex)

MPIO/DSM

Planned

Windows

Windows 7

x86

ATTO

Planned

Windows

Vista

x86

ATTO

Planned

Windows

x86

ATTO

Planned

Mixed

As appropriate above

Additional Linux HBA choices and Windows Server 200x Meta data Controller

7. Expand RHEL/SLES connectivity choices (Planned)

a. Add ATTO HBA‟s for either MDC‟s and/or clients using RDAC MPP

i. This step is not tied to any other steps and may occur at any time after step 3

b. Add ATTO HBA‟s for either MDC‟s and/or clients using ATTO multipathing driver

i. This step is not tied to any other steps and may occur at any time after step 3

8. Add Windows Server 200x as either StorNext clients or as StorNext MDC‟s (Planned)

a. Windows client Server 200x

i. Using previously supported QLogic and/or Emulex HBA‟s

ii. Using ATTO HBA‟s with either RDAC MPP or ATTO multipathing driver

b. We will NOT add this until AFTER the Windows Clients (XP, Vista, Windows 7) are

added to reduce confusion

APPLE, WINDOWS, and STORNEXT SUPPORT MATRIX

SOLUTION RESTRICTIONS AND RECOMMENDATIONS

HBA’s

Connections

Zone

MDC

Single or multiple (typical)

Up to four

All ports see Controller A and Controller B on DSxxxx

MDC - Limit number of defined paths to optimize initialization time. There are few MDC‟s in comparison to clients, so this choice should not be as restrictive as below. This is not a hard requirement, but is recommended.

Most configurations consist of two MDC‟s for high availability. Both MDC‟s must have the

same configuration; OS, HBA‟s, Driver Levels, etc

Client

Single (typical) or multiple

Up to two

All ports see Controller A and Controller B on DSxxxx

Client – Limit number of defined paths to four to optimize initialization time. This is not a hard requirement, but is recommended.

Storage

Controller A

Up to 8

All ports see all MDC and client ports

Controller B

Up to 8

All ports see all MDC and client ports

There are several important aspects to the configuring of the SAN that must be understood. The first is that the SAN design is architected to avoid logical drive failover in the storage subsystem. This is accomplished by employing a meshed fabric where each HBA on the server can see both controllers on the storage subsystem. The second aspect has to deal with access to the shared logical drives. There are three types of shared logical drives; Metadata,

Journal, and Data. All systems (MDC‟s and Clients) must be able to see the Data LUNs. The MDC‟s must also be able to both see the Metadata and Journal LUNs. It is important that the

clients do not have access to the Metadata or Journal LUNs. When configuring the storage partitioning within the storage subsystem, the methodology is as follows:  All HBA‟s in the MDC‟s will be defined within a single host definition (called MDCs?). This

host definition will have the Metadata and Journal LUNs directly mapped to this host definition.

 All Clients have their own host definitions. If desired, all clients that have the same OS can

have their HBA‟s combined within a single host definition.

 All Clients and the MDC‟s will be assigned to a single host group (called StorNext?). All of

the Data LUNs will be assigned to that host group.

+ 26 hidden pages

IBM DS3000, DS4000, DS5000 User Manual

Specifications and Main Features

Frequently Asked Questions

User Manual