IBM DS3000, DS4000, DS5000, SYSTEM STORAGE DS5000 User Manual

1.49 Mb
Loading...

IBM System Storage™ Digital Media Storage Solution

Installation Guide

Selling and Deploying DS3000/DS4000/DS5000

in Apple and StorNext Environments

Con Rice Modular Storage Product Specialist LSI Corporation 12007 Sunrise Valley Drive, Suite 325 Reston, VA 20191 Cell: 703-867-0012 Tel: 703-262-5418

e-mail: con.rice@lsi.com

Digital Media Storage Solution Installation Guide

February 25, 2010

© Copyright 2010, IBM Corporation

Contents

INTRODUCTION .......................................................................................................................

 

4

File Sharing Environments .....................................................................................................

 

4

THREE CURRENT SOLUTIONS ..............................................................................................

 

5

Apple Homogenous................................................................................................................

 

5

Apple Xsan Clients with Linux MDC (Meta Data Controller)...............................................

 

5

Linux Homogenous ................................................................................................................

 

5

Linux StorNext Clients with Linux MDC ..............................................................................

 

5

Heterogeneous ......................................................................................................................

 

6

Apple Xsan Clients, Linux StorNext Clients, Windows Clients (June) and Linux MDC

....... 6

COMPONENT DESCRIPTIONS ...............................................................................................

 

6

Apple Clients..........................................................................................................................

 

6

Linux StorNext Clients and MDC‟s .........................................................................................

 

6

SAN Architecture must meet RPQ criteria .............................................................................

 

7

IBM Storage ...........................................................................................................................

 

7

PLANNED SUPPORT ROLLOUT .............................................................................................

 

8

Apple Homogenous................................................................................................................

 

8

Apple Xsan Clients with Linux MDC (Meta Data Controller)...............................................

 

8

Linux Homogenous ................................................................................................................

 

9

Linux StorNext Clients with Linux MDC ..............................................................................

 

9

Heterogeneous ....................................................................................................................

 

10

Apple Xsan Clients, Linux StorNext Clients, Windows Clients (June) and Linux MDC.....

10

Planned Future Enhancements............................................................................................

 

11

Additional Linux HBA choices and Windows Server 200x Meta data Controller...............

 

11

APPLE, WINDOWS, and STORNEXT SUPPORT MATRIX....................................................

 

11

SOLUTION RESTRICTIONS AND RECOMMENDATIONS ....................................................

 

12

RECOMMENDED RAID CONFIGURATIONS.........................................................................

 

13

SOLUTION INSTALLATION....................................................................................................

 

14

QUANTUM / APPLE JOINT PRODUCT SUPPORT PROGRAM ............................................

 

16

Overview ..........................................................................................................................

 

16

Xsan Controlled SAN File System ....................................................................................

 

16

StorNext Controlled SAN File System ..............................................................................

 

16

Cooperation Effort Between Apple and QUANTUM .........................................................

 

16

Digital Media Storage Solution Installation Guide

2

 

© Copyright 2010, IBM Corporation. All rights reserved.

 

 

Closing a Case .................................................................................................................

16

MIGRATING FROM XSAN MDC TO STORNEXT MDC......................................................

17

ATTO .......................................................................................................................................

18

ATTO HBA INSTALLATION ....................................................................................................

19

ATTO Config Tool Features .................................................................................................

20

ATTO OS X Driver Installation .............................................................................................

20

ATTO OS X Configuration Tool Installation..........................................................................

21

Viewing multipathing information .........................................................................................

22

Paths Tab.............................................................................................................................

22

Path Status at Target Level..................................................................................................

23

Path Status at LUN Level.....................................................................................................

23

Additional Path Information ..................................................................................................

24

Detailed Info.........................................................................................................................

25

Load Balancing Policies .......................................................................................................

26

Configuring Multipathing ......................................................................................................

26

Collecting Celerity Host Adapter Info ...................................................................................

27

FC Host Adapter Configuration ............................................................................................

27

Useful OS X Applications .....................................................................................................

28

ATTO Problems? .................................................................................................................

28

Escalation Checklist .........................................................................................................

28

APPENDIX: CONFIGURATION SCRIPTS Setting TPGS On .................................................

29

Turning AVT Off ...................................................................................................................

29

APPENDIX: EXAMPLE CONFIGURATIONS ..........................................................................

30

Large Heterogeneous StorNext configuration ......................................................................

30

Mid to large -sized “MAC Homogenous” StorNext configuration ..........................................

32

Mid-sized “MAC Homogenous” StorNext configuration.......................................................

33

Mid-sized “MAC Homogenous” StorNext configuration........................................................

34

Small “MAC Homogenous” StorNext configuration ..............................................................

35

Mid to large -sized Heterogeneous StorNext configuration ..................................................

36

Additional Reference Links ......................................................................................................

37

Notices.....................................................................................................................................

37

Trademarks .............................................................................................................................

38

Digital Media Storage Solution Installation Guide

3

© Copyright 2010, IBM Corporation. All rights reserved.

 

INTRODUCTION

There has long been a desire to support Apple servers and work stations with IBM DS series storage, and now we have that capability. But due to confusion in the past, we will be approving a very specific set of known, quality configurations. There are two basic aspects of these solutions: One is basic hardware connectivity, the second is the support for file sharing. It‟s important not to confuse the two. Basic hardware connectivity to Apple is supported via RPQ. File sharing is also supported, but because of the added complexity requires very specific configuration and a more restrictive RPQ process.

File Sharing Environments

Apple installations typically use a shared file system called Xsan. Xsan is in reality a lite version of Quantum‟s StorNext File System. StorNext is very popular in the media market because it allows shared block-level file system access while offering integrated archive management. However, Apple offers very limited support outside very specific configurations. A 100% apple configuration must be used.

There are three components to the StorNext solution: Clients, Meta Data Controller (MDCs), and the storage. There are also ancillary components such as the SAN, the TCP/IP network, and archive storage such as tape libraries. However, for selling and support purposes the components are software, support, and implementations services.

StorNext Environment

The announced support for the IBM Digital Media Storage Solution is the result of efforts between ATTO (HBA‟s), Quantum (StorNext), LSI (Storage Subsystems), and IBM. We have identified a set of hardware, firmware, and configuration parameters that will be supported. The set of configurations will be expanded in a logical manner over the next few months as additional choices are available and tested.

Digital Media Storage Solution Installation Guide

4

© Copyright 2010, IBM Corporation. All rights reserved.

 

THREE CURRENT SOLUTIONS

Apple Homogenous

Apple Xsan Clients with Linux MDC (Meta Data Controller)

(Apple can also be connected without Xsan/StorNext support)

Linux Homogenous

Linux StorNext Clients with Linux MDC

Digital Media Storage Solution Installation Guide

5

© Copyright 2010, IBM Corporation. All rights reserved.

 

Heterogeneous

Apple Xsan Clients, Linux StorNext Clients, Windows Clients (June) and Linux MDC

COMPONENT DESCRIPTIONS

Apple Clients

Apple connection without StorNext/Xsan support, or

May use Apple Xsan Client software

oIf you use the Xsan clients and Xsan Meta Data Controller (MDC), then your support comes from Apple. However, if you use the StorNext MDC from Quantum, then Quantum will support the entire solution including the Xsan clients loaded on the Mac‟s. As you can see, this is a much more flexible solution.

Must use Linux StorNext Meta Data Controllers

Must use ATTO HBA and Multipath driver

oATTO Celerity 8GB FC HBAs:

FC-84EN [Quad Port]

FC-82EN [Dual Port]

FC-81EN [Single Port]

Linux StorNext Clients and MDC’s

Must buy Quantum StorNext software

Must buy Installation services from StorNext

Must buy support contract from Quantum

Supported Qlogic or Emulex HBA‟s

RDAC MPP Multipath diver

Servers must run approved versions of SLES or RHEL

Digital Media Storage Solution Installation Guide

6

© Copyright 2010, IBM Corporation. All rights reserved.

 

SAN Architecture must meet RPQ criteria

Limit number of paths for Xsan/StorNext clients to four

This is to limit both complexity and the amount of time required to initialize clients on the SAN

Redundant Meshed Fibre Channel SAN (cross-connected)

RDAC MPP supports this configuration

Some IBM documentation may seem to preclude this, but those documents are based on an old non-“mpp” version of RDAC

Limits cause for failover to Controller failure

Specific Firmware, software, and Operating System Levels

 

IBM Storage

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

DS5100/DS5300

 

 

 

 

DS3400

 

 

 

 

DS5020

 

 

 

 

 

Future

 

 

 

 

DS4700

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

DS5100

 

DS5300

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

DS3400

 

DS4700

 

 

DS5020

 

base

 

enhanced

 

 

 

 

 

 

 

 

 

 

 

 

 

performance

 

performance

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Burst I/O rate

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

cache reads

 

 

 

110,000

120,000

 

200,000

650,000

700,000

 

 

(IOPS)

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Sustained I/O rate

21,000

39,250

 

50,000

76,000

170,000

 

 

disk reads

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Sustained I/O rate

4,500

9,350

 

9,500

20,000

38,000

 

 

disk writes

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

448

 

 

Drives

 

 

48 SAS/SATA

 

112 FC/SATA

112

256

 

FC/SATA/FDE

 

 

 

 

 

FC/SATA/FDE

 

FC/SATA/FDE

 

/SSD*

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

(480) SATA*

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Burst throughput

 

 

1,600

 

1,550MB/s

 

 

3,700 MB/s

 

1,600MB/s

 

6,400 MB/s

 

 

 

 

 

 

 

 

 

 

 

cache read

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Sustained

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

throughput

 

 

 

925

 

980MB/s

 

 

1,600 MB/s

 

1,600MB/s

 

6,400 MB/s

 

 

disk read

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Sustained

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

throughput

 

 

 

720

 

850 MB/s

 

 

1,400 MB/s

 

1,300 MB/s

 

5,300 MB/s

 

 

 

 

 

 

 

 

 

 

 

 

disk write

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Host ports

 

 

 

4

 

4

 

 

4

 

8

 

16

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Digital Media Storage Solution Installation Guide

 

 

 

 

7

 

 

© Copyright 2010, IBM Corporation. All rights reserved.

 

 

 

 

 

 

 

PLANNED SUPPORT ROLLOUT

There are very specific capabilities that are being added and they are tied to specific hardware, software, and driver availability. Support will be added in this order:

Apple Homogenous

Apple Xsan Clients with Linux MDC (Meta Data Controller)

(Apple can also be connected without Xsan/StorNext support)

1.Single Host Client connected to DS3000/DS4000/DS5000 Storage (NOW)

a.Apple Leopard and Snow Leopard

i.Using ATTO HBA‟s and multipathing driver

b.Without StorNext or Xsan support

c.This is basic host connectivity support.

2.Multiple Apple Host Client connected to DS3000/DS4000/DS5000 Storage (NOW)

a.Apple Leopard and Snow Leopard using Xsan Client software

i.Using ATTO HBA‟s and multipathing driver

b.With StorNext MDC‟s running on RHEL/SLES

i.Using previously supported QLogic and/or Emulex HBA‟s

Digital Media Storage Solution Installation Guide

8

© Copyright 2010, IBM Corporation. All rights reserved.

 

Linux Homogenous

Linux StorNext Clients with Linux MDC

3.Multiple Linux Host Client connected to DS3000/DS4000/DS5000 Storage (NOW)

a.RHEL/SLES using StorNext Client software

i.Using previously supported QLogic and/or Emulex HBA‟s

b.With StorNext MDC‟s running on RHEL/SLES

i.Using previously supported QLogic and/or Emulex HBA‟s

Digital Media Storage Solution Installation Guide

9

© Copyright 2010, IBM Corporation. All rights reserved.

 

Heterogeneous

Apple Xsan Clients, Linux StorNext Clients, Windows Clients (June) and Linux MDC

4.Mixed Host Apple and Linux Client connected to DS3000/DS4000/DS5000 Storage (NOW)

a.Apple Leopard and Snow Leopard using Xsan Client software

i.Using ATTO HBA‟s and multipathing driver

b.RHEL/SLES systems using StorNext CLIENT software

i.Using previously supported QLogic and/or Emulex HBA‟s

c.With StorNext MDC‟s running on RHEL/SLES

i.Using previously supported QLogic and/or Emulex HBA‟s

5.Single Host Windows Client connected to DS3000/DS4000/DS5000 Storage

a.Windows client (XP, Vista, Windows 7) (June)

i.Using ATTO HBA‟s and multipathing driver

b.Without StorNext or XSAN support

c.This is basic host connectivity support.

6.Add Windows Host Client in mixed environments support connected to DS3000/DS4000/DS5000 Storage

a.Windows client (XP, Vista, Windows 7) (June)

i.Using ATTO HBA‟s and multipathing driver

b.With StorNext MDC‟s running on RHEL/SLES

i.Using previously supported QLogic and/or Emulex HBA‟s

ii.Using ATTO HBA‟s with either RDAC MPP or ATTO multipathing driver

Digital Media Storage Solution Installation Guide

10

© Copyright 2010, IBM Corporation. All rights reserved.

 

Planned Future Enhancements

Additional Linux HBA choices and Windows Server 200x Meta data Controller

7.Expand RHEL/SLES connectivity choices (Planned)

a.Add ATTO HBA‟s for either MDC‟s and/or clients using RDAC MPP

i.This step is not tied to any other steps and may occur at any time after step 3

b.Add ATTO HBA‟s for either MDC‟s and/or clients using ATTO multipathing driver

i.This step is not tied to any other steps and may occur at any time after step 3

8.Add Windows Server 200x as either StorNext clients or as StorNext MDC‟s (Planned)

a.Windows client Server 200x

i.Using previously supported QLogic and/or Emulex HBA‟s

ii.Using ATTO HBA‟s with either RDAC MPP or ATTO multipathing driver

b.We will NOT add this until AFTER the Windows Clients (XP, Vista, Windows 7) are added to reduce confusion

APPLE, WINDOWS, and STORNEXT SUPPORT MATRIX

 

O/S

Architecture

HBA

MPF

Supported

Meta Data Controller

 

 

 

 

Linux

RHEL 5.3

x64

As currently supported

RDAC (MPP)

Yes

(Qlogics/Emulex)

 

 

 

 

 

Linux

RHEL 5.3

x64

ATTO

ATTO

Planned

Linux

SLES 10.2

x64

As currently supported

RDAC (MPP)

Yes

(Qlogics/Emulex)

 

 

 

 

 

Linux

RHEL 5.3

x64

ATTO

ATTO

Planned

Client

 

 

 

 

 

Apple

Leopard

x64

ATTO

ATTO

Yes

OSX

 

 

 

 

 

Apple

Snow Leopard

x64

ATTO

ATTO

Yes

OSX

 

 

 

 

 

Linux

RHEL 5.3

x86, x64

As currently supported

RDAC (MPP)

Yes

(Qlogics/Emulex)

 

 

 

 

 

Linux

RHEL 5.3

x86, x64

ATTO

ATTO

Yes

Linux

SLES 10.2

x86, x64

As currently supported

RDAC (MPP)

Yes

(Qlogics/Emulex)

 

 

 

 

 

Linux

SLES 10.2

x86, x64

ATTO

ATTO

Yes

Windows

2003 SP2

x86, x64

As currently supported

MPIO/DSM

Planned

(Qlogics/Emulex)

 

 

 

 

 

Windows

2008 SP2

x86, x64

As currently supported

MPIO/DSM

Planned

(Qlogics/Emulex)

 

 

 

 

 

Windows

2008 R2

x86, x64

As currently supported

MPIO/DSM

Planned

(Qlogics/Emulex)

 

 

 

 

 

Windows

Windows 7

x86

ATTO

ATTO

Planned

Windows

Vista

x86

ATTO

ATTO

Planned

Windows

XP

x86

ATTO

ATTO

Planned

Mixed

 

 

As appropriate above

As appropriate

 

 

 

 

 

above

 

Digital Media Storage Solution Installation Guide

 

 

11

© Copyright 2010, IBM Corporation. All rights reserved.

 

 

 

SOLUTION RESTRICTIONS AND RECOMMENDATIONS

There are several important aspects to the configuring of the SAN that must be understood. The first is that the SAN design is architected to avoid logical drive failover in the storage subsystem. This is accomplished by employing a meshed fabric where each HBA on the server can see both controllers on the storage subsystem. The second aspect has to deal with access to the shared logical drives. There are three types of shared logical drives; Metadata,

Journal, and Data. All systems (MDC‟s and Clients) must be able to see the Data LUNs. The MDC‟s must also be able to both see the Metadata and Journal LUNs. It is important that the clients do not have access to the Metadata or Journal LUNs.

When configuring the storage partitioning within the storage subsystem, the methodology is as follows:

All HBA‟s in the MDC‟s will be defined within a single host definition (called MDCs?). This host definition will have the Metadata and Journal LUNs directly mapped to this host definition.

All Clients have their own host definitions. If desired, all clients that have the same OS can have their HBA‟s combined within a single host definition.

All Clients and the MDC‟s will be assigned to a single host group (called StorNext?). All of the Data LUNs will be assigned to that host group.

 

HBA’s

Connections

Zone

MDC

Single or

Up to four

All ports see Controller A and Controller B on

 

multiple (typical)

 

DSxxxx

MDC - Limit number of defined paths to optimize initialization time. There are few MDC‟s in comparison to clients, so this choice should not be as restrictive as below. This is not a hard requirement, but is recommended.

Most configurations consist of two MDC‟s for high availability. Both MDC‟s must have the same configuration; OS, HBA‟s, Driver Levels, etc

Client

Single (typical)

Up to two

All ports see Controller A and Controller B on

 

or multiple

 

DSxxxx

Client – Limit number of defined paths to four to optimize initialization time. This is not a hard requirement, but is recommended.

Storage

Controller A

Up to 8

All ports see all MDC and client ports

 

Controller B

Up to 8

All ports see all MDC and client ports

Digital Media Storage Solution Installation Guide

12

© Copyright 2010, IBM Corporation. All rights reserved.

 

+ 26 hidden pages