EMC Symmetrix DMX-3 Product Manual

Page 1
EMC® Symmetrix
DMX-3
Product Guide
P/N 300-002-197
REV A09
EMC Corporation
Corporate Headquarters:
Hopkinton, MA 01748
1
-508-435-1000
www.EMC.com
-9103
Page 2
Copyright © 2005-2008 EMC Corporation. All rights reserved.
Published December, 2008
EMC believes the information in this publication is accurate as of its publication date. The information is subject to change without notice.
THE INFORMATION IN THIS PUBLICATION IS PROVIDED “AS IS.” EMC CORPORATION MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE.
Use, copying, and distribution of any EMC software described in this publication requires an applicable software license.
For the most up-to-date regulatory document for your product line, go to the Technical Documentation and Advisories section on EMC Powerlink.
For the most up-to-date listing of EMC product names, see EMC Corporation Trademarks on EMC.com.
All other trademarks used herein are the property of their respective owners.
2
EMC Symmetrix DMX-3 Product Guide
Page 3

Contents

Warnings and Cautions.......................................................................... 17
Preface .................................................................................................... 21
Chapter 1 Introducing the Symmetrix DMX-3
Symmetrix DMX-3............................................................................ 26
Symmetrix DMX-3 configurations .......................................... 27
Symmetrix platform and Enginuity operating environment..... 29
Enginuity operating environment........................................... 29
EMC Solutions Enabler APIs ................................................... 30
Storage capacities and global memory requirements.................. 31
Storage capacities....................................................................... 31
Factors affecting storage capacity............................................ 31
Global memory requirements.................................................. 32
Performance features........................................................................ 33
Availability and integrity features.................................................. 35
Serviceability features ...................................................................... 37
Supported software applications.................................................... 38
Tiered Storage Optimization.................................................... 38
Storage management................................................................. 39
Symmetrix local and remote replication software solutions 39
Information mobility................................................................. 40
Hardware options............................................................................. 41
DMX-3 Silencer .......................................................................... 41
DMX-3 Silencer specifications ................................................. 42
DMX-3 systems securing kits................................................... 43
EMC Symmetrix DMX-3 Product Guide
3
Page 4
Contents
Chapter 2 Symmetrix DMX-3 Hardware
Major components............................................................................ 46
Symmetrix DMX-3 and component scaling attributes......... 50
DMX-3 configuration rules and guidelines........................... 51
Symmetrix DMX-3 architecture...................................................... 53
DMX-3 block diagram............................................................... 53
DMX-3 point-to-point message matrix................................... 55
DMX-3 midplane slot configuration....................................... 56
DMX-3 slot configuration......................................................... 57
Symmetrix channel connectivity and host integration ............... 59
Channel connectivity ................................................................ 59
Symmetrix channel configurations......................................... 60
Supported Fibre Channel interfaces ....................................... 60
Supported cluster hosts............................................................ 60
Mainframe serial channel interfaces....................................... 60
Supported mainframe operating systems.............................. 61
Fibre Channel disk subsystem........................................................ 62
Disk drives.................................................................................. 62
Link control cards (LCC).......................................................... 63
Power supply/ cooling module.............................................. 63
Symmetrix DMX disk drive capacities................................... 64
Symmetrix DMX-3 logical volume capacities ....................... 66
Configuration rules for vault devices..................................... 68
Symmetrix DMX disk drive emulations ................................ 68
Deleting (and then adding) devices online............................ 69
Open system disk emulation ................................................... 69
IBM CKD DASD disk emulation............................................. 71
Channel, disk, and global memory directors ............................... 75
Channel director connectivity ................................................. 75
Channel director descriptions.................................................. 76
Fibre Channel directors (front-end)........................................ 77
Fibre Channel adapters (front-end) ........................................ 78
ESCON channel directors......................................................... 79
Multiprotocol Channel Directors ............................................ 80
FICON channel director ........................................................... 80
Gigabit Ethernet (GigE) remote directors.............................. 81
GigE IPv4/v6 (IPsec capable) director................................... 82
iSCSI channel directors............................................................. 82
Fibre Channel disk directors (back-end)................................ 83
Global memory directors.......................................................... 83
Global memory director configuration .................................. 85
Symmetrix DMX-3 power subsystems.......................................... 86
System bay power subsystem components........................... 86
4
EMC Symmetrix DMX-3 Product Guide
Page 5
Storage bay power subsystem components........................... 87
DMX-3 communications and environmental control.................. 89
Communications control functions......................................... 89
Environmental control functions............................................. 90
Channel attachments ........................................................................ 92
FICON channel interface connections .................................... 92
ESCON channel interface connections ................................... 95
Mainframe serial channel extenders ....................................... 97
Open systems Fibre Channel interface connections ............. 98
Chapter 3 Symmetrix DMX-3 Input/Output Operations
Symmetrix DMX-3 operation ........................................................ 102
Symmetrix global memory management............................. 103
Elements of a Symmetrix I/O operation ..................................... 105
I/O response time: Mainframe environment....................... 105
I/O response time: Open systems environment ................. 106
Symmetrix I/O operations ..................................................... 106
Read operations........................................................................ 108
Write operations....................................................................... 110
Write destaging operation ...................................................... 112
I/O performance enhancements................................................... 113
Contents
Chapter 4 Performance and Optimization
Overview.......................................................................................... 116
Global memory performance features ......................................... 117
Global memory ASICs............................................................. 118
Tag Based Caching (TBC)........................................................ 119
Fast write capabilities.............................................................. 120
Dynamic Mirror Service Policy (DMSP) algorithm ............ 120
Disk Rotational Position Ordering (RPO) ............................ 120
Disk Multiple Priority Queues (DMPQ)............................... 120
PermaCache option.................................................................. 121
Symmetrix file system performance features.............................. 122
Dynamically adjusting performance algorithms................. 122
Enhancement of dynamic mirror service policy ................. 122
Enhancement of Symmetrix Optimizer ................................ 122
Enhanced system audit and investigation ........................... 123
Multiple channel directors............................................................. 124
Channel speeds and cable lengths......................................... 124
Host connectivity ..................................................................... 126
Open systems hypervolumes ....................................................... 127
EMC Symmetrix DMX-3 Product Guide
5
Page 6
Contents
Hypervolume extension feature............................................ 127
Disk drive cylinders................................................................ 127
Logical volume mapping ....................................................... 128
Metavolumes............................................................................ 128
Mainframe systems hypervolumes ............................................. 132
Hypervolume extension options........................................... 132
Split-volume capability........................................................... 132
Extended cylinder addressing option................................... 133
Determining cylinders for hypervolume user data............ 134
Tiered Storage Optimization......................................................... 136
Symmetrix Priority Controls.................................................. 136
Dynamic Cache Partitioning.................................................. 137
Optimizing Symmetrix system performance ............................. 139
Performance guidelines for open system devices............... 139
Virtual LUN technology......................................................... 140
Virtual LUN management...................................................... 140
Dynamic Host Addressing............................................................ 145
Virtual Provisioning ....................................................................... 146
Virtual Provisioning description ........................................... 146
Benefits of Virtual Provisioning ............................................ 147
Virtual Provisioning features................................................. 147
Multiport volume access for open systems environments ....... 149
Software options overview............................................................ 150
EMC ControlCenter family of products............................... 150
Symmetrix Optimizer ............................................................. 153
TimeFinder family of products.............................................. 154
Solutions Enabler..................................................................... 155
Symmetrix Management Console......................................... 155
Chapter 5 Data Integrity, Availability, and Protection
Overview.......................................................................................... 158
Symmetrix reliability and availability features................... 158
Symmetrix data integrity protection features ..................... 158
Data protection options .......................................................... 159
Reliability and availability features ............................................. 162
Reliable components............................................................... 162
Global memory director data integrity ................................ 162
Redundant global memory .................................................... 162
Channel director redundancy................................................ 163
Internal control data path redundancy ................................ 164
Fibre Channel back-end redundancy ................................... 164
Fibre Channel arbitrated loop design................................... 165
Dual-initiator feature ............................................................. 168
6
EMC Symmetrix DMX-3 Product Guide
Page 7
Contents
Redundant power subsystem ................................................ 169
Vaulting ..................................................................................... 170
Power loss to one power zone................................................ 170
Battery backup units ............................................................... 171
Nondisruptive component replacement............................... 172
Nondisruptive Enginuity upgrades...................................... 173
Nondisruptively change or remove FBA devices ............... 174
Deleting (and then adding) devices online.......................... 174
Maintaining data integrity ............................................................ 175
Remote support........................................................................ 175
Error Checking and Correction, and data integrity
protection .................................................................................. 176
Disk error correction and error verification......................... 177
Global memory director data integrity logic ....................... 178
Global memory error correction and error verification...... 178
Global memory chip-level redundancy................................ 179
Redundant global memory..................................................... 179
Longitude redundancy code (LRC)....................................... 179
Byte-level parity checking ...................................................... 179
Global memory access path protection................................. 180
DMX-3 security features................................................................. 181
Security overview .................................................................... 182
Symmetrix Service Credential, Secured by RSA ................. 182
Access control and user authorization.................................. 183
Symmetrix Audit Log.............................................................. 185
RSA enVision log security ...................................................... 185
EMC Certified Data Erasure for Symmetrix Disks ............. 186
IPsec security features............................................................. 187
Data protection guidelines............................................................. 189
Disk mirroring (RAID 1) concepts................................................ 191
Advantages of mirroring ........................................................ 191
Write operations with mirroring............................................ 191
Read operations with mirroring ............................................ 192
Error recovery with mirroring ............................................... 192
Dynamic Mirror Service Policy (DMSP)............................... 193
Business Continuance Volumes (BCV) ................................. 193
Virtual devices.......................................................................... 194
Symmetrix RAID 1/0 for open systems....................................... 195
Symmetrix RAID 10 for mainframe systems .............................. 196
Symmetrix DMX RAID 5 ............................................................... 198
RAID 5 overview...................................................................... 198
RAID 5 attributes ..................................................................... 198
RAID 5 device (volume).......................................................... 198
RAID 5 (3+1) ............................................................................. 199
EMC Symmetrix DMX-3 Product Guide
7
Page 8
Contents
RAID 5 (7+1)............................................................................. 199
RAID 5 modes of operation ................................................... 199
Normal mode........................................................................... 200
Regeneration ............................................................................ 202
RAID 5 performance optimization ....................................... 204
RAID 5 configuration guidelines .......................................... 205
RAID 5 configuration rules.................................................... 205
Symmetrix DMX RAID 6............................................................... 206
RAID 6 overview ..................................................................... 206
RAID 6 attributes..................................................................... 206
RAID 6 device (volume)......................................................... 206
Even-Odd algorithm ............................................................... 207
RAID 6 (6+2)............................................................................. 208
RAID 6 (14+2)........................................................................... 208
Rebuilding data and parity members................................... 209
RAID 6 configuration guidelines .......................................... 210
Comparing RAID 5 and RAID 6 ........................................... 210
Sparing in Symmetrix systems ..................................................... 211
Sparing configuration rules and guidelines........................ 211
Special DMX-3 sparing considerations ................................ 211
Sparing benefits ....................................................................... 213
Permanent sparing .................................................................. 213
Dynamic sparing ..................................................................... 216
SRDF family of products ............................................................... 221
Base SRDF family products.................................................... 221
SRDF family options ............................................................... 222
SRDF/A resiliency features ................................................... 222
Chapter 6 Mainframe Features and Support
Introduction..................................................................................... 226
Supported mainframe features..................................................... 227
EMC z/OS Storage Manager................................................. 227
Dynamic Channel Management............................................ 228
Dynamic Path Reconnection ................................................. 228
Concurrent Copy..................................................................... 228
Compatible Native Flash for Mainframe............................. 229
Multi-Path Lock Facility/Concurrent Access...................... 230
MultiSubsystem Imaging ....................................................... 230
Sequential Data Striping......................................................... 230
Partitioned Data Set (PDS) Assist ........................................ 230
Multiple Allegiance (MA) ...................................................... 231
Parallel Access Volumes ......................................................... 231
8
EMC Symmetrix DMX-3 Product Guide
Page 9
Contents
Compatible HyperPAV............................................................ 231
Dynamic Parallel Access Volumes......................................... 231
RAID 10 striping ...................................................................... 233
Supported ESCON devices and logical paths...................... 234
Supported FICON devices and logical paths .......................235
IBM MetroMirror (PPRC) ....................................................... 235
XRC support ............................................................................. 236
Configuring CKD volumes..................................................... 237
Deleting (and then adding) devices online.......................... 238
Support for 64 K cylinders...................................................... 238
FICON Cascading and Open Systems Intermix
configurations........................................................................... 238
Error reporting and recovery......................................................... 240
Types of errors.......................................................................... 240
Error reporting.......................................................................... 242
Operator messages................................................................... 246
EREP reports............................................................................. 248
Error handling.......................................................................... 249
Detecting the error................................................................... 250
Sense byte information................................................................... 251
Console error messages........................................................... 251
Host sense byte data formats ................................................. 253
Appendix A Symmetrix DMX-3 Specifications
Storage control................................................................................. 256
Physical data .................................................................................... 264
Environmental data ........................................................................ 266
Environmental Acclimation ................................................... 266
Power and cooling data.................................................................. 269
Electrical specifications and power requirements...................... 270
North American power specifications.................................. 271
North American extension cords and
mating connectors.................................................................... 271
International power specifications ........................................ 274
International extension cords
and mating connectors............................................................ 274
Appendix B Power Sequences
Vaulting............................................................................................. 278
Routinely powering up the Symmetrix DMX-3 ......................... 279
Powering down the Symmetrix DMX-3 ...................................... 281
EMC Symmetrix DMX-3 Product Guide
9
Page 10
Contents
Appendix C Planning and Installation
Planning overview.......................................................................... 284
Symmetrix DMX-3 presite considerations........................... 284
Layout and space recommendations.................................... 286
Securing the system................................................................. 286
Transportation and delivery guidelines............................... 287
Remote support ....................................................................... 287
Planning for upgrades ............................................................ 287
Symmetrix DMX-3 power requirements..................................... 288
Symmetrix touch current compliance .................................. 290
Regulatory compliance........................................................... 291
Choosing a UPS ....................................................................... 292
System placement options............................................................. 293
Overhead host cable routing.................................................. 294
Overhead power cable routing.............................................. 294
Floor load-bearing requirements........................................... 295
Symmetrix DMX-3 configuration floor cutouts .................. 297
Planning host connectivity............................................................ 298
Open systems installations............................................................ 301
Symmetrix hardware checklist.............................................. 301
Host checklist........................................................................... 302
Available EMC Fibre Channel cables.................................... 304
Available EMC GigE/iSCSI cables........................................ 305
Mainframe systems installations.................................................. 306
Symmetrix hardware checklist.............................................. 306
Available EMC ESCON cables .............................................. 307
Available EMC FICON cables ............................................... 308
10
Glossary ................................................................................................ 309
Index ..................................................................................................... 321
EMC Symmetrix DMX-3 Product Guide
Page 11

Figures

Title Page
1 Symmetrix DMX-3 nine-bay configuration................................................. 27
2 Symmetrix DMX-3 five-bay configuration.................................................. 28
3 Symmetrix DMX-3 two-bay configuration.................................................. 28
4 Enginuity and the storage platform relationships...................................... 29
5 DMX-3 Silencer................................................................................................ 41
6 Symmetrix DMX-3 system bay (interior view, front and rear)................. 47
7 Symmetrix DMX-3 storage bay (interior view, front and rear)................ 49
8 Symmetrix DMX-3 block diagram................................................................ 54
9 Symmetrix DMX-3 message fabric ............................................................... 56
10 Symmetrix DMX-3 card cage configurations (front).................................. 57
11 Symmetrix DMX-3 card cage configurations (rear) ................................... 58
12 Track format for 3390 DASD ......................................................................... 73
13 Global memory director to channel and disk director matrix.................. 84
14 Symmetrix DMX-3 system bay and storage bay to
customer PDU power cabling ....................................................................... 88
15 Communication to directors.......................................................................... 90
16 XCM environmental control functionality.................................................. 91
17 FICON channel attachments.......................................................................... 93
18 ESCON channel attachments......................................................................... 96
19 Host cache use ............................................................................................... 102
20 Symmetrix global memory management and data flow......................... 103
21 I/O response time (mainframe environment).......................................... 105
22 I/O response time (open systems environment)...................................... 106
23 Symmetrix I/O operations........................................................................... 107
24 Read operations............................................................................................. 108
25 Read hit........................................................................................................... 108
26 Read miss........................................................................................................ 109
27 Write operations............................................................................................ 110
28 Fast write........................................................................................................ 111
29 Delayed fast write ......................................................................................... 111
EMC Symmetrix DMX-3 Product Guide
11
Page 12
Figures
Title Page
30 Destaging operation...................................................................................... 112
31 TBC LRU function......................................................................................... 119
32 Logical volume mapping (8:1) .................................................................... 128
33 Concatenated volumes................................................................................. 130
34 Striped data.................................................................................................... 130
35 SMC migration dialog step 1....................................................................... 142
36 SMC migration dialog step 2....................................................................... 143
37 SMC migration dialog step 3....................................................................... 144
38 Fibre Channel back-end redundancy......................................................... 167
39 Symmetrix DMX dual-initiator example................................................... 169
40 Data record format for conventional DASD ............................................. 176
41 Symmetrix data record format.................................................................... 177
42 RAID 10 with Dynamic Mirror Service Policy.......................................... 196
43 RAID 5 data/parity (3+1) ............................................................................ 199
44 Writing data in RAID 5 normal mode ....................................................... 201
45 Reading data in RAID 5 normal mode ...................................................... 202
46 RAID 6 (6+2) data/parity layout................................................................ 208
47 RAID 6 (14+2)................................................................................................ 209
48 Permanent sparing process.......................................................................... 215
49 Dynamic sparing process............................................................................. 217
50 Dynamic sparing with locally mirrored pairs .......................................... 219
51 Dynamic support of Parallel Access Volumes.......................................... 232
52 Supported ESCON logical paths per port................................................. 234
53 Supported FICON logical paths per port.................................................. 235
54 PPRC and GDPS support............................................................................. 236
55 XRC overview................................................................................................ 237
56 z/OS IEA480E service alert error message format
(AC power failure)........................................................................................ 246
57 z/OS IEA480E service alert error message format
(mirror-1 volume in “not ready” state)...................................................... 247
58 z/OS IEA480E service alert error message format
(mirror-2 resynchronization)....................................................................... 247
59 z/OS IEA480E service alert error message format
(mirror-1 resynchronization)....................................................................... 248
60 Typical console error message.................................................................... 251
61 Power connections........................................................................................ 270
62 EMC model number DMX3-PCBL3DHR cable description................... 272
12
EMC Symmetrix DMX-3 Product Guide
Page 13
Title Page
63 EMC model number DMX3-PCBL3DHH cable description................... 272
64 System bay and storage bay wiring, North America (Delta).................. 273
65 EMC model number DMX3-PC3YAFLE cable description..................... 275
66 EMC model number DMX3-PCBL3YAG cable description.................... 275
67 System bay and storage bay wiring with flying leads (WYE) ................ 276
68 Symmetrix DMX-3 system bay and storage bay power switches.......... 280
69 DMX-3 system bay and storage bay to customer
PDU power cabling ....................................................................................... 288
70 DMX-3 power cabling requirement............................................................ 289
71 Nonraised floor installation......................................................................... 293
72 One system bay and eight storage bays..................................................... 297
Figures
EMC Symmetrix DMX-3 Product Guide
13
Page 14
Figures
14
EMC Symmetrix DMX-3 Product Guide
Page 15

Tables

Title Page
1 Symmetrix DMX-3 performance features.....................................................26
2 Performance features roadmap......................................................................33
3 Availability and integrity features roadmap................................................35
4 DMX-3 Silencer kits model information .......................................................42
5 DMX-3 Silencer physical specifications........................................................42
6 Symmetrix DMX-3 model component overview.........................................46
7 Symmetrix DMX-3 system bay component overview................................48
8 Symmetrix DMX-3 storage bay component overview................................50
9 DMX-3 configurations .....................................................................................51
10 IBM controller/DASD compatibility.............................................................61
11 Symmetrix DMX-3 disk drive features ........................................................63
12 Symmetrix DMX-3 disk drive capacities .....................................................65
13 Logical volumes supported on Symmetrix DMX-3 disk drives................66
14 Logical volumes supported for DMX-3 systems .........................................67
15 IBM DASD emulation characteristics............................................................72
16 Supported protocols and Symmetrix DMX-3 channel directors...............76
17 Symmetrix DMX-3 channel director models and descriptions .................77
18 Symmetrix devices and addressing capabilities
for Fibre Channel front-end directors ...........................................................78
19 ESCON director configurations.....................................................................79
20 FICON director configurations......................................................................81
21 Symmetrix FICON cable distances ...............................................................93
22 Symmetrix ESCON cable distances...............................................................97
23 Symmetrix Fibre Channel cable distances ...................................................98
24 Symmetrix open systems disk capacities and cylinders...........................128
25 Symmetrix mainframe disk capacities and cylinders ...............................134
26 Device emulations and number of cylinders .............................................135
27 Symmetrix DMX-3 channel director connectivity.....................................163
28 Data protection options.................................................................................189
29 RAID 5 write operation sequence in normal mode...................................200
EMC Symmetrix DMX-3 Product Guide
15
Page 16
Tables
Title Page
30 RAID 5 and RAID 6 comparison .................................................................210
31 Environmental errors reported as SIM messages......................................244
32 Error handling steps......................................................................................249
33 Unit status bits................................................................................................252
34 Channel status bits......................................................................................... 252
35 DMX-3 73 GB disk capacities ....................................................................... 257
36 DMX-3 146 GB disk capacities .....................................................................258
37 DMX-3 300 GB disk capacities .....................................................................259
38 DMX-3 450 GB disk capacities .....................................................................260
39 DMX-3 500 GB disk capacities .....................................................................261
40 Physical specifications...................................................................................264
41 Multibay width measurements ...................................................................264
42 Multibay weights ...........................................................................................265
43 Data center acclimation times ......................................................................266
44 Operating environment specifications........................................................267
45 Shipping and storage environment specifications.................................... 267
46 Air volume generated....................................................................................267
47 Sound power and sound pressure levels.................................................... 267
48 DMX-3 power consumption and heat dissipation....................................269
49 Electrical specifications, North American, three-phase, four-wire
(Delta) .............................................................................................................. 271
50 Extension line cord, North American, three-phase, four-wire (Delta)... 271 51 Electrical specifications, international, three-phase, five-wire, (WYE) .. 274
52 Extension line cord, international, three-phase, five-wire, (WYE) .........274
53 Preinstallation responsibility summary......................................................284
54 Symmetrix DMX-3 channel adapter port worksheet................................299
55 Symmetrix checklist for UNIX or PC server hosts....................................301
56 UNIX or PC server host checklist ................................................................ 302
57 EMC Fibre cables - Fibre Channel connect.................................................304
58 GigE/iSCSI channel cables ...........................................................................305
59 Symmetrix checklist for mainframe hosts..................................................306
60 ESCON channel cables..................................................................................307
61 EMC Fibre cables - FICON 9 micron connect ............................................308
16
EMC Symmetrix DMX-3 Product Guide
Page 17
The following warnings and cautions pertain throughout this guide:
WARNING Trained service personnel only.
This EMC product has more than one power supply cord. To reduce the risk of electric shock, disconnect all power supply cords before servicing.
Ground circuit continuity is vital for safe operation of the machine. Never operate the machine with grounding conductors disconnected. Remember to reconnect any grounding conductors removed for or during any installation procedure.
Warnings and
Cautions
ATTENTION Resérvé au personnel autorisé.
Cet appareil EMC comporte plus d'un cordon d'alimentation. Afin de prévenir les chocs électriques, débranchez tous les cordons d'alimentation avant de faire le dépannage.
Un circuit de terre continu est essentiel en vue du fonctionnement sécurisé de l'appareil. Ne mettez jamais l'appareil en marche lorsque le conducteur de mise à la terre est débranché.
WARNUNG Nur für authorisiertes Fachpersonal.
Dieses EMC Produkt verfügt über mehrere elektrische Netzanschlüsse. Zur Vermeidung eines elektrischen Schlages sind vor Servicearbeiten an der Stromversorgung alle Netzanschlüsse zu trennen.
Kontinuierliche Erdung ist notwendig während der gesamten Betriebsdauer des Gerätes. Es ist unzulässig das Gerät ohne Erdung zu betreiben. Gerät muss geerdet werden, bevor es am Stromnetz angeschlossen wird.
EMC Symmetrix DMX-3 Product Guide
17
Page 18
Warnings and Cautions
WARNING
WARNING
WARNING
CAUTION
!
Additional warnings
and cautions
Before attempting to service EMC hardware described in this document, observe the following additional Warnings and Cautions:
The hardware enclosure contains no user-serviceable parts, so it should not be moved or opened for any reason by untrained persons. If the hardware needs to be relocated or repaired, only qualified personnel familiar with safety procedures for electrical equipment and EMC hardware should access components inside the system or move the system.
This product operates at high voltages. To protect against physical harm, power off the system whenever possible while servicing.
In case of fire or other emergency involving the EMC product, isolate the product’s power and alert appropriate personnel.
Trained personnel are advised to exercise great care at all times when working on the EMC hardware. Remember to:
Remove rings, watches, or other jewelry and neckties before you begin
any procedures.
Use caution near any moving part and any part that may start
unexpectedly such as fans, motors, solenoids, etc.
Always use the correct tools for the job.
Always use the correct replacement parts.
Keep all paperwork, including incident reports, up-to-date, complete,
and accurate.
18
EMC Symmetrix DMX-3 Product Guide
Page 19
Warnings and Cautions
CAUTION
!
Static precautions EMC incorporates state-of-the-art technology in its designs, including
the use of LSI and VLSI components. These chips are very susceptible to damage caused by static discharge and need to be handled accordingly.
Before handling printed circuit boards or other parts containing LSI or VLSI components, observe the following precautions:
Store all printed circuit boards in antistatic bags.
Use a ground strap whenever you handle a printed circuit board.
Unless specifically designed for nondisruptive replacement, never
plug or unplug printed circuit boards with the power on. Severe component damage may result.
EMC Symmetrix DMX-3 Product Guide
19
Page 20
Warnings and Cautions
20
EMC Symmetrix DMX-3 Product Guide
Page 21

Preface

IMPORTANT
!
As part of its effort to improve and enhance the performance and capabilities of the Symmetrix product line, EMC periodically releases revisions of the Symmetrix hardware and Enginuity Operating Environment. Therefore, some functions described in this guide may not be supported by all versions of Symmetrix hardware or Enginuity currently in use.
For the most up-to-date information on Symmetrix and Enginuity, refer to the “Symmetrix DMX-3, DMX-4 EMC Enginuity Release Notes”, located on EMC Powerlink.
If your Symmetrix DMX-3 does not function properly or does not function as described in this document, please contact your EMC representative.
Audience This manual is part of the Symmetrix DMX series documentation set,
and is intended for use by storage administrators, system programmers, or operators who are involved in acquiring, managing, or operating the Symmetrix system.
Related
documentation
Conventions used in
this guide
For additional information on all Symmetrix-related publications, contact your EMC Sales Representative or refer to the EMC Powerlink website at:
http://Powerlink.EMC.com
EMC uses the following conventions for notes, cautions, warnings, and danger notices.
Note: A note presents information that is important, but not hazard-related.
EMC Symmetrix DMX-3 Product Guide
21
Page 22
Preface
CAUTION
!
WARNING
DANGER
A caution contains information essential to avoid data loss or damage to the system or equipment. The caution may apply to hardware or software.
A warning contains information essential to avoid a hazard that can cause severe personal injury, death, or substantial property damage if you ignore the warning.
A danger notice contains information essential to avoid a hazard that will cause severe personal injury, death, or substantial property damage if you ignore the message.
This product guide contains no DANGER messages.
Typographical conventions
EMC uses the following type style conventions in this document:
Normal Used in running (nonprocedural) text for:
• Names of interface elements (such as names of windows, dialog boxes, buttons, fields, and menus)
• Names of resources, attributes, pools, Boolean expressions, buttons, DQL statements, keywords, clauses, environment variables, filenames, functions, utilities
• URLs, pathnames, filenames, directory names, computer names, links, groups, service keys, file systems, notifications
Bold: Used in running (nonprocedural) text for:
• Names of commands, daemons, options, programs, processes, services, applications, utilities, kernels, notifications, system call, man pages
Used in procedures for:
• Names of interface elements (such as names of windows, dialog boxes, buttons, fields, and menus)
• What user specifically selects, clicks, presses, or types
Italic: Used in all text (including procedures) for:
• Full titles of publications referenced in text
• Emphasis (for example a new term)
• Variables
22
EMC Symmetrix DMX-3 Product Guide
Page 23
Courier: Used for:
• System output, such as an error message or script
• URLs, complete paths, filenames, prompts, and syntax when shown outside of running text
Courier bold: Used for:
• Specific user input (such as commands)
Courier italic: Used in procedures for:
• Variables on command line
• User input variables
< >
[ ] | { } ...
Angle brackets enclose parameter or variable values supplied by the user
Square brackets enclose optional values
Vertical bar indicates alternate selections - the bar means “or”
Braces indicate content that you must specify (that is, x or y or z)
Ellipses indicate nonessential information omitted from the example
MVS type conventions
The syntax conventions used in this guide are:
Preface
CAPITALIZATION = must be typed
[ ] = optional entry
| = alternative parameter value
UNDERSCORED = default value or menu selection
Where to get help EMC support, product, and licensing information can be obtained as
follows. Product information — For documentation, release notes, software
updates, or for information about EMC products, licensing, and service, go to the EMC Powerlink website (registration required) at:
http://Powerlink.EMC.com
Technical support — For technical support, go to EMC Customer Service on Powerlink. To open a service request through Powerlink, you must have a valid support agreement. Please contact your EMC sales representative for details about obtaining a valid support agreement or to answer any questions about your account.
EMC Symmetrix DMX-3 Product Guide
23
Page 24
Preface
Your comments Your suggestions will help us continue to improve the accuracy,
organization, and overall quality of the user publications. Please send your opinion of this document to:
techpubscomments@eng.EMC.com
24
EMC Symmetrix DMX-3 Product Guide
Page 25
Invisible Body Tag
1
Introducing the
Symmetrix DMX-3
This chapter provides an overview of the Symmetrix DMX-3 and highlights the performance, availability and serviceability features, and hardware and software options:
Symmetrix DMX-3 ............................................................................. 26
Symmetrix platform and Enginuity operating environment ...... 29
Storage capacities and global memory requirements................... 31
Performance features......................................................................... 33
Availability and integrity features................................................... 35
Serviceability features ....................................................................... 37
Supported software applications..................................................... 38
Hardware options.............................................................................. 41

Introducing the Symmetrix DMX-3

25
Page 26
Introducing the Symmetrix DMX-3

Symmetrix DMX-3

The EMC® Symmetrix DMXTM systems are EMC’s family of high-end storage solutions. The DMX-3 model establishes a new performance and capacity trajectory for the highest of the high-end enterprise systems.
The DMX-3 offers 4 Gb/s front-end that provides increased performance without increasing power and cooling.
The DMX-3 fully leverages the EMC industry-leading storage management functionality and introduces the economic benefits of scalable packaging to the high-end storage market.
The Symmetrix
®
DMX-3 is incrementally scalable, supporting from 96 to 1,920 2 Gb/s high-performance Fibre Channel disk drives, providing a maximum raw capacity of approximately 1 PB.
Note: For information on 2,400 drive support, contact your EMC Sales Representative.
To support the massive scalability of DMX-3 configurations, the DMX architecture has been expanded and improved to deliver higher throughput (1 GB/s links) and increased I/O performance (four dual
1.3 GHz PPC processor complexes per director). Table 1 on page 26 describes some of the Symmetrix DMX-3 performance features.
26
Tabl e 1 Symmetrix DMX-3 performance features
DMX data paths 32–128 8 per I/O director, 16 per global memory director
DMX data bandwidth 32–128 GB/s
DMX message bandwidth 4.0–6.4 GB/s
PowerPC processors 84–130 Four dual 1.3 GHz processor complexes per director
Global memory 16–512 GB
Concurrent Memory transfers 8–32 4 per global memory director
a. 256 GB effective
EMC Symmetrix DMX-3 Product Guide
a
Available in 8, 16, 32, and 64 GB global memory directors
Page 27
Introducing the Symmetrix DMX-3
The field-proven Direct Matrix Architecture® (“Symmetrix DMX-3
architecture” on page 53) provides dedicated, nonblocking
interconnects between I/O directors and global memory regions. Combined with expanded global memory director technology and the dynamically optimized caching algorithms of the Enginuity
storage operating environment, systems based on the Symmetrix DMX architecture deliver scalable performance to meet the most demanding information access, protection, and distribution requirements.

Symmetrix DMX-3 configurations

The DMX-3 consists of a single system bay and from one to eight storage bays. The system bay contains the 24-slot card cage, service processor, power modules, and battery backup unit (BBU) assemblies. The storage bays contain disk drives and associated BBU modules. In a highly scalable component and cabinet configuration, the DMX-3 has the capacity, connectivity, and throughput to handle a wide range of high-end storage applications.
Figure 1 on page 27 provides a front view of the exterior of a
Symmetrix DMX-3 configured with one system bay and eight storage bays. Figure 2 on page 28 provides a front view of the exterior of a Symmetrix DMX-3 configured with one system bay and four storage bays. Figure 3 on page 28 provides a front view of the exterior of a Symmetrix DMX-3 configured with one system bay and one storage bay.
Chapter 2, “Symmetrix DMX-3 Hardware,” provides more complete
descriptions of the Symmetrix DMX-3.
Figure 1 Symmetrix DMX-3 nine-bay configuration
Symmetrix DMX-3
27
Page 28
Introducing the Symmetrix DMX-3
Figure 2 Symmetrix DMX-3 five-bay configuration
28
Figure 3 Symmetrix DMX-3 two-bay configuration
EMC Symmetrix DMX-3 Product Guide
Page 29
Introducing the Symmetrix DMX-3
Symmetrix hardware
EMC Solutions Enabler Applications Program Interface (API)
Symmetrix-based applications
Host-based Symmetrix applications
Independent software vendor applications
Enginuity operating environment functions

Symmetrix platform and Enginuity operating environment

The Symmetrix DMX hardware architecture (“Symmetrix DMX-3
architecture” on page 53) and the Enginuity
TM
operating environment are the foundation for the Symmetrix DMX system storage platform, which consists of the following:
Symmetrix DMX hardware
Enginuity-based operating functions
EMC Solutions Enabler Application Program Interfaces (APIs)
Symmetrix-based applications
Host-based Symmetrix applications
Independent Software Vendor (ISV) applications
Figure 4 on page 29 illustrates the relationships among these software
layers (and Symmetrix hardware).
Figure 4 Enginuity and the storage platform relationships

Enginuity operating environment

Symmetrix Enginuity is the operating environment for the Symmetrix DMX systems. Enginuity manages and ensures the optimal flow and integrity of information through the different hardware components of the Symmetrix system. Enginuity manages all Symmetrix operations from monitoring and optimizing internal data flow, to ensuring the fastest response to the user's requests for information, to protecting and replicating data.
Symmetrix platform and Enginuity operating environment
29
Page 30
Introducing the Symmetrix DMX-3
Enginuity services Enginuity provides the following services for the Symmetrix DMX
systems:
Independently manages system resources to intelligently
optimize performance across a wide range of I/O requirements.
Ensures system availability through advanced fault monitoring,
detection, and correction capabilities and provides concurrent maintenance and serviceability features.
Interrupts and prioritizes tasks from microprocessors and, for
example, ensures that fencing off failed areas takes precedence over other operations.
Offers the foundation for specific software features available
through EMC’s disaster recovery, business continuance, and storage management software.
Provides functional services for both Symmetrix-based
functionality and for a large suite of EMC storage application software.
Defines priority of each task including basic system maintenance,
I/O processing, application processing (for example, EMC ControlCenter
®
, SRDF®, TimeFinder®, and EMC
ControlCenter Symmetrix Optimizer).
Provides uniform access through APIs for internal calls and
provides an external interface to allow integration with other software providers and ISVs.

EMC Solutions Enabler APIs

30
EMC Symmetrix DMX-3 Product Guide
EMC Solutions Enabler APIs are the storage management programming interfaces that provide an access mechanism for managing the Symmetrix
third-party storage, switches, and host storage resources. They enable the creation of storage management applications that don’t have to understand the management details of each piece within the total storage environment.
Note: Contact your local EMC Sales Representative or the EMC Powerlink® website at: http://Powerlink.EMC.com for more information on EMC storage management APIs
Page 31
Introducing the Symmetrix DMX-3

Storage capacities and global memory requirements

This section describes the Symmetrix DMX-3 storage capacities and global memory requirements.

Storage capacities

Factors affecting storage capacity

The Symmetrix DMX-3 offers 73 GB, 146 GB, 300 GB, 450 GB, and 500 GB disk drives and can be configured with from 96 to 1,920 disk drives.
The capacities are based on storage capacity of each disk drive type and the following storage protection options:
Mirrored (RAID 1)
RAID 10, RAID 1/0
SRDF
RAID 5 (3+1) or RAID 5 (7+1)
RAID 6 (6+2) or RAID 6 (14+2)
Note: Appendix A, “Symmetrix DMX-3 Specifications,” contains additional
information on drive and system capacities.
The following factors affect disk storage capacity:
Drive capacity size
Type of data protection options used
Internal Symmetrix File System (SFS) usage — A Symmetrix
DMX-3 reserves two SFS logical volumes consisting of 6,140 cylinders each (slightly less than 6 GB). These volumes are protected using mirroring, consuming slightly less than 24 GB total physical space.
The size of the blocks — 512 or 520 bytes per block
Vault devices — S y m metrix DMX-3 uses vault devices for
vaulting data from global memory during a power-down operation. Vault devices require 5 GB of space. For each pair of disk directors in a DMX-3, 160 GB of total capacity is reserved for vaulting data from memory during system powerdown.
Note: “Configuration rules for vault devices” on page 68 and “Vaulting”
on page 170, contain more information on vaulting.
Storage capacities and global memory requirements
31
Page 32
Introducing the Symmetrix DMX-3

Global memory requirements

The Symmetrix DMX-3 is available with global memory capacity ranging from 16 GB to 512 GB (256 GB effective). The total global memory requirement for a Symmetrix DMX-3 is based upon specific system configurations and customer requirements. Besides the customer’s applications, other variables that affect the amount of global memory a Symmetrix DMX-3 requires include the following:
Number of global memory directors
Variable back-end disk director and front-end channel director
board configurations
Various loop configurations for disk drives
Number of disk drives
Disk capacity, including speed and protection type
Number of logical volumes
Your local EMC Sales Representative will assist you in determining your global memory requirements.
Note: “Global memory directors” on page 83 provides additional
information on memory configurations.
32
EMC Symmetrix DMX-3 Product Guide
Page 33

Performance features

Symmetrix DMX-3 offers improved performance over conventional Storage Control Unit (SCU) and Direct Access Storage Device (DASD) designs. Table 2 on page 33 identifies many of the Symmetrix DMX-3 and Enginuity supported features that enhance performance and increase throughput.
Tabl e 2 Performance features roadmap (1 of 2)
Feature Document sources
Introducing the Symmetrix DMX-3
Direct Matrix (DMX) Architecture with up to 128 direct nonblocking data paths and up to 128 GB/s aggregate internal bandwidth in the DMX-3
Symmetrix DMX-3 global memory directors for optimized performance
One hundred percent global memory fast write capabilities “Write operations” on page 110
PermaCache option “PermaCache option” on page 121
2 Gb/s Fibre Channel Drive Infrastructure “Fibre Channel disk subsystem” on page 62
• Multiple scalable channel directors, disk directors, and global memory directors
• ESCON channel speeds up to 17 MB/s
• FICON channel speeds up to 4 Gb/s
• Fibre Channel speeds up to 4 Gb/s
• iSCSI channel speeds up to 1 Gb/s
• Gigabit Ethernet (GigE) remote director speeds up to 1 Gb/s
• GigE IPv4/v6 (IPsec capable) channel speeds up to 1 Gb/s
• FICON Cascading and Open Systems Intermix Configurations
Logical volume capacities “Symmetrix DMX-3 logical volume capacities” on page 66
Hypervolume Extension option “Open systems hypervolumes” on page 127
Tiered storage optimization “Symmetrix Priority Controls” on page 136
a
“Symmetrix DMX-3” on page 26 and “Symmetrix DMX-3
architecture” on page 53
“Symmetrix DMX-3 and component scaling attributes” on
page 50
“DMX-3 point-to-point message matrix” on page 55
“Global memory performance features” on page 117
“Memory striping” on page 118
“Global memory directors” on page 83
“Global memory director configuration” on page 85
“Disk mirroring (RAID 1) concepts” on page 191
“Channel, disk, and global memory directors” on page 75
“ESCON channel directors” on page 79
“FICON channel director” on page 80
“Fibre Channel directors (front-end)” on page 77
“iSCSI channel directors” on page 82
“Gigabit Ethernet (GigE) remote directors” on page 81
“GigE IPv4/v6 (IPsec capable) director” on page 82
“Symmetrix FICON configurations” on page 94
“Mainframe systems hypervolumes” on page 132
“Dynamic Cache Partitioning” on page 137
Virtual LUNs “Virtual LUN technology” on page 140
ControlCenter “EMC ControlCenter family of products” on page 150
TimeFinder “TimeFinder family of products” on page 154
Performance features
33
Page 34
Introducing the Symmetrix DMX-3
Tabl e 2 Performance features roadmap (2 of 2)
Feature Document sources
Dynamic host addressing “Dynamic Host Addressing” on page 145
Virtual Provisioning “Virtual Provisioning” on page 146
Tab based Caching (TBC) “Tag Based Caching (TBC)” on page 119
3380 and 3390 mixed-track geometry “IBM CKD DASD disk emulation” on page 71
Compatible Parallel Access Volumes (COM-PAVs) “Parallel Access Volumes” on page 231
Compatible HyperPAV “Compatible HyperPAV” on page 231
Dynamic Parallel Access Volumes “Dynamic Parallel Access Volumes” on page 231
PPRC Command Support “IBM MetroMirror (PPRC)” on page 235
a. Contact your local EMC Sales Representative for currently supported host channel connectivity.
34
EMC Symmetrix DMX-3 Product Guide
Page 35
Introducing the Symmetrix DMX-3

Availability and integrity features

The Symmetrix DMX-3 includes key enhancements that improve the reliability, availability, and serviceability. Table 3 on page 35 highlights many of the Symmetrix DMX-3 availability and integrity features.
Tabl e 3 Availability and integrity features roadmap (1 of 2)
Feature Document sources
Proactive Error Detection and Remote Support “Maintaining data integrity” on page 175
“Error Checking and Correction, and data integrity protection”
on page 176
“Disk error correction and error verification” on page 177
“Global memory director data integrity logic” on page 178
Support for online Enginuity upgrades and updates “Nondisruptive Enginuity upgrades” on page 173
Fully fault-tolerant design with redundant critical components and concurrent maintenance support
Channel director redundancy with end-to-end automatic channel failover and load balancing
Internal Control Data Path redundancy “Internal control data path redundancy” on page 164
Fibre Channel back-end functionality featuring redundant disk directors, disk channels, and disk ports
Dual-initiator disk directors “Dual-initiator feature” on page 168
2N power supply redundancy “Redundant power subsystem” on page 169
Vaulting “Configuration rules for vault devices” on page 68
Redundant Global Memory “Redundant global memory” on page 162
Advanced Communications and Environmental Control Modules
DMX-3 security features “Symmetrix Service Credential, Secured by RSA” on page 182
“Reliability and availability features” on page 162
“Channel director redundancy” on page 163
“Fibre Channel back-end redundancy” on page 164
“Fibre Channel arbitrated loop design” on page 165
“Vaulting” on page 170
“DMX-3 communications and environmental control” on
page 89
“Symmetrix Audit Log” on page 185
“RSA enVision log security” on page 185
“EMC Certified Data Erasure for Symmetrix Disks” on
page 186
“IPsec security features” on page 187
Symmetrix Mirroring option “Disk mirroring (RAID 1) concepts” on page 191
Availability and integrity features
35
Page 36
Introducing the Symmetrix DMX-3
Tabl e 3 Availability and integrity features roadmap (2 of 2)
Feature Document sources
RAID 5 (3+1), RAID 5 (7+1) RAID 6 (6+2), RAID 6 (14+2) RAID 10 data protection options
“Symmetrix DMX RAID 5” on page 198
“Symmetrix DMX RAID 6” on page 206
“Symmetrix RAID 10 for mainframe systems” on page 196
Sparing option “Dynamic sparing” on page 216
“Permanent sparing” on page 213
SRDF “Base SRDF family products” on page 221
“SRDF family options” on page 222
• Nondisruptive component replacement
• Nondisruptive change or remove drives
“Nondisruptive component replacement” on page 172
“Nondisruptively change or remove FBA devices” on page 174
36
EMC Symmetrix DMX-3 Product Guide
Page 37

Serviceability features

Each Symmetrix DMX-3 has an integrated service processor that continuously monitors the Symmetrix environment. The service processor communicates with the EMC Customer Support Center through a customer-supplied direct phone line. The service processor automatically dials the Customer Support Center whenever the Symmetrix system detects a component failure or environmental violation. An EMC Product Support Engineer at the Customer Support Center can also run diagnostics remotely through the service processor to determine the source of a problem and potentially resolve it before the problem becomes critical. Within the DMX-3 control e-net matrix is the Communications and Environmental Control Module, known as the XCM. The XCM provide the low-level system-wide communications for running application software, monitoring, and system diagnostics from the service processor.
Symmetrix DMX systems feature an incrementally scalable design with a low parts count for quick component replacement, should a failure occur. This low parts count minimizes the number of failure points.
The Symmetrix DMX systems feature nondisruptive replacement of its major components, which can be replaced while the Symmetrix system is powered on, including:
Channel directors
Disk directors
Global memory directors
Disk adapters
Channel adapters
Disk drives
Power supplies
Power Distribution Units (PDU)
Power Distribution Panels (PDP)
Power supply/ cooling module for drive enclosure
Battery backup modules
Cooling fan modules
Communications and Environmental Control (XCM) modules
Service processor components:
Introducing the Symmetrix DMX-3
• Keyboard
• Video Display and Mouse
Note: Chapter 2, “Symmetrix DMX-3 Hardware” and “Nondisruptive
component replacement” on page 172 provide more information on these
components.
Serviceability features
37
Page 38
Introducing the Symmetrix DMX-3

Supported software applications

Enginuity is what enables simultaneous connection to virtually all mainframe, UNIX, Windows, iSeries, and Linux platforms—and all validated in EMC’s interoperability labs. The result: you can do whatever you want with your information. Centralize it. Re-purpose it. Consolidate it. Replicate it. Share it. Distribute and manage it. Put it to work where it’s relevant, anytime without compromise.
Enginuity is the solid foundation of EMC’s storage software offering—and the driving force behind the operational consistency and nondisruptive features across Symmetrix.
The software offerings are divided into these categories:
“Tiered Storage Optimization” on page 38
“Storage management” on page 39
“Symmetrix local and remote replication software solutions” on
page 39
“Information mobility” on page 40

Tiered Storage Optimization

38
EMC Symmetrix DMX-3 Product Guide
Note: Product information on these software options are available on the EMC Powerlink website at:
http://Powerlink.EMC.com
All of the software products are furnished under a license. Refer to the copyright page in this product guide for the complete licensing statement. For software license, model numbers, prerequisites, and additional information, contact your local EMC Sales Representative.
EMC delivered two software products with the latest version of Enginuity (5772) that optimize performance with multi-tiered Symmetrix systems. Dynamic Cache Partitioning provides dedicated memory resource allocation. Symmetrix Priority Controls help manage multiple application workloads by setting priority levels for device groups, allowing higher-priority applications to have faster response times than lower priority applications.
Note: “Tiered Storage Optimization” on page 136 contains related
information.
Page 39
Introducing the Symmetrix DMX-3

Storage management

Symmetrix local and remote replication software solutions

Storage Management Console is an intuitive, browser-based GUI for Symmetrix device management for open systems as well as z/OS-attached systems. Symmetrix Management Console features management and monitoring of local and remote replication, as well as the tiered storage optimization tools Symmetrix Priority Controls and Dynamic Cache Partitioning.
The EMC ControlCenter family of storage management software, provides automated management of your multi-vendor networked storage environment through a single, consistent, information-centric approach.
EMC z/OS Storage Manager (EzSM) is a mainframe software product providing discovery and viewing of your Symmetrix environment. EzSM provides facilities to handle volumes, data sets, catalogs, and detailed Symmetrix functionality information.
Note: See “EMC ControlCenter family of products” on page 150 for related information.
The EMC TimeFinder and SRDF families of software are the most powerful suites of local and remote storage replication solutions available in the industry; enabling business continuance volumes for parallel processing activities like backup, testing and development, and local restore, as well as remotely replicated copies to guard against primary site disasters and outages.
Note: “TimeFinder family of products” on page 154 contains related
information. “Base SRDF family products” on page 221 and “SRDF family
options” on page 222 contains related information.
Supported software applications
39
Page 40
Introducing the Symmetrix DMX-3

Information mobility

Copy and move data to where it provides the most value. Symmetrix DMX enables online data mobility and migration while minimizing complexity and disruption. Move data between storage tiers, platforms, and sites quickly, efficiently, and without disruption:
EMC Open Migrator/LM — Provides host-based, nondisruptive
data migration/data mobility at the volume level for Microsoft Windows and UNIX servers.
EMC Open Replicator for Symmetrix — Enables remote
point-in-time copies to be used for high-speed data mobility, remote vaulting, migrations, and distribution between EMC Symmetrix DMX and qualified storage systems with full or incremental copy capabilities.
SRDF/Data Mobility (DM) — Enables rapid transfer of data from
source volumes to remote volumes anywhere in the world.
Note: Product information on these software options are available on the EMC Powerlink website at:
http://Powerlink.EMC.com
Note: “Base SRDF family products” on page 221 and “SRDF family options”
on page 222 contain related information.
40
EMC Symmetrix DMX-3 Product Guide
Page 41

Hardware options

Titan Titan
SYM-001247
Storage Bay (Mohawk)
SYMMETRIX
EMC
2
PS1 P
S2 P
S3
PS4
PS5
PS6
PS7
PS8
System Bay (Titan)
EMC
2
Introducing the Symmetrix DMX-3
The following hardware options are offered with the DMX-3 systems:
DMX-3 Silencer
DMX-3 Systems Securing Kits

DMX-3 Silencer

The Symmetrix DMX-3 Silencer as shown in Figure 5 on page 41 is a fan noise reduction option for the Symmetrix DMX-3 system bay and storage bay systems. The Symmetrix DMX-3 Silencer is designed with leading edge sound reducing materials that attenuate high-frequency noise components and reduce overall sound levels. It is designed not to affect airflow or thermal performance.
Figure 5 DMX-3 Silencer
Hardware options
41
Page 42
Introducing the Symmetrix DMX-3
Tabl e 4 DMX-3 Silencer kits model information
Table 4 on page 42 provides the DMX-3 Silencer kits model
information.
Model Number Description Comments
TB24-Silencer System bay silencer kit 1 kit per bay
SB-Silencer Storage bay silencer kit 1 kit per bay
The DMX-3 Silencer kit contains the following components:
DMX-3 Silencer for top of system bay and or storage bay
Full length foam piece for the storage bay
An 11-in. by 20-in. foam piece for the system bay
Note: Contact your EMC Sales Representative for Silencer kit information and current availability.

DMX-3 Silencer specifications

Tabl e 5 DMX-3 Silencer physical specifications
DMX-3 silencer for system bay Dimensions
DMX-3 silencer for storage bay Dimensions
Table 5 on page 42 lists the dimensions and weight for the DMX-3
Silencer for the system bay and storage bay.
Height Width Depth
Weight Pounds
Height Width Depth
Weight Pounds
Table 47 on page 267 lists the sound power and sound pressure levels
for the DMX-3 system bay and storage bays.
Inches
8.25 23
36.5
10
Inches
6.5 29
36.5
9.4
Centimeters
20.96
58.42
92.71
Kilograms
4.54
Centimeters
16.51
73.66
92.71
Kilograms
4.26
42
EMC Symmetrix DMX-3 Product Guide
Page 43
Introducing the Symmetrix DMX-3

DMX-3 systems securing kits

Some customers require that their EMC equipment be installed to withstand significant shock and vibration. Installation of EMC Symmetrix DMX-3 systems securing kits in combination with adequate substrate construction, will mitigate collateral damage during such events.
The kits contain heavy brackets plus hardware used to attach the brackets to the frames of the system and storage bays. The brackets are attached to the floor using bolts that engage the flooring substructure provided by the user.
Symmetrix DMX-3 systems securing kits can be installed to system and storage bays without lifting the bays.
Note: Please refer to the EMC Symmetrix DMX-3 Physical Planning Guide for information regarding the EMC securing kits, or contact your EMC Sales Representative for specific information.
Hardware options
43
Page 44
Introducing the Symmetrix DMX-3
44
EMC Symmetrix DMX-3 Product Guide
Page 45
Invisible Body Tag
2
Symmetrix DMX-3
Hardware
This chapter describes the main hardware components of the Symmetrix DMX-3 including:
Major components ............................................................................. 46
Symmetrix DMX-3 architecture....................................................... 53
Symmetrix channel connectivity and host integration................. 59
Fibre Channel disk subsystem ......................................................... 62
Channel, disk, and global memory directors................................. 75
Symmetrix DMX-3 power subsystems ........................................... 86
DMX-3 communications and environmental control................... 89
Channel attachments ......................................................................... 92

Symmetrix DMX-3 Hardware

45
Page 46
Symmetrix DMX-3 Hardware
WARNING

Major components

The Symmetrix DMX-3 is a disk array subsystem that is composed of a system bay and from one to eight storage bays. This section describes the Symmetrix DMX-3 components.
Tabl e 6 Symmetrix DMX-3 model component overview
Symmetrix DMX-3 components Component information location
Main component locations of the system bay, front and rear views Figure 6 on page 47
Main component descriptions of the system bay Table 7 on page 48
Main component locations of the storage bay, front and rear views Figure 7 on page 49
Main component descriptions of the storage bay Table 8 on page 50
To reduce the risk of personal injury, do not open the doors or move the Symmetrix DMX-3 unless you are qualified and familiar with safety procedures for electrical equipment and the Symmetrix DMX-3. The Symmetrix DMX-3 contains no user-serviceable parts. Neither the system bay nor the storage bays should not be moved or opened for any reason by untrained persons. If the Symmetrix DMX-3 is in need of relocation or repair, only qualified personnel should access components inside the bays or move them.
46
EMC Symmetrix DMX-3 Product Guide
Page 47
PS1 PS2 PS3 PS4 PS5 PS6 PS7 PS8
LAN1
LAN2
PS8 PS7 PS6 PS5 PS4 PS3 PS2 PS1
ON
I
OFF
O
ON
I
OFF
O
ON
I
OFF
O
ON
I
OFF O
ON
I
OFF O
ON
I
OFF O
Fans Fans
Power supplies
*KVM
UPS
*Server
SYM-000978
Power zone B left side
Power zone A
right side
Disk directors,
Channel directors,
and Global memory
directors in 24-Slot
card cage
**Battery backup unit
assemblies
**Battery backup unit
modules
Disk adapters, Channel adapters,
and Environmental and communication
modules (XCM)
Power distribution panels
Power distribution
units
System bay front System bay rear
* The service processor consists of the KVM and the server. ** The battery backup unit assembly consists of two battery backup unit modules.
Symmetrix DMX-3 Hardware
Figure 6 Symmetrix DMX-3 system bay (interior view, front and rear)
Major components
47
Page 48
Symmetrix DMX-3 Hardware
Tabl e 7 Symmetrix DMX-3 system bay component overview
Component Description
Cooling fan modules Three 3-fan modules maintain air circulation and cool the unit internally.
Card cage and midplane The front 24 slots contain global memory directors, disk directors, and channel directors (front-end
Fibre Channel, ESCON, FICON, and iSCSI channel directors
a
, or GigE Remote directors). The rear slots contain the channel host adapters, GigE Remote adapters, disk adapters, and the Communications and Environmental Control Modules (XCMs).
Channel directors/adapters and remote director adapters (front-end)
a
Up to 12 channel directors connect to the front side of the midplane and the adapters to the rear side of the midplane in the system cabinet. Each channel director’s adapter provides the interface to the host or network.
Fibre Channel Disk Directors/Adapters (Back-End)
Two, four, six or eight disk directors connect to the midplane in the front of the cabinet. Each disk director’s adapter provides the interface to the Fibre Channel disk drives. The adapter connects to the opposite side of the midplane in the rear of the cabinet.
Global memory directors Two, four, six, or eight global memory directors provide up to 512 GB (256 GB effective) total global
memory, available in 8 GB, 16 GB, 32 GB, and 64 GB global memory director capacities.
Communications and environmental control module (XCM)
Two communications and environmental control modules (XCMs) connect to the midplane in the rear card cage. The XCM contains the Ethernet interface between the directors (channel, disk, and memory) and the service processor. It monitors and logs environmental events for all Symmetrix DMX-3 FRUs (field replacable units) and reports any operational problems such as thermal excursion, voltage drop, etc. It also has connectors for paths between the XCM and the BBU modules (in the system bay and the storage bays) for sending commands and receiving status.
Power supplies Up to eight power supplies support the system bay and are split between two (A and B) three-phase
power zones. Each zone supports up to four power supplies. One zone can maintain power for the entire system bay independent of the power supplies in the other zone. The DMX-3 is available in three-phase Delta or three-phase WYE configurations.
Power distribution panel (PDP), power distribution unit (PDU), and AC connectors
Two PDPs, one for each zone, provide a centralized cabinet interface and distribution control of the AC power input lines when connected to the system bay PDUs. The PDPs contain the manual On/Off power switches, which are accessible through the rear door. The PDUs, one for each power zone, provide the main interface between the input AC from the PDPs and the various components contained within the system bay.
Battery backup unit (BBU) assembly consisting of two BBU modules
Service processor (keyboard, video display, and mouse - KVM), server, and uninterruptible power supply (UPS)
Up to eight BBU modules provide backup for each of the power supplies. If AC power fails, the BBU modules can maintain power for two 5-minute periods of AC loss while the Symmetrix system shuts down.
The service processor consists of a KVM and a server that connects to the Symmetrix subsystem through an Ethernet interface. The service processor uses an external modem for communicating with the EMC Customer Support Center when the Symmetrix system detects an error condition. The service processor is used to download the Symmetrix system configuration to the directors and provides diagnostic and maintenance utilities for the Symmetrix system. The server battery backup is provided by a UPS.
a. Contact your local EMC Sales Representative for current channel director availability.
48
EMC Symmetrix DMX-3 Product Guide
Page 49
Symmetrix DMX-3 Hardware
Battery backup
unit (BBU) modules
Disk drives,
15 per drive
enclosure
Drive enclosure
covers
BBU assembly
cover
Storage bay front
Storage bay rear
! !
EXP PRI
EXP PRI
EXP PRI
EXP PRI
#
#
!
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
! !
! !
! !
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
OFF O
I ON
OFF O
I ON
OFF O
I ON
! !
! !
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
! !
! !
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
! !
! !
! !
BBU modules
OFF O
I ON
OFF O
I ON
Power supply/ System cooling
OFF O
I
modules
ON
Power distribution units (PDUs)
Link control cards (LCCs)
Power distribution panels (PDPs)
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
! !
Power zone B left side
Power zone A
right side
Figure 7 Symmetrix DMX-3 storage bay (interior view, front and rear)
Major components
SYM-000977
49
Page 50
Symmetrix DMX-3 Hardware
Table 8 Symmetrix DMX-3 storage bay component overview
Component Description
Drive enclosures The Symmetrix DMX-3 storage bay is configured with capacities of 120 or 240 disk drives. Each
drive enclosure includes the following components:
• Redundant power and cooling modules for disk drives
• Two Link Control Cards (LCC)
• From 4 to 15 Fibre Channel disk drives per drive enclosure The storage bays can be populated with any combination of DMX disk drives (73 GB, 146 GB, and
300 GB 10,000 rpm drives; 73 GB, 146 GB, and 300 GB, and 450 GB 15,000 rpm drives; and 500 GB 7,200 rpm drives) Some configuration restrictions may apply.
Battery backup unit (BBU) modules
Power distribution panel (PDP), Power distribution unit (PDU), and AC connectors
Two BBU modules are required for four drive enclosures (up to eight BBU modules support up to 16 drive enclosures in one storage bay). The BBU modules provide backup power to the drive enclosures.
Two PDPs, one for each zone, provide a centralized cabinet interface and distribution control of the AC power input lines when connected to the storage bay PDUs. The PDPs contain the manual On/Off power switches, which are accessible through the rear door. The PDUs, one for each power zone, provide the main interface between the input AC from the PDPs and the BBU modules to the drive enclosures contained within the storage bay.

Symmetrix DMX-3 and component scaling attributes

The Symmetrix DMX-3 base configurations are composed of a system bay and independent storage bays, that have common configuration guidelines. Any DMX-3 base configuration accommodates the later addition (upgrade) of capacity through the on-line addition of drives, drive enclosures, if required, and additional storage bays that support up to 1,920 2 Gb/s or 4 Gb/s disk drives. The Direct Matrix
infrastructure accommodates nondisruptive addition of disk directors (increasing from two to eight disk directors) enabling increased capacity when needed.
The DMX-3 consists of a system bay and from one to eight storage bays. The DMX-3 system bay has from two to eight disk directors, up to 12 channel directors (combined director total 16), and two, four, six, or eight global memory directors. The system bay also contains up to eight power supplies, each of which has a dedicated 2.2 kW BBU.
Table 9 on pa ge 51 describes the available DMX-3 configurations.
50
EMC Symmetrix DMX-3 Product Guide
Page 51
Symmetrix DMX-3 Hardware
Tabl e 9 DMX-3 configurations
Number of disk directors 2 disk directors 4 disk directors 6 disk directors 8 disk directors
Drive channels 8 162432
Minimum and maximum
number of disk drives 96–240 192–960 360–1,440 480–1,920
Minimum and maximum
TB capacity (raw)
Maximum TB capacity
(protected)
a
b
7.04–119.90 14.08–479.62 26.40–719.43 35.21–959.54
102 301 435 525.1
Maximum global memory
(usable) 64 GB 144 GB 216 GB 256 GB
Usable connectivity
d
48 x 4 Gb/s Fibre
Channel
64 x 4 Gb/s Fibre
Channel
64 x 4 Gb/s Fibre
Channel
64 x 4 Gb/s Fibre
24 x 4 Gb/s FICON 48 x 4 Gb/s FICON 40 x 4 Gb/s FICON 32 x 4 Gb/s FICON
48 ESCON 64 ESCON 64 ESCON 64 ESCON
8 x 1 Gb/s Ethernet
remote replication
24 x 1 Gb/s Gigabit
Ethernet iSCSI
a. Minimum raw capacity for a DMX-3 is based on 73 GB disk drives and maximum capacity is based on 500 GB disk drives.
b. Maximum protected capacity for a DMX-3 is based on RAID 5 (7+1) data protection configurations, allowance for vault devices, and
Symmetrix file system (SFS) requirements.
c. Based 1,920 500 GB drives.
d. Combinations may be limited or restricted.

DMX-3 configuration rules and guidelines

The following are some of the system configuration rules and guidelines to consider when planning your new or upgrading your DMX-3:
8 x 1 Gb/s Ethernet
remote replication
48 x 1 Gb/s Gigabit
Ethernet iSCSI
8 x 1 Gb/s Ethernet
remote replication
40 x 1 Gb/s Gigabit
Ethernet iSCSI
8 x 1 Gb/s Ethernet
remote replication
32 x 1 Gb/s Gigabit
Ethernet iSCSI
c
Channel
All bays must be configured in an inline installation. Each bay is
bolted to the adjacent bays during installation.
Storage bays can be populated with any combination of 73 GB,
146 GB and 300 GB 10,000 rpm drives, 73 GB, 146 GB, 300 GB, 450 GB 15,000 rpm drives, and 500 GB 7,200 rpm drives. Some restrictions may apply.
A minimum of four (4) disk drives must be configured in each
drive enclosure.
Major components
51
Page 52
Symmetrix DMX-3 Hardware
While all drives (different capacities or different speeds) can be
intermixed in Symmetrix DMX-3 systems, locations on disk director pairs and drive loops may affect application performance. Consult your Symmetrix representative for guidelines on optimal configuration of mixed drive sizes and speeds.
5 GB on the first 4 drives of every drive loop (160 GB per disk
director pair) is reserved for memory vaulting.
The first four disk drives on each drive loop in the direct-attached
storage bay support the memory vault devices.
24 GB of total capacity is reserved for internal Symmetrix File
System (SFS) use.
Symmetrix systems support various data protection methods:
• RAID 1 — Mirrored pairs of two hypervolumes
• RAID 1/0 — Mirroring and striping for open system environments
• RAID 10 — Data striped across four mirrored pairs of hypervolumes for mainframe environments
• RAID 5 (3+1) or RAID 5 (7+1) — Data striped on four or eight hypervolumes with rotating parity
• RAID 6 (6+2) or RAID 6 (14+2) — Data striped on eight or sixteen hypervolumes with rotating parity
• SRDF — Data mirrored to another Symmetrix
• Dynamic sparing — Increases data availability by copying the data on a failing volume to a spare volume until the original device is replaced
• Permanent sparing — Replaces a faulty drive automatically from a list of available spares residing in the Symmetrix system without CE involvement on site
52
Note: Chapter 5, “Data Integrity, Availability, and Protection,” provides
more information and configuration rules regarding the above data protection options.
Consider details of space, power and installation requirements as
well as planning for future system expansion. Appendix C
“Planning and Installation,” and the EMC Symmetrix DMX-3
Physical Planning Guide provide details on these topics.
EMC Symmetrix DMX-3 Product Guide
Page 53

Symmetrix DMX-3 architecture

The Symmetrix DMX-3 features a high-performance, Direct Matrix Architecture (DMX) supporting up to 128 point-to-point serial connections within the DMX system.
Symmetrix DMX technology is distributed across all channel directors, disk directors, and global memory directors in Symmetrix DMX systems. Enhanced global memory technology supports multiple regions and 16 connections on each global memory director. In the Direct Matrix Architecture, contention is minimized because control information and commands are transferred across a separate and dedicated message matrix. The major components of Symmetrix DMX architecture are the front-end channel directors (and their interface adapters), global memory directors, and back-end disk directors (and their interface adapters).
The matrix midplane provides configuration flexibility through the slot configuration. Each director slot port is hard-wired point-to-point to one port on each global memory director board.
This section includes the following topics:
Symmetrix DMX-3 Hardware

DMX-3 block diagram

“DMX-3 block diagram” on page 53
“DMX-3 configuration rules and guidelines” on page 51
“DMX-3 point-to-point message matrix” on page 55
“DMX-3 slot configuration” on page 57
In a fully configured Symmetrix DMX-3, each of the eight director ports on the sixteen directors connects to one of the 16 memory ports on each of the eight global memory directors. These 128 individual point-to-point connections facilitate up to 128 concurrent global memory operations in the system. Figure 8 on page 54 illustrates the point-to-point architecture and the interconnection of the major components of the Symmetrix DMX-3 systems.
Symmetrix DMX-3 architecture
53
Page 54
Symmetrix DMX-3 Hardware
Battery backup
unit odules
Cooling
ESCON Director
ESCON Host Atta c h
Direct
Matrix
Direct
Matrix
FC Director
FC Host Atta c h
Direct
Matrix
Direct
Matrix
MultiP r otocol C D
Direct
Matrix
Direct
Matrix
MultiP r otocol C D
FICON , GigE , iSCS I
Direct
Matrix
Direct
Matrix
MultiP r otocol C D
FICON , GigE , iSCS I
Direct
Matrix
Direct
Matrix
MultiP r otocol C D
FICON , GigE , iSCS I
Direct
Matrix
Direct
Matrix
FC Director
FC Host Atta c h
Direct
Matrix
Direct
Matrix
ESCON Director
ESCON Host Atta c h
Direct
Matrix
Direct
Matrix
Cntl
FC (Ba c k-End )
Symmetrix
FC disk d e vice s
Direct
Matrix
Direct
Matrix
Cntl
FC (Ba c k-End )
Symmetrix
FC Disk D e vice s
Direct
Matrix
Direct
Matrix
Cntl
FC (BE or FE)
Symmetrix
FC disk devices*
Direct
Matrix
Direct
Matrix
Cntl
FC (BE or FE)
Symmetrix
FC disk devices*
Direct
Matrix
Direct
Matrix
Cntl
FC (BE or FE)
Symmetrix
FC disk d e vices *
Direct
Matrix
Direct
Matrix
Cntl
FC (BE or FE)
Symmetrix
FC disk d e vices *
Direct
Matrix
Direct
Matrix
Cntl
FC (Ba c k-End )
Symmetrix
FC disk d e vice s
Direct
Matrix
Direct
Matrix
Cntl
FC (Ba c k-End )
Symmetrix
FC disk d e vice s
Direct
Matrix
Direct
Matrix
Cntl
Cntl Cntl Cntl Cntl Cntl Cntl Cntl
Cont r ol and comm unications signal s
Cont r ol and comm unications signal s
32 GB
Global
memor y
32 GB
Global
memor y
32 GB
Global
memor y
32 GB
Global
memor y
32 GB
Global
memor y
32 GB
Global
memor y
32 GB
Global
memor y
32 GB
Global
memor y
E n vironmenta l
control and
status ignals
(XCM)
*Note : The DMX-4 system suppor ts Fibre Channel , FICON , ESCON , and iSCSI connections as well as GigE , Fibre Channel , and ESCON remote connections .
The DMX-4 system midplane has f our slots that suppo r t either f r ont-end c hannel directo r s or ba c k-end disk directo r s .
E n vironmenta l
control and
status signals
(XCM)
FICON , GigE , iSCS I
Power supplies
Service
processor
(KVM & server)
UPS
Modem
Figure 8 Symmetrix DMX-3 block diagram
54
EMC Symmetrix DMX-3 Product Guide
Page 55
Symmetrix DMX-3 Hardware

DMX-3 point-to-point message matrix

Symmetrix DMX systems feature a point-to-point interconnect technology for its separate matrix fabrics, which have been implemented for both data plane functions and control plane functions. This Symmetrix DMX message matrix provides high bandwidth and low latency control plane communication, which manages the data movement through the Symmetrix system.
Figure 9 on page 56 is a simplified view of the Symmetrix DMX
message matrix. The message fabric is made up of several fabric elements, or FE, connected together so that all end nodes are connected to a unique port on the outer edge of the message fabric. The end nodes are commonly referred to as the Message Engine or ME. The ME is an integral part of the CPU controller and allows the front-end and back-end processors to communicate with each other through the message fabric.
The message fabric is managed by a fabric manager, which provides initialization for the fabric elements, real-time monitoring, and diagnostic functions. The fabric manager is assigned to any one of the director processors and communicates to the fabric through special in-band fabric management packets.
Symmetrix DMX-3 architecture
55
Page 56
Symmetrix DMX-3 Hardware
Message
fabric
FE FE
XCM0
FE
FE
FE
FE
XCM1
FE
FE
FE
FE
FE
A B C D
FE
A B C D
Front-end
hannel director
Back-end
disk director
Back-end
disk director
Front-end
cdannel Director
Fabric
Manager
Figure 9 Symmetrix DMX-3 message fabric

DMX-3 midplane slot configuration

The front of the Symmetrix DMX-3 card cage midplane contains the channel directors, disk directors, and global memory directors. The rear card cage midplane contains the adapters, and the Communications and Environmental Control Module (XCM) pair.
56
EMC Symmetrix DMX-3 Product Guide
Page 57
Symmetrix DMX-3 Hardware
Dir
T ype
BE
Dir
T ype
FE
Dir
T ype
BE
Dir
T
ype
FE
Dir
ype
FE
Dir
T
ype
BE
Dir
T T ype
FE
or
Dir
Ty pe Type Type
BE
Dir
T T ype
BE
Dir
FE
Dir
ype
BE
Dir Dir
Dir
BE
M0
M1
M7 M6 M5 M4 M3
M2
FE*
or
FE*
or or FE* FE*
BE FE
1 8 7 6 5 4 3 2
9
16 13
12 11 10
Dir
Type
14
Dir
Type
15
SYM-000085
FE
Type
FE
Ty pe
Global memory directors
M0 through M7
Director pairs
Global memory Director pairs
*Note: These slots (Directors 5, 6, 11, and 12) in the midplane can be configured with either front-end or back-end directors.
The Symmetrix DMX systems require certain board types to occupy particular slot locations within the card cage. Adhering to the configurations stated for each model type ensures that the physical routing of the serial signals minimizes contention for memory resources, maximizes bandwidth within the system, and maintains total redundancy to the same memory location through two completely different hardware paths. Termination of TTL and GTLP signals occurs at the adapters in the end slot locations.

DMX-3 slot configuration

The Symmetrix DMX-3 midplane provides eight slots in the center of the midplane reserved for global memory directors and the remaining 16 slots are reserved for channel directors and disk directors (eight to the left and eight to the right of memory). Figure 10
on page 57 shows the card cage layout for the global memory
directors, the Front-End (FE) and Back-End (BE) designations for the Fibre Channel directors, and the FE designations for the ESCON directors, FICON directors, iSCSI, or GigE Remote directors.
Figure 10 Symmetrix DMX-3 card cage configurations (front)
Symmetrix DMX-3 architecture
57
Page 58
Symmetrix DMX-3 Hardware
Adapter pairs
SYM-000078
Adp
16
Type
BE
Adp
15
Type
BE
Adp
14
Ty pe
FE
Adp
13
Type
FE
Adp
12
Ty pe
BE
or
FE*
Adp
11
Type
BE
or
FE*
Adp
6
Type
BE
or
FE*
Adp
5
Type
BE
or
FE*
Adp
10
Type
FE
Adp
9
Type
FE
Adp
8
Type
FE
Adp
7
Type
FE
Adp
4
Ty pe
FE
Adp
3
Type
FE
Adp
2
Type
BE
Adp
1
Type
BE
XCM
1
XCM
0
Type
FE
Type
FE
*Note: These slots (Ad
apters 12, 11, 6, and 5) in the midplane can be configured with either front-end or back-end apapters.
On the rear side of the midplane Figure 11 on page 58, the adapters reside behind their respective directors, and two slots behind the memory are reserved for the XCM pair.
58
Figure 11 Symmetrix DMX-3 card cage configurations (rear)
EMC Symmetrix DMX-3 Product Guide
Page 59
Symmetrix DMX-3 Hardware

Symmetrix channel connectivity and host integration

The Symmetrix DMX-3 can be integrated with all major enterprise hosts and servers. This section outlines the emulations and hosts Symmetrix systems support through Fibre Channel, iSCSI, ESCON, FICON, or GigE (SRDF) interfaces.
Note: For the most current information on Symmetrix systems and specific host integration, contact your local EMC Sales Representative, or refer to the EMC Powerlink website.

Channel connectivity

Open systems
connectivity
Mainframe systems
connectivity
IBM iSeries Fibre
Channel connectivity
The Symmetrix DMX-3 supports connectivity to mainframe and open systems hosts.
Note: The Symmetrix Enterprise Storage Platform (ESP) software enabler, a software option, is required if you plan to store and access mainframe and open systems data on the same Symmetrix system. For more information on the ESP option, contact your local EMC Sales Representative.
The Symmetrix DMX-3 connects to Fibre Channel and iSCSI open system host interfaces such as UNIX, Windows, Linux, and iSeries systems.
Note: Contact your local EMC Sales Representative for availability of iSeries host connectivity.
The Symmetrix DMX-3 supports ESCON and FICON host connectivity to mainframe systems.
With the Symmetrix Fibre Channel adapter, users are able to connect Symmetrix systems through fibre to the iSeries 270 and 8xx models. When using directly connected fibre devices (point-to-point) the maximum distance is 500 m.
The DMX-3 systems support Fibre Channel connectivity to iSeries systems. Fibre Channel is currently capable of running up to 2 Gbs/s full duplex with iSeries systems.
Note: For information on disk drives supported for iSeries systems, contact your EMC Sales Representative.
Symmetrix channel connectivity and host integration
59
Page 60
Symmetrix DMX-3 Hardware

Symmetrix channel configurations

Supported Fibre Channel interfaces

Supported cluster hosts

EMC offers the following Symmetrix DMX-3 channel directors:
Eight-port ESCON directors
Eight-port Fibre Channel directors
Multiprotocol Channel Director (MPCD) that supports:
• FICON host connections
• iSCSI host connections
• GigE SRDF connections
• GigE IPv4/v6 (IPsec capable) connections
• Fibre Channel connections
Table 17 on page 77 describes DMX-3 channel director configurations.
The Symmetrix DMX systems Fibre Channel interfaces attach to most open systems and iSeries hosts that have Fibre Channel connectivity.
Note: Consult your local EMC Sales Representative for the most current list of supported hosts, models, operating systems, and EMC open systems host support policies, or refer to the EMC Powerlink website.
For the most recent information on supported cluster hosts, refer to the EMC Powerlink website.

Mainframe serial channel interfaces

60
EMC Symmetrix DMX-3 Product Guide
Symmetrix serial channel interfaces attach to IBM S/370, S/390 (ES/9000, 309X, 308X, 43XX, and 9370), the plug-compatible manufacturer (PCM) equivalent, Amdahl, Unisys, Bull, and Siemens.
Note: “Channel attachments” on page 92 contains a more detailed discussion
of channel attachment options.
Table 10 on page 61 shows the IBM DASD models and controllers
that Symmetrix systems emulate.
Page 61
Tabl e 1 0 IBM controller/DASD compatibility
IBM controller
IBM DASD 3990-6 2105 2107
a
3380
3390-1 X X X
3390-2 X X X
3390-3 X X X
3390-9 X X X
3390-27 X X
3390-54 X X
a. Contact your local EMC Sales Representative for information on 3380 support.
XXX
Symmetrix DMX-3 Hardware

Supported mainframe operating systems

In IBM/PCM mainframe environments, the Symmetrix DMX system is operating-system independent. The memory processing algorithms are self-managed, and the Symmetrix system does not depend on host cache commands to benefit from read and write caching.
Almost every S/370 and z/OS operating system can be supported, including:
TPF AIX/ESA MVS/ESA MVS/SP MVS/XA
MVT/VSE VM/ESA VM/HPO VM/SP VM/XA
VSE/ESA VSE/SP z/OS z/OS.e z/VM
Symmetrix DMX systems also support the following mainframe operating systems:
GC0S7 GCOS8 LINUX for z/Series MSP OS/1100
PICK TPF
a. Contact your local EMC Sales Representative for availability of TPF support.
a
UTS
Symmetrix channel connectivity and host integration
61
Page 62
Symmetrix DMX-3 Hardware

Fibre Channel disk subsystem

The Symmetrix DMX-3 disk subsystem are contained in the storage bays. They are fully redundant components and can be replaced nondisruptively. The disk subsystems consist of the following components:
Disk drives — One-inch low-profile 2 Gb/s Fibre Channel disk
drives available in 73 GB, 146 GB, 300 GB, 450 GB, and 500 GB sizes. A fully populated drive enclosure holds 15 disk drives and 16 drive enclosures per storage bay.
Two link control cards (Fibre Channel interface cards).
Two power supply/cooling modules.
The drive enclosure supports 2 Gb/s back-end fibre interface (FC-AL). The dual-loop configuration provides redundancy, port bypass capability, and disk access up to 2 Gb/s per loop.

Disk drives

The Symmetrix DMX-3 uses industry-standard 2 Gb/s Fibre Channel disk drives for physical disk drives. The disk drives are installed in the front of storage bays and connect to a midplane. Each disk drive is integrated with a dual-port Fibre Channel Arbitrated Loop (FC-AL) controller with Fibre Channel interface that transports SCSI protocol. The Symmetrix DMX-3 supports Fibre Channel loops ranging from 15 drives to 60 drives per loop. Table 11 on page 63 lists the features for each type of Symmetrix DMX-3 disk drive.
62
EMC Symmetrix DMX-3 Product Guide
Page 63
Symmetrix DMX-3 Hardware
Tabl e 1 1 Symmetrix DMX-3 disk drive features
Disk capacity and rotational speed
Interface
73 GB
10 K / 15 rpm
146 GB
10 K / 15 K rpm
2 Gb/s FC 2 Gb/s FC 2 Gb/s FC 2 / 4 Gb/s FC 2 Gb/s FC
maximum data transfers per port
Internal data rate megabits per
b
second
Average access time (read/write)
a
ms
Device-level data
470–944/685–1,142 470–944/685–1,142 470/944 1.95 Gb/s (max) 470/944
4.7–5.4/3.5–4.0 4.7–5.4/4.7–5.4 4.7/5.4 3.4–4.1 8.5/9.5
16 MB 32 MB 32 MB 16 MB 32 MB
buffer
a. Contact your EMC Sales Representative for the latest drive specifications.
b. These specifications are subject to change.

Link control cards (LCC)

The link control card’s main function is to provide services to the drive enclosure, which includes the capability to control functionality and monitor environmental status. Each drive enclosure has two LCCs. The LCC performs the following functions:
Individual Fibre Channel disk poweron and poweroff functions
Loop configuration control
Failover control
Marker LED control
Individual disk port control
Drive presence detection
Reporting of temperature and voltage status information
RS-232 monitoring of the BBU modules that support the
components in the storage bay
300 GB
10 K / 15K rpm
a
450 GB
15K
500 GB
7.2 K rpm

Power supply/ cooling module

Two power supply/cooling modules provide all necessary power and cooling to the 15 disk drives in the disk enclosure in an N+1 configuration.
Fibre Channel disk subsystem
63
Page 64
Symmetrix DMX-3 Hardware

Symmetrix DMX disk drive capacities

Precise storage capacity values depend on:
Whether the user configures the disk to emulate an open systems
device or a mainframe 3390 device.
Whether the user calculates a gigabyte to equal:
• 1,000 * 1,000 * 1,000 bytes
• or 1,024 * 1,024 * 1,024 bytes
The number of logical volumes configured on the disk.
Data protection option used: (RAID 1, RAID 5 (3+1), RAID 5
(7+1), RAID 6 (6+2), RAID 6 (14+2), RAID 10, RAID 1/0, and SRDF).
Table 12 on page 65 shows the available Symmetrix cylinders and
storage capacities for 73 GB, 146 GB, 300 GB, 450 GB, and 500 GB disk drives based on the open systems, mainframe, and iSeries emulations. When calculating total system capacity, the following must also be included: 24 GB of total capacity is reserved for internal Symmetrix File System use. From 160 to 640 GB of total capacity is reserved for vaulting data from memory during system power down. Each DMX-3 system requires a minimum of two global spare drives and one additional global spare drive for every 100 disk drives or a portion thereof. For example, a DMX-3 with 547 disk drives requires 2 + 6= 8 global spare drives.
64
EMC Symmetrix DMX-3 Product Guide
Page 65
Symmetrix DMX-3 Hardware
The GB values shown in Table 12 on page 65 are based on the following conventions: The GB 1024 bytes. The GB
value is based on 1 GB = 1000 * 1000 * 1000
10
value is based on 1 GB = 1024 *1024 *
2
bytes. Although the open systems GB values are expressed differently, they are equivalent.
a
450 GB
15K
500 GB
7.2K
Disk size and speed (rpm)
Tabl e 1 2 Symmetrix DMX-3 disk drive capacities
73 GB
10K or 15K
146 GB
10K or 15K
300 GB
10K or 15K
Raw Capacity 73.41 GB 146.82 GB 300 GB 450.00 500 GB
10
449.643 GB
10
499.6 GB
Formatted capacity (open systems in GB
) 73.34 GB
10
146.69 GB
10
10
299.76 GB
Formatted capacity (open systems in GB2) 68.30 GB
136.62 GB
2
2
279.17 GB
2
418.763 GB
2
465.29 GB
Cylinders (open systems) 74,611 149,227 304,932 457,764 508,626
Formatted capacity (mainframe systems, 3380 emulation)
a
69.88 GB
139.77 GB
10
10
285.60 GB
10
443.87 GB
10
476.00 GB
Cylinders (mainframe systems, 3380 emulation)
a
98,134 196,269 401,052 601,578 668,420
Formatted capacity (mainframe systems, 3390 emulation)
72.40 GB
144.81 GB
10
10
295.91 GB
10
443.87 GB
10
493.19 GB
Cylinders (mainframe systems, 3390 emulation)
85,189 170,379 348,150 522,225 580,251
10
2
10
10
Formatted capacity
72.82 GB
145.66 GB
10
10
292.46 GB
10
438.702 GB
10
(iSeries emulation)
a. Contact your local EMC Sales Representative for information on 3380 emulations, disk drives, and data protection methods.
Fibre Channel disk subsystem
N/A
65
Page 66
Symmetrix DMX-3 Hardware

Symmetrix DMX-3 logical volume capacities

The maximum number of logical volumes supported on Symmetrix DMX-3 physical disk drives depends on the data protection used.
Table 13 on page 66 describes the logical volumes supported on
Symmetrix DMX disk drives.
Tabl e 1 3 Logical volumes supported on Symmetrix DMX-3 disk drives
Symmetrix DMX-3 disk drives and data protection
Logical volumes per disk drive with SRDF Protection (without local data protection) 160
Logical volumes per disk drive with RAID 1 Protection 173
Logical volumes per disk drive with RAID 5 (3+1) Protection 255
Logical volumes per disk drive with RAID 5 (7+1) Protection 255
Logical volumes per disk drive with RAID 6 (6+2) Protection 255
Logical volumes per disk drive with RAID 6 (14+2) Protection 255
Logical volumes per disk drive with RAID 10 Protection (mainframe data volumes only) 255
a. For information on Symmetrix DMX-3 data protection options, refer to Table 28 on page 189.
Note: “Open systems hypervolumes” on page 127 or “Mainframe systems
hypervolumes” on page 132 contain more information on logical volumes.
Configuration requirements for Symmetrix systems vary according to the applications used. To configure logical volumes for optimum Symmetrix system performance, consult your local EMC Sales Representative.
a
Maximum logical volumes
66
The Symmetrix DMX-3 can support up to 64,000 logical volumes, depending on the number of disk directors, the type of data protection, and hardware configuration. Table 14 on page 67 describes the maximum logical volumes supported on DMX-3 systems by the number of drives, DA boards, and type of data protection employed.
Note: “Logical volumes supported for DMX-3 systems” on page 67 shows
the maximum logical volumes available for the Symmetrix DMX-3 with the number of disk drives stated and a homogeneous protection scheme on those disk drives. The logical volume limit is a function of the number of disk directors, disk drives, Enginuity level, and data protection type. Consult your local EMC Sales Representative for currently supported logical volumes for DMX-3 systems.
EMC Symmetrix DMX-3 Product Guide
Page 67
Symmetrix DMX-3 Hardware
Maximum number
of disk drives
Tabl e 1 4 Logical volumes supported for DMX-3 systems
Number of DA
boards
Data protection Maximum logical volumes per system
1,920 8 SRDF 64,000
1,920 8 RAID 1 64,000
1,920 8 RAID 5 (3+1) 64,000
1,920 8 RAID 5 (7+1) 32,768
1,920 8 RAID 6 (6+2) 30,720
1,920 8 RAID 6 (14+2) 15,360
1,920 8 RAID 10 16,000
1,440 6 SRDF 64,000
1,440 6 RAID 1 64,000
1,440 6 RAID 5 (3+1) 49,152
1,440 6 RAID 5 (7+1) 24,576
1,440 6 RAID 6 (6+2) 23,040
1,440 6 RAID 6 (14+2) 11,520
1,440 6 RAID 10 16,000
960 4 SRDF 64,000
960 4 RAID 1 64,000
960 4 RAID 5 (3+1) 32,768
960 4 RAID 5 (7+1) 16,384
960 4
960 4
960 4
240 2
240 2
240 2
240 2
240 2
240 2
240 2
RAID 6 (6+2)
RAID 6 (14+2)
RAID 10
SRDF
RAID 1
RAID 5 (3+1)
RAID 5 (7+1)
RAID 6 (6+2)
RAID 6 (14+2)
RAID 10
15,360
7,680
16,000
20,760
20,760
15,300
7,650
3,840
1,920
7,650
Fibre Channel disk subsystem
67
Page 68
Symmetrix DMX-3 Hardware

Configuration rules for vault devices

Vault devices are volumes on designated physical disk drives that reserve a dedicated 5 GB space for vaulting data including metadata. The following configuration rules apply to the vaulting drives and disk directors:
Each disk director pair requires 32 such dedicated devices for a
total of 160 GB of vault space per disk director pair.
The vault devices can only use single-mirror data protection and
cannot be configured with TimeFinder/Snap, virtual, or dynamic spare devices.
Vault drives are eligible for permanent sparing if there is a valid
spare on the same port. The vault device cannot be moved to a different loop, but it can be moved to a different location on the same loop. “Permanent sparing” on page 213 contains additional information
The drive pool, virtual devices, or drive devices cannot reside in
the 5 GB of vault space. However, they can reside on the same physical disk drive as the vault devices but not within the vault devices.
The distribution of the vault devices across the disk directors, the
back-end interfaces, and the physical disks should be such that a full vault will be possible within the time frame dictated by the capacity of the battery (up to five minutes).
The total capacity of all of the vault hypervolumes in the system
will be at least sufficient to keep two logical copies of the persistent part of global memory.

Symmetrix DMX disk drive emulations

68
EMC Symmetrix DMX-3 Product Guide
Symmetrix DMX systems support connectivity to mainframe systems and open systems hosts. When the Symmetrix DMX systems are configured to open systems hosts such as UNIX, Windows, Linux, or iSeries the Symmetrix disk drives emulate standard disk drives. When the Symmetrix DMX systems are configured to IBM z/OS/PCM system hosts, the Symmetrix disk drives emulate IBM CKD DASD.
Note: The Symmetrix Enterprise Storage Platform (ESP) software enabler, a software option, is required if you plan to store and access mainframe and open systems data on the same Symmetrix system.
Page 69
Symmetrix DMX-3 Hardware

Deleting (and then adding) devices online

Open system disk emulation

FBA data and
command format
Enginuity supports removing and then adding devices online, which facilitates the following configuration enhancements:
Change Device Emulation Online Remove a CKD volume and
add an FBA volume.
Convert between mirrored and RAID protected volumes.
The optimal order is to delete devices and then add. If done in the
reverse order, unnecessary global memory will be allocated for the deleted devices.
When attempting to add or delete devices, or change protection
type of devices, a new minimum cache value will be calculated. In rare cases this new value could prohibit the changes until additional memory is added to the system.
On open systems hosts, the Symmetrix DMX logical disk volumes appear as standard SCSI disk drives with data stored in Fixed Block Architecture (FBA) format. All host logical volume manager software can be used with Symmetrix disk volumes. The following paragraphs describe the FBA disk format and logical volume structure.
Fixed Block Architecture (FBA) disk drives store data in fixed-sized blocks (typically 512 bytes). A disk drive using FBA format is viewed as a large array of blocks. The physical position of each block (cylinder and track) is usually not significant to the host. When requesting disk access for read or write, the host addresses a file by the logical block address (LBA) of the starting block and a count of the total blocks used by the file. Symmetrix channel directors and disk directors control access to global memory and disk drives, responding to host requests as a standard disk drive.
Logical volume
structure (open
systems)
Note: Disk drives in Symmetrix DMX systems attached to iSeries hosts are configured in 520-byte blocks.
The channel directors interact with global memory. Therefore, there is no physical meaning to cylinders, tracks, and heads on the Symmetrix logical volume from the front-end point of view. However, Symmetrix systems use a logical geometry definition for their logical volume structure. This geometry is reflected in the mode sense data available to the host.
Fibre Channel disk subsystem
69
Page 70
Symmetrix DMX-3 Hardware
Symmetrix systems use the following logical volume structure:
Each logical volume has n cylinders
Each cylinder has 15 tracks (heads)
Each track has 128 blocks of 512 bytes
Therefore, a Symmetrix logical volume with n cylinders has a usable block capacity of:
n * 15 * 128 n for each volume is defined during Symmetrix configuration.
To calculate the size of the logical volume: Number of cylinders * heads * blocks * 512
(n * 15 * 128* 512)
Note: “Open systems hypervolumes” on page 127 provides information on
configuring open systems logical volumes.
Flexible device
geometry
(for Sun Solaris hosts)
Flexible device geometry improves interoperability when migrating data between DMX-3 or DMX-4 and older Symmetrix systems. When the Symmetrix DMX-3 was introduced, the disk geometry presented to the host by the disk array changed. The number of sectors per track was doubled to 128, which also led to a doubling of the cylinder size. In the Sun Solaris operating system, disk geometry, disk size, manufacturer ID, and the partition table are stored in the label in sector 0 of the disk. The label is written to the disk using the format utility, which makes a device usable to the OS. When a Solaris device is opened for I/O activity, the label is written to host cache and the SCSI driver uses the partition information to translate relative partition addresses to device absolute logical block addresses.
The difference between disk geometries will not cause issues in most scenarios. However, there are three pieces of information contained in the disk label that, if modified, can cause a new label to be written by the operating system. If disk geometry, manufacturer ID, or the size of the disk drive change, format will write a new label if “auto configure” is run from the format> type menu, followed by label.
When a device is migrated to a DMX-4 or DMX-3 using a product that produces a track-by-track copy of the source device on the target device (SRDF, RecoverPoint, or Open Replicator for example), the entire device is migrated including the VTOC label. When this occurs between devices with heterogeneous disk geometries, there will be a difference between the disk geometry written in the label on the target (which was copied from the source) and the disk geometry that
70
EMC Symmetrix DMX-3 Product Guide
Page 71
Symmetrix DMX-3 Hardware
is presented to the target host by the DMX-4 or DMX-3. If the device is re-labeled, there may be potential issues with data availability.
This is because Solaris reserves two cylinders from every device for use by the operating system. DMX-4 and DMX-3 cylinders are twice as large as cylinders from previous generation Symmetrix disk arrays, meaning that the operating system will overwrite the last 1920 sectors of the user data area with an area reserved for operating system use. It should be noted that, regardless of a difference in geometry between the label and the actual disk, no issue will be seen if the disk is not re-labeled by the user. This potential issue has been resolved with the introduction of Flexible Device Geometry.
To alleviate any potential for corruption, two features have been added to Symmetrix Enginuity. A bin file setting has been included that allows the DMX-3 and DMX-4 to present an external device geometry for all Symmetrix devices that is identical to the device geometry of earlier Symmetrix arrays. Functionality has also been added to Enginuity that allows alternate disk geometry to be presented on a device by device basis.
Note: Contact your EMC Customer Engineer to determine if this feature should be enabled on your Symmetrix DMX system.

IBM CKD DASD disk emulation

The Symmetrix DMX system appears to mainframe operating systems as a 3990-6, 2105, or 2107 controller. The physical disk drives can appear to the mainframe operating system as a mix of multiple 3390 and 3380 device types. All standard models of the 3380 or 3390 volumes can be emulated up to the physical volume sizes installed.
Fibre Channel disk subsystem
71
Page 72
Symmetrix DMX-3 Hardware
A single Symmetrix system can simultaneously support both 3380 and 3390 device emulations. Table 15 on page 72 lists the Symmetrix characteristics for some standard IBM device emulation modes. Symmetrix systems also support nonstandard device sizes, as long as the cylinder count does not exceed that of the equivalent IBM device type.
Contact your EMC Sales Representative for 3380 support.
Note: Appendix A “Symmetrix DMX-3 Specifications,”contains more IBM
DASD emulation characteristics.
Tabl e 1 5 IBM DASD emulation characteristics
IBM DASD model MB/volume Bytes/track Bytes/cylinder Cylinders/volume
a
3390-54
3390-27 27,844 56,664 849,960 32,760
3390-9 8,514 56,664 849,960 10,017
3390-3 2,838 56,664 849,960 3,339
3390-2 1,892 56,664 849,960 2,226
55,688 56,664 849,960 65,520
72
3390-1 946 56,664 849,960 1,113
a
3380K
a. Contact your local EMC Sales Representative for currently supported IBM Controller/DASD emulation modes and 3380 support.
Mixed track
geometries
1,891 47,476 712,140 2,655
You can configure a Symmetrix DMX system with both 3380 and 3390 track geometries on the same disk device (3380 and 3390 devices cannot be defined in the same SSID or LCU). A single disk device can contain up to 255 logical volumes, depending on the data protection used.
Note: “Mainframe systems hypervolumes” on page 132 contains
information on configuring mainframe logical volumes.
IBM/PCM data and
command formats
All Symmetrix systems support the count-key-data (CKD) and extended count-key-data (ECKD) format used by IBM 3390 and 3380 DASD. For a full description of the channel command words (CCW) supported, refer to the IBM 3390 Storage Control Reference. Figure 12
on page 73 shows the CKD track format emulated for 3390 and 3380
DASD.
EMC Symmetrix DMX-3 Product Guide
Page 73
Symmetrix DMX-3 Hardware
Index
marker
R0
Magnetic
disk
Figure 12 Track format for 3390 DASD
HA D
KC
Track format
All tracks are written with formatted records. The start and end of each track are defined by the index marker. Each track has the same basic format as that shown in Figure 12 on page 73. That is, it has an index marker, home address (HA), record zero (R0), and one or more data records (R1 through Rn). These track formats are discussed in the following sections.
Information is recorded on all Symmetrix disk drives in an emulation format chosen at configuration. Each track contains certain nondata information (such as the address of the track, the address of each record, the length of each record, and the gaps between each area), and data information.
Index marker — An index marker indicates the physical beginning and end of each track for each disk drive (Figure 12 on page 73).
Index
marker
R1
KCD
Home address (HA) — There is one home address on each track that defines the physical location of the track by specifying the track address (cylinder and head location) and the condition of the track (flag byte). The flag byte indicates whether the track is usable, defective, or an alternate track.
Record zero–r0 (track descriptor record) — This is the first record after the home address. The Count field indicates its physical location (cylinder and head), record number, key length, and data length. In general, the key length is zero bytes and the data length is eight.
Data records (R1 through Rn)All remaining records on a track are data records. The Count field indicates the data record's physical location (cylinder and head), record number, key length, and data length. The key is optional and, when used, contains information used by an application. The data area contains the user data. To determine the number of records a track can hold, refer to the IBM
3390 Direct Access Storage Introduction or IBM 3380 Direct Access Storage Introduction for the equations for calculating this number.
Fibre Channel disk subsystem
73
Page 74
Symmetrix DMX-3 Hardware
Track capacity Track capacity is the maximum capacity achievable when there is one
physical data record per track formatted without a key. Because the track can contain multiple data records, additional Address Markers, Count Areas, and gaps reduce the number of bytes available for data.
The track capacity is the number of bytes left for data records after subtracting the bytes needed for the home address, record zero, address marker, count area, cyclic check (for error correction), and the gaps for one data record.
For 3390 emulations, the track capacity is 56,664 bytes. For 3380 emulations, the track capacity is 47,476 bytes.
74
EMC Symmetrix DMX-3 Product Guide
Page 75

Channel, disk, and global memory directors

This section describes the Symmetrix DMX-3 directors. The channel directors and global memory directors manage the storage control functions. The disk directors handle the data storage functions.
Symmetrix DMX-3 Hardware

Channel director connectivity

The Symmetrix DMX-3 provides channel connectivity through combinations of mainframe systems and open systems channel directors. These include:
Fibre Channel directors (also used with SRDF)
ESCON directors
ESCON directors used for SRDF, data migration, and the SDMS
(Symmetrix Data Migration Service) application
Multiprotocol Channel Directors (MPCD) available with these
channel connection combinations:
• Fibre Channel
•FICON
•iSCSI
• GigE (Gigabit Ethernet) remote directors used for SRDF
• GigE IPv4/v6 (IPsec capable) directors
Note: The Symmetrix DMX-3 supports mixed ESCON, FICON, Fibre Channel, and iSCSI interfaces when the required Symmetrix ESP software is installed on the Symmetrix system. Contact your local EMC Sales Representative for currently supported host connectivity.
The Symmetrix DMX-3 supports open systems hosts such as UNIX systems, Linux systems, and Windows connectivity through Symmetrix Fibre Channel or iSCSI directors. (iSeries connectivity is only supported through Fibre Channel directors.) The Symmetrix DMX-3 supports mainframe connectivity through ESCON and FICON directors. The Symmetrix DMX-3 connects directly to host processors through physical channel attachments. Table 16 on
page 76 describes the protocols that are supported by the Symmetrix
DMX-3 channel directors.
Channel, disk, and global memory directors
75
Page 76
Symmetrix DMX-3 Hardware
Tabl e 1 6 Supported protocols and Symmetrix DMX-3 channel directors
Protocol
4 Gb/s Fibre Channel host/SAN ports 2-64 1-8 per Fibre Channel Director
2 Gb/s Fibre Channel remote replication ports 2-8 1-4 per Fibre Channel Director
1 Gb/s iSCSI ports 2-32 1-4 per Multiprotocol Channel Director
1 Gb/s GigE remote replication ports 2-8 1-4 per Multiprotocol Channel Director
1 Gb/s GigE IPv4/v6 (IPsec capable) 2-8 1-4 per Multiprotocol Channel Director
4 Gb/s FICON host ports 2-32 1-4 per Multiprotocol Channel Director
ESCON host ports 2-80 1-8 per ESCON Channel Director
ESCON remote replication ports 2-8 1-4 per ESCON Channel Director
a. Contact your local EMC Sales Representative for ESCON channel director and GigE Remote support availability.
b. Usable ports are per qualified channel directors.
a
Usable system ports
b
Ports per channel director

Channel director descriptions

Symmetrix DMX-3 channel directors are single boards that occupy one slot on the Symmetrix midplane. All channel directors interface to host channels through interface adapter cards connected to the opposite side of the midplane. The Symmetrix DMX-3 supports up to 12 channel directors.
Note: Appendix C “Planning and Installation,”provides information on
mainframe and open systems channel director configurations. Contact your local EMC Sales Representative for specific supported configurations.
All channel directors contain four high performance processor complexes. The channel directors process data from the host and manage access to global memory over a direct matrix (DMX) technology (Figure 8 on page 54). Each channel director on the Symmetrix DMX-3 supports eight internal links to global memory. DMX technology is used across the Symmetrix system, as it is also designed into each global memory director. In addition to DMX technology, each director includes support for a separate message matrix for the transfer of control information.
Note: “DMX-3 point-to-point message matrix” on page 55 and
“DMX-3 communications and environmental control” on page 89
provide information on the Symmetrix DMX message matrix.
Table 17 on page 77 describes the DMX-3 channel director models.
76
EMC Symmetrix DMX-3 Product Guide
Page 77
Symmetrix DMX-3 Hardware
Tabl e 1 7 Symmetrix DMX-3 channel director models and descriptions
Fibre
Description
Model number
DMX3-80000B 8-port Fibre Channel (FC) Director (8 MM ports) 8
DMX3-71000B 8-port Fibre Channel Director (7 MM /1 SM port) 7 1
DMX3-62000B 8-port Fibre Channel Director (6 MM/2 SM ports) 6 2
DMX3-00004B 4-port FICON Channel Director (4 SM ports) 4
DMX3-00040B 4-port FICON Channel Director (4 MM ports) 4
DMX3-00103B 4-port MPCD
DMX3-00400 4-port GigE or iSCSI Channel Director (4 MM ports) 4
DMX3-ESCD8 8-port ESCON DIR (8 MM ports) N/A N/A N/A N/A N/A
DMX3-40002B 6-port MPCD (4 FC MM. port/2 FICON SM ports) 4 2
DMX3-40200B 6-port MPCD (4 FC MM. ports/2 GigE or iSCSI MM ports) 4 2
DMX3-60100B 7-port MPCD (6 FC MM. ports/1 GigE or iSCSI MM ports) 6 1
DMX3-00103BS 4-port MPCD (1 GigE IPv4/v6 (IPsec capable) MM port/ 3 FICON SM
ports)
DMX3-00400S 4-port GigE or iSCSI Channel Director (4 GigE IPv4/v6
(IPsec capable) MM ports)
DMX3-40200BS 6-port MPCD (4 FC MM ports/ 2 GigE IPv4/v6 (IPsec capable) MM
ports)
DMX3-60100BS 7-port MPCD (6 FC MM ports/ 1 GigE IPv4/v6 (IPsec capable) MM
port)
a. Contact your local EMC Sales Representative for currently supported host channel directors and GigE remote directors.
b. MM = multimode. SM = single-mode.
c. MPCD = Multiprotocol Channel Director.
c
(1 GigE or iSCSI MM port/3 FICON SM ports) 1 3
a
Channel
b
GigE FICON
MM SM MM MM SM
13
4
42
61

Fibre Channel directors (front-end)

The Fibre Channel front-end director has eight FC ANSI compliant, 4 Gb/s (also configurable to 2 Gb/s, and 1 Gb/s) Fibre Channel interfaces for connection to host systems. The director has eight high-speed paths to global memory. The Fibre Channel director interfaces to the host channels through an eight-port Fibre Channel interface adapter and is available in single-mode and multimode configurations (Table 17 on page 77). Each Symmetrix DMX Fibre Channel director supports eight internal links to global memory. Data transfers between host and global memory can execute concurrently across all Fibre Channel ports on a director. Table 18 on page 78 lists
Channel, disk, and global memory directors
77
Page 78
Symmetrix DMX-3 Hardware
Tabl e 1 8 Symmetrix devices and addressing capabilities
Maximum Symmetrix devices and device addresses
Symmetrix devices per processor complex 4,096
Symmetrix devices per Fibre Channel director 16,384
Addresses range per port 0–4,095 (0x000–0xFFF)
a. Each Fibre Channel front-end director has four processor complexes.
the Fibre Channel front-end support capabilities for directors, their Symmetrix devices, and their addressing.
for Fibre Channel front-end directors
Maximum Symmetrix devices per front-end
Fibre Channel processor complex
Note: The numerical values for Symmetrix devices stated in Table 18 on
page 78 are the maximum allowed according to the architectural limits of the
microcode running on the Fibre Channel front-end director. The actual limits allowed for customer environments will be lower and are dependent on the host type, HBA and driver type/version, and overall system implementation. Also, note that using metadevices will reduce the number of host-visible volumes for a given number of devices (Symmetrix Devices) configured to the Fibre Channel front-end director; that is, each member of the metadevice will be counted to the allowed limit of devices configured to a Fibre Channel front-end director the EMC Powerlink website.
. For information on Fibre Channel host attachments, go to
a

Fibre Channel adapters (front-end)

Fibre Channel
directors for SRDF
iSeries Fibre Channel
Connectivity
78
EMC Symmetrix DMX-3 Product Guide
The Symmetrix DMX-3 can support up to eight qualified Fibre Channel directors. Contact your local EMC Sales Representative for specific supported configurations.
The Symmetrix DMX-3 Fibre Channel adapters provide the connectivity between the host channels and the Fibre Channel front-end director through optical transceiver connections.
Note: Symmetrix Fibre Channel directors currently support connections to a number of hosts supporting Fibre Channel connectivity. For a current list of supported hosts, go to the EMC Powerlink website.
The Fibre Channel host director can be Enginuity-configured as the link between Symmetrix units in a Symmetrix Remote Data Facility (SRDF) configuration. The Fibre Channel director interfaces to Symmetrix channels through the Fibre Channel interface adapter.
The Symmetrix Fibre Channel Adapters, through fibre, connect to the iSeries 270 and 8xx models. When using directly connected fibre devices (point-to-point) the maximum distance is 500 m in 1 Gb/s mode.
Page 79
Symmetrix DMX-3 Hardware

ESCON channel directors

The Symmetrix DMX-3 ESCON director has eight ESCON channel interfaces for connection to host systems and eight high-speed paths to global memory. The ESCON channel director interfaces to the host channels through an eight-port ESCON channel interface adapter and supports data transfer rates up to 17 MB/s per port.
The Symmetrix ESCON director can support up to 1,024 logical paths per port when only the A port of the A and B ports of the processor is configured and up to 512 logical paths per port when both the A and B ports are configured.
Note: Contact your local EMC Sales Representative for ESCON channel director availability.
The Symmetrix DMX-3 may support 2 to 10 ESCON channel directors. Table 19 on page 79 describes the ESCON channel configurations supported in the DMX-3.
Tabl e 1 9 ESCON director configurations
A and B port enabled A port enabled
Maximum LCU (logical control units) per port 16 (00 to 0F) 16 (00 to 0F)
Maximum LCUs per Symmetrix system 250 250
Maximum devices per LCU 256 256
Maximum logical paths per port 512 1,024
Maximum logical paths per LCU per port 32 64
Maximum DMX channel addresses per one or two ports 2,048 + 2,048 2,048
Maximum DMX channel addresses per Symmetrix system consisting of up to 64,000 base devices (physical devices) with up to 255 aliases (logical devices)
Maximum concurrent I/O host connections per Symmetrix DMX system
a. The maximum concurrent I/O connections is based on 10 ESCON directors. Contact your local EMC Sales Representative for specific
supported configurations.
a
64,000 64,000
80 40
SDMS support The Symmetrix ESCON director supports the SDMS (Symmetrix
Data Migration Service) application for migrating data over ESCON channels from one Symmetrix system to ESCON channels on another Symmetrix system.
Channel, disk, and global memory directors
79
Page 80
Symmetrix DMX-3 Hardware

Multiprotocol Channel Directors

FICON channel director

The Symmetrix DMX-3 Multiprotocol Channel Director (MPCD), through mezzanine card technology, supports Fibre Channel, GigE, GigE IPv4/v6 (IPsec capable), iSCSI, and FICON protocols on Symmetrix DMX systems.
The MPCD implements a flexible mezzanine card that delivers highly configurable support for FICON channels to mainframe systems, Fibre Channel connections to open systems configurations, or Gigabit Ethernet support for iSCSI, or SRDF over IP connections.
Note: Contact your local EMC Sales Representative for currently supported protocols. Table 17 on page 77 describes the supported Multiprotocol models.
FICON channel directors support native mode point-to-point connections and FICON native mode switched point-to-point connections to IBM 9672, G5/G6, z/900, and z/990 systems running z/OS, z/VM, VM/ESA, and VSE/ESA operating systems. FICON employs ESCON protocols that have been mapped to the FC-4 upper-level protocol layer of the Fibre Channel architecture. FICON supports multiple concurrent I/O connections, channel program multiplexing, and better link utilization than ESCON path switching. FICON allows the consolidation of multiple ESCON channels into one FICON channel.
The FICON mezzanine card provides up to four single-mode or multimode LC bidirectional (full duplex) connections. Symmetrix FICON channels transfer data at speeds up to 4 Gb/s.
80
Note: “Symmetrix FICON configurations” on page 94 contains information
on additional configuration options.
The Symmetrix DMX FICON design auto-detects 4 Gb/s, 2 Gb/s or 1 GB/s at switch or channel port login time.
The Symmetrix DMX-3 system may support up to eight FICON channel directors. Table 20 on page 81 describes the FICON channel director configurations supported in the DMX-3.
EMC Symmetrix DMX-3 Product Guide
Page 81
Symmetrix DMX-3 Hardware
Tabl e 2 0 FICON director configurations
Maximum LCUs (logical control units) per port 64 (00 to FE)
Maximum LCUs per Symmetrix system 250
Maximum devices per LCU 256
Maximum logical paths per port 8,192
Maximum logical paths per LCU per port 128
Maximum DMX channel addresses per port 8,192
Maximum DMX channel addresses per Symmetrix system, base and alias 64,000
Maximum I/O host connections per Symmetrix DMX system
a. The maximum I/O connections are based on 8 FICON directors for the DMX-3. Contact your local EMC Sales Representative for specific
supported configurations.
a
32

Gigabit Ethernet (GigE) remote directors

GigE remote mezzanine cards on the MPCD enable remote director functionality based upon Gigabit Ethernet technology that enable direct Symmetrix-to-IP network attachment and eliminate the need for expensive media converter appliances.
GigE support for SRDF on Symmetrix DMX systems:
Increases the options for Symmetrix-to-Symmetrix connectivity.
Allows the Symmetrix system to connect to your existing
Ethernet infrastructure and directly access high-speed data transmission conduits using Internet Protocol (IP).
Supports SRDF traffic to one or more remote Symmetrix systems
that also have GigE remote directors installed.
Supports TCP/IP protocols and function layers.
Is fully compatible with the SRDF protocols and other Symmetrix
DMX directors, drives, software, and protection schemes.
Symmetrix DMX GigE remote channels for SRDF transfer data at speeds up to 1 Gb/s. The GigE director provides up to four 1 Gb/s Ethernet ports and connects using LC connectors. It is compatible with Symmetrix DMX-2 and Symmetrix 8000 systems.
Channel, disk, and global memory directors
81
Page 82
Symmetrix DMX-3 Hardware

GigE IPv4/v6 (IPsec capable) director

iSCSI channel directors

The GigE IPv4/v6 (IPsec capable) channel director provides support for the latest Internet Protocol standards, including IPsec (Internet Protocol Security) and IPv6. The embedded line-grade encryption co-processor provides strong security without degrading performance. Preshared encryption keys simplify management while maintaining security for data in transit.
These directors can co-exist in the same system with any existing DMX-3 channel directors. With the new director, IPsec can be enabled on a port-by-port basis. IPsec is enabled through a separately purchased software license.
The IP Stack version can be similarly configured per port. No additional software license is required.
The number of IPsec sessions will be limited to 100 per port. IPsec can be enabled for SRDF connections. IPsec enabled and IPsec disabled channel directors can co-exist in the same Symmetrix.
“IPsec security features” on page 187 contains additional
information on IPsec.
The Symmetrix DMX-3 MPCD, through mezzanine card technology, supports iSCSI channel connectivity by way of Gigabit Ethernet (GigE) hardware for the Symmetrix DMX systems. The iSCSI channel director supports iSCSI channel connectivity to IP networks and to iSCSI-capable open systems server systems for block storage transfer between hosts and storage. The primary applications are storage consolidation and host extension for stranded servers and departmental workgroups. Symmetrix GigE remote channels for SRDF transfer data at speeds up to 1 Gb/s. The Symmetrix iSCSI director provides up to four 1 Gb/s Ethernet ports and connects using LC connectors.
82
The iSCSI directors support the iSNS protocol, a mechanism that provides Naming and Discovery services for iSCSI initiators. The iSNS server information is configured in the Symmetrix IMPL file for each iSCSI director. Each iSCSI director must register itself with the iSNS server, which provides:
A mechanism to query iSNS server to find other hosts/targets
Support for State Change Notification and Status Inquiry
The iSCSI director supports TCP/IP protocols and function layers. It is fully compatible with the SRDF protocols and other Symmetrix DMX directors, drives, software, and protection schemes.
EMC Symmetrix DMX-3 Product Guide
Page 83
Symmetrix DMX-3 Hardware

Fibre Channel disk directors (back-end)

Global memory directors

The Symmetrix DMX-3 Fibre Channel back-end disk directors manage the interface to the disk drives, and are responsible for data movement between the disk drives s and global memory. Each disk director on a Symmetrix DMX system supports eight internal links to global memory.
The Symmetrix DMX-3 features a 2 Gb/s Fibre Channel back-end infrastructure. The Fibre Channel disk director has eight multiplex processors that support one port each on its back adapter.
The Symmetrix DMX-3 is available with two, four, six, or eight disk directors, supporting Fibre Channel loops ranging from 15 drives to 60 drives per loop.
Note: For information on maximum logical volumes supported on each Symmetrix DMX physical disk drive and the maximum logical volumes supported for each Symmetrix DMX model, refer to “Symmetrix DMX-3
logical volume capacities” on page 66.
The Symmetrix DMX-3 global memory director technology is one of the most crucial components of a Symmetrix system. The DMX-3 uses global memory directors that use industry-standard Double Data Rate Synchronous Dynamic Random-Access Memory (DDR SDRAM), the latest generation of DDR SDRAM chip technology.
All read and write operations transfer data to or from global memory. Any transfers between the host processor, channel directors, and global memory directors are achieved at much greater electronic speeds than transfers involving disks. The DMX-3 global memory directors work in pairs. The hardware writes to the primary global memory director first, and then automatically writes data to the secondary global memory director. All reads are from the primary memory director. Upon a primary or secondary global memory director failure, all directors drop the failed global memory director and switch to a nondual write mode. Striping between global memory directors is default.
Each Symmetrix DMX-3 global memory director accommodates four separately addressable, simultaneously accessible memory regions, which greatly reduces the probability of contention for global memory access.
Channel, disk, and global memory directors
83
Page 84
Symmetrix DMX-3 Hardware
Dir 3
Dir 4
Dir 7
Dir 8
Dir 9
Dir 10
Dir 14
Dir 13
Dir 1
Dir 2
Dir 5
Dir 6
Dir 11
Dir 12
Dir 15
Dir 16
M 0
M 1
M 2
M 3
M 4
M 5
M 6
M 7
Each global memory director has 16 ports with point-to-point serial connections between the global memory director and channel or disk directors (16 directors) through the direct matrix. Each memory director port consists of a pair of full-duplex serial links—two serial links out (TX) and two serial links in (RX).
Each of the eight director ports on the 16 directors connect to one of the 16 memory ports on each of the eight global memory directors (Figure 13 on page 84). These 128 individual point-to-point connections facilitate up to 128 concurrent cache operations in the system.
84
Figure 13 Global memory director to channel and disk director matrix
The DMX architecture ensures highest performance due to the following:
Requests for global memory are expedited to reduce locking.
Requests are intelligently arbitrated to optimize available
resource usage.
EMC Symmetrix DMX-3 Product Guide
Page 85
Symmetrix DMX-3 Hardware

Global memory director configuration

The Symmetrix DMX system can support up to eight slots in the midplane dedicated to global memory and 512 GB of global memory (256 GB effective) global memory. Individual global memory directors are available in 8 GB, 16 GB, 32 GB, and 64 GB sizes.
When configuring global memory for the Symmetrix DMX systems follow these guidelines:
Very large eight disk director configurations may be limited or
restricted by currently available Symmetrix DMX-3 maximum memory.
Global memory directors can be added to the DMX-3 not to
exceed the maximum designed for the system’s configuration.
Global memory directors must be configured in pairs of the same
capacity.
Channel, disk, and global memory directors
85
Page 86
Symmetrix DMX-3 Hardware

Symmetrix DMX-3 power subsystems

The Symmetrix DMX-3 power subsystem uses a 2N power architecture.The Symmetrix DMX-3 power subsystem includes the following features in the system bay and storage bay:
2N power zones
Dual-line cords, one for each zone per bay, providing on/off
function
BBU modules with internal chargers and electronic status
reporting
The DMX-3 power subsystem architecture provides two completely separate power zones (Power Zone A and Power Zone B), each of which can maintain power for an entire system bay or storage bay independent of the operation of the second zone. There is no redundancy within each zone, rather the redundancy is accomplished through the two-zone design.

System bay power subsystem components

The system bay contains up to eight power supplies that are split into two power zones—Power Zone A and Power Zone B, consisting of up to four power supplies each. The system bay also contains up to eight Battery Backup Unit (BBU) modules providing battery backup in the event an AC failure occurs. One BBU provides the AC line power, and high voltage DC backup to one power supply. The A side BBU modules receive their power from the A side Power Distribution Unit (PDU) and the B side BBU modules receive their power from the B side PDU shown in Figure 14 on page 88. Two Power Distribution Panels (PDPs), one for each zone, provide a centralized cabinet interface and distribution control of the AC power input lines when connected to the system bay PDUs. The PDPs contain the manual On/Off power switches, which are accessible through the rear door. The DMX-3 system bay PDPs are available in three-phase Delta and three-phase WYE configurations.
Through an RS-232 interface, the XCM modules communicate with the system bay BBU modules to determine the BBU status and run battery tests.
86
EMC Symmetrix DMX-3 Product Guide
Page 87
Symmetrix DMX-3 Hardware

Storage bay power subsystem components

Symmetrix DMX-3
power configurations
The storage bay power subsystem consists of the drive enclosure power supply/ cooling modules and the BBU modules that provide the battery backup for the drive enclosures. The A side BBU modules receive their power from the A side PDU and support both the A and B side drive enclosures. The B side BBU modules receive their power from the B side PDU shown in Figure 14 on page 88, and support both the A and B side drive enclosures. Two PDPs, one for each zone, provide a centralized cabinet interface and distribution control of the AC power input lines when connected to the storage bay PDUs. The storage bay PDPs contain the manual On/Off power switches, which are accessible through the rear door. The DMX-3 storage bay PDPs are available in three-phase Delta and three-phase WYE configurations.
The Symmetrix DMX-3 power subsystem supports three-phase Delta or three-phase WYE configurations. Each bay requires two separate PDUs—one for Zone A and one for Zone B power for the Symmetrix DMX-3 system bay and each storage bay shown in Figure 14 on
page 88.
Note: “Power and cooling data” on page 269, “Electrical specifications and
power requirements” on page 270, and “Symmetrix DMX-3 power requirements” on page 288 contain more detailed information on the
Symmetrix DMX-3 power requirements. The EMC Symmetrix DMX-3 Physical Planning Guide available on the EMC Powerlink website provides additional information.
Symmetrix DMX-3 power subsystems
87
Page 88
Symmetrix DMX-3 Hardware
Zone B
AC input
cable B
Cable connectors are shown as they exit the bottom rear of the
DMX bays.
This cabling is internal
to the DMX bays.
The customer’s AC power feeds
are connected to these two
three-phase connectors.
DMX storage bay
rear view
Zone A
AC input
cable A
Zone B PDP
(left)
Zone A PDP
(right)
15 ft. Extension cord
15 ft. Extension cord
Customer’s power
distribution unit
number B
Customer’s power
distribution unit
number A
Zone B
AC input
cable B
Cable connectors are shown as they exit the bottom rear of the
DMX bays.
This cabling is internal
to the DMX bays.
The customer’s AC power feeds
are connected to these two
three-phase connectors.
DMX system bay
rear view
Zone A
AC input
cable A
Zone B PDP
(left)
Zone A PDP
(right)
15 ft. Extension cord
15 ft. Extension cord
Customer’s power
distribution unit
number B
Customer’s power
distribution unit
number A
88
EMC Symmetrix DMX-3 Product Guide
Figure 14 Symmetrix DMX-3 system bay and storage bay to
customer PDU power cabling
Page 89

DMX-3 communications and environmental control

Within the Symmetrix DMX-3 message matrix are the Environmental Control Module (ECM) and Communication Control Module (CCM). These two modules provide the low-level, system-wide communications for running application software, monitoring, and system diagnostics from the service processor.
Symmetrix DMX-3 Hardware

Communications control functions

The XCM’s primary function is to act as a communications agent between the service processor (KVM and server) and the embedded processing nodes within the system. Figure 15 on page 90 illustrates the Ethernet fabric interconnecting the processing nodes to the service processor. External connections to the service processor provide dial-home capabilities for remote monitoring and diagnostics.
The software-driven failover mechanism exists such that the Ethernet fabric remains intact should an XCM become temporarily unavailable. As a backup to the Ethernet fabric, the XCM also contains RS-232 multiplexing logic to allow for an alternate means of serial communication to embedded processing nodes within the DMX-3. The XCM also has the ability to issue remote commands to the director boards, global memory directors, and itself. These commands can be issued from the service processor or remotely, by the EMC Customer Support Center, providing a rich set of intelligent serviceability functions. Also within the XCM is the top-level fabric for the message matrix communications system. This is a high-speed communications fabric within the DMX-3 that allows for fast, reliable messaging between compute nodes.
DMX-3 communications and environmental control
89
Page 90
Symmetrix DMX-3 Hardware
Serial
Managed
Ethernet
Switch
PowerP
C
860DP
L a p t o p
T r a n s c e i v e r
I n t e r f a c e
CC
M
Managed
Ethernet
fabric
Director 1
Managed
Ethernet
fabric
Node
Director 16
R
e
d
u
n
d
a
n
t
L
i
n
k
R
e
d
u
n
d
a
n
t
L
i
n
k
Managed
Ethernet
fabric
KVM
T r a n s c e i v e r
I n t e r f a c e
XCM0
XCM1
100 Base-T
Node
Node
Node
Node
Node
Node
Node
Customer
phone line

Environmental control functions

90
EMC Symmetrix DMX-3 Product Guide
Figure 15 Communication to directors
The XCM monitors and logs environmental events across all critical components (Figure 16 on page 91) and reports any operational problems. Critical components include channel and disk directors, global memory directors, power supplies, power line input modules, fans, and various on/off switches. The XCM environmental control is capable of monitoring each component’s local voltages ensuring optimum power delivery. Temperature of directors and memory are also continuously monitored. The AC power main is checked for:
AC failures
Transfer to auxiliary
DC failures
Current sharing between DC supplies
DC output voltage
Specific notification of overvoltage condition
Current from each DC supply
Page 91
Voltage drops across major connectors
Directors (16)
Memory boards (8)
Service processor
Fans (9)
BBU modules (4, 6, or 8)
Power supplies (4, 6, or 8)
Inter - XCM comm.
System ID
XCM
Ailing components can be detected and replaced before a failure occurs.
Figure 16 XCM environmental control functionality
Symmetrix DMX-3 Hardware
DMX-3 communications and environmental control
91
Page 92
Symmetrix DMX-3 Hardware

Channel attachments

The Symmetrix DMX-3 can attach to ESCON channels, FICON channels, or Fibre Channels, or a mix of channel types. The physical connection to a Symmetrix channel interface occurs at the connectors on the channel adapters.
Note: The Symmetrix Enterprise Storage Platform (ESP) option is required when both mainframe hosts (ESCON or FICON channels) and open systems hosts (Fibre Channels, iSCSI, or GigE SRDF) connect to the same Symmetrix system. of supported hosts, models, operating systems, and EMC open systems host support policies, or refer to the EMC Powerlink website.
Consult your local EMC Sales Representative for the most current list

FICON channel interface connections

The Symmetrix DMX-3 FICON directors connect to mainframe hosts. The four-port, four-processor MPCD and the FICON adapter provide the capability for four concurrent operations through four physical interfaces for communicating with the FICON channels in host systems.
Note: “FICON channel director” on page 80 contains more information on
the FICON director.
FICON channels use fiber optic cables. The current FICON implementation supports data transfer rates up to 4 Gb/s. There are two types of fiber-optic cables: multimode and single-mode.
Note: Symmetrix systems directly connect to FICON single-mode or multimode cables. “Symmetrix FICON configurations” on page 94 contains information on additional configuration options.
In the FICON environment, a link connects a host FICON channel with a Symmetrix FICON channel interface. This link can be a direct connection between the processor or LPAR and the FICON channel interface. The link can also have a FICON director that branches off to additional single-mode or multimode links with connections to Symmetrix FICON channel directors. Figure 17 on page 93 illustrates several types of FICON channel attachments.
Table 21 on page 93 describes the maximum distances supported by
FICON cables.
92
EMC Symmetrix DMX-3 Product Guide
Page 93
Symmetrix DMX-3 Hardware
SYM-000347
SM or MM
FICON director
FICON
FC SM or MM
SM or MM
Symmetrix
FICON
director
SM or MM
FICON
FC SM or MM
SM or MM
Symmetrix
FICON
director
Symmetrix
FICON
director
Distance inter switch link
SM or MM
Symmetrix
FICON
director
SM
FC
FICON
Symmetrix
FICON
director
MM
FC
FICON
Symmetrix
FICON
director
FICON director
FICON director
Figure 17 FICON channel attachments
Tabl e 2 1 Symmetrix FICON cable distances
a
Cable type Cable description Maximum supported distance
9 micron, 1 Gb/s • 10 km (6.2 miles) for each link
Single-mode (SM) Long wave Laser (1,310 nm)
• Up to 20 km (12.43 miles) for each link with IBM RPQ
9 micron, 2 Gb/s • 10 km (6.2 miles) for each link
• Up to 12 km (7.45 miles) for each link with IBM RPQ
9 micron, 4 Gb/s 10 km (6.2 miles) for each link
50 micron, 1 Gb/s 500 m (1,640 ft) for each link
50 micron, 2 Gb/s 300 m (984 ft) for each link
Multimode
50 micron, 4 Gb/s 150 m (492 ft) for each link
62.5 micron, 1 Gb/s 300 m (984 ft) for each link
62.5 micron, 2 Gb/s 150 m (492 ft) for each link
62.5 micron, 2 Gb/s 70 m (230 ft) for each link
a. Distances are point-to-point.
Channel attachments
93
Page 94
Symmetrix DMX-3 Hardware
Symmetrix FICON
configurations
In addition to the standard direct-connect configuration, Symmetrix DMX-3 FICON models support the use of Cascading and Open Systems Intermix configurations. Cascading can be used to reduce the number of FICON adapters and the amount of intersite cabling required by making use of switch-to-switch communication.
Intermix allows FICON zones to be added to existing Open Systems switches within a site and between sites. These two features help reduce the overall costs while providing greater FICON connectivity, backup, and recovery.
Note: For specific Cascading and Open System Intermix configuration requirements, contact your local EMC Sales Representative.
FICON cascading configurations
Cascading provides greatly enhanced FICON connectivity within local and remote sites through the use of switch-to-switch extensions of the CPU to the DMX FICON network. These cascaded switches communicate over long distances using a small number of high speed lines called ISLs (InterSwitch Links). Up to a maximum of two switches may be connected together within a path between the CPU and the DMX.
Same switch vendors are required for a Cascaded configuration. The EMC and IBM branded McDATA and INRANGE switches are supported in pairs. To support Cascading, each vendor requires specific models, hardware and software features, configuration settings, and restrictions. Specific IBM CPU models, MVS release levels, channel hardware, and microcode levels are also required.
94
FICON open systems Intermix configurations
Open Systems Intermix allows separate FICON zones to be defined within new or existing open systems switches. These switches can also be Cascaded to further enhance connectivity and remote backup and recovery. The EMC and IBM branded McDATA and INRANGE switches are supported. To support Open Systems Intermix, each vendor requires specific models, hardware and software features, configuration settings, and restrictions. Specific IBM CPU models, MVS release levels, channel hardware, and microcode levels are also required.
EMC Symmetrix DMX-3 Product Guide
Page 95
Symmetrix DMX-3 Hardware

ESCON channel interface connections

The Symmetrix DMX-3 ESCON directors connect to mainframe hosts. The eight-port, four-processor ESCON director provides the capability for four concurrent operations through its four physical interfaces for communicating with the serial channels in host systems.
Note: “ESCON channel directors” on page 79 contains more information on
the ESCON director.
ESCON channels use fiber optic cables. These serial channels are formally called the ESA/390 Enterprise Systems Connection Architecture (ESCON) I/O interface. The serial channels use point-to-point or switched point-to-point links. Each link has two physical fibers for transporting data: one for inbound signals and one for outbound signals. The current ESCON implementation supports data transfer rates up to 17 MB/s.
There are two types of fiber optic cables: multimode and single-mode. Multimode cables support a maximum link of
1.86 miles (3 km). Single-mode cables support a maximum link of
12.42 miles (20 km) with the Extended Distance Feature (XDF).
Note: Symmetrix systems directly connect to ESCON multimode cables only.
In the ESCON environment, a link connects a host serial or ESCON channel with a Symmetrix serial channel (ESCON) interface. This link can be a direct connection between the processor, or LPAR, and the serial channel interface. This link can also have up to two ESCON Directors configured between the processor, or LPAR, and the serial channel interface. The Symmetrix system supports a maximum connection length of 26.7 miles (43 km) with two single-mode cables and one multimode cable.
Figure 18 on page 96 illustrates several types of ESCON channel
attachments. Table 22 on page 97 describes cable types and supported distances.
Channel attachments
95
Page 96
Multimode
fiber optic
cables
Multimode
fiber optic
cables
Multimode
fiber optic
cables
Multimode
fiber optic
cables
Multimode
fiber optic
cables
Multimode
fiber optic
cables
Multimode fiber optic
cables
Multimode fiber optic
cables
Single-mode
fiber optic
cables
Single-mode
fiber optic
cables
Single-mode
fi
ber optic
cables
ESCON channel
ESCON channel
ESCON channel
ESCON channel
ESCON channel
Processor
or LPAR
Processor
or LPAR
Processor
or LPAR
Processor
or LPAR
Processor
or LPAR
3 km
Max
3 km
Max
3 km
Max
3 km
Max
20 km
Max
20 km
Max
20 km
Max
3 km
Max
3 km
Max
3 km M
ax
3 km Max
Symmetrix
ESCON
director
Symmetrix
ESCON
director
Symmetrix
ESCON
director
Symmetrix
ESCON director
Symmetrix
ESCON director
Repeater
Repeater
Repeater
Repeater Repeater
Repeater
FICON link
ESCON links
FICON LX
FCV
FICON bridge card
9032-5 ESCD
MM
<= 3 km
Symmetrix
ESCON director
Symmetrix
ESCON director
SM
Symmetrix DMX-3 Hardware
96
Figure 18 ESCON channel attachments
EMC Symmetrix DMX-3 Product Guide
Page 97
Symmetrix DMX-3 Hardware
Tabl e 2 2 Symmetrix ESCON cable distances
Cable type Cable description Maximum distance
Direct fiber, multimode 50 micron 2 km (1.24 miles) per cable segment
62.5 micron 3 km (1.86 miles) per cable segment
a
Fiber repeaters/converters (for example, McDATA 9191 to McDATA 9191) 3 converters/repeaters maximum allowed
Other fiber repeaters/converters three converters/repeaters maximum allowed
a. A cable segment is a physical cable connecting one node to another.
b. Typical best-case distance specifications are quoted; refer to specific vendor’s equipment for current information.

Mainframe serial channel extenders

This section describes the various types of conversion devices and channel extenders compatible with Symmetrix systems for channel
9 micron 30 km (18.64 miles) per cable segment
9 micron 20 km (12.42 miles) per cable segment
attachment. Symmetrix systems can attach to ESCON (serial) channels directly, or through ESCON channel extenders, or directors.
Note: Each repeater can be either an ESCON director or an IBM 9036 Remote Channel Extender. If two ESCON directors are used, one of them must use ports that are dedicated to the Symmetrix-to-ESCON channel path.
ESCON director The ESCON director provides dynamic switching and extended link
path lengths (with XDF capability) when attaching an ESCON channel (TYPE=CNC) to a Symmetrix serial channel interface. One or two ESCON directors may be configured in the channel attachment. However, one of the directors must be configured with a static connection because the ESCON architecture recognizes only one port address. The dynamic switch configuration is defined in the IOCP. The ESCON director may also be used to provide additional flexibility and extend channel lengths when used with channel converters.
b
Channel attachments
97
Page 98
Symmetrix DMX-3 Hardware
Channel extender The IBM 9036 Remote Channel Extender (or equivalent device)
attaches an ESCON channel (TYPE=CNC) to a Symmetrix serial channel interface. The Remote Channel Extender extends the distance of the connection and, depending on the model, can convert connections from multimode (3 km) to single-mode (20 km).
Note: Connections to Symmetrix serial channel interfaces must be multimode.

Open systems Fibre Channel interface connections

Tabl e 2 3 Symmetrix Fibre Channel cable distances
The Symmetrix Fibre Channel adapter provides an interface between the director and open systems host channels. Each Fibre Channel adapter is located at the rear of the midplane, opposite its corresponding channel director. These adapters provide the connectivity between the host channels and the Fibre Channel directors (FC-0 layer of the Fibre Channel standard).
The eight-port Fibre Channel director provides the capability for eight concurrent operations through its eight physical interfaces for communicating with the host systems.
Note: “Fibre Channel directors (front-end)” on page 77 contains more
information on the Fibre Channel director.
Fibre Channel directors use fiber optic cables. The channels use Fibre Channel arbitrated loop or switched fabric links. Each link has two physical fibers for transporting data: One for inbound signals and one for outbound signals. The current Fibre Channel implementation supports data transfer rates up to 4 Gb/s (Table 23 on page 98).
c
Cable type Cable description Maximum distance
9 micron, 1 Gb/s 10 km (6.2 miles) per cable segment
a
98
Single-mode
EMC Symmetrix DMX-3 Product Guide
9 micron, 2 Gb/s 10 km (6.2 miles) per cable segment
9 micron, 4 Gb/s 10 km (6.2 miles) per cable segment
Page 99
Symmetrix DMX-3 Hardware
Tabl e 2 3 Symmetrix Fibre Channel cable distances
Cable type Cable description Maximum distance
50 micron, 1 Gb/s 500 m (1,640 ft) per cable segment
50 micron, 2 Gb/s 300 m (984 ft) per cable segment
Multimode
50 micron, 4 Gb/s 150 m (492 ft) per cable segment
62.5 micron, 1 Gb/s 300 m (984 ft) per cable segment
62.5 micron, 2 Gb/s 150 m (492 ft) per cable segment
62.5 micron,4 Gb/s 70 m (230 ft) per cable segment
a. Distances are point-to-point.
Note: For more information on Fibre Channel attachments and cables, refer to the EMC Powerlink website.
a
Channel attachments
99
Page 100
Symmetrix DMX-3 Hardware
100
EMC Symmetrix DMX-3 Product Guide
Loading...