EMC believes the information in this publication is accurate as of its publication date. The information is
subject to change without notice.
THE INFORMATION IN THIS PUBLICATION IS PROVIDED “AS IS.” EMC CORPORATION MAKES NO
REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS
PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR
FITNESS FOR A PARTICULAR PURPOSE.
Use, copying, and distribution of any EMC software described in this publication requires an applicable
software license.
For the most up-to-date regulatory document for your product line, go to the Technical Documentation and
Advisories section on EMC Powerlink.
For the most up-to-date listing of EMC product names, see EMC Corporation Trademarks on EMC.com.
All other trademarks used herein are the property of their respective owners.
2
EMC Symmetrix DMX-3 Product Guide
Page 3
Contents
Warnings and Cautions.......................................................................... 17
The following warnings and cautions pertain throughout this guide:
WARNINGTrained service personnel only.
This EMC product has more than one power supply cord. To reduce
the risk of electric shock, disconnect all power supply cords before
servicing.
Ground circuit continuity is vital for safe operation of the machine.
Never operate the machine with grounding conductors disconnected.
Remember to reconnect any grounding conductors removed for or
during any installation procedure.
Warnings and
Cautions
ATTENTIONResérvé au personnel autorisé.
Cet appareil EMC comporte plus d'un cordon d'alimentation. Afin de
prévenir les chocs électriques, débranchez tous les cordons
d'alimentation avant de faire le dépannage.
Un circuit de terre continu est essentiel en vue du fonctionnement
sécurisé de l'appareil. Ne mettez jamais l'appareil en marche lorsque
le conducteur de mise à la terre est débranché.
WARNUNGNur für authorisiertes Fachpersonal.
Dieses EMC Produkt verfügt über mehrere elektrische
Netzanschlüsse. Zur Vermeidung eines elektrischen Schlages sind vor
Servicearbeiten an der Stromversorgung alle Netzanschlüsse zu
trennen.
Kontinuierliche Erdung ist notwendig während der gesamten
Betriebsdauer des Gerätes. Es ist unzulässig das Gerät ohne Erdung
zu betreiben. Gerät muss geerdet werden, bevor es am Stromnetz
angeschlossen wird.
EMC Symmetrix DMX-3 Product Guide
17
Page 18
Warnings and Cautions
WARNING
WARNING
WARNING
CAUTION
!
Additional warnings
and cautions
Before attempting to service EMC hardware described in this
document, observe the following additional Warnings and Cautions:
The hardware enclosure contains no user-serviceable parts, so it
should not be moved or opened for any reason by untrained persons.
If the hardware needs to be relocated or repaired, only qualified
personnel familiar with safety procedures for electrical equipment
and EMC hardware should access components inside the system or
move the system.
This product operates at high voltages. To protect against physical
harm, power off the system whenever possible while servicing.
In case of fire or other emergency involving the EMC product, isolate
the product’s power and alert appropriate personnel.
Trained personnel are advised to exercise great care at all times
when working on the EMC hardware.
Remember to:
◆Remove rings, watches, or other jewelry and neckties before you begin
any procedures.
◆Use caution near any moving part and any part that may start
unexpectedly such as fans, motors, solenoids, etc.
◆Always use the correct tools for the job.
◆Always use the correct replacement parts.
◆Keep all paperwork, including incident reports, up-to-date, complete,
and accurate.
18
EMC Symmetrix DMX-3 Product Guide
Page 19
Warnings and Cautions
CAUTION
!
Static precautionsEMC incorporates state-of-the-art technology in its designs, including
the use of LSI and VLSI components. These chips are very susceptible
to damage caused by static discharge and need to be handled
accordingly.
Before handling printed circuit boards or other parts containing
LSI or VLSI components, observe the following precautions:
◆Store all printed circuit boards in antistatic bags.
◆Use a ground strap whenever you handle a printed circuit board.
◆Unless specifically designed for nondisruptive replacement, never
plug or unplug printed circuit boards with the power on. Severe
component damage may result.
EMC Symmetrix DMX-3 Product Guide
19
Page 20
Warnings and Cautions
20
EMC Symmetrix DMX-3 Product Guide
Page 21
Preface
IMPORTANT
!
As part of its effort to improve and enhance the performance and capabilities
of the Symmetrix product line, EMC periodically releases revisions of the
Symmetrix hardware and Enginuity Operating Environment. Therefore,
some functions described in this guide may not be supported by all versions
of Symmetrix hardware or Enginuity currently in use.
For the most up-to-date information on Symmetrix and Enginuity,
refer to the “Symmetrix DMX-3, DMX-4 EMC Enginuity Release
Notes”, located on EMC Powerlink.
If your Symmetrix DMX-3 does not function properly or does not function
as described in this document, please contact your EMC representative.
AudienceThis manual is part of the Symmetrix DMX series documentation set,
and is intended for use by storage administrators, system
programmers, or operators who are involved in acquiring, managing,
or operating the Symmetrix system.
Related
documentation
Conventions used in
this guide
For additional information on all Symmetrix-related publications,
contact your EMC Sales Representative or refer to the EMC
Powerlink website at:
http://Powerlink.EMC.com
EMC uses the following conventions for notes, cautions, warnings,
and danger notices.
Note: A note presents information that is important, but not hazard-related.
EMC Symmetrix DMX-3 Product Guide
21
Page 22
Preface
CAUTION
!
WARNING
DANGER
A caution contains information essential to avoid data loss or
damage to the system or equipment. The caution may apply to
hardware or software.
A warning contains information essential to avoid a hazard that can
cause severe personal injury, death, or substantial property damage
if you ignore the warning.
A danger notice contains information essential to avoid a hazard
that will cause severe personal injury, death, or substantial property
damage if you ignore the message.
This product guide contains no DANGER messages.
Typographical conventions
EMC uses the following type style conventions in this document:
NormalUsed in running (nonprocedural) text for:
• Names of interface elements (such as names of windows,
dialog boxes, buttons, fields, and menus)
• Names of commands, daemons, options, programs,
processes, services, applications, utilities, kernels,
notifications, system call, man pages
Used in procedures for:
• Names of interface elements (such as names of windows,
dialog boxes, buttons, fields, and menus)
• What user specifically selects, clicks, presses, or types
Italic:Used in all text (including procedures) for:
• Full titles of publications referenced in text
• Emphasis (for example a new term)
• Variables
22
EMC Symmetrix DMX-3 Product Guide
Page 23
Courier:Used for:
• System output, such as an error message or script
• URLs, complete paths, filenames, prompts, and syntax when
shown outside of running text
Courier bold:Used for:
• Specific user input (such as commands)
Courier italic:Used in procedures for:
• Variables on command line
• User input variables
< >
[ ]
|
{ }
...
Angle brackets enclose parameter or variable values supplied by
the user
Square brackets enclose optional values
Vertical bar indicates alternate selections - the bar means “or”
Braces indicate content that you must specify (that is, x or y or z)
Ellipses indicate nonessential information omitted from the
example
MVS type conventions
The syntax conventions used in this guide are:
Preface
◆CAPITALIZATION = must be typed
◆[ ] = optional entry
◆| = alternative parameter value
◆UNDERSCORED = default value or menu selection
Where to get helpEMC support, product, and licensing information can be obtained as
follows.
Product information — For documentation, release notes, software
updates, or for information about EMC products, licensing, and
service, go to the EMC Powerlink website (registration required) at:
http://Powerlink.EMC.com
Technical support — For technical support, go to EMC Customer
Service on Powerlink. To open a service request through Powerlink,
you must have a valid support agreement. Please contact your EMC
sales representative for details about obtaining a valid support
agreement or to answer any questions about your account.
EMC Symmetrix DMX-3 Product Guide
23
Page 24
Preface
Your commentsYour suggestions will help us continue to improve the accuracy,
organization, and overall quality of the user publications. Please send
your opinion of this document to:
techpubscomments@eng.EMC.com
24
EMC Symmetrix DMX-3 Product Guide
Page 25
Invisible Body Tag
1
Introducing the
Symmetrix DMX-3
This chapter provides an overview of the Symmetrix DMX-3 and
highlights the performance, availability and serviceability features,
and hardware and software options:
The EMC® Symmetrix DMXTM systems are EMC’s family of high-end
storage solutions. The DMX-3 model establishes a new performance
and capacity trajectory for the highest of the high-end enterprise
systems.
The DMX-3 offers 4 Gb/s front-end that provides increased
performance without increasing power and cooling.
The DMX-3 fully leverages the EMC industry-leading storage
management functionality and introduces the economic benefits of
scalable packaging to the high-end storage market.
The Symmetrix
®
DMX-3 is incrementally scalable, supporting from
96 to 1,920 2 Gb/s high-performance Fibre Channel disk drives,
providing a maximum raw capacity of approximately 1 PB.
Note: For information on 2,400 drive support, contact your EMC Sales
Representative.
To support the massive scalability of DMX-3 configurations, the DMX
architecture has been expanded and improved to deliver higher
throughput (1 GB/s links) and increased I/O performance (four dual
1.3 GHz PPC processor complexes per director). Table 1 on page 26
describes some of the Symmetrix DMX-3 performance features.
26
Tabl e 1Symmetrix DMX-3 performance features
DMX data paths 32–128 8 per I/O director, 16 per global memory director
DMX data bandwidth 32–128 GB/s
DMX message bandwidth 4.0–6.4 GB/s
PowerPC processors 84–130 Four dual 1.3 GHz processor complexes per director
Global memory 16–512 GB
Concurrent Memory transfers 8–32 4 per global memory director
a. 256 GB effective
EMC Symmetrix DMX-3 Product Guide
a
Available in 8, 16, 32, and 64 GB global memory directors
Page 27
Introducing the Symmetrix DMX-3
The field-proven Direct Matrix Architecture® (“Symmetrix DMX-3
architecture” on page 53) provides dedicated, nonblocking
interconnects between I/O directors and global memory regions.
Combined with expanded global memory director technology and
the dynamically optimized caching algorithms of the Enginuity
™
storage operating environment, systems based on the Symmetrix
DMX architecture deliver scalable performance to meet the most
demanding information access, protection, and distribution
requirements.
Symmetrix DMX-3
configurations
The DMX-3 consists of a single system bay and from one to eight
storage bays. The system bay contains the 24-slot card cage, service
processor, power modules, and battery backup unit (BBU)
assemblies. The storage bays contain disk drives and associated BBU
modules. In a highly scalable component and cabinet configuration,
the DMX-3 has the capacity, connectivity, and throughput to handle a
wide range of high-end storage applications.
Figure 1 on page 27 provides a front view of the exterior of a
Symmetrix DMX-3 configured with one system bay and eight storage
bays. Figure 2 on page 28 provides a front view of the exterior of a
Symmetrix DMX-3 configured with one system bay and four storage
bays. Figure 3 on page 28 provides a front view of the exterior of a
Symmetrix DMX-3 configured with one system bay and one storage
bay.
Chapter 2, “Symmetrix DMX-3 Hardware,” provides more complete
descriptions of the Symmetrix DMX-3.
Figure 1Symmetrix DMX-3 nine-bay configuration
Symmetrix DMX-3
27
Page 28
Introducing the Symmetrix DMX-3
Figure 2Symmetrix DMX-3 five-bay configuration
28
Figure 3Symmetrix DMX-3 two-bay configuration
EMC Symmetrix DMX-3 Product Guide
Page 29
Introducing the Symmetrix DMX-3
Symmetrix hardware
EMC Solutions Enabler Applications Program Interface (API)
Symmetrix-based applications
Host-based Symmetrix applications
Independent software vendor applications
Enginuity operating environment functions
Symmetrix platform and Enginuity operating environment
The Symmetrix DMX hardware architecture (“Symmetrix DMX-3
architecture” on page 53) and the Enginuity
TM
operating
environment are the foundation for the Symmetrix DMX system
storage platform, which consists of the following:
◆Symmetrix DMX hardware
◆Enginuity-based operating functions
◆EMC Solutions Enabler Application Program Interfaces (APIs)
◆Symmetrix-based applications
◆Host-based Symmetrix applications
◆Independent Software Vendor (ISV) applications
Figure 4 on page 29 illustrates the relationships among these software
layers (and Symmetrix hardware).
Figure 4Enginuity and the storage platform relationships
Enginuity operating
environment
Symmetrix Enginuity is the operating environment for the
Symmetrix DMX systems. Enginuity manages and ensures the
optimal flow and integrity of information through the different
hardware components of the Symmetrix system. Enginuity manages
all Symmetrix operations from monitoring and optimizing internal
data flow, to ensuring the fastest response to the user's requests for
information, to protecting and replicating data.
Symmetrix platform and Enginuity operating environment
29
Page 30
Introducing the Symmetrix DMX-3
Enginuity servicesEnginuity provides the following services for the Symmetrix DMX
systems:
◆Independently manages system resources to intelligently
optimize performance across a wide range of I/O requirements.
◆Ensures system availability through advanced fault monitoring,
detection, and correction capabilities and provides concurrent
maintenance and serviceability features.
◆Interrupts and prioritizes tasks from microprocessors and, for
example, ensures that fencing off failed areas takes precedence
over other operations.
◆Offers the foundation for specific software features available
through EMC’s disaster recovery, business continuance, and
storage management software.
◆Provides functional services for both Symmetrix-based
functionality and for a large suite of EMC storage application
software.
◆Defines priority of each task including basic system maintenance,
I/O processing, application processing (for example,
EMC ControlCenter
®
, SRDF®, TimeFinder®, and EMC
ControlCenter Symmetrix Optimizer).
◆Provides uniform access through APIs for internal calls and
provides an external interface to allow integration with other
software providers and ISVs.
EMC Solutions
Enabler APIs
30
EMC Symmetrix DMX-3 Product Guide
EMC Solutions Enabler APIs are the storage management
programming interfaces that provide an access mechanism for
managing the Symmetrix
third-party storage, switches, and host
storage resources. They enable the creation of storage management
applications that don’t have to understand the management details of
each piece within the total storage environment.
Note: Contact your local EMC Sales Representative or the EMC Powerlink®
website at: http://Powerlink.EMC.com for more information on EMC
storage management APIs
Page 31
Introducing the Symmetrix DMX-3
Storage capacities and global memory requirements
This section describes the Symmetrix DMX-3 storage capacities and
global memory requirements.
Storage capacities
Factors affecting
storage capacity
The Symmetrix DMX-3 offers 73 GB, 146 GB, 300 GB, 450 GB, and
500 GB disk drives and can be configured with from 96 to 1,920 disk
drives.
The capacities are based on storage capacity of each disk drive type
and the following storage protection options:
◆Mirrored (RAID 1)
◆RAID 10, RAID 1/0
◆SRDF
◆RAID 5 (3+1) or RAID 5 (7+1)
◆RAID 6 (6+2) or RAID 6 (14+2)
Note: Appendix A, “Symmetrix DMX-3 Specifications,” contains additional
information on drive and system capacities.
The following factors affect disk storage capacity:
◆Drive capacity size
◆Type of data protection options used
◆Internal Symmetrix File System (SFS) usage — A Symmetrix
DMX-3 reserves two SFS logical volumes consisting of 6,140
cylinders each (slightly less than 6 GB). These volumes are
protected using mirroring, consuming slightly less than 24 GB
total physical space.
◆The size of the blocks — 512 or 520 bytes per block
◆Vault devices — S y m metrix DMX-3 uses vault devices for
vaulting data from global memory during a power-down
operation. Vault devices require 5 GB of space. For each pair of
disk directors in a DMX-3, 160 GB of total capacity is reserved for
vaulting data from memory during system powerdown.
Note: “Configuration rules for vault devices” on page 68 and “Vaulting”
on page 170, contain more information on vaulting.
Storage capacities and global memory requirements
31
Page 32
Introducing the Symmetrix DMX-3
Global memory
requirements
The Symmetrix DMX-3 is available with global memory capacity
ranging from 16 GB to 512 GB (256 GB effective). The total global
memory requirement for a Symmetrix DMX-3 is based upon specific
system configurations and customer requirements. Besides the
customer’s applications, other variables that affect the amount of
global memory a Symmetrix DMX-3 requires include the following:
◆Number of global memory directors
◆Variable back-end disk director and front-end channel director
board configurations
◆Various loop configurations for disk drives
◆Number of disk drives
◆Disk capacity, including speed and protection type
◆Number of logical volumes
Your local EMC Sales Representative will assist you in determining
your global memory requirements.
Note: “Global memory directors” on page 83 provides additional
information on memory configurations.
32
EMC Symmetrix DMX-3 Product Guide
Page 33
Performance features
Symmetrix DMX-3 offers improved performance over conventional
Storage Control Unit (SCU) and Direct Access Storage Device
(DASD) designs. Table 2 on page 33 identifies many of the Symmetrix
DMX-3 and Enginuity supported features that enhance performance
and increase throughput.
Tabl e 2Performance features roadmap (1 of 2)
FeatureDocument sources
Introducing the Symmetrix DMX-3
Direct Matrix (DMX) Architecture with up to 128 direct
nonblocking data paths and up to 128 GB/s aggregate internal
bandwidth in the DMX-3
Symmetrix DMX-3 global memory directors for optimized
performance
One hundred percent global memory fast write capabilities• “Write operations” on page 110
PermaCache option• “PermaCache option” on page 121
2 Gb/s Fibre Channel Drive Infrastructure• “Fibre Channel disk subsystem” on page 62
• Multiple scalable channel directors, disk directors, and global
memory directors
• ESCON channel speeds up to 17 MB/s
• FICON channel speeds up to 4 Gb/s
• Fibre Channel speeds up to 4 Gb/s
• iSCSI channel speeds up to 1 Gb/s
• Gigabit Ethernet (GigE) remote director speeds up to 1 Gb/s
• GigE IPv4/v6 (IPsec capable) channel speeds up to 1 Gb/s
• FICON Cascading and Open Systems Intermix Configurations
PPRC Command Support• “IBM MetroMirror (PPRC)” on page 235
a. Contact your local EMC Sales Representative for currently supported host channel connectivity.
34
EMC Symmetrix DMX-3 Product Guide
Page 35
Introducing the Symmetrix DMX-3
Availability and integrity features
The Symmetrix DMX-3 includes key enhancements that improve the
reliability, availability, and serviceability. Table 3 on page 35
highlights many of the Symmetrix DMX-3 availability and integrity
features.
Tabl e 3Availability and integrity features roadmap (1 of 2)
FeatureDocument sources
Proactive Error Detection and Remote Support• “Maintaining data integrity” on page 175
• “Error Checking and Correction, and data integrity protection”
on page 176
• “Disk error correction and error verification” on page 177
• “Global memory director data integrity logic” on page 178
Support for online Enginuity upgrades and updates• “Nondisruptive Enginuity upgrades” on page 173
Fully fault-tolerant design with redundant critical components
and concurrent maintenance support
Channel director redundancy with end-to-end automatic
channel failover and load balancing
Internal Control Data Path redundancy• “Internal control data path redundancy” on page 164
Fibre Channel back-end functionality featuring redundant disk
directors, disk channels, and disk ports
Dual-initiator disk directors• “Dual-initiator feature” on page 168
2N power supply redundancy• “Redundant power subsystem” on page 169
Vaulting• “Configuration rules for vault devices” on page 68
Redundant Global Memory• “Redundant global memory” on page 162
Advanced Communications and Environmental Control
Modules
DMX-3 security features• “Symmetrix Service Credential, Secured by RSA” on page 182
• “Reliability and availability features” on page 162
• “Channel director redundancy” on page 163
• “Fibre Channel back-end redundancy” on page 164
• “Fibre Channel arbitrated loop design” on page 165
• “Vaulting” on page 170
• “DMX-3 communications and environmental control” on
page 89
• “Symmetrix Audit Log” on page 185
• “RSA enVision log security” on page 185
• “EMC Certified Data Erasure for Symmetrix Disks” on
• “Symmetrix RAID 10 for mainframe systems” on page 196
Sparing option• “Dynamic sparing” on page 216
• “Permanent sparing” on page 213
SRDF• “Base SRDF family products” on page 221
• “SRDF family options” on page 222
• Nondisruptive component replacement
• Nondisruptive change or remove drives
• “Nondisruptive component replacement” on page 172
• “Nondisruptively change or remove FBA devices” on page 174
36
EMC Symmetrix DMX-3 Product Guide
Page 37
Serviceability features
Each Symmetrix DMX-3 has an integrated service processor that
continuously monitors the Symmetrix environment. The service
processor communicates with the EMC Customer Support Center
through a customer-supplied direct phone line. The service processor
automatically dials the Customer Support Center whenever the
Symmetrix system detects a component failure or environmental
violation. An EMC Product Support Engineer at the Customer
Support Center can also run diagnostics remotely through the service
processor to determine the source of a problem and potentially
resolve it before the problem becomes critical. Within the DMX-3
control e-net matrix is the Communications and Environmental
Control Module, known as the XCM. The XCM provide the low-level
system-wide communications for running application software,
monitoring, and system diagnostics from the service processor.
Symmetrix DMX systems feature an incrementally scalable design
with a low parts count for quick component replacement, should a
failure occur. This low parts count minimizes the number of failure
points.
The Symmetrix DMX systems feature nondisruptive replacement of
its major components, which can be replaced while the Symmetrix
system is powered on, including:
◆Channel directors
◆Disk directors
◆Global memory directors
◆Disk adapters
◆Channel adapters
◆Disk drives
◆Power supplies
◆Power Distribution Units (PDU)
◆Power Distribution Panels (PDP)
◆Power supply/ cooling module for drive enclosure
◆Battery backup modules
◆Cooling fan modules
◆Communications and Environmental Control (XCM) modules
◆Service processor components:
Introducing the Symmetrix DMX-3
• Keyboard
• Video Display and Mouse
Note: Chapter 2, “Symmetrix DMX-3 Hardware” and “Nondisruptive
component replacement” on page 172 provide more information on these
components.
Serviceability features
37
Page 38
Introducing the Symmetrix DMX-3
Supported software applications
Enginuity is what enables simultaneous connection to virtually all
mainframe, UNIX, Windows, iSeries, and Linux platforms—and all
validated in EMC’s interoperability labs. The result: you can do
whatever you want with your information. Centralize it. Re-purpose
it. Consolidate it. Replicate it. Share it. Distribute and manage it. Put
it to work where it’s relevant, anytime without compromise.
Enginuity is the solid foundation of EMC’s storage software
offering—and the driving force behind the operational consistency
and nondisruptive features across Symmetrix.
The software offerings are divided into these categories:
◆“Tiered Storage Optimization” on page 38
◆“Storage management” on page 39
◆“Symmetrix local and remote replication software solutions” on
page 39
◆“Information mobility” on page 40
Tiered Storage
Optimization
38
EMC Symmetrix DMX-3 Product Guide
Note: Product information on these software options are available on the
EMC Powerlink website at:
http://Powerlink.EMC.com
All of the software products are furnished under a license. Refer to
the copyright page in this product guide for the complete licensing
statement. For software license, model numbers, prerequisites, and
additional information, contact your local EMC Sales Representative.
EMC delivered two software products with the latest version of
Enginuity (5772) that optimize performance with multi-tiered
Symmetrix systems. Dynamic Cache Partitioning provides dedicated
memory resource allocation. Symmetrix Priority Controls help
manage multiple application workloads by setting priority levels for
device groups, allowing higher-priority applications to have faster
response times than lower priority applications.
Note: “Tiered Storage Optimization” on page 136 contains related
information.
Page 39
Introducing the Symmetrix DMX-3
Storage
management
Symmetrix local
and remote
replication software
solutions
Storage Management Console is an intuitive, browser-based GUI for
Symmetrix device management for open systems as well as
z/OS-attached systems. Symmetrix Management Console features
management and monitoring of local and remote replication, as well
as the tiered storage optimization tools Symmetrix Priority Controls
and Dynamic Cache Partitioning.
The EMC ControlCenter family of storage management software,
provides automated management of your multi-vendor networked
storage environment through a single, consistent, information-centric
approach.
EMC z/OS Storage Manager (EzSM) is a mainframe software
product providing discovery and viewing of your Symmetrix
environment. EzSM provides facilities to handle volumes, data sets,
catalogs, and detailed Symmetrix functionality information.
Note: See “EMC ControlCenter family of products” on page 150 for related
information.
The EMC TimeFinder and SRDF families of software are the most
powerful suites of local and remote storage replication solutions
available in the industry; enabling business continuance volumes for
parallel processing activities like backup, testing and development,
and local restore, as well as remotely replicated copies to guard
against primary site disasters and outages.
Note: “TimeFinder family of products” on page 154 contains related
information. “Base SRDF family products” on page 221 and “SRDF family
options” on page 222 contains related information.
Supported software applications
39
Page 40
Introducing the Symmetrix DMX-3
Information mobility
Copy and move data to where it provides the most value. Symmetrix
DMX enables online data mobility and migration while minimizing
complexity and disruption. Move data between storage tiers,
platforms, and sites quickly, efficiently, and without disruption:
◆EMC Open Migrator/LM — Provides host-based, nondisruptive
data migration/data mobility at the volume level for Microsoft
Windows and UNIX servers.
◆EMC Open Replicator for Symmetrix — Enables remote
point-in-time copies to be used for high-speed data mobility,
remote vaulting, migrations, and distribution between EMC
Symmetrix DMX and qualified storage systems with full or
incremental copy capabilities.
◆SRDF/Data Mobility (DM) — Enables rapid transfer of data from
source volumes to remote volumes anywhere in the world.
Note: Product information on these software options are available on the
EMC Powerlink website at:
http://Powerlink.EMC.com
Note: “Base SRDF family products” on page 221 and “SRDF family options”
on page 222 contain related information.
40
EMC Symmetrix DMX-3 Product Guide
Page 41
Hardware options
Titan Titan
SYM-001247
Storage Bay (Mohawk)
SYMMETRIX
EMC
2
PS1 P
S2 P
S3
PS4
PS5
PS6
PS7
PS8
System Bay (Titan)
EMC
2
Introducing the Symmetrix DMX-3
The following hardware options are offered with the DMX-3 systems:
◆DMX-3 Silencer
◆DMX-3 Systems Securing Kits
DMX-3 Silencer
The Symmetrix DMX-3 Silencer as shown in Figure 5 on page 41 is a
fan noise reduction option for the Symmetrix DMX-3 system bay and
storage bay systems. The Symmetrix DMX-3 Silencer is designed
with leading edge sound reducing materials that attenuate
high-frequency noise components and reduce overall sound levels. It
is designed not to affect airflow or thermal performance.
Figure 5DMX-3 Silencer
Hardware options
41
Page 42
Introducing the Symmetrix DMX-3
Tabl e 4DMX-3 Silencer kits model information
Table 4 on page 42 provides the DMX-3 Silencer kits model
information.
Model NumberDescriptionComments
TB24-SilencerSystem bay silencer kit1 kit per bay
SB-SilencerStorage bay silencer kit1 kit per bay
The DMX-3 Silencer kit contains the following components:
◆DMX-3 Silencer for top of system bay and or storage bay
◆Full length foam piece for the storage bay
◆An 11-in. by 20-in. foam piece for the system bay
Note: Contact your EMC Sales Representative for Silencer kit information
and current availability.
DMX-3 Silencer
specifications
Tabl e 5DMX-3 Silencer physical specifications
DMX-3 silencer for system bayDimensions
DMX-3 silencer for storage bayDimensions
Table 5 on page 42 lists the dimensions and weight for the DMX-3
Silencer for the system bay and storage bay.
Height
Width
Depth
WeightPounds
Height
Width
Depth
WeightPounds
Table 47 on page 267 lists the sound power and sound pressure levels
for the DMX-3 system bay and storage bays.
Inches
8.25
23
36.5
10
Inches
6.5
29
36.5
9.4
Centimeters
20.96
58.42
92.71
Kilograms
4.54
Centimeters
16.51
73.66
92.71
Kilograms
4.26
42
EMC Symmetrix DMX-3 Product Guide
Page 43
Introducing the Symmetrix DMX-3
DMX-3 systems
securing kits
Some customers require that their EMC equipment be installed to
withstand significant shock and vibration. Installation of EMC
Symmetrix DMX-3 systems securing kits in combination with
adequate substrate construction, will mitigate collateral damage
during such events.
The kits contain heavy brackets plus hardware used to attach the
brackets to the frames of the system and storage bays. The brackets
are attached to the floor using bolts that engage the flooring
substructure provided by the user.
Symmetrix DMX-3 systems securing kits can be installed to system
and storage bays without lifting the bays.
Note: Please refer to the EMC Symmetrix DMX-3 Physical Planning Guide for
information regarding the EMC securing kits, or contact your EMC Sales
Representative for specific information.
Hardware options
43
Page 44
Introducing the Symmetrix DMX-3
44
EMC Symmetrix DMX-3 Product Guide
Page 45
Invisible Body Tag
2
Symmetrix DMX-3
Hardware
This chapter describes the main hardware components of the
Symmetrix DMX-3 including:
◆ Major components ............................................................................. 46
The Symmetrix DMX-3 is a disk array subsystem that is composed of
a system bay and from one to eight storage bays. This section
describes the Symmetrix DMX-3 components.
Tabl e 6Symmetrix DMX-3 model component overview
Symmetrix DMX-3 componentsComponent information location
Main component locations of the system bay, front and rear viewsFigure 6 on page 47
Main component descriptions of the system bayTable 7 on page 48
Main component locations of the storage bay, front and rear viewsFigure 7 on page 49
Main component descriptions of the storage bayTable 8 on page 50
To reduce the risk of personal injury, do not open the doors or move
the Symmetrix DMX-3 unless you are qualified and familiar with
safety procedures for electrical equipment and the Symmetrix
DMX-3. The Symmetrix DMX-3 contains no user-serviceable parts.
Neither the system bay nor the storage bays should not be moved or
opened for any reason by untrained persons. If the Symmetrix DMX-3
is in need of relocation or repair, only qualified personnel should
access components inside the bays or move them.
46
EMC Symmetrix DMX-3 Product Guide
Page 47
PS1 PS2 PS3 PS4 PS5 PS6 PS7 PS8
LAN1
LAN2
PS8 PS7 PS6 PS5 PS4 PS3 PS2 PS1
ON
I
OFF
O
ON
I
OFF
O
ON
I
OFF
O
ON
I
OFF O
ON
I
OFF O
ON
I
OFF O
FansFans
Power supplies
*KVM
UPS
*Server
SYM-000978
Power zone B
left side
Power zone A
right side
Disk directors,
Channel directors,
and Global memory
directors in 24-Slot
card cage
**Battery backup unit
assemblies
**Battery backup unit
modules
Disk adapters,
Channel adapters,
and Environmental
and communication
modules (XCM)
Power distribution
panels
Power
distribution
units
System bay frontSystem bay rear
* The service processor consists of the KVM and the server.
** The battery backup unit assembly consists of two battery backup unit modules.
Symmetrix DMX-3 Hardware
Figure 6Symmetrix DMX-3 system bay (interior view, front and rear)
Major components
47
Page 48
Symmetrix DMX-3 Hardware
Tabl e 7Symmetrix DMX-3 system bay component overview
ComponentDescription
Cooling fan modulesThree 3-fan modules maintain air circulation and cool the unit internally.
Card cage and midplaneThe front 24 slots contain global memory directors, disk directors, and channel directors (front-end
Fibre Channel, ESCON, FICON, and iSCSI channel directors
a
, or GigE Remote directors). The rear
slots contain the channel host adapters, GigE Remote adapters, disk adapters, and the
Communications and Environmental Control Modules (XCMs).
Channel directors/adapters
and remote director
adapters
(front-end)
a
Up to 12 channel directors connect to the front side of the midplane and the adapters to the rear
side of the midplane in the system cabinet. Each channel director’s adapter provides the interface to
the host or network.
Fibre Channel Disk
Directors/Adapters
(Back-End)
Two, four, six or eight disk directors connect to the midplane in the front of the cabinet. Each disk
director’s adapter provides the interface to the Fibre Channel disk drives. The adapter connects to
the opposite side of the midplane in the rear of the cabinet.
Global memory directorsTwo, four, six, or eight global memory directors provide up to 512 GB (256 GB effective) total global
memory, available in 8 GB, 16 GB, 32 GB, and 64 GB global memory director capacities.
Communications and
environmental control
module (XCM)
Two communications and environmental control modules (XCMs) connect to the midplane in the
rear card cage. The XCM contains the Ethernet interface between the directors (channel, disk, and
memory) and the service processor. It monitors and logs environmental events for all Symmetrix
DMX-3 FRUs (field replacable units) and reports any operational problems such as thermal
excursion, voltage drop, etc. It also has connectors for paths between the XCM and the BBU
modules (in the system bay and the storage bays) for sending commands and receiving status.
Power suppliesUp to eight power supplies support the system bay and are split between two (A and B) three-phase
power zones. Each zone supports up to four power supplies. One zone can maintain power for the
entire system bay independent of the power supplies in the other zone. The DMX-3 is available in
three-phase Delta or three-phase WYE configurations.
Power distribution panel
(PDP), power distribution
unit (PDU), and AC
connectors
Two PDPs, one for each zone, provide a centralized cabinet interface and distribution control of the
AC power input lines when connected to the system bay PDUs. The PDPs contain the manual
On/Off power switches, which are accessible through the rear door. The PDUs, one for each power
zone, provide the main interface between the input AC from the PDPs and the various components
contained within the system bay.
Battery backup unit (BBU)
assembly consisting of two
BBU modules
Service processor
(keyboard, video display,
and mouse - KVM), server,
and uninterruptible power
supply (UPS)
Up to eight BBU modules provide backup for each of the power supplies. If AC power fails, the BBU
modules can maintain power for two 5-minute periods of AC loss while the Symmetrix system shuts
down.
The service processor consists of a KVM and a server that connects to the Symmetrix subsystem
through an Ethernet interface. The service processor uses an external modem for communicating
with the EMC Customer Support Center when the Symmetrix system detects an error condition.
The service processor is used to download the Symmetrix system configuration to the directors and
provides diagnostic and maintenance utilities for the Symmetrix system. The server battery backup
is provided by a UPS.
a. Contact your local EMC Sales Representative for current channel director availability.
48
EMC Symmetrix DMX-3 Product Guide
Page 49
Symmetrix DMX-3 Hardware
Battery backup
unit (BBU) modules
Disk drives,
15 per drive
enclosure
Drive enclosure
covers
BBU assembly
cover
Storage bay front
Storage bay rear
! !
EXP PRI
EXP PRI
EXP PRI
EXP PRI
#
#
!
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
! !
! !
! !
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
OFF O
I ON
OFF O
I ON
OFF O
I ON
! !
! !
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXPPRI
! !
! !
! !
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
! !
! !
!!
BBU modules
OFF
O
I
ON
OFF
O
I
ON
Power supply/
System cooling
OFF
O
I
modules
ON
Power distribution
units (PDUs)
Link control
cards (LCCs)
Power distribution
panels (PDPs)
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
! !
EXP PRI
EXP PRI
#
!
!
#
EXP PRI
EXP PRI
! !
! !
Power zone B
left side
Power zone A
right side
Figure 7Symmetrix DMX-3 storage bay (interior view, front and rear)
Major components
SYM-000977
49
Page 50
Symmetrix DMX-3 Hardware
Table 8Symmetrix DMX-3 storage bay component overview
ComponentDescription
Drive enclosuresThe Symmetrix DMX-3 storage bay is configured with capacities of 120 or 240 disk drives. Each
drive enclosure includes the following components:
• Redundant power and cooling modules for disk drives
• Two Link Control Cards (LCC)
• From 4 to 15 Fibre Channel disk drives per drive enclosure
The storage bays can be populated with any combination of DMX disk drives (73 GB, 146 GB, and
300 GB 10,000 rpm drives; 73 GB, 146 GB, and 300 GB, and 450 GB 15,000 rpm drives; and 500
GB 7,200 rpm drives) Some configuration restrictions may apply.
Battery backup unit (BBU)
modules
Power distribution panel (PDP),
Power distribution unit (PDU),
and AC connectors
Two BBU modules are required for four drive enclosures (up to eight BBU modules support up to
16 drive enclosures in one storage bay). The BBU modules provide backup power to the drive
enclosures.
Two PDPs, one for each zone, provide a centralized cabinet interface and distribution control of the
AC power input lines when connected to the storage bay PDUs. The PDPs contain the manual
On/Off power switches, which are accessible through the rear door. The PDUs, one for each
power zone, provide the main interface between the input AC from the PDPs and the BBU
modules to the drive enclosures contained within the storage bay.
Symmetrix DMX-3
and component
scaling attributes
The Symmetrix DMX-3 base configurations are composed of a system
bay and independent storage bays, that have common configuration
guidelines. Any DMX-3 base configuration accommodates the later
addition (upgrade) of capacity through the on-line addition of drives,
drive enclosures, if required, and additional storage bays that support
up to 1,920 2 Gb/s or 4 Gb/s disk drives. The Direct Matrix
™
infrastructure accommodates nondisruptive addition of disk directors
(increasing from two to eight disk directors) enabling increased
capacity when needed.
The DMX-3 consists of a system bay and from one to eight storage
bays. The DMX-3 system bay has from two to eight disk directors, up
to 12 channel directors (combined director total 16), and two, four, six,
or eight global memory directors. The system bay also contains up to
eight power supplies, each of which has a dedicated 2.2 kW BBU.
Table 9 on pa ge 51 describes the available DMX-3 configurations.
50
EMC Symmetrix DMX-3 Product Guide
Page 51
Symmetrix DMX-3 Hardware
Tabl e 9DMX-3 configurations
Number of disk directors2 disk directors4 disk directors6 disk directors8 disk directors
Drive channels8 162432
Minimum and maximum
number of disk drives96–240192–960360–1,440480–1,920
Minimum and maximum
TB capacity (raw)
Maximum TB capacity
(protected)
a
b
7.04–119.9014.08–479.6226.40–719.4335.21–959.54
102301435525.1
Maximum global memory
(usable)64 GB144 GB216 GB256 GB
Usable connectivity
d
48 x 4 Gb/s Fibre
Channel
64 x 4 Gb/s Fibre
Channel
64 x 4 Gb/s Fibre
Channel
64 x 4 Gb/s Fibre
24 x 4 Gb/s FICON48 x 4 Gb/s FICON40 x 4 Gb/s FICON32 x 4 Gb/s FICON
48 ESCON64 ESCON64 ESCON64 ESCON
8 x 1 Gb/s Ethernet
remote replication
24 x 1 Gb/s Gigabit
Ethernet iSCSI
a. Minimum raw capacity for a DMX-3 is based on 73 GB disk drives and maximum capacity is based on 500 GB disk drives.
b. Maximum protected capacity for a DMX-3 is based on RAID 5 (7+1) data protection configurations, allowance for vault devices, and
Symmetrix file system (SFS) requirements.
c. Based 1,920 500 GB drives.
d. Combinations may be limited or restricted.
DMX-3
configuration rules
and guidelines
The following are some of the system configuration rules and
guidelines to consider when planning your new or upgrading your
DMX-3:
8 x 1 Gb/s Ethernet
remote replication
48 x 1 Gb/s Gigabit
Ethernet iSCSI
8 x 1 Gb/s Ethernet
remote replication
40 x 1 Gb/s Gigabit
Ethernet iSCSI
8 x 1 Gb/s Ethernet
remote replication
32 x 1 Gb/s Gigabit
Ethernet iSCSI
c
Channel
◆All bays must be configured in an inline installation. Each bay is
bolted to the adjacent bays during installation.
◆Storage bays can be populated with any combination of 73 GB,
146 GB and 300 GB 10,000 rpm drives, 73 GB, 146 GB, 300 GB,
450 GB 15,000 rpm drives, and 500 GB 7,200 rpm drives. Some
restrictions may apply.
◆A minimum of four (4) disk drives must be configured in each
drive enclosure.
Major components
51
Page 52
Symmetrix DMX-3 Hardware
◆While all drives (different capacities or different speeds) can be
intermixed in Symmetrix DMX-3 systems, locations on disk
director pairs and drive loops may affect application
performance. Consult your Symmetrix representative for
guidelines on optimal configuration of mixed drive sizes and
speeds.
◆5 GB on the first 4 drives of every drive loop (160 GB per disk
director pair) is reserved for memory vaulting.
◆The first four disk drives on each drive loop in the direct-attached
storage bay support the memory vault devices.
◆24 GB of total capacity is reserved for internal Symmetrix File
System (SFS) use.
◆Symmetrix systems support various data protection methods:
• RAID 1 — Mirrored pairs of two hypervolumes
• RAID 1/0 — Mirroring and striping for open system
environments
• RAID 10 — Data striped across four mirrored pairs of
hypervolumes for mainframe environments
• RAID 5 (3+1) or RAID 5 (7+1) — Data striped on four or eight
hypervolumes with rotating parity
• RAID 6 (6+2) or RAID 6 (14+2) — Data striped on eight or
sixteen hypervolumes with rotating parity
• SRDF — Data mirrored to another Symmetrix
• Dynamic sparing — Increases data availability by copying the
data on a failing volume to a spare volume until the original
device is replaced
• Permanent sparing — Replaces a faulty drive automatically
from a list of available spares residing in the Symmetrix
system without CE involvement on site
52
Note: Chapter 5, “Data Integrity, Availability, and Protection,” provides
more information and configuration rules regarding the above data
protection options.
◆Consider details of space, power and installation requirements as
well as planning for future system expansion. Appendix C
“Planning and Installation,” and the EMC Symmetrix DMX-3
Physical Planning Guide provide details on these topics.
EMC Symmetrix DMX-3 Product Guide
Page 53
Symmetrix DMX-3 architecture
The Symmetrix DMX-3 features a high-performance, Direct Matrix
Architecture (DMX) supporting up to 128 point-to-point serial
connections within the DMX system.
Symmetrix DMX technology is distributed across all channel
directors, disk directors, and global memory directors in Symmetrix
DMX systems. Enhanced global memory technology supports
multiple regions and 16 connections on each global memory director.
In the Direct Matrix Architecture, contention is minimized because
control information and commands are transferred across a separate
and dedicated message matrix. The major components of Symmetrix
DMX architecture are the front-end channel directors (and their
interface adapters), global memory directors, and back-end disk
directors (and their interface adapters).
The matrix midplane provides configuration flexibility through the
slot configuration. Each director slot port is hard-wired
point-to-point to one port on each global memory director board.
This section includes the following topics:
Symmetrix DMX-3 Hardware
DMX-3 block
diagram
◆“DMX-3 block diagram” on page 53
◆“DMX-3 configuration rules and guidelines” on page 51
◆“DMX-3 point-to-point message matrix” on page 55
◆“DMX-3 slot configuration” on page 57
In a fully configured Symmetrix DMX-3, each of the eight director
ports on the sixteen directors connects to one of the 16 memory ports
on each of the eight global memory directors. These 128 individual
point-to-point connections facilitate up to 128 concurrent global
memory operations in the system. Figure 8 on page 54 illustrates the
point-to-point architecture and the interconnection of the major
components of the Symmetrix DMX-3 systems.
Symmetrix DMX-3 architecture
53
Page 54
Symmetrix DMX-3 Hardware
Battery backup
unit odules
Cooling
ESCON Director
ESCON Host Atta c h
Direct
Matrix
Direct
Matrix
FC Director
FC Host Atta c h
Direct
Matrix
Direct
Matrix
MultiP r otocol C D
Direct
Matrix
Direct
Matrix
MultiP r otocol C D
FICON , GigE , iSCS I
Direct
Matrix
Direct
Matrix
MultiP r otocol C D
FICON , GigE , iSCS I
Direct
Matrix
Direct
Matrix
MultiP r otocol C D
FICON , GigE , iSCS I
Direct
Matrix
Direct
Matrix
FC Director
FC Host Atta c h
Direct
Matrix
Direct
Matrix
ESCON Director
ESCON Host Atta c h
Direct
Matrix
Direct
Matrix
Cntl
FC (Ba c k-End )
Symmetrix
FC disk d e vice s
Direct
Matrix
Direct
Matrix
Cntl
FC (Ba c k-End )
Symmetrix
FC Disk D e vice s
Direct
Matrix
Direct
Matrix
Cntl
FC (BE or FE)
Symmetrix
FC disk devices*
Direct
Matrix
Direct
Matrix
Cntl
FC (BE or FE)
Symmetrix
FC disk devices*
Direct
Matrix
Direct
Matrix
Cntl
FC (BE or FE)
Symmetrix
FC disk d e vices*
Direct
Matrix
Direct
Matrix
Cntl
FC (BE or FE)
Symmetrix
FC disk d e vices*
Direct
Matrix
Direct
Matrix
Cntl
FC (Ba c k-End )
Symmetrix
FC disk d e vice s
Direct
Matrix
Direct
Matrix
Cntl
FC (Ba c k-End )
Symmetrix
FC disk d e vice s
Direct
Matrix
Direct
Matrix
Cntl
Cntl Cntl Cntl Cntl Cntl Cntl Cntl
Cont r ol and comm unicationssignal s
Cont r ol and comm unicationssignal s
32 GB
Global
memor y
32 GB
Global
memor y
32 GB
Global
memor y
32 GB
Global
memor y
32 GB
Global
memor y
32 GB
Global
memor y
32 GB
Global
memor y
32 GB
Global
memor y
E n vironmenta l
control and
status ignals
(XCM)
*Note : The DMX-4 system suppor ts Fibre Channel , FICON , ESCON , and iSCSI connections as well as GigE , Fibre Channel , and ESCON remote connections .
The DMX-4 system midplane has f our slots that suppo r t either f r ont-end c hannel directo r s or ba c k-end disk directo r s .
E n vironmenta l
control and
statussignals
(XCM)
FICON , GigE , iSCS I
Power supplies
Service
processor
(KVM & server)
UPS
Modem
Figure 8Symmetrix DMX-3 block diagram
54
EMC Symmetrix DMX-3 Product Guide
Page 55
Symmetrix DMX-3 Hardware
DMX-3
point-to-point
message matrix
Symmetrix DMX systems feature a point-to-point interconnect
technology for its separate matrix fabrics, which have been
implemented for both data plane functions and control plane
functions. This Symmetrix DMX message matrix provides high
bandwidth and low latency control plane communication, which
manages the data movement through the Symmetrix system.
Figure 9 on page 56 is a simplified view of the Symmetrix DMX
message matrix. The message fabric is made up of several fabric
elements, or FE, connected together so that all end nodes are
connected to a unique port on the outer edge of the message fabric.
The end nodes are commonly referred to as the Message Engine or ME.
The ME is an integral part of the CPU controller and allows the
front-end and back-end processors to communicate with each other
through the message fabric.
The message fabric is managed by a fabric manager, which provides
initialization for the fabric elements, real-time monitoring, and
diagnostic functions. The fabric manager is assigned to any one of the
director processors and communicates to the fabric through special
in-band fabric management packets.
Symmetrix DMX-3 architecture
55
Page 56
Symmetrix DMX-3 Hardware
Message
fabric
FE FE
XCM0
FE
FE
FE
FE
XCM1
FE
FE
FE
FE
FE
A B C D
FE
A B C D
Front-end
hannel director
Back-end
disk director
Back-end
disk director
Front-end
cdannel Director
Fabric
Manager
Figure 9Symmetrix DMX-3 message fabric
DMX-3 midplane
slot configuration
The front of the Symmetrix DMX-3 card cage midplane contains the
channel directors, disk directors, and global memory directors. The
rear card cage midplane contains the adapters, and the
Communications and Environmental Control Module (XCM) pair.
56
EMC Symmetrix DMX-3 Product Guide
Page 57
Symmetrix DMX-3 Hardware
Dir
T ype
BE
Dir
T ype
FE
Dir
T ype
BE
Dir
T
ype
FE
Dir
ype
FE
Dir
T
ype
BE
Dir
T T ype
FE
or
Dir
Ty pe Type Type
BE
Dir
T T ype
BE
Dir
FE
Dir
ype
BE
Dir Dir
Dir
BE
M0
M1
M7 M6 M5 M4 M3
M2
FE*
or
FE*
or or
FE* FE*
BE FE
1 8 7 6 5 4 3 2
9
16 13
12 11 10
Dir
Type
14
Dir
Type
15
SYM-000085
FE
Type
FE
Ty pe
Global memory directors
M0 through M7
Director pairs
Global memory Director pairs
*Note: These slots (Directors 5, 6, 11, and 12) in the midplane can be configured with either front-end or back-end directors.
The Symmetrix DMX systems require certain board types to occupy
particular slot locations within the card cage. Adhering to the
configurations stated for each model type ensures that the physical
routing of the serial signals minimizes contention for memory
resources, maximizes bandwidth within the system, and maintains
total redundancy to the same memory location through two
completely different hardware paths. Termination of TTL and GTLP
signals occurs at the adapters in the end slot locations.
DMX-3 slot
configuration
The Symmetrix DMX-3 midplane provides eight slots in the center of
the midplane reserved for global memory directors and the
remaining 16 slots are reserved for channel directors and disk
directors (eight to the left and eight to the right of memory). Figure 10
on page 57 shows the card cage layout for the global memory
directors, the Front-End (FE) and Back-End (BE) designations for the
Fibre Channel directors, and the FE designations for the ESCON
directors, FICON directors, iSCSI, or GigE Remote directors.
apters 12, 11, 6, and 5) in the midplane can be configured with either front-end or back-end apapters.
On the rear side of the midplane Figure 11 on page 58, the adapters
reside behind their respective directors, and two slots behind the
memory are reserved for the XCM pair.
Symmetrix channel connectivity and host integration
The Symmetrix DMX-3 can be integrated with all major enterprise
hosts and servers. This section outlines the emulations and hosts
Symmetrix systems support through Fibre Channel, iSCSI, ESCON,
FICON, or GigE (SRDF) interfaces.
Note: For the most current information on Symmetrix systems and specific
host integration, contact your local EMC Sales Representative, or refer to the
EMC Powerlink website.
Channel
connectivity
Open systems
connectivity
Mainframe systems
connectivity
IBM iSeries Fibre
Channel connectivity
The Symmetrix DMX-3 supports connectivity to mainframe and open
systems hosts.
Note: The Symmetrix Enterprise Storage Platform (ESP) software enabler, a
software option, is required if you plan to store and access mainframe and
open systems data on the same Symmetrix system. For more information on
the ESP option, contact your local EMC Sales Representative.
The Symmetrix DMX-3 connects to Fibre Channel and iSCSI open
system host interfaces such as UNIX, Windows, Linux, and iSeries
systems.
Note: Contact your local EMC Sales Representative for availability of iSeries
host connectivity.
The Symmetrix DMX-3 supports ESCON and FICON host
connectivity to mainframe systems.
With the Symmetrix Fibre Channel adapter, users are able to connect
Symmetrix systems through fibre to the iSeries 270 and 8xx models.
When using directly connected fibre devices (point-to-point) the
maximum distance is 500 m.
The DMX-3 systems support Fibre Channel connectivity to iSeries
systems. Fibre Channel is currently capable of running up to 2 Gbs/s
full duplex with iSeries systems.
Note: For information on disk drives supported for iSeries systems, contact
your EMC Sales Representative.
Symmetrix channel connectivity and host integration
59
Page 60
Symmetrix DMX-3 Hardware
Symmetrix channel
configurations
Supported Fibre
Channel interfaces
Supported cluster
hosts
EMC offers the following Symmetrix DMX-3 channel directors:
◆Eight-port ESCON directors
◆Eight-port Fibre Channel directors
◆Multiprotocol Channel Director (MPCD) that supports:
• FICON host connections
• iSCSI host connections
• GigE SRDF connections
• GigE IPv4/v6 (IPsec capable) connections
• Fibre Channel connections
Table 17 on page 77 describes DMX-3 channel director configurations.
The Symmetrix DMX systems Fibre Channel interfaces attach to most
open systems and iSeries hosts that have Fibre Channel connectivity.
Note: Consult your local EMC Sales Representative for the most current list
of supported hosts, models, operating systems, and EMC open systems host
support policies, or refer to the EMC Powerlink website.
For the most recent information on supported cluster hosts, refer to
the EMC Powerlink website.
Mainframe serial
channel interfaces
60
EMC Symmetrix DMX-3 Product Guide
Symmetrix serial channel interfaces attach to IBM S/370, S/390
(ES/9000, 309X, 308X, 43XX, and 9370), the plug-compatible
manufacturer (PCM) equivalent, Amdahl, Unisys, Bull, and Siemens.
Note: “Channel attachments” on page 92 contains a more detailed discussion
of channel attachment options.
Table 10 on page 61 shows the IBM DASD models and controllers
that Symmetrix systems emulate.
Page 61
Tabl e 1 0IBM controller/DASD compatibility
❏IBM controller❏
IBM DASD 3990-621052107
a
3380
3390-1XXX
3390-2XXX
3390-3XXX
3390-9XXX
3390-27XX
3390-54 XX
a. Contact your local EMC Sales Representative for information on 3380 support.
XXX
Symmetrix DMX-3 Hardware
Supported
mainframe
operating systems
In IBM/PCM mainframe environments, the Symmetrix DMX system
is operating-system independent. The memory processing algorithms
are self-managed, and the Symmetrix system does not depend on
host cache commands to benefit from read and write caching.
Almost every S/370 and z/OS operating system can be supported,
including:
TPF AIX/ESAMVS/ESAMVS/SPMVS/XA
MVT/VSEVM/ESAVM/HPOVM/SPVM/XA
VSE/ESAVSE/SPz/OSz/OS.ez/VM
Symmetrix DMX systems also support the following mainframe
operating systems:
GC0S7GCOS8LINUX for z/SeriesMSPOS/1100
PICKTPF
a. Contact your local EMC Sales Representative for availability of TPF support.
a
UTS
Symmetrix channel connectivity and host integration
61
Page 62
Symmetrix DMX-3 Hardware
Fibre Channel disk subsystem
The Symmetrix DMX-3 disk subsystem are contained in the storage
bays. They are fully redundant components and can be replaced
nondisruptively. The disk subsystems consist of the following
components:
◆Disk drives — One-inch low-profile 2 Gb/s Fibre Channel disk
drives available in 73 GB, 146 GB, 300 GB, 450 GB, and 500 GB
sizes. A fully populated drive enclosure holds 15 disk drives and
16 drive enclosures per storage bay.
◆Two link control cards (Fibre Channel interface cards).
◆Two power supply/cooling modules.
The drive enclosure supports 2 Gb/s back-end fibre interface
(FC-AL). The dual-loop configuration provides redundancy, port
bypass capability, and disk access up to 2 Gb/s per loop.
Disk drives
The Symmetrix DMX-3 uses industry-standard 2 Gb/s Fibre Channel
disk drives for physical disk drives. The disk drives are installed in
the front of storage bays and connect to a midplane. Each disk drive
is integrated with a dual-port Fibre Channel Arbitrated Loop (FC-AL)
controller with Fibre Channel interface that transports SCSI protocol.
The Symmetrix DMX-3 supports Fibre Channel loops ranging from
15 drives to 60 drives per loop. Table 11 on page 63 lists the features
for each type of Symmetrix DMX-3 disk drive.
a. Contact your EMC Sales Representative for the latest drive specifications.
b. These specifications are subject to change.
Link control cards
(LCC)
The link control card’s main function is to provide services to the
drive enclosure, which includes the capability to control functionality
and monitor environmental status. Each drive enclosure has two
LCCs. The LCC performs the following functions:
◆Individual Fibre Channel disk poweron and poweroff functions
◆Loop configuration control
◆Failover control
◆Marker LED control
◆Individual disk port control
◆Drive presence detection
◆Reporting of temperature and voltage status information
◆RS-232 monitoring of the BBU modules that support the
components in the storage bay
300 GB
10 K / 15K rpm
a
450 GB
15K
500 GB
7.2 K rpm
Power supply/
cooling module
Two power supply/cooling modules provide all necessary power
and cooling to the 15 disk drives in the disk enclosure in an N+1
configuration.
Fibre Channel disk subsystem
63
Page 64
Symmetrix DMX-3 Hardware
Symmetrix DMX disk
drive capacities
Precise storage capacity values depend on:
◆Whether the user configures the disk to emulate an open systems
device or a mainframe 3390 device.
◆Whether the user calculates a gigabyte to equal:
• 1,000 * 1,000 * 1,000 bytes
• or 1,024 * 1,024 * 1,024 bytes
◆The number of logical volumes configured on the disk.
Table 12 on page 65 shows the available Symmetrix cylinders and
storage capacities for 73 GB, 146 GB, 300 GB, 450 GB, and 500 GB disk
drives based on the open systems, mainframe, and iSeries
emulations. When calculating total system capacity, the following
must also be included: 24 GB of total capacity is reserved for internal
Symmetrix File System use. From 160 to 640 GB of total capacity is
reserved for vaulting data from memory during system power down.
Each DMX-3 system requires a minimum of two global spare drives
and one additional global spare drive for every 100 disk drives or a
portion thereof. For example, a DMX-3 with 547 disk drives requires
2 + 6= 8 global spare drives.
64
EMC Symmetrix DMX-3 Product Guide
Page 65
Symmetrix DMX-3 Hardware
The GB values shown in Table 12 on page 65 are based on the
following conventions: The GB
1024 bytes. The GB
value is based on 1 GB = 1000 * 1000 * 1000
10
value is based on 1 GB = 1024 *1024 *
2
bytes. Although the open systems GB values are expressed
differently, they are equivalent.
a. Contact your local EMC Sales Representative for information on 3380 emulations, disk drives, and data protection methods.
Fibre Channel disk subsystem
N/A
65
Page 66
Symmetrix DMX-3 Hardware
Symmetrix DMX-3
logical volume
capacities
The maximum number of logical volumes supported on Symmetrix
DMX-3 physical disk drives depends on the data protection used.
Table 13 on page 66 describes the logical volumes supported on
Symmetrix DMX disk drives.
Tabl e 1 3Logical volumes supported on Symmetrix DMX-3 disk drives
Symmetrix DMX-3 disk drives and data protection
Logical volumes per disk drive with SRDF Protection (without local data protection)160
Logical volumes per disk drive with RAID 1 Protection173
Logical volumes per disk drive with RAID 5 (3+1) Protection255
Logical volumes per disk drive with RAID 5 (7+1) Protection255
Logical volumes per disk drive with RAID 6 (6+2) Protection255
Logical volumes per disk drive with RAID 6 (14+2) Protection255
Logical volumes per disk drive with RAID 10 Protection (mainframe data volumes only)255
a. For information on Symmetrix DMX-3 data protection options, refer to Table 28 on page 189.
Note: “Open systems hypervolumes” on page 127 or “Mainframe systems
hypervolumes” on page 132 contain more information on logical volumes.
Configuration requirements for Symmetrix systems vary according to the
applications used. To configure logical volumes for optimum Symmetrix
system performance, consult your local EMC Sales Representative.
a
Maximum logical volumes
66
The Symmetrix DMX-3 can support up to 64,000 logical volumes,
depending on the number of disk directors, the type of data
protection, and hardware configuration. Table 14 on page 67
describes the maximum logical volumes supported on DMX-3
systems by the number of drives, DA boards, and type of data
protection employed.
Note: “Logical volumes supported for DMX-3 systems” on page 67 shows
the maximum logical volumes available for the Symmetrix DMX-3 with the
number of disk drives stated and a homogeneous protection scheme on those
disk drives. The logical volume limit is a function of the number of disk
directors, disk drives, Enginuity level, and data protection type. Consult your
local EMC Sales Representative for currently supported logical volumes for
DMX-3 systems.
EMC Symmetrix DMX-3 Product Guide
Page 67
Symmetrix DMX-3 Hardware
Maximum number
of disk drives
Tabl e 1 4Logical volumes supported for DMX-3 systems
Number of DA
boards
Data protectionMaximum logical volumes per system
1,9208SRDF64,000
1,9208RAID 164,000
1,9208RAID 5 (3+1)64,000
1,9208RAID 5 (7+1) 32,768
1,9208RAID 6 (6+2)30,720
1,9208RAID 6 (14+2)15,360
1,9208RAID 1016,000
1,4406SRDF64,000
1,4406RAID 164,000
1,4406RAID 5 (3+1)49,152
1,4406RAID 5 (7+1) 24,576
1,4406RAID 6 (6+2)23,040
1,4406RAID 6 (14+2)11,520
1,4406RAID 1016,000
9604SRDF64,000
9604RAID 164,000
9604RAID 5 (3+1)32,768
9604RAID 5 (7+1) 16,384
9604
9604
9604
2402
2402
2402
2402
2402
2402
2402
RAID 6 (6+2)
RAID 6 (14+2)
RAID 10
SRDF
RAID 1
RAID 5 (3+1)
RAID 5 (7+1)
RAID 6 (6+2)
RAID 6 (14+2)
RAID 10
15,360
7,680
16,000
20,760
20,760
15,300
7,650
3,840
1,920
7,650
Fibre Channel disk subsystem
67
Page 68
Symmetrix DMX-3 Hardware
Configuration rules
for vault devices
Vault devices are volumes on designated physical disk drives that
reserve a dedicated 5 GB space for vaulting data including metadata.
The following configuration rules apply to the vaulting drives and
disk directors:
◆Each disk director pair requires 32 such dedicated devices for a
total of 160 GB of vault space per disk director pair.
◆The vault devices can only use single-mirror data protection and
cannot be configured with TimeFinder/Snap, virtual, or dynamic
spare devices.
◆Vault drives are eligible for permanent sparing if there is a valid
spare on the same port. The vault device cannot be moved to a
different loop, but it can be moved to a different location on the
same loop. “Permanent sparing” on page 213 contains additional
information
◆The drive pool, virtual devices, or drive devices cannot reside in
the 5 GB of vault space. However, they can reside on the same
physical disk drive as the vault devices but not within the vault
devices.
◆The distribution of the vault devices across the disk directors, the
back-end interfaces, and the physical disks should be such that a
full vault will be possible within the time frame dictated by the
capacity of the battery (up to five minutes).
◆The total capacity of all of the vault hypervolumes in the system
will be at least sufficient to keep two logical copies of the
persistent part of global memory.
Symmetrix DMX disk
drive emulations
68
EMC Symmetrix DMX-3 Product Guide
Symmetrix DMX systems support connectivity to mainframe systems
and open systems hosts. When the Symmetrix DMX systems are
configured to open systems hosts such as UNIX, Windows, Linux, or
iSeries the Symmetrix disk drives emulate standard disk drives.
When the Symmetrix DMX systems are configured to IBM
z/OS/PCM system hosts, the Symmetrix disk drives emulate IBM
CKD DASD.
Note: The Symmetrix Enterprise Storage Platform (ESP) software enabler, a
software option, is required if you plan to store and access mainframe and
open systems data on the same Symmetrix system.
Page 69
Symmetrix DMX-3 Hardware
Deleting (and then
adding) devices
online
Open system disk
emulation
FBA data and
command format
Enginuity supports removing and then adding devices online, which
facilitates the following configuration enhancements:
◆Change Device Emulation Online — Remove a CKD volume and
add an FBA volume.
◆Convert between mirrored and RAID protected volumes.
◆The optimal order is to delete devices and then add. If done in the
reverse order, unnecessary global memory will be allocated for
the deleted devices.
◆When attempting to add or delete devices, or change protection
type of devices, a new minimum cache value will be calculated.
In rare cases this new value could prohibit the changes until
additional memory is added to the system.
On open systems hosts, the Symmetrix DMX logical disk volumes
appear as standard SCSI disk drives with data stored in Fixed Block
Architecture (FBA) format. All host logical volume manager software
can be used with Symmetrix disk volumes. The following paragraphs
describe the FBA disk format and logical volume structure.
Fixed Block Architecture (FBA) disk drives store data in fixed-sized
blocks (typically 512 bytes). A disk drive using FBA format is viewed
as a large array of blocks. The physical position of each block
(cylinder and track) is usually not significant to the host. When
requesting disk access for read or write, the host addresses a file by
the logical block address (LBA) of the starting block and a count of
the total blocks used by the file. Symmetrix channel directors and
disk directors control access to global memory and disk drives,
responding to host requests as a standard disk drive.
Logical volume
structure (open
systems)
Note: Disk drives in Symmetrix DMX systems attached to iSeries hosts are
configured in 520-byte blocks.
The channel directors interact with global memory. Therefore, there is
no physical meaning to cylinders, tracks, and heads on the
Symmetrix logical volume from the front-end point of view.
However, Symmetrix systems use a logical geometry definition for
their logical volume structure. This geometry is reflected in the mode
sense data available to the host.
Fibre Channel disk subsystem
69
Page 70
Symmetrix DMX-3 Hardware
Symmetrix systems use the following logical volume structure:
◆Each logical volume has n cylinders
◆Each cylinder has 15 tracks (heads)
◆Each track has 128 blocks of 512 bytes
Therefore, a Symmetrix logical volume with n cylinders has a usable
block capacity of:
n * 15 * 128
n for each volume is defined during Symmetrix configuration.
To calculate the size of the logical volume:
Number of cylinders * heads * blocks * 512
(n * 15 * 128* 512)
Note: “Open systems hypervolumes” on page 127 provides information on
configuring open systems logical volumes.
Flexible device
geometry
(for Sun Solaris hosts)
Flexible device geometry improves interoperability when migrating
data between DMX-3 or DMX-4 and older Symmetrix systems. When
the Symmetrix DMX-3 was introduced, the disk geometry presented
to the host by the disk array changed. The number of sectors per track
was doubled to 128, which also led to a doubling of the cylinder size.
In the Sun Solaris operating system, disk geometry, disk size,
manufacturer ID, and the partition table are stored in the label in
sector 0 of the disk. The label is written to the disk using the format
utility, which makes a device usable to the OS. When a Solaris device
is opened for I/O activity, the label is written to host cache and the
SCSI driver uses the partition information to translate relative
partition addresses to device absolute logical block addresses.
The difference between disk geometries will not cause issues in most
scenarios. However, there are three pieces of information contained in
the disk label that, if modified, can cause a new label to be written by
the operating system. If disk geometry, manufacturer ID, or the size
of the disk drive change, format will write a new label if “auto
configure” is run from the format> type menu, followed by label.
When a device is migrated to a DMX-4 or DMX-3 using a product
that produces a track-by-track copy of the source device on the target
device (SRDF, RecoverPoint, or Open Replicator for example), the
entire device is migrated including the VTOC label. When this occurs
between devices with heterogeneous disk geometries, there will be a
difference between the disk geometry written in the label on the
target (which was copied from the source) and the disk geometry that
70
EMC Symmetrix DMX-3 Product Guide
Page 71
Symmetrix DMX-3 Hardware
is presented to the target host by the DMX-4 or DMX-3. If the device
is re-labeled, there may be potential issues with data availability.
This is because Solaris reserves two cylinders from every device for
use by the operating system. DMX-4 and DMX-3 cylinders are twice
as large as cylinders from previous generation Symmetrix disk
arrays, meaning that the operating system will overwrite the last 1920
sectors of the user data area with an area reserved for operating
system use. It should be noted that, regardless of a difference in
geometry between the label and the actual disk, no issue will be seen
if the disk is not re-labeled by the user. This potential issue has been
resolved with the introduction of Flexible Device Geometry.
To alleviate any potential for corruption, two features have been
added to Symmetrix Enginuity. A bin file setting has been included
that allows the DMX-3 and DMX-4 to present an external device
geometry for all Symmetrix devices that is identical to the device
geometry of earlier Symmetrix arrays. Functionality has also been
added to Enginuity that allows alternate disk geometry to be
presented on a device by device basis.
Note: Contact your EMC Customer Engineer to determine if this feature
should be enabled on your Symmetrix DMX system.
IBM CKD DASD disk
emulation
The Symmetrix DMX system appears to mainframe operating
systems as a 3990-6, 2105, or 2107 controller. The physical disk drives
can appear to the mainframe operating system as a mix of multiple
3390 and 3380 device types. All standard models of the 3380 or 3390
volumes can be emulated up to the physical volume sizes installed.
Fibre Channel disk subsystem
71
Page 72
Symmetrix DMX-3 Hardware
A single Symmetrix system can simultaneously support both 3380
and 3390 device emulations. Table 15 on page 72 lists the Symmetrix
characteristics for some standard IBM device emulation modes.
Symmetrix systems also support nonstandard device sizes, as long as
the cylinder count does not exceed that of the equivalent IBM device
type.
Contact your EMC Sales Representative for 3380 support.
Note: Appendix A “Symmetrix DMX-3 Specifications,”contains more IBM
DASD emulation characteristics.
Tabl e 1 5IBM DASD emulation characteristics
IBM DASD modelMB/volumeBytes/trackBytes/cylinderCylinders/volume
a
3390-54
3390-2727,84456,664849,96032,760
3390-98,51456,664849,96010,017
3390-32,83856,664849,9603,339
3390-21,89256,664849,9602,226
55,68856,664849,96065,520
72
3390-194656,664849,9601,113
a
3380K
a. Contact your local EMC Sales Representative for currently supported IBM Controller/DASD emulation modes and 3380 support.
Mixed track
geometries
1,89147,476712,1402,655
You can configure a Symmetrix DMX system with both 3380 and 3390
track geometries on the same disk device (3380 and 3390 devices
cannot be defined in the same SSID or LCU). A single disk device can
contain up to 255 logical volumes, depending on the data protection
used.
Note: “Mainframe systems hypervolumes” on page 132 contains
information on configuring mainframe logical volumes.
IBM/PCM data and
command formats
All Symmetrix systems support the count-key-data (CKD) and
extended count-key-data (ECKD) format used by IBM 3390 and 3380
DASD. For a full description of the channel command words (CCW)
supported, refer to the IBM 3390 Storage Control Reference. Figure 12
on page 73 shows the CKD track format emulated for 3390 and 3380
DASD.
EMC Symmetrix DMX-3 Product Guide
Page 73
Symmetrix DMX-3 Hardware
Index
marker
R0
Magnetic
disk
Figure 12Track format for 3390 DASD
HAD
KC
Track format
All tracks are written with formatted records. The start and end of
each track are defined by the index marker. Each track has the same
basic format as that shown in Figure 12 on page 73. That is, it has an
index marker, home address (HA), record zero (R0), and one or more
data records (R1 through Rn). These track formats are discussed in
the following sections.
Information is recorded on all Symmetrix disk drives in an emulation
format chosen at configuration. Each track contains certain nondata
information (such as the address of the track, the address of each
record, the length of each record, and the gaps between each area),
and data information.
Index marker — An index marker indicates the physical beginning
and end of each track for each disk drive (Figure 12 on page 73).
Index
marker
R1
KCD
Home address (HA) — There is one home address on each track that
defines the physical location of the track by specifying the track
address (cylinder and head location) and the condition of the track
(flag byte). The flag byte indicates whether the track is usable,
defective, or an alternate track.
Record zero–r0 (track descriptor record) — This is the first record
after the home address. The Count field indicates its physical location
(cylinder and head), record number, key length, and data length. In
general, the key length is zero bytes and the data length is eight.
Data records (R1 through Rn) — All remaining records on a track are
data records. The Count field indicates the data record's physical
location (cylinder and head), record number, key length, and data
length. The key is optional and, when used, contains information
used by an application. The data area contains the user data. To
determine the number of records a track can hold, refer to the IBM
3390 Direct Access Storage Introduction or IBM 3380 Direct Access
Storage Introduction for the equations for calculating this number.
Fibre Channel disk subsystem
73
Page 74
Symmetrix DMX-3 Hardware
Track capacityTrack capacity is the maximum capacity achievable when there is one
physical data record per track formatted without a key. Because the
track can contain multiple data records, additional Address Markers,
Count Areas, and gaps reduce the number of bytes available for data.
The track capacity is the number of bytes left for data records after
subtracting the bytes needed for the home address, record zero,
address marker, count area, cyclic check (for error correction), and the
gaps for one data record.
For 3390 emulations, the track capacity is 56,664 bytes. For 3380
emulations, the track capacity is 47,476 bytes.
74
EMC Symmetrix DMX-3 Product Guide
Page 75
Channel, disk, and global memory directors
This section describes the Symmetrix DMX-3 directors. The channel
directors and global memory directors manage the storage control
functions. The disk directors handle the data storage functions.
Symmetrix DMX-3 Hardware
Channel director
connectivity
The Symmetrix DMX-3 provides channel connectivity through
combinations of mainframe systems and open systems channel
directors. These include:
◆Fibre Channel directors (also used with SRDF)
◆ESCON directors
◆ESCON directors used for SRDF, data migration, and the SDMS
™
(Symmetrix Data Migration Service) application
◆Multiprotocol Channel Directors (MPCD) available with these
channel connection combinations:
• Fibre Channel
•FICON
•iSCSI
• GigE (Gigabit Ethernet) remote directors used for SRDF
• GigE IPv4/v6 (IPsec capable) directors
Note: The Symmetrix DMX-3 supports mixed ESCON, FICON, Fibre
Channel, and iSCSI interfaces when the required Symmetrix ESP software is
installed on the Symmetrix system. Contact your local EMC Sales
Representative for currently supported host connectivity.
The Symmetrix DMX-3 supports open systems hosts such as UNIX
systems, Linux systems, and Windows connectivity through
Symmetrix Fibre Channel or iSCSI directors. (iSeries connectivity is
only supported through Fibre Channel directors.) The Symmetrix
DMX-3 supports mainframe connectivity through ESCON and
FICON directors. The Symmetrix DMX-3 connects directly to host
processors through physical channel attachments. Table 16 on
page 76 describes the protocols that are supported by the Symmetrix
DMX-3 channel directors.
Channel, disk, and global memory directors
75
Page 76
Symmetrix DMX-3 Hardware
Tabl e 1 6Supported protocols and Symmetrix DMX-3 channel directors
Protocol
4 Gb/s Fibre Channel host/SAN ports 2-64 1-8 per Fibre Channel Director
2 Gb/s Fibre Channel remote replication ports 2-8 1-4 per Fibre Channel Director
1 Gb/s iSCSI ports 2-32 1-4 per Multiprotocol Channel Director
1 Gb/s GigE remote replication ports 2-8 1-4 per Multiprotocol Channel Director
1 Gb/s GigE IPv4/v6 (IPsec capable)2-81-4 per Multiprotocol Channel Director
4 Gb/s FICON host ports 2-321-4 per Multiprotocol Channel Director
ESCON host ports 2-801-8 per ESCON Channel Director
ESCON remote replication ports 2-8 1-4 per ESCON Channel Director
a. Contact your local EMC Sales Representative for ESCON channel director and GigE Remote support availability.
b. Usable ports are per qualified channel directors.
a
Usable system ports
b
Ports per channel director
Channel director
descriptions
Symmetrix DMX-3 channel directors are single boards that occupy
one slot on the Symmetrix midplane. All channel directors interface
to host channels through interface adapter cards connected to the
opposite side of the midplane. The Symmetrix DMX-3 supports up to
12 channel directors.
Note: Appendix C “Planning and Installation,”provides information on
mainframe and open systems channel director configurations. Contact your
local EMC Sales Representative for specific supported configurations.
All channel directors contain four high performance processor
complexes. The channel directors process data from the host and
manage access to global memory over a direct matrix (DMX)
technology (Figure 8 on page 54). Each channel director on the
Symmetrix DMX-3 supports eight internal links to global memory.
DMX technology is used across the Symmetrix system, as it is also
designed into each global memory director. In addition to DMX
technology, each director includes support for a separate message
matrix for the transfer of control information.
Note: “DMX-3 point-to-point message matrix” on page 55 and
“DMX-3 communications and environmental control” on page 89
provide information on the Symmetrix DMX message matrix.
Table 17 on page 77 describes the DMX-3 channel director models.
76
EMC Symmetrix DMX-3 Product Guide
Page 77
Symmetrix DMX-3 Hardware
Tabl e 1 7Symmetrix DMX-3 channel director models and descriptions
Fibre
Description
Model number
DMX3-80000B8-port Fibre Channel (FC) Director (8 MM ports)8
DMX3-71000B8-port Fibre Channel Director (7 MM /1 SM port)7 1
DMX3-62000B8-port Fibre Channel Director (6 MM/2 SM ports)6 2
DMX3-00004B4-port FICON Channel Director (4 SM ports)4
DMX3-00040B4-port FICON Channel Director (4 MM ports)4
DMX3-00103B4-port MPCD
DMX3-004004-port GigE or iSCSI Channel Director (4 MM ports)4
DMX3-ESCD88-port ESCON DIR (8 MM ports) N/AN/AN/AN/AN/A
DMX3-40002B6-port MPCD (4 FC MM. port/2 FICON SM ports)4 2
DMX3-40200B6-port MPCD (4 FC MM. ports/2 GigE or iSCSI MM ports)4 2
DMX3-60100B7-port MPCD (6 FC MM. ports/1 GigE or iSCSI MM ports)61
DMX3-00103BS 4-port MPCD (1 GigE IPv4/v6 (IPsec capable) MM port/ 3 FICON SM
ports)
DMX3-00400S4-port GigE or iSCSI Channel Director (4 GigE IPv4/v6
(IPsec capable) MM ports)
DMX3-40200BS 6-port MPCD (4 FC MM ports/ 2 GigE IPv4/v6 (IPsec capable) MM
ports)
DMX3-60100BS 7-port MPCD (6 FC MM ports/ 1 GigE IPv4/v6 (IPsec capable) MM
port)
a. Contact your local EMC Sales Representative for currently supported host channel directors and GigE remote directors.
b. MM = multimode. SM = single-mode.
c. MPCD = Multiprotocol Channel Director.
c
(1 GigE or iSCSI MM port/3 FICON SM ports)1 3
a
Channel
b
GigEFICON
MM SMMMMMSM
13
4
42
61
Fibre Channel
directors (front-end)
The Fibre Channel front-end director has eight FC ANSI compliant,
4 Gb/s (also configurable to 2 Gb/s, and 1 Gb/s) Fibre Channel
interfaces for connection to host systems. The director has eight
high-speed paths to global memory. The Fibre Channel director
interfaces to the host channels through an eight-port Fibre Channel
interface adapter and is available in single-mode and multimode
configurations (Table 17 on page 77). Each Symmetrix DMX Fibre
Channel director supports eight internal links to global memory. Data
transfers between host and global memory can execute concurrently
across all Fibre Channel ports on a director. Table 18 on page 78 lists
Channel, disk, and global memory directors
77
Page 78
Symmetrix DMX-3 Hardware
Tabl e 1 8Symmetrix devices and addressing capabilities
Maximum Symmetrix devices and device addresses
Symmetrix devices per processor complex4,096
Symmetrix devices per Fibre Channel director16,384
Addresses range per port0–4,095 (0x000–0xFFF)
a. Each Fibre Channel front-end director has four processor complexes.
the Fibre Channel front-end support capabilities for directors, their
Symmetrix devices, and their addressing.
for Fibre Channel front-end directors
Maximum Symmetrix devices per front-end
Fibre Channel processor complex
Note: The numerical values for Symmetrix devices stated in Table 18 on
page 78 are the maximum allowed according to the architectural limits of the
microcode running on the Fibre Channel front-end director. The actual limits
allowed for customer environments will be lower and are dependent on the
host type, HBA and driver type/version, and overall system implementation.
Also, note that using metadevices will reduce the number of host-visible
volumes for a given number of devices (Symmetrix Devices) configured to
the Fibre Channel front-end director; that is, each member of the metadevice
will be counted to the allowed limit of devices configured to a Fibre Channel
front-end director
the EMC Powerlink website.
. For information on Fibre Channel host attachments, go to
a
Fibre Channel
adapters
(front-end)
Fibre Channel
directors for SRDF
iSeries Fibre Channel
Connectivity
78
EMC Symmetrix DMX-3 Product Guide
The Symmetrix DMX-3 can support up to eight qualified Fibre
Channel directors. Contact your local EMC Sales Representative for
specific supported configurations.
The Symmetrix DMX-3 Fibre Channel adapters provide the
connectivity between the host channels and the Fibre Channel
front-end director through optical transceiver connections.
Note: Symmetrix Fibre Channel directors currently support connections to a
number of hosts supporting Fibre Channel connectivity. For a current list of
supported hosts, go to the EMC Powerlink website.
The Fibre Channel host director can be Enginuity-configured as the
link between Symmetrix units in a Symmetrix Remote Data Facility
(SRDF) configuration. The Fibre Channel director interfaces to
Symmetrix channels through the Fibre Channel interface adapter.
The Symmetrix Fibre Channel Adapters, through fibre, connect to the
iSeries 270 and 8xx models. When using directly connected fibre
devices (point-to-point) the maximum distance is 500 m in 1 Gb/s
mode.
Page 79
Symmetrix DMX-3 Hardware
ESCON channel
directors
The Symmetrix DMX-3 ESCON director has eight ESCON channel
interfaces for connection to host systems and eight high-speed paths
to global memory. The ESCON channel director interfaces to the host
channels through an eight-port ESCON channel interface adapter
and supports data transfer rates up to 17 MB/s per port.
The Symmetrix ESCON director can support up to 1,024 logical paths
per port when only the A port of the A and B ports of the processor is
configured and up to 512 logical paths per port when both the A and
B ports are configured.
Note: Contact your local EMC Sales Representative for ESCON channel
director availability.
The Symmetrix DMX-3 may support 2 to 10 ESCON channel
directors. Table 19 on page 79 describes the ESCON channel
configurations supported in the DMX-3.
Tabl e 1 9ESCON director configurations
A and B port enabledA port enabled
Maximum LCU (logical control units) per port16 (00 to 0F)16 (00 to 0F)
Maximum LCUs per Symmetrix system250250
Maximum devices per LCU256256
Maximum logical paths per port 5121,024
Maximum logical paths per LCU per port 3264
Maximum DMX channel addresses per one or two ports2,048 + 2,0482,048
Maximum DMX channel addresses per Symmetrix system consisting of up to
64,000 base devices (physical devices) with up to 255 aliases (logical devices)
Maximum concurrent I/O host connections per Symmetrix DMX system
a. The maximum concurrent I/O connections is based on 10 ESCON directors. Contact your local EMC Sales Representative for specific
supported configurations.
a
64,00064,000
8040
SDMS supportThe Symmetrix ESCON director supports the SDMS (Symmetrix
Data Migration Service) application for migrating data over ESCON
channels from one Symmetrix system to ESCON channels on another
Symmetrix system.
Channel, disk, and global memory directors
79
Page 80
Symmetrix DMX-3 Hardware
Multiprotocol
Channel Directors
FICON channel
director
The Symmetrix DMX-3 Multiprotocol Channel Director (MPCD),
through mezzanine card technology, supports Fibre Channel, GigE,
GigE IPv4/v6 (IPsec capable), iSCSI, and FICON protocols on
Symmetrix DMX systems.
The MPCD implements a flexible mezzanine card that delivers highly
configurable support for FICON channels to mainframe systems,
Fibre Channel connections to open systems configurations, or Gigabit
Ethernet support for iSCSI, or SRDF over IP connections.
Note: Contact your local EMC Sales Representative for currently supported
protocols. Table 17 on page 77 describes the supported Multiprotocol models.
FICON channel directors support native mode point-to-point
connections and FICON native mode switched point-to-point
connections to IBM 9672, G5/G6, z/900, and z/990 systems running
z/OS, z/VM, VM/ESA, and VSE/ESA operating systems. FICON
employs ESCON protocols that have been mapped to the FC-4
upper-level protocol layer of the Fibre Channel architecture. FICON
supports multiple concurrent I/O connections, channel program
multiplexing, and better link utilization than ESCON path switching.
FICON allows the consolidation of multiple ESCON channels into
one FICON channel.
The FICON mezzanine card provides up to four single-mode or
multimode LC bidirectional (full duplex) connections. Symmetrix
FICON channels transfer data at speeds up to 4 Gb/s.
80
Note: “Symmetrix FICON configurations” on page 94 contains information
on additional configuration options.
The Symmetrix DMX FICON design auto-detects 4 Gb/s, 2 Gb/s or
1 GB/s at switch or channel port login time.
The Symmetrix DMX-3 system may support up to eight FICON
channel directors. Table 20 on page 81 describes the FICON channel
director configurations supported in the DMX-3.
EMC Symmetrix DMX-3 Product Guide
Page 81
Symmetrix DMX-3 Hardware
Tabl e 2 0FICON director configurations
Maximum LCUs (logical control units) per port64 (00 to FE)
Maximum LCUs per Symmetrix system250
Maximum devices per LCU256
Maximum logical paths per port 8,192
Maximum logical paths per LCU per port 128
Maximum DMX channel addresses per port8,192
Maximum DMX channel addresses per Symmetrix system, base and alias 64,000
Maximum I/O host connections per Symmetrix DMX system
a. The maximum I/O connections are based on 8 FICON directors for the DMX-3. Contact your local EMC Sales Representative for specific
supported configurations.
a
32
Gigabit Ethernet
(GigE) remote
directors
GigE remote mezzanine cards on the MPCD enable remote director
functionality based upon Gigabit Ethernet technology that enable
direct Symmetrix-to-IP network attachment and eliminate the need
for expensive media converter appliances.
GigE support for SRDF on Symmetrix DMX systems:
◆Increases the options for Symmetrix-to-Symmetrix connectivity.
◆Allows the Symmetrix system to connect to your existing
Ethernet infrastructure and directly access high-speed data
transmission conduits using Internet Protocol (IP).
◆Supports SRDF traffic to one or more remote Symmetrix systems
that also have GigE remote directors installed.
◆Supports TCP/IP protocols and function layers.
◆Is fully compatible with the SRDF protocols and other Symmetrix
DMX directors, drives, software, and protection schemes.
Symmetrix DMX GigE remote channels for SRDF transfer data at
speeds up to 1 Gb/s. The GigE director provides up to four 1 Gb/s
Ethernet ports and connects using LC connectors. It is compatible
with Symmetrix DMX-2 and Symmetrix 8000 systems.
Channel, disk, and global memory directors
81
Page 82
Symmetrix DMX-3 Hardware
GigE IPv4/v6 (IPsec
capable) director
iSCSI channel
directors
The GigE IPv4/v6 (IPsec capable) channel director provides support
for the latest Internet Protocol standards, including IPsec (Internet
Protocol Security) and IPv6. The embedded line-grade encryption
co-processor provides strong security without degrading
performance. Preshared encryption keys simplify management while
maintaining security for data in transit.
These directors can co-exist in the same system with any existing
DMX-3 channel directors. With the new director, IPsec can be enabled
on a port-by-port basis. IPsec is enabled through a separately
purchased software license.
The IP Stack version can be similarly configured per port. No
additional software license is required.
The number of IPsec sessions will be limited to 100 per port. IPsec can
be enabled for SRDF connections. IPsec enabled and IPsec disabled
channel directors can co-exist in the same Symmetrix.
“IPsec security features” on page 187 contains additional
information on IPsec.
The Symmetrix DMX-3 MPCD, through mezzanine card technology,
supports iSCSI channel connectivity by way of Gigabit Ethernet
(GigE) hardware for the Symmetrix DMX systems. The iSCSI channel
director supports iSCSI channel connectivity to IP networks and to
iSCSI-capable open systems server systems for block storage transfer
between hosts and storage. The primary applications are storage
consolidation and host extension for stranded servers and
departmental workgroups. Symmetrix GigE remote channels for
SRDF transfer data at speeds up to 1 Gb/s. The Symmetrix iSCSI
director provides up to four 1 Gb/s Ethernet ports and connects
using LC connectors.
82
The iSCSI directors support the iSNS protocol, a mechanism that
provides Naming and Discovery services for iSCSI initiators. The
iSNS server information is configured in the Symmetrix IMPL file for
each iSCSI director. Each iSCSI director must register itself with the
iSNS server, which provides:
◆A mechanism to query iSNS server to find other hosts/targets
◆Support for State Change Notification and Status Inquiry
The iSCSI director supports TCP/IP protocols and function layers. It
is fully compatible with the SRDF protocols and other Symmetrix
DMX directors, drives, software, and protection schemes.
EMC Symmetrix DMX-3 Product Guide
Page 83
Symmetrix DMX-3 Hardware
Fibre Channel disk
directors
(back-end)
Global memory
directors
The Symmetrix DMX-3 Fibre Channel back-end disk directors
manage the interface to the disk drives, and are responsible for data
movement between the disk drives s and global memory. Each disk
director on a Symmetrix DMX system supports eight internal links to
global memory.
The Symmetrix DMX-3 features a 2 Gb/s Fibre Channel back-end
infrastructure. The Fibre Channel disk director has eight multiplex
processors that support one port each on its back adapter.
The Symmetrix DMX-3 is available with two, four, six, or eight disk
directors, supporting Fibre Channel loops ranging from 15 drives to
60 drives per loop.
Note: For information on maximum logical volumes supported on each
Symmetrix DMX physical disk drive and the maximum logical volumes
supported for each Symmetrix DMX model, refer to “Symmetrix DMX-3
logical volume capacities” on page 66.
The Symmetrix DMX-3 global memory director technology is one of
the most crucial components of a Symmetrix system. The DMX-3 uses
global memory directors that use industry-standard Double Data
Rate Synchronous Dynamic Random-Access Memory (DDR
SDRAM), the latest generation of DDR SDRAM chip technology.
All read and write operations transfer data to or from global memory.
Any transfers between the host processor, channel directors, and
global memory directors are achieved at much greater electronic
speeds than transfers involving disks. The DMX-3 global memory
directors work in pairs. The hardware writes to the primary global
memory director first, and then automatically writes data to the
secondary global memory director. All reads are from the primary
memory director. Upon a primary or secondary global memory
director failure, all directors drop the failed global memory director
and switch to a nondual write mode. Striping between global
memory directors is default.
Each Symmetrix DMX-3 global memory director accommodates four
separately addressable, simultaneously accessible memory regions,
which greatly reduces the probability of contention for global
memory access.
Channel, disk, and global memory directors
83
Page 84
Symmetrix DMX-3 Hardware
Dir 3
Dir 4
Dir 7
Dir 8
Dir 9
Dir 10
Dir 14
Dir 13
Dir 1
Dir 2
Dir 5
Dir 6
Dir 11
Dir 12
Dir 15
Dir 16
M 0
M 1
M 2
M 3
M 4
M 5
M 6
M 7
Each global memory director has 16 ports with point-to-point serial
connections between the global memory director and channel or disk
directors (16 directors) through the direct matrix. Each memory
director port consists of a pair of full-duplex serial links—two serial
links out (TX) and two serial links in (RX).
Each of the eight director ports on the 16 directors connect to one of
the 16 memory ports on each of the eight global memory directors
(Figure 13 on page 84). These 128 individual point-to-point
connections facilitate up to 128 concurrent cache operations in the
system.
84
Figure 13Global memory director to channel and disk director matrix
The DMX architecture ensures highest performance due to the
following:
◆Requests for global memory are expedited to reduce locking.
◆Requests are intelligently arbitrated to optimize available
resource usage.
EMC Symmetrix DMX-3 Product Guide
Page 85
Symmetrix DMX-3 Hardware
Global memory
director
configuration
The Symmetrix DMX system can support up to eight slots in the
midplane dedicated to global memory and 512 GB of global memory
(256 GB effective) global memory. Individual global memory
directors are available in 8 GB, 16 GB, 32 GB, and 64 GB sizes.
When configuring global memory for the Symmetrix DMX systems
follow these guidelines:
◆Very large eight disk director configurations may be limited or
restricted by currently available Symmetrix DMX-3 maximum
memory.
◆Global memory directors can be added to the DMX-3 not to
exceed the maximum designed for the system’s configuration.
◆Global memory directors must be configured in pairs of the same
capacity.
Channel, disk, and global memory directors
85
Page 86
Symmetrix DMX-3 Hardware
Symmetrix DMX-3 power subsystems
The Symmetrix DMX-3 power subsystem uses a 2N power
architecture.The Symmetrix DMX-3 power subsystem includes the
following features in the system bay and storage bay:
◆2N power zones
◆Dual-line cords, one for each zone per bay, providing on/off
function
◆BBU modules with internal chargers and electronic status
reporting
The DMX-3 power subsystem architecture provides two completely
separate power zones (Power Zone A and Power Zone B), each of
which can maintain power for an entire system bay or storage bay
independent of the operation of the second zone. There is no
redundancy within each zone, rather the redundancy is
accomplished through the two-zone design.
System bay power
subsystem
components
The system bay contains up to eight power supplies that are split into
two power zones—Power Zone A and Power Zone B, consisting of
up to four power supplies each. The system bay also contains up to
eight Battery Backup Unit (BBU) modules providing battery backup
in the event an AC failure occurs. One BBU provides the AC line
power, and high voltage DC backup to one power supply. The A side
BBU modules receive their power from the A side Power Distribution
Unit (PDU) and the B side BBU modules receive their power from the
B side PDU shown in Figure 14 on page 88. Two Power Distribution
Panels (PDPs), one for each zone, provide a centralized cabinet
interface and distribution control of the AC power input lines when
connected to the system bay PDUs. The PDPs contain the manual
On/Off power switches, which are accessible through the rear door.
The DMX-3 system bay PDPs are available in three-phase Delta and
three-phase WYE configurations.
Through an RS-232 interface, the XCM modules communicate with
the system bay BBU modules to determine the BBU status and run
battery tests.
86
EMC Symmetrix DMX-3 Product Guide
Page 87
Symmetrix DMX-3 Hardware
Storage bay power
subsystem
components
Symmetrix DMX-3
power configurations
The storage bay power subsystem consists of the drive enclosure
power supply/ cooling modules and the BBU modules that provide
the battery backup for the drive enclosures. The A side BBU modules
receive their power from the A side PDU and support both the A and
B side drive enclosures. The B side BBU modules receive their power
from the B side PDU shown in Figure 14 on page 88, and support
both the A and B side drive enclosures. Two PDPs, one for each zone,
provide a centralized cabinet interface and distribution control of the
AC power input lines when connected to the storage bay PDUs. The
storage bay PDPs contain the manual On/Off power switches, which
are accessible through the rear door. The DMX-3 storage bay PDPs
are available in three-phase Delta and three-phase WYE
configurations.
The Symmetrix DMX-3 power subsystem supports three-phase Delta
or three-phase WYE configurations. Each bay requires two separate
PDUs—one for Zone A and one for Zone B power for the Symmetrix
DMX-3 system bay and each storage bay shown in Figure 14 on
page 88.
Note: “Power and cooling data” on page 269, “Electrical specifications and
power requirements” on page 270, and “Symmetrix DMX-3 power
requirements” on page 288 contain more detailed information on the
Symmetrix DMX-3 power requirements. The EMC Symmetrix DMX-3 Physical Planning Guide available on the EMC Powerlink website provides additional
information.
Symmetrix DMX-3 power subsystems
87
Page 88
Symmetrix DMX-3 Hardware
Zone B
AC input
cable B
Cable connectors are shown as
they exit the bottom rear of the
DMX bays.
This cabling is internal
to the DMX bays.
The customer’s AC power feeds
are connected to these two
three-phase connectors.
DMX storage bay
rear view
Zone A
AC input
cable A
Zone B PDP
(left)
Zone A PDP
(right)
15 ft.
Extension cord
15 ft.
Extension cord
Customer’s power
distribution unit
number B
Customer’s power
distribution unit
number A
Zone B
AC input
cable B
Cable connectors are shown as
they exit the bottom rear of the
DMX bays.
This cabling is internal
to the DMX bays.
The customer’s AC power feeds
are connected to these two
three-phase connectors.
DMX system bay
rear view
Zone A
AC input
cable A
Zone B PDP
(left)
Zone A PDP
(right)
15 ft.
Extension cord
15 ft.
Extension cord
Customer’s power
distribution unit
number B
Customer’s power
distribution unit
number A
88
EMC Symmetrix DMX-3 Product Guide
Figure 14Symmetrix DMX-3 system bay and storage bay to
customer PDU power cabling
Page 89
DMX-3 communications and environmental control
Within the Symmetrix DMX-3 message matrix are the Environmental
Control Module (ECM) and Communication Control Module (CCM).
These two modules provide the low-level, system-wide
communications for running application software, monitoring, and
system diagnostics from the service processor.
Symmetrix DMX-3 Hardware
Communications
control functions
The XCM’s primary function is to act as a communications agent
between the service processor (KVM and server) and the embedded
processing nodes within the system. Figure 15 on page 90 illustrates
the Ethernet fabric interconnecting the processing nodes to the
service processor. External connections to the service processor
provide dial-home capabilities for remote monitoring and
diagnostics.
The software-driven failover mechanism exists such that the Ethernet
fabric remains intact should an XCM become temporarily
unavailable. As a backup to the Ethernet fabric, the XCM also
contains RS-232 multiplexing logic to allow for an alternate means of
serial communication to embedded processing nodes within the
DMX-3. The XCM also has the ability to issue remote commands to
the director boards, global memory directors, and itself. These
commands can be issued from the service processor or remotely, by
the EMC Customer Support Center, providing a rich set of intelligent
serviceability functions. Also within the XCM is the top-level fabric
for the message matrix communications system. This is a high-speed
communications fabric within the DMX-3 that allows for fast, reliable
messaging between compute nodes.
DMX-3 communications and environmental control
89
Page 90
Symmetrix DMX-3 Hardware
Serial
Managed
Ethernet
Switch
PowerP
C
860DP
L ap t o p
T r an s c e i v e r
I n t e r f ac e
CC
M
Managed
Ethernet
fabric
Director 1
Managed
Ethernet
fabric
Node
Director 16
R
e
d
u
n
d
a
n
t
L
i
n
k
R
e
d
u
n
d
a
n
t
L
i
n
k
Managed
Ethernet
fabric
KVM
T r a n s c e i v e r
I n t e r f a c e
XCM0
XCM1
100 Base-T
Node
Node
Node
Node
Node
Node
Node
Customer
phone line
Environmental
control functions
90
EMC Symmetrix DMX-3 Product Guide
Figure 15Communication to directors
The XCM monitors and logs environmental events across all critical
components (Figure 16 on page 91) and reports any operational
problems. Critical components include channel and disk directors,
global memory directors, power supplies, power line input modules,
fans, and various on/off switches. The XCM environmental control is
capable of monitoring each component’s local voltages ensuring
optimum power delivery. Temperature of directors and memory are
also continuously monitored. The AC power main is checked for:
◆AC failures
◆Transfer to auxiliary
◆DC failures
◆Current sharing between DC supplies
◆DC output voltage
◆Specific notification of overvoltage condition
◆Current from each DC supply
Page 91
◆Voltage drops across major connectors
Directors (16)
Memory boards (8)
Service processor
Fans (9)
BBU modules (4, 6, or 8)
Power supplies (4, 6, or 8)
Inter - XCM comm.
System ID
XCM
Ailing components can be detected and replaced before a failure
occurs.
Figure 16XCM environmental control functionality
Symmetrix DMX-3 Hardware
DMX-3 communications and environmental control
91
Page 92
Symmetrix DMX-3 Hardware
Channel attachments
The Symmetrix DMX-3 can attach to ESCON channels, FICON
channels, or Fibre Channels, or a mix of channel types. The physical
connection to a Symmetrix channel interface occurs at the connectors
on the channel adapters.
Note: The Symmetrix Enterprise Storage Platform (ESP) option is required
when both mainframe hosts (ESCON or FICON channels) and open systems
hosts (Fibre Channels, iSCSI, or GigE SRDF) connect to the same Symmetrix
system.
of supported hosts, models, operating systems, and EMC open systems host
support policies, or refer to the EMC Powerlink website.
Consult your local EMC Sales Representative for the most current list
FICON channel
interface
connections
The Symmetrix DMX-3 FICON directors connect to mainframe hosts.
The four-port, four-processor MPCD and the FICON adapter provide
the capability for four concurrent operations through four physical
interfaces for communicating with the FICON channels in host
systems.
Note: “FICON channel director” on page 80 contains more information on
the FICON director.
FICON channels use fiber optic cables. The current FICON
implementation supports data transfer rates up to 4 Gb/s. There are
two types of fiber-optic cables: multimode and single-mode.
Note: Symmetrix systems directly connect to FICON single-mode or
multimode cables. “Symmetrix FICON configurations” on page 94 contains
information on additional configuration options.
In the FICON environment, a link connects a host FICON channel
with a Symmetrix FICON channel interface. This link can be a direct
connection between the processor or LPAR and the FICON channel
interface. The link can also have a FICON director that branches off to
additional single-mode or multimode links with connections to
Symmetrix FICON channel directors. Figure 17 on page 93 illustrates
several types of FICON channel attachments.
Table 21 on page 93 describes the maximum distances supported by
FICON cables.
92
EMC Symmetrix DMX-3 Product Guide
Page 93
Symmetrix DMX-3 Hardware
SYM-000347
SM or MM
FICON
director
FICON
FCSM or MM
SM or MM
Symmetrix
FICON
director
SM or MM
FICON
FCSM or MM
SM or MM
Symmetrix
FICON
director
Symmetrix
FICON
director
Distance
inter switch
link
SM or MM
Symmetrix
FICON
director
SM
FC
FICON
Symmetrix
FICON
director
MM
FC
FICON
Symmetrix
FICON
director
FICON
director
FICON
director
Figure 17FICON channel attachments
Tabl e 2 1Symmetrix FICON cable distances
a
Cable type Cable descriptionMaximum supported distance
9 micron, 1 Gb/s• 10 km (6.2 miles) for each link
Single-mode (SM) Long wave
Laser (1,310 nm)
• Up to 20 km (12.43 miles) for each link with IBM RPQ
9 micron, 2 Gb/s• 10 km (6.2 miles) for each link
• Up to 12 km (7.45 miles) for each link with IBM RPQ
9 micron, 4 Gb/s10 km (6.2 miles) for each link
50 micron, 1 Gb/s500 m (1,640 ft) for each link
50 micron, 2 Gb/s300 m (984 ft) for each link
Multimode
50 micron, 4 Gb/s150 m (492 ft) for each link
62.5 micron, 1 Gb/s300 m (984 ft) for each link
62.5 micron, 2 Gb/s150 m (492 ft) for each link
62.5 micron, 2 Gb/s70 m (230 ft) for each link
a. Distances are point-to-point.
Channel attachments
93
Page 94
Symmetrix DMX-3 Hardware
Symmetrix FICON
configurations
In addition to the standard direct-connect configuration, Symmetrix
DMX-3 FICON models support the use of Cascading and Open
Systems Intermix configurations. Cascading can be used to reduce
the number of FICON adapters and the amount of intersite cabling
required by making use of switch-to-switch communication.
Intermix allows FICON zones to be added to existing Open Systems
switches within a site and between sites. These two features help
reduce the overall costs while providing greater FICON connectivity,
backup, and recovery.
Note: For specific Cascading and Open System Intermix configuration
requirements, contact your local EMC Sales Representative.
FICON cascading configurations
Cascading provides greatly enhanced FICON connectivity within
local and remote sites through the use of switch-to-switch extensions
of the CPU to the DMX FICON network. These cascaded switches
communicate over long distances using a small number of high speed
lines called ISLs (InterSwitch Links). Up to a maximum of two
switches may be connected together within a path between the CPU
and the DMX.
Same switch vendors are required for a Cascaded configuration. The
EMC and IBM branded McDATA and INRANGE switches are
supported in pairs. To support Cascading, each vendor requires
specific models, hardware and software features, configuration
settings, and restrictions. Specific IBM CPU models, MVS release
levels, channel hardware, and microcode levels are also required.
94
FICON open systems Intermix configurations
Open Systems Intermix allows separate FICON zones to be defined
within new or existing open systems switches. These switches can
also be Cascaded to further enhance connectivity and remote backup
and recovery. The EMC and IBM branded McDATA and INRANGE
switches are supported. To support Open Systems Intermix, each
vendor requires specific models, hardware and software features,
configuration settings, and restrictions. Specific IBM CPU models,
MVS release levels, channel hardware, and microcode levels are also
required.
EMC Symmetrix DMX-3 Product Guide
Page 95
Symmetrix DMX-3 Hardware
ESCON channel
interface
connections
The Symmetrix DMX-3 ESCON directors connect to mainframe hosts.
The eight-port, four-processor ESCON director provides the
capability for four concurrent operations through its four physical
interfaces for communicating with the serial channels in host
systems.
Note: “ESCON channel directors” on page 79 contains more information on
the ESCON director.
ESCON channels use fiber optic cables. These serial channels are
formally called the ESA/390 Enterprise Systems Connection
Architecture (ESCON) I/O interface. The serial channels use
point-to-point or switched point-to-point links. Each link has two
physical fibers for transporting data: one for inbound signals and one
for outbound signals. The current ESCON implementation supports
data transfer rates up to 17 MB/s.
There are two types of fiber optic cables: multimode and
single-mode. Multimode cables support a maximum link of
1.86 miles (3 km). Single-mode cables support a maximum link of
12.42 miles (20 km) with the Extended Distance Feature (XDF).
Note: Symmetrix systems directly connect to ESCON multimode cables only.
In the ESCON environment, a link connects a host serial or ESCON
channel with a Symmetrix serial channel (ESCON) interface. This link
can be a direct connection between the processor, or LPAR, and the
serial channel interface. This link can also have up to two ESCON
Directors configured between the processor, or LPAR, and the serial
channel interface. The Symmetrix system supports a maximum
connection length of 26.7 miles (43 km) with two single-mode cables
and one multimode cable.
Figure 18 on page 96 illustrates several types of ESCON channel
attachments. Table 22 on page 97 describes cable types and supported
distances.
Channel attachments
95
Page 96
Multimode
fiber optic
cables
Multimode
fiber optic
cables
Multimode
fiber optic
cables
Multimode
fiber optic
cables
Multimode
fiber optic
cables
Multimode
fiber optic
cables
Multimode
fiber optic
cables
Multimode
fiber optic
cables
Single-mode
fiber optic
cables
Single-mode
fiber optic
cables
Single-mode
fi
ber optic
cables
ESCON
channel
ESCON
channel
ESCON
channel
ESCON
channel
ESCON
channel
Processor
or LPAR
Processor
or LPAR
Processor
or LPAR
Processor
or LPAR
Processor
or LPAR
3 km
Max
3 km
Max
3 km
Max
3 km
Max
20 km
Max
20 km
Max
20 km
Max
3 km
Max
3 km
Max
3 km
M
ax
3 kmMax
Symmetrix
ESCON
director
Symmetrix
ESCON
director
Symmetrix
ESCON
director
Symmetrix
ESCON
director
Symmetrix
ESCON
director
Repeater
Repeater
Repeater
RepeaterRepeater
Repeater
FICON link
ESCON links
FICON LX
FCV
FICON bridge card
9032-5 ESCD
MM
<= 3 km
Symmetrix
ESCON
director
Symmetrix
ESCON
director
SM
Symmetrix DMX-3 Hardware
96
Figure 18ESCON channel attachments
EMC Symmetrix DMX-3 Product Guide
Page 97
Symmetrix DMX-3 Hardware
Tabl e 2 2Symmetrix ESCON cable distances
Cable type Cable descriptionMaximum distance
Direct fiber, multimode 50 micron2 km (1.24 miles) per cable segment
62.5 micron3 km (1.86 miles) per cable segment
a
Fiber repeaters/converters (for example,
McDATA 9191 to McDATA 9191)
3 converters/repeaters maximum allowed
Other fiber repeaters/converters
three converters/repeaters maximum allowed
a. A cable segment is a physical cable connecting one node to another.
b. Typical best-case distance specifications are quoted; refer to specific vendor’s equipment for current information.
Mainframe serial
channel extenders
This section describes the various types of conversion devices and
channel extenders compatible with Symmetrix systems for channel
9 micron 30 km (18.64 miles) per cable segment
9 micron 20 km (12.42 miles) per cable segment
attachment. Symmetrix systems can attach to ESCON (serial)
channels directly, or through ESCON channel extenders, or directors.
Note: Each repeater can be either an ESCON director or an IBM 9036 Remote
Channel Extender. If two ESCON directors are used, one of them must use
ports that are dedicated to the Symmetrix-to-ESCON channel path.
ESCON directorThe ESCON director provides dynamic switching and extended link
path lengths (with XDF capability) when attaching an ESCON
channel (TYPE=CNC) to a Symmetrix serial channel interface. One or
two ESCON directors may be configured in the channel attachment.
However, one of the directors must be configured with a static
connection because the ESCON architecture recognizes only one port
address. The dynamic switch configuration is defined in the IOCP.
The ESCON director may also be used to provide additional
flexibility and extend channel lengths when used with channel
converters.
b
Channel attachments
97
Page 98
Symmetrix DMX-3 Hardware
Channel extenderThe IBM 9036 Remote Channel Extender (or equivalent device)
attaches an ESCON channel (TYPE=CNC) to a Symmetrix serial
channel interface. The Remote Channel Extender extends the distance
of the connection and, depending on the model, can convert
connections from multimode (3 km) to single-mode (20 km).
Note: Connections to Symmetrix serial channel interfaces must be
multimode.
Open systems Fibre
Channel interface
connections
Tabl e 2 3Symmetrix Fibre Channel cable distances
The Symmetrix Fibre Channel adapter provides an interface between
the director and open systems host channels. Each Fibre Channel
adapter is located at the rear of the midplane, opposite its
corresponding channel director. These adapters provide the
connectivity between the host channels and the Fibre Channel
directors (FC-0 layer of the Fibre Channel standard).
The eight-port Fibre Channel director provides the capability for
eight concurrent operations through its eight physical interfaces for
communicating with the host systems.
Note: “Fibre Channel directors (front-end)” on page 77 contains more
information on the Fibre Channel director.
Fibre Channel directors use fiber optic cables. The channels use Fibre
Channel arbitrated loop or switched fabric links. Each link has two
physical fibers for transporting data: One for inbound signals and
one for outbound signals. The current Fibre Channel implementation
supports data transfer rates up to 4 Gb/s (Table 23 on page 98).
c
Cable type Cable descriptionMaximum distance
9 micron, 1 Gb/s10 km (6.2 miles) per cable segment
a
98
Single-mode
EMC Symmetrix DMX-3 Product Guide
9 micron, 2 Gb/s10 km (6.2 miles) per cable segment
9 micron, 4 Gb/s10 km (6.2 miles) per cable segment
Page 99
Symmetrix DMX-3 Hardware
Tabl e 2 3Symmetrix Fibre Channel cable distances
Cable type Cable descriptionMaximum distance
50 micron, 1 Gb/s500 m (1,640 ft) per cable segment
50 micron, 2 Gb/s300 m (984 ft) per cable segment
Multimode
50 micron, 4 Gb/s150 m (492 ft) per cable segment
62.5 micron, 1 Gb/s300 m (984 ft) per cable segment
62.5 micron, 2 Gb/s150 m (492 ft) per cable segment
62.5 micron,4 Gb/s 70 m (230 ft) per cable segment
a. Distances are point-to-point.
Note: For more information on Fibre Channel attachments and cables, refer
to the EMC Powerlink website.
a
Channel attachments
99
Page 100
Symmetrix DMX-3 Hardware
100
EMC Symmetrix DMX-3 Product Guide
Loading...
+ hidden pages
You need points to download manuals.
1 point = 1 manual.
You can buy points or you can get point for every manual you upload.