System Storage
TM
DS3500 Technical Overview
®
Ma Song
© 2010 IBM
Corporation
IBM Systems
System Storage
TM
Announcing…
IBM System Storage™ DS3500 Express
6 Gbps SAS-based storage system
§ Next generation entry-level storage system featuring 6 Gbps SAS
technology, improved performance, concurrent iSCSI/SAS or FC/SAS host
connectivity, increased scalability and enhanced features
Benefits
§ Affordable entry-point with midrange performance, scalability and features
§ Green efficiencies reduce energy expenditures
§ Extensive suite of Microsoft and VMware solutions
§ Ease-of-use built into a powerful and intuitive management software
§ Multi-protocol connectivity support concurrent DAS / SAN
§ Balanced performance ideally-suited for mixed workloads and virtualization
§ Enhanced security features provides relentless data protection
IBM Systems
System Storage
TM
IBM Entry-Level And Midrange Storage
Positioning
DS3500
• FC, SAS, iSCSI connectivity
• (96) SAS, SED-SAS, NL-SAS drives
• EXP3512 (12 3.5-in drive), EXP3524 (24
3.5-in drive) expansion units
DS3200, DS3300, DS3400
• FC, SAS, iSCSI connectivity
• (48) SAS, SATA drives
DS5100, DS5300
• FC, iSCSI connectivity
• (480) SSD, FC, SED, SATA drives
• EXP5000 (16 drives) or new EXP5060 (60
drives) expansion units
DS5020,DS3950*
• FC, iSCSI connectivity
• (112) FC, SED (DS5020 only), SATA drives
• EXP5020 (16 drives) expansion unit
• EXP3000 (12 drive) expansion unit
SMB / Entry-level Workgroup Department Data Center HPC
• SAS, iSCSI connectivity
• DAS/shared DAS/IP SAN
• Simple management
• Snapshot replication
• iSCSI, FC connectivity
• Shared DAS, small SAN
• Simple management
• Snapshot replication
• FC, iSCSI connectivity
• Homogeneous SANs
• Performance value
• Configuration flexibility
• Local/remote replication
• FC connectivity
• Heterogeneous SANs
• Highest performance
• Configuration flexibility
• Local/remote replication
• FC connectivity
• System clusters
• GPFS
• Maximum bandwidth
• Capacity density
IBM Systems
System Storage
TM
DS3500
§ SBB(Storage Bridge Bay) 2.0 compliant form factor
§ 2 6Gbps SAS host ports on the base board
§ Base board allows connection of one daughter card for support
of additional host interface types (1 Gbps iSCSI, 8Gbps FC)
§ Supports Simplex and Duplex system configurations
§ 6Gbps SAS support for the back end
§ 2 tray types
► EXP3524 (pictured)
► EXP3512
IBM Systems
System Storage
TM
DS3500 -Controller Canister Assembly
Memory DIMM
HIC Daughter Card
SDHC Card
Lid
Battery
DS3500 PCBA in Base
Faceplate
HIC Adapter Plate
IBM Systems
System Storage
TM
DS3500 Controller
6
IBM Systems
System Storage
TM
Core processor
§ Next-generation 6 Gb SAS
Power PC 440 ROC 800-MHz processor
– Super scalar core with a 1.9x MIPS multiplier that translates into
1.5-GHZ x-scale
§ The core processor has been updated with the 6Gbs SAS Power PC
440 ROC processor also often referred to as the meteor chip.
§ IBM PowerPC 440 内核是一个32位的RISC 的CPU，该内核充分发挥了
Book E增强型POWER架构的高可扩展性和灵活性，并专为嵌入式应用
进行了优化。
IBM Systems
System Storage
TM
DS3500 -SBB 2.0 Support
§ Midplane EEPROMs (1 per bus) contain (list not
comprehensive):
► Midplane (enclosure) VPD data
► SBB-specific data
► Drive Port Mapping Tables
► Vendor-specific data
§ Tray functionality
► Cleanly identify errors and faults
► Authenticate tray components
IBM Systems
System Storage
TM
DS3500 – Controller Block Diagram
IBM Systems
System Storage
TM
DS3500 – Back Panel w/ no Daughter Card
RS232
Ethernet
Host SAS 2.0
Expansion SAS 2.0
IBM Systems
System Storage
TM
Optional Host Daughter Card
§ Two 6 Gbps SAS ports per controller standard
§ Optional host card provide increased connectivity
and multi-protocol support
Part Number Feature Code Host Daughter Card
68Y8431 3610
68Y8432 3611
68Y8433 3612
6 Gbps SAS 2 host port
daughter card
8 Gbps FC 4 host port
daughter card
1 Gbps iSCSI 4 host port
daughter card
IBM Systems
System Storage
TM
DS3500 – Controller w/ SAS Daughter Card
Fault
Amber
Ch 3
Activity
Green
Ch 4
Host SAS 2.0
IBM Systems
System Storage
TM
DS3500 -SAS Daughter Card Block Diagram
IBM Systems
System Storage
TM
DS3500 – Controller w/ iSCSI Daughter Card
Link Up
Green
Link
Active
Green
Host iSCSI
IBM Systems
System Storage
TM
DS3500 -iSCSI Daughter Card Block Diagram
IBM Systems
System Storage
TM
DS3500 – Controller w/ FC Daughter Card
Rate
2 Gb
4 Gb
Rate
8 GB
Both
On
Ch 3
Ch 4
Ch 5 Ch 6
Host FC
IBM Systems
System Storage
TM
DS3500 -FC Daughter Card Block Diagram
IBM Systems
System Storage
TM
DS3500 – EXP3524
§ 2U
§ 24 2.5” vertical drive slots
§ Slots numbered from left to right
§ Drives supported:
Disk Interconnect Speed (rpm) Capacity (GB)
6 Gbps SAS 7,200 500 GB
6 Gbps SAS 10,000 300 GB
73 GB
6 Gbps SAS 15,000
146 GB
6 Gbps SAS SED 10,000 300 GB
IBM Systems
System Storage
TM
DS3500 – EXP3512
§ 2U
§ 12 3.5” horizontal drive slots
§ Slots just like older DS3000
enclosure
§ Drives supported:
Disk Interconnect Speed (rpm) Capacity
(GB)
1.0 TB
7,200
2.0 TB
6 Gbps SAS
15,000
6 Gbps SAS SED 15,000 600 GB
300 GB
450 GB
600 GB
IBM Systems
System Storage
TM
EXP3512 and EXP3524 ESM
§ Uses SFF-8088 4-
port wide miniSAS
connectors for host
and cascaded ESM
connections
§ “Bobcat” 36 port
expander
§ SBB 2.0 compliant
§ HW support for
standby mode and
WoS
► No FW support for
these yet
IBM Systems
System Storage
TM
Expansion Units and Cabling
EXP3512
• 2U Enclosure
• Dual-active controllers/ESMs
• 12 3.5” Drives
• SAS drive connections
• Hot-swappable CRUs
EXP3524
• All enclosures are
SBB compliant
• Enclosures are cabled
for enclosure loss
protection
• Top down, bottom up
• EXP3512 and
EXP3524 expansion
enclosures can be
intermixed behind an
DS3500
• 2U Enclosure
• Dual-active controllers/ESMs
• 24 2.5” Drives
• SAS drive connections
• Hot-swappable CRUs
IBM Systems
System Storage
TM
Supported Drives
Capacity 2.5-in. 3.5-in.
146 GB
300 GB
450 GB
500 GB
600 GB
15K 10K 7200
SED
SED
22
1 TB
2 TB
IBM Systems
System Storage
TM
3.5-in 15K SAS
2.5-in. SAS Drives
Drive costs* (48 drives)
3.5-in 15K SAS – $38,352
2.5-in 15K SAS – $27,792
Drive and enclosure costs (48 drives)
$51,948 (4 enclosures total)
$34,590(2 enclosures total)
IOPs (48 drives)
14,112
16,512
Watts (48 drives)
2.5-in15K SAS
2.5-in drives provide a 27%
cost saving over 3.5-in drives
When expansion units are
considered, the overall
hardware costs of 3.5-in drives
is considerably higher
2.5-in drives deliver slightly more
IOPs across 48 drives than 3.5-in
drives
634
197
IOPs per watt (48 drives)
22.3
83.9
23
3.5-in drives require much more
power than 2.5-in drives
2.5-in. drives deliver four times
the IOPs per watt as 3.5-in drives
* Based on lowest drive capacity available
IBM Systems
System Storage
TM
DS3500 -Power
§ 585W AC Power (system shouldn’t draw more than ~350 W)
§ Dual PSU operation, fully redundant
§ SBB compliant slot and latching
§ 2 Fans internal to each PSU
§ PSU LEDs
► Service Action Allowed
► Service Action Required
► AC Good
► DC Good
► LED for future use
LED for
Future Use
§ 3 minute replacement time – cooling may be an issue after that
time
IBM Systems
System Storage
TM
DS Storage Manager Software
§ Feature-rich management software enables high performance, maximum
utilization and uninterrupted data availability
IBM Systems
System Storage
TM
DS Storage Manager Enhancements
Feature
FlashCopy
Volume Copy
Partitions
Remote Mirroring
SED management
Dynamic Capabilities
DS3000
8 /volume 64/system
8 simultaneous
Up to 32
Not supported
Not supported
CLI and some GUI
DS3500
8 /volume 64/system
8 simultaneous
Up to 64
Supported across FC hosts
SED management
GUI or CLI
The new DS Storage Manager brings increased replication granularity, consolidation, security, and
dynamic capabilities
IBM Systems
System Storage
TM
Security Features –“Password Protect” Storage Manager
§ New password system
► User MUST set a password for managing the system
► Password must be “strong”
● Between 8 and 30 characters
● At least 1 character must be upper-case
● At least 1 character must be numeric
● At least 1 character must be “special” (such as ! # $)
● No whitespace or non-printing characters
► Must enter password when:
● Launching AMW
● Making changes to the system SED key
● After “idle” time (adjustable from 1 minute to 2 hours; can also be set to
“never”)
IBM Systems
System Storage
TM
Configuration Flexibility
§ Tune any attribute to meet any application need
§ Single storage system supports:
► Multiple RAID levels
0, 1, 1+0, 3, 5, 6
► Multiple drive types, capacities, form factors
and rotational speeds
► Multiple and various RAID sizes
● RAID 1 and 10 – 1+1 up to 48+48
● RAID 3, 5 and 6 – 2+1 up to 29+1
► One or more volumes per RAID group
► Settings defined on a logical drive basis
● Concurrently maximize performance, capacity and availability
► Dynamic configuration / re-configuration
IBM Systems
System Storage
TM
DACstore Technology
§ Configuration data is stored on every configured drive.
► Each drive knows its state and status as
well as its logical drives’ state and status
► One drive in each volume group stores the
controller-and subsystem-level information
● Minimum of three per disk system
§ DACstore benefits:
USABLE
STORAGE
► Creates “data intact” drive portability as drives
are not bound to a given enclosure or slot
● Individual physical drives can be relocated within a system
to improve channel utilization (performance / availability)
● Individual volume groups can be migrated to another system
● Full systems can be upgraded by simply replacing the controllers
§ Higher availability
► Critical configuration data stored on every drive, not just a few
IBM Systems
System Storage
TM
Management of SED Drives
§ In combination with SED, IBM DS Storage Manager supports a full data
encryption solution
► Maintains /controls the key linkage and communications with the SED drive
► Provides all the management tools necessary to quickly and simply enable
and SED drives
Application
§ Secure
§ Cost-effective
§ No impact on performance or ease-of-use
Management
Servers
SED Key
Authentication Key Flow
SAN
Data
Flow
IBM Systems
System Storage
TM
Storage Partitioning
§ Creates multiple virtual systems
from a single disk system
► Max 64 partitions
§ Heterogeneous host support
enables consolidation in
multi-platform environments
Host
A
Storage
Partition
A
Host
B
Storage
Partition
B
SVC
Group C
Storage
Partition
C
31
§ Storage-based implementation
ensures data integrity
§ Logical partitioning provides flexibility
LD
2
Unmapped Volumes
IBM Systems
System Storage
TM
FlashCopy
§ A point-in-time (PiT) image of a logical drive
► Logical equivalent of a physical copy
§ Features:
► Provides an instantaneous copy
► Requires less disk space than a full copy
► Mappable to any host
► Can be read from, or written to
§ Primary uses:
► PiT backup image
► File / volume restoration source
► Data mining / analysis
Z
X B C
Base
A C
FlashCopy
Repository
Physical Logical
A B C
FlashCopy
Image
IBM Systems
System Storage
TM
Volume Copy
§ Complete point-in-time replication of one logical drive
(FlashCopy image) to another within a disk system
► Target also referred to as a clone
§ Primary uses:
► Full PiT data set available for analysis, mining, or testing
● Doesn’t degrade performance
of production logical drive
Production Server
Analysis Server
► Redistribute data for performance
and/or capacity optimization
● Technology migration to
new / faster / larger drives
● Move logical drives to more
desirable volume groups with different
RAID levels
FlashCopy
Source
PiT
Clone
VolumeCopy
IBM Systems
System Storage
TM
Remote Mirror across FC Host Ports
Investment protection Leverage existing hardware
resources
§ Low cost, effective disaster recovery or centralize
backup data
§ Storage-based data replication with multiple mirroring
modes
§ Primary uses:
► Disaster recovery, Centralized backup, centralized data
mining
Remote Office
► Designed to provide ongoing, real-time replication from a
Remote Office
DS3500 to another DS3500, DS4000, or DS5000
$
Corporate Data Center
► Up to 8 mirror pairs
Remote Office
REPLICATE
RESTORE
IBM Systems
System Storage
TM
DS3500 Series Advanced Software Features –
START HERE
This solution is “complete” for the majority of typical storage workloads, however, when an organization’s storage requirements grow, the
AIX/VIOS Host Kit
(FC host ports only) 68Y8458
Out-of-the-box includes: 4 partitions, 2 FlashCopy® images, support for 96 drives (EXP3512 and/or EXP3524
expansion units), and Windows, Linux (on Intel), and VMware host attachment.
DS3500 series can grow as well.
Select from any of the Advanced Features below
Linux on Power Kit
(Power Blades only) 68Y8459
HP/UX Host Kit
68Y8461
Partition Feature Options
Initial Upgrades
Additional
Upgrades
8 → 16 Partitions
4 → 8 Partitions
68Y8441
68Y8436
8 → 32 Partitions
68Y8442
4 → 16Partitions
68Y8437
8 → 64 Partitions
68Y8443
4 → 32 Partitions
68Y8438
16 → 32 Partitions
68Y8445
4 → 64 Partitions
16 → 64 Partitions
68Y8446
68Y8439
32 → 64 Partitions
68Y8448
Replication Feature Options
FlashCopy: Base
4 images per volume / 64 per system
68Y8451
4 images per volume / 64 per system + Volume Copy
FlashCopy / Volume Copy: Base
68Y8454
Volume Copy: Base
128 relationships per system
68Y8453
Turbo Performance
69Y2871
FlashCopy: 8x64 Upgrade
8 images per volumes / 64 per system
68Y8452
Full Disk Encryption (SED)
Remote Mirroring (over FC)
8 mirror pairs per system
68Y8455
68Y8490
IBM Systems
System Storage
TM
DS3000 / DS3500 Comparison
Dual-controller system
(unless noted)
Core technology 3 Gbps SAS 6 Gbps SAS
• Two / Six 3 Gbps SAS; or
Host interfaces options
Redundant drive channels Two 3 Gb SAS Two 6 Gb SAS
Max drives and type 48 SAS / SATA 96 SAS / SED-SAS / NL-SAS
Drive enclosures 3.5-in drives in 12-drive enclosure
Data cache 1 GB per controllers 1 or 2 GB per controller
Cache IOPS 103,000 IOPS 200,000 IOPS (turbo)
Disk Read IOPS 21,000 IOPS 40,000 IOPS (turbo)
Disk Read MB/s 940 MB/s 4,000 MB/s (turbo)
• Four 4 Gbps FC; or
• Four 1 Gbps iSCSI
D S 3 0 0 0 D S 3 5 0 0
• Four / Eight 6 Gbps SAS; or
• Eight 4 Gbps FC and four 3 Gbps SAS; or
• Eight 1 Gbps iSCSI and four 3 Gbps SAS
3.5-in drive in 12-drive enclosure
2.5-in drives in 24-drive enclosure
36
Premium features
• Partitioning (32)
• FlashCopy (8)
• VolumeCopy
• Partitioning (64)
• FlashCopy (8)
• VolumeCopy
• Remote Mirroring (FC-only)
IBM Systems
System Storage
TM
DS3500/3950/5020 - Specification Comparison
Dual-controller system DS5020 DS3950 DS3500
• Four 8 Gbps FC
Host interface
Redundant drive channels Four 4 Gbps FC Four 4 Gbps FC Two 6 Gbps SAS
Drive enclosure 16-drive (3.5-in) 3U 16-drive (3.5-in) 3U
Max drives 112 112 96
Drives supported FC,SATA, SED FC, SATA SAS, NL SAS, SED*
XOR engine Integrated XOR / P+Q Integrated XOR / P+Q Integrated XOR / P+Q
Dual Ethernet Yes Yes Yes
• Four additional optional
interfaces – 8 Gbps FC
or 1 Gbps iSCSI
• Four 8 Gbps FC ,or
• Four 8 Gbps FC and four
1 Gbps iSCSI
• Four or eight 6 Gbps SAS
• Eight 8 Gbps FC and four 6
Gbps SAS
• Eight 1 Gbps iSCSI and
four 6 Gbps SAS
12-drive (3.5-in) 2U
24-drive (2.5-in) 2U
37
Data cache / memory 2 or 4 GB 2 or 4 GB 2 or 4 GB
* Two drive options – 600GB SAS SED (3.5-in) or 300GB SAS SED (2.5-in)
IBM Systems
System Storage
TM
DS3500/3950/5020 - Management Software Comparison
Dual-controller system DS5020 DS3950 DS3500
Management software version DS Storage Manager DS Storage Manager DS Storage Manager
Max logical drives 1,024 1,024 256
Max LUN size > 2TB > 2TB > 2TB
RAID levels 1, 3, 5, 6, 10 1, 3, 5, 6, 10 1, 3, 5, 6, 10
Max RAID 10 / 0 size 112 drives 112 drives 96 drives
Max RAID 3 / 5 / 6 size 30 drives 30 drives 30 drives
Max partitions 128 128 64
Max snapshots per base
volume
Maximum remote mirrors
(across FC)
38
8 8 8
64 64 8
IBM Systems
System Storage
TM
thanks
IBM Systems
Loading...