IBM Power 595 Technical Overview And Introduction

Front cover

IBM Power 595

Technical Overview and Introduction

PowerVM virtualization technology including Live Partition Mobility

World-class performance and flexibility

Mainframe-inspired continuous availability

ibm.com/redbooks

Charlie Cler

Carlo Costantini

Redpaper

International Technical Support Organization

IBM Power 595 Technical Overview and Introduction

August 2008

REDP-4440-00

Note: Before using this information and the product it supports, read the information in “Notices” on page vii.

First Edition (August 2008)

This edition applies to the IBM Power Systems 595 (9119-FHA), IBMs most powerful Power Systems offering.

Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

Contents

Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii

Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . viii

Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix

The team that wrote this paper . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix

Become a published author . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .x

Comments welcome. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .x

Chapter 1. General description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1

1.1 Model overview and attributes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

1.2 Installation planning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

1.2.1 Physical specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

1.2.2 Service clearances . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5

1.2.3 Operating environment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

1.2.4 Power requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

1.3 Minimum configuration requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

1.3.1 Minimum required processor card features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

1.3.2 Memory features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

1.3.3 System disks and media features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

1.3.4 I/O Drawers attachment (attaching using RIO-2 or 12x I/O loop adapters) . . . . . 15

1.3.5 IBM i, AIX, Linux for Power I/O considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

1.3.6 Hardware Management Console models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

1.3.7 Model conversion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

1.4 Racks power and cooling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29

1.4.1 Door kit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30

1.4.2 Rear door heat exchanger . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31

1.4.3 Power subsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31

1.5 Operating system support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32

1.5.1 IBM AIX 5.3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

1.5.2 IBM AIX V6.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33

1.5.3 IBM i 5.4 (formerly IBM i5/OS V5R4) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

1.5.4 IBM i 6.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35

1.5.5 Linux for Power Systems summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35

Chapter 2. Architectural and technical overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37

2.1 System design. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38

2.1.1 Design highlights. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38

2.1.2 Center electronic complex (CEC) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40

2.1.3 CEC midplane . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42

2.1.4 System control structure (SCS). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43

2.1.5 System controller (SC) card . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47

2.1.6 System VPD cards . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48

2.1.7 Oscillator card . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49

2.1.8 Node controller card . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49

2.1.9 DC converter assembly (DCA) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50

2.2 System buses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51

2.2.1 System interconnects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51

2.2.2 I/O subsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55

2.3 Bulk power assembly . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57

2.3.1 Bulk power hub (BPH) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58

2.3.2 Bulk power controller (BPC) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60

2.3.3 Bulk power distribution (BPD) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60

2.3.4 Bulk power regulators (BPR). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61

2.3.5 Bulk power fan (BPF) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62

2.3.6 Integrated battery feature (IBF). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63

2.3.7 POWER6 EnergyScale . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63

2.4 System cooling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69

2.5 Light strips . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69

2.6 Processor books . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70

2.6.1 POWER6 processor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73

2.6.2 Decimal floating point . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76

2.6.3 AltiVec and Single Instruction, Multiple Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77

2.7 Memory subsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78

2.7.1 Memory bandwidth . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79

2.7.2 Available memory features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80

2.7.3 Memory configuration and placement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81

2.8 Internal I/O subsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 82

2.8.1 Connection technology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83

2.8.2 Internal I/O drawers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84

2.8.3 Internal I/O drawer attachment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88

2.8.4 Single loop (full-drawer) cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89

2.8.5 Dual looped (half-drawer) cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90

2.8.6 I/O drawer to I/O hub cabling sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90

2.9 PCI adapter support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92

2.9.1 LAN adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93

2.9.2 SCSI adapters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93

2.9.3 iSCSI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94

2.9.4 SAS adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94

2.9.5 Fibre Channel adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95

2.9.6 Asynchronous, WAN, and modem adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95

2.9.7 PCI-X Cryptographic Coprocessor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96

2.9.8 IOP adapter. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97

2.9.9 RIO-2 PCI adapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97

2.9.10 USB and graphics adapters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97

2.10 Internal storage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97

2.11 Media drawers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98

2.11.1 Media drawer, 19-inch (7214-1U2) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99

2.11.2 DVD/Tape SAS External Storage Unit (#5720). . . . . . . . . . . . . . . . . . . . . . . . . . 99

2.12 External I/O enclosures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100

2.12.1 TotalStorage EXP24 Disk Dwr (#5786). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100

2.12.2 PCI Expansion Drawer (#5790) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100

2.12.3 EXP 12S Expansion Drawer (#5886) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100

2.13 Hardware Management Console (HMC) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101

2.13.1 Determining the HMC serial number. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102

2.14 Advanced System Management Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103

2.14.1 Accessing the ASMI using a Web browser . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103

2.14.2 Accessing the ASMI using an ASCII console . . . . . . . . . . . . . . . . . . . . . . . . . . 104

2.14.3 Accessing the ASMI using an HMC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104

2.14.4 Server firmware. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105

Chapter 3. Virtualization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109

3.1 Virtualization feature support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109

iv IBM Power 595 Technical Overview and Introduction

3.2 PowerVM and PowerVM editions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110

3.3 Capacity on Demand. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111

3.3.1 Permanent activation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112

3.3.2 On/Off CoD . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113

3.3.3 Utility CoD . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114

3.3.4 Trial CoD . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114

3.3.5 Capacity Backup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114

3.4 POWER Hypervisor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115

3.5 Logical partitioning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116

3.5.1 Dynamic logical partitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117

3.5.2 Shared processor pool partitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117

3.5.3 Shared dedicated capacity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118

3.5.4 Multiple shared processor pools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118

3.6 Virtual Ethernet . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119

3.7 Virtual I/O Server. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120

3.7.1 Virtual SCSI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121

3.7.2 Shared Ethernet Adapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122

3.8 PowerVM Lx86 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124

3.9 PowerVM Live Partition Mobility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 125

3.10 AIX 6 workload partitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 127

3.11 System Planning Tool . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128

Chapter 4. Continuous availability and manageability . . . . . . . . . . . . . . . . . . . . . . . . 131

4.1 Reliability. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 132

4.1.1 Designed for reliability. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 132

4.1.2 Placement of components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133

4.1.3 Continuous field monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133

4.2 Availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 134

4.2.1 Detecting and deallocating failing components. . . . . . . . . . . . . . . . . . . . . . . . . . 134

4.2.2 Special uncorrectable error handling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141

4.2.3 Cache protection mechanisms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 142

4.2.4 The input output subsystem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 143

4.2.5 Redundant components and concurrent repair update. . . . . . . . . . . . . . . . . . . . 145

4.2.6 Availability in a partitioned environment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 148

4.2.7 Operating system availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149

4.3 Serviceability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 150

4.3.1 Service environments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151

4.3.2 Service processor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151

4.3.3 Detecting errors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 152

4.3.4 Diagnosing problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 154

4.3.5 Reporting problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155

4.3.6 Notifying the appropriate contacts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 157

4.3.7 Locating and repairing the problem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 158

4.4 Operating system support for RAS features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 160

4.5 Manageability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 162

4.5.1 Service processor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 162

4.5.2 System diagnostics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163

4.5.3 Electronic Service Agent . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163

4.5.4 Manage serviceable events with the HMC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 165

4.5.5 Hardware user interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 165

4.5.6 IBM System p firmware maintenance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 166

4.5.7 Management Edition for AIX . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 168

4.5.8 IBM Director . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 168

Contents v

4.6 Cluster solution . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 169

Related publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 171

IBM Redbooks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 171

Other publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 171

Online resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 172

How to get Redbooks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 173

Help from IBM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 173

vi IBM Power 595 Technical Overview and Introduction

Notices

This information was developed for products and services offered in the U.S.A.

IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM product, program, or service.

IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing, to:

IBM Director of Licensing, IBM Corporation, North Castle Drive, Armonk, NY 10504-1785 U.S.A.

The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION

PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you.

This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice.

Any references in this information to non-IBM Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk.

IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you.

Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.

This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental.

This information contains sample application programs in source language, which illustrate programming techniques on various operating platforms. You may copy, modify, and distribute these sample programs in any form without payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written. These examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability, serviceability, or function of these programs.

Trademarks

IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. These and other IBM trademarked terms are marked on their first occurrence in this information with the appropriate symbol (® or ™), indicating US registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml

The following terms are trademarks of the International Business Machines Corporation in the United States, other countries, or both:

1350™ AIX 5L™ AIX® BladeCenter® Chipkill™ DB2® DS8000™ Electronic Service Agent™ EnergyScale™ eServer™ HACMP™ i5/OS® IBM® iSeries® Micro-Partitioning™

OpenPower® OS/400® POWER™ Power Architecture® POWER Hypervisor™ POWER4™ POWER5™ POWER5+™ POWER6™ PowerHA™ PowerPC® PowerVM™ Predictive Failure Analysis® pSeries® Rational®

Redbooks® Redbooks (logo) ® RS/6000® System i™ System i5™ System p™ System p5™ System Storage™ System x™ System z™ Tivoli® TotalStorage® WebSphere® Workload Partitions Manager™ z/OS®

The following terms are trademarks of other companies:

AMD, the AMD Arrow logo, and combinations thereof, are trademarks of Advanced Micro Devices, Inc.

Novell, SUSE, the Novell logo, and the N logo are registered trademarks of Novell, Inc. in the United States and other countries.

ABAP, SAP NetWeaver, SAP, and SAP logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries.

Java, JVM, Power Management, Ultra, and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.

Internet Explorer, Microsoft, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.

Intel, Intel logo, Intel Inside logo, and Intel Centrino logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States, other countries, or both.

UNIX is a registered trademark of The Open Group in the United States and other countries.

Linux is a trademark of Linus Torvalds in the United States, other countries, or both.

Other company, product, or service names may be trademarks or service marks of others.

viii IBM Power 595 Technical Overview and Introduction

Preface

This IBM® Redpaper is a comprehensive guide describing the IBM Power 595 (9119-FHA) enterprise-class IBM Power Systems server. The goal of this paper is to introduce several technical aspects of this innovative server. The major hardware offerings and prominent functions include:

 The POWER6™ processor available at frequencies of 4.2 and 5.0 GHz

 Specialized POWER6 DDR2 memory that provides improved bandwidth, capacity, and

 Support for AIX®, IBM i, and Linux® for Power operating systems.

 EnergyScale™ technology that provides features such as power trending, power-saving,

 PowerVM™ virtualization

 Mainframe levels of continuous availability.

This Redpaper is intended for professionals who want to acquire a better understanding of Power Systems products, including:

 Clients

 Sales and marketing professionals

 Technical support professionals

reliability

thermal measurement, and processor napping.

 IBM Business Partners

 Independent software vendors

This Redpaper expands the current set of IBM Power Systems documentation by providing a desktop reference that offers a detailed technical description of the 595 system.

This Redpaper does not replace the latest marketing materials, tools, and other IBM publications available, for example, at the IBM Systems Hardware Information Center

http://publib.boulder.ibm.com/infocenter/systems/scope/hw/index.jsp. It is intended as

an additional source of information that, together with existing sources, can be used to enhance your knowledge of IBM server solutions.

The team that wrote this paper

This paper was produced by a team of specialists from around the world working at the International Technical Support Organization, Austin Center.

Charlie Cler is an Executive IT Specialist for IBM in the United States. He has worked with IBM Power Systems and related server technology for over 18 years. Charlie’s primary areas of expertise include Power Systems processor virtualization and server consolidation. He holds a masters degree in Mechanical Engineering from Purdue University with specialization in robotics and computer graphics.

Carlo Costantini is a Certified IT Specialist for IBM and has over 30 years of experience with IBM and IBM Business Partners. He currently works in Italy Power Systems Platforms as Presales Field Technical Sales Support for IBM Sales Representatives and IBM Business

Partners. Carlo has broad marketing experience and his current major areas of focus are competition, sales, and technical sales support. He is a certified specialist for Power Systems servers. He holds a masters degree in Electronic Engineering from Rome University.

The project manager that organized the production of this material was:

Scott Vetter, (PMP) is a Certified Executive Project Manager at the International Technical Support Organization, Austin Center. He has enjoyed 23 years of rich and diverse experience working for IBM in a variety of challenging roles. His latest efforts are directed at providing world-class Power Systems Redbooks®, whitepapers, and workshop collateral.

Thanks to the following people for their contributions to this project:

Terry Brennan, Tim Damron, George Gaylord, Dan Henderson, Tenley Jackson, Warren McCracken, Patrick O’Rourke, Paul Robertson, Todd Rosedahl, Scott Smylie, Randy Swanberg, Doug Szerdi, Dave Williams

IBM Austin

Mark Applegate

Avnet

Become a published author

Join us for a two- to six-week residency program! Help write a book dealing with specific products or solutions, while getting hands-on experience with leading-edge technologies. You will have the opportunity to team with IBM technical professionals, Business Partners, and Clients.

Your efforts will help increase product acceptance and client satisfaction. As a bonus, you will develop a network of contacts in IBM development labs, and increase your productivity and marketability.

Find out more about the residency program, browse the residency index, and apply online at:

ibm.com/redbooks/residencies.html

Comments welcome

Your comments are important to us!

We want our papers to be as helpful as possible. Send us your comments about this paper or other IBM Redbooks in one of the following ways:

 Use the online Contact us review Redbooks form found at:

ibm.com/redbooks

 Send your comments in an e-mail to:

redbooks@us.ibm.com

 Mail your comments to:

IBM Corporation, International Technical Support Organization Dept. HYTD Mail Station P099 2455 South Road Poughkeepsie, NY 12601-5400

x IBM Power 595 Technical Overview and Introduction

Chapter 1. General description

IBM System i™ and IBM System p™ platforms are unifying the value of their servers into a single and powerful lineup of IBM Power Systems servers based on POWER6-processor technology with support for the IBM i operating system (formerly known as i5/OS®), IBM AIX, and Linux for Power operating systems. This new single portfolio of Power Systems servers offers industry-leading technology, continued IBM innovation, and the flexibility to deploy the operating system that your business requires.

This publication provides overview and introductory-level technical information for the POWER6-based IBM Power 595 server with Machine Type and Model (MTM) 9119-FHA.

The IBM Power 595 server is designed to help enterprises deploy the most cost-effective and flexible IT infrastructure, while achieving the best application performance and increasing the speed of deployment of new applications and services. As the most powerful member of the IBM Power Systems family, the Power 595 server is engineered to deliver exceptional performance, massive scalability and energy-efficient processing for a full range of complex, mission-critical applications with the most demanding computing requirements.

Equipped with ultra-high frequency IBM POWER6 processors in up to 64-core, symmetric multiprocessing (SMP) configurations, the Power 595 server is designed to scale rapidly and seamlessly to address the changing needs of today's data centers. With advanced PowerVM virtualization, EnergyScale technology, and Capacity on Demand (CoD) options, the Power 595 is ready to help businesses take control of their IT infrastructure and confidently consolidate multiple UNIX®-based, IBM i, and Linux application workloads onto a single system.

1.1 Model overview and attributes

The Power 595 server (9119-FHA) offers an expandable, high-end enterprise solution for managing the computing requirements to enable your business to become an On Demand Business. The Power 595 is an 8- to 64-core SMP system packaged in a 20U (EIA-unit) tall central electronics complex (CEC) cage. The CEC is 50 inches tall, and housed in a 24-inch wide rack. Up to 4 TB of memory are supported on the Power 595 server.

The Power 595 (9119-FHA) server consists of the following major components:

 A 42U-tall, 24-inch system rack that houses the CEC, Bulk Power Assemblies (BPA) that

are located at the top of the rack, and I/O drawers that are located at the bottom of the rack. A redundant power subsystem is standard. Battery backup is an optional feature. CEC features include:

– A 20U-tall CEC housing that features the system backplane cooling fans, system

electronic components, and mounting slots for up to eight processor books.

– One to eight POWER6 processor books. Each processor book contains eight,

dual-threaded SMP cores that are packaged on four multi-chip modules (MCMs). Each MCM contains one dual-core POWER6 processor supported by 4 MB of on-chip L2 cache (per core) and 32 MB of shared L3 cache. Each processor book also provides:

• Thirty-two DDR2 memory DIMM slots

• Support for up to four GX based I/O hub adapter cards (RIO-2 or 12x) for connection to system I/O drawers

• Two Node Controller (NC) service processors (primary and redundant)

 One or two optional Powered Expansion Racks, each with 32U of rack space for up to

eight, 4U I/O Expansion Drawers. Redundant Bulk Power Assemblies (BPA) are located at the top of the Powered Expansion Rack. Optional battery backup capability is available. Each Powered Expansion Rack supports one 42U bolt-on, nonpowered Expansion Rack for support of additional I/O drawers.

 One or two nonpowered Expansion Racks, each supporting up to seven 4U I/O Expansion

Drawers.

 One to 30 I/O Expansion Drawers (maximum of 12 RIO-2), each containing 20 PCI-X slots

and 16 hot-swap SCSI-3 disk bays.

 In addition to the 24 inch rack-mountable I/O drawers, also available are standard, 2

meters high, 19 inch I/O racks for mounting both SCSI and SAS disk drawers. Each disk drawer is individually powered by redundant, 220 V power supplies. The disk drawers can be configured for either RAID or non-RAID disk storage. A maximum of 40 SCSI drawers (each with 24 disks), and 185 SAS drawers (each with 12 disks), can be mounted in 19-inch racks. The maximum number of disks available in 19 inch racks is 960 hot-swap SCSI disks (288 TB) and 2,220 hot-swap SAS disks (666 TB).

Note: In this publication, the main rack containing the CEC is referred to as the system

. Other IBM documents might use the terms CEC rack or Primary system rack to refer

rack

to this rack.

Table 1-1 on page 3 lists the major attributes of the Power 595 (9119-FHA) server.

2 IBM Power 595 Technical Overview and Introduction

Table 1-1 Attributes of the 9119-FHA

Attribute 9119-FHA

SMP processor configurations 8- to 64 core POWER6 using 8-core processor books

8-core processor books Up to 8

POWER6 processor clock rate 4.2 GHz Standard or 5.0 GHz Turbo

L2 cache 4 MB per core

L3 cache 32 MB per POWER6 processor (shared by two cores)

RAM (memory) 16, 24, or 32 DIMMs configured per processor book

Up to 4 TB of 400 MHz DDR2 Up to 1 TB of 533 MHz DDR2 Up to 512 GB of 667 MHz DDR2

Processor packaging MCM

Maximum memory configuration 4 TB

Rack space 42U 24-inch custom rack

I/O drawers 24": 1 - 30

19" I/O drawers 0 - 96

Internal disk bays 16 maximum per 24" I/O drawer

Internal disk storage Up to 4.8 TB per 24" I/O drawer

64-bit PCI-X Adapter slots #5791 RIO-2 drawer:

20 PCI-X (133 MHz), 240 per system #5797 or #5798 drawer: 14 PCI-X 2.0 (266 MHz), 6 PCI-X (133 MHz), 600 per system

I/O ports 4 GX+ adapter ports per processor book, 32 per system

POWER™ Hypervisor LPAR, Dynamic LPAR, Virtual LAN

PowerVM Standard Edition (optional)

Micro-Partitioning™ with up to 10 micro-partitions per processor (254 maximum); Multiple shared processor pools; Virtual I/O Server; Shared Dedicated Capacity; PowerVM Lx86

PowerVM Enterprise Edition

PowerVM Standard Edition plus Live Partition Mobility

(optional)

Capacity on Demand configurations 8 to 64 processor cores in increments of one (using one to

eight processor books); 4.2 or 5.0 GHz POWER6 processor

cores.

Capacity on Demand (CoD) features (optional)

Processor CoD (in increments of one processor), Memory CoD (in increments of 1 GB), On/Off Processor CoD, On/Off Memory CoD, Trial CoD, Utility CoD

High availability software PowerHA™ family

Chapter 1. General description 3

Attribute 9119-FHA

RAS features Processor Instruction Retry

Alternate Processor Recovery Selective dynamic firmware updates IBM Chipkill™ ECC, bit-steering memory ECC L2 cache, L3 cache Redundant service processors with automatic failover Redundant system clocks with dynamic failover Hot-swappable disk bays Hot-plug/blind-swap PCI-X slots Hot-add I/O drawers Hot-plug power supplies and cooling fans Dynamic Processor Deallocation Dynamic deallocation of logical partitions and PCI bus slots Extended error handling on PCI-X slots Redundant power supplies and cooling fans Redundant battery backup (optional)

Operating systems AIX V5.3 or later

IBM i V5.4 or later SUSE® Linux Enterprise Server 10 for POWER SP2 or later Red Hat Enterprise Linux 4.7 and 5.2 for POWER or later

a. Minimum requirements include a single 8-core book with three cores active, and for every

8-core book, three cores must be active.

1.2 Installation planning

Complete installation instructions are shipped with each server. The Power 595 server must be installed in a raised floor environment. Comprehensive planning information is available at this address:

http://publib.boulder.ibm.com/infocenter/eserver/v1r3s/index.jsp

1.2.1 Physical specifications

The key specifications, such as dimensions and weights, are described in this section. Table 1-2 lists the major Power 595 server dimensions.

Table 1-2 Power 595 server dimensions

Dimension Rack only Rack with

Height 201.4 cm

(79.3 in)

Width 74.9 cm

(29.5 in)

Depth 127.3 cm

(50.1 in)

a. Rack with slim line and side doors, one or two frames b. Rack with slim line front door and rear door heat exchanger (RDHX), system rack only

side doors

201.4 cm (79.3 in)

77.5 cm (30.5 in)

Slim line Acoustic

1 Frame 2 Frames 1 Frame 2 Frames

201.4 cm (79.3 in)

77.5 cm (30.5 in)

148.6 cm (58.5 in)

152.1 cm (61.3 in)

201.4 cm (79.3 in)

156.7 cm (61.7 in)

201.4 cm (79.3 in)

77.5 cm (30.5 in)

180.6 cm (71.1 in)

201.4 cm (79.3 in)

156.7 cm (61.7 in)

180.6 cm (71.1 in)

4 IBM Power 595 Technical Overview and Introduction

Table 1-3 lists the Power 595 server full system weights without the covers.

Table 1-3 Power 595 server full system weights (no covers)

Frame With integrated battery

backup

A Frame (system rack) 1542 kg (3400 lb) 1451 kg (3200 lb)

A Frame (powered expansion rack) 1452 kg (3200 lb) 1361 kg (3000 lb)

Z Frame (bolt-on expansion rack) N/A 1157 kg (2559 lb)

Without integrated battery backup

Table 1-4 lists the Power 595 cover weights.

Table 1-4 Power 595 cover weights

Covers Weight

Side covers pair 50 kg (110 lb)

Slim Line doors, single 15 kg (33 lb)

Acoustic doors, single (Expansion frame) 25 kg (56 lb)

Acoustic doors, single (System rack) 20 Kg (46 lb)

Table 1-5 lists the Power 595 shipping crate dimensions.

Table 1-5 Power 595 shipping crate dimensions

Dimension Weight

Height 231 cm (91 in)

Width 94 cm (37 in)

Depth 162 cm (63.5 in)

Weight Varies by configuration. Max 1724 kg (3800 lb)

1.2.2 Service clearances

Several possible rack configurations are available for Power 595 systems. Figure 1-1 on page 6 shows the service clearances for a two-rack configuration with acoustical doors.

Note: The Power 595 server must be installed in a raised floor environment.

Chapter 1. General description 5

Figure 1-1 Service clearances for a two-rack system configuration with acoustic doors

Service clearances for other configurations can be found at:

http://publib.boulder.ibm.com/infocenter/eserver/v1r3s/index.jsp?topic=/iphad/serv iceclearance.htm

Important: If the Power 595 server must pass through a doorway opening less than 2.02 meters (79.5 inches), you should order the compact handling option (#7960) which, ships the rack in two parts.

1.2.3 Operating environment

Table 1-6 lists the operating environment specifications for the Power 595 server.

Table 1-6 Power 595 server operating environment specifications

Description Range

Recommended operating temperature (8-core, 16-core, and 32-core configurations)

Recommended operating temperature (48-core and 64-core configurations)

Relative humidity 20% to 80%

10 degrees to 32 degrees C (50 degrees to 89.6 degrees F)

10 degrees to 28 degrees C (50 degrees to 82.4 degrees F)

6 IBM Power 595 Technical Overview and Introduction

Description Range

Maximum wet bulb 23 degrees C (73 degrees F) (operating)

Sound power  Declared A-weighted sound power level, per

Sound pressure  Declared A-weighted one-meter sound

a. The maximum temperatures of 32°C (90°F) and 28°C (82°F) are linearly derated above 1295

m (4250 ft).

1.2.4 Power requirements

All Power 595 configurations are designed with a fully redundant power system. To take full advantage of the power subsystem redundancy and reliability features, each of the two power cords should be connected to different distribution panels.

Table 1-7 lists the electrical and thermal characteristics for the Power 595 server.

Table 1-7 Power 595 electrical and thermal characteristics

Description Range

ISO 9296: 9.2 bels (with slim line doors)

 Declared A-weighted sound power level, per

ISO 9296: 8.2 bels (with acoustical doors)

pressure level, per ISO 9296: 79 decibels (with slim line doors)

 Declared A-weighted one-meter sound

pressure level, per ISO 9296: 69 decibels (with acoustical doors)

Operating voltages  3-phase V ac at 50/60 Hz): 200 to 240 V;

380 to 415 V; 480 V

 Rated current (A per phase): 48 A or 63

A or 80 A; 34 A or 43 A; 24 A or 34 A

 Power consumption: 27,500 watts

(maximum for full CEC, three I/O drawers)

 Power source loading: 27.7 kVA  Thermal output: 27,500 joules/sec

(93,840 Btu/hr) maximum

Inrush current 134

Power Factor 0.99

Operating frequency 50/60 plus or minus 0.5 Hz

Maximum Power (Fully configured 4.2 GHz system) 23.3 KW

Maximum Power (Fully configured 5.0 GHz system) 28.3 KW

Maximum thermal output (4.2 GHz processor) 74.4 KBTU/hr

Maximum thermal output (5.0 GHz processor) 83.6 KBTU/hr

Table 1-8 on page 8 lists the electrical characteristics for 4.2 GHz and 5.0 GHz Power 595 servers, and the Powered Expansion Rack (U.S., Canada, and Japan).

Chapter 1. General description 7

Table 1-8 Electrical characteristics (U.S., Canada, and Japan)

Description US, Canada, Japan US high voltage

Voltage and Frequency

4.2 GHz Server

System Rating 48 A 63 A 24 A 24 A

Plug rating 60 A 100 A 30 A 30 A

Recommended circuit breaker rating

Cord size 6 AWG 6 AWG 8 AWG 8 AWG

Recommended receptacle

5.0 GHz Server

System Rating 48 A 63 A 24 A 34 A

Plug rating 60 A 100 A 30 A 60 A

Recommend circuit breaker rating

Cord size 6 AWG 4 AWG 8 AWG 6 AWG

200-240 V at 50-60 Hz 480 V at 50-60 Hz

60 A80 A30 A30 A

IEC60309, 60 A, type 460R9W

60 A 100 A 30 A 60 A

IEC60309, 100 A, type 4100R9W

IEC60309, 30 A, type 430R7W

Recommended receptacle

Powered Expansion Rack

System rating 48 A 63 A 24 A 24 A

Plug rating 60 A 100 A 30 A 30 A

Recommend circuit breaker rating

Cord size 6 AWG 6 AWG 8 AWG 8 AWG

Recommended receptacle

IEC60309, 60 A, type 460R9W

60 A80 A30 A30 A

IEC60309, 60 A, type 460R9W

IEC60309, 100 A, type 4100R9W

IEC60309, 30 A, type 430R7W

Table 1-9 lists the electrical characteristics for 4.2 GHz and 5.0 GHz Power 595 servers, and the Powered Expansion Rack (World Trade).

Table 1-9 Electrical characteristics (World Trade)

Description Worl d Tra d e

Voltage and frequency

4.2 GHz server

200-240 V at 50-60 Hz 380/415 V at 50-60 Hz

System rating 48 A 63 A 34 A 34 A

Plug rating no plug no plug no plug no plug

8 IBM Power 595 Technical Overview and Introduction

Description Worl d Tra d e

Recommend circuit breaker rating

Cord size 6 AWG 6 AWG 8 AWG 8 AWG

Recommended receptacle

5.0 GHz server

System rating 48 A 80 A 34 A 43 A

Plug rating no plug no plug no plug no plug

Recommend circuit breaker rating

Cord size 6 AWG 4 AWG 8 AWG 6 AWG

Recommended receptacle

Powered Expansion Rack

System rating Powered I/O Rack

60 A80 A40 A40 A