HP (Hewlett-Packard) 359449-001 User Manual

HP High Performance Clusters LC 1000 Series

Design and Configuration Guide

March 2004

Part Number 359449-001

359449-001 1

Table Of Contents

Titles Pages

Introduction 3 - 4

Design and Configuration Matrix 5

Myrinet Reference Designs 6 - 9

Myrinet Order Worksheet 10

GigE Reference Designs

GigE Order Worksheet

Fast Ethernet Reference Designs

Fast Ethernet Order Worksheet

DL380 and DL140 Options

Software Options

Storage Subsystems

Storage Subsystem Options

Myrinet Upgrade Worksheet

GigE Upgrade Worksheet

Fast Ethernet Upgrade Worksheet

11 - 15

16

17- 21

22

23

24

25 - 29

30

31

32

33

359449-001 2

Introduction

p

Summary:

The LC 1000 Series Design and Configuration Guide provides an easy and flexible way to design High Performance Computing (HPC) clusters. It is easy to design an HPC cluster with this guide because everything needed for the cluster is specified through Reference Designs. The flexible process provides the ability to fully configure the cluster by selecting the number of compute nodes in the cluster, type of cluster interconnect network, processor types, processor speeds, other server options, storage subsystems, storage options, and software options.

Reference Designs:

The LC 1000 Series Cluster Reference Designs in this guide serve as the foundation for designing an HPC cluster. The Reference Designs include wiring diagrams of the three cluster networks: In Band (IB) and Out of Band (OOB) management networks and the cluster interconnect network. The Reference Designs contain rack configurations detailing component

lacement in the racks and the location of the potential expansion compute nodes and switches. The Reference Designs also provide comprehensive parts lists to assist you in the order process. The parts lists include all of the part numbers and part descriptions, along with their respective quantities, needed to build an LC 1000 Series Cluster. The Reference Designs are distinguished from one another by the types and sizes of the cluster interconnect network switch. The types of cluster interconnect networks supported by the LC 1000 Series Clusters are: Myrinet, Gigabit Ethernet and Fast Ethernet. Each cluster interconnect network switch supports a certain range of compute nodes and can be expanded to some maximum number of compute nodes.

Using the Design and Configuration Matrix:

The LC 1000 Series Design and Configuration Matrix assists in selecting an LC 1000 Series Cluster Reference Design to be customized to meet your needs. By utilizing three basic inputs, the LC 1000 Series Design and Configuration Matrix helps define the most cost efficient cluster interconnect network switch solution while satisfying both your current compute node count configuration needs and future compute node count expansion plans.

The three basic inputs needed to define the cluster configuration are located in the first three columns of the Design and Configuration matrix. Select a Cluster Interconnect Network, the number of Compute nodes to make up the cluster, and the maximum number of Compute nodes you may expand the cluster to in the future. Each selection from left to right narrows down the

otential options. Once the three selections are made, the result on the right hand side of the matrix is a particular Reference Design and Reference Parts List as well as the page(s) to find them on. The resulting page(s) provide(s) a detailed reference wiring diagram, a reference rack configuration diagram, and a Reference Parts List. Refer to the quantity column of the Reference Parts List whose range includes the selected compute node count. Each quantity column encompasses an entire cluster solution. (Note: Use only the column for your desired node count.) Once the correct column quantity is selected, record the quantities needed for each

art in the appropriate cluster interconnect network Order Worksheet. Order Worksheets for each cluster interconnect network are included in this document to assist in recording the quantities needed to order the LC 1000 Series Cluster. Where prompted, substitute the number of compute nodes selected for the # sign in the simple equations.

An Options Worksheet is also available in this document to order hardware options for the DL380 (Control node) and DL140 (Compute node). Options include, but are not limited to, additional processors, memory and disk capacity. All Compute nodes must be identically configured.

359449-001 3

Software Options:

f

p

Software options such as operating system media and licenses are available. Please refer to the LC 1000 Series Software Options worksheet for part numbers and quantities. The operating system options available with the LC 1000 Series Clusters include Red Hat 3 one year and three year licenses, SLES 8 one year and three year licenses, and Microsoft Windows Server 2003. Separate part numbers are provided for Control and Compute nodes. When ordering Red Hat 3 and SLES 8, the first group of eight compute nodes require a special part number to be ordered that contains the media, HP Care Pack, and the base eight licenses. The licenses for the additional groups of eight compute nodes should be ordered using the separate part number indicated in the Software Options table. The licenses for Microsoft Windows come in bundles o 16 for the Compute nodes.

Scali Manage/Connect software is also available. The appropriate Control node media and license and the correct number of Compute node licenses must be ordered. Scali Manage/Connect is supported on Linux operating systems only.

Storage Subsystems:

Storage Subsystems are also available for the compute cluster. In the LC 1000 Series Design and Configuration Guide, several Storage Subsystems have been defined with wiring diagrams, rack configurations, and Reference Parts Lists. The Storage Subsystems are attached to the compute cluster via the In Band Gigabit Ethernet network. If you would like to select one of the Storage Subsystems, simply place the order using the appropriate Reference Parts List.

To add storage options, please refer to the Storage Subsystem Options worksheet.

Using the Upgrade Worksheets:

There are Upgrade Worksheets for each cluster interconnect network included in this document. Each Reference Design has its own maximum expandability as illustrated by the LC 1000 Series Design and Configuration Matrix and listed on each LC 1000 Series Cluster Reference Design

age. To expand your Compute node count, find the correct cluster interconnect network Upgrade Worksheet and fill out the Current Configuration column and the New Configuration column using the appropriate Reference Parts List. Depending on the situation, these two inputs could come from separate quantity columns but will always come from the same Reference Design. Then subtract the quantity of each part in the Current Configuration column from each

art in the New Configuration column, and enter the difference in the Parts Needed column. The generated Parts Needed column provides you with exactly the necessary parts to achieve your new configuration.

359449-001 4

LC 1000 Series Design and Configuration Matrix

y

g

Select Result

Cluster

Interconnect

Network

Myrinet

GigE

Fast Ethernet

# of Compute

Reference

Future

Maximum

Nodes

Design

Parts List

Expansion

1 - 32 32 16 Node M

32 Node Myrinet641 - 64

rinet 1 - 32 Nodes 6

1 - 32 Nodes 7 33 - 64 Nodes 7 29 - 68 Nodes 8 - 9

64 Node Myrinet12829 - 128

69 - 108 Nodes 8 - 9

109 - 128 Nodes 8 - 9 1 - 22 22 16 Node Gi 1 - 36 36 24 Node Gi

1 - 64 64 32 Node GigE

E 1 - 22 Nodes 11 E 1 - 36 Nodes 12

1 - 32 Nodes 13 33 - 64 Nodes 13 29 - 68 Nodes 14 - 15

29 - 128 128 64 Node GigE

69 - 108 Nodes 14 - 15

109 - 128 Nodes 14 - 15 1 - 22 22 16 Node FE 1 - 22 Nodes 17 1 - 36 36 24 Node FE 1 - 36 Nodes 18 1 - 32 72 32 Node FE 1 - 32 Nodes 19

33 - 72 Nodes 20 - 21

33 - 192 192 64 Node FE

73 - 112 Nodes 20 - 21 113 - 152 Nodes 20 - 21 153 - 192 Nodes 20 - 21

Pages

359449-001 5

y

(

)

y

g

y

p

y

,

y

g

y

p

y

g

y

,

p

y

,

ying

p

359449-001 6

LC 1000 Series 16 Node Myrinet DL140 Cluster Reference Design

Myrinet (expandable to 32 nodes)

Rack 1

Control

DL380

Node

SCSI 2

SCSI 1

Serial

NIC2

NIC1

iLO

Compute

DL140

Node

ATA 2

ATA 1

Serial

Myr

NIC1

NIC2

Public LAN

SW1

Myricom w/Myrinet

Line Cards

(Cluster Interconnect

Switch)

SW2

ProCurve 2848

10/100/1000

(IB Management Switch)

42 41 40 S 33 39 S 32 38 S 31 37 S 30 36 S 29 35 S 28 34 S 27 33 S 26 32 S 25 31 S 24 30

S 23 DL380

29 28 S 22 27 S 21 26 S 20 25 S 19 24 S 18 23 S 17

SW 3 Cyclades

22

SW 2 ProCurve 2848

21 20 19 S 16 DL140 18 S 15 DL140 17 S 14 DL140 16 S 13 DL140 15 S 12 DL140 14 S 11 DL140 13 S 10 DL140 12 S 9 DL140 11 S 8 DL140 10 S 7 DL140

9 S 6 DL140 8 S 5 DL140 7 S 4 DL140 6 S 3 DL140 5 S 2 DL140 4 S 1 DL140 3

SW 1

2 1

U

Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion

Expansion Expansion Expansion Expansion Expansion Expansion

TFT5600

Myricom 5 slot

chassis w/Myrinet

line cards

Rack 1 (R1)

Compute

DL140

Node

ATA 2

ATA 1

Serial

NIC1

NIC2

Myr

SW3

Cyclades

(OOB Management

Switch)

Optional Storage Solution

US ABA 001 001 D72 EMEA ABB 421 B31 B31

Part Number Key

WWW XXX YYY ZZZ

Notes: 1. # represents the number of compute nodes.

2. Please refer to the server options table for adding processors, memory, disks, network adapters, ...

Part Numbers

LC 1000 Series Parts List

M

rinet

1 - 32 Nodes

32 Node Max

Factory Integration Quantit

325733-888 Level 4 Factory Integration 1 359578-B21 Confi

uration Resource Kit 1

DL380G3 Control Node Quantit

333705-XXX DL380G3 1P-3.2GHz 1MB Cache 533MHz FSB, 2X512MB RAM 333704-XXX DL380G3 1P-3.06GHz 1MB Cache 533MHz FSB, 2X512MB RAM 310587-XXX DL380G3 1P-3.06GHz 512KB Cache 533MHz FSB, 2X512MB RAM

1

349201-XXX DL380G3 1P-2.8GHz 512KB Cache 400MHz FSB, 2X512MB RAM

DL140 Com

ute Nodes Quantit

350534-B21 DL140 1P-2.4GHz 512KB Cache 533MHz FSB, 1X512MB RAM 350535-B21 DL140 2P-2.4GHz 512KB Cache 533MHz FSB, 1X1GB RAM 359043-B21 DL140 1P-3.06GHz 512KB Cache 533MHz FSB

1X1GB RAM

# 356533-B21 DL140 2P-3.06GHz 512KB Cache 533MHz FSB, 1X1GB RAM 350533-B21 DL140 2P-3.2GHz 1MB Cache 533MHz FSB, 1X1GB RAM

257894-006 M

rinet Fiber PCI-X Single Port Adapter Card - M3F-PCIXD-2 #

142257-B28 Power Cord, SPT-2, IEC-C13 IEC-C14, 20 inches #

IB / OOB Mana

ement Interconnect Quantit

J4904A#WWW ProCurve 2848 - 10/100/1000-T Switch, 48 Ports, 1U 1

355477-B21 C

365242-001

clades Alterpath ACS, Console Server, 48 Ports - ATP0190 1 clades RS-232 to RJ45 Adapter #

C

Cluster Interconnect Quantit

M

257896-002 257896-003 257896-004

257895-001

262818-001 M

337807-001

360363-B21

rinet 5-Slot Switch Frame, 3U, Max Support 32 Ports - M3-E32

M

rinet 9-Slot Switch Frame, 5U, Max Support 64 Ports - M3-E64

M

rinet 17-Slot Switch Frame, 9U, Max Support 128 Ports - M3-E128 Myrinet 8-Port Fiber Switch Card With XBar - M3-SW16-8F *** Round u

to the nearest integer.

rinet SNMP Monitoring Line Card, Dual Port - M3-M Myrinet Front Blanking Panel - M3-BLANK *** Round down to the nearest inte M

rinet Switch Rail Kit

er.

1

# / 8

1

4 - (# / 8)

1

Common Interconnect Parts Quantit

356578-B21 1U Switch Rail Kit, 10K Series Rack Mount

142257-006 Power Cord

BN26M-03 or

263474-B22

Shielded CAT 5E Cable (EMEA), 3M, 1 Per or CAT 5E Cable (US), 6 FT, 8 Per Pack *** For US

BN26M-04 or

263474-B23

Shielded CAT 5E Cable (EMEA), 4M, 1 Per or CAT 5E Cable (US), 12 FT, 8 Per Pack *** For US

BN26M-07 or

263474-B24

Shielded CAT 5E Cable (EMEA), 7M, 1 Per or CAT 5E Cable (US), 20 FT, 4 Per Pack *** For US

IEC-C13 IEC-C14, 4.5FT 3

divide Quantity by 8 and round up to the nearest integer.

divide Quantity by 4 and round up to the nearest integer.

2

# * 2 + 2

2

221692-B22 Fiber Cable, LC-LC, OPTICAL, 5M #

221692-B23 Fiber Cable, LC-LC, OPTICAL, 15M

Rack and Power Com

onents Quantit

245161-B22 Rack 10642 (42U) Shock Pallet 1 221546-YYY TFT5600RKM 1

169989-001 Ke

board/Mouse/Monitor Extension Cable 1

If # <= 8, then 1.

252663-ZZZ Modular PDU, 24A (US) or 32A (EMEA), High Voltage

If 8 < # <= 22, then 2.

If # > 22

then 3. 246099-B21 Side Panel 42U, 10K Series All 1 246107-B21 Stabilizer 600mm, 10K Series All 1 248929-B21 Ba

253214-B21

Kit, 10K Series All Blanking Panels, 10 Per Set, 1U, 10K Series All *** Round u

to the nearest integer.

(39 - #) / 10

y

(Exp

)

(

)

y

g

y

X

p

y

g

y

r

y

p

y

g

y

,

p

y

Y

y

,

ying

p

359449-001 7

LC 1000 Series 32 Node Myrinet DL140 Cluster Reference Design

Myrinet (expandable to 64 nodes)

Rack 1

Control

DL380

Node

SCSI 2

SCSI 1

Serial

NIC2

NIC1

iLO

Compute

DL140

Node

ATA 2

ATA 1

Serial

NIC1

NIC2

Myr

Compute

DL140

Node

ATA 2

ATA 1

Serial

NIC1

NIC2

Myr

Node

ATA 2

ATA 1

Public LAN

SW1

Myricom w/Myrinet

Line Cards

(Cluster Interconnect

Switch)

SW2

ProCurve 2848

10/100/1000

(IB Management Switch)

42 S 33 DL140 42 41 S 32 DL140 41 40 S 31 DL140 40 39 S 30 DL140 39 38 S 29 DL140 38 37 S 28 DL140 37 36 S 27 DL140 36 35 S 26 DL140 35 34 S 25 DL140 34 S 32 33 S 24 DL140 33 S 31 32 S 23 DL140 32 S 30 31 S 22 DL140 31 S 29 30 30 S 28

S 21 DL380

29 29 S 27 28 S 20 DL140 28 S 26 27 S 19 DL140 27 S 25 26 S 18 DL140 26 S 24 25 S 17 DL140 25 S 23 24 S 16 DL140 24 S 22 23 S 15 DL140 23 S 21 22 22

SW 3 Cyclades SW 2

21 21

SW 2 ProCurve 2848 20 20 S 20 19 S 14 DL140 19 S 19 18 S 13 DL140 18 S 18 17 S 12 DL140 17 S 17 16 S 11 DL140 16 S 16 15 S 10 DL140 15 S 15 14 S 9 DL140 14 S 14 13 S 8 DL140 13 S 13 12 S 7 DL140 12 S 12 11 S 6 DL140 11 S 11 10 S 5 DL140 10 S 10

9 S 4 DL140 9 S 9 8 S 3 DL140 8 S 8 7 S 2 DL140 7 S 7 6 S 1 DL140 6 S 6 55S5 44S4 33S3 22S2 11S1

UU

TFT5600

Myricom 9 slot

SW 1

chassis w/Myrinet

line cards

Rack 1 (R1) Rack 2 (R2)

SW3

Cyclades

(OOB Management

Switch)

Optional Storage Solution

SW 1

4x

Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion

ProCurve 2848

10/100/1000

(IB Management Switch)

Rack 2

Compute

DL140

Serial

NIC1

NIC2

Myr

SW1

Compute

DL140

Node

ATA 2

ATA 1

Serial

NIC1

NIC2

SW2

Cyclades

(OOB Management

Switch)

Myr

Part Number Key

WWW XXX YYY ZZZ US ABA 001 001 D72 EMEA ABB 421 B31 B31

Notes: 1. # represents the number of compute nodes.

2. Please refer to the server options table for adding processors, memory, disks, network adapters, ...

Part Numbers

LC 1000 Series Parts List

rinet

M

Factory Integration Quantit

andable to 64 Nodes

1 - 32 Nodes

33 - 64 Nodes

64 Node Max

Quantit

325733-888 Level 4 Factory Integration 1 2 359578-B21 Confi

uration Resource Kit 1 1

DL380G3 Control Node Quantit

Quantit

333705-XXXDL380G3 1P-3.2GHz 1MB Cache 533MHz FSB, 2X512MB RAM 333704-XX 310587-XX 349201-XX

DL380G3 1P-3.06GHz 1MB Cache 533MHz FSB, 2X512MB RAM DL380G3 1P-3.06GHz 512KB Cache 533MHz FSB, 2X512MB RAM DL380G3 1P-2.8GHz 512KB Cache 400MHz FSB, 2X512MB RAM

DL140 Com

ute Nodes Quantit

11

Quantit

350534-B21 DL140 1P-2.4GHz 512KB Cache 533MHz FSB, 1X512MB RAM 350535-B21 DL140 2P-2.4GHz 512KB Cache 533MHz FSB, 1X1GB RAM 359043-B21 DL140 1P-3.06GHz 512KB Cache 533MHz FSB, 1X1GB RAM

## 356533-B21 DL140 2P-3.06GHz 512KB Cache 533MHz FSB, 1X1GB RAM 350533-B21 DL140 2P-3.2GHz 1MB Cache 533MHz FSB, 1X1GB RAM

257894-006 M

rinet Fiber PCI-X Single Port Adapter Card - M3F-PCIXD-2 # #

142257-B28 Power Cord, SPT-2, IEC-C13 IEC-C14, 20 inches # #

IB / OOB Mana

ement Interconnect Quantit

Quantit

J4904A#WW W ProCurve 2848 - 10/100/1000-T Switch, 48 Ports, 1U 1 2

355477-B21 C

365242-001

257896-002 257896-003 257896-004

257895-001

262818-001 M

337807-001

360363-B21

356578-B21 1U Switch Rail Kit, 10K Series Rack Mount

clades Alterpath ACS, Console Server, 48 Ports - ATP0190 1 2

C

clades RS-232 to RJ45 Adapte

##

Cluster Interconnect Quantit

M

rinet 5-Slot Switch Frame, 3U, Max Support 32 Ports - M3-E32 rinet 9-Slot Switch Frame, 5U, Max Support 64 Ports - M3-E64

M M

rinet 17-Slot Switch Frame, 9U, Max Support 128 Ports - M3-E128 Myrinet 8-Port Fiber Switch Card With XBar - M3-SW16-8F *** Round u

to the nearest integer.

rinet SNMP Monitoring Line Card, Dual Port - M3-M Myrinet Front Blanking Panel - M3-BLANK *** Round down to the nearest inte M

rinet Switch Rail Kit

er.

11

# / 8 # / 8

11

8 - (# / 8) 8 - (# / 8)

11

Common Interconnect Parts Quantit

24

Quantit

142257-006 Power Cord, IEC-C13 IEC-C14, 4.5FT 3 5

BN26M-03 or

263474-B22

BN26M-04 or

263474-B23

BN26M-07 or

263474-B24

Shielded CAT 5E Cable (EMEA), 3M, 1 Per or CAT 5E Cable (US), 6 FT, 8 Per Pack *** For US

divide Quantity by 8 and round up to the nearest integer. Shielded CAT 5E Cable (EMEA), 4M, 1 Per or CAT 5E Cable (US), 12 FT, 8 Per Pack

divide Quantity by 8 and round up to the nearest integer.

*** For US Shielded CAT 5E Cable (EMEA), 7M, 1 Per or CAT 5E Cable (US), 20 FT, 4 Per Pack

divide Quantity by 4 and round up to the nearest integer.

*** For US

# * 2 + 2 # * 2 + 7

22

221692-B22 Fiber Cable, LC-LC, OPTICAL, 5M # #

221692-B23 Fiber Cable, LC-LC, OPTICAL, 15M

Rack and Power Com

onents Quantit

Quantit

245161-B22 Rack 10642 (42U) Shock Pallet 1 2 221546-YY

169989-001 Ke

252663-ZZZ Modular PDU, 24A (US) or 32A (EMEA), High Voltage

246099-B21 Side Panel 42U

TFT5600RKM 11

board/Mouse/Monitor Extension Cable 1 1

If # <= 6, then 1.

If 6 < # <= 20, then 2.

then 3.

If # > 20

If # <= 44, then 4.

If 44 < # <= 58, then 5.

If # > 58, then 6.

10K Series All 1 1 246107-B21 Stabilizer 600mm, 10K Series All 1 248929-B21 Ba

253214-B21

Kit, 10K Series All 1 Blanking Panels, 10 Per Set, 1U, 10K Series All *** Round u

to the nearest integer.

(39 - #) / 10 (81 - #) / 10

359449-001 8

LC 1000 Series 64 Node Myrinet DL140 Cluster Reference Design

Myrinet (expandable to 128 nodes)

ATA 1

Rack 2

Node

ATA 2

Serial

Compute

DL140

NIC1

NIC2

Myr

Compute

DL140

Node

ATA 2

ATA 1

Serial

NIC1

NIC2

Myr

ATA 1

Rack 1

Compute

DL140

Node

ATA 2

ATA 1

Serial

NIC1

NIC2

Myr

Compute

DL140

Node

ATA 2

ATA 1

Serial

NIC1

NIC2

Myr

Control

DL380

Node

SCSI 2

SCSI 1

Serial

NIC2

NIC1

iLO

Rack 3

Compute

DL140

Node

ATA 2

Serial

NIC1

NIC2

ATA 1

Myr

Public LAN

SW1

Myricom w/Myrinet

Line Cards

(Cluster Interconnect

Switch)

SW1

ProCurve 2848

10/100/1000

(IB Management Switch)

42 S 40 42 S 29 DL140 42 S 40 42 41 S 39 41 S 28 DL140 41 S 39 41 40 S 38 40 S 27 DL140 40 S 38 40 39 S 37 39 S 26 DL140 39 S 37 39 38 S 36 DL140 38 S 25 DL140 38 S 36 38 37 S 35 DL140 37 S 24 DL140 37 S 35 37 36 S 34 DL140 36 S 23 DL140 36 S 34 36 35 S 33 DL140 35 S 22 DL140 35 S 33 35 34 S 32 DL140 34 S 21 DL140 34 S 32 34 33 S 31 DL140 33 S 20 DL140 33 S 31 33 32 S 30 DL140 32 S 19 DL140 32 S 30 32 31 S 29 DL140 31 S 18 DL140 31 S 29 31 30 S 28 DL140 30 30 S 28 30 29 S 27 DL140 29 29 S 27 29 28 S 26 DL140 28 S 16 DL140 28 S 26 28 27 S 25 DL140 27 S 15 DL140 27 S 25 27 26 S 24 DL140 26 S 14 DL140 26 S 24 26 25 S 23 DL140 25 S 13 DL140 25 S 23 25 24 S 22 DL140 24 S 12 DL140 24 S 22 24 23 S 21 DL140 23 S 11 DL140 23 S 21 23 22 22 22 22 21 21 21 21

SW 1 ProCurve 2848 20 S 20 DL140 20 20 S 20 20 S 20 19 S 19 DL140 19 S 10 DL140 19 S 19 19 S 19 18 S 18 DL140 18 S 9 DL140 18 S 18 18 S 18 17 S 17 DL140 17 S 8 DL140 17 S 17 17 S 17 16 S 16 DL140 16 S 7 DL140 16 S 16 16 S 16 15 S 15 DL140 15 S 6 DL140 15 S 15 15 S 15 14 S 14 DL140 14 S 5 DL140 14 S 14 14 S 14 13 S 13 DL140 13 S 4 DL140 13 S 13 13 S 13 12 S 12 DL140 12 S 3 DL140 12 S 12 12 S 12 11 S 11 DL140 11 S 2 DL140 11 S 11 11 S 11 10 S 10 DL140 10 S 1 DL140 10 S 10 10 S 10

9 S 9 DL140 9 9 S 9 9 S 9 8 S 8 DL140 8 8 S 8 8 S 8 7 S 7 DL140 7 7 S 7 7 S 7 6 S 6 DL140 6 6 S 6 6 S 6 5 S 5 DL140 5 5 S 5 5 S 5 4 S 4 DL140 4 4 S 4 4 S 4 3 S 3 DL140 3 3 S 3 3 S 3 2 S 2 DL140 2 2 S 2 2 S 2 1 S 1 DL140 1 1 S 1 1 S 1

UUUU

Expansion Expansion Expansion Expansion Expansion Expansion

Rack 1 (R1) Rack 2 (R2) Rack 3 (R3) Rack 4 (R4)

SW2

Cyclades

(OOB Management

Switch)

S 17 DL380

SW 3 Cyclades

SW 2 ProCurve 2848

SW 1

4x

TFT5600 Expansion Expansion

Myricom 17 slot

chassis w/Myrinet

line cards

SW2

ProCurve 2848

10/100/1000

(IB Management Switch)

SW 2

SW3

Cyclades

(OOB Management

Switch)

4x

Optional Storage Solution

Expansion

Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion

Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion Expansion

SW1

ProCurve 2848

10/100/1000

(IB Management Switch)

4x

SW 2SW 2 Cyclades SW 1SW 1

Cyclades

(OOB Management

Expansion

Switch)

Rack 4

Compute

DL140

Node

ATA 2

Serial

NIC1

NIC2

Myr

SW2

Compute

DL140

Node

ATA 2

ATA 1

Serial

NIC1

NIC2

Myr

SW1

ProCurve 2848

10/100/1000

(IB Management Switch)

Compute

DL140

Node

ATA 2

ATA 1

Serial

NIC1

NIC2

SW2

Cyclades

(OOB Management

Switch)

Myr

y

(Exp

)

(Exp

)

(

)

y

g

y

X

p

y

g

y

r

y

p

y

g

y

,

p

y

Y

y

,

ying

p

359449-001 9

Part Number Key

WWW XXX YYY ZZZ US ABA 001 001 D72 EMEA ABB 421 B31 B31

LC 1000 Series 64 Node Myrinet DL140 Cluster Reference Design

Notes: 1. # represents the number of compute nodes.

2. Please refer to the server options table for adding processors, memory, disks, network adapters, ...

Part Numbers

325733-888 Level 4 Factory Integration 2 3 4 359578-B21 Confi

333705-XXXDL380G3 1P-3.2GHz 1MB Cache 533MHz FSB, 2X512MB RAM 333704-XX 310587-XX 349201-XX

350534-B21 DL140 1P-2.4GHz 512KB Cache 533MHz FSB, 1X512MB RAM 350535-B21 DL140 2P-2.4GHz 512KB Cache 533MHz FSB, 1X1GB RAM 359043-B21 DL140 1P-3.06GHz 512KB Cache 533MHz FSB, 1X1GB RAM 356533-B21 DL140 2P-3.06GHz 512KB Cache 533MHz FSB, 1X1GB RAM 350533-B21 DL140 2P-3.2GHz 1MB Cache 533MHz FSB, 1X1GB RAM 257894-006 M 142257-B28 Power Cord, SPT-2, IEC-C13 IEC-C14, 20 inches # # #

J4904A#WW W ProCurve 2848 - 10/100/1000-T Switch, 48 Ports, 1U 2 3 4

355477-B21 C 365242-001

257896-002 257896-003 257896-004

257895-001

262818-001 M

337807-001

360363-B21

356578-B21 1U Switch Rail Kit, 10K Series Rack Mount 142257-006 Power Cord, IEC-C13 IEC-C14, 4.5FT 5 7 9

BN26M-03 or

263474-B22

BN26M-04 or

263474-B23

BN26M-07 or

263474-B24

221692-B22 Fiber Cable, LC-LC, OPTICAL, 5M # #

221692-B23 Fiber Cable, LC-LC, OPTICAL, 15M

245161-B22 Rack 10642 (42U) Shock Pallet 2 3 4

221546-YY

169989-001 Ke

252663-ZZZ Modular PDU, 24A (US) or 32A (EMEA), High Voltage

246099-B21 Side Panel 42U 246107-B21 Stabilizer 600mm, 10K Series All 248929-B21 Ba

253214-B21

uration Resource Kit 1 1 1

DL380G3 1P-3.06GHz 1MB Cache 533MHz FSB, 2X512MB RAM DL380G3 1P-3.06GHz 512KB Cache 533MHz FSB, 2X512MB RAM DL380G3 1P-2.8GHz 512KB Cache 400MHz FSB, 2X512MB RAM

rinet Fiber PCI-X Single Port Adapter Card - M3F-PCIXD-2 # # #

clades Alterpath ACS, Console Server, 48 Ports - ATP0190 2 3 4

C

clades RS-232 to RJ45 Adapte

M

rinet 5-Slot Switch Frame, 3U, Max Support 32 Ports - M3-E32 rinet 9-Slot Switch Frame, 5U, Max Support 64 Ports - M3-E64

M M

rinet 17-Slot Switch Frame, 9U, Max Support 128 Ports - M3-E128 Myrinet 8-Port Fiber Switch Card With XBar - M3-SW16-8F *** Round u

rinet SNMP Monitoring Line Card, Dual Port - M3-M 1 1 1 Myrinet Front Blanking Panel - M3-BLANK *** Round down to the nearest inte M

rinet Switch Rail Kit

Shielded CAT 5E Cable (EMEA), 3M, 1 Per or CAT 5E Cable (US), 6 FT, 8 Per Pack *** For US Shielded CAT 5E Cable (EMEA), 4M, 1 Per or CAT 5E Cable (US), 12 FT, 8 Per Pack *** For US Shielded CAT 5E Cable (EMEA), 7M, 1 Per or CAT 5E Cable (US), 20 FT, 4 Per Pack *** For US

TFT5600RKM 111

board/Mouse/Monitor Extension Cable 1 1 1

Blanking Panels, 10 Per Set, 1U, 10K Series All *** Round u

to the nearest integer.

divide Quantity by 8 and round up to the nearest integer.

divide Quantity by 4 and round up to the nearest integer.

Kit, 10K Series All 1 2 3

to the nearest integer.

LC 1000 Series Parts List

rinet

M

Factory Integration Quantit

DL380G3 Control Node Quantit

DL140 Com

IB / OOB Mana

Cluster Interconnect Quantit

Common Interconnect Parts Quantit

Rack and Power Com

10K Series All 1 1 1

ute Nodes Quantit

ement Interconnect Quantit

er.

onents Quantit

29 - 68 Nodes

andable to 128 Nodes

111

###

11

# / 8 # / 8 # / 8

16 - (# / 8) 16 - (# / 8) 16 - (# / 8)

111

468

# * 2 + 7 # * 2 + 12 # * 2 + 13

222

226

If # <= 40, then 4.

If 40 < # <= 54, then 5.

If # > 54

then 6.

(81 - #) / 10 (123 - #) / 10 (165 - #) / 10

69 - 108 Nodes

andable to 128 Nodes

Quantit

###

Quantit

If # <= 80, then 7.

If 80 < # <= 94, then 8.

If # > 94, then 9.

109 - 128 Nodes

128 Node Max

Quantit

If # < 120, then #

else 120.

If # < 120, then 0

else # - 120.

Quantit

If # <= 120, then 10

else 11.

1

LC 1000 Series Myrinet DL140 Cluster Order Worksheet

y

g

y

p

y

g

y

(

(US)

(

(US)

(

(US)

p

y

Y

y

(US)

ying

g

Note: Please make multiple copies for future use.

Part Numbers

325733-888 Level 4 Factory Integration 359578-B21 Confi

333705-XXX DL380G3 1P-3.2GHz 1MB Cache 533MHz FSB, 2X512MB RAM 333704-XXX DL380G3 1P-3.06GHz 1MB Cache 533MHz FSB, 2X512MB RAM 310587-XXX DL380G3 1P-3.06GHz 512KB Cache 533MHz FSB, 2X512MB RAM 349201-XXX DL380G3 1P-2.8GHz 512KB Cache 400MHz FSB, 2X512MB RAM

350534-B21 DL140 1P-2.4GHz 512KB Cache 533MHz FSB, 1X512MB RAM 350535-B21 DL140 2P-2.4GHz 512KB Cache 533MHz FSB, 1X1GB RAM 359043-B21 DL140 1P-3.06GHz 512KB Cache 533MHz FSB, 1X1GB RAM 356533-B21 DL140 2P-3.06GHz 512KB Cache 533MHz FSB, 1X1GB RAM 350533-B21 DL140 2P-3.2GHz 1MB Cache 533MHz FSB, 1X1GB RAM 257894-006 M 142257-B28 Power Cord, SPT-2, IEC-C13 IEC-C14, 20 inches

J4904A#WWW ProCurve 2848 - 10/100/1000-T Switch, 48 Ports, 1U

355477-B21 C 365242-001

257896-002 257896-003 257896-004 257895-001 262818-001 M 337807-001 M 360363-B21

356578-B21 1U Switch Rail Kit, 10K Series Rack Mount 142257-006 Power Cord, IEC-C13 IEC-C14, 4.5FT

BN26M-03 or Shielded CAT 5E Cable

263474-B22

BN26M-04 or Shielded CAT 5E Cable

263474-B23

BN26M-07 or Shielded CAT 5E Cable

263474-B24 221692-B22 Fiber Cable, LC-LC, OPTICAL, 5M 221692-B23 Fiber Cable, LC-LC, OPTICAL, 15M

245161-B22 Rack 10642 (42U) Shock Pallet

221546-YY

169989-001 Ke 252663-ZZZ Modular PDU, 24A 246099-B21 Side Panel 42U, 10K Series All 246107-B21 Stabilizer 600mm, 10K Series All 248929-B21 Ba 253214-B21 Blankin

uration Resource Kit

rinet Fiber PCI-X Single Port Adapter Card - M3F-PCIXD-2

clades Alterpath ACS, Console Server, 48 Ports - ATP0190

C

clades RS-232 to RJ45 Adapter

Myrinet 5-Slot Switch Frame, 3U, Max Support 32 Ports - M3-E32 Myrinet 9-Slot Switch Frame, 5U, Max Support 64 Ports - M3-E64 Myrinet 17-Slot Switch Frame, 9U, Max Support 128 Ports - M3-E128 M

rinet 8-Port Fiber Switch Card With XBar - M3-SW16-8F rinet SNMP Monitoring Line Card, Dual Port - M3-M rinet Front Blanking Panel - M3-BLANK

Myrinet Switch Rail Kit

CAT 5E Cable

TFT5600RKM

board/Mouse/Monitor Extension Cable

Kit, 10K Series All

Panels, 10 Per Set, 1U, 10K Series All

LC 1000 Series Parts List

rinet

M

Factory Integration Quantit

DL380G3 Control Node Quantit

DL140 Com

IB / OOB Mana

Cluster Interconnect Quantit

Common Interconnect Parts Quantit

EMEA), 3M, 1 Per or

, 6 FT, 8 Per Pack

EMEA), 4M, 1 Per or

, 12 FT, 8 Per Pack

EMEA), 7M, 1 Per or

, 20 FT, 4 Per Pack

Rack and Power Com

or 32A (EMEA), High Voltage

ute Nodes Quantit

ement Interconnect Quantit

onents Quantit

Order

Part Number Key

WWW XXX YYY ZZZ US ABA 001 001 D72 EMEA ABB 421 B31 B31

359449-001 10