Silicon Graphics Origin 350 User Manual

SGI® Origin® 350 Server System User’s Guide

007-4566-001

CONTRIBUTORS

Written by Francisco Razo

Illustrated by Dan Young and Chrystie Danzer

Production by Karen Jacobson

Contributions by Charles Alexander, Dick Brownell, David Diederichs, Steve Ewing, Mike Grayson, Patrick Heintz, Nancy Heller, Matt Hoy,

Brad Juskiewicz,Jusson Koo,Art Ordonio, PaulPedersen, GillesPerrenoud, Mike Petersen, Hao Pham, Keith Rich, German Rico, Bob Sanders, Mark Schwenden, Bruce Shifrin, Gary Spilde, Brian Stickney, Benjie Sun, and Michael Wright.

Cover Design by Sarah Bolles, Sarah Bolles Design, and Dany Galgani, SGI Technical Publications

COPYRIGHT

© 2003, Silicon Graphics, Inc. All rights reserved; provided portions may be copyright in third parties, as indicated elsewhere herein. No permission is granted to copy, distribute, or create derivative works from the contents of this electronic documentation in any manner, in whole or in part, without the prior written permission of Silicon Graphics, Inc.

LIMITED RIGHTS LEGEND

The electronic (software) version of this document was developed at private expense; if acquired under an agreement with the USA government or any contractor thereto, it is acquired as “commercial computer software” subject to the provisions of its applicable license agreement, as speciﬁed in (a) 48 CFR 12.212 of the FAR; or, if acquired for Department of Defense units, (b) 48 CFR 227-7202 of the DoD FAR Supplement; or sections succeeding thereto. Contractor/manufacturer is Silicon Graphics, Inc., 1600 Amphitheatre Pkwy 2E, Mountain View, CA 94043-1351.

TRADEMARKS AND ATTRIBUTIONS

Silicon Graphics, SGI, the SGI logo, InﬁniteReality, IRIX, Octane, Onyx2, and Origin are registered trademarks, and NUMAﬂex, NUMAlink, SGIconsole, Supportfolio, VPro, and XIO are trademarks of Silicon Graphics, Inc., in the United States and/or other countries worldwide.

MIPS is a registered trademark of MIPS Technologies, Inc., used under license by Silicon Graphics, Inc.

Linux is a registered trademark of Linus Torvalds.

Record of Revision

Version Description

001 June 2003

Original publication

007-4566-001 iii

Contents

Figures . . . . . . . . . . . . . . . . . . . . . . . . . . xi

Tables . . . . . . . . . . . . . . . . . . . . . . . . . xvii

Important Information . . . . . . . . . . . . . . . . . . . . . xx

Chapter Descriptions . . . . . . . . . . . . . . . . . . . . . . xx

Related Publications . . . . . . . . . . . . . . . . . . . . . xxii

Conventions . . . . . . . . . . . . . . . . . . . . . . . xxiv

Product Support . . . . . . . . . . . . . . . . . . . . . . xxiv

Reader Comments . . . . . . . . . . . . . . . . . . . . . . xxv

1. Installation and Operation . . . . . . . . . . . . . . . . . . . . 1

System Installation Overview (the Road Map) . . . . . . . . . . . . . . .2

Safety Precautions . . . . . . . . . . . . . . . . . . . . . . . 3

Hazard Statements . . . . . . . . . . . . . . . . . . . . . 3

ESD Precautions . . . . . . . . . . . . . . . . . . . . . . 4

Safety Measures . . . . . . . . . . . . . . . . . . . . . . 4

Installing a Rack . . . . . . . . . . . . . . . . . . . . . . . 5

Preinstallation Activities . . . . . . . . . . . . . . . . . . . . 6

Site Plan Verification. . . . . . . . . . . . . . . . . . . . 6

Tools Required . . . . . . . . . . . . . . . . . . . . . 7

Power Receptacle Verification . . . . . . . . . . . . . . . . .7

Unloading and Moving System Equipment . . . . . . . . . . . . . . 10

Unloading the Equipment from the Truck . . . . . . . . . . . . . 10

Inspecting the Shipping Crate . . . . . . . . . . . . . . . . .12

Transporting the Shipping Crate . . . . . . . . . . . . . . . . 13

Removing a Short Rack from the Shipping Crate . . . . . . . . . . . . . 13

Removing a Tall Rack from the Shipping Crate . . . . . . . . . . . . . 16

Positioning and Leveling a Single-rack System . . . . . . . . . . . . . 19

Positioning and Leveling a Multiple-rack (Clustered) System . . . . . . . . . 20

007-4566-001 v

Contents

Unpacking and Inspecting Server System Modules . . . . . . . . . . . . . 23

Setting the Server System on a Table Top . . . . . . . . . . . . . . . . 23

Installing the Server System in a Rack . . . . . . . . . . . . . . . . . 25

Rackmounting Modules with Slide Rails . . . . . . . . . . . . . . . 25

Determining Space Requirements . . . . . . . . . . . . . . . . 26

Checking the Slide Rail Hardware . . . . . . . . . . . . . . . . 26

Preparing the Slide Rail Assemblies . . . . . . . . . . . . . . . 27

Preparing the Module . . . . . . . . . . . . . . . . . . . 30

Determining Where to Attach the Slide Rail in the Rack . . . . . . . . . . 31

Attaching the Slide Rail to the Rack . . . . . . . . . . . . . . . 32

Installing Clip Nuts in Rack Rails . . . . . . . . . . . . . . . .35

Installing the Module in the Rack . . . . . . . . . . . . . . . . 36

Adjusting the Position of the Rackmounted Module . . . . . . . . . . . 38

Removing a Module on Slide Rails from a Rack . . . . . . . . . . . . . 39

Rackmounting Modules with Shelf Rails . . . . . . . . . . . . . . . 42

Removing a Module on Shelf Rails from a Rack . . . . . . . . . . . . . 44

Cabling the System Modules to Each Other . . . . . . . . . . . . . . . . 45

Cabling the Server System to a Power Source . . . . . . . . . . . . . . . 48

Connecting a Single-module or Dual-module Server System to a Power Source . . . . 48

Connecting a Multiple-module Server System to a Power Source . . . . . . . . 49

Connecting the System Console . . . . . . . . . . . . . . . . . . . 51

Operating the Server System . . . . . . . . . . . . . . . . . . . . 53

Powering the Server System On and Off . . . . . . . . . . . . . . . 53

Preparing to Power On . . . . . . . . . . . . . . . . . . . 53

Powering On at the System Console . . . . . . . . . . . . . . . 54

Powering On Manually . . . . . . . . . . . . . . . . . . . 56

Powering Off at the System Console . . . . . . . . . . . . . . . 58

Powering Off Manually . . . . . . . . . . . . . . . . . . . 59

Connecting Two Server Systems. . . . . . . . . . . . . . . . . . 60

Operating the Server System Modules via Front Panel Controls. . . . . . . . . 61

Operating the L1 Controller . . . . . . . . . . . . . . . . . . . 62

2. System Overview . . . . . . . . . . . . . . . . . . . . . . . 65

Physical Features . . . . . . . . . . . . . . . . . . . . . . . 66

vi 007-4566-001

Contents

Functional Architecture . . . . . . . . . . . . . . . . . . . . . 68

System Configurations . . . . . . . . . . . . . . . . . . . . . 75

Base Configuration . . . . . . . . . . . . . . . . . . . . . 76

NUMAlink Configuration . . . . . . . . . . . . . . . . . . . 78

System Components . . . . . . . . . . . . . . . . . . . . . . 80

Major Components of a Base Configuration . . . . . . . . . . . . . . 80

Major Components of a NUMAlink Configuration . . . . . . . . . . . . 81

Compute Module . . . . . . . . . . . . . . . . . . . . . . 83

NUMAlink Module . . . . . . . . . . . . . . . . . . . . . 85

MPX Module . . . . . . . . . . . . . . . . . . . . . . . 86

PCI Expansion Devices . . . . . . . . . . . . . . . . . . . . 87

Storage Expansion . . . . . . . . . . . . . . . . . . . . . 89

SGI TP900 Storage Module . . . . . . . . . . . . . . . . . 90

2Gb SGI TP9100 Storage System . . . . . . . . . . . . . . . . 91

SGI TP9400 and SGI TP9500 Storage Systems . . . . . . . . . . . . 93

Tape Devices . . . . . . . . . . . . . . . . . . . . . . 94

L2 Controller . . . . . . . . . . . . . . . . . . . . . . . 97

USB Hub . . . . . . . . . . . . . . . . . . . . . . . . 99

Power Components . . . . . . . . . . . . . . . . . . . . . 99

Rack . . . . . . . . . . . . . . . . . . . . . . . . .103

3. Compute Module . . . . . . . . . . . . . . . . . . . . . . .107

System Features . . . . . . . . . . . . . . . . . . . . . . .108

IP53 Node Board . . . . . . . . . . . . . . . . . . . . . .114

Processors (CPUs) . . . . . . . . . . . . . . . . . . . .115

Primary and Secondary Cache . . . . . . . . . . . . . . . . .116

Local Memory (DIMMs). . . . . . . . . . . . . . . . . . .116

Bedrock ASIC. . . . . . . . . . . . . . . . . . . . . .119

IO9 Card . . . . . . . . . . . . . . . . . . . . . . . .119

Interface Board with a Daughtercard . . . . . . . . . . . . . . . .120

PCI Riser Card . . . . . . . . . . . . . . . . . . . . . .120

DVD-ROM. . . . . . . . . . . . . . . . . . . . . . . .121

Disk Drives . . . . . . . . . . . . . . . . . . . . . . .121

Power Supplies . . . . . . . . . . . . . . . . . . . . . .122

007-4566-001 vii

Contents

External Components . . . . . . . . . . . . . . . . . . . . . 122

Front Panel Items . . . . . . . . . . . . . . . . . . . . . 122

Rear Panel Items . . . . . . . . . . . . . . . . . . . . . 124

System Configuration . . . . . . . . . . . . . . . . . . . . . 126

Internal Configurations . . . . . . . . . . . . . . . . . . . 126

External Configurations . . . . . . . . . . . . . . . . . . . 127

Technical Specifications . . . . . . . . . . . . . . . . . . . . 130

4. Memory and PCI Expansion (MPX) Module . . . . . . . . . . . . . . 133

System Features . . . . . . . . . . . . . . . . . . . . . . 133

IP53 Node Board . . . . . . . . . . . . . . . . . . . . . 135

Local Memory (DIMMs) . . . . . . . . . . . . . . . . . . 135

Bedrock ASIC . . . . . . . . . . . . . . . . . . . . . 138

Interface Board. . . . . . . . . . . . . . . . . . . . . . 138

PCI Riser Card . . . . . . . . . . . . . . . . . . . . . . 138

Power Supplies . . . . . . . . . . . . . . . . . . . . . 139

External Components . . . . . . . . . . . . . . . . . . . . . 139

Front Panel Items . . . . . . . . . . . . . . . . . . . . . 139

Rear Panel Items . . . . . . . . . . . . . . . . . . . . . 140

System Configurations. . . . . . . . . . . . . . . . . . . . . 142

Internal Configurations . . . . . . . . . . . . . . . . . . . 142

External Configurations . . . . . . . . . . . . . . . . . . . 143

Technical Specifications . . . . . . . . . . . . . . . . . . . . 146

5. NUMAlink Module . . . . . . . . . . . . . . . . . . . . . 147

Overview . . . . . . . . . . . . . . . . . . . . . . . . 147

External Components . . . . . . . . . . . . . . . . . . . . . 149

Front Panel Components . . . . . . . . . . . . . . . . . . . 149

Rear Panel Components . . . . . . . . . . . . . . . . . . . 151

Technical Specifications . . . . . . . . . . . . . . . . . . . . 153

6. Installing and Removing Customer-replaceable Units . . . . . . . . . . . 155

Safety Instructions . . . . . . . . . . . . . . . . . . . . . . 155

PCI and PCI-X Cards . . . . . . . . . . . . . . . . . . . . . 157

Rules for Card Installation and Removal . . . . . . . . . . . . . . 158

viii 007-4566-001

Contents

Installing a Card . . . . . . . . . . . . . . . . . . . . . .158

Removing a Card . . . . . . . . . . . . . . . . . . . . . .167

Disk Drives . . . . . . . . . . . . . . . . . . . . . . . . .176

Installing a Disk Drive . . . . . . . . . . . . . . . . . . . .177

Removing a Disk Drive . . . . . . . . . . . . . . . . . . . .179

Power Supplies . . . . . . . . . . . . . . . . . . . . . . .181

Reading the Power Supply LEDs . . . . . . . . . . . . . . . . .182

Replacing a Power Supply . . . . . . . . . . . . . . . . . . .182

Memory. . . . . . . . . . . . . . . . . . . . . . . . . .186

Installing a DIMM . . . . . . . . . . . . . . . . . . . . .189

Removing a DIMM . . . . . . . . . . . . . . . . . . . . .193

L1 Controller Display . . . . . . . . . . . . . . . . . . . . . .196

7. Troubleshooting . . . . . . . . . . . . . . . . . . . . . . .203

Troubleshooting Chart . . . . . . . . . . . . . . . . . . . . .204

L1 Controller Error Messages . . . . . . . . . . . . . . . . . . .206

SGI Electronic Support . . . . . . . . . . . . . . . . . . . . .208

A. Technical Specifications . . . . . . . . . . . . . . . . . . . . .211

Environmental System Specifications . . . . . . . . . . . . . . . . .212

Compute Module Specifications . . . . . . . . . . . . . . . . . . .213

MPX Module Specifications . . . . . . . . . . . . . . . . . . . .215

PCI Expansion Module Specifications . . . . . . . . . . . . . . . . .216

NUMAlink Module Specifications . . . . . . . . . . . . . . . . . .217

Rack Specifications . . . . . . . . . . . . . . . . . . . . . .218

SGI TP900 Storage Module Specifications . . . . . . . . . . . . . . . .219

Power Bay Module Specifications . . . . . . . . . . . . . . . . . .220

USB Hub Specifications . . . . . . . . . . . . . . . . . . . . .221

Non-proprietary I/O Port Specifications . . . . . . . . . . . . . . . .221

Compute Module . . . . . . . . . . . . . . . . . . . . . .222

MPX Module . . . . . . . . . . . . . . . . . . . . . . .224

L2 Controller . . . . . . . . . . . . . . . . . . . . . . .225

NUMAlink Module . . . . . . . . . . . . . . . . . . . . .226

SGI TP900 Storage Module . . . . . . . . . . . . . . . . . . .226

007-4566-001 ix

Contents

USB Hub . . . . . . . . . . . . . . . . . . . . . . . 227

DB-9 Connector . . . . . . . . . . . . . . . . . . . . . 228

RJ-45 Connector . . . . . . . . . . . . . . . . . . . . . 229

External SCSI Port Connector . . . . . . . . . . . . . . . . . 230

Stereo Jack Connector Conductor . . . . . . . . . . . . . . . . 232

USB Type A Connector . . . . . . . . . . . . . . . . . . . 233

USB Type B Connector . . . . . . . . . . . . . . . . . . . 234

PS/2 Connectors . . . . . . . . . . . . . . . . . . . . . 235

B. Regulatory Specifications and Safety Information . . . . . . . . . . . . 237

Manufacturer’s Regulatory Declarations . . . . . . . . . . . . . . . 237

Server Model Number . . . . . . . . . . . . . . . . . . . 237

CE Notice and Manufacturer's Declaration of Conformity . . . . . . . . . 237

Electromagnetic Emissions . . . . . . . . . . . . . . . . . . 238

FCC Notice (USA Only) . . . . . . . . . . . . . . . . . . 238

Industry Canada Notice (Canada Only) . . . . . . . . . . . . . 239

VCCI Notice (Japan Only) . . . . . . . . . . . . . . . . . 239

Chinese Class A Regulatory Notice. . . . . . . . . . . . . . . 239

Korean Class A Regulatory Notice . . . . . . . . . . . . . . . 239

Shielded Cables . . . . . . . . . . . . . . . . . . . . . 240

Electrostatic Discharge . . . . . . . . . . . . . . . . . . . 240

Laser Compliance Statements. . . . . . . . . . . . . . . . . . . 240

Lithium Battery Statement . . . . . . . . . . . . . . . . . . . 242

Index. . . . . . . . . . . . . . . . . . . . . . . . . . 243

x 007-4566-001

Figures

Figure 1-1 30-amp Single-phase Power Receptacle for North American Sites . 8

Figure 1-2 32-amp Single-phase Power Plug for International Sites . . . . 9

Figure 1-3 Dimensions of Tall Rack Shipping Crate . . . . . . . . 11

Figure 1-4 Dimensions of Short Rack Shipping Crate . . . . . . . . 12

Figure 1-5 Removing a Short Rack from the Shipping Crate . . . . . . 15

Figure 1-6 Removing a Tall Rack from the Shipping Crate. . . . . . . 18

Figure 1-7 Leveling Bolts . . . . . . . . . . . . . . . . 19

Figure 1-8 Seismic Tie-down Attachment Points . . . . . . . . . 20

Figure 1-9 Leveling Bolts . . . . . . . . . . . . . . . . 21

Figure 1-10 Joining Locations . . . . . . . . . . . . . . . 22

Figure 1-11 Location of Table-mounting Feet . . . . . . . . . . . 24

Figure 1-12 Removing the Chassis Rail from the Slide Rail . . . . . . . 28

Figure 1-13 Attaching the Rear Mounting Bracket to the Slide Rail . . . . 29

Figure 1-14 Attaching Chassis Rails to the Module Chassis . . . . . . . 30

Figure 1-15 Mounting Hole Pattern of Rack Vertical Rails . . . . . . . 31

Figure 1-16 Placing the Barnuts on the Rack Rails . . . . . . . . . 33

Figure 1-17 Attaching the Slide Rail to the Rack . . . . . . . . . . 34

Figure 1-18 Installing Clip Nuts in Rack Rails . . . . . . . . . . 35

Figure 1-19 Pressing the Safety Latches . . . . . . . . . . . . 37

Figure 1-20 Securing the Module to the Rack . . . . . . . . . . . 38

Figure 1-21 Releasing the Safety Latches . . . . . . . . . . . . 40

Figure 1-22 Releasing the Slide Latches . . . . . . . . . . . . 41

Figure 1-23 Installing the Shelf Rails in the Rack . . . . . . . . . . 43

Figure 1-24 Securing the Module to the Rack . . . . . . . . . . . 44

Figure 1-25 Cabling a Base Compute Module to a System Expansion Compute

Module . . . . . . . . . . . . . . . . . . 46

Figure 1-26 Cabling Multiple Modules to Each Other . . . . . . . . 47

007-4566-001 xi

Figures

Figure 1-27 Power Connector on the Rear of the Base Compute Module . . . 48

Figure 1-28 Connecting a Dual-module System to a Power Source . . . . . 49

Figure 1-29 Connecting Multiple Modules to a Power Source . . . . . . 50

Figure 1-30 Location of the Console Port . . . . . . . . . . . . 52

Figure 1-31 PDU Circuit Breaker . . . . . . . . . . . . . . 55

Figure 1-32 Location of the Power Button . . . . . . . . . . . . 57

Figure 1-33 Front Panel Functions . . . . . . . . . . . . . . 62

Figure 2-1 Example of SGI Origin 350 Server Systems . . . . . . . . 67

Figure 2-2 Base Compute Module Connected to an Expansion Compute

Module . . . . . . . . . . . . . . . . . . 70

Figure 2-3 Compute Modules Connected via a NUMAlink Module . . . . 71

Figure 2-4 Base Compute Module Connected to an MPX Module . . . . . 72

Figure 2-5 Connection of MPX and PCI Expansion Modules to Compute

Modules via NUMAlink Module . . . . . . . . . . . 74

Figure 2-6 Examples of Base Configurations in 17U and 39U Racks . . . . 77

Figure 2-7 Examples of NUMAlink Configurations in 17U and 39U Racks . . 79

Figure 2-8 Component Example of NUMAlink Configuration . . . . . . 82

Figure 2-9 Front and Rear Views of Compute Module . . . . . . . . 84

Figure 2-10 NUMAlink Module . . . . . . . . . . . . . . . 85

Figure 2-11 MPX Module. . . . . . . . . . . . . . . . . 86

Figure 2-12 PCI Expansion Module . . . . . . . . . . . . . . 88

Figure 2-13 PCI Card Slot Numbering on the PCI Expansion Module . . . . 89

Figure 2-14 SGI TP900 Storage Module. . . . . . . . . . . . . 91

Figure 2-15 2Gb SGI TP9100 Storage System . . . . . . . . . . . 92

Figure 2-16 SGI TP9400 Storage System . . . . . . . . . . . . 93

Figure 2-17 L2 Controller. . . . . . . . . . . . . . . . . 97

Figure 2-18 System Control for Base Configuration . . . . . . . . . 98

Figure 2-19 System Control for NUMAlink Configuration . . . . . . . 98

Figure 2-20 USB Hub . . . . . . . . . . . . . . . . . . 99

Figure 2-21 Power Distribution Unit and Power Strip . . . . . . . 100

Figure 2-22 Power Bay Module . . . . . . . . . . . . . . 101

Figure 2-23 Power Connections for a Sample Origin 350 Server System . . 102

Figure 2-24 Unit Numbering within Rack . . . . . . . . . . . 103

xii 007-4566-001

Figures

Figure 2-25 Slide Mounting Rails . . . . . . . . . . . . . .104

Figure 2-26 L-shaped Mounting Rails (Shelf Rails) . . . . . . . . .105

Figure 2-27 Front Views of Short and Tall Racks . . . . . . . . . .106

Figure 3-1 Front and Side Views of a Compute Module . . . . . . .109

Figure 3-2 Block Diagram of Base Compute Module . . . . . . . .113

Figure 3-3 IP53 Node Board . . . . . . . . . . . . . . .115

Figure 3-4 Local Memory Layout . . . . . . . . . . . . . .118

Figure 3-5 Front Panel Items . . . . . . . . . . . . . . .122

Figure 3-6 Rear Panel Items . . . . . . . . . . . . . . .124

Figure 3-7 System with One Base Compute Module and One MPX Module. .128 Figure 3-8 System with a PCI Expansion Module, an MPX Module, a

NUMAlink Module, a System Expansion Compute Module, and

a Base Compute Module . . . . . . . . . . . . .129

Figure 4-1 Front and Side Views of MPX Module . . . . . . . . .134

Figure 4-2 Local Memory Layout . . . . . . . . . . . . . .137

Figure 4-3 Front Panel Items . . . . . . . . . . . . . . .139

Figure 4-4 Rear Panel Items . . . . . . . . . . . . . . .141

Figure 4-5 System with One MPX Module and One Base Compute Module. .144 Figure 4-6 System with PCI Expansion Module, MPX Module, NUMAlink

Module, System Expansion Compute Module, and a Base

Compute Module . . . . . . . . . . . . . . .145

Figure 5-1 Block Diagram of NUMAlink Module . . . . . . . . .148

Figure 5-2 Front View of NUMAlink Module . . . . . . . . . .150

Figure 5-3 Rear View of NUMAlink Module . . . . . . . . . .152

Figure 6-1 PCI and PCI-X Card Slots in the Rear Panel of the Base Compute

Module . . . . . . . . . . . . . . . . . .157

Figure 6-2 Opening the Cover to Install the Card . . . . . . . . .159

Figure 6-3 Removing the Chassis Rail . . . . . . . . . . . .160

Figure 6-4 Removing the Lower PCI/PCI-X Support Bracket . . . . . .161

Figure 6-5 Removing Blanking Plate . . . . . . . . . . . . .162

Figure 6-6 Installing the Card and Installing the Retaining Screw . . . .163

Figure 6-7 Replacing the Lower PCI/PCI-X Support Bracket . . . . . .164

Figure 6-8 Replacing the Chassis Rail. . . . . . . . . . . . .165

Figure 6-9 Closing the Cover . . . . . . . . . . . . . . .166

007-4566-001 xiii

Figures

Figure 6-10 Opening the Cover to Remove the Card . . . . . . . . 168

Figure 6-11 Removing the Chassis Rail . . . . . . . . . . . . 169

Figure 6-12 Removing the Lower PCI/PCI-X Support Bracket . . . . . 170

Figure 6-13 Removing the Retaining Screw and Extracting the Card . . . 171

Figure 6-14 Placing a Blanking Plate . . . . . . . . . . . . 172

Figure 6-15 Replacing the Lower PCI/PCI-X Support Bracket . . . . . 173

Figure 6-16 Replacing the Chassis Rail . . . . . . . . . . . . 174

Figure 6-17 Close and Screw Down Cover . . . . . . . . . . . 175

Figure 6-18 Disk Drive Location. . . . . . . . . . . . . . 176

Figure 6-19 Installing a Disk Drive . . . . . . . . . . . . . 178

Figure 6-20 Removing a Disk Drive . . . . . . . . . . . . . 180

Figure 6-21 Power Supplies Location . . . . . . . . . . . . 181

Figure 6-22 Removing a Power Supply . . . . . . . . . . . . 184

Figure 6-23 Installing the power supply . . . . . . . . . . . 185

Figure 6-24 Layout of DIMM Slots and Local Memory Banks . . . . . 188

Figure 6-25 Opening Module Cover to Install DIMMs . . . . . . . 190

Figure 6-26 Removing the Plastic Air Baffle . . . . . . . . . . 191

Figure 6-27 Inserting a DIMM . . . . . . . . . . . . . . 192

Figure 6-28 Opening Module to Remove DIMM . . . . . . . . . 193

Figure 6-29 Removing the Plastic Air Baffle . . . . . . . . . . 194

Figure 6-30 Removing a DIMM . . . . . . . . . . . . . . 195

Figure 6-31 L1 Controller Display on Base Compute Module . . . . . 196

Figure 6-32 Opening the Module to Access the L1 Controller Display . . . 197

Figure 6-33 Removing the L1 Controller Display Panel . . . . . . . 198

Figure 6-34 Installing an L1 Controller Display Panel . . . . . . . 200

Figure 7-1 Full Support Sequence . . . . . . . . . . . . . 208

Figure A-1 Rear Panel of Compute Module . . . . . . . . . . 223

Figure A-2 Non-Proprietary Connectors on Rear Panel of MPX Module . . 224 Figure A-3 Non-Proprietary Connectors on Rear Panel of L2 Controller . . 225 Figure A-4 Non-Proprietary Connector on Rear Panel of NUMAlink Module 226 Figure A-5 Non-proprietary Connectors on Rear Panel of TP900 Storage

Module . . . . . . . . . . . . . . . . . 226

Figure A-6 USB Hub Type A Connectors . . . . . . . . . . . 227

xiv 007-4566-001

Figures

Figure A-7 DB-9 Connector Pin Assignments . . . . . . . . . .228

Figure A-8 RJ-45 Connector Pin Assignments . . . . . . . . . .229

Figure A-9 Pin Number Locations for External SCSI Port . . . . . . .230

Figure A-10 Stereo Jack Connector Conductors . . . . . . . . . .232

Figure A-11 Pin Number Locations for USB Type A Connector . . . . . .233

Figure A-12 Pin Number Locations for USB Type B Connector . . . . . .234

Figure A-13 Pin Number Locations for the PS/2 Keyboard and Mouse

Connectors . . . . . . . . . . . . . . . . .235

007-4566-001 xv

Tables

Table 1-1 Installation Tools . . . . . . . . . . . . . . . 7

Table 1-2 Module Space Requirements . . . . . . . . . . . . 26

Table 1-3 Rackmounting Hardware . . . . . . . . . . . . . 26

Table 2-1 Origin 350 Configuration Ranges. . . . . . . . . . . 75

Table 2-2 Supported Tape Drive Subsystems . . . . . . . . . . 95

Table 3-1 Comparing Origin 300 Server System with Origin 350 Server

System . . . . . . . . . . . . . . . . . .110

Table 3-2 DIMMs and Bank Pairs . . . . . . . . . . . . .117

Table 3-3 Memory DIMM Specifications . . . . . . . . . . .118

Table 3-4 Bandwidth Characteristics of the Compute Module . . . . .130

Table 3-5 General Features of the Compute Module . . . . . . . .130

Table 3-6 Compute Module Specifications . . . . . . . . . . .131

Table 4-1 DIMM Slots and Corresponding Bank Pairs . . . . . . .136

Table 4-2 Memory DIMM Specifications . . . . . . . . . . .137

Table 4-3 Bandwidth Characteristics of the MPX Module. . . . . . .146

Table 4-4 MPX Module Specifications . . . . . . . . . . . .146

Table 5-1 NUMAlink Module Technical Specifications . . . . . . .153

Table 5-2 NUMAlink Module Port Specifications . . . . . . . . .153

Table 5-3 Bandwidth Characteristics of the NUMAlink Module . . . . .153

Table 6-1 LED Status and Power Supply Condition . . . . . . . .182

Table 6-2 DIMMs and Bank Pairs . . . . . . . . . . . . .186

Table 7-1 Troubleshooting Chart. . . . . . . . . . . . . .204

Table 7-2 L1 Controller Messages . . . . . . . . . . . . .206

Table A-1 Environmental Specifications . . . . . . . . . . . .212

Table A-2 Bandwidth Characteristics of the Compute Module . . . . .213

Table A-3 General Features of the Compute Module . . . . . . . .213

Table A-4 Compute Module Specifications . . . . . . . . . . .214

007-4566-001 xvii

Tables

Table A-5 Bandwidth Characteristics of the MPX Module . . . . . . 215

Table A-6 MPX Module Specifications . . . . . . . . . . . 215

Table A-7 Bandwidth Characteristics of the PCI Expansion Module . . . 216

Table A-8 PCI Expansion Module Specifications . . . . . . . . 216

Table A-9 Bandwidth Characteristics of the NUMAlink Module . . . . 217

Table A-10 NUMAlink Module Specifications . . . . . . . . . 217

Table A-11 NUMAlink Module Port Specifications . . . . . . . . 217

Table A-12 Short Rack Specifications (with Skins) . . . . . . . . 218

Table A-13 Tall Rack Specifications. . . . . . . . . . . . . 218

Table A-14 TP900 Storage Module Specifications. . . . . . . . . 219

Table A-15 Power Bay Module Specifications . . . . . . . . . . 220

Table A-16 Power Supply Specifications . . . . . . . . . . . 220

Table A-17 USB Hub Specifications. . . . . . . . . . . . . 221

Table A-18 Compute Module Connectors . . . . . . . . . . . 222

Table A-19 MPX Module Connectors . . . . . . . . . . . . 224

Table A-20 L2 Controller Connectors . . . . . . . . . . . . 225

Table A-21 Ethernet Connector Pin Assignments. . . . . . . . . 229

Table A-22 SCSI VHDCI Pin Assignments. . . . . . . . . . . 230

Table A-23 Conductor Assignments for Stereo Jack Connector . . . . . 232

Table A-24 Pin Assignments for USB Type A Connector . . . . . . 233

Table A-25 Pin Assignments for USB Type B Connector. . . . . . . 234

Table A-26 Pin Assignments for the PS/2 Connectors . . . . . . . 235

xviii 007-4566-001

About This Guide

This guide provides an overview of the SGI Origin 350 server system components. It also describes how to set up and operate the Origin 350 server system.

The Origin 350 server system is either a standalone base compute module, or a base compute module connected and rackmounted with the following optional modules that expand the function of the system:

• A system expansion compute module, which is interconnected to the base compute module via a NUMAlink 3 cable, adds processors, memory, and PCI/PCI-X card slots, but may or may not have an IO9 card. (The new single system created by connecting the two modules together can include 4, 6, or 8 processors with local memory of up to 16 GB.)

• A 2U memory and PCI expansion (MPX) module provides extra memory and four PCI and PCI-X card slots to your system. See Chapter 4, “Memory and PCI Expansion (MPX) Module,” for information about this module.

• The 4U PCI expansion module adds PCI slots, but no processors, no memory, and no IO9 card. There are two versions of the PCI expansion module: one module has 12 PCI slots that support 3.3-V or universal PCI cards, and the other module has 6 PCI slots that support 5-V or universal PCI cards and 6 slots that support 3.3-V or universal PCI cards. For information about this module, see PCI Expansion Module User’s Guide (5.0-V Support and/or 3.3-V Support) (007-4499-00x).

• The SGI TP900 storage module provides additional storage to the system. For information about this module, see SGI Total Performance 900 Storage System User’s Guide (007-4428-00x). The Origin 350 server supports other storage modules. See “Storage Expansion” on page 89 for information.

• The NUMAlink module connects two or more compute modules in your server system. See Chapter 5, “NUMAlink Module,” for information about this module.

This guide is written for owners, system administrators, and users of the Origin 350 server system. It is written with the assumption that the reader has a general knowledge of computers and computer operations.

007-4566-001 xix

About This Guide

Important Information

Your SGI system support engineer (SSE) should perform the addition or replacement of parts, cabling, and service of your Origin 350 server system, with the exception of the following tasks that you may perform yourself:

• Installing your system in a rack.

• Cabling the system modules to each other.

• Connecting a system console to your server system.

• Using your system console to enter commands and perform system functions such as powering on and powering off.

• Using the On/Off, reset, and non-maskable interrupt (NMI) switches on the front panel of your server system.

• Installing and removing PCI and PCI-X cards.

Caution: Exception: Because the installation and removal of an IO9 PCI card, which installs in the lowermost slot, is more complicated and can cause damage to your system if not performed properly, it can only be installed and removed by a trained SGI system support engineer.

• Installing and removing disk drives.

• Installing and removing power supplies.

• Installing and removing DIMMs.

• Installing and removing the L1 controller display.

Chapter Descriptions

The following topics are covered in this guide:

• Chapter 1, “Installation and Operation,” provides instructions for rack mounting, cabling, and operating the Origin 350 server system.

• Chapter 2, “System Overview,” provides a general overview of the Origin 350 server system, including a list of the system features. This chapter also includes a quick description of the various components and modules that can be part of an Origin 350 server system.

xx 007-4566-001

About This Guide

• Chapter 3, “Compute Module,” describes the Origin 350 base and system expansion

compute modules and provides details about their internal and external components.

• Chapter 4, “Memory and PCI Expansion (MPX) Module,” describes the MPX

module and provides details about its internal and external components.

• Chapter 5, “NUMAlink Module,” describes the NUMAlink module and provides

details about its internal and external components.

• Chapter 6, “Installing and Removing Customer-replaceable Units,” describes how

to install and remove the following customer-replaceable units (CRUs): PCI and PCI-X cards, disk drives, power supplies, memory (DIMMs), and the L1 system controller display.

• Chapter 7, “Troubleshooting,” describes how to troubleshoot your system by using

the L1 controller and L1 controller messages, and by reading your system LEDs.

• Appendix A, “Technical Speciﬁcations,” contains environmental and physical

speciﬁcations for the Origin 350 server system, as well as pin assignments for non-proprietary connectors for the various modules that can be part of an Origin 350 server system.

• Appendix B, “Regulatory Speciﬁcations and Safety Information,” contains

regulatory speciﬁcations and safety information related to the Origin 350 server system.

An index completes this guide.

007-4566-001 xxi

About This Guide

Related Publications

This section lists various information sources and explains how to access them. The following SGI publications relate to the Origin 350 server system:

• SGI Origin 350 Server System User’s Guide (this manual) (hard copy shipped with the

• IRIX Admin Software Installation and Licensing Guide (hard copy shipped with system

system and available online) (007-4566-00x). Use this guide to become acquainted with your server and to learn how to operate and monitor the server system. In addition, this guide contains information on installing the server system in a 19-inch rack, cabling the system, and replacing PCI and PCI-X cards, disk drives, power supplies, DIMMs, and an L1 display.

Warning: To ensure your safety and protect your system, do not add or replace

any components that this guide does not designate as customer replaceable. Contact your SGI system support engineer (SSE) to install any hardware components that are not designated as customer replaceable in this guide.

and available online) (007-1364-xxx). This is the complete reference guide on using the installation program, inst, to install software. For information on using the Software Manager to install software, see the online Personal System Administration

Guide.

• SGI L1 and L2 Controller Software User’s Guide (007-3938-00x) (hard copy shipped

with system and available online). This guide describes the L1 and L2 controller functions, commands, and error messages that you may need to operate and maintain your system.

• PCI Expansion Module User’s Guide (5.0-V Support and/or 3.3-V Support) (007-4499-00x). This guide describes the 4U PCI expansion module, which is an optional module that adds 12 PCI slots (but no processors, or memory, and no IO9 card) to your system.

• SGI Total Performance 900 Storage System User’s Guide (007-4428-00x). This guide describes the SGI TP900 storage module, which provides additional storage to the Origin 350 server system.

• SGIconsole Hardware Connectivity Guide (007-4340-00x) (optional). This guide describes how to connect an SGIconsole to your Origin 350 server system and other systems supported by the SGIconsole. You use the SGIconsole to manage and monitor your graphics systems.

xxii 007-4566-001

About This Guide

You can obtain SGI documentation, release notes, or man pages in the following ways:

• See the SGI Technical Publications Library at http://docs.sgi.com. Various formats

are available. This library contains the most recent and most comprehensive set of online books, release notes, man pages, and other information.

• If it is installed on your SGI system, you can use InfoSearch, an online tool that

provides a more limited set of online books, release notes, and man pages. With an IRIX system, select Help from the Toolchest, and then select InfoSearch. Or you can type infosearch on a command line.

• You can also view release notes by typing either grelnotes or relnotes on a

command line.

• You can also view man pages by typing man <title> on a command line. The

following paragraphs provide more information about man pages.

SGI systems include a set of IRIX man pages, formatted in the standard UNIX “man page” style. Important system conﬁguration ﬁles and commands are documented on man pages. These are found online on the internal system disk (or CD-ROM) and are displayed using the man command. For example, to display the man page for the Add_disk command, type the following on a command line:

man Add_disk

References in the documentation to these pages include the name of the command and the section number in which the command is found. For example, “Add_disk(1)” refers to the Add_disk command and indicates that it is found in section 1 of the IRIX reference.

For additional information about displaying man pages using the man command, see man(1).

In addition, the apropos command locates man pages based on keywords. For example, to display a list of man pages that describe disks, type the following on a command line:

apropos disk

For information about setting up and using apropos, see apropos(1) and makewhatis(1M).

007-4566-001 xxiii

About This Guide

Conventions

The following conventions are used throughout this document:

Convention Meaning

Command This ﬁxed-space font denotes literal items such as commands, ﬁles,

routines, path names, signals, messages, andprogramming language structures.

variable The italic typeface denotes variable entries and words or concepts

being deﬁned. Italic typeface is also used for book titles.

user input This ﬁxed-space font denotes literal items that the user enters in

interactive sessions. Output is shown in nonbold, ﬁxed-space font.

[ ] Brackets enclose optional portions of a command or directive line.

... Ellipses indicate that a preceding element can be repeated. man page(x) Man page section identiﬁers appear in parentheses after man page

names.

GUI element This font denotes the names of graphical user interface (GUI)

elements such as windows, screens, dialog boxes, menus, toolbars, icons, buttons, boxes, ﬁelds, and lists.

Product Support

SGI provides a comprehensive product support and maintenance program for its products, as follows:

• If you are in North America, contact the Technical Assistance Center at 1 (800) 800 4SGI or contact your authorized service provider.

• If you are outside North America, contact the SGI subsidiary or authorized distributor in your country.

xxiv 007-4566-001

Reader Comments

About This Guide

If you have comments about the technical accuracy, content, or organization of this document, contact SGI. Be sure to include the title and document number of the manual with your comments. (Online, the document number is located in the front matter of the manual. In printed manuals, the document number is located at the bottom of each page.)

You can contact SGI in any of the following ways:

• Send e-mail to the following address:

techpubs@sgi.com

• Use the Feedback option on the Technical Publications Library website:

http://docs.sgi.com

• Contact your customer service representative and ask that an incident be ﬁled in the

SGI incident tracking system.

• Send mail to the following address:

Technical Publications SGI 1600 Amphitheatre Pkwy., M/S 535 Mountain View, California 94043-1351

• Send a fax to the attention of “Technical Publications” at +1 650 932 0801.

SGI values your comments and will respond to them promptly.

007-4566-001 xxv

Chapter 1

1. Installation and Operation

This chapter describes how to install and operate your SGI Origin 350 server system. Speciﬁcally, the following topics are covered:

• “System Installation Overview (the Road Map)” on page 2

• “Safety Precautions” on page 3

• “Installing a Rack” on page 5

• “Unpacking and Inspecting Server System Modules” on page 23

• “Setting the Server System on a Table Top” on page 23

• “Installing the Server System in a Rack” on page 25

Note: The rackmounting kit enables the module to be mounted in an SGI rack and in an industry-standard 19-inch wide rack.

• “Cabling the System Modules to Each Other” on page 45

• “Cabling the Server System to a Power Source” on page 48

• “Connecting the System Console” on page 51

• “Operating the Server System” on page 53

007-4566-001 1

1: Installation and Operation

System Installation Overview (the Road Map)

In this chapter, different installation instructions are provided for different types of system installations. Follow the instructions for your type of installation, as follows:

Note: It is assumed that you will be connecting a system console to your server system in each installation case.

• If you have ordered a server system that is already rackmounted, which means that the modules that compose your system are also already cabled together, follow the instructions in these sections:

– “Safety Precautions” on page 3

– “Installing a Rack” on page 5

– “Cabling the Server System to a Power Source” on page 48

– “Connecting the System Console” on page 51

• If you have ordered system modules and an empty rack or racks with the intention of rackmounting and cabling your own server system, follow the instructions in these sections:

– “Safety Precautions” on page 3

– “Installing a Rack” on page 5

– “Unpacking and Inspecting Server System Modules” on page 23

– “Installing the Server System in a Rack” on page 25

– “Cabling the System Modules to Each Other” on page 45

– “Cabling the Server System to a Power Source” on page 48

– “Connecting the System Console” on page 51

• If you have ordered either a single- or dual-module server system that you intend to install on a table top, follow the instructions in these sections:

– “Safety Precautions” on page 3

– “Unpacking and Inspecting Server System Modules” on page 23

– “Cabling the System Modules to Each Other” on page 45

– “Cabling the Server System to a Power Source” on page 48

2 007-4566-001

• If you have your own rack, and have ordered server system modules with the

Safety Precautions

Before you install an Origin 350 server system, you should familiarize yourself with the safety precautions discussed in the following subsections:

Safety Precautions

– “Connecting the System Console” on page 51

intention of rackmounting and cabling your own server system, follow the instructions in these sections:

– “Safety Precautions” on page 3

– “Unpacking and Inspecting Server System Modules” on page 23

– “Installing the Server System in a Rack” on page 25

– “Cabling the System Modules to Each Other” on page 45

– “Cabling the Server System to a Power Source” on page 48

– “Connecting the System Console” on page 51

• “Hazard Statements” on page 3

• “ESD Precautions” on page 4

• “Safety Measures” on page 4

Hazard Statements

During the installation of the computer system, be alert for hazard advisory statements with icons, which signify the following:

• Caution Indicates a potentially hazardous situation that, if not avoided, can result

in minor or moderate injury. A caution statement also alerts you to unsafe practices that can result in equipment damage and/or data corruption. A caution message is accompanied by an icon as shown in the following example:

Caution:

!

007-4566-001 3

1: Installation and Operation

ESD Precautions

• Warning indicates a potentially hazardous situation that, if not avoided, could result in death or serious injury. A warning message is accompanied by icon as shown in the following example:

Warning:

• Danger indicates an imminently hazardous situation that, if not avoided, will result in death or serious injury. A danger message is accompanied by the same icon as a warning.

Observe electrostatic discharge (ESD) precautions during the entire installation process to eliminate possible ESD damage to the equipment. Wear an SGI-approved wrist strap when you handle an ESD-sensitive device. Connect the wrist strap cord directly to earth ground.

Caution: Observe all ESD precautions. Failure to do so can result in damage to the

!

equipment.

Safety Measures

Observe the following safety measures when you install the system:

• Use caution when you remove the system from the shipping crate. Failure to handle the system carefully can result in personal injury or property damage.

Warning: Ensure that the shipping crate is positioned close to its destination

before you unpack the crate.

4 007-4566-001

Installing a Rack

Warning: Employ a minimum of two people to lift the system module or

modules off the shipping pallet, to move the module(s) from one location to another, and to install the module(s) in a rack. Otherwise, someone could be seriously injured.

• Do not move the system while it is connected to power.

Danger: Keep ﬁngers and conductive tools away from high-voltage areas. Failure to

follow these precautions will result in serious injury or death. The high-voltage areas of the system are indicated with high-voltage warning labels.

• Ensure that a qualiﬁed electrician has properly installed the power receptacles.

• Set all circuit breakers to the OFF (O) position before you plug in the system power

cord.

Warning: Use the following guidelines to prevent the rack from toppling over.

Otherwise, people could be seriously injured and/or equipment could be damaged.

• Follow these guidelines to prevent the rack from toppling over:

• Make sure that only one module is extended out of the rack at one time.

• Install all equipment in the lowest available position in the rack.

• Ensure that the tip tray is bolted to the front of the rack.

Installing a Rack

This section describes how to install a rack at your site location, as follows:

• “Preinstallation Activities” on page 6

• “Unloading and Moving System Equipment” on page 10

• “Removing a Short Rack from the Shipping Crate” on page 13

• “Removing a Tall Rack from the Shipping Crate” on page 16

• “Positioning and Leveling a Single-rack System” on page 19

007-4566-001 5

1: Installation and Operation

• “Positioning and Leveling a Multiple-rack (Clustered) System” on page 20

Although these instructions are based on the assumption that you have ordered an empty rack or racks to rackmount your own modules, you can also use these instructions to install a rack that already has your server system modules rackmounted and cabled together. If this is the case, after you have completed installing your rack, proceed to “Cabling the Server System to a Power Source” on page 48 to continue your installation.

If your system will not be rackmounted, skip thissection and proceed to “Unpacking and Inspecting Server System Modules” on page 23 to begin your installation.

Preinstallation Activities

Perform the following preinstallation activities days or weeks before you receive your system: perform site veriﬁcations, gather appropriate tools to complete the installation, and ensure that the correct power receptacle is installed and properly wired. These activities are explained in the following subsections:

• “Site Plan Veriﬁcation” on page 6

Site Plan Veriﬁcation

• “Tools Required” on page 7

• “Power Receptacle Veriﬁcation” on page 7

Ensure that all site requirements are met before your system arrives. If you have questions about the site requirements or you would like to order full-size ﬂoor templates for your site, contact a site planning representative by e-mail (site@sgi.com) or by telephone (+1 715 726 2820).

6 007-4566-001

Tools Required

Table 1-1 lists the tools that you need to complete the installation.

Table 1-1 Installation Tools

Tool Part Number Purpose

13-mm wrench 7260744 Adjust the leveling pads.

13-mm socket (3/8-in. drive) 7260726 Remove bracket bolts from tall rack shipping

19-mm socket (3/8-in. drive) 9470618 Remove bolts from short rack shipping crate.

Extension, 6-in. (3/8-in. drive) 7260655 Used with ratchet and sockets.

Ratchet, reversible (3/8-in. drive) 7260755 Used with extension and sockets.

Level, 9-in. 9470556 Level the rack.

Power Receptacle Veriﬁcation

Installing a Rack

crate.

Ensure that a qualiﬁed technician installs the correct power receptacles. The Origin 350 server system uses one or two single-phase power receptacles. For North American sites, the single-phase receptacle is a 30-amp, 200- to 240-volt receptacle that has two phase sockets and one ground socket. For international sites, the single-phase receptacle is a 32-amp, 200-volt receptacle that has one phase socket, one neutral socket, and one ground socket.

For North American sites, follow these steps to ensure that a single-phase power receptacle is properly wired:

1. Set the voltmeter to a high AC voltage range.

2. Check the voltage between socket X and socket Y (see Figure 1-1). The meter should

read between 200 and 240 VAC.

3. Check the voltage between socket X and the ground socket. The meter should read

approximately 120 VAC.

4. Check the voltage between socket Y and the ground socket. The meter should read

approximately 120 VAC.

5. Check the voltage between the ground socket and an earth-ground location. The

meter should read 0 VAC.

007-4566-001 7

1: Installation and Operation

!

6. Change the voltmeter to a low-resistance setting.

7. Measure between the ground socket and an appropriate earth-ground location and ensure that resistance is less than 1 ohm.

8. Repeat steps 1 through 7 for any additional single-phase power receptacles.

Caution: If a voltage reading is incorrect, or if the resistance measured in step 7 is more than 1 ohm, contact a site-approved electrician. Do not proceed with the installation.

Ground pole

Pole Y

Power cord connector

Pole X

Ground socket

Figure 1-1 30-amp Single-phase Power Receptacle for North American Sites

Socket X

Socket Y

Receptacle

For international sites, follow these steps to ensure that a single-phase power receptacle is properly wired:

1. Set the voltmeter to a high AC voltage range.

2. Check the voltage between socket 1 and socket 2 (see Figure 1-2). The meter should read between 200 and 240 VAC.

8 007-4566-001

Installing a Rack

3. Check the voltage between socket 1 (line) and the ground socket. The meter should

read between 200 and 240 VAC.

4. Check the voltage between socket 2 (neutral) and the ground socket. The meter

should read approximately 0 VAC.

5. Check the voltage between the ground socket and an earth-ground location. The

meter should read 0 VAC.

6. Change the voltmeter to a low-resistance setting.

7. Measure between the ground socket and an appropriate earth-ground location and

ensure that resistance is less than 1 ohm.

8. Repeat steps 1 through 7 for any additional single-phase power receptacles.

Caution: If a voltage reading is incorrect, or if the resistance measured in step 7 is more than 1 ohm, contact a site-approved electrician. Do not proceed with the installation.

!

Pin 1 (line)

Pin 2 (neutral)

Power cord connector

Ground socket

Socket 2

Ground pin

Socket 1 (line)

Figure 1-2 32-amp Single-phase Power Plug for International Sites

(neutral)

Receptacle

007-4566-001 9

1: Installation and Operation

Unloading and Moving System Equipment

The Origin 350 server system arrives at the site in cardboard shipping crates.

For a short rack system, the documentation carton and the accessories carton are packed with the system. The documentation carton contains the system manuals as well as warranty and licensing information. The accessories carton contains the I/O, peripheral, and system cables, and any additional connectors or tools that are required for a speciﬁc conﬁguration. The PC, workstation, or terminal is shipped in a separate carton.

For a tall rack system, the system documentation; accessories; and PC, workstation, or terminal arrive in separate cartons.

This section describes how to unload and transport the system to its designated location, as follows:

• “Unloading the Equipment from the Truck” on page 10

• “Inspecting the Shipping Crate” on page 12

• “Transporting the Shipping Crate” on page 13

Unloading the Equipment from the Truck

If your loading dock is the same height as the transportation vehicle, use a pallet jack to unload the system from the transportation vehicle. The pallet jack should have 48-in. tines or forks. Follow any instructions that are printed on the packing crates.

If the loading dock is not the same height as the vehicle, you must provide a forklift or another approved method to unload the system. You can use a platform or ramp to obtain the desired level as long as the ramp incline does not exceed a ratio of one unit vertical to six units horizontal. For more information on site requirements, contact site planning by e-mail (site@sgi.com) or by telephone (+1 715 726 2820).

Warning: Use two or more people to prevent computer equipment from rolling off

the transportation vehicle. Failure to do so could result in serious damage to the computer equipment.

10 007-4566-001

Installing a Rack

If your site does not have a loading dock, arrange for a forklift to unload the system from the transportation vehicle. Ensure that two or three people are available to help unload the equipment. Move all crates slowly and carefully.

Figure 1-3 shows the lift openings and dimensions of a tall rack shipping crate. This ﬁgure also shows where to position the pallet jack.

Side view End view

81.5

(2070.1 mm)

50.5

(1524 mm)

51.25

(1301.75 mm)

40

(1016 mm)

Pallet jack position

Figure 1-3 Dimensions of Tall Rack Shipping Crate

007-4566-001 11

1: Installation and Operation

Figure 1-4 shows the lift openings and dimensions of a short rack shipping crate. This ﬁgure also shows where to position the pallet jack.

(1238 mm)

Pallet jack position

Figure 1-4 Dimensions of Short Rack Shipping Crate

Inspecting the Shipping Crate

After the system is unloaded from the truck, follow these steps before you unpack it:

1. Ensure that the crates and cartons arrive unopened.

2. Inspect the shipping crate for signs of external damage such as dents, holes, crushed

Side view

48.75

42.75

(1068 mm)

corners, and water marks.

End view

29.25

(743 mm)

3. Ensure that the tilt watch has not been tripped.

4. If the crate is damaged, ﬁle a damage claim with the carrier immediately. In addition, notify your local Customer Support Center (CSC) for any missing, incorrect, or damaged items. For CSC contact information, see http://www.sgi.com/support/supportcenters.html.

12 007-4566-001

Transporting the Shipping Crate

Use a pallet jack with forks that are 48 in. (122 cm) long or longer to transport the shipping crate to the designated location. See Figure 1-3 and Figure 1-4 for the crate dimensions and location to position the pallet jack. For system weight and dimensions, contact site planning by e-mail (site@sgi.com) or by telephone (+1 715 726 2820).

If the crate does not ﬁt through all access doors, you may need to partially disassemble the crate.

Caution: If the system shipping or storage environment is signiﬁcantly colder than the

!

environment in which it will be installed [40 ºF (22 ºC) or greater disparity], leave the rack in its shipping crate for at least 24 hours at room temperature before you start the installation. This acclimation prevents damage to the equipment that could result from thermal shock and condensation.

Removing a Short Rack from the Shipping Crate

Installing a Rack

Warning: Be careful when you unpack and move the short rack system. Ensure that

the rack remains on a level surface and that the rack weight remains evenly distributed across the four casters. If you must lift the casters over an obstacle, such as a door threshold, use proper lifting techniques and employ a minimum of two people.

Caution: Do not subject the rack to any unnecessary shocks or vibration while you

!

007-4566-001 13

unpack and install the system.

See Figure 1-5 as you follow these steps; the numbered illustrations correspond to the numbered steps.

1. Ensure that the temperature of the rack is acclimated to the environment in which

you are installing it.

2. Remove the crate cover.

3. Lift the ramp out of the crate and set it aside.

4. Remove the documentation carton, accessories carton, and cardboard packing

material.

5. Lift the sidewalls of the crate up and over the system.

1: Installation and Operation

6. Remove the four bolts that secure the rack to the crate. You must reach underneath the crate and feel for the bolts.

7. Align the holes in the edge of the ramp with the pegs in the base of the crate. Ensure that the ramp is secure.

8. Remove the gate pins from the left and right ends of the gate. Then remove the gate.

9. Pull the rack down the ramp.

Warning: The maximum weight of the short rack is 488 lb (221 kg). Use caution

when you roll the rack down the ramp.

14 007-4566-001

Installing a Rack

Figure 1-5 Removing a Short Rack from the Shipping Crate

007-4566-001 15

Peg

1: Installation and Operation

Removing a Tall Rack from the Shipping Crate

Warning: In its maximum conﬁguration, a tall rack system weighs approximately

1,110 lb (499 kg). Use caution when you unpack and move this rack. Ensure that the rack remains on a level surface and that the rack weight remains evenly distributed across the four casters.

To unpack a tall rack, you will need the following tools:

• Extension, 6-inch, 3/8-in. drive

• 13-mm standard 3/8-in. drive socket

• Ratchet, reversible, 3/8-in. drive

See Figure 1-6 as you follow these steps; the numbered illustrations correspond to the numbered steps.

1. Ensure that the temperature of the rack is acclimated to the environment in which you are installing it and that the system crate is in a stable, upright position.

2. Remove the bands that secure the crate.

Note: Brace the wooden ramp as you remove the horizontal bandthat surrounds the crate and the wooden ramp. The ramp moves freely after you remove this band.

3. Place the ramp so that the three holes in the edge of the ramp align with the pegs in the base of the pallet deck.

4. Remove the cardboard cover, the two cardboard sidewalls, and the foam cushion.

5. Remove the bolts that secure the rack to the pallet deck, as follows: a. Remove the top four bolts from the rear mounting bracket; do not remove the

bottom bolts.

b. Remove the four bolts that secure the front mounting bracket and tip tray to the

bottom of the pallet deck. Set the tip tray aside.

c. Remove the top four bolts from the front mounting bracket. Set the mounting

bracket aside.

16 007-4566-001

Installing a Rack

6. Use two people to roll the rack out of the crate and down the ramp.

Warning: Use extreme caution when you roll the tall rack down the ramp. Personal

injury and system damage could result if the rack becomes unbalanced or gains too much momentum when it rolls down the ramp.

7. Bolt the tip tray to the front of the rack before you move the rack to its designated

location. This tray prevents the rack from tipping while you move the rack.

007-4566-001 17

1: Installation and Operation

5a

2

3

4

Cardboard cover

Foam cushion

Cardboard sidewalls

Pegs

Ramp

5b

5c

Tip tray

Bolt

Rear mounting bracket

Front mounting

bracket

6

Bolt

7

Front mounting bracket

Tip tray

Figure 1-6 Removing a Tall Rack from the Shipping Crate

18 007-4566-001

Positioning and Leveling a Single-rack System

Caution: To avoid ESDdamage to the electronic components, be sure to positionthe rack

!

before you remove the ESD bag that covers the rack assembly.

To position and level a single-rack system, follow these steps:

1. Grasp the rear of the rack and roll the rack to its designated location.

2. Remove the ESD bag.

3. If you are installing a tall rack, adjust the leveling bolts, as shown in Figure 1-7, until

the rack is level.

Installing a Rack

Figure 1-7 Leveling Bolts

4. Ensure that the circuit breaker on the power distribution unit is in the OFF (O)

position. Then connect the power cord to a grounded power outlet. Plugging in the power cord grounds the rack.

007-4566-001 19

1: Installation and Operation

5. Secure the rack with seismic tie-downs if you are installing the system in an earthquake zone.

Note: Tall and short racks have four threaded holes that are located at the bottom of the rack (see Figure 1-8). Use these holes to secure the seismic tie-downs. SGI does not supply the seismic tie-downs.

Top view of short rack

Top view of tall rack

Seismic tie-down attachment points Casters

Leveling pads

Figure 1-8 Seismic Tie-down Attachment Points

Positioning and Leveling a Multiple-rack (Clustered) System

Caution: To avoid ESD damage to the electronic components, be sure to position the

!

20 007-4566-001

racks before you remove the ESD bags that cover the rack assemblies.

To position and level a multiple-rack (clustered) system, follow these steps:

1. Grasp the rear of each rack and roll the rack to its designated location.

2. Remove the ESD bags.

Installing a Rack

3. Adjust the leveling bolts of rack 001, as shown in Figure 1-9, until the rack is level.

Figure 1-9 Leveling Bolts

4. Using the leveling bolts of rack 002, adjust rack 002 so that the joining holes of rack

002 align with the joining holes of rack 001. See Figure 1-10.

5. Using the provided straps, screws, and washers, bolt the racks together in the four

designated locations shown in Figure 1-10.

6. If your system has additional racks, repeat steps 4 and 5 until all of the racks are

bolted together.

7. Ensure that the circuit breakers on the power distribution units are in the OFF (O)

position. Then connect the power cords to grounded power outlets. Plugging in the power cords grounds the racks.

8. Secure the racks with seismic tie-downs if you are installing the system in an

earthquake zone.

Note: Tall racks have four threaded holes that are located at the bottom of the rack (see Figure 1-8 on page 20). Use these holes to secure the seismic tie-downs. SGI does not supply the seismic tie-downs.

007-4566-001 21

1: Installation and Operation

Joining holes of

location 4

Location 3

Location 2

Location 1

Strap Washer Screw

Figure 1-10 Joining Locations

22 007-4566-001

Unpacking and Inspecting Server System Modules

This section is written for the person who wants to install his or her own individual server system modules either on a rack or on a tabletop. It describes how to unpack and inspect individual server system modules.

Before unpacking your modules, inspect the packaging container for evidence of mishandling during transit. If the packaging container is damaged, photograph it for reference. After you remove the contents, keep the damaged container and the packing materials.

Remove the module or modules from the packaging container and ensure that all accessories are included. Inspect the module(s) and accessories for damage. If the contents appear damaged, ﬁle a damage claim with the carrier immediately. In addition, notify your local Customer Support Center (CSC) for any missing, incorrect, or damaged items. For CSC contact information, see http://www.sgi.com/support/supportcenters.html.

Setting the Server System on a Table Top

If your server system is a single module (the base compute module) system or a dual-module (a base compute module cabled to an MPX module, for example) system, and you choose to operate it on a table top, you need to install ﬁve self-adhesive feet that are supplied with the module(s). To install the feet, follow these steps:

1. Place the module upside down on a ﬂat, stable surface.

2. Peel off the protective ﬁlm from the feet and place them on the ﬁve circular marks,

as shown in Figure 1-11.

3. If you have a dual-module system, repeat steps 1 and 2 to put feet on the second

module. (If you have a dual-module system, it is recommended that you place the base compute module on the bottom, and that you place the other module on top.)

Note: If you mount the system in a rack at a later date, you will need to remove the feet.

007-4566-001 23

1: Installation and Operation

Figure 1-11 Location of Table-mounting Feet

24 007-4566-001

Installing the Server System in a Rack

This section describes how to install the modules that compose an Origin 350 server system on a rack with either a slide rail assembly or with a shelf rail assembly (also known as a ﬁxed rail assembly). It also describes how to remove these modules from these racks.

The base computemodule, thesystem expansion compute module, and the MPX module are rackmounted with slide rails. The NUMAlink module, the PCI expansion module, and the SGI TP900 storage system are rackmounted with shelf rails.

This rackmounting information is found in the following sections:

• “Rackmounting Modules with Slide Rails” on page 25

• “Removing a Module on Slide Rails from a Rack” on page 39

• “Rackmounting Modules with Shelf Rails” on page 42

• “Removing a Module on Shelf Rails from a Rack” on page 44

Installing the Server System in a Rack

Rackmounting Modules with Slide Rails

This section describes how to rackmount modules with slide rail assemblies. You can use the instructions to rackmount base compute modules, system expansion compute modules, and MPX modules. This section includes the following topics:

• “Determining Space Requirements” on page 26

• “Checking the Slide Rail Hardware” on page 26

• “Preparing the Slide Rail Assemblies” on page 27

• “Preparing the Module” on page 30

• “Determining Where to Attach the Slide Rail in the Rack” on page 31

• “Attaching the Slide Rail to the Rack” on page 32

• “Installing Clip Nuts in Rack Rails” on page 35

• “Installing the Module in the Rack” on page 36

• “Adjusting the Position of the Rackmounted Module” on page 38

007-4566-001 25

1: Installation and Operation

Determining Space Requirements

Table 1-2 speciﬁes the space requirements when rackmounting either a base compute module, a system expansion compute module, or an MPX module in a 19-inch rack.

Table 1-2 Module Space Requirements

Height 3.44 inches (8.74 cm)

Width 17.06 inches (43.33 cm)

Depth 27 inches (68.58 cm) (with bezel)

Weight 37.80 lb (17.18 kg) minimum

Required front clearance for module 8.25 in. (20.96 cm)

Required rear clearance for module 10 in. (25.40 cm)

Required side clearance for module 6 in. (15.24 cm) (right side)

conﬁguration; 44.50 lb (20.23 kg) maximum conﬁguration

a

No clearance requirement for left side.

Required front clearance for rack 36 in. (91 cm)

Required rear clearance for rack 36 in. (91 cm)

a. Weight will vary depending on whether the system has one or two power supplies, on the amount

of DIMMs installed, and on whether you have one or two disk drives in your system.

Checking the Slide Rail Hardware

Table 1-3 lists the hardware that you will use to mount the module in a 19-inch rack.

Table 1-3 Rackmounting Hardware

Hardware Type Qty Usage

Slide rail assembly (includes chassis rail)

2-in. rear mounting bracket 2 Mounts the slide rails to the rear rack rails.

10-24 x 1/4-in. Phillips screw 10 Secures the chassis rails to the module.

26 007-4566-001

2 Allows the module to slide in and out of rack.

(The left and right slides are identical.)

(The left and right brackets are identical.)

Table 1-3 Rackmounting Hardware (continued)

Hardware Type Qty Usage

Installing the Server System in a Rack

10-32 x 1/2-in. Phillips screw Shoulder washer Barnut

10-32 x 1/2-in. Phillips screw Barnut

10-32 clip nut 2 Provides a threaded hole for fastening the module front

10-32 x 1/2-in. Phillips screw 2 Fastens the module front panel to the clip nut.

Preparing the Slide Rail Assemblies

The slide rail assembly consists of a chassis rail and a slide rail. You need to remove the chassis rail from the slide rail so that you can install a mounting bracket to the slide rail and attach the chassis rail to the module (see “Preparing the Module” on page 30). To remove the chassis rail from the slide rail, follow these steps:

1. Remove the two slide rail assemblies and the rear mounting brackets from the

shipping container.

2. Extend each slide rail assembly until the safety latch snaps into place.

3. Press the safety latch and remove the chassis rail from the slide rail, as shown in

Figure 1-12.

8

Secures the slide rails to the rack rails. 8 4

42Secures the slide rails to their mounting brackets.

panel to the rack rails.

007-4566-001 27

1: Installation and Operation

Safety latch

Slide rail

Safety latch

Chassis rail

Figure 1-12 Removing the Chassis Rail from the Slide Rail

4. Place one of the mounting brackets on the back of the slide rail, as shown in Figure 1-13. Adjust the position of the mounting bracket on the slide rail according to the depth of the rack.

5. Place a barnut next to the mounting bracket. Secure the mounting bracket to the slide rail by inserting two 10-32 x 1/2-in. screws through the assembly and into the barnut, as shown in Figure 1-13.

6. Repeat steps 4 and 5 to attach a mounting bracket to the other slide rail.

28 007-4566-001

Barnut

Installing the Server System in a Rack

Rear mounting bracket

Slide rail

Figure 1-13 Attaching the Rear Mounting Bracket to the Slide Rail

007-4566-001 29

1: Installation and Operation

Preparing the Module

!

To attach the chassis rails to the module, follow these steps:

1. Place the module on a ﬂat, stable surface.

2. Using four 10-24 x 1/4-in. screws, attach one of the chassis rails to the right side of the module chassis. Ensure that the rail is installed in the correct direction (see Figure 1-14).

Caution: Use only the 1/4-in. (0.64 cm) length screws. Longer screws damage internal components in the module.

3. Using ﬁve 10-24 x 1/4-in. screws, attach the second rail to the left side of the module chassis. Again, ensure that the rail is installed in the correct direction.

Figure 1-14 Attaching Chassis Rails to the Module Chassis

30 007-4566-001

Determining Where to Attach the Slide Rail in the Rack

The module requires two units (2U) of space within the rack (one unit is equivalent to

1.75 inches [44.5 cm]). To determine where you should install the slide rails in the rack, you must count mounting holes. Each U contains three mounting holes; therefore, in the 2U of space that the module occupies, there are six mounting holes. The bottom hole of the 2U space is hole 1. The top mounting hole in the 2U space is hole 6. See Figure 1-15.

Note: A module in the rack is identiﬁed by the lowest U number that it occupies. For example, in Figure 1-15 the module resides in U5 (the ﬁfth unit within the rack).

Installing the Server System in a Rack

8

7

6

8

7

6

5th hole

5

2nd hole 6th hole

1st hole

4

3

2

1

4

3

2

1

Figure 1-15 Mounting Hole Pattern of Rack Vertical Rails

To determine how many mounting holes you must count, use the following formula: 3 x (the lowest U number that the module will occupy) - 2. For example, when you want to install the module in locations U9 and U10, count 25 mounting holes (3 x 9 - 2) starting from the bottom of the rack. The 25th hole is the ﬁrst mounting hole of U9.

2U

007-4566-001 31

1: Installation and Operation

Attaching the Slide Rail to the Rack

To attach the slide rail to the rack, follow these steps:

Tip: The slide rails must be level in the rack. To ensure that you install the slide rails correctly, carefully count the mounting holes on all of the rack rails (two front rails and two rear rails).

1. Locate eight 10-32 x 1/2-in. Phillips screws, eight shoulder washers, and four barnuts.

2. Place one of the barnuts inside the rack and align it with the second and third holes of the selected 2U of space (see Figure 1-16).

Note: The holes in the barnuts are not centered. The barnuts need to be placed in such a way that the holes are closest to the inside edge of the rack rails. See Figure 1-16.

3. Insert two screws with shoulder washers through the rack rail to hold the barnut in place. The screws should not be tightened at this point.

4. Repeat steps 2 and 3 to install the remaining three barnuts on the other three rack rails (front and rear of rack).

32 007-4566-001

Installing the Server System in a Rack

6

Barnut

Inside edge

5

4

3

2

1

6

5

4

2U of space

3

2

1

Figure 1-16 Placing the Barnuts on the Rack Rails

007-4566-001 33

1: Installation and Operation

5. Insert the front and rear brackets of one of the slide rails between the rack rails and the barnuts, as shown in Figure 1-17.

6. Tighten the screws on the front- and rear-end of the rails. Do not tighten ﬁrmly at this point, because all screws will be ﬁrmly tightened once the module is installed in the rack.

7. Repeat steps 5 and 6 to attach the second slide rail to the other side of the rack.

7

6

5

7

6

5

Tighten

4

3

2

1

Barnut

4

3

2

1

screws

Rack rail

Figure 1-17 Attaching the Slide Rail to the Rack

34 007-4566-001

Slide rail assembly

Installing Clip Nuts in Rack Rails

5

6

Clip nuts secure the modules to the rack. To install the clip nuts, slide the clip nuts over the ﬁfth hole of the selected 2U of space on each of the front rails. See Figure 1-18 for details.

Installing the Server System in a Rack

8

5th hole

7

6

5

4

3

2

1

Figure 1-18 Installing Clip Nuts in Rack Rails

2U space

007-4566-001 35

1: Installation and Operation

Installing the Module in the Rack

To install the module in the rack, follow these steps:

Note: Step 2 requires two people.

1. Fully extend the left and right slide rails from the rack until they lock into place.

2. With one person holding each side of the module, align the chassis rails of the module with the slide rails of the rack.

3. Slide the chassis rails into the slide rails until the chassis rails are stopped by the safety latches.

4. Press the safety latches on both sides of the module to fully seat the chassis rails into the slide rails (see Figure 1-19).

5. Firmly tighten all screws (the eight screws that secure the slide rails to the rack rails).

36 007-4566-001

Slide rail extended, locked in place

Safety latch

Installing the Server System in a Rack

6

5

4

3

2

1

6

5

4

3

2

1

Safety latch

Figure 1-19 Pressing the Safety Latches

007-4566-001 37

Push latches

1: Installation and Operation

6. Secure the module to the rack by inserting a 10-32 x 1/2-in. Phillips screw in the top hole of each chassis ear (see Figure 1-20).

1

0

9

8

7

6

5

4

3

2

1

10-32 x 1/2-in. screws

Figure 1-20 Securing the Module to the Rack

Adjusting the Position of the Rackmounted Module

Once the module is installed in the rack, you can adjust the position of the module in the rack (upward and sideways). To adjust the position of the module, loosen the front mounting screws, adjust the module to the desired position, and then tighten the mounting screws.

Caution: Do not lift the module by its bezel; it is not designed to handle the weight of

!

38 007-4566-001

the module. Instead, use the chassis ears to move the module (see Figure 1-20).

Removing a Module on Slide Rails from a Rack

To remove the module that is on slide rails on a rack, follow these steps:

1. Power off the module. For instructions on how to power off the module, see

“Powering the Server System On and Off” on page 53.

2. Disconnect all of the cables at the rear of the module.

Warning: Components may be hot. To avoid injury, allow the components to cool

for approximately ﬁve minutes before you proceed with these instructions.

3. Remove the two screws that secure the module to the front rails of the rack.

4. Carefully pull the module from the rack until it is stopped by the safety latches.

5. With one person holding each side, release the safety latches on both sides of the

module and pull the module out of the slide rail (see Figure 1-21).

6. Place the module on a ﬂat, stable surface.

Installing the Server System in a Rack

007-4566-001 39

1: Installation and Operation

6

5

4

3

2

1

6

5

4

3

2

1

Safety latch

Push latches

Slide extended, locked in place

Figure 1-21 Releasing the Safety Latches

40 007-4566-001

Safety latch

Installing the Server System in a Rack

7. To slide the slide rails back into the rack, push down on the slide latches as shown in

Figure 1-22.

Note: Before you can reinstall a moduleinto the rack, fully extend the slide railsfrom the rack until they lock into place.

Slide latch

Figure 1-22 Releasing the Slide Latches

007-4566-001 41

1: Installation and Operation

Rackmounting Modules with Shelf Rails

This section describes how to rackmount a module using shelf rails. The NUMAlink module, the 4U PCI expansion module, and the TP900 storage module are rackmounted with shelf rails (also known as ﬁxed rails).

The module ships with shelf rails that must be mounted in the rack. The shelf rails support the module within the rack.

To attach the shelf rails to the rack, follow these steps:

1. Locate the slot location in the rack in which you will install the module.

2. In the slot location from step 1, position the left shelf rail at a 90-degree angle to the front and rear rack rails (see Figure 1-23).

3. Insert the top-front bracket tab into one of the narrow slots in the front rack rail.

4. Insert the top-rear bracket tab into the narrow slot in the rear rack rail.

Note: Verify that the tabs are the same height to ensure that the module is level in the rack.

5. Lower the bottom of the shelf rail until its two lower tabs engage with the wide slots in the front and rear rack rails.

6. Install the two push-in fasteners that secure the shelf rail to the front and rear rack rails.

7. Place the EMI gasket bracket on the rear rack rail. Then install the two screws that secure the bracket and the shelf to the rear rack rail.

8. Repeat steps 2 through 7 for the right shelf rail.

42 007-4566-001

Installing the Server System in a Rack

Front/rear bracket tabs

Rail

Shelf rail

Torx screws

EMI gasket bracket

Shelf rail

Rear view

Figure 1-23 Installing the Shelf Rails in the Rack

9. Set the rear edge of the module on the shelf rails. Then slide the module into the

rack until the module ears are snug against the rack rails. See Figure 1-24.

10. Fasten the module to the front rails of the rack with the screws and clip nuts

provided. See Figure 1-24.

11. Fasten the module to the rear rails of the rack with the screws and clip nuts

provided.

Push-in fasteners

007-4566-001 43

1: Installation and Operation

1

0

9

8

7

6

5

4

3

2

1

10-32 x 1/2-in. screws

Figure 1-24 Securing the Module to the Rack

Removing a Module on Shelf Rails from a Rack

To remove the module that is on shelf rails on a rack, follow these steps:

1. Power off the module. For instructions on how to power off the module, see “Powering the Server System On and Off” on page 53.

2. Disconnect all of the cables at the rear of the module.

Warning: Components may be hot. To avoid injury, allow the components to cool

for approximately ﬁve minutes before you proceed with these instructions.

3. Remove the two screws and clip nuts that secure the module to the front rails of the rack.

4. Remove the two screws and clip nuts that secure the module to the rear rails of the rack.

44 007-4566-001

5. Carefully and slowly slide out the module by holding and pulling on one of the

module ears with one hand, while placing the other hand securely under the module so that it supports the weight of the module as it clears the rack.

6. Place the module on a ﬂat, stable surface.

Cabling the System Modules to Each Other

Some conﬁgurations of an Origin 350 server system will consist of either two or more modules. This section describes how to cable together these multiple modules.

Note: If your server system is made up of a single module, you can skip this section and proceed to “Cabling the Server System to a Power Source” on page 48 for instructions to connect your system to power.

Cabling two modules to each other that consist of a base compute module and a module to expand the server system’s functionality, such as a system expansion compute module, entails connecting a cable from base compute module’s NUMAlink connector to the NUMAlink connector of the added module.

Cabling the System Modules to Each Other

Figure 1-25 shows the cabling of a base compute module to a system expansion compute module, which can add up to 8 GB of local memory, four PCI/PCI-X slots, and an IO9 card to a server system. (The IO9 card adds real time interrupt input [RTI] and output [RTO] connectors, an Ethernet port, and a SCSI port to the system.)

007-4566-001 45

1: Installation and Operation

System expansion compute module

XIO NUMAlink

Base compute module

XIO NUMAlink

Figure 1-25 Cabling a Base Compute Module to a System Expansion Compute Module

Figure 1-26 shows the cabling of the following server system modules (and other items) to each other in a 39U rack:

• SGIconsole (system console) to monitor and manage your system. (The LAN2 port connects to the L2 controller’s Ethernet port with an RJ-45 twisted-pair cable.)

• L2 controller. (Using an RJ-45 twisted-pair cable, the L2 controller’s L1 port connects to the NUMAlink module’s L1 port.)

• Two 4U PCI expansion modules. (Using a NUMAlink 3 cable, the NUMAlink port of the top PCI expansion module connects to the NUMAlink module’s 2-B port. Using another NUMAlink 3 cable, the NUMAlink port of the lower PCI expansion module connects to the NUMAlink module’s 3-C port.

• NUMAlink module. (Using a NUMAlink 3 cable, the NUMAlink module’s G-7 port connects to the system expansion compute module’s NUMAlink port. Using another NUMAlink 3 cable, the NUMAlink module’s F-6 port connects to the base compute module’s NUMAlink port connector.

• System expansion compute module.

• Base compute module. (Using a SCSI cable, the SCSI port on the base compute module connects to the TP900 module’s SCSI port.)

• TP900 storage module.

46 007-4566-001

Cabling the System Modules to Each Other

SGIconsole

LAN2 port

NUMAlink port

L2 controller

PWR ICMB

Console

Modem Ethernet LCD Display L1 Ports

L2 System Controller

13 2

4

Fault

PCI expansion module

NUMAlink module

48 VDC

12 VDC

L1 PORT

CB 1

PWR

G

F E

D

8

7

1

6

2

5

3

4

H A B C

L1 port

NUMAlink port

System expansion compute module

XIO NUMAlink

Base compute module

XIO NUMAlink

TP900

OUTPUT

GOOD

FAULT

CHANNEL 2 CHANNEL 1

SCSI ports

Figure 1-26 Cabling Multiple Modules to Each Other

007-4566-001 47

1: Installation and Operation

Cabling the Server System to a Power Source

This section describes how to make the following connections to a power source:

• “Connecting a Single-module or Dual-module Server System to a Power Source” on page 48

• “Connecting a Multiple-module Server System to a Power Source” on page 49

Connecting a Single-module or Dual-module Server System to a Power Source

If you are operating your server system on a table top, connect the base compute module to a wall power receptacle. If your module resides in a rack, connect the module to a power distribution unit (PDU) or a power strip. See Figure 1-27 for the location of the module’s power connector.

PCI 4

PCI 3

CONSOLE

L1 PORT

1

2 3 4

XIO NUMALINK

PCI 2

PCI 1

Power connector

Figure 1-27 Power Connector on the Rear of the Base Compute Module

Figure 1-28 shows the connecting of a dual-module server system (an MPX module and a base compute module), located on either a tabletop or desktop, to a power source.

48 007-4566-001

Cabling the Server System to a Power Source

MPX module

Base compute module

Figure 1-28 Connecting a Dual-module System to a Power Source

Connecting a Multiple-module Server System to a Power Source

This section describes how to cable the multiple modules that make up a multiple-module server system to a power source. Figure 1-29 shows a sample of a multiple-module server system that includes the following modules (and other items):

• L2 controller

• Two PCI expansion modules

• NUMAlink module

• System expansion compute module

• Base compute module

• TP900 storage module

007-4566-001 49

1: Installation and Operation

• Power bay

• Power distribution unit (PDU), Power adapter, and USB hub

Power source

USB hub

Power distribution unit (PDU)

Power adapter

L2 controller

PCI expansion module

NUMAlink module

System expansion compute module

Base compute module

C

H A

N N

E L

1

C

H A

N N

E L 2

I.D

.R

A

N

G

E

O U T

P U

G

T

O

O D

F A

U L T

C H A

N N E

L 1

C

H A

N N

E L 2

I.D

.R

A

N

G

E

O U T

P

U

G

T

O

D

F A

U L

T

TP900 storage module

Power bay

Figure 1-29 Connecting Multiple Modules to a Power Source

50 007-4566-001

Components within rack

Connecting the System Console

This section explains how to attach and establish a connection between a system console and an Origin 350 server system. The system console enables you to perform the following activities:

• Start an IRIX console session to set up networking and other conﬁguration

parameters.

• Monitor your system by reading the status and error message information that the

L1 controller generates.

• Enter L1 controller commands to monitor or change particular system functions.

You can, for example, monitor the speed of fans for a particular module. See the SGI L1 and L2 Controller Software User’s Guide (007-3938-00x) for descriptions of the L1 controller commands that you can use.

• Power on or power off your server system.

The system console can be a server that runs the SGIconsole remote multiserver management system or a personal computer (PC). SGIconsole provides a central server control environment that has the following features:

Connecting the System Console

• Support for SGI clusters, partitioned systems, and large single-system-image

servers.

• Expandable to support additional servers.

• Rackmountable, space-efﬁcient platform.

• Software applications and tools for installation and conﬁguration, for console

functionality, and for monitoring and managing system-level performance.

• Web-based user interface.

For instructions on how to attach a system console that runs SGIconsole software to your server system, see the SGIconsole Hardware Connectivity Guide (007-4340-00x).

To attach a PC to your server system, connect a null modem serial cable between the PC and the CONSOLE port of the base compute module of your server system (see Figure 1-30). To establish a connection between your server system and the system console (PC), follow these steps:

007-4566-001 51

1: Installation and Operation

1. Ensure that the L1 controller of the base compute module is powered on. When the base compute module is connected to a power source, the L1 controller should be powered on.

Note: When powered on, the L1 controller displays L1 running. If it does not display L1 running, check the connection between the base compute module and the power source. In addition, ensure that the circuit breaker of the power source is on.

2. Power on the system console.

3. Ensure that the system console has the following network settings:

• Baud 38400

• No parity

• 8 data bits

• 1 stop bit

• Hardware ﬂow control on (RTS/CTS)

4. Type cu -l ttyd2 for an IRIX-based console, or cu -l ttys0 -S38400 for a Linux-based console, and then press Enter to display the L1 prompt. If the console uses another operating system, start a terminal emulation program as instructed in the console’s user documentation.

PCI 4

PCI 3

CONSOLE port

CONSOLE

L1 PORT

1

Figure 1-30 Location of the Console Port

52 007-4566-001

2 3 4

XIO NUMALINK

PCI 2

PCI 1

Operating the Server System

This section describes how to operate an Origin 350 server system, as follows:

• “Powering the Server System On and Off” on page 53

• “Connecting Two Server Systems” on page 60

• “Operating the Server System Modules via Front Panel Controls” on page 61

• “Operating the L1 Controller” on page 62

Powering the Server System On and Off

This section describes how to power on and power off your server system (or an individual module) at a system console, or manually, as follows:

• “Preparing to Power On” on page 53

• “Powering On at the System Console” on page 54

• “Powering On Manually” on page 56

Operating the Server System

• “Powering Off at the System Console” on page 58

• “Powering Off Manually” on page 59

Preparing to Power On

To prepare to power on your system, follow these steps:

1. Conﬁrm that all the modules and other system items are plugged in securely. If

necessary, see “Cabling the System Modules to Each Other” on page 45 for information.

2. Conﬁrm that all the server system power cables are plugged in securely to a power

source. If necessary, see “Cabling the Server System to a Power Source” on page 48 for information.

007-4566-001 53

1: Installation and Operation

3. Ensure that the power switch on the rear panel of each DC-powered NUMAlink and PCI expansion module that you want to power on is set to the ON (I) position. This switch enables the L1 controllers of the NUMAlink module and PCI expansion modules to power on after you turn on the circuit breaker of the PDU.

Note: The Origin 350 base and AC-powered NUMAlink modules do not have a power switch; when the PDU circuit breaker is on, their L1 controllers are on.

Powering On at the System Console

To power on and boot your system using the system console, follow these steps:

Note: You must manually power on the TP900 storage module by placing the power switch(es) in the ON (I) position. You must turn this module on before rebooting the system.

1. If not yet done so, connect a system console to the server system as described in “Connecting the System Console” on page 51.

2. If the monitors and other peripherals are equipped with voltage select switches, verify that they are set for the appropriate AC voltage and plug them in. Note that they are normally plugged into sources outside the rack system.

3. Turn on the circuit breaker switch of the PDU as shown in Figure 1-31.

54 007-4566-001

Operating the Server System

Power distribution unit (PDU)

Wall power source

Circuit breaker switch

Figure 1-31 PDU Circuit Breaker

4. Verify that all of the L1 controllers display “L1 running.” If any L1 controllers are

not running, contact your SGI system support engineer (SSE).

5. At the system console, access the L2 controller by entering the following command:

$> /stand/sysco/bin/12term

6. From the L2 prompt, display the system conﬁguration by entering the following

command:

L2> cfg

This command lists the modules that the L2 controller detects in the system and their system controller addresses. If a module that you want to power on does not appear in the list, it will not power on. Ensure that the module’s L1 controller is running and that the module is cabled properly.

7. From the L2 prompt (L2>), power on an individual module by entering the

following command. (If you want to power on the entire system, proceed to Step 8.)

L2> r <rack#> s <slot#> pwr u

For example, to power on an Origin 350 base compute module in rack 1, slot 18, enter the following command:

L2> r 1 s 18 pwr u

The slot number is the unit number of the module within the rack.

007-4566-001 55

1: Installation and Operation

If you want to power on several selected modules of a rack at the same time, you must enter the rack number followed by the slot numbers of the modules that you want to power on. For example, to power on the modules in slots 18, 20, and 22, enter the following command:

L2> r 1 s 18,20,22 pwr u

8. If you want to power on the entire system, enter the following command:

L2> pwr u

(The default setting for the pwr u command is all racks and slots.)

9. When the L2 prompt appears, you will not see the output that is produced during the power-on procedure unless you redirect the keyboard input from the L2 controller to the normal console by typing control d.

L2> ctrl d

10. When the power-on procedure completes, the following System Maintenance Menu appears on the system console.

System Maintenance Menu

1) Start System

2) Install System Software

3) Run Diagnostics

4) Recover System

5) Enter Command Monitor Option?

11. Select option 1 “Start System” to boot the IRIX operating system.

Powering On Manually

To power on your system or an individual module manually, follow these steps:

1. If the monitors and other peripherals are equipped with voltage select switches, verify that they are set for the appropriate AC voltage and plug them in. Note that they are normally plugged into power sources outside the rack system.

2. Turn on the circuit breaker switch of the PDU as shown in Figure 1-31 on page 55.

56 007-4566-001

Operating the Server System

3. Press the power buttons or power switches on each of the modules that you want to

power on in the following order:

a. For the PCI expansion module or a NUMAlink module, press the power switch

on the module’s rear panel to the ON (I) position to start the module’s L1 controller. Then, push in the On/Off switch with LED in the front of the module to power on the rest of the module’s internal components.

Note: The Origin 350 base and AC-powered NUMAlink modules do not have a power switch. To power on their L1 controllers, plug the modules to the PDU.

b. For the TP900 storage module, press the power button on its rear panel to ON

(I).

c. For the MPX module, the base compute module, and the system expansion

compute module, press the power button with the LED on the front panel of each module (see Figure 1-32).

Power button with LED

Figure 1-32 Location of the Power Button

007-4566-001 57

1: Installation and Operation

Powering Off at the System Console

To power off your system using the system console, follow these steps:

Caution: If you power off the system before you halt the operating system, you can lose

!

data.

1. Shut down the IRIX operating system by entering the following command:

# init 0

2. To access the L2 prompt, direct the keyboard input to the L2 controller by entering Ctrl+T.

$> ctrl t

3. From the L2 prompt (L2>), power off an individual module by entering the following command. (If you want to power off the entire system, proceed to Step 4.)

L2> r <rack#> s <slot#> pwr d

For example, to power off an Origin 350 base compute module in rack 1, slot 18, enter the following command:

L2> r 1 s 18 pwr d

The slot number is the unit number of the module within the rack.

If you want to power off several selected modules from the rack at the same time, enter the rack number followed by the slot numbers of the modules that you want to power off. For example, to power off the modules in slots 18, 20, and 22, enter the following command:

L2> r 1 s 18,20,22 pwr d

4. If you want to power off all of the modules within the rack, enter the following command:

L2> pwr d

(The default setting for the pwr d command is all racks and slots.)

“Powered Down” appears on the L1 display when the module is powered off. The L1 controller is still powered on.

58 007-4566-001

Powering Off Manually

!

Operating the Server System

5. To power down an L1 controller of a DC-powered NUMAlink or PCI expansion

module, set the power switch to the Off (O) position. The power switch of the NUMAlink or PCI expansion module is located in the upper-left corner of the rear of the module.

Note: The Origin 350 base and AC-powered NUMAlink modules do not have a power switch. To power down their L1 controllers, unplug the modules from the PDU.

To power off your system manually, follow these steps:

Caution: If you power off the system before you halt the operating system, you can lose data.

1. Shut down the IRIX operating system by entering the following command:

# init 0

2. Press the power buttons or power switches on each of the modules that you want to

power off. You may power off the modules in any order:

• For the PCI expansion module or DC NUMAlink module, press the power

switch on the module’s rear panel to the OFF (O) position to turn off the module’s L1 controller. Then, push on the On/Off switch with LED in the front of the module to power off the rest of the module’s internal components. The green LED on the On/Off switch turns off when the module is powered off.

Note: The Origin 350 base and AC-powered NUMAlink modules do not have a power switch. To power off their L1 controllers, unplug the modules from the PDU.

• To power off the TP900 storage module, press the power button on its rear panel

to the OFF (O) position.

• To power off the base compute module, the system expansion compute module, and the MPX module, press the power button with the LED on the front panel of each module (see Figure 1-32 on page 57).

007-4566-001 59

1: Installation and Operation

Connecting Two Server Systems

Before connecting two Origin 350 server systems to each other, you must assign unique system ID numbers to the servers, as follows:

1. Designate one of the servers as the master server and the other server as the slave.

2. Connect a console to the slave server (see “Connecting the System Console” on page 51), and power on the server (see “Powering the Server System On and Off” on page 53).

3. Use the brick slot <slotnumber> L1 command to set the slave system ID number to a higher number than the master system ID number. For example, if the master server’s L1 prompt indicates that its ID number is 01 (001c01-L1>), then the slave system ID number should be 02 or higher (001c02-L1>).

001c01-L1>brick slot 02 brick slot set to 02.

See the SGI L1 and L2 Controller Software User’s Guide (007-3938-00x) for more information on L1 commands.

To connect two Origin 350 server systems to each other with a NUMAlink 3 cable, follow these steps:

1. Power off both servers (see “Powering the Server System On and Off” on page 53).

2. Connect the NUMAlink 3 cable to the NUMAlink connectors on both servers.

3. Connect a system console to the master server, as described in “Connecting the System Console” on page 51.

4. Power on both servers as described in “Powering the Server System On and Off” on page 53.

The console outputshould indicate that the processors and memory on both servers have been discovered. If the slave server has not been discovered, use the reset L1 command to perform a reset of the system.

Note: For server-to-server communication to work correctly, the network mode on the server must be set to 422 (when connecting a PC [system console] to a serial port). Use the network L1 command to set the network mode. (See the SGI L1 and L2 Controller Software User’s Guide (007-3938-00x) for more information on L1 commands.)

60 007-4566-001

Operating the Server System Modules via Front Panel Controls

The front panel of the base compute module, the system expansion compute module, and the MPX module provides the following control features, as shown in Figure 1-33:

Note: If your server system includes other modules such as the TP900 and the PCI expansion module, see the operating instructions provided for those modules.

• Status LEDs. The front panel has the following LEDs:

• Power button LED. This LED illuminates green when the internal components are on.

• Service-required LED. This LED illuminates yellow to indicate that an item is not functioning properly (for example, a fan is off), but the server is still operating.

• Failure LED. This LED illuminates red to indicate that a failure has occurred and the server is down.

• Power button. Press this button to power on the server. Alternatively, you can power on the server system at a system console.

Operating the Server System

• Reset button. Press this button to reset the internal processors and ASICs. The reset will cause a memory loss. (To perform a reset without losing memory, see the NMI button information that follows.)

• NMI button. Press the NMI (non-maskable interrupt) button to reset the internal processors and ASICs without losing memory. Register data and memory are stored in a /var/adm/crash ﬁle.

007-4566-001 61

1: Installation and Operation

L1 controller display

Figure 1-33 Front Panel Functions

Operating the L1 Controller

The L1 controller operates in one of the two following modes:

• L1 mode. The L1 prompt (001c01-L1>) is visible and all input is directed to the L1

command processor.

• Console mode from L1. Output from the system is visible and all input is directed to the system.

The L1 controller is ready to accept commands when you see a prompt of the following form:

001c01-L1>

See the SGI L1 and L2 Controller Software User’s Guide (007-3938-00x) for a detailed list of L1 commands.

Failure LED

Service-required LED

NMI

Reset

Power button with LED

62 007-4566-001

Operating the Server System

To enter console mode, press Ctrl+D at the L1 prompt, as follows:

001c01-L1> Ctrl+D entering console mode 001c01 console, <CTRL-T> to escape to L1 . <system output appears here> .

To return to L1 mode, press Ctrl+T, as follows:

Ctrl+T

escaping to L1 system controller 001c01-L1>

At this point, you can enter any L1 command. When the command completes execution, the L1 returns to console mode:

re-entering console mode 001c01 console, <CTRL-T> to escape to L1

To permanently engage the L1 mode, press Ctrl+T and then enter the l1 command, as follows:

Ctrl+T

escaping to L1 system controller 001c01-L1> l1 L1 command processor engaged, <CTRL-D> for console mode. 001c01-L1>

007-4566-001 63

Chapter 2

2. System Overview

This chapter provides an overview of the physical and architectural aspects of your SGI Origin 350 server system. System conﬁgurations and components are described and illustrated. This chapter includes the following sections:

• “Physical Features” on page 66

• “Functional Architecture” on page 68

• “System Conﬁgurations” on page 75

• “System Components” on page 80

007-4566-001 65

2: System Overview

Physical Features

The Origin 350 server system is the latest advancement in the SGI NUMAﬂex approach to modular computing. It is designed to deliver maximum sustained performance in a compact system footprint. Independent scalingof computationalpower,I/O bandwidth, and in-rack storage lets you conﬁgure a system to meet your unique computational needs. The small footprint and highly modular design of the Origin 350 server system makes it ideal for computational throughput, media streaming, or complex data management.

The Origin 350 server system can be expanded from a standalone 2 processor server system to a high-performance server system with 32 processors, 64 GB of memory, and 62 PCI/PCI-X slots. For most conﬁgurations, the Origin 350 server system is housed in one 17U rack or one 39U rack as shown in Figure 2-1; however, for small system conﬁgurations, the Origin 350 server system can be placed on a table top.

Systems that are housed in 17U racks have a maximum weight of approximately 488 lb (221 kg). The maximum weight of systems that are housed in 39U racks is approximately 1,100 lb (499 kg). The racks have casters that enable you to remove the system from the shipping container and roll it to its placement at your site.

See Chapter 1, “Installation and Operation,” for more information about installing your system. Your Site Planning Guide for SGI Origin 350 and SGI Onyx 350 Rack Systems (007-4649-00x) also provides additional physical planning information.

For more information about the technical speciﬁcations of your system, see Appendix A, “Technical Speciﬁcations,” in this manual.

66 007-4566-001

17U rack

Physical Features

39U rack

Figure 2-1 Example of SGI Origin 350 Server Systems

007-4566-001 67

2: System Overview

Functional Architecture

The Origin 350 server system is based on the SGI NUMAﬂex architecture, which is the third-generation shared-memory system architecture that is the basis of SGI HPCservers and supercomputers. The NUMAﬂex architecture is speciﬁcally engineered to provide technical professionals with superior performance and scalability in a design that is easy to deploy, program, and manage. It has the following features:

Shared access of processors, memory, and I/O. The Bedrock ASICs and the NUMAlink interconnect functions of the NUMAﬂex architecture enable applications to share processors, memory, and I/O devices.

• Each Bedrock ASIC in the system is an 8-input by 6-output crossbar that acts as the memory controller between processors and memory in the system for both local and remote memory accesses.

• The NUMAlink interconnect channels information between all the modules in the system to create a single contiguous memory in the system of up to 64 GB and enables every processor in a system direct access to every I/O slot in the system.

Together, the Bedrock ASICs and the NUMAlink interconnect enable efﬁcient access to processors, local and remote memory, and I/O devices without the bottlenecks associated with switches, backplanes, and other commodity interconnect technologies.

System scalability. The NUMAﬂex architecture incorporates a low-latency, high-bandwidth interconnect that is designed to maintain performance as you scale system computing, I/O, and storage functions. For example, the computing dimension in somesystem conﬁgurations can rangefrom 4 to 32 processors in a single system image (SSI). To increase the number of processors beyond 32, you can cluster Origin 350 server systems together. The maximum number of processors in a clustered conﬁguration is

128.

Efﬁcient resource management. The NUMAﬂex architecture is designed to run complex models and, because the entire memory space is shared, large models can ﬁt into memory with no programming restrictions. Rather than waiting for all of the processors to complete their assigned tasks, the system dynamically reallocates memory, resulting in faster time to solution.

68 007-4566-001

Functional Architecture

The Origin 350 server system can be conﬁgured with or without a NUMAlink module. When the system does not have a NUMAlink module, the system can contain from 2 to 8 processors. When the system does have a NUMAlink module, the system can contain from 4 to 32 processors.

Note: For more information about these conﬁgurations, see “System Conﬁgurations” on page 75.

The processors are housed in compute modules (see Figure 2-2) that can be conﬁgured as one the following devices:

• Base compute module with base I/O functionality. All Origin 350 server systems

contain one base compute module that contains the following components:

– Two or four 64-bit MIPS RISC processors.

– 4 MB of secondary (L2) cache per processor.

– 1 GB to 8 GB of local memory.

– Four PCI/PCI-X slots.

Note: The lowermost PCI/PCI-X slot comes with a factory-installed IO9 PCI 66 MHz card. Consequently, the slot (third slot down), which is on the same bus as the slot in which the IO9 PCI card is installed, can only support a PCI card that runs at a speed of 66 MHz or slower. Therefore, the two uppermost slots can support PCI/PCI-X cards, while the third one down can only support a PCI card.

– One IO9 PCI card that comes factory-installed in the lowermost PCI/PCI-X slot.

The IO9 card has a real time interrupt input port and output port, an Ethernet port, and a SCSI connector. The IO9 card is also needed to support the module’s two SCSI disk drives, the DVD-ROM, a serial port, and a daughtercard with three more serial ports and two PS/2 connectors for a keyboard and a mouse.

– One Bedrock ASIC (the crossbar between the processors, local memory, the

network interface, and the I/O interface).

• Expansion compute module (no base I/O functionality). For Origin 350 server

systems that contain more than one compute module, the additional modules are expansion compute modules. The only difference between the base compute module and the expansion compute module is that the expansion compute module

007-4566-001 69

2: System Overview

may or may not contain an IO9 PCI card and the devices and connector ports the IO9 card supports.

Note: Each system requires one IO9 PCI card; this required card resides in the base compute module. The system can contain additional IO9 cards that reside in the expansion compute modules; these cards are required only when you want additional SCSI hard disk drives, DVD-ROMs, and/or the connectors the IO9 card supports.

For more information about the compute module (base compute module and system expansion compute module), see “Compute Module” on page 83.

Base compute module Expansion compute module

Ethernet port

SCSI port

Serial ports

RTI port

RTO port

L2

PCI bus 2 slot 2 PCI bus 2 slot 1 PCI bus 1 slot 2 PCI bus 1 slot 1

IO9

CPU

1.6 GB/s

SCSI port

L1 control

Memory/ Directory

3.2 GB/s

Bedrock

2.4 GB/s 2.4 GB/s

PIC

DVD-ROM

Two disks

USB port Console port

NUMAlink 3 channel

3.2 GB/s full-duplex

(1.6 GB/s each direction)

Xtown2 channel

2.4 GB/s full-duplex

(1.2 GB/s each direction)

Memory/ Directory

3.2 GB/s

1.6 GB/s

Bedrock

1.6 GB/s

PIC

L1 control

Figure 2-2 Base Compute Module Connected to an Expansion Compute Module

CPU

PCI bus 2 slot 2 PCI bus 2 slot 1 PCI bus 1 slot 2 PCI bus 1 slot 1

USB port Console port

L2

70 007-4566-001

Functional Architecture

When the system consists of a base compute module only, the maximum number of processors 4. To increase the number of processors in the system, the base compute module can connect to one or more expansion compute modules. When a system has more than two compute modules, a NUMAlink module is required. The NUMAlink module is a 2U AC-powered device that can connect up to eight compute modules. See Figure 2-3.

4-processor

expansion compute module

4-processor

expansion compute module

Port 6

Port 5

Port 4

4-processor

base compute module

NUMAlink module

GH

F

Router

ASIC

E

D

C

4-processor

expansion compute module

4-processor

expansion compute module

Port 8Port 7

A

B

expansion compute module

Port 1

Port 2

Port 3

4-processor

Figure 2-3 Compute Modules Connected via a NUMAlink Module

007-4566-001 71

4-processor

expansion compute module

4-processor

expansion compute module

NUMAlink 3 channels

3.2 GB/s full-duplex

(1.6 GB/s each direction)

2: System Overview

To increase the amount of memory in the system, the compute modules can connect to a memory and PCI expansion (MPX) module as shown in Figure 2-4.The MPX module is a 2U AC-powered device that can have from 1 GB to 8 GB of memory. This module also has four PCI/PCI-X slots.

For more information about the MPX module, see “MPX Module” on page 86.

Base compute module MPX module

Ethernet port

SCSI port

Serial ports

RTI port

RTO port

L2

PCI bus 2 slot 2 PCI bus 2 slot 1 PCI bus 1 slot 2 PCI bus 1 slot 1

IO9

CPU

1.6 GB/s

SCSI port

L1 control

Memory/ Directory

3.2 GB/s

Bedrock

2.4 GB/s 2.4 GB/s

PIC

DVD-ROM

Two disks

USB port Console port

NUMAlink 3 channel

3.2 GB/s full-duplex

(1.6 GB/s each direction)

Xtown2 channel

2.4 GB/s full-duplex

(1.2 GB/s each direction)

Memory/ Directory

3.2 GB/s

Bedrock

PIC

L1 control

PCI bus 2 slot 2 PCI bus 2 slot 1 PCI bus 1 slot 2 PCI bus 1 slot 1

USB port Console port

Figure 2-4 Base Compute Module Connected to an MPX Module

To increase the number of PCI/PCI-X slots, the base compute module can connect to an MPX module. The MPX module is a 2U AC-powered device that has four PCI/PCI-X slots. This module also increases the amount of memory by 1 GB to 8 GB.

To increase the number of PCI slots, the base compute module can connect to a PCI expansion module. The PCI expansion module is a 4U, DC-powered device that can have either 6 or 12 PCI slots.

72 007-4566-001

Functional Architecture

The MPX and PCI expansion modules are peer-attached devices; they connect to the compute module via the NUMAlink connector. If the system has a NUMAlink module, the MPX and PCI expansion modules connect to the compute modules via the NUMAlink module (see Figure 2-5).

For more information about the MPX module, see “MPX Module” on page 86. For more information about the PCI expansion module, see “PCI Expansion Devices” on page 87.

007-4566-001 73

2: System Overview

4-processor

Expansion compute module

MPX module

Port 6

Port 5

Port 4

4-processor

Base compute module

NUMAlink module

GH

F

Router

ASIC

E

D

C

4-processor

Expansion compute module

MPX module

Port 8Port 7

A

B

Expansion compute module

Port 1

Port 2

Port 3

4-processor

PCI expansion module

Figure 2-5 Connection of MPX and PCI Expansion Modules to Compute Modules via

74 007-4566-001

PCI expansion module

NUMAlink 3 channels

3.2 GB/s full-duplex

(1.6 GB/s each direction)

NUMAlink Module

Silicon Graphics Origin 350 User Manual

Specifications and Main Features

Frequently Asked Questions

User Manual