Quanta Computer STRATOS S400-X44E Technical Manual

STRATOS S400 Series

S400-X44E

4U Server

Technical Guide

Date Modified: June 11, 2014 10:07 am Document Version: 1.0.1

TABLE OF CONTENTS

TABLE OF CONTENTS

About the Server

Introduction 1-1

System Features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-1

Major Features: . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-1

Specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-1

Package Contents 1-2
A Tour of the System 1-3

System Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-3

2.5” HDD System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-3

System Front Features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-4

Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-4

Control Panel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-4

System Rear Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-5

Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-5

I/O Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-6

Power Sub-System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-6

LED Status Definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-7

I

TABLE OF CONTENTS

I/O LED Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-7

LAN LED . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-8

Control Panel LED. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-9

PSU LED . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1-9

Installing Hardware

Safety Measures 2-1
Hard Disk Drives 2-2

Removing a 2.5” Swappable HDD Assembly . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-2

Removing a 2.5” Swappable HDD from an HDD Tray . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-2

Installing a 2.5” Swappable HDD Assembly . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-3

Installing a 2.5” Swappable HDD into an HDD Tray . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-3

Power Supply Unit 2-4

Removing a PSU . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-4

Installing a PSU . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-4

Operator Panel 2-5

Removing a Operator Panel Assembly . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-5

Installing a Operator Panel Assembly. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-6

Top Cover 2-7

II

TABLE OF CONTENTS

Removing a Top Cover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-7

Installing a Top Cover . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-7

Processor Heat Sinks 2-9

Removing a Processor Heat Sink. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-9

Installing a Processor Heat Sink . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-10

Air Baffle 2-11

Removing an Air Baffle. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-11

Installing an Air Baffle . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-12

Processors 2-14

Removing a Processor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-14

Installing a Processor. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-15

Memory Modules 2-18

General Guidelines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-18

Memory Support List . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-20

Memory Population Configurations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-20

Removing Memory Modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-23

Installing Memory Modules. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-24

Expansion Cards 2-25

III

TABLE OF CONTENTS

Removing a 10G/40G SFP+ Mezzanine Card. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-25

Installing a 10G/40G SFP+ Mezzanine Assembly. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-26

Removing a SAS Mezzanine Assembly . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-27

Installing a SAS Mezzanine Assembly . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-28

Removing a GPGPU Assembly. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-29

Installing a GPGPU Assembly . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-31

Mainboard Module 2-33

Removing a Mainboard Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-33

Installing a Mainboard Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-37

Power Distribution Board 2-41

Removing a PDB . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-41

Installing a PDB . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-41

HDD Backplane 2-42

Removing a HDD Backplane . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-42

Installing a HDD Backplane . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-43

Air Duct 2-44

Removing an Air Duct . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-44

Installing an Air Duct. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-44

Hot Swap Fan Module 2-46

IV

TABLE OF CONTENTS

Removing a Hot Swap Fan Module. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-46

Installing a Hot Swap Fan Module . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-46

Fan Module Assembly 2-47

Removing a Fan Cage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-47

Installing a Fan Cage. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2-48

Cable Routing 2-49

BIOS

BIOS Setup Utility 3-1

Operation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-1

Setup Page Layout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-1

Entering BIOS Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-2

Keyboard Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-2

Menu Selection Bar . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-4

Server Platform Setup Utility Screens . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-4

Main Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-5

Advanced Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-7

PCI Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-8

TPM Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-10

V

TABLE OF CONTENTS

WHEA Support Screen. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-11

Processor Configuration Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-12

Runtime Error Logging Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-18

SATA Controller Screen. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-19

Intel TXT(LT-SX) Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-21

USB Configuration Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-22

Super I/O Configuration Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-23

Onboard Device Configuration Screen. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-25

Console Redirection Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-26

Chipset Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-31

North Bridge Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-32

South Bridge Screen. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-34

ME Subsystem Screen. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-36

Server Management Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-37

System Event Log Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-39

FRU Information Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-40

BMC Network Configuration Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-42

Boot Option Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-44

Network Device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-46

Security Screen. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-47

VI

TABLE OF CONTENTS

Secure Boot Menu Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-48

Key Management Screen. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-49

Exit Screen. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-53

Loading BIOS Defaults. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-55

BIOS Update Utility 3-56

BIOS Update Utility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-56

Recovery Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-56

Recovery Flow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-57

Clear CMOS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-58

Clear Password . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-58

Server Management 3-59

Console Redirection. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-59

Serial Configuration Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-59

Keystroke Mapping. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-59

Limitations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-60

Interface to Server Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-60

PXE Boot . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-60

Checkpoints . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-61

VII

TABLE OF CONTENTS

Checkpoint Ranges. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-61

Standard Checkpoints. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-62

DXE Phase. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-65

ACPI/ASL Checkpoints. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-67

Extra Checkpoint Ranges . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3-68

BMC

Server Management Software 4-1

Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-1

BMC Key Features and Functions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-1

Power System. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-1

Front Panel User Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-2

VIII

TABLE OF CONTENTS

Power Button. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-2

ID Button . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-2

LEDs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-2

LAN Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-3

Session and User . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-3

RMCP+ . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-4

Serial Over LAN. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-4

Time Sync . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-4

SEL . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-4

Platform Event . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-5

Platform Event Filter. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-5

BMC Firmware Update . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-5

DOS Recovery Utility. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-5

WebUI Update . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-5

BMC Recovery 4-6

Recovery Process in DOS System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-6

Recovery Process in Linux System. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-6

Recovery Process in Windows System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-6

Web Graphical User Interface for ESMS 4-7

IX

TABLE OF CONTENTS

Using the Web GUI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-7

Login . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-7

Dashboard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-9

Device Information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-9

Network Information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-10

Sensor Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-10

Event Logs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-11

Server Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-11

FRU Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-12

Server Component . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-13

Server identify . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-14

Server Health Group. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-15

Sensor Readings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-15

Event Log . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-17

Configuration Group . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-18

Active Directory . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-18

DNS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-21

LDAP/E-Directory . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-24

Mouse Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-27

X

TABLE OF CONTENTS

Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-27

PEF. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-30

RADIUS. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-37

Remote Session . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-39

SMTP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-40

SOL . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-42

SSL. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-43

User Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-46

Virtual Media . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-50

Remote Control. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-51

Console Redirection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-51

Server Power Control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-57

Maintenance Group . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-58

Firmware Update . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-59

Preserve Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-60

Restore Factory Defaults . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-60

Log Out . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-61

User Privilege . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4-61

Connectors and Jumpers

XI

TABLE OF CONTENTS

Mainboard Connectors and Jumpers 5-1

Connectors and Jumpers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .5-1

Rail Kit Assembly

Installation and Configuration 6-1

Installing the Rails. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .6-1

Installing the Cable Management Arm (CMA) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .6-3

Removing the Cable Management Arm (CMA). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .6-4

Troubleshooting

Troubleshooting 7-1

System does not Boot after Initial Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7-1

System does not boot after Configuration Changes. . . . . . . . . . . . . . . . . . . . . . . . . . . .7-3

Installation Problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7-4

Installation and Assembly Safety Instructions

Installation Assembly Safety Instructions 8-1

Safety Information

XII

TABLE OF CONTENTS

Server Safety Information 9-1

Safety Warnings and Cautions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9-1

Intended Application Uses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9-2

Site Selection. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9-3

Equipment Handling Practices. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9-3

Power and Electrical Warnings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9-3

Power Cord Warnings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9-4

System Access Warnings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9-5

Rack Mount Warnings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9-6

Electrostatic Discharge (ESD) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9-7

Other Hazards . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9-7

Battery Replacement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9-7

Cooling and Airflow. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9-7

Laser Peripherals or Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9-8

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9-8

Regulatory and Compliance Information

Electromagnetic Compatibility Notices 10-1

XIII

TABLE OF CONTENTS

FCC Verification Statement (USA) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10-1

Europe (CE Declaration of Conformity). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10-2

VCCI (Japan) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10-2

BSMI (Taiwan) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10-2

Regulated Specified Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10-2

Restriction of Hazardous Substances (RoHS) Compliance. . . . . . . . . . . . . . . . . . . . . . . .10-3

End of Life / Product Recycling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10-3

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10-3

Product Regulatory Compliance Markings 10-4

XIV

CONVENTIONS

WARNING!

CAUTION!

Note:

!

Conventions

Several different typographic conventions are used throughout
this manual. Refer to the following examples for common
usage.

Bold type face denotes menu items, buttons and application

names.

Italic type face denotes references to other sections, and the

names of the folders, menus, programs, and files.

<Enter> type face denotes keyboard keys.

Warning information appears before the text it references and
should not be ignored as the content may prevent damage to
the device.

!

XV

CAUTIONS APPEAR BEFORE THE TEXT IT REFERENCES, SIMILAR TO
NOTES AND WARNINGS. CAUTIONS, HOWEVER, APPEAR IN CAPITAL
LETTERS AND CONTAIN VITAL HEALTH AND SAFETY INFORMATION.

Highlights general or useful information and tips.

ACRONYMS

Acronyms

T

ERM DEFINITION

TERM DEFINITION

A/D Analog to Digital

ACPI Advanced Configuration and Power Interface

ASF Alerting Standard Forum

Active-high (positive true) signals are asserted when in

Asserted

BIOS Basic Input/Output System

BIST Built-In Self Test

BMC

Bridge

BSP Bootstrap processor

Byte 8-bit quantity

CLI Command Line Interface

CMOS

CPU Central Processing Unit

the high electrical state (near power potential). Active­low (negative true) signals are asserted when in the
low electrical state (near ground potential).

At the heart of the IPMI architecture is a microcontroller
called the Baseboard management controller (BMC)

Circuitry connecting one computer bus to another,
allowing an agent on one to access the other

In terms of this specification, this describes the PC-AT
compatible region of battery-backed 128 bytes of mem­ory, which normally resides on the baseboard

Deasserted

DTC Data Transfer Controller

EEPROM

EMP Emergency Management Port

FRU Field Replaceable Unit

GB 1024 MB.

GPIO General Purpose Input/Out

HSC Hot-Swap Controller

Hz Hertz (1 cycle/second)

2

I

C

IANA Internet Assigned Numbers Authority

IBF Input buffer

ICH I/O Controller Hub

ICMB Intelligent Chassis Management Bus

IERR Internal Error

IP Internet Protocol

IPMB Intelligent Platform Management Bus

IPMI Intelligent Platform Management Interface

A signal is deasserted when in the inactive state.
Active-low signal names have “_L” appended to the
end of the signal mnemonic. Active-high signal names
have no “_L” suffix. To reduce confusion when referring
to active-high and active-low signals, the terms one/
zero, high/low, and true/false are not used when
describing signal states.

Electrically Erasable Programmable Read-Only Mem­ory

Inter-Integrated Circuit bus

XVI

ACRONYMS

T

ERM DEFINITION

ITP In-Target Probe

KB 1024 bytes.

KCS Keyboard Controller Style

KVM Keyboard, Video, Mouse

LAN Local Area Network

LCD Liquid Crystal Display

LCT Lower Critical Threshold

LED Light Emitting Diode

LNCT Lower Non-Critical Threshold

LNRT Lower Non-Recoverable Threshold

LPC Low Pin Count

LSI Large Scale Integration

LUN Logical Unit Number

MAC Media Access Control

MB 1024 KB

MD2 Message Digest 2 – Hashing Algorithm

MD5

Message Digest 5 – Hashing Algorithm – Higher Secu­rity

Ms Milliseconds

Mux Multiplexer

NIC Network Interface Card

NMI Non-maskable Interrupt

NM Node Management

OBF Output buffer

OEM Original Equipment Manufacturer

Ohm Unit of electrical resistance

PDB Power Distribution Board

T

ERM DEFINITION

PEF Platform Event Filtering

PEP Platform Event Paging

PERR Parity Error

POH Power-On Hours

POST Power-On Self Test

PWM Pulse Width Modulation

RAC Remote Access Card

RAM Random Access Memory

RMCP Remote Management Control Protocol

ROM Read Only Memory

RTC

Real-Time Clock. Component of the chipset on the
baseboard.

RTOS Real Time Operation System

SCI Serial Communication Interface

SDC SCSI Daughter Card

SDR Sensor Data Record

SEEPROM

Serial Electrically Erasable Programmable Read-Only
Memory

SEL System Event Log

SERR System Error

2

C protocol. The

SMBus

A two-wire interface based on the I
SMBus is a low-speed bus that provides positive
addressing for devices, as well as bus arbitration

SMI

Server Management Interrupt. SMI is the highest prior­ity non-maskable interrupt

SMM Server Management Mode

SMS Server Management Software

SNMP Simple Network Management Protocol

XVII

ACRONYMS

T

ERM DEFINITION

SOL Serial Over LAN

UART Universal Asynchronous Receiver/Transmitter

UCT Upper Critical Threshold

UDP User Datagram Protocol

UNCT Upper Non-Critical Threshold

UNRT Upper Non-Recoverable Threshold

WDT Watchdog Timer

Word 16-bit quantity

XVIII

SAFETY INFORMATION

Safety Information

Important Safety Instructions

Read all caution and safety statements in this document before
performing any of the instructions.

Warnings

Heed safety instructions: Before working with the server,

whether using this manual or any other resource as a refer­ence, pay close attention to the safety instructions. Adhere to
the assembly instructions in this manual to ensure and maintain
compliance with existing product certifications and approvals.
Use only the described, regulated components specified in this
manual. Use of other products / components will void the UL
listing and other regulatory approvals of the product and will
most likely result in non-compliance with product regulations in
the region(s) in which the product is sold.

System power on/off: The power button DOES NOT turn off

the system AC power. To remove power from system, you must
unplug the AC power cord from the wall outlet. Make sure the
AC power cord is unplugged before opening the chassis, add­ing, or removing any components.

Hazardous conditions, devices and cables: Hazardous elec-

trical conditions may be present on power, telephone, and com­munication cables. Turn off the server and disconnect the
power cord, telecommunications systems, networks, and
modems attached to the server before opening it. Otherwise,
personal injury or equipment damage can result.

Electrostatic discharge (ESD) and ESD protection: ESD can

damage drives, boards, and other parts. We recommend that
you perform all procedures in this chapter only at an ESD work­station. If one is not available, provide some ESD protection by
wearing an antistatic wrist strap attached to chassis ground any
unpainted metal surface on the server when handling parts.

ESD and handling boards: Always handle boards carefully.

They can be extremely sensitive to electrostatic discharge
(ESD). Hold boards only by their edges. After removing a board
from its protective wrapper or from the server, place the board
component side up on a grounded, static free surface. Use a
conductive foam pad if available but not the board wrapper. Do
not slide board over any surface.

Installing or removing jumpers: A jumper is a small plastic

encased conductor that slips over two jumper pins. Some jump­ers have a small tab on top that can be gripped with fingertips
or with a pair of fine needle nosed pliers. If the jumpers do not
have such a tab, take care when using needle nosed pliers to
remove or install a jumper; grip the narrow sides of the jumper

XIX

SAFETY INFORMATION

with the pliers, never the wide sides. Gripping the wide sides
can damage the contacts inside the jumper, causing intermittent
problems with the function controlled by that jumper. Take care
to grip with, but not squeeze, the pliers or other tool used to
remove a jumper, or the pins on the board may bend or break.

XX

REVISION HISTORY

Revision History

Refer to the table below for the updates made to this manual.

DATE CHAPTER UPDATES

Copyright

Copyright © 2014 Quanta Computer Inc. This publication,
including all photographs, illustrations and software, is pro­tected under international copyright laws, with all rights
reserved. Neither this manual, nor any of the material contained
herein, may be reproduced without the express written consent
of the manufacturer. All trademarks and logos are copyrights of
their respective owners.

Version 1.0.1 / June 11, 2014

Disclaimer

The information in this document is subject to change without
notice. The manufacturer makes no representations or warran­ties with respect to the contents hereof and specifically dis-

claims any implied warranties of merchantability or fitness for
any particular purpose. Furthermore, the manufacturer reserves
the right to revise this publication and to make changes from
time to time in the content hereof without obligation of the man­ufacturer to notify any person of such revision or changes.

For the latest information and updates please refer to

www.QuantaQCT.com

All the illustrations in this technical guide are for reference only
and are subject to change without prior notice.

XXI

REVISION HISTORY

About the Book

This manual is written for system technicians who are responsi­ble for troubleshooting, upgrading, and repairing the server
chassis. This document provides an overview of the hardware
features of the chassis, troubleshooting information, and
instructions on how to add and replace components of the
multi-node server series. The document also provides informa­tion on the BIOS, and Baseboard Management Controller
(BMC).

For the latest version of this manual, see

www.QuantaQCT.com.

XXII

About the Server

Chapter 1

ABOUT THE SERVER INTRODUCTION

Note:

1.1. Introduction

System Features

The system comprises a 4U/28” long chassis using a standard
SSI mainboard. Some of the major features are as follows:

Major Features:

Chipset

Intel® Romley -EP 4S platform (Intel® C602 chipset),
upgradeable ROM kit support.

Processors

Intel®Xeon® E5-4600 / E5-4600 v2 product family, up to four
units

PCIe

 (1) PCIe x8 G3 slot for Quanta LSI SAS/RAID, 10GbE

SFP+, Infiniband mezzanine card

Expansion cards are optional components.

Memory

DIMM slots x 48, twelve slots/per CPU, DDR3-800/1066/
1333/1600 supporting RDIMM, LRDIMM, UDIMM

Storage

SAS/SATA ports x8 (upgradeable ROM kit support for eight
SAS ports), Slim-line SATA port x1 for DVD-RW device,
SATA port x1 for 5.25” tape backup device

Network

Single chip dual port Ethernet device Powerville (I350)

 (4) PCIe x16 G3 slots in x16 bus

 (1) PCIe x16 G3 slot in x8 bus

 (2) PCIe x8 G3 slots in x8 bus

 (1) PCIe x8 G3 slot in x4 bus

1-1

Specifications

Form Factor

Rack-mount server with a height of 4U

ABOUT THE SERVER SYSTEM FEATURES

Chassis Size (L x W x H)

 704 mm x 424 mm x 173.8 mm

 27.71” x 16.69” x 6.84”

Mainboard Size (W x L)

 414.02 mm x 533.40 mm

 16.3” x 21”

Processor

Up to four Intel®Xeon® E5-4600 / E5-4600 v2 series proces­sors with bus speed up to 8.0GT/s.

Romley-EP 4S (Intel® Xeon® E5-4600 / E5-4600 v2 series)
processors supports the following features:

 Up to 10-cores and 20-threads per CPU

 Cost-Optimized (lowerBOM vs. premiumEX)

 Ring architecture implementation, includes Directory Bit &

adds Home Snoop, Route Thru, and more Node IDs

 Socket-R (LGA 2011)

Chipset

Intel® Romley -EP 4S platform (Intel® C602 chipset),
upgradeable ROM kit support.

Memory

 DIMM slots x 48, twelve slots/per CPU, up to 1.024 TB

 DDR3-800/1066/1333/1600 supporting RDIMM, LRDIMM,

UDIMM

Storage

 Up to 25MB Last-Level Cache

 Intel

 Integrated Memory Controller – supports DDR3 800/1066/

®

Turbo Boost Technology

1333/1600 via a memory buffer

 Up to 40 lanes integrated PCIe G3 per socket

 Supports 2S/4S configurations

 Intel

1-2

®

QuickPathInterconnect with 2 x 8GT/s links

 Hot-swappable 2.5” SAS/SATA 6 Gb/s hard disk drives, up

to eight units (upgradeable ROM kit support for eight SAS
ports).

 Slim-line SATA port for DVD-RW device

 SATA port for 5.25” tape backup device

HDD Backplane

Hot-swappable backplane

ABOUT THE SERVER SYSTEM FEATURES

PCIe Expansion Slot

 Slot 1 PCIe Gen-3x16, x16 connector (CPU0)

 Slot 2 PCIe Gen-3x4, x8 connector (CPU0)

 Slot 3 PCIe Gen-3x16, x16 connector (CPU0)

 Slot 4 PCIe Gen-3x8, x8 connector (CPU1)

 Mezzanine PCIe Gen-3x8, Mezz connector (CPU1)

 Slot 5 PCIe Gen-3x8, x8 connector (CPU1)

 Slot 6 PCIe Gen-3x16, x16 connector (CPU2)

 Slot 7 PCIe Gen-3x8, x16 connector (CPU2)

 Slot 8 PCIe Gen-3x16, x16 connector (CPU2)

Network

 Single chip dual port Ethernet device Powerville (I350)

Rear I/O

 External USB

 Management port

 LAN1 port

 LAN2 port

 ID button

 PCIe mezzanine slot

 Serial port

 VGA port

Power Supply

System supports up to four 1100W hot-swappable power
supply modules in a 3+1 redundant configuration

Management Port

10/100/1000 MB/s RJ45 LAN port for management (BMC)

Integrated Graphics BMC

Aspeed AST2300 8MB DDR3 Video memory

1-3

ABOUT THE SERVER PACKAGE CONTENTS

Important:

1.2. Package Contents

The following list includes the package components for a 4U
configuration:

 4U chassis system

 Power cord (optional)

 CD (technical guide included)

 Rail kit

Server configurations may vary. Confirm your sales representa­tive for the exact items included in your order.

1-2

ABOUT THE SERVER A TOUR OF THE SYSTEM

2

1

1.3. A Tour of the System

System Overview

The S400-X44E is available as a 2.5” HDD system.

2.5” HDD System

2.5” HDD System Component Description

NO.ITEM DESCRIPTION

1 Fans Fan module cage
2 2.5 Hard Drives 2.5” hard disk drives (HDD) cage (x8)

2.5” HDD System Component Overview

1-3

ABOUT THE SERVER SYSTEM FRONT FEATURES

1234

56

1234 5678 910

111213

System Front Features

Configuration

2.5” HDD Configuration

2.5” HDD Configuration

2.5” HDD Configuration (Continued)

NO.ITEM DESCRIPTION

5 HDD Bays HDD array
6 Tape Drive Bay Insert a tape drive here

Control Panel

Control Panel Features

2.5” HDD Configuration

NO.ITEM DESCRIPTION

1 Optical Drive Insert an optical drive here
2 Control Panel Control system
3 VGA port Connect a monitor to this port
4 USB port USB ports (2.0 compliant)

1-4

Control Panel Features

Control Panel Features

ITEM ICON NAME DESCRIPTION

1 LAN1 LED LAN access

ABOUT THE SERVER SYSTEM REAR FEATURES

1

2

Control Panel Features (Continued)

ITEM ICON NAME DESCRIPTION

2 LAN2 LED L AN access

3 LAN3 LED L AN access

4 LAN4 LED L AN access

5 ID LED Lights for system identification

6

7Fault LED

8 Fan fault LED

9 Power LED

HDD Activity
LED

Hard disk drive access

Provides critical and non-critical
failure notification

Amber: On, fan fault
OFF: No fan fault

Green: ON, system power on
OFF: system off

Control Panel Features (Continued)

ITEM ICON NAME DESCRIPTION

13

Identification
Button

Push to activate ID LED

System Rear Features

Configuration

10 Reset Button

11 NMI button Asserts NMI

12 Power Button

Press to restart the system when
the system is powered on

Based on System Off, Push Button
to turn PSU and System on

Based on System on, Push Button
to turn PSU and System off

1-5

System Rear Configuration

System Rear Configuration

NO. ITEM DESCRIPTION

1 I/O ports Connect I/O devices to these ports.
2 Power Supply Unit Power supply unit (PSU)

ABOUT THE SERVER POWER SUB-SYSTEM

12

3456789

PSU

I/O Features

System Rear I/O Features

System Rear I/O Features

ITEM ICON NAME DESCRIPTION

1 Serial port Connect serial devices to this port
2 SFP+ ports Connect SPF+ cables

System Rear I/O Features (Continued)

ITEM ICON NAME DESCRIPTION

8

9 VGA port Connect a monitor to this port

Identification
Button

Push to activate ID LED

Power Sub-System

3 USB port USB ports (2.0 compliant)

4 Dedicated Management LAN Port

5 LAN LAN access

6Fault LED

7 ID LED Lights for system identification

1-6

Provides critical and non-critical
failure notification

PSU Description

A system can have more than one power supply units (PSU).
The primary PSU and redundant backup(s). Redundant
backup(s) are optional.

ABOUT THE SERVER LED STATUS DEFINITIONS

Note:

Power Supply Units by Model

MODEL PSU AC INPUT

(1) 1100W high efficiency PSU,
100-240VAC (Default)

To use PSUs other than the models listed make sure to contact
the system dealer first and obtain authorized approval.

110/220V

LED Status Definitions

I/O LED Description

I/O LED Description

NAME COLOR CONDITION DESCRIPTION

ID LED Blue

Link/
Act

LAN1
LED

Speed

Link/
Act

LAN2
LED

Speed

Green

Amber ON Link speed is 1000Mbits/sec

Green ON Link speed is 100Mbits/sec

Green

Amber ON Llink speed is 1000Mbits/sec
Green ON Link speed is 100Mbits/sec

Blinking Unit selected for identification
OFF No identification requested
ON LAN Link

Blinking
OFF Disconnect

OFF

ON LAN Link
Blinking
OFF Disconnect

OFF

LAN Access (off when there
is traffic)

OFF, link speed is 10Mbits/
sec

LAN Access (off when there
is traffic)

OFF, link speed is 10Mbits/
sec

1-7

ABOUT THE SERVER LED STATUS DEFINITIONS

Speed

Link / Activity

PIN 1
Location

I/O LED Description (Continued)

NAME COLOR CONDITION DESCRIPTION

ON LAN Link

Link/

Act
Service
Port
LED

Speed

Green

Amber ON Link speed is 1000Mbits/sec
Green ON Link speed is 100Mbits/sec

Blinking
OFF Disconnect

OFF

LAN Access (off when there
is traffic)

OFF, link speed is 10Mbits/
sec

LAN LED

The system mainboard has one I350 Ethernet controller and
two 1GbE ports. Each RJ45 connector has two built-in LEDs.
See the following illustration and table for details.

RJ45 LAN Connector

1 GbE LED Description

CONFIGURATION 1 GBE CHIP ONBOARD

Speed Link / Activity
1GbE Amber Green Blinking
100M Green Green Blinking

1-8

ABOUT THE SERVER LED STATUS DEFINITIONS

1

Control Panel LED

Control Panel LED Description

NAME COLOR CONDITION DESCRIPTION

ON System power on

Power LED Green

Fan Fault
LED

Identifica­tion

Fault LED

Amber

Blue

Amber

OFF System power off
ON Fan fault
OFF No fan fault
Blinking Unit selected for identification
OFF No identification requested

 Critical Failure: critical

fan, voltage, temperature
state.

Blinking

OFF Error has been de-asserted

 Non-Critical Failure: non-

critical fan, voltage, tem­perature state, CPU ther­mal trip.

Control Panel LED Description (Continued)

NAME COLOR CONDITION DESCRIPTION

ON Link

LAN1 LED Green

Blinking

ON Link

LAN2 LED Green

Blinking

LAN Access (off when there
is traffic)

LAN Access (off when there
is traffic)

PSU LED

ON

Green

OFF

HDD Activ­ity

1-9

Green

Blinking

OFF No access (non-SAS)

 SEL Cleared
 No error

BMC indicating a system
health error

Hard disk drive access (only
on board SATA port)

PSU LED

PSU LED Description

NO FEATURE STATUS DESCRIPTION

Green Normal operation

1PSU LED

Yellow Fault

Installing Hardware

Chapter 2

INSTALLING HARDWARE SAFETY MEASURES

WARNING!

WARNING!

WARNING!

WARNING!

WARNING!

WARNING!

WARNING!

WARNING!

WARNING!

!

2.1. Safety Measures

!

!

!

!

Always ask for assistance to move or lift the system.

Only perform troubleshooting as authorized by the product
documentation, or as directed by a service and support team.
Repairs not authorized by warranty may void the warranty
and damage the system.

Always make sure to disconnect the system from the AC elec­trical source. Powering down the system DOES NOT ensure
there is no electrical activity in the system.

Server components and circuit boards are easily damaged by
discharges of static electricity. Working on servers that are
connected to a power supply can be extremely dangerous.
Follow the guidelines below to avoid personal injury or dam­age to the server.

!

!

!

Wear a grounded wrist strap. If none are available, discharge
any personal static electricity by touching the bare metal
chassis of the server case, or the bare metal body of any
other grounded device.

Humid environments tend to have less static electricity than
dry environments. A grounding strap is warranted whenever
danger of static electricity exists.

Do not touch the components on the unless it is necessary to
do so. Do not flex or stress circuit boards.

Leave all replacement components inside their static-proof
packaging until you are ready to use them.

!

2-1

Always disconnect the server from the power outlet whenever
you are working inside the server case.

INSTALLING HARDWARE HARD DISK DRIVES

2

3

1

2.2. Hard Disk Drives

Removing a 2.5” Swappable HDD Assembly

1. Press the tray handle button.

2. Pull the HDD tray handle open.

Removing HDD Assembly

Removing a 2.5” Swappable HDD from an HDD Tray

Disassembling HDD Assembly

4. Remove the screws securing the HDD to the HDD tray.

5. Remove the HDD from the HDD tray.

3. Grasp the tray handle and pull the tray out of the system.

2-2

INSTALLING HARDWARE INSTALLING A 2.5” SWAPPABLE HDD ASSEMBLY

2

1

Installing a 2.5” Swappable HDD Assembly

Installing HDD Assembly

1. Insert the HDD assembly into the system. Make sure the
hard drive is fully inserted.

2. Push the tray handle closed.

Installing a 2.5” Swappable HDD into an HDD Tray

Assembling HDD Tray

2-3

3. Install the HDD into the HDD tray.

4. Secure the HDD to the HDD tray with screws.

INSTALLING HARDWARE POWER SUPPLY UNIT

CAUTION!

Note:

A

B

B

2.3. Power Supply Unit

!

DISCONNECT THE POWER SUPPLY UNIT FROM THE POWER SOURCE
BEFORE REMOVING PSU. FAILURE TO DO SO COULD RESULT IN DAM-
AGE TO THE EQUIPMENT OR PERSONAL INJURY.

The redundant power supply unit can be replaced without shut­ting down the system.

Removing a PSU

1. Pull the PSU handle (A) up to the open position.

2. Press and hold the locking latch (B) lever.

3. Pull the PSU from the system.

Removing the PSU

Installing a PSU

2-4

Installing a Power Supply Unit

Insert the power supply unit (PSU) into the system. Make sure
the PSU is flush with the system and the locking latch lever (B)
is locked in place.

INSTALLING HARDWARE OPERATOR PANEL

Prerequisite:

2.4. Operator Panel

Removing a Operator Panel Assembly

Remove the top cover. See Removing a Top Cover.

1. Disconnect the operator panel cable from the connector
on mainboard.

2. Remove the operator panel assembly from the chassis.

Removing the Operator Panel Assembly

3. Remove the operator panel board from the panel hous­ing.

2-5

Disconnecting the Operator Panel Cable

Disassembling the Operator Panel

INSTALLING HARDWARE INSTALLING A OPERATOR PANEL ASSEMBLY

Prerequisite:

Installing a Operator Panel Assembly

Remove the top cover. See Removing a Top Cover.

1. Secure the operator panel board on the panel housing.

Assembling the Operator Panel

2. Install the operator panel assembly into the chassis.

Installing the Operator Panel Assembly

3. Connect the operator panel cable to the connector on
mainboard.

2-6

Connecting the Operator Panel Cable

INSTALLING HARDWARE TOP COVER

Prerequisite:

B

B

1

A

2.5. Top Cover

Removing a Top Cover

Turn off the system and any attached peripherals.

Unplug the AC power cables and disconnect all peripher­als, LAN lines and any other cables.

1. Remove the screw(s) from the top cover (A).

2. Press the release button(s) (B) and slide the top cover
(A).

3. Lift the top cover off the chassis.

Opening Top Cover

Installing a Top Cover

2-7

1. Place the top cover (A) on the chassis.

2. Slide the top cover into place.

INSTALLING HARDWARE INSTALLING A TOP COVER

A

3. Install and secure the screw(s) into the top cover.

Closing Top Cover

2-8

INSTALLING HARDWARE PROCESSOR HEAT SINKS

Prerequisite:

WARNING!

!

4

3

2

1

2.6. Processor Heat Sinks

Removing a Processor Heat Sink

The heatsink remains hot after the system has been powered
down. Allow sufficient time to cool before handling system compo­nents.

Remove the top cover. See Removing a Top Cover.

1. Loosen the captive screw(s) securing the heat sink to the
mainboard.

2-9

Removing the Heat Sink

2. Remove the heat sink.

INSTALLING HARDWARE INSTALLING A PROCESSOR HEAT SINK

Prerequisite:

Note:

1

2

4

3

Installing a Processor Heat Sink

To install a processor heat sink on processor number 2, see

Installing an Air Baffle.

Remove the top cover. See Removing a Top Cover.

1. Place the heat sink on the processor.

2-10

Installing Heat Sink

2. Secure the heat sink with the captive screw(s) in the order

shown on the image Installing Heat Sink.

INSTALLING HARDWARE AIR BAFFLE

Prerequisite:

WARNING!

!

1

3

2

4

2.7. Air Baffle

Removing an Air Baffle

This procedure applies to the processor number 2 heat sink

removal. See the numbering of the processors in Mainboard
Connectors and Jumpers section.

The heatsink remains hot after the system has been powered
down. Allow sufficient time to cool before handling system compo­nents.

Remove the top cover. See Removing a Top Cover.

2-11

1. Loosen the captive screw(s) securing the heat sink
assembly to the mainboard in an order shown on the fol­lowing image:

Removing Heat Sink Assembly

INSTALLING HARDWARE INSTALLING AN AIR BAFFLE

Prerequisite:

90°

90°

2. Remove the heat sink assembly.

3. Release the air baffle from adhesive on top of the heat
sink.

Installing an Air Baffle

This procedure applies to the processor number 2 heat sink air

baffle. See the numbering of the processors in Mainboard Con-
nectors and Jumpers section.

Remove the top cover. See Removing a Top Cover.

4. Leaving the adhesive area inside, fold the air baffle as
shown on the following image:

2-12

Removing Air Baffle

Folding Air Baffle

INSTALLING HARDWARE INSTALLING AN AIR BAFFLE

WARNING!

1

3

2

4

7. Secure heat sink assembly with captive screw(s) in the

!

5. Align holes on air baffle with the pins on top of the heat

6. Seal air baffle on heat sink. Make sure the sides of the air

Before installing an air baffle on heat sink, take a note of the
AIR FLOW arrow on top of the heat sink to avoid blocking

proper system cooling. See Sealing Air Baffle.

sink.

baffle are secured.

order shown on the image Installing Heat Sink Assembly.

Sealing Air Baffle

2-13

Installing Heat Sink Assembly

INSTALLING HARDWARE PROCESSORS

Prerequisite:

WARNING!

!

2.8. Processors

Removing a Processor

The processor remains hot after the system has been powered
down. Allow sufficient time to cool before handling system compo­nents.

Remove the CPU heatsink. See Removing a Processor
Heat Sink.

1. Press the unlocking lever of the processor socket down
and upwards as shown.

2. Press the locking lever of the processor socket down and
upwards.

3. Pull the locking lever fully open as shown.

Release Locking Lever

2-14

Release Unlocking Lever

INSTALLING HARDWARE INSTALLING A PROCESSOR

Note:

4. Press down on unlocking lever and lift load plate fully
open.

Installing a Processor

Use the socket cover to protect the socket when the socket is
empty.

1. Remove the dust cover.

Load Plate Opening

5. Remove processor.

Dust Cover Removal

2. Press the unlocking lever of the processor socket down
and upwards as shown.

Processor Removal

2-15

INSTALLING HARDWARE INSTALLING A PROCESSOR

5. Press down on unlocking lever and lift load plate fully
open.

Release Unlocking Lever

3. Press the locking lever of the processor socket down and
upwards.

Load Plate Opening

4. Pull the locking lever fully open as shown.

6. .Locate the pin-1 (A) on processor and the pin-1 (B) cor­ner of the socket.

Release Locking Lever

2-16

7. Locate the indent (C) on processor and corresponding tab
(D) on socket.

INSTALLING HARDWARE INSTALLING A PROCESSOR

A

B

D

C

Note:

Use the socket cover to protect the socket when the socket is
empty.

9. Repeat steps 1 through 7 for the remaining processors.

Installing Processor

8. Replace the processor bracket, unlocking and locking
levers to lock the processor in place.

Replacing Processor Bracket

2-17

INSTALLING HARDWARE MEMORY MODULES

WARNING!

!

2.9. Memory Modules

Mainboard is supplied with all DIMM slots populated with dummy
DIMMs for proper air flow. When installing and replacing memory
modules, only remove those dummy DIMMs that are to be directly
replaced. All DIMM slots must be occupied at all times by either a
memory module or dummy DIMM.

General Guidelines

All multi-node servers have specific rules for the population of
memory on the individual mainboards that must be obeyed.
Refer to the following individual server rules for information on
how to populate the particular server required

2-18

INSTALLING HARDWARE GENERAL GUIDELINES

Rear

CPU1

G1G2G3H1H2H3F3F2F1E3E2E1

CPU0

A1A2A3B1B2B3

D3D2D1C3C2C1

T3T2T1R3R2R1

CPU3

M3M2M1L3L2L1

CPU2

J1J2J3K1K2K3

N1N2N3P1P2P3

Memory Population Configuration

2-19

INSTALLING HARDWARE MEMORY SUPPORT LIST

Memory Support List Memory Population Configura-

tions

DIMM Configuration Parameters

PARAMETER POSSIBLE VALUE

DIMM Type

DIMM Construction

DIMM Frequencies

RDIMM (w/ECC) or UDIMM (w or
w/o ECC) or LRDIMM

RDIMM raw cards:

 A (1Rx8), B (2Rx8), C (1Rx4), D

(2Rx4), E/J (2Rx4), F/AB
(4Rx4), or H (4Rx8)

UDIMM raw cards:

 A (1Rx8), B (2Rx8), C (1Rx16),

D (1Rx8 w/ECC), E (2Rx8 w/
ECC)

LRDIMM raw cards:

 C/K (4Rx4 DDP), B (4Rx8 P)

DDR3-800, DDR3-1066, DDR3­1333, DDR3-1600

RDIMM Population Configurations within a Channel (Three Slots
per Channel)

CONFIGU

RATION

N

UMBER

1

2

POR

S

PEED

 A:

DDR3

­1333,
1066

 B:

DDR3

-1600,
1333,
1066

 A:

DDR3

­1333,
1066

B: DDR3­1600,
1333,
1066

1N OR 2N DIMM2 DIMM1 DIMM0

1N Empty Empty

1N Empty Empty Dual-rank

Single­Rank

2-20

INSTALLING HARDWARE MEMORY POPULATION CONFIGURATIONS

RDIMM Population Configurations within a Channel (Three Slots
per Channel) (Continued)

CONFIGU

RATION

N

UMBER

3

4

5

POR

S

PEED

 A:

DDR3

- 1066

 B:

DDR3

-1066

 A:

DDR3

-1333,
1066

 B:

DDR3

­1333,
1066

 A:

DDR3

-1333,
1066

B: DDR3

- 1333,
1066

1N OR 2N DIMM2 DIMM1 DIMM0

1N Empty Empty

1N Empty

1N Empty

Single­rank

Sinle­rank

Quad­rank

Single­rank

Dual-rank

RDIMM Population Configurations within a Channel (Three Slots
per Channel) (Continued)

CONFIGU

RATION

N

UMBER

6

7

8

9

POR

S

PEED

 A:

DDR3

-1333,
1066

B: DDR3

- 1333,
1066

 A:

DDR3

-800

 B:

DDR3

-800

 A:

DDR3

-800

B: DDR3­800

 A:

DDR3

-800

B: DDR3­800

1N OR 2N DIMM2 DIMM1 DIMM0

1N Empty Dual-rank Dual-rank

1N Empty

Single­rank

1N Empty Dual-rank

1N Empty

Quad­rank

Quad­rank

Quad­rank

Quad­rank

2-21

INSTALLING HARDWARE MEMORY POPULATION CONFIGURATIONS

RDIMM Population Configurations within a Channel (Three Slots
per Channel) (Continued)

CONFIGU

RATION

N

UMBER

10

11

12

13

POR

S

PEED

 A:

DDR3

-800

B: DDR3­800

 A:

DDR3

-800

B: DDR3­800

 A:

DDR3

-800

B: DDR3­800

 A:

DDR3

-800

B: DDR3­800

1N OR 2N DIMM2 DIMM1 DIMM0

1N

1N

1N

Single­rank

Single­rank

Single­rank

Single­rank

Single­rank

SDual­rank

Single­rank

Dual-rank

Dual-rank

1N Dual-rank Dual-rank Dual-rank

UDIMM Population Configurations within a Channel (Three Slots
per Channel)

CONFIGU

RATION

N

UMBER

1

2

POR

S

PEED

 A:

DDR3

­1333,
1066

 B:

DDR3

-1600,
1333,
1066

 A:

DDR3

­1333,
1066

B: DDR3­1600,
1333,
1066

1N OR 2N DIMM2 DIMM1 DIMM0

1N Empty Empty

Single­Rank

1N Empty Empty Dual-rank

2-22

INSTALLING HARDWARE REMOVING MEMORY MODULES

CAUTION!

WARNING!

!

!

UDIMM Population Configurations within a Channel (Three Slots
per Channel) (Continued)

CONFIGU

RATION

N

UMBER

3

4

POR

S

PEED

 A:

DDR3

­1333,
1066

 B:

DDR3

-1066,
1333,
1066

 A:

DDR3

­1333,
1066

 B:

DDR3

-1066,
1333,
1066

1N OR 2N DIMM2 DIMM1 DIMM0

2N Empty

2N Empty

Single­rank

Single­rank

Single­rank

Dual-rank

UDIMM Population Configurations within a Channel (Three Slots
per Channel) (Continued)

CONFIGU

RATION

N

UMBER

5

POR

S

PEED

 A:

DDR3

­1333,
1066

 B:

DDR3

-1066,
1333,
1066

1N OR 2N DIMM2 DIMM1 DIMM0

2N Empty Dual-rank Dual-rank

Removing Memory Modules

HANDLE THE MEMORY MODULE BY THE EDGES AT ALL TIMES.

Memory modules remain hot after the system is powered down.
Allow sufficient time for the memory modules to cool before han­dling system components.

2-23

INSTALLING HARDWARE INSTALLING MEMORY MODULES

Prerequisite:

1

2

A

1

2

1

CAUTION!

Note:

Installing Memory Modules

Remove the top cover. See Removing a Top Cover.

1. Press down on the two memory module slot levers (A).
The memory module partially ejects.

Removing Memory Modules

2. Lift out the memory module.

Push the memory module firmly into the memory module slot.
The locking latches should automatically close over the edges
of the memory board when fully inserted into the slot.

Installing Memory Modules

!

HANDLE THE MEMORY MODULE BY THE EDGES AT ALL TIMES.

2-24

Make sure the notch in the memory board aligns with the
obstruction in the memory slot.

INSTALLING HARDWARE EXPANSION CARDS

Prerequisite:

11

1

2

3

4

4

4

2.10. Expansion Cards

Removing a 10G/40G SFP+ Mez­zanine Card

Remove the top cover. See Removing a Top Cover.

1. Remove screw(s) from mezzanine assembly.

2-25

Removing SFP+ Mezzanine Assembly

2. Disconnect the mezzanine card from the linking board.

INSTALLING HARDWARE INSTALLING A 10G/40G SFP+ MEZZANINE ASSEMBLY

Prerequisite:

3. Disconnect the linking board from the mainboard connec­tor.

4. Remove standoff(s) from the mainboard.

5. Remove the mezzanine card.

6. Replace the I/O shield on the rear panel.

Rear Panel I/O Shield (1 of 2)

Installing a 10G/40G SFP+ Mez­zanine Assembly

Remove the top cover. See Removing a Top Cover.

1. Replace the I/O shield to provide openings for the SFP+
mezzanine card.

Rear Panel I/O Shield (1 of 2)

2-26

Rear Panel I/O Shield (2 of 2)

Rear Panel I/O Shield (2 of 2)

INSTALLING HARDWARE REMOVING A SAS MEZZANINE ASSEMBLY

Prerequisite:

55

5

4

3

2

2

2

4

1

1

1

2

3

2

4

4

4

2. Secure standoff(s) to the mainboard.

Removing a SAS Mezzanine Assembly

Remove the top cover. See Removing a Top Cover.

1. Remove screw(s) from SAS mezzanine assembly.

2-27

Installing a SFP+ Mezzanine Assembly

3. Connect the linking board to the mainboard connector.

4. Connect the mezzanine card to the linking board.

5. Install and secure the screw(s) to the mezzanine card.

Removing a SAS Mezzanine Card

2. Disconnect mezzanine card from the linking board.

INSTALLING HARDWARE INSTALLING A SAS MEZZANINE ASSEMBLY

Prerequisite:

3. Disconnect the linking board from the mainboard connec­tor.

4. Remove the standoff(s) from the mainboard.

5. Gently flip the mezzanine card and disconnect SAS
cable(s) from the card.

Disconnecting Cable

6. Remove the mezzanine card.

2. Removing the cabling of SAS 0-3 and SAS 4-7 from the
mini-SAS connectors on mainboard.

3. Connect the mini-SAS cable labeled SAS 0-3 with exten­sible cable (DD0S4ETH900) to the mezzanine card, only
for SAS ports to 0 to 3.

4. Connect the mini-SAS cable labled SAS 4-7 to the mez­zanine card.

Connecting Cable

Installing a SAS Mezzanine Assembly

2-28

Remove the top cover. See Removing a Top Cover.

1. Locate the min-SAS connectors on mainboard. See Con-
nectors and Jumpers on page 5-1

INSTALLING HARDWARE REMOVING A GPGPU ASSEMBLY

Prerequisite:

3

5

5

6

6

6

2

2

2

1

2

5. Secure the standoff(s) to the mainboard.

Removing a GPGPU Assembly

Remove the top cover. See Removing a Top Cover.

1. Disconnect cable from GPGPU assembly.

2-29

Installing a SAS Mezzanine Assembly

6. Connect linking board to the mainboard connector.

7. Gently flip the mezzanine assembly.

8. Connect the mezzanine assembly to the linking board.

9. Install and secure the screw(s) to the mezzanine assem­bly.

Disconnecting a GPGPU Cable from Assembly

2. If only one GPGPU card is installed, remove a dummy
GPU bracket in adjacent slot.

INSTALLING HARDWARE REMOVING A GPGPU ASSEMBLY

3

3

4

5

5

3. Remove screw(s) from GPGPU assembly.

5. Remove front and rear GPGPU brackets.

Removing GPGPU Assembly Screw(s)

4. Disconnect GPGPU assembly from mainboard connector.

2-30

Removing GPGPU Assembly Brackets

INSTALLING HARDWARE INSTALLING A GPGPU ASSEMBLY

Prerequisite:

1

1

3

3

2

Installing a GPGPU Assembly

Remove the top cover. See Removing a Top Cover.

6. Secure front and rear GPGPU brackets to the assembly.

7. Connect GPGPU assembly to mainboard connector.

2-31

Securing GPGPU Assembly Screw(s)

8. Secure screw(s) to the GPGPU assembly.

Securing GPGPU Assembly Brackets

INSTALLING HARDWARE INSTALLING A GPGPU ASSEMBLY

4

5

9. If only one GPGPU card is installed, secure a dummy
GPU bracket in adjacent slot.

Connecting a GPGPU Cable to an Assembly

10.Connect cable to the GPGPU assembly.

2-32

INSTALLING HARDWARE MAINBOARD MODULE

Prerequisite:

2.11. Mainboard Module

2. Remove bridge bracket.

Removing a Mainboard Module

Remove the top cover. See Removing a Top Cover.

Disconnect all cables from mainboard.

Remove air duct. See Removing an Air Duct.
Remove memory modules. See Removing Memory Mod-

ules.
Remove heatsink. See Removing a Processor Heat Sink.

2-33

Remove processor. See Removing a Processor.

Remove mezzanine card. See Removing a 10G/40G

SFP+ Mezzanine Card.

Remove GPGPU card. See Removing a SAS Mezzanine

Assembly.

1. Remove screw(s) from bridge board (A).

Removing Bridge Bracket

INSTALLING HARDWARE REMOVING A MAINBOARD MODULE

3. Guide cables away from mainboard assembly.

Guiding Cables

4. Remove screw(s) from both sides of the chassis.

Removing Screws

5. Remove screw(s) from all PCIe slot dust cover(s).

2-34

INSTALLING HARDWARE REMOVING A MAINBOARD MODULE

Rear

6. Remove PCIe slot dust cover(s).

Removing Dust Covers

7. Hold the hooks and pull the mainboard module assembly
towards front panel to release from securing tabs on
chassis.

8. Remove mainboard module assembly.

Mainboard Module Assembly Removal

9. Angle mainboard assembly 90°

degrees on a surface with

connectors on rear facing up.

2-35

10.Remove screw(s) from hooks on middle frame (A).

INSTALLING HARDWARE REMOVING A MAINBOARD MODULE

11.Remove hooks.

Removing Hooks from Middle Frame

13.Remove screw(s) from mainboard module.

12.Place mainboard on surface middle frame down.

2-36

Removing Screws

INSTALLING HARDWARE INSTALLING A MAINBOARD MODULE

14.Slide mainboard to realase from pins.

Removing Mainboard

Installing a Mainboard Module

1. Align pin holes on mainboard with pins on middle frame.

2. Install mainboard on middle frame.

3. Slide mainboard to secure to the pins on middle frame.

2-37

Installing Mainboard on Middle Frame

INSTALLING HARDWARE INSTALLING A MAINBOARD MODULE

4. Install screw(s) to mainboard module.

5. Angle mainboard assembly 90° degrees on a surface with
connectors on rear facing up.

6. IAlign hooks with screw holes on middle frame.

7. Install hooks.

8. nstall screw(s) to hooks on middle frame.

Installing Screws

2-38

Installing Hooks

9. Place mainboard on surface middle frame down.

10.Guide cables on the sides of the chassis.

11.Angle mainboard assembly to the chassis.

INSTALLING HARDWARE INSTALLING A MAINBOARD MODULE

CAUTION!

10

11

12

15

Rear

12.Align mainboard assembly with the tabs on chassis and
slots on rear panel.

!

TO AVOID DAMAGING THE CABLES, MAKE SURE THE CABLES WOULD

NOT GET CAUGHT AT MAINBOARD ASSEMBLY INSTALLATION.

13.Guide cables through the openings on the mainboard
assembly.

14.Install mainboard assembly.

15.Slide mainboard assembly to secure to the tabs on chas­sis.

17.Install and secure PCIe slot dust covers to the chassis
with the screw(s).

Mainboard Installation

Installing Memory Assembly

16.Align PCIe slot dust covers with the slots on chassis.

2-39

INSTALLING HARDWARE INSTALLING A MAINBOARD MODULE

18.Install screw(s) to the sides of the chassis.

Installing Screws

19.Align screw holes on bridge bracket with the screw holes
on chassis.

20.Install bridge bracket.

21.Install and secure screw(s) to the bridge bracket.

Installing Bridge Bracket

22.Install cables to the connectors. See Cable Routing.

2-40

INSTALLING HARDWARE POWER DISTRIBUTION BOARD

Prerequisite:

2.12. Power Distribution Board

Removing a PDB

Remove the PSU(s) from the chassis.

1. Disconnect the cable(s) from the PDB.

2. Remove the screw(s) from the PDB.

3. Slide the PDB to release it from the chassis pins.

Installing a PDB

1. Align the holes in the PDB with the chassis pins.

2. Insert the chassis pins in the PDB holes.

3. Slide the PDB to secure it to the chassis pins.

2-41

Removing a PDB

4. Remove the PDB from the chassis.

Inserting a PDB

4. Install and secure the screw(s) into the PDB.

INSTALLING HARDWARE HDD BACKPLANE

Prerequisite:

Front

Hooks

Hooks

2.13. HDD Backplane

Removing a HDD Backplane

Remove the mainboard. See Removing a Mainboard
Module.

Remove all swappable HDD assemblies.

Remove the optical drive assembly.

1. Remove all cables from the HDD backplane.

2. Lift the HDD backplane over the hooks.

3. ,Tilt and remove the HDD backplane from the chassis.

Removing a HDD Backplane

2-42

INSTALLING HARDWARE INSTALLING A HDD BACKPLANE

Guide
Slots

Front

Hooks

Hooks

Installing a HDD Backplane

1. Align the HDD backplane at an angle to the chassis.

2. Insert the HDD backplane so it sits in the chassis guide
slots.

3. Tilt and lift the HDD backplane over the hooks.

Installing a HDD Backplane

2-43

INSTALLING HARDWARE AIR DUCT

Prerequisite:

Prerequisite:

WARNING!

!

2.14. Air Duct

Removing an Air Duct

Installing an Air Duct

Remove the top cover. See Removing a Top Cover.

1. Press the air duct tabs.

1. Remove the air duct from the chassis.

Remove the top cover. See Removing a Top Cover.

Air ducts are needed for the proper cooling of the system. To pre­vent damage to the system, when installing the air duct, make
sure the arrow on top of the air duct points towards the rear panel
of the mainboard module.

2-44

Removing an Air Duct

INSTALLING HARDWARE INSTALLING AN AIR DUCT

1. Align the air duct with the middle bracket and insert the
plastic tabs into the wells in the middle bracket.

Installing the Air Duct

2. Install the air duct.

2-45

INSTALLING HARDWARE HOT SWAP FAN MODULE

Front

Front

LED

2.15. Hot Swap Fan Module

Removing a Hot Swap Fan Mod­ule

1. Push the release latches inwards.

2. Remove the fan module from the chassis.

Installing a Hot Swap Fan Mod­ule

1. Align the fan module with the fan cage.

2. Insert the fan module into the chassis.

Installing Hot Swap Fan Module

Removing Hot Swap Fan Module

2-46

INSTALLING HARDWARE FAN MODULE ASSEMBLY

Prerequisite:

2.16. Fan Module Assembly

Removing a Fan Cage

Remove all the fan modules.

1. Remove the screw(s) from the front of the chassis.

Fan Cage Front Panel Screws

2. Remove the screw(s) from the top of the fan cage and
remove the fan cage from the chassis.

Removing Fan Cage

2-47

INSTALLING HARDWARE INSTALLING A FAN CAGE

2

3

Installing a Fan Cage

1. Align the fan cage with the chassis.

2. Insert the fan cage into the chassis.

3. Install and secure the screw(s) into the top of the fan
cage.

4. Insert the screw(s) into the front of the chassis.

Fan Cage Front Panel Screws

Inserting Fan Cage

2-48

INSTALLING HARDWARE CABLE ROUTING

2.17. Cable Routing

The following image illustrates cable routing in the system.

LAN

2X18pin

1100W Hot Swap

Power Supply

Module #1

1100W Hot Swap

Power Supply

Module #2

1100W Hot Swap

1100W Hot Swap

Power Supply

Power Supply

Module #3

Module #3

1100W Hot Swap

Power Supply

Module #4

MINI-SAS 4-7

SATA0

SATA1

2x7 pin

USB

Memory

Memory

PCH

2X18pin

MINI-SAS 0-3

CPU0

CPU1

Memory

Memory

CPU2

Memory

2x6 pin

Sideband Signal

2x4 pin

GPU1 PWR

6+24 pin
Card Edge

2x4 pin

GPU2 PWR

2x2 pin

Tape Driver

PWR

2x5 pin

HSBP PWR

6+24 pin

Card Edge

2x8 pin

PWR

2x2 pin

FAN PWR

2x8 pin

MB PWR

6+24 pin

Card Edge

2x8 pin

MB PWR

2x8 pin

MB PWR

6+24 pin

Card Edge

2x4 pin

GPU3 PWR

2x4 pin

GPU4 PWR

Power Cable

Signal Cable

System Cable Routing

2-49

2x8 pin

PWR

2x8 pin MB

PWR

2x6 pin

Sideband Signal

FAN 8

38 x 80 x 80 mm
2x3 pin

PWR

FAN 4

38 x 80 x 80 mm
2x3 pin

PWR

HDD_2 HDD_5

GPIO-B GPIO-A

HDD_1

HDD_0

29 pin

SAS

2.5"

SAS/SATA

HDD

VSC410XKM

29 pin

SAS

2.5"

SAS/SATA

HDD

2x2 pin

FAN PWR

2x2 pin

CPU3

8 pin HSBP

Control

FAN 6
38 x 80 x 80 mm
38 x 80 x 80 mm

2x3 pin

PWR

FAN 2
38 x 80 x 80 mm
38 x 80 x 80 mm

2x3 pin

PWR

8 pin HSBP

Control

29 pin

SAS

2.5"

SAS/SATA

HDD

Memory

2x20 pin FP

FP/FAN Board

FAN 5
38 x 80 x 80 mm
38 x 80 x 80 mm

2x3 pin

PWR

FAN 1
38 x 80 x 80 mm
38 x 80 x 80 mm

2x3 pin

DVD

HDD_7

HDD_6

PWR

2x5 pin

HSBP PWR

13 pin Slim

SATA

Slimline SATA

Optical Device

2x6 pin

FP

2x6 pin

FP

Front Panel

EXT

Vedio

Memory

2x20 pin FP

2x20 pin FP 2x20 pin FP

FAN 7
38 x 80 x 80 mm
38 x 80 x 80 mm

2x3 pin

PWR

FAN 3
38 x 80 x 80 mm
38 x 80 x 80 mm

2x3 pin

PWR

HDD_4

MAXIM

HDD_3

SAS/SATA HSBP

29 pin

SAS

2.5"

SAS/SATA

HDD

USB

3x EXT

USB

2x7 pin

2x8 pin MB

PWR

2x8 pin MB

PWR

BIOS

Chapter 3

BIOS BIOS SETUP UTILITY

3.1. BIOS Setup Utility

The BIOS Setup utility is provided to perform system configura­tion changes and to display current settings and environment
information.

The BIOS Setup utility stores configuration settings in system
non-volatile storage. Changes affected by BIOS Setup will not
take effect until the system is rebooted. The BIOS Setup Utility

can be accessed during POST by using the <DEL> or <F2>

key.

The following sections describe the look and behavior for plat­form Setup.

Operation

BIOS Setup has the following features:

 The server board BIOS will only be available in English.

 BIOS Setup is functional via console redirection over vari-

ous terminal emulation standards. This may limit some
functionality for compatibility, e.g., usage of colors, some
keys or key sequences, or support of pointing devices.

Setup Page Layout

The setup page layout is sectioned into functional areas. Each
occupies a specific area of the screen and has dedicated func­tionality. The following table lists and describes each functional
area.

BIOS Setup Page Layout

FUNCTIONAL

A

REA

Title Bar

Setup Item List

Item Specific
Help Area

The title bar is located at the top of the screen and dis­plays the title of the form (page) the user is currently
viewing. It may also display navigational information.

The Setup Item List is a set of controllable and infor­mational items. Each item in the list occupies the left
column of the screen.

A Setup Item may also open a new window with more
options for that functionality on the board.

The Item Specific Help area is located on the right side
of the screen and contains help text for the highlighted
Setup Item. Help information may include the meaning
and usage of the item, allowable values, effects of the
options, etc.

DESCRIPTION

3-1

BIOS ENTERING BIOS SETUP

BIOS Setup Page Layout (Continued)

FUNCTIONAL

A

REA

Keyboard Com­mand Bar

The Keyboard Command Bar is located at the bottom
right of the screen and continuously displays help for
keyboard special keys and navigation keys.

DESCRIPTION

Entering BIOS Setup

BIOS Setup is started by pressing <DEL> or <F2> during boot

time when the OEM logo is displayed.

When Quiet Boot is disabled, the message "press <DEL> or
<F2> to enter setup" will be displayed on the diagnostics

screen.

Keyboard Commands

The bottom right portion of the Setup screen provides a list of
commands that are used to navigate through the Setup utility.
These commands are displayed at all times.

Each Setup menu page contains a number of features. Except
those used for informative purposes, each feature is associated
with a value field. This field contains user-selectable parame­ters. Depending on the security option chosen and in effect by
the password, a menu feature's value may or may not be
changeable. If a value is non-changeable, the feature's value
field is inaccessible and displays as "grayed out."

Keyboard Commands

KEY OPTION DESCRIPTION

The <Enter> key is used to activate sub-menus
when the selected feature is a sub-menu, or to
display a pick list if a selected option has a value

<Enter>

Execute
Command

field, or to select a sub-field for multi-valued fea­tures like time and date. If a pick list is dis-

played, the <Enter> key will select the currently

highlighted item, undo the pick list, and return
the focus to the parent menu.

3-2

BIOS KEYBOARD COMMANDS

Load Previous Values?

Yes N o

Keyboard Commands (Continued)

KEY OPTION DESCRIPTION

The <Esc> key provides a mechanism for back­ing out of any field. When the <Esc> key is
pressed while editing any field or selecting fea­tures of a menu, the parent menu is re-entered.

When the <Esc> key is pressed in any sub­menu, the parent menu is re-entered. When the
<Esc> key is pressed in any major menu, the
exit confirmation window is displayed and the

<Esc> Exit

↑

Select
Item

user is asked whether changes can be dis-

carded. If No is selected and the <Enter> key is
pressed, or if the <Esc> key is pressed, the

user is returned to where he/she was before
<Esc> was pressed, without affecting any exist-

ing any settings. If Yes is selected and the
<Enter> key is pressed, setup is exited and the

BIOS returns to the main System Options Menu
screen.

The up arrow is used to select the previous
value in a pick list, or the previous option in a
menu item's option list. The selected item must

then be activated by pressing the <Enter> key.

Keyboard Commands (Continued)

KEY OPTION DESCRIPTION

The <Tab> key is used to move between fields.

<Tab>

-

+

Select
Field

Change
Value

Change
Value

For example, <Tab> can be used to move from

hours to minutes in the time item in the main
menu.

The minus key on the keypad is used to change
the value of the current item to the previous
value. This key scrolls through the values in the
associated pick list without displaying the full
list.

The plus key on the keypad is used to change
the value of the current menu item to the next
value. This key scrolls through the values in the
associated pick list without displaying the full
list. On 106-key Japanese keyboards, the plus
key has a different scan code than the plus key
on the other keyboard, but will have the same
effect.

Pressing <F8> causes the following to appear:

\

The down arrow is used to select the next value

↓

Select
Item

in a menu item's option list, or a value field's
pick list. The selected item must then be acti-

vated by pressing the <Enter> key.

↔

3-3

Select
Menu

The left and right arrow keys are used to move
between the major menu pages. The keys have
no affect if a sub-menu or pick list is displayed.

<F8>

Previous
Values

If Yes is highlighted and <Enter> is pressed, all
Setup fields are set to their previous values. If
No is highlighted and <Enter> is pressed, or if
the <Esc> key is pressed, the user is returned
to where they were before <F8> was pressed
without affecting any existing field values

BIOS MENU SELECTION BAR

Load Optimized Defaults?

Yes No

Save configuration and exit?

Yes No

Keyboard Commands (Continued)

KEY OPTION DESCRIPTION

Pressing <F9> causes the following to appear:

\

<F9>

<F10>

Setup
Defaults

Save and
Exit

If Yes is highlighted and <Enter> is pressed, all

Setup fields are set to their default values. If No

is highlighted and <Enter> is pressed, or if the
<Esc> key is pressed, the user is returned to
where they were before <F9> was pressed with-

out affecting any existing field values.
Pressing <F10> causes the following message

to appear:

If Yes is highlighted and <Enter> is pressed, all
changes are saved and Setup is exited. If No is
highlighted and <Enter> is pressed, or the
<Esc> key is pressed, the user is returned to
where they were before <F10> was pressed
without affecting any existing values.

Menu Selection Bar

The Menu Selection Bar is located at the top of the BIOS Setup
Utility screen. It displays the major menu selections available to
the user. By using the left and right arrow keys, the user can
select the menus listed here.

Server Platform Setup Utility Screens

The sections below describe the screens available for the con­figuration of a server platform. In these sections, tables are
used to describe the contents of each screen. These tables fol­low the following guidelines:

 The text and values in the Setup Item, Options, and Help

columns in the tables are displayed on the BIOS Setup
screens.

 Bold text in the Options column of the tables indicates

default values. These values are not displayed in bold on
the setup screen. The bold text in this document is to
serve as a reference point.

3-4

 The Comments column provides additional information

where it may be helpful. This information does not appear
in the BIOS Setup screens.

BIOS MAIN SCREEN

Version 2.11.1210 - Copyright (C) 2011 American Megatrends, Inc.

Aptio Setup Utility - Copyright (C) 2011 American Megatrends, Inc.

Main Advanced Chipset Server Mgmt Boot Security Save & Exit

BIOS Information
BIOS Vendor
Core Version
Compliancy
Project Version
Build Date and Time

Memory Information
Total Memory

System Date

System Time

Access Level

American Megatrends

4.6.5.1
UEFI 2.3; PI 1.2
S4E_1A01
11/03/2011

8192 MB (DDR3)

[Tue 11/04/2011]
[14:28:25]

Admlnistrator

Set the Date. Use Tab to
switch between Date elements.

: Select Screen
: Select Item
Enter: Select
+/-: Change Opt.
F1: General Help
F8: Previous Value
F9: Optimized Defaults
F10: Save & Exit
ESC: Exit

 Information in the screen shots that is enclosed in brack-

ets (< >) indicates text that varies, depending on the
option(s) installed. For example <Current Date> is
replaced by the actual current date.

 Information that is enclosed in square brackets ([]) in the

tables indicates areas where the user needs to type in text
instead of selecting from a provided option.

 Whenever information is changed (except Date and Time)

the systems requires a save and reboot to take place.

Pressing <ESC> will discard the changes and boot the

system according to the boot order set from the last boot.

3-5

Main Screen

The Main screen is the screen that is first displayed when BIOS
Setup is entered, unless an error has occurred. If an error has
occurred, the Error Manager screen will be displayed instead.

Main Screen

BIOS MAIN SCREEN

Main Screen Fields

SETUP ITEM OPTIONS

BIOS Ven­dor

Core Ver­sion

Compliancy

Project Ver­sion

Build Date

Tot a l M e m ­ory

[Day of
System
Date

week

MM/DD/

YYYY]

HELP

T

EXT

Set the
Date.
Use Tab
to switch
between
Date ele­ments.

COMMENTS

Information only. Displays the
BIOS Vendor.

Information only. Displays the
AMI BIOS Core version.

Information only. Displays the
BIOS compliancy.

Information only. Displays the
Project version.

Information only. Displays the
BIOS build date.

Information only. Displays the
Total System Memory Size.

Main Screen Fields (Continued)

SETUP ITEM OPTIONS

Access
Level

HELP

T

EXT

COMMENTS

Information only. Displays the
Access Level.

Set the
Time.

System
Time

[HH:MM:

SS]

Use Tab
to switch
between
Time ele­ments.

3-6

BIOS ADVANCED SCREEN

Advanced Screen

The Advanced screen provides an access point to configure
several options. On this screen, the user selects the option that
is to be configured. Configurations are performed on the
selected screen, not directly on Advanced screen.

To access this screen from Main screen, press the right arrow
until Advanced screen is chosen.

Advanced Screen

SETUP ITEM OPTIONS HELP TEXT COMMENTS

PCI Subsys­tem Settings

Trusted Com­puting

WHEA Con­figuration

CPU Config­uration

Runtime
Error Logging

SATA Config­uration

SAS Configu­ration

PCI, PCI-X and PCI
Express Settings.

Trusted Computing
Settings.

General WHEA
Configuration set­tings.

CPU Configuration
Parameters.

Runtime Error Log­ging Support Setup
Options

SATA Devices Con­figuration.

SAS Devices Con­figuration.

Advanced Screen

3-7

Intel TXT(LT­SX) Configu­ration

USB Configu­ration

Super IO
Configuration

Onboard
Device Con­figuration

Intel Trusted Execu­tion Technology
Configuration

USB Configuration
Parameters.

System Super IO
Chip Parameters.

Onboard Device
Parameters.

BIOS ADVANCED SCREEN

Advanced Screen (Continued)

SETUP ITEM OPTIONS HELP TEXT COMMENTS

Serial Port
Console
Redirection

Serial Port Console
Redirection.

PCI Screen

The PCI Screen provides fields to configure PCI add-in cards,
the onboard NIC controllers, and video options. To access this
screen from the Main screen, select Advanced | PCI.

MainAdvanced ChipsetServer MgmtBootSecurity Save & Exit

PCI Express Settings Change PCI Express Devices

Aptio Setup Utility - Copyright (C) 2011 American Megatrends, Inc.

Settings.

: Select Screen
: Select Item
Enter: Select
+/-: Change Opt.
F1: General Help
F8: Previous Value
F9: Optimized Defaults
F10: Save & Exit
ESC: Exit

3-8

Version 2.14.1219 - Copyright (C) 2011 American Megatrends, Inc.

PCI Subsystem Settings Screen

BIOS ADVANCED SCREEN

PCI Subsystem Settings Screen

SETUP ITEM OPTIONS HELP TEXT COMMENTS

PCI Express
Settings

Change PCI
Express Devices
Settings.

PCI Express Settings Screen

MainAdvanced ChipsetServer MgmtBootSecurity Save & Exit

PCI Express Device Register Settings

Maximum Payload

ASPM Support

WARNING: Enabling ASPM may cause some
PCI-E devices to tall

Aptio Setup Utility - Copyright (C) 2011 American Megatrends, Inc.

[Auto]

[Disabled]

Version 2.11.1210 - Copyright (C) 2011 American Megatrends, Inc.

set Maximum Payload of PCI
Express Device or allow System
BIDS to select the Value.

: Select Screen
: Select Item
Enter: Select
+/-: Change Opt.
F1: General Help
F8: Previous Value
F9: Optimized Defaults
F10: Save & Exit
ESC: Exit

3-9

PCI Express Settings Screen

BIOS ADVANCED SCREEN

PCI Express Settings Fields

SETUP ITEM OPTIONS HELP TEXT COMMENTS

[Auto]

Maximum
Payload

ASPM Sup­port

[128 Bytes]

[256 Bytes]

[512 Bytes]

[1024 Bytes]

[2048 Bytes]

[4096 Bytes]

[Disabled]

[Auto]

Set Maximum Payload of
PCI Express Device or
allow System BIOS to
select the value.

Set the ASPM Level:
AUTO - BIOS auto con­figure : DISABLE -

Disables ASPM

TPM Screen

Aptio Setup Utility - Copyright (C) 2011 American Megatrends, Inc.

Advanced RecoveryMain Chipset Server Mgmt Boot Security Save & Exit

Configuration
Security Device Support

Current Status Information
NO Security Device Found

Version 2.14.1219 - Copyright (C) 2011 American Megatrends, Inc.

[Disabled]

Enables or Disables BIOS
support for security
device. O.S. will not show
Security Device. TCG EFI
protocol and INT1A
interface will not be
available.

: Select Screen
: Select Item
Enter: Select
+/-: Change Opt.
F1: General Help
F8: Previous Value
F9: Optimized Defaults
F10: Save & Exit
ESC: Exit

3-10

Trusted Computing Screen

BIOS ADVANCED SCREEN

ain

t

Serve

oot

it

Trusted Com puting Fields

SETUP ITEM OPTIONS HELP TEXT COMMENTS

Enables or Disables

BIOS support for secu­Security
Device Sup­port

Current Sta­tus Informa­tion

[Disabled]
[Enabled]

rity device. O.S. will not

show Security Device.

TCG EFI protocol and

INT1A interface will not

be available.

Information
only. Dis­plays the
Current Sta­tus Informa­tion

WHEA Support Screen

M

WHEA Support [Enabled] Enable or disable Windows

Aptio Setup Utility - Copyright (C) 2011 American Megatrends, Inc.

Advanced Chipse

Version 2.11.1210 - Copyright (C) 2011 American Megatrends, Inc.

r MgmtB

SecuritySave & Ex

Hardware Error Architecture.

: Select Screen
: Select Item
Enter: Select
+/-: Change Opt.
F1: General Help
F8: Previous Value
F9: Optimized Defaults
F10: Save & Exit
ESC: Exit

WHEA Support Screen

3-11

BIOS ADVANCED SCREEN

Version 2.14.1219 - Copyright (C) 2011 American Megatrends, Inc.

Aptio Setup Utility - Copyright (C) 2011 American Megatrends, Inc.

Advanced RecoveryMain Chipset Server Mgmt Boot Security Save & Exit

: Select Screen

: Select Item

Enter: Select

+/-: Change Opt.

F1: General Help

F8: Previous Value

F9: Optimized Defaults

F10: Save & Exit

ESC: Exit

CPU Configuration

Socket 0 CPU Information

Socket 1 CPU Information
Socket 2 CPU Information
Socket 3 CPU Information

CPU Speed

64-bit

Hyper-threading
Active Processor Cores
Execute Disable Bit
Hardware Prefetcher
Adjacent Cache Line Prefetch
DCU Streamer Prefetcher
DCU IP Prefetcher
Intel Virtualization Technology
CPU power management Configuration

2900 MHz

Supported

[Enabled]
[All]
[Enabled]
[Enabled]
[Enabled]
[Enabled]
[Enabled]
[Enabled]

Socket specific CPU

Information

WHEA Support Fields

SETUP ITEM OPTIONS HELP TEXT COMMENTS

WHEA Sup­port

3-12

[Disabled]
[Enabled]

Enable or disable Win-

dows Hardware Error

Architecture. When

Enabled the BIOS would

publishes WHEA-spe-

cific ACPI tables that

describe the platform

error interfaces for the

OS as Spec, and also

implements the ASL code

to support and enable

WHEA capability in the

platform.

Processor Configuration Screen

The Processor screen provides a place for the user to view the
processor core frequency, system bus frequency, and enable or
disable several processor options. The user can also select an
option to view information about a specific processor.

To access this screen from the Main screen, select Advanced |
Processor.

Processor Configuration Screen

BIOS ADVANCED SCREEN

Processor Configuration Fields

SETUP ITEM OPTIONS HELP TEXT COMMENTS

Socket 0
CPU Infor­mation

Socket 1
CPU Infor­mation

Socket 2
CPU Infor­mation

Socket 3
CPU Infor­mation

CPU Speed

64-bit

Socket specific
CPU Information.

Socket specific
CPU Information.

Socket specific
CPU Information.

Socket specific
CPU Information.

Information only.
Displays the speed
of the processor.

Information only.
Displays 64-bit
supported or not.

Processor Configuration Fields (Continued)

SETUP ITEM OPTIONS HELP TEXT COMMENTS

Enabled for Win­dows XP and Linux
(OS optimized for
Hyper-Threading
Technology) and

Hyper­threading

Active Pro­cessor Cores

[Disabled]
[Enabled]

[All]
[1]
[2]
[3]
...

Disabled for other
OS (OS not opti­mized for Hyper­Threading Technol­ogy). When Dis­abled only one
thread per enabled
core is enabled.

Number of cores to
enable in each pro­cessor package.

For Sandy Bridge,
it could only enable
1 or more even
cores.
For Ivy Bridge, it
could enable all
numbers of cores
less than the max
cores.

3-13

BIOS ADVANCED SCREEN

Processor Configuration Fields (Continued)

SETUP ITEM OPTIONS HELP TEXT COMMENTS

 XD can prevent

certain classes
of malicious buf­fer overflow
attacks when

combined with a
Execute Dis­able Bit

Hardware
Prefetcher

Adjacent
Cache Line
Prefetch

[Disabled]
[Enabled]

[Disabled]
[Enabled]

[Disabled]
[Enabled]

supporting OS

(Windows Sever

2003 SP1, Win-

dows XP SP2,

SuSE Linux 9.2,

RedHat Enter-

prise 3 Update

3.)

To turn on/off
prefetching of adja­cent cache lines.

To turn on/off the
Mid Level Cache
(L2) streamer
prefetcher.

Processor Configuration Fields (Continued)

SETUP ITEM OPTIONS HELP TEXT COMMENTS

When enabled, a

Intel Virtual­ization Tech­nology

CPU Power
Manage­ment Config­uration

[Disabled]
[Enabled]

VMM can utilize the
additional hardware
capabilities pro­vided by Vander­pool Technology.

CPU Power Man­agement Configu­ration Parameters

Enable prefetcher
DCU
Streamer
Prefetcher

DCU IP
Prefetcher

3-14

[Disabled]
[Enabled]

[Disabled]
[Enabled]

of next L1 Data line

based upon multi-

ple loads in same

cache line.

Enable prefetcher

of next L1 line

based upon

sequential load his-

tory.