Supero SuperServer 1027GR-TRFT series, SuperServer 1027GR-TRF series User Manual

Relion 1800GT

Versatile Enterprise and HPC Server featuring the latest Intel Technology

Technical Guide
Rev. 1.0

www.penguincomputing.com | 1-888-PENGUIN (736-4846) | twitter:@PenguinHPC

PENGUIN

COMPUTING

SUPER

SUPERSERVER

1027GR-TRF

1027GR-TRFT

®

USER’S MANUAL

Revision 1.0a

The information in this User’s Manual has been carefully reviewed and is believed to be accurate.
The vendor assumes no responsibility for any inaccuracies that may be contained in this document,
makes no commitment to update or to keep current the information in this manual, or to notify any

person or organization of the updates. Please Note: For the most up-to-date version of this

manual, please see our web site at www.supermicro.com.

Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this manual at any time and without notice. This product, including software and docu­mentation, is the property of Supermicro and/or its licensors, and is supplied only under a license.
Any use or reproduction of this product is not allowed, except as expressly permitted by the terms
of said license.

IN NO EVENT WILL SUPERMICRO BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL,
SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO
USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF
SUCH DAMAGES. IN PARTICULAR, SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY
HARDWARE, SOFTWARE, OR DATA STORED OR USED WITH THE PRODUCT, INCLUDING THE
COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH
HARDWARE, SOFTWARE, OR DATA.

Any disputes arising between manufacturer and customer shall be governed by the laws of Santa
Clara County in the State of California, USA. The State of California, County of Santa Clara shall
be the exclusive venue for the resolution of any such disputes. Super Micro's total liability for all
claims will not exceed the price paid for the hardware product.

FCC Statement: This equipment has been tested and found to comply with the limits for a Class A
digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable
protection against harmful interference when the equipment is operated in a commercial environ­ment. This equipment generates, uses, and can radiate radio frequency energy and, if not installed
and used in accordance with the manufacturer’s instruction manual, may cause harmful interference
with radio communications. Operation of this equipment in a residential area is likely to cause harmful
interference, in which case you will be required to correct the interference at your own expense.

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warn­ing applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”

WARNING: Handling of lead solder materials used in this
product may expose you to lead, a chemical known to the
State of California to cause birth defects and other repro­ductive harm.

Manual Revision 1.0a
Release Date: August 17, 2012

Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.

Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.

Copyright © 2012 by Super Micro Computer, Inc.
All rights reserved.

Printed in the United States of America

Preface

About This Manual

This manual is written for professional system integrators and PC technicians.

It provides information for the installation and use of the SuperServer 1027GR-

TRF/1027GR-TRFT. Installation and maintenance should be performed by experi-

enced technicians only.

The 1027GR-TRF/1027GR-TRFT is based on the SC118GQ-R1800B 1U rackmount

server chassis and the Super X9DRG-HF/X9DRG-HTF serverboard. Please refer

to our web site for an up-to-date list of supported operating systems, processors

and memory. See Chapter 1 for a list of differences between the server models.

Manual Organization

Preface

Chapter 1: Introduction

The fi rst chapter provides a checklist of the main components included with the

server system and describes the main features of the Super X9DRG-HF/X9DRG-

HTF serverboard and the SC118GQ-R1800B chassis.

Chapter 2: Server Installation

This chapter describes the steps necessary to install the system into a rack and

check out the server confi guration prior to powering up the system. If your server

was ordered without the processor and memory components, this chapter will refer

you to the appropriate sections of the manual for their installation.

Chapter 3: System Interface

Refer to this chapter for details on the system interface, which includes the functions

and information provided by the control panel on the chassis as well as other LEDs

located throughout the system.

Chapter 4: System Safety

You should thoroughly familiarize yourself with this chapter for a general overview

of safety precautions that should be followed when installing and servicing the

system.

iii

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Chapter 5: Advanced Serverboard Setup

Chapter 5 provides detailed information on the X9DRG-HF/X9DRG-HTF

serverboard, including the locations and functions of connectors, headers and jump-

ers. Refer to this chapter when adding or removing processors or main memory

and when reconfi guring the serverboard.

Chapter 6: Advanced Chassis Setup

Refer to Chapter 6 for detailed information on the SC118GQ-R1800B 1U rackmount

server chassis. You should follow the procedures given in this chapter when install-

ing, removing or reconfi guring SATA or peripheral drives and when replacing system

power supply units and cooling fans.

Chapter 7: BIOS

The BIOS chapter includes an introduction to BIOS and provides detailed informa-

tion on running the BIOS Setup Utility.

Appendix A: BIOS Error Beep Codes

Appendix B: System Specifi cations

iv

Notes

Preface

v

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Table of Contents

Chapter 1 Introduction

1-1 Overview ......................................................................................................... 1-1

1-2 Serverboard Features ..................................................................................... 1-2

Processors ...................................................................................................... 1-2

Memory ........................................................................................................... 1-2

Serial ATA ....................................................................................................... 1-2

PCI Expansion Slots ....................................................................................... 1-2

Onboard Controllers/Ports .............................................................................. 1-2

IPMI ................................................................................................................. 1-2

1-3 Server Chassis Features ................................................................................ 1-3

System Power ................................................................................................. 1-3

SATA Subsystem ............................................................................................. 1-3

Front Control Panel ......................................................................................... 1-3

Cooling System ............................................................................................... 1-3

1-4 GPU Subsystem .............................................................................................. 1-4

1-5 Contacting Supermicro .................................................................................... 1-6

Chapter 2 Server Installation

2-1 Overview ......................................................................................................... 2-1

2-2 Unpacking the System .................................................................................... 2-1

2-3 Preparing for Setup ......................................................................................... 2-1

Choosing a Setup Location ............................................................................. 2-1

Rack Precautions ............................................................................................ 2-2

Server Precautions .......................................................................................... 2-2

Rack Mounting Considerations ....................................................................... 2-3

Ambient Operating Temperature ................................................................ 2-3

Reduced Airfl ow ......................................................................................... 2-3

Mechanical Loading ................................................................................... 2-3

Circuit Overloading ..................................................................................... 2-3

Reliable Ground ......................................................................................... 2-3

2-4 Installing the System into a Rack ................................................................... 2-4

Identifying the Sections of the Rack Rails ...................................................... 2-4

Installing the Inner Rail Extensions ................................................................ 2-5

Assembling the Outer Rails ............................................................................ 2-6

Installing the Outer Rails onto the Rack ......................................................... 2-7

Installing and Removing the Chassis From a Rack ....................................... 2-8

Installing the Server into a Telco Rack ........................................................... 2-9

vi

Table of Contents

Chapter 3 System Interface

3-1 Overview ......................................................................................................... 3-1

3-2 Control Panel Buttons ..................................................................................... 3-1

Reset ............................................................................................................... 3-1

Power .............................................................................................................. 3-1

3-3 Control Panel LEDs ........................................................................................ 3-2

Overheat/Fan Fail/UID LED ............................................................................ 3-2

NIC2 ................................................................................................................ 3-2

NIC1 ................................................................................................................ 3-2

HDD ................................................................................................................. 3-3

Power .............................................................................................................. 3-3

3-4 Drive Carrier LEDs .......................................................................................... 3-3

Chapter 4 System Safety

4-1 Electrical Safety Precautions .......................................................................... 4-1

4-2 General Safety Precautions ............................................................................ 4-2

4-3 ESD Precautions ............................................................................................. 4-3

4-4 Operating Precautions .................................................................................... 4-4

Chapter 5 Advanced Serverboard Setup

5-1 Handling the Serverboard ............................................................................... 5-1

Precautions ..................................................................................................... 5-1

Unpacking ....................................................................................................... 5-2

5-2 Serverboard Installation .................................................................................. 5-2

5-3 Connecting Cables .......................................................................................... 5-3

Connecting Data Cables ................................................................................. 5-3

Connecting Power Cables .............................................................................. 5-3

Connecting the Control Panel ......................................................................... 5-3

5-4 I/O Ports .......................................................................................................... 5-4

5-5 Installing the Processor and Heatsink ............................................................ 5-5

Installing an LGA 2011 Processor ................................................................... 5-5

Installing a CPU Heatsink ............................................................................... 5-8

Memory Support .............................................................................................. 5-9

Processor/DIMM Population Confi gurations ............................................ 5-10

5-6 Expansion Cards ............................................................................................5-11

5-7 Serverboard Details ...................................................................................... 5-12

X9DRG-HF/X9DRG-HTF Quick Reference .................................................. 5-13

5-8 Connector Defi nitions ................................................................................... 5-15

5-9 Jumper Settings ............................................................................................ 5-21

5-10 Onboard Indicators ........................................................................................ 5-23

vii

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

5-11 SATA Ports .................................................................................................... 5-24

5-12 Installing Software ......................................................................................... 5-25

Supero Doctor III ........................................................................................... 5-26

Chapter 6 Advanced Chassis Setup

6-1 Static-Sensitive Devices .................................................................................. 6-1

Precautions ..................................................................................................... 6-1

6-2 Control Panel .................................................................................................. 6-2

6-3 System Cooling ............................................................................................... 6-2

System Fan Failure ......................................................................................... 6-3

Installing the Air Shroud .................................................................................. 6-4

Installing Graphics (GPU) Cards..................................................................... 6-5

6-4 Drive Bay Installation/Removal ....................................................................... 6-7

Accessing the Drive Bays ............................................................................... 6-7

Hard Drive Installation ..................................................................................... 6-7

6-5 Power Supply .................................................................................................. 6-8

Chapter 7 BIOS

7-1 Introduction ...................................................................................................... 7-1

Starting BIOS Setup Utility .............................................................................. 7-1

How To Change the Confi guration Data ......................................................... 7-2

Starting the Setup Utility ................................................................................. 7-2

7-2 Main Setup ...................................................................................................... 7-2

7-3 Advanced Setup Confi gurations...................................................................... 7-4

7-4 Event Logs .................................................................................................... 7-25

7-5 IPMI ............................................................................................................... 7-27

7-6 Boot ............................................................................................................... 7-29

7-7 Security ......................................................................................................... 7-30

7-8 Save & Exit ................................................................................................... 7-31

Appendix A BIOS POST Error Codes
Appendix B System Specifi cations

viii

Chapter 1: Introduction

Chapter 1

Introduction

1-1 Overview

The SuperServer 1027GR-TRF/1027GR-TRFT series is a GPU-optimized server

comprised of two main subsystems: the SC118GQ-R1800B 1U server chassis and

the X9DRG-HF/X9DRG-HTF serverboard. Please refer to our web site for informa-

tion on operating systems that have been certifi ed for use with the system (www.

supermicro.com).

• Two 4-cm counter-rotating fans (FAN-0117L4)

• Eight 4-cm counter-rotating fans (FAN-0102L4)

• One air shroud (MCP-310-11802-0N)

• One 1U NVIDIA® Kepler™ side bracket (MCP-240-00117-0N)

• Two passive CPU heatsinks (one each of SNK-P0047PS and SNK-P0047PSC)

• Riser Cards

One RSC-R1UG-E16A-X9 for PCI-Express 3.0 x16 card. left front side

One RSC-R1UG-E16B-X9 for PCI-Express 3.0 x16 card, left rear side

One RSC-R1UG-E16AR-X9 for PCI-Express 3.0 x16 card, right front side

One RSC-R1UG-E16R-X9 for PCI-Express 3.0 x8 low-profi le card, above

serverboard

• Three power cables for GPU cards (CBL-0333L)

• SATA Accessories

One SAS backplane (BPN-SAS-118G-4)

Four hot-swap drive carriers (MCP-220-00047-0B)

Four SATA cables (CBL-0207L, CBL-0227L, 2 pcs. of CBL-0228L)

One SGPIO cable (CBL-0157L)

• One rail set (MCP-290-00054-0N)

• One Super Server 1027GR-TRF/1027GR-TRFT User's Manual

1-1

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

1-2 Serverboard Features

At the heart of the SuperServer 1027GR-TRF/1027GR-TRFT server is the X9DRG-

HF/X9DRG-HTF, a dual processor serverboard based on the Intel C602 chipset.

Below are the main features of the X9DRG-HF/X9DRG-HTF. (See Figure 1-1 for a

block diagram of the chipset).

Processors

The X9DRG-HF/X9DRG-HTF supports two Intel Xeon E5-2600 series processors in

LGA 2011 sockets (Socket R). Please refer to the serverboard description pages on

our web site for a complete listing of supported processors (www.supermicro.com).

Memory

The X9DRG-HF/X9DRG-HTF has eight DIMM slots that can support up to 256 GB

of registered ECC DDR3-1600/1333/1066/800 MHz RDIMMs. Modules of the same

size and speed are recommended. See Chapter 5 for details.

Serial ATA

A SATA controller is integrated into the chipset to provide a 4-port SATA subsystem,

which is RAID 0, 1, 5 and 10 supported. Two of these are SATA 3.0 ports and two

are SATA 2.0 ports. The SATA drives are hot-swappable units.

Note: The operating system you use must have RAID support to enable the hot-

swap capability and RAID function of the SATA drives.

PCI Expansion Slots

The X9DRG-HF/X9DRG-HTF has three PCI-Express 3.0 x16 slots to support

three double-width GPU cards. Additional slots support one PCI-Express 3.0 x8

low-profi le card.

Onboard Controllers/Ports

The color-coded I/O ports include one COM port (an additional COM header is lo-

cated on the serverboard), a VGA (monitor) port, two USB 2.0 ports, two Gb Ethernet

LAN ports (two 10 Gb ports on the X9DRG-HTF) and one dedicated IPMI LAN port.

IPMI

IPMI (Intelligent Platform Management Interface) is a hardware-level interface speci-

fi cation that provides remote access, monitoring and administration for Supermicro

1-2

Chapter 1: Introduction

server platforms. IPMI allows server administrators to view a server’s hardware

status remotely, receive an alarm automatically if a failure occurs, and power cycle

a system that is non-responsive.

1-3 Server Chassis Features

System Power

The SC118GQ-R1800B features a high-effi ciency, redundant 1800W power supply

composed of two separate power modules. This power redundancy feature allows

you to replace a failed power supply without shutting down the system. See Chapter

6 for details.

SATA Subsystem

The SC118GQ-R1800B chassis includes four 2.5" drive bays, which may be used

to house hot-swappable SATA drives. RAID 0, 1, 5 and 10 are supported.

Front Control Panel

The control panel provides a system monitoring and control interface. LEDs indicate

system power, HDD activity, network activity, and a system overheat/fan fail/ UID

LED. A main power button and a system reset button are also included.

Cooling System

The SC118GQ-R1800B has an innovative cooling design that includes ten 4-cm

counter-rotating PWM (Pulse Width Modulated) fans. The power supply modules

also include a cooling fan. All chassis and power supply fans operate continuously.

An air shrouds is included to further help cool the GPUs. See note on the following

page regarding fan control.

1-3

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

1-4 GPU Subsystem

The 1027GR-TRF/1027GR-TRFT server represents one of Supermicro's massively

parallel processing multiple-GPU servers, with support for up to three NVIDIA®

Fermi™ or Kepler™ GPUs, which place this system at the forefront of today's GPU

computing solutions.

Please refer to the NVIDIA web site (www.nvidia.com) for details on Fermi GPUs.

Notes

The GPUs can be bundled with the system as follows:

1027GR-TRF/1027GR-TRFT-FM309: includes three NVIDIA Fermi M2090 GPUs.

1027GR-TRF/1027GR-TRFT-FM375: includes three NVIDIA Fermi M2075 GPUs

NVIDIA® Kepler™ GPUs (requires their own mounting brackets for installation: p/n

MCP-240-00117-0N)

1-4

Chapter 1: Introduction

Figure 1-1. Intel C602 Chipset:

System Block Diagram

Note: This is a general block diagram. Please see Chapter 5 for details.

Dedicated LAN

VGA Port

#0-4

#0-3

#0-2

#0-1

DDR3

800/1066/1333/1600

PCI-E X16 G3

PCI-E X16 G3

PCI-E X16

SLOT 2

PCI-E X16

SLOT 1

SLOT 5

PCI-E X4 Gen2

PCI-E X4

SLOT 6

BMC

WPCM450

VGA

Internal

COM Port

Header

2 in Rear
Panel

CPU1 CPU2

E5-2600 Series
8 SNB CORE
DDR3

#2 #3 #1 #1 #2 #3

PCI-E X8 G3

PCI-E X8

LANE1/2/3/4

PCI

PCI
LANE5

LANE6

USB 2.0

USB

#0~#1

SPI

DMI2

DMI2

P0

P1

DMI2
4GB/s

PCH

C602

QPI

8G

QPI

8G

I350/X540

SAS/SATA

Ports #0~3

SATA
Ports #0~5

P1

E5-2600 Series
8 SNB CORE
DDR3

P0

PCI-E X16 G3

PCI-E X8 G3

LAN

3.0 Gb/S

SATA2

3.0 Gb/S

SATA3

6.0 Gb/S

PCI-E X16 G3

SATA2/

SAS1

#0~#1

DMI2

#6~#9

I-SATA

PCI-E X16

S-SATA2

#2~#5

#1-4

#1-3

#1-2

#1-1

800/1066/1333/1600

DDR3

SLOT 4

PCI-E X16

SLOT 3

I-SATA

1-5

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

1-5 Contacting Supermicro

Headquarters

Address: Super Micro Computer, Inc.

980 Rock Ave.

San Jose, CA 95131 U.S.A.

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

Web Site: www.supermicro.com

Europe

Address: Super Micro Computer B.V.

Het Sterrenbeeld 28, 5215 ML

's-Hertogenbosch, The Netherlands

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

[e-mail] (Customer Support)

Asia-Pacifi c

Address: Super Micro Computer, Inc.

4F, No. 232-1, Liancheng Rd.

Chung-Ho Dist., New Taipei City 235

Taiwan

Tel: [phone]

Fax: [phone]

Web Site: www.supermicro.com.tw

Technical Support:

Email: [e-mail]

Tel: [phone], ext.132 or 139

1-6

Chapter 2: Server Installation

Chapter 2

Server Installation

2-1 Overview

This chapter provides a quick setup checklist to get your system up and running.

Following these steps in the order given should enable you to have the system

operational within a minimum amount of time. This quick setup assumes that your

system has come to you with the processors and memory preinstalled. If your sys-

tem is not already fully integrated with a serverboard, processors, system memory

etc., please turn to the chapter or section noted in each step for details on installing

specifi c components.

2-2 Unpacking the System

You should inspect the box the system was shipped in and note if it was damaged

in any way. If the server itself shows damage you should fi le a damage claim with

the carrier who delivered it.

Decide on a suitable location for the rack unit that will hold the server. It should

be situated in a clean, dust-free area that is well ventilated. Avoid areas where

heat, electrical noise and electromagnetic fi elds are generated. You will also need

it placed near a grounded power outlet. Read the Rack and Server Precautions in

the next section.

2-3 Preparing for Setup

The box the server was shipped in should include two sets of rail assemblies, two

rail mounting brackets and the mounting screws you will need to install the system

into the rack. Follow the steps in the order given to complete the installation process

in a minimum amount of time. Please read this section in its entirety before you

begin the installation procedure outlined in the sections that follow.

Choosing a Setup Location

• Leave enough clearance in front of the rack to enable you to open the front door

completely (~25 inches) and approximately 30 inches of clearance in the back

of the rack to allow for suffi cient airfl ow and ease in servicing.This product is for

installation only in a Restricted Access Location (dedicated equipment rooms,

service closets and the like).

2-1

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

!

!

• This product is not suitable for use with visual display work place devices

acccording to §2 of the the German Ordinance for Work with Visual Display

Units.

Warnings and Precautions!

Rack Precautions

• Ensure that the leveling jacks on the bottom of the rack are fully extended to

the fl oor with the full weight of the rack resting on them.

• In single rack installation, stabilizers should be attached to the rack. In multiple

rack installations, the racks should be coupled together.

• Always make sure the rack is stable before extending a component from the

rack.

• You should extend only one component at a time - extending two or more si-

multaneously may cause the rack to become unstable.

• Rack-mounted equipment should not be used as a shelf or work space.

Server Precautions

• Review the electrical and general safety precautions in Chapter 4.

• Determine the placement of each component in the rack before you install the

rails.

• Install the heaviest server components on the bottom of the rack fi rst, and then

work up.

• Use a regulating uninterruptible power supply (UPS) to protect the server from

power surges, voltage spikes and to keep your system operating in case of a

power failure.

• Allow the hot plug SATA drives and power supply modules to cool before touch-

ing them.

2-2

Chapter 2: Server Installation

• Always keep the rack's front door and all panels and components on the servers

closed when not servicing to maintain proper cooling.

Rack Mounting Considerations

Ambient Operating Temperature

If installed in a closed or multi-unit rack assembly, the ambient operating tempera-

ture of the rack environment may be greater than the ambient temperature of the

room. Therefore, consideration should be given to installing the equipment in an

environment compatible with the manufacturer’s maximum rated ambient tempera-

ture (Tmra).

Reduced Airfl ow

Equipment should be mounted into a rack so that the amount of airfl ow required

for safe operation is not compromised.

Mechanical Loading

Equipment should be mounted into a rack so that a hazardous condition does not

arise due to uneven mechanical loading.

Circuit Overloading

Consideration should be given to the connection of the equipment to the power

supply circuitry and the effect that any possible overloading of circuits might have

on overcurrent protection and power supply wiring. Appropriate consideration of

equipment nameplate ratings should be used when addressing this concern.

Reliable Ground

A reliable ground must be maintained at all times. To ensure this, the rack itself

should be grounded. Particular attention should be given to power supply connec-

tions other than the direct connections to the branch circuit (i.e. the use of power

strips, etc.).

2-3

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

2-4 Installing the System into a Rack

This section provides information on installing the SC118GQ chassis into a rack

unit with the rails provided. There are a variety of rack units on the market, which

may mean that the assembly procedure will differ slightly. You should also refer to

the installation instructions that came with the rack unit you are using.

Note: This rail will fi t a rack between 26" and 33.5" deep.

Identifying the Sections of the Rack Rails

The chassis package includes two rack rail assemblies in the rack mounting kit.

Each assembly consists of two sections: an inner fi xed chassis rail that secures

directly to the server chassis and an outer fi xed rack rail that secures directly to

the rack itself.

Figure 2-1. Identifying the Sections of the Rack Rails

Inner Rail (preattached

to the chassis)

Inner Rail

Extension:

attach to the

chassis

Outer Rails:

slide together, then

attach to the front

and rear brackets

Front and Rear

Brackets: attach to

the rack

2-4

Chapter 2: Server Installation

Installing the Inner Rail Extensions

The SC118GQ chassis includes a set of inner rack rails in two sections: inner rails

(A) and inner rail extensions (B). The inner rails are preattached and do not interfere

with normal use of the chassis if you decide not to install to a server rack. Attaching

the inner rail extensions to to the inner rails stabilizes the chassis within the rack.

Installing the Inner Rail Extensions

1. Place the inner rail extensions (B) over the preattached inner rails (A) which

are attached to the side of the chassis. Align the hooks of the inner rail with

the rail extension holes. Make sure the extension faces "outward" just like the

inner rail.

2. Slide the extension toward the front of the chassis.

3. Secure the chassis with screws as illustrated.

4. Repeat steps 1-3 for the other inner rail extension.

Figure 2-2. Installing the Inner Rails

2-5

1

1

2

1

3

1

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Assembling the Outer Rails

Each outer rail is in two sections that must be assembled before mounting on to

the rack.

Assembling the Outer Rails

1. Identify the left and right outer rails by examining the ends, which bend

outward.

2. Slide the front section of the outer rail (A), into the rear section of the outer

rail (B).

Figure 2-3. Assembling the Outer Rails

Secure to the

front of the rack

Slide outer rails

together

Assembling the sections of

A

1

the outer rail

B

1

Secure to the

rear of the rack

Outer rail assembled

2-6

Chapter 2: Server Installation

Installing the Outer Rails onto the Rack

Outer Rail Installation

1. Adjust the outer rails to the proper length so that the outer rail fi ts snugly

within the rack.

2. Align the holes on the front of the outer rail, with the holes on the front of the

rack (C) and secure with the screws provided.

3. Align the holes on the rear of the outer rail to the holes on the rack (D) and

secure with the screws provided.

4. Repeat the procedure with the second outer rail assembly.

Figure 2-4. Installing the Outer Rails to the Rack

C

1

D

1

2-7

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Installing and Removing the Chassis From a Rack

Installation into a Rack

1. Slide the inner rail extensions into the front of the outer rails.

2. Push the chassis backward into the rack until it clicks into the locked postion.

Removing the Chassis From a Rack

1. Press the outer rail latch to release the chassis.

2. Carefully slide the chassis forward, off the outer rails and out of the chassis.

Figure 2-5. Chassis Installation Figure 2-6. Chassis Removal

Outer Rail

Latch

2-8

Chapter 2: Server Installation

Installing the Server into a Telco Rack

Optional brackets are needed to install the server to a telco (open type) rack.

To install the server into a Telco type rack, use the two L-shaped brackets on either

side of the chassis (four total). First, determine how far follow the server will extend

out the front of the rack. Larger chassis should be positioned to balance the weight

between front and back. If a bezel is included on your server, remove it. Then at-

tach the two front brackets to each side of the chassis, then the two rear brackets

positioned with just enough space to accommodate the width of the telco rack. Finish

by sliding the chassis into the rack and tightening the brackets to the rack.

Figure 2-7. Installing the Server into a Telco Rack

2-9

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Notes

2-10

Chapter 3: System Interface

Chapter 3

System Interface

3-1 Overview

There are several LEDs on the control panel as well as others on the drive carri-

ers to keep you constantly informed of the overall status of the system as well as

the activity and health of specifi c components. There are also two buttons on the

chassis control panel. This chapter explains the meanings of all LED indicators and

the appropriate response you may need to take.

3-2 Control Panel Buttons

There are two push-buttons located on the front of the chassis: a reset button and

a power on/off button.

Reset

Use the reset button to reboot the system.

Power

The main power button is used to apply or remove power from the power supply

to the server system. Turning off system power with this button removes the main

power but keeps standby power supplied to the system.

3-1

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

3-3 Control Panel LEDs

The two control panels are located on the front of the SC118GQ chassis. Each

control panel has six LEDs. These LEDs provide critical information related to dif-

ferent parts of the system. This section explains what each LED indicates when

illuminated and any action that may be required..

Overheat/Fan Fail/UID LED

When this LED fl ashes it indicates a fan failure. When continuously on (not fl ash-

ing) it indicates an overheat condition, which may be caused by cables obstructing

the airfl ow in the system or the ambient room temperature being too warm. Check

the routing of the cables and make sure that all fans are present and operating

normally. Also check to make sure that the air shrouds are installed and that the

top cover is on. Finally, verify that the heatsinks are installed properly. This LED

will remain fl ashing or on as long as the overheat condition exists. When used with

a UID-compatible motherboard, the UID function is used to turn on or off the blue

light function of the the LED. Once the blue light is activated through the system

software, the unit can be easily located in very large racks and server banks.

2

NIC2

Indicates network activity on GLAN2 when fl ashing .

1

NIC1

Indicates network activity on GLAN1 when fl ashing .

3-2

Chapter 3: System Interface

HDD

This light indicates SATA and/or peripheral drive activity when fl ashing.

Power

Indicates power is being supplied to the system's power supply units. This LED

should normally be illuminated when the system is operating.

3-4 Drive Carrier LEDs

• Green: Each hard drive carrier (for use with SATA drives) has a green LED.

When illuminated, this green LED (on the front of the SATA drive carrier) indi-

cates drive activity. A connection to the backplane enables this LED to blink on

and off when that particular drive is being accessed. Please refer to Chapter 6

for instructions on replacing failed SATA drives.

• Red: The red LED to indicate a SATA drive failure. If one of the SATA drives

fail, you should be notifi ed by your system management software. Please refer

to Chapter 6 for instructions on replacing failed SATA drives.

3-3

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Notes

3-4

Chapter 4: System Safety

!

Chapter 4

System Safety

4-1 Electrical Safety Precautions

Note: power should always be disconnected before performing any service

on the system.

Basic electrical safety precautions shall be followed to protect yourself from harm

and the server from damage:

• Be aware of the locations of the power on/off switch on the chassis as well

as the room's emergency power-off switch, disconnection switch or electrical

outlet. If an electrical accident occurs, you can then quickly remove power from

the system.

• Do not work alone when working with high voltage components.

• Power should always be disconnected from the system when removing or in-

stalling main system components, such as the serverboard, memory modules

and fl oppy drive. When disconnecting power, you should fi rst power down the

system with the operating system fi rst and then unplug the power cords of all

the power supply units in the system.

• When working around exposed electrical circuits, another person who is familiar

with the power-off controls should be nearby to switch off the power if neces-

sary.

• Use only one hand when working with powered-on electrical equipment. This

is to avoid making a complete circuit, which will cause electrical shock. Use

extreme caution when using metal tools, which can easily damage any electrical

components or circuit boards they come into contact with.

• Do not use mats designed to decrease static electrical discharge as protection

from electrical shock. Instead, use rubber mats that have been specifi cally

designed as electrical insulators.

• The power supply power cords must include a grounding plug and must be

plugged into grounded electrical outlets.

4-1

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

!

• This product may be connected to an IT power system. In all cases, make sure

that the unit is also reliably connected to Earth (ground).

• Serverboard Battery: CAUTION - There is a danger of explosion if the onboard

battery is installed upside down, which will reverse its polarites (see Figure 4-1).

This battery must be replaced only with the same or an equivalent type recom-

mended by the manufacturer (CR2032). Dispose of used batteries according to

the manufacturer's instructions.

• DVD-ROM Laser: CAUTION - this server may have come equipped with a

DVD-ROM drive. To prevent direct exposure to the laser beam and hazardous

radiation exposure, do not open the enclosure or use the unit in any uncon-

ventional way.

• Mainboard replaceable soldered-in fuses: Self-resetting PTC (Positive Tempera-

ture Coeffi cient) fuses on the mainboard must be replaced by trained service

technicians only. The new fuse must be the same or equivalent as the one

replaced. Contact technical support for details and support.

4-2 General Safety Precautions

Follow these rules to ensure general safety:

• Keep the area around the server clean and free of clutter.

• The server weighs approximately 37 lbs. (16.8 kg) when fully loaded. When lifting

the system, two people at either end should lift slowly with their feet spread out

to distribute the weight. Always keep your back straight and lift with your legs.

• Place the chassis top cover and any system components that have been re-

moved away from the system or on a table so that they won't accidentally be

stepped on.

• While working on the system, do not wear loose clothing such as neckties and

unbuttoned shirt sleeves, which can come into contact with electrical circuits or

be pulled into a cooling fan.

4-2

Chapter 4: System Safety

!

• Remove any jewelry or metal objects from your body, which are excellent metal

conductors that can create short circuits and harm you if they come into contact

with printed circuit boards or areas where power is present.

• After accessing the inside of the system, close the system back up and secure

it to the rack unit with the retention screws after ensuring that all connections

have been made.

4-3 ESD Precautions

Electrostatic Discharge (ESD) is generated by two objects with different electrical

charges coming into contact with each other. An electrical discharge is created to

neutralize this difference, which can damage electronic com ponents and printed

circuit boards. The following measures are generally suffi cient to neutralize this

difference before contact is made to protect your equipment from ESD:

• Use a grounded wrist strap designed to prevent static discharge.

• Keep all components and printed circuit boards (PCBs) in their antistatic bags

until ready for use.

• Touch a grounded metal object before removing the board from the antistatic

bag.

• Do not let components or PCBs come into contact with your clothing, which may

retain a charge even if you are wearing a wrist strap.

• Handle a board by its edges only; do not touch its components, peripheral chips,

memory modules or contacts.

• When handling chips or modules, avoid touching their pins.

• Put the serverboard and peripherals back into their antistatic bags when not

in use.

• For grounding purposes, make sure your computer chassis provides excellent

conductivity between the power supply, the case, the mounting fasteners and

the serverboard.

4-3

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

!

!

4-4 Operating Precautions

Care must be taken to assure that the chassis cover is in place when the system

is operating to ensure proper cooling. Out of warranty damage to the system can

occur if this practice is not strictly followed.

Figure 4-1. Installing the Onboard Battery

TUM TTER

TTER OER

Please handle used batteries carefully. Do not damage the battery in any way; a

damaged battery may release hazardous materials into the environment. Do not

discard a used battery in the garbage or a public landfi ll. Please comply with the

regulations set up by your local hazardous waste management agency to dispose

of your used battery properly.

4-4

Chapter 5: Advanced Serverboard Setup

Chapter 5

Advanced Serverboard Setup

This chapter covers the steps required to install the X9DRG-HF/X9DRG-HTF

serverboard into the chassis, connect the data and power cables and install add-on

cards. All serverboard jumpers and connections are also described. A layout and

quick reference chart are included in this chapter for your reference. Remember to

completely close the chassis when you have fi nished working with the serverboard

to better cool and protect the system.

5-1 Handling the Serverboard

Electrostatic Discharge (ESD) can damage electronic com ponents. To prevent dam-

age to any printed circuit boards (PCBs), it is important to handle them very carefully

(see previous chapter). To prevent the serverboard from bending, keep one hand

under the center of the board to support it when handling. The following measures

are generally suffi cient to protect your equipment from electric static discharge.

Precautions

• Use a grounded wrist strap designed to prevent Electrostatic Discharge

(ESD).

• Touch a grounded metal object before removing any board from its antistatic

bag.

• Handle a board by its edges only; do not touch its components, peripheral chips,

memory modules or gold contacts.

• When handling chips or modules, avoid touching their pins.

• Put the serverboard, add-on cards and peripherals back into their antistatic

bags when not in use.

• For grounding purposes, make sure your computer chassis provides excellent

conductivity between the power supply, the case, the mounting fasteners and

the serverboard.

5-1

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Unpacking

The serverboard is shipped in antistatic packaging to avoid electrical static dis-

charge. When unpacking the board, make sure the person handling it is static

protected.

5-2 Serverboard Installation

This section explains the fi rst step of physically mounting the X9DRG-HF/X9DRG-

HTF into the SC118GQ chassis. Following the steps in the order given will eliminate

the most common problems encountered in such an installation. To remove the

serverboard, follow the procedure in reverse order.

Installing to the Chassis

1. Access the inside of the system by removing the screws from the back lip of

the top cover of the chassis, then pull the cover off.

2. Make sure that the I/O ports on the serverboard align properly with their

respective holes in the I/O shield at the back of the chassis.

3. Carefully mount the serverboard to the serverboard tray by aligning the board

holes with the raised metal standoffs that are visible in the chassis.

4. Insert screws into all the mounting holes on your serverboard that line up

with the standoffs and tighten until snug (if you screw them in too tight, you

might strip the threads). Metal screws provide an electrical contact to the

serverboard ground to provide a continuous ground for the system.

5. Install the processors and make all necessary cable connections, as de-

scribed in the sections that follow.

Warning: To avoid damaging the serverboard and its components, do not apply

any force greater than 8 lbs. per square inch when installing a screw into a mount-

ing hole.

5-2

Chapter 5: Advanced Serverboard Setup

5-3 Connecting Cables

Now that the serverboard is installed, the next step is to connect the cables to the

board. These include the data (ribbon) cables for the peripherals and control panel

and the power cables.

Connecting Data Cables

The ribbon cables used to transfer data from the peripheral devices have been care-

fully routed to prevent them from blocking the fl ow of cooling air that moves through

the system from front to back. If you need to disconnect any of these cables, you

should take care to keep them routed as they were originally after reconnecting

them (make sure the red wires connect to the pin 1 locations). The following data

cables (with their locations noted) should be connected. (See the layout on page

5-12 for connector locations.)

• SATA drive data cables (I-SATA0 ~ 3)

• SATA sideband cable (T-SGPIO ~ 1)

• Control Panel cable (JF1)

• GPU power cables (JPW3, JPW7 and JPW11)

• SATA backplane power cable (JPW5)

Important! Make sure the the cables do not come into contact with the fans.

Connecting Power Cables

The X9DRG-HF/X9DRG-HTF has three proprietary power supply connectors

(JPW1, JPW2 and JPW9) for connection to the ATX power supply. See Section 5-9

for power connector pin defi nitions.

Connecting the Control Panel

JF1 contains header pins for various front control panel connectors. See Figure 5-1

for the pin locations of the various front control panel buttons and LED indicators.

All JF1 wires have been bundled into a single ribbon cable to simplify this connec-

tion. Make sure the red wire plugs into pin 1 as marked on the board. The other

end connects to the Control Panel PCB board, located just behind the system status

LEDs on the chassis. See Chapter 5 for details and pin descriptions.

5-3

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Figure 5-1. Control Panel Header Pins

20 19

Ground

NMI

x (Key)

Power On LED

HDD LED

NIC1 LED (Link)

NIC2 LED (Link)

OH/Fan Fail/PWR Fail/UID LED

PWR Fail LED

Ground

Ground

2 1

x (Key)

3.3V

FP UID/3.3V Stby

NIC1 LED (Activity)

NIC2 LED (Activity)

Blue LED (UID Cathode)

3.3V

Reset (Button)

Power (Button)

5-4 I/O Ports

The I/O ports are color coded in conformance with the PC 99 specifi cation. See

Figure 5-2 below for the colors and locations of the various I/O ports.

Figure 5-2. I/O Ports

1

3

1

2

4

1

5

1

6

1

IO Ports

1. USB Port 0 5. LAN Port 2

2. USB Port 1 6. VGA Port

3. IPMI Dedicated LAN 7. UID Switch

4. LAN Port 1

1

7

5-4

Chapter 5: Advanced Serverboard Setup

!

OPEN 1st

WARNING!

OPEN 1st

WARNING!

5-5 Installing the Processor and Heatsink

Avoid placing direct pressure to the top of the processor package. Always

remove the power cord fi rst before adding, removing or changing any

hardware components.

Notes:

• Always connect the power cord last and always remove it before adding, re-

moving or changing any hardware components. Make sure that you install the

processor into the CPU socket before you install the CPU heatsink.

• If you buy a CPU separately, make sure that you use an Intel-certifi ed multi-

directional heatsink only.

• Make sure to install the serverboard into the chassis before you install the CPU

heatsinks.

• When receiving a serverboard without a processor pre-installed, make sure that

the plastic CPU socket cap is in place and none of the socket pins are bent;

otherwise, contact your retailer immediately.

• Refer to the Supermicro web site for updates on CPU support.

Installing an LGA 2011 Processor

Follow the procedure below, beginning

with the CPU1 socket.

1. There are two levers on the LGA

2011 socket. First press and re-

lease the load lever labeled 'Open

1st'.

2. Press the second load lever

labeled 'Close 1st' to release the

load plate from its locked position.

Press down on

Pull lever away
from the socket

the lever labeled

'Close 1st'

WARNING!

OPEN 1st

WARNING!

OPEN 1st

5-5

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

WARNING!

OPEN

1st

WARNING!

3. With the lever labeled 'Close 1st'

fully retracted, gently push down

on the 'Open 1st' lever to open the

load plate. Lift the load plate to

open it completely.

4. Using your thumb and the index

fi nger, remove the 'WARNING'

plastic cap from the socket.

5. Use your thumb and index fi nger

to hold the CPU by its edges. Align

the CPU keys, which are semi-

circle cutouts, against the socket

keys.

6. Once they are aligned, carefully

lower the CPU straight down into

the socket. (Do not drop the CPU

on the socket. Do not move the

CPU horizontally or vertically and

do not rub the CPU against any

pins of the socket, which may

damage the CPU or the socket.)

WARNING!

OPEN 1st

Gently push
down to pop
the load plate
open.

WARNING!

Socket Keys

CPU Keys

5-6

Warning: You can only install the CPU to the socket in one direction. Make

!

OPEN 1st

OPEN 1st

sure that the CPU is properly inserted into the socket before closing the

load plate. If it doesn't close properly, do not force it as it may damage

your CPU. Instead, open the load plate again and double-check that the

CPU is aligned properly.

7. With the CPU in the socket, in-

spect the four corners of the CPU

to make sure that they are fl ush

with the socket.

8. Close the load plate. Lock the

lever labeled 'Close 1st', then lock

the lever labeled 'Open 1st'. Use

your thumb to gently push the

load levers down until the lever

locks.

9. Repeat the procedure to install

a second processor in the CPU2

socket if desired.

Chapter 5: Advanced Serverboard Setup

Gently close

the load plate.

Push down and lock the

level labeled 'Close 1st'.

Note: the PCI-E slots are controlled by

the presence of a CPU. Slots will not

be functional if the CPU that controls

them is not installed. See Section 5-7

for details.

OPEN 1st

Lever Lock

OPEN 1st

Push down

and lock the

lever labeled

'Open 1st'.

5-7

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Installing a CPU Heatsink

1. Remove power from the system

and unplug the AC power cord

from the power supply.

2. Do not apply any thermal grease

to the heatsink or the CPU die;

the required amount has already

been applied.

3. Place the heatsink on top of the

CPU so that the four mounting

holes are aligned with those on

the (preinstalled) heatsink reten-

tion mechanism.

4. Screw in two diagonal screws until

just snug. Do not fully tighten the

screws or you may damage the

CPU.)

5. Add the two remaining screws

then fi nish the installation by fully

tightening all four screws.

Removing the Heatsink

SNK-P0047PS (CPU1)

SNK-P0047PSC (CPU2)

1. Unscrew and remove the heatsink screws from the serverboard in the sequence

as show in the picture above.

2. Hold the heatsink and gently wriggle the heatsink to loosen it from the CPU. (Do

not use excessive force when wriggling the heatsink!!)

3. Once the heatsink is loose, remove it from the CPU socket.

4. Clean the surface of the CPU and the heatsink to get rid of the old thermal

grease. Reapply the proper amount of thermal grease on the surface before you

re-install a heatsink.

Note: see Chapter 6 for details on installing the air shroud.

5-8

Chapter 5: Advanced Serverboard Setup

!

5-6 Installing Memory

CAUTION! Exercise extreme care when installing or removing DIMM

modules to prevent any possible damage.

Memory Support

The X9DRG-HF/X9DRG-HTF supports up to 256 GB of registered ECC DDR3-

1600/1333/1066/800 MHz RDIMMs in 8 DIMM slots. See the following tables for

memory installation.

Notes: Memory speed support is dependent on the type of CPU used on the board.

Installing Memory Modules

1. Insert the desired number of DIMMs into the memory slots, starting with

P1-DIMM 1A. For best memory performance, please install memory modules

of the same type and same speed on the memory slots as indicated on the

tables below.

2. Insert each DIMM module vertically into its slot. Pay attention to the notch

along the bottom of the module to avoid installing incorrectly (see Figure 5-4).

3. Gently press down on the DIMM module until it snaps into place in the slot.

Repeat for all modules.

Figure 5-3. DIMM Installation

Notch

To In st al l : Insert module

vertically and press
down until it snaps into
place. Pay attention to
the alignment notch at
the bottom.

To Remove:

Use your thumbs to
gently push the release
tabs near both ends of
the module. This should
release it from the slot.

Release Tab

Note: Notch should align
with the receptive key
point on the slot.

Front View

Notch

Release Tab

Top View of DDR3 Slot

5-9

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Processor/DIMM Population Confi gurations

For memory to work properly, follow the tables below for memory installation.

• For memory to operate properly, please install DIMMs in pairs (have an even

number of DIMMs installed).

• All channels in a system will run at the fastest common frequency.

Processors and their Corresponding

DIMMs

CPU# Corresponding DIMM Modules
CPU 1 P1-A1 P1-B1 P1-C1 P1-D1
CPU2 P2-E1 P2-F1 P2-G1 P2-H1

Populating DIMMs

Number of

CPUs+DIMMs

1 CPU &
2 DIMMs

1 CPU &
4 DIMMs

2 CPUs &

4 DIMMs

CPU1
P1-A1/P1-B1

CPU1
P1-A1/P1-B1, P1-C1/P1-D1

CPU1 + CPU2
P1-A1/P1-B1, P2-E1/P2-F1

CPU and DIMM Population Confi guration Table

(For memory to work proper, please install DIMMs in pairs)

2 CPUs &

6 DIMMs

2 CPUs &

8 DIMMs

CPU1 + CPU2
P1-A1/P1-B1/P1-C1/P1-D1, P2-E1/P2-F1

CPU1 + CPU2
P1-A1/P1-B1/P1-C1/P1-D1, P2-E1/P2-F1/P2-G1/P2-H1

RDIMM Support POR

DIMM

Slots per

Channel

1 1 Reg. ECC DDR3 800/1066/1333/1600 SR, DR, or QR

2 1 Reg. ECC DDR3 800/1066/1333/1600 SR, DR, or QR

2 2 Reg. ECC DDR3 800/1066/1333/1600 Mixing SR, DR, QR

Population Rules:

1. Any combination of x4 and x8 RDIMMs with 1 Gb or 2 Gb DRAM density are supported.

2. Populate DIMMs starting with DIMM A1.

3. When mixing QR with SR or DR on the same DDR channel, put the QR in DIMMA1 fi rst.

DIMMs

Popu-

lated
per DDR
Channel

RDIMM Type

(RDIMM = Regis-

tered DIMMs)

POR Speeds (in MHz) Ranks per DIMM

(Any Combination)

5-10

Chapter 5: Advanced Serverboard Setup

5-6 Expansion Cards

In addition to offering support for three GPU cards, the 1027GR-TRF/1027GR-TRFT

supports one low-profi le PCI-Express 3.0 x8 expansion card (in x16 slot). A riser

card is required to support expansion cards.

Refer to Chapter 6 for instructions on installing an expansion card in the system..

5-11

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

5-7 Serverboard Details

Figure 5-5. X9DRG-HF/X9DRG-HTF Layout

SW1

S/IO
JWD1

JPCIE6

JPCIE5

CPU1 Slot1 PCI-E 3.0 x8

PCH Slot6 PCI-E 2.0 x4

(in x8)

(in x16)

JSD1

I-SATA0

S-SATA0

I-SATA1

S-SATA1

I-SATA2

S-SATA2

I-SATA3

S-SATA3

JPCIE1

I-SATA4

CPU1Slot1PCI-E 3.0 X16

I-SATA5

FAND

LE4

J30

JCOM1

J29

JBT1

JPB1

JI2C2
JI2C1

JVGA1

JPG1

BMC CTRL

DM1

DM2

BIOS

PCH

CLOSE 1st

JLAN2

CPU1

JLAN1

LAN CTRL

JPBR1

JPME1

JOH1
JSPK1

Battery

JWP1

USB/0/1

IPMI LAN

JPL1

PHY

JTPM1

JPW10

JRK1

P1-DIMMC

P1-DIMMD

Use SNK-P0047PS

FANC

P1-DIMMB

P1-DIMMA

JPCIE2

T-SGPIO5

T-SGPIO1

CPU1 Slot2

T-SGPIO2

PCI-E 3.0 X16

J21

JPW11

JPW8

JPW7

JF1

LE1

JPW6

JPW5

FANA

FANB

FAN3

FAN4

JL1

Notes

" " indicates the location of Pin 1.

OPEN 1st

P2-DIMMH

P2-DIMMG

CLOSE 1st

X9DRG-HF

Rev.

CPU2

CPU2

OPEN 1st

1.01

JPW1

P2-DIMMF

P2-DIMME

FANH

JPW9

FANG

JPCIE3

CPU2 Slot 3 PCI-E 3.0 X16

JPW2

JPW4

JPCIE4

CPU2 Slot4 PCI-E 3.0 X16

JPW3

FANF

FANE

FAN2

FAN1

Use SNK-P0047PSC

The X9DRG-HTF supports two X540-based 10G LAN ports, the X9DRG-HF sup-

ports two I350-based 1G LAN ports.

5-12

Chapter 5: Advanced Serverboard Setup

X9DRG-HF/X9DRG-HTF Quick Reference

Jumper Description Default Setting

JBT1 Clear CMOS See Section 5-9

JBR1 ME Recovery Pins 2-3 (Normal)

JPB1 BMC Enable/Disable Pins 1-2 (Enabled)

JPG1 VGA Enable/Disable Pins 1-2 (Enabled)

JPL1 LAN1/LAN2 Enable/Disable Pins 1-2 (Enabled)

JPME1 Manufacture Mode Pins 1-2 (Normal)

JWD Watch Dog Timer Enable/Disable Pins 1-2 (Reset)

JWP1 Write-Protect Enable/Disable Pins 1-2 (Enabled)

Connector Description

Battery Onboard Battery

FAN1 - FAN4 CPU Fans

FANA - FANH GPU Fans

JCOM1 COM Header for Front Chassis Access

JF1 Control Panel Header

JL1 Chassis Intrusion Header

JOH1 Overheat LED Indicator

2

JI

C1/JI2C2 Power Supply SMBbus I2C Header

JPW1 Proprietary 62-pin Power Connector

JPW2 Proprietary 20-pin Power Connector

JPW3-8, JPW11 12V 8-pin Power Connectors

JPW9 Proprietary 38-pin Power Connector

JPW10 5V 4-pin Power Connector

JSD1 Power Fail Header

JSPK1 Onboard Speaker Header

JTPM1 TPM (Trusted Platform Module)/Port 80 Header

JRK1 SATA RAID Key Header

JVGA1 Backpanel VGA Port

LAN1/LAN2

(IPMI) LAN IPMI Dedicated LAN

LAN Ports 1/2 (Gb LAN on X9DRG-HF, 10 Gb LAN on X9DRG­HTF)

5-13

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

I-SATA 0~5 SATA 3.0 (I-SATA 0/1) and SATA 2.0 Ports (I-SATA 2~5)

S-SATA 0~3 SATA 2.0 Ports (S-SATA 0~3)

PCI Slot 1/Slot 2 PCI-E 3.0 x16 Slots (Available when CPU1 is populated)

PCI Slot 5 PCI-E 3.0 x8 in x16 Slot (Available when CPU1 is populated)

PCI Slot 3/Slot 4 PCI-E 3.0 x16 Slots (Available when CPU2 is populated)

(PCH) PCI Slot 6 PCI-E 2.0 x4 in x8 Slot (Available when CPU2 is populated)

SW1 UID Switch

T-SGPIO 1/2/S Serial Link General Purpose I/O Headers

USB 0/1 Back Panel USB Ports

LED Description State/Status

DM1 BMC Heartbeat LED Green: BMC Normal

LE1 Standby PWR LED Green: SB Power On

LE4 UID Switch LED

Notes:

PCI-E Slot 1, Slot 2 and Slot 5 are controlled by CPU1 and are only available when a

processor is installed in CPU Socket 1. PCI-E Slot 3, Slot 4 and Slot 6 are controlled

by CPU2 and are available only when a processor is installed in CPU Socket 2.

To provide adequate power supply to the system, be sure to connect all onboard

power connectors to the power supply.

5-14

5-8 Connector Defi nitions

Chapter 5: Advanced Serverboard Setup

Power Connectors

Three SMC-proprietary power connectors

are located at JPW1, JPW2 and JPW9 to

provide main power to the serverboard.

Seven 12V, 8-pin power connectors, lo-

cated at JPW3-8 and JPW11, are used

for SATA devices and GPU cards (JPW5

is for the backplane). An additional 4-pin

auxilliary connector is located at JPW10.

Connect these power headers as de-

scribed below.

JPW1: 62-pin SMC-Proprietary (Required)

JPW2: 20-pin SMC-Proprietary (Required)

JPW9: 38-pin SMC-Proprietary (Required)

JPW5: 12V 8-pin for HDD backplane (Required)

12V 8-pin Power

Connector Pin Defi nitions

Pins Defi nition

1 through 3 +12V

4 through 8 Ground

5V 4-pin Power

Connector

Pin Defi nitions

Pins Defi nition

1 +12V

2-3 Ground

4 +5V

JPW3, 4, 6, 7, 8, 11: 12V 8-pin for GPU power

JPW10: 5V 4-pin Auxilliary

Power Button Connector

The PW_ON connector is on pins 1 and 2

of JF1. Momentarily contacting both pins

will power on/off the system. This button

can also be confi gured to function as a

suspend button (with a setting in the BIOS,

see Chapter 7). To turn off the power when

set to suspend mode, press the button for

at least 4 seconds. Refer to the table on

the right for pin defi nitions. This header

should be connected to the chassis power

button. See the table on the right for pin

defi nitions.

Power Button

Pin Defi nitions (JF1)

Pin# Defi nition

1 Power Button

2 Ground

5-15

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Reset Connector

The reset connector is located on pins 3

and 4 of JF1 and attaches to the reset

switch on the computer chassis. See the

table on the right for pin defi nitions.

Power Fail LED

The Power Fail LED connection is located

on pins 5 and 6 of JF1. Refer to the table

on the right for pin defi nitions.

Overheat/Fan Fail/UID LED

Connect an LED cable to pins 7 and 8 of

JF1 for the Overheat/Fan Fail and UID

LED connections. The red LED (pin 8)

provides warning of an overheat or fan

failure. The blue LED (pin 7) works as the

UID LED indicator for the front panel UID

but ton l ocate d on p ins 13~14 of J F1. W hen

Jumper J_UID_OW is set to off (default),

the red LED takes precedence over the

blue LED. Refer to the tables on the right

for more information.

Reset Button

Pin Defi nitions (JF1)

Pin# Defi nition

3 Reset

4 Ground

PWR Fail LED

Pin Defi nitions (JF1)

Pin# Defi nition

5 3.3V

6 PWR Fail LED

OH/Fan Fail/Blue_UID LED Pin

Defi nitions (JF1)

Pin# Defi nition

7 Blue_LED-Cathode(UID)/5.5V.SB

8 OH/Fan Fail/UID LED (Red)

OH/Fan Fail LED Status

(Red LED)

State Defi nition

Off Normal

On Overheat

Flashing Fan Fail

NIC2 (LAN2) LED

The LED connections for LAN2 are on pins

9 and 10 of JF1. Attach an LED cable to

display network activity. See the table on

the right for pin defi nitions.

NIC1 (LAN1) LED

The LED connections for LAN1 are on pins

11 and 12 of JF1. Attach an LED cable to

display network activity. See the table on

the right for pin defi nitions.

NIC2 LED

Pin Defi nitions (JF1)

Pin# Defi nition

9 Activity LED

10 Link LED

NIC1 LED

Pin Defi nitions (JF1)

Pin# Defi nition

11 Activity LED

12 Link LED

5-16

Chapter 5: Advanced Serverboard Setup

HDD/FP UID Button

The HDD/UID button connections are

located on pins 13/14 of JF1. Attach a

hard-drive LED cable to display HDD or

SATA activity. This connection can also be

used for the front panel UID (Unit Identi-

fi er) button. (The UID LED on pin 7 of JF1

works in conjunction with the UID button.)

When the user presses and releases the

UID button, the UID LED will be turned on

or off to indicate the location of the unit in

a stack or rackmounted servers.

Power On LED

The Power On LED connector is located

on pins 15 and 16 of JF1. This connection

is used to provide LED indication of power

being supplied to the system. See the table

on the right for pin defi nitions.

HDD/UID LED

Pin Defi nitions (JF1)

Pin# Defi nition

13 UID Signal/3.3V

14 HDD Activity

Power LED

Pin Defi nitions (JF1)

Pin# Defi nition

15 +3.3V

16 Control

Fan Headers

The X9DRG-HF/X9DRG-HTF has twelve

fan headers. Fans 1~4 are for CPU/system

use and Fans A~H for GPU use.. All are

4-pin fan headers, which are backward

compatible with traditional 3-pin fans.

However, fan speed control is available for

4-pin fans only. See the table on the right

for pin defi nitions.

Serial Ports

A COM Port (COM1) is located next to

the UID switch to provide serial port sup-

port. See the table on the right for pin

defi nitions.

Fan Header

Pin Defi nitions

Pin# Defi nition

1 Ground

2 +12V

3 Tachometer

4 Pulse Width Modulation

Serial Port Pin Defi nitions

Pin #Defi nition Pin # Defi nition

1 DCD 6 DSR

2 RXD 7 RTS

3 TXD 8 CTS

4 DTR 9 RI

5 Ground 10 NC

5-17

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

NMI Header

The non-maskable interrupt header is lo-

cated at JNMI1. Refer to the table on the

right for pin defi nitions.

Internal Buzzer

The Speaker header, located at JSPK1,

can be used to provide audible alarms for

various beep codes. See the table on the

right for pin defi nitions.

Chassis Intrusion

A Chassis Intrusion header is located at

JL1 on the serverboard. Attach an ap-

propriate cable from the chassis to inform

you of a chassis intrusion when the chassis

is opened.

NMI Button

Pin Defi nitions

Pin# Defi nition

1 Control

2 Ground

Internal Buzzer
Pin Defi nitions

Pin# Defi nitions

Pin 1 Pos. (+) 5V

Pin 2 Neg. (-) Alarm Speaker

Chassis Intrusion

Pin Defi nitions

Pin# Defi nition

1 Intrusion Input

2 Ground

T-SGPIO Headers

Three SGPIO (Serial-Link General Pur-

pose Input/Output) headers are provided

on the serverboard. These headers sup-

port serial link interfaces for the onboard

SATA ports. See the table on the right for

pin defi nitions.

RAIDKey Header

A RAIDKey header (JRK1) provides

RAID function support to enhance sys-

tem performance.

T-SGPIO

Pin Defi nitions

Pin# Defi nition Pin Defi nition

1NC 2NC

3 Ground 4 Data

5 Load 6 Ground

7 Clock 8 NC

NC = No Connection

RAIDKey

Pin Defi nitions

Pin# Defi nition

1 Ground

2 Signal

3 Ground

5-18

Chapter 5: Advanced Serverboard Setup

TPM Header/Port 80

A Trusted Platform Module/Port 80 header

is located at JTPM1 to provide TPM and

Port 80 support, which will enhance system

performance and data security. See the

table on the right for pin defi nitions.

TPM/Port 80 Header

Pin Defi nitions

Pin# Defi nition Pin # Defi nition

1 LCLK 2 GND

3 LFRAME# 4 <(KEY)>

5 LRESET# 6 NC

7 LAD 3 8 LAD 2

9 +3.3V 10 LAD1

11 LAD0 12 GND

13 NC 14 NC

15 +3V_DUAL 16 SERIRQ

17 GND 18 CLKRUN# (X)

19 LPCPD# 20 NC

Universal Serial Bus (USB)

Two Universal Serial Bus ports (USB0/1)

are located on the I/O backplane. Connect

USB devices to these ports.

Ethernet Ports

Two Ethernet ports are located next to the

USB 0/1 on the IO backplane. In addition,

an IPMI Dedicated LAN is located above

the USB ports 0/1. These ports accept

RJ45 type cables. Please refer to the LED

Indicator Section for LAN LED information

Note: The X9DRG-HF features two Gb

LAN ports while the X9DRG-HTF features

two 10 Gb LAN ports.

USB

Pin Defi nitions

Pin# Defi nition

1 +5V

2 PO-

3 PO+

4 Ground

5NA

LAN Ports

Pin Defi nition

Pin# Defi nition Pin# Defi nitions

1 TD0+ 11 TD3-

2 TD0- 12 PIV8_NIC

3 PIV8_NIC 13 ACT LED-

4 TD1+ 14 ACT LED+

5 TD1- 15 Link 100 LED

(Green)

6 PIV8_NIC 16 Link 1000 LED

(Yellow)

7 TD2+ 17 Ground

8 TD2- 18 Ground

9 PIV8_NIC 19 Ground

10 TD3+ 20 Ground

5-19

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Unit Identifi er Switch

A Unit Identifi er (UID) switch and two LED

indicators are provided on the serverboard.

The rear UID LED (LE4) is located next

to the rear UID switch. The front panel

UID LED is on pins 7/8 of JF1. Connect

a cable to pins 7/8 on JF1 for front panel

UID indication. Pressing the UID switch will

turn on both the rear and front UID LEDs.

Pressing the UID switch again will turn

off both LEDs. These UIDs provide easy

identifi cation of a system unit that may be

in need of service.

Note: the UID can also be triggered via

IPMI. Please refer to the IPMI User's Guide

posted on our Website.

Color/State OS Status

Blue:
On

Blue:
Blinking

Pin# Defi nition

1 Button In

2 Ground

3 Ground

4 Ground

UID LED (LE4)

Status

Windows OS Unit Identifi ed

Linux OS Unit Identifi ed

UID Switch

Overheat LED/Fan Fail

The JOH1 header is used to connect an

LED indicator to provide warnings of chas-

sis overheating and fan failure. This LED

will blink when a fan failure occurs. Refer

to the tables on right for pin defi nitions.

Power SMB (I2C) Connectors

Power System Management Bus (I

Connectors (JI

2

C1/JI2C2) monitor power

2

C)

supply, fan and system temperatures. See

the table on the right for pin defi nitions.

Overheat LED

Pin Defi nitions

Pin# Defi nition

1 5vDC

2 OH Active

OH/Fan Fail LED

Status

State Message

Solid Overheat

Blinking Fan Fail

PWR SMB

Pin Defi nitions

Pin# Defi nition

1 Clock

2 Data

3 PWR Fail

4 Ground

5 +3.3V

5-20

5-9 Jumper Settings

Explanation of Jumpers

To modify the operation of the

serverboard, jumpers can be used

to choose between optional settings.

Jumpers create shorts between two

pins to change the function of the con-

nector. Pin 1 is identifi ed with a square

solder pad on the printed circuit board.

See the serverboard layout pages for

jumper locations.

Note: On a two-pin jumper, "Closed"

means the jumper is on both pins and

"Open" means the jumper is either on

only one pin or completely removed.

Chapter 5: Advanced Serverboard Setup

3 2 1

Connector

Pins

Jumper

3 2 1

Setting

CMOS Clear

JBT1 is used to clear CMOS (which will also clear any passwords). Instead of pins,

this jumper consists of contact pads to prevent accidentally clearing the contents

of CMOS.

To clear CMOS,

1. First power down the system and unplug the power cord(s).

2. With the power disconnected, short the CMOS pads with a metal object such

as a small screwdriver.

3. Remove the screwdriver (or shorting device).

4. Reconnect the power cord(s) and power on the system.

Note: Do not use the PW_ON connector to clear CMOS.

VGA Enable/Disable

JPG1 allows you to enable or disable the

VGA port. The default position is on pins

1 and 2 to enable VGA. See the table on

the right for jumper settings.

VGA Enable/Disable

Jumper Settings

Jumper Setting Defi nition

Pins 1-2 Enabled

Pins 2-3 Disabled

5-21

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

LAN1/2 Enable/Disable

Change the setting of jumper JPL1 to en-

able or disable the LAN1/LAN2 Ethernet

ports on the serverboard. See the table on

the right for jumper settings. The default

setting is enabled.

Watch Dog Enable/Disable

JWD controls the Watch Dog function.

Watch Dog is a system monitor that can

reboot the system when a software ap-

plication hangs. Jumping pins 1-2 (default)

will cause WD to reset the system if an

application hangs. Jumping pins 2-3 will

generate a non-maskable interrupt signal

for the application that hangs. See the

table on the right for jumper settings.

Watch Dog must also be enabled in BIOS.

LAN1/2 Enable/Disable

Jumper Settings

Jumper Setting Defi nition

Pins 1-2 Enabled

Pins 2-3 Disabled

Jumper Settings

Jumper Setting Defi nition

Pins 1-2 Reset

Pins 2-3 NMI

Open Disabled

Watch Dog

Note: When enabled, the user needs to

write their own application software in order

to disable the Watch Dog Timer.

Manufacturer Mode Select

Close jumper JPME1 to bypass SPI fl ash

security and force the system to use the

Manufacturer Mode, which will allow the

user to fl ash the system fi rmware from a

host server to modify system settings. See

the table on the right for jumper settings.

Write Protect Enable

Close pins 1/2 of jumper JWP1 to enable

Write Protect support for system security

and data integrity. See the table on the

right for jumper settings.

ME Mode Select

Jumper Settings

Jumper Setting Defi nition

1-2 Normal (Default)

2-3 Manufacture Mode

Write Protect

Jumper Settings

Jumper Setting Defi nition

Pins 1/2 Write_Protect Enable (Default)

Pins 2/3 Write_Protect Disable

5-22

Chapter 5: Advanced Serverboard Setup

BMC Enable/Disable

Use jumper JPB1 to enable or disable the

BMC (Baseboard Management Controller),

which supports IPMI 2.0/KVM. See the

table on the right for jumper settings.

5-10 Onboard Indicators

LAN1/2 Port LEDs

The Ethernet ports have two LEDs. On

each port, one LED indicates activity while

the other LED may be green, amber or

off to indicate the speed of the connec-

tion. See the table on the right for the

functions associated with the connection

speed LED.

BMC Enable/Disable

Jumper Settings

Both Jumpers Defi nition

Pins 1-2 Enabled

Pins 2-3 Disabled

LAN Port LEDs

(Connection Speed Indicator)

LED Color 1 Gb Ports 10 Gb Ports

Off NC or 10 Mb/s 10/100 Mb/Off

Green 100 Mb/s 10 Gb/s

Amber 1 Gb/s 1 Gb/s

Note: the dedicated IPMI LAN does not

operate at 1 Gb/s.

Dedicated IPMI LAN Port LEDs

A dedicated IPMI LAN port is also located

on the I/O backplane. The amber LED on

the right indicates activity, while the green

LED on the left indicates the speed of the

connection. Please note that the IPMI LAN

does not support 1Gbps connections. See

the table at right for more information.

Onboard Power LED

An Onboard Power LED is located at

LE1. This LED Indicator is on when the

system is on. Be sure to unplug the AC

power cable before removing or adding any

components. See the table on the right for

more details.

IPMI LAN LEDs

Color/State Defi nition

Link (Left) Green: Solid 100 Mbps

Activity (Right) Amber: Blinking Active

Onboard PWR LED Indicator

LED Color Defi nition

Off System Off (power cable

Green System On

Green:
Flashing
Quickly

not connected)

ACPI S1 State

5-23

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

ME Recovery

JBR1 is used for ME Firmware Recovery

mode, which will limit system resource

for essential function use only without

putting restrictions on power use. In the

single operation mode, online upgrade

will be available via Recovery mode. See

the table on the right for jumper settings.

BMC Heartbeat LED

The BMC Heartbeat LED is designated

DM1. When DM1 is blinking, the BMC

(Baseboard Management Controller) is

functioning normally. See the table at right

for more information.

ME Recovery Select

Jumper Settings

Jumper Setting Defi nition

1-2 Manufacture Mode

2-3 Normal (Default)

BMC Heatbeat LED Indicator

LED Status

Green: Blinking BMC: Normal

Rear UID LED

The rear UID LED is located at LE4 on the

backplane. This LED is used in conjunc-

tion with the rear UID switch to provide

easy identifi cation of a system that might

be in need of service.

5-11 SATA Ports

SATA Ports

Two SATA 3.0 ports (I-SATA0 and I-

SATA1) and eight SATA 2.0 ports (I-SATA2

through I-SATA5 and S-SATA0 through S-

SATA3) are included on the serverboard.

There are no jumpers to confi gure the

onboard SATA ports. See the table on the

right for pin defi nitions.

UID LED

Status

Color/State OS Status

Blue: On Windows OS Unit Identifi ed

Blue:
Blinking

Linux OS Unit Identifi ed

SATA Port

Pin Defi nitions

Pin # Defi nition

1 Ground

2 TXP

3 TXN

4 Ground

5 RXN

6 RXP

7 Ground

5-24

Chapter 5: Advanced Serverboard Setup

5-12 Installing Software

After the hardware has been installed, you should fi rst install the operating system

and then the drivers. The necessary drivers are all included on the Supermicro CDs

that came packaged with your system.

Note: Click the icons showing a hand writing on paper to view the readme fi les

for each item. Click the computer icons to the right of these items to install each

item (from top to the bottom) one at a time. After installing each item, you must
re-boot the system before moving on to the next item on the list. The bottom

icon with a CD on it allows you to view the entire contents of the CD.

Driver/Tool Installation Display Screen

5-25

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Supero Doctor III

The Supero Doctor III program is a web-based management tool that supports

remote management capability. It includes Remote and Local Management tools.

The local management is called SD III Client. The Supero Doctor III program

included on the CD-ROM that came with your serverboard allows you to monitor

the environment and operations of your system. Supero Doctor III displays crucial

system information such as CPU temperature, system voltages and fan status. See

the Figure below for a display of the Supero Doctor III interface.

Note: The default User Name and Password for SuperDoctor III is ADMIN / AD-

MIN.

Note: When SuperDoctor III is fi rst installed, it adopts the temperature threshold

settings that have been set in BIOS. Any subsequent changes to these thresholds

must be made within Super Doctor, as the Super Doctor settings override the BIOS

settings. To set the BIOS temperature threshold settings again, you would fi rst need

to uninstall SuperDoctor III.

Supero Doctor III Interface Display Screen (Health Information)

5-26

Chapter 5: Advanced Serverboard Setup

Supero Doctor III Interface Display Screen (Remote Control)

Note: SD III Software Revision 1.0 can be downloaded from our Web Site at: ftp://

ftp.supermicro.com/utility/Supero_Doctor_III/. You can also download the SDIII

User's Guide at: http://www.supermicro.com/manuals/other/SDIII_User_Guide.pdf.

For Linux, we will recommend using Supero Doctor II.

5-27

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Notes

5-28

Chapter 6: Advanced Chassis Setup

Chapter 6

Advanced Chassis Setup

This chapter covers the steps required to install components and perform mainte-

nance on the SC118GQ chassis. For component installation, follow the steps in the

order given to eliminate the most common problems encountered. If some steps

are unnecessary, skip ahead to the next step.

Tools Required:

maintenance is a Philips screwdriver.

The only tool you will need to install components and perform

6-1 Static-Sensitive Devices

Electrostatic Discharge (ESD) can damage electronic com ponents. To prevent

damage to any printed circuit boards (PCBs), it is important to handle them very

carefully.

The following measures are generally suffi cient to protect your equipment from

ESD damage.

Precautions

• Use a grounded wrist strap designed to prevent static discharge.

• Touch a grounded metal object before removing any board from its antistatic

bag.

• Handle a board by its edges only; do not touch its components, peripheral chips,

memory modules or gold contacts.

• When handling chips or modules, avoid touching their pins.

• Put the serverboard, add-on cards and peripherals back into their antistatic

bags when not in use.

• For grounding purposes, make sure your computer chassis provides excellent

conductivity between the power supply, the case, the mounting fasteners and

the serverboard.

6-1

SUPERSERVER 1027GR-TRF/1027GR-TRFT Series User's Manual

Figure 6-1. Chassis: Front and Rear Views

GPU Card

Control Panel

Hot-Swap Drive Bays (4)

PCI Slot

Power Supplies

GPU Card

GPU CardRear I/O Ports

Note: the number of PCI slots available depends on the presence of GPUs in the

server model.

6-2 Control Panel

The control panel (located on the front of the chassis) must be connected to the

JF1 connector on the serverboard to provide you with system status indications. A

ribbon cable has bundled these wires together to simplify the connection. Connect

the cable from JF1 on the serverboard to the appropriate header on the Control

Panel PCB (printed circuit board). Make sure the red wire plugs into pin 1 on both

connectors. Pull all excess cabling out of the airfl ow path.

The control panel LEDs inform you of system status. See "Chapter 3: System In-

terface" for details on the LEDs and the control panel buttons. Details on JF1 can

be found in "Chapter 5: Advanced Serverboard Installation."

6-3 System Cooling

Ten 4-cm counter-rotating fans provide the cooling for the system. Each fan unit

is actually made up of two fans joined back-to-back, which rotate in opposite di-

rections. This counter-rotating action generates exceptional airfl ow and works to

dampen vibration levels.

It is very important that the chassis top cover is properly installed and making a

good seal in order for the cooling air to circulate properly through the chassis and

cool the components.

6-2

Chapter 6: Advanced Chassis Setup

System Fan Failure

Fan speed is controlled by system temperature via a BIOS setting. If a fan fails, the

remaining fans will ramp up to full speed. Replace any failed fan at your earliest

convenience with the same type and model (the system can continue to run with a

failed fan). Failed fans can be identifi ed through the BIOS. (See the fan numbering

in Figure 6-3. These numbers are also imprinted on the fl oor of the chassis.)

Replacing a System Fan

1. If the BIOS is not being utilized to determine which fan has failed, open the

top cover of the chassis while the system is running to locate the position of

the failed fan. Never run the server for an extended period of time with the

top cover open.

2. Turn off the power to the system and unplug the AC power cord.

3. Remove the failed fan's wiring from the serverboard.

4. Remove the four pins securing the fan to the fan tray.

5. Lift the failed fan from the fan tray and out of the chassis.

6. Place the new fan into the vacant space in the fan tray, while making sure the

arrows on the top of the fan (indicating air direction) point in the same direc-

tion as the arrows on the other fans in the same fan tray.

7. Reconnect the fan wires to the exact same chassis fan headers as the previ-

ous fan.

8. Reconnect the AC power cord, power up the system and check that the fan is

working properly before replacing the chassis cover.

Figure 6-2. Removing a Fan from the Fan Tray

6-3

SUPERSERVER 1027GR-TRF/1027GR-TRFT Series User's Manual

Figure 6-3. Installing a Fan

Figure 6-4. Installing the Air Shroud

Installing the Air Shroud

Air shrouds concentrate airfl ow to maximize fan effi ciency. The SC118GQ chassis

air shroud does not require screws to set up. Note that each GPU card has its

own air shroud.

Installing the Air Shroud

1. Position the air shroud in the chassis as illustrated in Figure 6-4.

6-4

Chapter 6: Advanced Chassis Setup

2. Align the notch on the air shroud with the pin on the add-on card bracket.

3. Slide the pin into the back of the notch.

4. Lower the front of the air shroud over the fan tray, sliding the front notches

over the pins on the fan tray.

Installing Graphics (GPU) Cards

The system supports three GPU cards, which are mounted in brackets to fi t into

the PCI-E 3.0 slots at the front of the chassis. NVIDIA Fermi M2090, Fermi M2075

and NVIDIA Kepler K10 GPUs are supported. The GPU cards may be preinstalled,

the procedure below is provided for when a GPU card needs to be replaced. See

NVIDIA's web site for more details on the K10 GPU specifi cations.

Installing Graphics Cards

1. Identify the left and right brackets and graphics cards as illustrated below.

2. Insert the graphics cards into the brackets, aligning the mounting holes in the

cards with those in the brackets. Kepler cards require a different bracket than

Fermi cards (MCP-240-00117-0N). The system comes with Fermi brackets al-

ready installed by default. If replacing Fermi GPUs with Kepler GPUs, remove

the Fermi brackets from the chassis and replace with the Kepler brackets.

3. Secure each card to the bracket using the screws that are included for this

purpose. Keplers: remove the bracket on the end of the GPU, add a washer

(included in kit) between the plate and the pcb for each screw, then attach the

GPU to the system Kepler bracket (MCP-240-00117-0N), which now takes the

place of the Fermi bracket.

4. Carefullly position each bracket in the chassis as illustrated below, aligning

the four mounting holes in the top and side of each bracket with the corre-

sponding mounting holes in the chassis. Pay attention to the airfl ow arrows

to install each card into the correct side of the chassis

5. Secure the bracket to the chassis by using the screws provided.

6. After a GPU card is installed, you must connect it to one of the following

power headers on the serverboard: JPW3, JPW4, JPW6, JPW7, JPW8 or

JPW11.

6-5

SUPERSERVER 1027GR-TRF/1027GR-TRFT Series User's Manual

Figure 6-5. Installing GPU Cards into the Left and Right GPU Brackets

Airfl ow

1

2

Left Side GPU Bracket

and Cards

Arrows indicate

direction of airfl ow

Right Side GPU Bracket

and Cards

Important Note for Kepler GPUs: note the airfl ow arrows on top of the GPU card.

The card with the arrow pointing toward the Tesla logo should go on the left side of

the chassis, and the card with the arrow pointing away from the Tesla logo should

go on the right side of the chassis (when viewed from the front of the system).

The Kepler GPU card brackets need two additional washers added (see note on

previous page).

6-6

Chapter 6: Advanced Chassis Setup

!

6-4 Drive Bay Installation/Removal

Accessing the Drive Bays

Because of their hotswap capability, you do not need to access the inside of the

chassis or power down the system to install or replace hard drives. Proceed to the

next section for instructions.

Hard Drive Installation

The hard drives are mounted in drive carriers to simplify their installation and

removal from the chassis. These carriers also help promote proper airfl ow for

the drive bays. For this reason, even empty carriers without drives installed must

remain in the chassis.

Removing Hard Drive Carriers from the Chassis

1. Press the release button on the drive carrier. This extends the drive carrier handle.

2. Use the handle to pull the drive carrier out of the chassis.

Installing a Hard Drive into a Drive Carrier

1. Remove the dummy drive, which comes pre-installed in the drive carrier, by

removing the screws securing the dummy drive to the carrier. Note that these

screws cannot be reused on the actual 2.5" hard drive.

2. Insert a drive into the carrier with the PCB side facing down and the connec-

tor end toward the rear of the carrier.

3. Align the drive in the carrier so that the screw holes of both line up. Note that

there are holes in the carrier marked “SATA” to aid in correct installation.

4. Secure the drive to the carrier with four M3 screws as illustrated below. These

screws are included in the chassis accessory box.

5. Insert the drive carrier into its bay, keeping the carrier oriented so that the

hard drive is on the top of the carrier and the release button is on the right

side. When the carrier reaches the rear of the bay, the release handle will

retract.

6. Push the handle in until it clicks into its locked position

Warning: Except for short periods of time (swapping hard drives), do not

operate the server with the hard drive carriers removed.

6-7

SUPERSERVER 1027GR-TRF/1027GR-TRFT Series User's Manual

!

Figure 6-6. Removing a Hard Drive Carrier

1

1

Figure 6-7. Installing a Hard Drive into a Carrier

1

2

Enterprise level hard disk drives are recommended for use in Supermicro

chassis and servers. For information on recommended HDDs, visit the

Supermicro Web site at http://www.supermicro.com/products/nfo/storage.

cfm

6-5 Power Supply

The 1027GR-TRF/1027GR-TRFT series server includes an 1800 watt redundant

power supply consisting of two power modules. Each power supply module has an

auto-switching capability, which enables it to automatically sense and operate at a

100V - 240V input voltage.

If either of the two power supply modules fail, the other module will take the full

load and allow the system to continue operation without interruption.

Replacement units can be ordered directly from Supermicro. The power supply

units have a hot-swap capability, meaning you can replace the failed unit without

powering down the system.

6-8

Chapter 6: Advanced Chassis Setup

Figure 6-8. Removing the Power Supply

Removing the Power Supply

1. First unplug the AC power cord from the failed power supply module.

2. Depress the locking tab on the power supply module.

3. Use the handle to pull it straight out with the rounded handle.

Installing a New Power Supply

1. Replace the failed hot-swap unit with another identical power supply unit.

2. Push the new power supply unit into the power bay until you hear a click.

3. Secure the locking tab on the unit.

4. Finish by plugging the AC power cord back into the unit.

6-9

SUPERSERVER 1027GR-TRF/1027GR-TRFT Series User's Manual

Notes

6-10

Chapter 7: BIOS

Chapter 7

BIOS

7-1 Introduction

This chapter describes the AMI BIOS Setup utility for the X9DRG-HF/HTF. It also

provides the instructions on how to navigate the AMI BIOS Setup utility screens.

The AMI ROM BIOS is stored in a Flash EEPROM and can be easily updated.

Starting BIOS Setup Utility

To enter the AMI BIOS Setup utility screens, press the <Del> key while the system

is booting up.

Note: In most cases, the <Del> key is used to invoke the AMI BIOS setup

screen. There are a few cases when other keys are used, such as <F3>,

<F4>, etc.

Each main BIOS menu option is described in this manual. The Main BIOS setup

menu screen has two main frames. The left frame displays all the options that can

be confi gured. Grayed-out options cannot be confi gured. Options in blue can be

confi gured by the user. The right frame displays the key legend. Above the key

legend is an area reserved for a text message. When an option is selected in the

left frame, it is highlighted in white. Often a text message will accompany it.

Note: The AMI BIOS has default text messages built in. The manufacturer

retains the option to include, omit, or change any of these text mes-

sages.

The AMI BIOS Setup utility uses a key-based navigation system called "hot keys."

Most of the AMI BIOS setup utility "hot keys" can be used at any time during setup

navigation. These keys include <F3>, <F4>, <Enter>, <ESC>, arrow keys, etc.

Note 1: Options printed in Bold are default settings.

Note 2: <F3> is used to load optimal default settings. <F4> is used to save

the settings and exit the setup utility.

7-1

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

How To Change the Confi guration Data

The confi guration data that determines the system parameters may be changed by

entering the AMI BIOS Setup utility. This Setup utility can be accessed by pressing

<Delete> at the appropriate time during system boot.

Note: For AMI UEFI BIOS Recovery, please refer to the UEFI BIOS Re-

covery User Guide posted @http://www.supermicro.com/support/manuals/.

Starting the Setup Utility

Normally, the only visible Power-On Self-Test (POST) routine is the memory test.

As the memory is being tested, press the <Delete> key to enter the main menu of

the AMI BIOS Setup utility. From the main menu, you can access the other setup

screens. An AMI BIOS identifi cation string is displayed at the left bottom corner of

the screen below the copyright message.

Warning! Do not upgrade the BIOS unless your system has a BIOS-related

issue. Flashing the wrong BIOS can cause irreparable damage to the sys-

tem. In no event shall the manufacturer be liable for direct, indirect, special,

incidental, or consequential damage arising from a BIOS update. If you have

to update the BIOS, do not shut down or reset the system while the BIOS

is being updated to avoid possible boot failure.

7-2 Main Setup

When you fi rst enter the AMI BIOS Setup utility, you will enter the Main setup screen.

You can always return to the Main setup screen by selecting the Main tab on the

top of the screen. The Main BIOS Setup screen is shown below.

7-2

Chapter 7: BIOS

The AMI BIOS Main menu displays the following information:

System Date/System Time

Use this option to change the system time and date. Highlight System Time or
System Date using the arrow keys. Enter new values through the keyboard and

press <Enter>. Press the <Tab> key to move between fi elds. The date must be

entered in Day MM/DD/YY format. The time is entered in HH:MM:SS format. (Note:

The time is in the 24-hour format. For example, 5:30 P.M. appears as 17:30:00.).

Supermicro X9DRG-HF

Version

This item displays the SMC version of the BIOS ROM used in this system.

Build Date

This item displays the date that the BIOS Setup utility was built.

Memory Information

Total Memory

This displays the amount of memory that is available in the system.

7-3

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

7-3 Advanced Setup Confi gurations

Select the Advanced tab to access the following submenu items.

XBoot Features

Quiet Boot

This feature allows the user to select bootup screen display between POST mes-

sages and the OEM logo. Select Disabled to display the POST messages. Select

Enabled to display the OEM logo instead of the normal POST messages. The op-

tions are Enabled and Disabled.

AddOn ROM Display Mode

Use this item to set the display mode for the Option ROM. Select Keep Current to

use the current AddOn ROM Display setting. Select Force BIOS to use the Option

ROM display mode set by the system BIOS. The options are Force BIOS and

Keep Current.

Bootup Num-Lock

Use this feature to set the Power-on state for the Numlock key. The options are

Off and On.

Wait For 'F1' If Error

Select Enabled to force the system to wait until the 'F1' key is pressed if an error

occurs. The options are Disabled and Enabled.

7-4

Chapter 7: BIOS

Interrupt 19 Capture

Interrupt 19 is the software interrupt that handles the boot disk function. When this

item is set to Enabled, the ROM BIOS of the host adaptors will "capture" Interrupt 19

at bootup and allow the drives that are attached to these host adaptors to function

as bootable disks. If this item is set to Disabled, the ROM BIOS of the host adap-

tors will not capture Interrupt 19, and the drives attached to these adaptors will not

function as bootable devices. The options are Enabled and Disabled.

Power Confi guration

Watch Dog Function

If enabled, the Watch Dog timer will allow the system to reboot when it is inactive

for more than 5 minutes. The options are Enabled and Disabled.

Power Button Function

If this feature is set to Instant Off, the system will power off immediately as soon

as the user presses the power button. If this feature is set to 4 Seconds Override,

the system will power off when the user presses the power button for 4 seconds or

longer. The options are Instant Off and 4 Seconds Override.

Restore on AC Power Loss

Use this feature to set the power state after a power outage. Select Stay Off for the

system power to remain off after a power loss. Select Power On for the system

power to be turned on after a power loss. Select Last State to allow the system

to resume its last state before a power loss. The options are Power On, Stay Off,
and Last State.

XCPU Confi guration

This submenu displays the information of the CPU as detected by the BIOS. It also

allows the user to confi guration CPU settings.

XSocket 1 CPU Information/Socket 2 CPU Information

This submenu displays the following information regarding the CPUs installed

in Socket 1/ Socket 2.

• Type of CPU

• CPU Signature

• Microcode Patch

7-5

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

• CPU Stepping

• Maximum CPU Speed

• Minimum CPU Speed

• Processor Cores

• Intel HT (Hyper-Threading) Technology

• Intel VT-x Technology

• Intel SMX Technology

• L1 Data Cache

• L1 Code Cache

• L2 Cache

• L3 Cache

CPU Speed

This item displays the speed of the CPU installed in Socket 1/Socket 2.

64-bit

This item indicates if the CPU installed in Socket 1 or Socket 2 supports 64-bit
technology.

Clock Spread Spectrum

Select Enable to enable Clock Spectrum support, which will allow the BIOS to moni-

tor and attempt to reduce the level of Electromagnetic Interference caused by the

components whenever needed. The options are Disabled and Enabled.

RTID (Record Types IDs)

This feature displays the total number of Record Type IDs for local and remote

pools. The options are Optimal and Alternate.

Hyper-threading

Select Enabled to support Intel Hyper-threading Technology to enhance CPU per-

formance. The options are Enabled and Disabled.

7-6

Chapter 7: BIOS

Active Processor Cores

Set to Enabled to use a processor's second core and above. (Please refer to Intel's

website for more information.) The options are All, 1, 2, 4 and 6.

Limit CPUID Maximum

This feature allows the user to set the maximum CPU ID value. Enable this function

to boot the legacy operating systems that cannot support processors with extended

CPUID functions. The options are Enabled and Disabled (for the Windows OS).

Execute-Disable Bit (Available if supported by the OS & the CPU)

Select Enabled to enable the Execute Disable Bit which will allow the processor

to designate areas in the system memory where an application code can execute

and where it cannot, thus preventing a worm or a virus from fl ooding illegal codes

to overwhelm the processor or damage the system during an attack. The default is

Enabled. (Refer to Intel and Microsoft Web sites for more information.)

Intel® AES-NI

Select Enable to use the Intel Advanced Encryption Standard (AES) New Instruc-

tions (NI) to ensure data security. The options are Enabled and Disabled.

MLC Streamer Prefetcher (Available when supported by the CPU)

If set to Enabled, the MLC (mid-level cache) streamer prefetcher will prefetch

streams of data and instructions from the main memory to the L2 cache to improve

CPU performance. The options are Disabled and Enabled.

MLC Spatial Prefetch (Available when supported by the CPU)

If this feature is set to Disabled, The CPU prefetches the cache line for 64 bytes.

If this feature is set to Enabled the CPU fetches both cache lines for 128 bytes as

comprised. The options are Disabled and Enabled.

DCU Streamer Prefetcher (Available when supported by the CPU)

Select Enabled to support Data Cache Unite (DCU) prefetch of L1 data to speed

up data accessing and processing in the DCU to enhance CPU performance. The

options are Disabled and Enabled.

DCU IP Prefetcher

Select Enabled for DCU (Data Cache Unit) IP Prefetcher support, which will prefetch

IP addresses to improve network connectivity and system performance. The options

are Enabled and Disabled.

7-7

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Intel® Virtualization Technology (Available when supported by the CPU)

Select Enabled to support Intel Virtualization Technology, which will allow one

platform to run multiple operating systems and applications in independent parti-

tions, creating multiple "virtual" systems in one physical computer. The options

are Enabled and Disabled.

Note: If there is any change to this setting, you will need to power off and

restart the system for the change to take effect. Please refer to Intel’s

website for detailed information.)

X CPU Power Management Confi guration

This submenu allows the user to confi gure the following CPU Power Management

settings.

Power Technology

Select Energy Effi ciency to support power-saving mode. Select Custom to cus-

tomize system power settings. Select Disabled to disable power-saving settings.

The options are Disabled, Energy Effi cient, and Custom. If the option is set to

Custom, the following items will display:

EIST (Available when Power Technology is set to Custom)

EIST (Enhanced Intel SpeedStep Technology) allows the system to au-

tomatically adjust processor voltage and core frequency to reduce power

consumption and heat dissipation. The options are Disabled (GV3 Disabled),

and Enabled (GV3 Enabled). (Note: GV3 is Intel Speedstep support used

on older platforms. Please refer to Intel’s website for detailed information.)

Turbo Mode (Available when Power Technology is set to Custom)

Select Enabled to use the Turbo Mode to boost system performance. The

options are Enabled and Disabled.

C1E (Available when Power Technology is set to Custom)

Select Enabled to enable Enhanced C1 Power State to boost system per-

formance. The options are Enabled and Disabled.

CPU C3 Report (Available when Power Technology is set to Custom)

Select Enabled to allow the BIOS to report the CPU C3 State (ACPI C2) to

the operating system. During the CPU C3 State, the CPU clock generator

is turned off. The options are Enabled and Disabled.

7-8

Chapter 7: BIOS

CPU C6 Report (Available when Power Technology is set to Custom)

Select Enabled to allow the BIOS to report the CPU C6 State (ACPI C3) to

the operating system. During the CPU C6 State, the power to all cache is

turned off. The options are Enabled and Disabled.

CPU C7 Report (Available when Power Technology is set to Custom)

Select Enabled to allow the BIOS to report the CPU C7 State (ACPI C3) to

the operating system. CPU C7 State is a processor-specifi c low C-State.

The options are Enabled and Disabled.

Package C-State limit (Available when Power Technology is set to
Custom)

This feature allows the user to set the limit on the C-State package register.

The options are C0, C2, C6, and No Limit.

Energy/Performance Bias

This setting allows the user to adjust the fan speed based on performance (maxi-

mum cooling) or energy effi ciency (maximum energy savings). The options are

Performance, Balanced Performance, Balanced Energy, and Energy Effi cient.

Factory Long Duration Power Limit

This item displays the power limit set by the manufacturer during which long

duration power is maintained.

Long Duration Power Limit

This item displays the power limit set by the user during which long duration

power is maintained. The default setting is 0.

Factory Long Duration Maintained

This item displays the period of time set by the manufacturer during which long

duration power is maintained.

Long Duration Maintained

This item displays the period of time during which long duration power is main-

tained. The default setting is 0.

Recommended Short Duration Power

This item displays the short duration power settings recommended by the

manufacturer.

7-9

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Short Duration Power Limit

This item displays the time period during which short duration power is main-

tained. The default setting is 0.

XChipset Confi guration

XNorth Bridge

This feature allows the user to confi gure the settings for the Intel North Bridge.

XIntegrated IO Confi guration

Intel VT-d

Select Enabled to enable Intel Virtualization Technology support for Direct I/O

VT-d

by reporting the I/O device assignments to the VWM (Virtual Working

Memory) through the DMAR ACPI Tables. This feature offers fully-protected

I/O resource sharing across Intel platforms, providing greater reliability, security

and availability in networking and data-sharing. The options are Enabled and

Disabled.

Data Direct I/O

Select Enabled to enable Intel I/OAT (I/O Acceleration Technology), which sig-

nifi cantly reduces CPU overhead by leveraging CPU architectural improvements

and freeing the system resource for other tasks. The options are Disabled and

Enabled.

DCA Support

When set to Enabled, this feature uses Intel's DCA (Direct Cache Access)

Technology to improve data transfer effi ciency. The default is Enabled and can

not be changed.

IIO 1 PCIe Port Bifurcation Control

This submenu confi gures the following IO PCIe Port Bifurcation Control settings

for IIO 1 PCIe ports to determine how the available PCI-Express lanes to be

distributed between the PCI-Exp. Root Ports.

CPU1 Slot 5 PCI-E 3.0 x8 OPROM

This feature allows the user to set the PCI-Exp bus speed for the slot specifi ed

above. The options are Gen1 (Generation 1), Gen2 and Gen3.

7-10

Chapter 7: BIOS

CPU1 Slot 2 PCI-E 3.0 x16 OPROM

This feature allows the user to set the PCI-Exp bus speed for the slot specifi ed

above. The options are Gen1 (Generation 1), Gen2 and Gen3.

CPU1 Slot 1 PCI-E 3.0 x16 OPROM

This feature allows the user to set the PCI-Exp bus speed for the slot specifi ed

above. The options are Gen1 (Generation 1), Gen2 and Gen3.

IIO 2 PCIe Port Bifurcation Control

This submenu confi gures the following IO PCIe Port Bifurcation Control settings

for IIO 2 PCIe ports to determine how the available PCI-Express lanes to be

distributed between the PCI-Exp. Root Ports.

CPU2 Slot 3 PCI-E 3.0 x16 OPROM

This feature allows the user to set the PCI-Exp bus speed for the slot specifi ed

above. The options are Gen1 (Generation 1), Gen2 and Gen3.

CPU2 Slot 4 PCI-E 3.0 x16 OPROM

This feature allows the user to set the PCI-Exp bus speed for the slot specifi ed

above. The options are Gen1 (Generation 1), Gen2 and Gen3.

XQPI Confi guration

Current QPI Link

This item displays the current status of the QPI Link.

Current QPI Frequency

This item displays the frequency of the QPI Link.

Isoc

Select Enabled to enable Ischronous support to meet QoS (Quality of Service)

requirements. This feature is especially important for virtualization technology.

The options are Enabled and Disabled.

QPI (Quick Path Interconnect) Link Speed Mode

Use this feature to select data transfer speed for QPI Link connections. The

options are Fast and Slow.

QPI Link Frequency Select

Use this feature to select the desired QPI frequency. The options are Auto, 6.4

GT/s, 7.2 GT/s, and 8.0 GT/s.

7-11

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

XDIMM Confi guration

This section displays the following DIMM information.

Current Memory Mode

This item displays the current memory mode.

Current Memory Speed

This item displays the current memory speed.

Mirroring

This item displays if memory mirroring is supported by the motherboard. Memory

mirroring creates a duplicate copy of the data stored in the memory to enhance

data security.

Sparing

This item displays if memory sparing is supported by the motherboard. Memory

sparing enhances system performance.

XDIMM Information

CPU Socket 1 DIMM Information/ CPU Socket 2 DIMM Information

The status of the memory modules detected by the BIOS will be displayed as

detected by the BIOS.

Memory Mode

When Independent is selected, all DIMMs are available to the operating system.

When Mirroring is selected, the motherboard maintains two identical copies of all

data in memory for data backup. When Lock Step is selected, the motherboard

uses two areas of memory to run the same set of operations in parallel. The

options are Independent, Mirroring, and Lock Step.

DRAM RAPL Mode

RAPL (Running Average Power Limit) provides mechanisms to enforce power

consumption limits on supported processors The options are DRAM RAPL

MODE0 , DRAM RAPL MODE1, and Disabled.

DDR Speed

Use this feature to force a DDR3 memory module to run at a frequency other

than what is specifi ed in the specifi cation. The options are Auto, Force DDR3-

800, Force DDR3-1066, Force DDR3-1333, Force DDR3-1600 and Force SPD.

7-12

Chapter 7: BIOS

Channel Interleaving

This feature selects from the different channel interleaving methods. The options

are Auto, 1 Way, 2 Way, 3, Way, and 4 Way.

Rank Interleaving

This feature allows the user to select a rank memory interleaving method. The

options are Auto, 1 Way, 2 Way, 4, Way, and 8 Way.

Patrol Scrub

Patrol Scrubbing is a process that allows the CPU to correct correctable memory

errors detected on a memory module and send the correction to the requestor

(the original source). When this item is set to Enabled, the IO hub will read and

write back one cache line every 16K cycles, if there is no delay caused by internal

processing. By using this method, roughly 64 GB of memory behind the IO hub

will be scrubbed every day. The options are Enabled and Disabled.

Demand Scrub

Demand Scrubbing is a process that allows the CPU to correct correctable

memory errors found on a memory module. When the CPU or I/O issues a

demand-read command, and the read data from memory turns out to be a

correctable error, the error is corrected and sent to the requestor (the original

source). Memory is updated as well. Select Enabled to use Demand Scrubbing

for ECC memory correction. The options are Enabled and Disabled.

Data Scrambling

Select Enabled to enable data scrambling to ensure data security and integrity.

The options are Disabled and Enabled.

Device Tagging

Select Enabled to support device tagging. The options are Disabled and En-

abled.

Thermal Throttling

Throttling improves reliability and reduces power consumption in the proces-

sor via automatic voltage control during processor idle states. The options are

Disabled and CLTT (Closed Loop Thermal Throttling).

7-13

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

XSouth Bridge Confi guration

This feature allows the user to confi gure the settings for the Intel PCH chip.

PCH Information

This feature displays the following PCH information.

Name: This item displays the name of the PCH chip.

Stepping: This item displays the status of the PCH stepping.

USB Devices: This item displays the USB devices detected by the BIOS.

All USB Devices

This feature enables all USB ports/devices. The options are Disabled and Enabled.

(If set to Enabled, EHCI Controller 1 and Controller 2 will appear.)

EHCI Controller 1/EHCI Controller 2 (Available when All USB Devices is set
to Enabled)

Select Enabled to enable EHCI (Enhanced Host Controller Interface) Controller 1

or Controller 2. The options are Disabled and Enabled.

Legacy USB Support (Available when USB Functions is not Disabled)

Select Enabled to support legacy USB devices. Select Auto to disable legacy sup-

port if USB devices are not present. Select Disable to have USB devices available

for EFI (Extensive Firmware Interface) applications only. The settings are Disabled,

Enabled and Auto.

Port 60/64 Emulation

Select Enabled to enable I/O port 60h/64h emulation support for the legacy USB

keyboard so that it can be fully supported by the operating systems that does not

recognize a USB device. The options are Disabled and Enabled.

EHCI Hand-Off

This item is for operating systems that do not support Enhanced Host Controller

Interface (EHCI) hand-off. When enabled, EHCI ownership change will be claimed

by the EHCI driver. The options are Disabled and Enabled.

XSATA Confi guration

When this submenu is selected, the AMI BIOS automatically detects the presence

of IDE or SATA devices and displays the following items.

SATA Port0~SATA Port5: The AMI BIOS displays the status of each SATA port

as detected by the BIOS.

7-14

Chapter 7: BIOS

SATA Mode

Use this feature to confi gure SATA mode for a selected SATA port. The options are

Disabled, IDE Mode, AHCI Mode and RAID Mode. The following are displayed

depending on your selection:

IDE Mode

The following items are displayed when IDE Mode is selected:

Serial-ATA (SATA) Controller 0~1

Use this feature to activate or deactivate the SATA controller, and set the

compatibility mode. The options for SATA Controller 0 are Disabled, En-

hanced, and Compatible. The options for SATA Controller 1 are Disabled
and Enhanced.

AHCI Mode

The following items are displayed when the AHCI Mode is selected.

Aggressive Link Power Management

Select Enabled to enable Aggressive Link Power Management support

for Cougar Point B0 stepping and beyond. The options are Enabled and

Disabled.

Port 0~5 Hot Plug

Select Enabled to enable hot-plug support for a particular port, which will

allow the user to change a hardware component or device without shutting

down the system. The options are Enabled and Disabled.

Staggered Spin Up

Select Enabled to enable Staggered Spin-up support to prevent excessive

power consumption caused by multiple HDDs spinning-up simultaneously.

The options are Enabled and Disabled.

RAID Mode

The following items are displayed when RAID Mode is selected:

Port 0~5 Hot Plug

Select Enabled to enable hot-plug support for the particular port. The options

are Enabled and Disabled.

7-15

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

XSCU (Storage Control Unit) Confi guration

Storage Controller Unit

Select Enabled to enable PCH SCU storage devices. The options are Disabled

and Enabled.

OnChip SCU Option ROM

Select Enabled to support the onboard SCU Option ROM to boot up the system via

a storage device. The options are Disabled and Enabled.

SCU Port 0~SCU Port 3: The AMI BIOS will automatically detect the onboard SCU

devices and display the status of each SCU device as detected.

XPCIe/PCI/PnP Confi guration

PCI ROM Priority

Use this feature to select the Option ROM to boot the system when there are mul-

tiple Option ROMs available in the system. The options are EFI Compatible ROM

and Legacy ROM.

PCI Latency Timer

Use this feature to set the latency Timer of each PCI device installed on a PCI bus.

Select 64 to set the PCI latency to 64 PCI clock cycles. The options are 32, 64, 96,

128, 160, 192, 224 and 248.

Above 4G Decoding (Available if the system supports 64-bit PCI decoding)

Select Enabled to decode a PCI device that supports 64-bit in the space above 4G

Address. The options are Enabled and Disabled.

PERR# Generation

Select Enabled to allow a PCI device to generate a PERR number for a PCI Bus

Signal Error Event. The options are Enabled and Disabled.

SERR# Generation

Select Enabled to allow a PCI device to generate an SERR number for a PCI Bus

Signal Error Event. The options are Enabled and Disabled.

Maximum Payload

Select Auto to allow the system BIOS to automatically set the maximum payload

value for a PCI-E device to enhance system performance. The options are Auto,

128 Bytes and 256 Bytes.

7-16

Chapter 7: BIOS

Maximum Read Request

Select Auto to allow the system BIOS to automatically set the maximum Read

Request size for a PCI-E device to enhance system performance. The options are

Auto, 128 Bytes, 256 Bytes, 512 Bytes, 1024 Bytes, 2048 Bytes, and 4096 Bytes.

ASPM Support

This feature allows the user to set the Active State Power Management (ASPM)

level for a PCI-E device. Select Force L0 to force all PCI-E links to operate at L0

state. Select Auto to allow the system BIOS to automatically set the ASPM level for

the system. Select Disabled to disable ASPM support. The options are Disabled,

Force L0, and Auto.

Warning: Enabling ASPM support may cause some PCI-E devices to fail!

CPU1 Slot 1 PCI-E 3.0 x16 OPROM/ CPU1 Slot 2 PCI-E 3.0 x16 OPROM/
CPU1 Slot 5 PCI-E 3.0 x8 OPROM/ CPU2 Slot 3 PCI-E 3.0 x16 OPROM/
CPU2 Slot 4 PCI-E 3.0 x16 OPROM

Select Enabled to enable Option ROM support to boot the computer using a

network interface from the slots specifi ed above. The options are Enabled and

Disabled.

Onboard LAN Option ROM Select

Select iSCSI to use the iSCSI Option ROM to boot the computer using a network

device. Select PXE (Preboot Execution Environment) to use an PXE Option ROM

to boot the computer using a network device. The options are iSCSI and PXE.

Load Onboard LAN1 Option ROM/Load Onboard LAN2 Option ROM

Select Enabled to enable the onboard LAN1 Option ROM~LAN2 Option ROM. This

is to boot the computer using a network device. The default setting for LAN1 Op-

tion ROM is Enabled, and the default setting for LAN2 Option ROM is Disabled.

VGA Priority

This feature allows the user to select the graphics adapter to be used as the primary

boot device. The options are Onboard, and Offboard.

Network Stack

Select Enabled enable PXE (Preboot Execution Environment) or UEFI (Unifi ed

Extensible Firmware Interface) for network stack support. The options are Enabled

and Disabled.

7-17

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

XSuper IO Confi guration

Super IO Chip: This item displays the Super IO chip used in the motherboard.

XSerial Port 1 Confi guration

Serial Port
Select Enabled to enable a serial port specifi ed by the user. The options are En-

abled and Disabled.

Device Settings

This item displays the settings of Serial Port 1.

Change Settings

Use this feature to set the optimal Platform Environment Control Interface (PECI)

setting for a serial port specifi ed. The default setting is Auto, which will allow the

AMI BIOS to automatically select the best PECI setting.

Device Mode

Use this feature to select the desired mode for a serial port specifi ed. The options

are Normal and High Speed.

XSOL Confi guration

Serial Port
Select Enabled to enable a serial port specifi ed by the user. The options are En-

abled and Disabled.

Device Settings

This item displays the settings of the SOL Port.

Change Settings

Use this feature to set the optimal Platform Environment Control Interface (PECI)

setting for a serial port specifi ed. The default setting is Auto, which will allow the

AMI BIOS to automatically select the best PECI setting.

Serial Port Attribute

Use this feature to select the attribute for this serial port. The options are SOL

(Serial On LAN), and COM.

7-18

Chapter 7: BIOS

Device Mode

Use this feature to select the desired mode for a serial port specifi ed. The options

are Normal and High Speed.

XSerial Port Console Redirection

COM 1/SOL

These two submenus allow the user to confi gure the following Console Redirection

settings for a COM Port specifi ed by the user.

Console Redirection

Select Enabled to use a COM Port selected by the user for Console Redirection.

The options are Enabled and Disabled. The default setting for COM1 is Disabled,
and for SOL is Enabled.

XConsole Redirection Settings

This feature allows the user to specify how the host computer will exchange data

with the client computer, which is the remote computer used by the user.

Terminal Type

This feature allows the user to select the target terminal emulation type for Con-

sole Redirection. Select VT100 to use the ASCII Character set. Select VT100+ to

add color and function key support. Select ANSI to use the Extended ASCII Char-

acter Set. Select VT-UTF8 to use UTF8 encoding to map Unicode characters

into one or more bytes. The options are ANSI, VT100, VT100+, and VT-UTF8.

Bits Per second

Use this feature to set the transmission speed for a serial port used in Console

Redirection. Make sure that the same speed is used in the host computer and the

client computer. A lower transmission speed may be required for long and busy

lines. The options are 9600, 19200, 38400, 57600 and 115200 (bits per second).

Data Bits

Use this feature to set the data transmission size for Console Redirection. The

options are 7 Bits and 8 Bits.

Parity

A parity bit can be sent along with regular data bits to detect data transmission

errors. Select Even if the parity bit is set to 0, and the number of 1's in data bits

is even. Select Odd if the parity bit is set to 0, and the number of 1's in data bits

7-19

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

is odd. Select None if you do not want to send a parity bit with your data bits

in transmission. Select Mark to add a mark as a parity bit to be sent along with

the data bits. Select Space to add a Space as a parity bit to be sent with your

data bits. The options are None, Even, Odd, Mark and Space.

Stop Bits

A stop bit indicates the end of a serial data packet. Select 1 Stop Bit for standard

serial data communication. Select 2 Stop Bits if slower devices are used. The

options are 1 and 2.

Flow Control

This feature allows the user to set the fl ow control for Console Redirection to

prevent data loss caused by buffer overfl ow. Send a "Stop" signal to stop send-

ing data when the receiving buffer is full. Send a "Start" signal to start sending

data when the receiving buffer is empty. The options are None and Hardware

RTS/CTS.

VT-UTF8 Combo Key Support

Select Enabled to enable VT-UTF8 Combination Key support for ANSI/VT100

terminals. The options are Enabled and Disabled.

Recorder Mode

Select Enabled to capture the data displayed on a terminal and send it as text

messages to a remote server. The options are Disabled and Enabled.

Resolution 100x31

Select Enabled for extended-terminal resolution support. The options are Dis-

abled and Enabled.

Legacy OS Redirection Resolution

Use this feature to select the number of rows and columns used in Console

Redirection for legacy OS support. The options are 80x24 and 80x25.

Putty KeyPad

This feature selects Function Keys and KeyPad settings for Putty, which is a

terminal emulator designed for the Windows OS. The options are VT100, LINUX,

XTERMR6, SC0, ESCN, and VT400.

Serial Port for Out-of-Band Management/Windows Emergency Management
Services (EMS)

The submenu allows the user to confi gure Console Redirection settings to support

Out-of-Band Serial Port management.

7-20

Chapter 7: BIOS

Console Redirection

Select Enabled to use a COM Port selected by the user for Console Redirection.

The options are Enabled and Disabled.

X

Console Redirection Settings

This feature allows the user to specify how the host computer will exchange

data with the client computer, which is the remote computer used by the user.

Out-of-Band Management Port

The feature selects a serial port used by the Microsoft Windows Emergency

Management Services (EMS) to communicate with a remote server. The options

are COM1 and SOL.

Terminal Type

This feature allows the user to select the target terminal emulation type for Con-

sole Redirection. Select VT100 to use the ASCII character set. Select VT100+

to add color and function key support. Select ANSI to use the extended ASCII

character set. Select VT-UTF8 to use UTF8 encoding to map Unicode characters

into one or more bytes. The options are ANSI, VT100, VT100+, and VT-UTF8.

Bits Per Second

This item sets the transmission speed for a serial port used in Console Redirec-

tion. Make sure that the same speed is used in the host computer and the client

computer. A lower transmission speed may be required for long and busy lines.

The options are 9600, 19200, 57600, and 115200 (bits per second).

Flow Control

This feature allows the user to set the fl ow control for Console Redirection to

prevent data loss caused by buffer overfl ow. Send a "Stop" signal to stop send-

ing data when the receiving buffer is full. Send a "Start" signal to start sending

data when the receiving buffer is empty. The options are None, Hardware RTS/

CTS, and Software Xon/Xoff.

Data Bits, Parity, Stop Bits

The status of these features is displayed.

XACPI Settings

Use this feature to confi gure Advanced Confi guration and Power Interface (ACPI)

power management settings for your system.

7-21

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

ACPI Sleep State

Use this feature to select the ACPI State when the system is in sleep mode. Select

S1 (CPU_Stop_Clock) to erase all CPU caches and stop executing instructions.

Power to the CPU(s) and RAM is maintained, but RAM is refreshed. Select Sus-

pend Disabled to use power-reduced mode. Power will only be supplied to limited

components (such as RAMs) to maintain the most critical functions of the system.

The options are S1 (CPU_Stop_Clock) and Suspend Disabled.

NUMA (NON-Uniform Memory Access)

This feature enables the Non-Uniform Memory Access ACPI support. The options

are Enabled and Disabled.

High Precision Event Timer

Select Enabled to activate the High Precision Event Timer (HPET) that produces

periodic interrupts at a much higher frequency than a Real-time Clock (RTC) does

in synchronizing multimedia streams, providing smooth playback, reducing the de-

pendency on other timestamp calculation devices, such as an x86 RDTSC Instruc-

tion embedded in the CPU. The High Performance Event Timer is used to replace

the 8254 Programmable Interval Timer. The options are Enabled and Disabled.

XTrusted Computing (A vailable when a TPM device is detected
by the BIOS)

Confi guration

TPM Support

Select Enabled on this item and enable the TPM jumper on the motherboard to

enable TPM support to improve data integrity and network security. The options

are Enabled and Disabled.

TPM State

Select Enabled to enable TPM security settings to improve data integrity and

network security. The options are Disabled and Enabled.

Pending Operation: This item displays the status of a pending operation.

Current Status Information: This item displays the information regarding the

current TPM status.

TPM Enable Status

This item displays the status of TPM Support to indicate if TPM is currently

enabled or disabled.

7-22

Chapter 7: BIOS

TPM Active Status

This item displays the status of TPM Support to indicate if TPM is currently ac-

tive or deactivated.

TPM Owner Status

This item displays the status of TPM Ownership.

XIntel TXT (LT-SX) Confi guration

Intel TXT (LT-SX) Hardware Support

This feature indicates if the following hardware components support the Intel

Trusted Execution Technology.

CPU: TXT (Trusted Execution Technology) Feature

Chipset: TXT (Trusted Execution Technology) Feature

Intel TXT (LT-SX) Confi guration

This feature displays the following TXT confi guration setting.

TXT (L T -SX) Support: This item indicates if the Intel TXT support is enabled

or disabled.

Intel TXT (LT-SX) Dependencies

This feature displays the features that need to be enabled for the Intel Trusted

Execution Technology to work properly in the system.

VT-d Support: Intel Virtualization Technology with Direct I/O support

VT Support: Intel Virtualization Technology support

TPM Support: Trusted Platform support

TPM State: Trusted Platform state

XME Subsystem

This feature displays the following ME Subsystem Confi guration settings.

• ME BIOS Interface Version

• ME Version

7-23

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

iSCSI Confi guration: This item displays iSCSI confi guration information:

iSCSI Initiator Name

This item displays the name of the iSCSI Initiator, which is a unique name used

in the world. The name must use IQN format. The following actions can also

be performed:

• Add an Attempt

• Delete Attempts

• Commit Changes and Exit

• Discard Changes and Exit

• Change Attempt Order

• Commit Changes and Exit

• Discard Changes and Exit

Intel® I350 Gigabit Network Connections: These items display the following

information on the Intel I350 LAN connections.

XNIC Confi guration

Link Speed

Use this feature to change the link speed and duplex for the current port. The op-

tions are AutoNeg, 10Mbps Half, 10Mbps Full, 100Mbps Half, and 100Mbps full.

Wake on LAN

Select enabled to wake the system with a magic packet. The options are Enabled

and Disabled.

Blink LEDs

This feature allows the user to specify the duration for LEDs to blink. The range is

from 0 ~ 15 seconds. The default setting is 0.

PORT CONFIGURATION INFORMATION

This section displays the following port information:

• UEFI Driver

• Adapter PBA

7-24

• Chip Type

• PCI Device ID

• PCI Bus:Device:Function

• Link Status

• Factory MAC Address

• Alternate MAC Address

7-4 Event Logs

Select the Event Logs tab to access the following submenu items.

Chapter 7: BIOS

XChange SMBIOS Event Log Settings

This feature allows the user to confi gure SMBIOS Event settings.

Enabling/Disabling Options

SMBIOS Event Log

Select Enabled to enable SMBIOS (System Management BIOS) Event Logging

during system boot. The options are Enabled and Disabled.

7-25

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Runtime Error Logging Support

Select Enabled to support Runtime Error Logging. The options are Enabled and

Disabled.

Memory Correctable Error Threshold

This feature allows the user to enter the threshold value for correctable memory

errors. The default setting is 10.

PCI Error Logging Support

Select Enabled to support error event logging for PCI slots. The options are Enabled

and Disabled.

Erasing Settings

Erase Event Log

Select Enabled to erase the SMBIOS (System Management BIOS) Event Log,

which is completed before a event logging is initialized upon system reboot. The

options are No and Yes.

When Log is Full

Select Erase Immediately to immediately erase SMBIOS error event logs that ex-

ceed the limit when the SMBIOS event log is full. Select Do Nothing for the system

to do nothing when the SMBIOS event log is full. The options are Do Nothing and

Erase Immediately.

SMBIOS Event Log Standard Settings

Log System Boot Event
Select Enabled to log system boot events. The options are Disabled and Enabled.

MECI (Multiple Event Count Increment)

Enter the increment value for the multiple event counter. Enter a number between

1 to 255. The default setting is 1.

METW (Multiple Event Count Time Window)

This item allows the user to decide how long (in minutes) should the multiple event

counter wait before generating a new event log. Enter a number between 0 to 99.

The default setting is 60.

View SMBIOS Event Log

This item allows the user to view the event in the SMBIOS event log. Select this

item and press <Enter> to view the status of an event in the log.

Date/Time/Error Code/Severity

7-26

Chapter 7: BIOS

View System Event Log

This item allows the user to view the event in the system event log. Select this item

and press <Enter> to view the status of an event in the log.

Date/Time/Error Code/Severity

7-5 IPMI

Select the IPMI (Intelligent Platform Management Interface) tab to access the fol-

lowing submenu items.

IPMI Firmware Revision

This item indicates the IPMI fi rmware revision used in your system.

IPMI Status

This item indicates the status of the IPMI fi rmware installed in your system.

XSystem Event Log

Enabling/Disabling Options

SEL Components

Select Enabled for all system event logging at bootup. The options are Enabled

and Disabled.

7-27

SUPERSERVER 1027GR-TRF/1027GR-TRFT User's Manual

Erasing Settings

Erase SEL

Select Yes, On next reset to erase all system event logs upon next system reboot.

Select Yes, On every reset to erase all system event logs upon each system reboot.

Select No to keep all system event logs after each system reboot. The options are

No, Yes, On next reset, and Yes, On every reset.

When SEL is Full

This feature allows the user to decide what the BIOS should do when the system

event log is full. Select Erase Immediately to erase all events in the log when the

system event log is full. The options are Do Nothing and Erase Immediately.

Custom EFI Logging Options

Log EFI Status Codes

Select Enabled to log EFI (Extensible Firmware Interface) Status Codes, Error

Codes or Progress Codes. The options are Enabled and Disabled.

Note: After making changes on a setting, be sure to reboot the system for

the changes to take effect.

XBMC Network Confi guration

LAN Channel 1: This feature allows the user to confi gure the settings for LAN1 Port.

Update IPMI LAN Confi guration

This feature allows the user to decide if the BIOS should confi gure the IPMI setting

at next system boot. The options are No and Yes. If the option is set to Yes, the

user is allow to confi gure the IPMI settings at next system boot:

Confi guration Address Source

This feature allows the user to select the source of the IP address for this computer.

If Static is selected, you will need to know the IP address of this computer and enter

it to the system manually in the fi eld. If DHCP is selected, the BIOS will search for

a DHCP (Dynamic Host Confi guration Protocol) server in the network that is at-

tached to and request the next available IP address for this computer. The options

are DHCP and Static. The following items are assigned IP addresses automatically

if DHCP is selected, or can be confi gured manually if Static is selected.

Station IP Address

This item displays the Station IP address for this computer. This should be in decimal

and in dotted quad form (i.e., 192.168.10.253).

7-28

Chapter 7: BIOS

Subnet Mask

This item displays the sub-network that this computer belongs to. The value of each

three-digit number separated by dots should not exceed 255.

Station MAC Address

This item displays the Station MAC address for this computer. Mac addresses are

6 two-digit hexadecimal numbers.

Gateway IP Address

This item displays the Gateway IP address for this computer. This should be in

decimal and in dotted quad form (i.e., 192.168.10.253).

7-6 Boot

This submenu allows the user to confi gure the following boot settings for the

system.

Boot Option Priorities

Boot Option #1/ Boot Option #2/ Boot Option #3, etc.

Use this feature to specify the sequence of boot device priority.

Network Devices

Use these options to set the order of the legacy network, USB, and Hard Disk Drive

devices detected by the motherboard.

7-29