Supero FatTwin F627R3-R72B+, FatTwin F627R3-RTB+ User Manual

®

SUPER

User's Manual

Revision 1.0c

FatTwin

F627R3-RTB+

F627R3-R72B+

The information in this User’s Manual has been carefully reviewed and is believed to be accurate.
The vendor assumes no responsibility for any inaccuracies that may be contained in this document,
makes no commitment to update or to keep current the information in this manual, or to notify any
person or organization of the updates. Please Note: For the most up-to-date version of this

manual, please see our web site at

www.supermicro.com.

Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this manual at any time and without notice. This product, including software and
documentation, is the property of Supermicro and/or its licensors, and is supplied only under a
license. Any use or reproduction of this product is not allowed, except as expressly permitted by
the terms of said license.

IN NO EVENT WILL SUPERMICRO BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL,
SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO
USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF
SUCH DAMAGES. IN PARTICULAR, SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY
HARDWARE, SOFTW ARE, OR DA TA STORED OR USED WITH THE PRODUCT, INCLUDING THE
COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH
HARDWARE, SOFTWARE, OR DATA.

Any disputes arising between manufacturer and customer shall be governed by the laws of Santa
Clara County in the State of California, USA. The State of California, County of Santa Clara shall
be the exclusive venue for the resolution of any such disputes. Super Micro's total liability for all
claims will not exceed the price paid for the hardware product.

FCC Statement: This equipment has been tested and found to comply with the limits for a Class
A digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide
reasonable protection against harmful interference when the equipment is operated in a commercial
environment. This equipment generates, uses, and can radiate radio frequency energy and, if not
installed and used in accordance with the manufacturer’s instruction manual, may cause harmful
interference with radio communications. Operation of this equipment in a residential area is likely
to cause harmful interference, in which case you will be required to correct the interference at your
own expense.

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate
warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See

www.dtsc.ca.gov/hazardouswaste/perchlorate”

WARNING: Handling of lead solder materials used in this
product may expose you to lead, a chemical known to
the State of California to cause birth defects and other
reproductive harm.

Manual Revision 1.0c
Release Date: December 30, 2014

Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.

Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.

Copyright © 2014 by Super Micro Computer, Inc.
All rights reserved.

Printed in the United States of America

iii

Preface

Preface

About This Manual

This manual is written for professional system integrators and PC technicians. It
provides information for the installation and use of the FatTwin F627R3-R TB+/R72B+.
Installation and maintainance should be performed by experienced technicians only .

The FatTwin™ F627R3-RTB+/R72B+ is a high-end server based on the
SCF424AS-R1K28B 4U rackmount chassis and the dual processor X9DRFR
serverboard. All models have an IPMI LAN port and four serverboard nodes with
eight hot-swap 3.5" SAS or SATA Hard Disk Drives (HDD) each per node.

The difference between the FatTwin F627R3-RTB+ and FatTwin F627R3-R72B+
is that the F627R3-R72B+ has SAS2 capability and the F627R3-RTB+ does not.

Manual Organization

Chapter 1: Introduction

The fi rst chapter provides a checklist of the main components included with the
server system and describes the main features of the X9DRFR serverboard and
the SCF424AS-R1K28B chassis.

Chapter 2: Server Installation

This chapter describes the steps necessary to install the FatTwin F627R3-RTB+/R72B+
into a rack and check out the server confi guration prior to powering up the system.
If your server was ordered without processor and memory components, this chapter
will refer you to the appropriate sections of the manual for their installation.

Chapter 3: System Interface

Refer here for details on the system interface, which includes the functions and
information provided by the control panel on the chassis as well as other LEDs
located throughout the system.

Chapter 4: System Safety

You should thoroughly familiarize yourself with this chapter for a general overview
of safety precautions that should be followed when installing and servicing the
FatTwin F627R3-RTB+/R72B+.

Chapter 5: Advanced Serverboard Setup

Chapter 5 provides detailed information on the X9DRFR serverboard, including the
locations and functions of connections, headers and jumpers. Refer to this chapter
when adding or removing processors or main memory and when reconfi guring the
serverboard.

FatTwin F627R3-RTB+/R72B+ User's Manual

iv

Chapter 6: Advanced Chassis Setup

Refer to Chapter 6 for detailed information on the SCF424AS-R1K28B server
chassis. You should follow the procedures given in this chapter when installing,
removing or reconfi guring SATA or peripheral drives and when replacing system
power supply units and cooling fans.

Chapter 7: BIOS

The BIOS chapter includes an introduction to BIOS and provides detailed information
on running the CMOS Setup Utility.

Appendix A: BIOS Error Beep Codes
Appendix B: System Specifi cations

v

FatTwin F627R3-RTB+/R72B+ User's Manual

Notes

vi

Table of Contents

Chapter 1 Introduction

1-1 Overview .........................................................................................................1-1

1-2 Serverboard Features .....................................................................................1-2

Processors ......................................................................................................1-2

Memory ...........................................................................................................1-2

Serial ATA .......................................................................................................1-3

SAS .................................................................................................................1-3

PCI Expansion Slots ....................................................................................... 1-3

Onboard Controllers/Ports ..............................................................................1-3

Graphics Controller ......................................................................................... 1-4

Nuvoton WPCM450 Controller .......................................................................1-4

WPCM450R DDR2 Memory Interface ....................................................... 1-4

WPCM450R PCI System Interface ............................................................1-4

Other Features Supported by the WPCM BMC Controller ........................ 1-4

Power Supply ..................................................................................................1-5

Super I/O ......................................................................................................... 1-5

1-3 Server Chassis Features ................................................................................1-5

System Power .................................................................................................1-5

SAS/SATA Subsystem .....................................................................................1-6

Front Control Panel ......................................................................................... 1-6

I/O Ports ..........................................................................................................1-6

Cooling System ............................................................................................... 1-6

Air Shrouds ..................................................................................................... 1-6

Mounting Rails ................................................................................................ 1-7

1-4 Advanced Power Management ....................................................................... 1-7

Intel® Intelligent Power Node Manager (NM) .................................................1-7

Manageability Engine (ME) ............................................................................. 1-7

1-5 Contacting Supermicro ....................................................................................1-9

1-6 Fat Twin: System Notes ................................................................................ 1-10

Nodes ............................................................................................................1-10

System Power ............................................................................................... 1-10

SAS/SATA Backplane/Drives ........................................................................ 1-10

Chapter 2 Server Installation

2-1 Overview .........................................................................................................2-1

2-2 Unpacking the System .................................................................................... 2-1

2-3 Preparing for Setup ......................................................................................... 2-1

FatTwin F627R3-RTB+/R72B+ User's Manual

vii

2-4 Cautions! .........................................................................................................2-2

Choosing a Setup Location .............................................................................2-2

Rack Precautions ............................................................................................ 2-2

Server Precautions ..........................................................................................2-2

Rack Mounting Considerations ....................................................................... 2-3

Ambient Operating Temperature ................................................................ 2-3

Reduced Airfl ow ......................................................................................... 2-3

Mechanical Loading ...................................................................................2-3

Circuit Overloading ..................................................................................... 2-3

Reliable Ground ......................................................................................... 2-4

2-5 Rack Mounting Instructions .............................................................................2-4

Identifying the Sections of the Rack Rails ...................................................... 2-4

Adjusting the Rails .......................................................................................... 2-4

Locking Tabs ...................................................................................................2-5

Installing the Rails on a Rack ......................................................................... 2-6

Chassis Installation ......................................................................................... 2-7

2-6 Checking the Serverboard Setup ....................................................................2-8

2-7 Checking the Drive Bay Setup ........................................................................2-9

Chapter 3 System Interface

3-1 Overview .........................................................................................................3-1

3-2 Control Panel Buttons ..................................................................................... 3-2

3-3 Control Panel LEDs ........................................................................................3-3

Information LED .............................................................................................. 3-3

3-4 Drive Carrier LEDs .......................................................................................... 3-4

Chapter 4 Standardized Warning Statements for AC Systems

4-1 About Standardized Warning Statements ....................................................... 4-1

Warning Defi nition ........................................................................................... 4-1

Installation Instructions ....................................................................................4-4

Circuit Breaker ................................................................................................ 4-5

Power Disconnection Warning ........................................................................ 4-6

Equipment Installation ..................................................................................... 4-8

Restricted Area ................................................................................................ 4-9

Battery Handling ............................................................................................4-10

Redundant Power Supplies ..........................................................................4-12

Backplane Voltage ........................................................................................ 4-13

Comply with Local and National Electrical Codes ........................................ 4-14

Product Disposal ........................................................................................... 4-15

Table of Contents

viii

Hot Swap Fan Warning .................................................................................4-16

Power Cable and AC Adapter ...................................................................... 4-18

Chapter 5 Advanced Motherboard Setup

5-1 Handling the Motherboard ..............................................................................5-1

Precautions .....................................................................................................5-1

Unpacking .......................................................................................................5-1

5-2 Connecting Cables .......................................................................................... 5-2

Connecting Data Cables ................................................................................. 5-2

5-3 Control Panel Connectors and I/O Ports ........................................................ 5-2

Connecting the Control Panel ......................................................................... 5-3

5-4 Processor and Heatsink Installation................................................................5-4

Installing a Passive CPU Heatsink ................................................................. 5-8

Removing the Heatsink ................................................................................... 5-9

5-5 Installing Memory ..........................................................................................5-10

Removing Memory Modules ..........................................................................5-11

Memory Support .............................................................................................5-11

Installing UDIMM (ECC/Non-ECC) Memory ............................................5-12

Installing RDIMM (ECC) Memory ............................................................. 5-13

5-6 Motherboard Details ...................................................................................... 5-14

5-7 Connector Defi nitions .................................................................................... 5-17

5-8 Jumper Settings ............................................................................................ 5-22

Explanation of Jumpers ................................................................................5-22

5-9 Onboard Indicators ........................................................................................5-24

5-10 Serial ATA Connections ................................................................................. 5-26

5-11 Installing Drivers ............................................................................................5-27

SuperDoctor III .............................................................................................. 5-28

5-12 Serverboard Battery ......................................................................................5-30

Chapter 6 Advanced Chassis Setup

6-1 Static-Sensitive Devices ..................................................................................6-1

Precautions .....................................................................................................6-1

Unpacking .......................................................................................................6-1

6-2 Control Panel ..................................................................................................6-2

6-3 Removing the Power Cord ..............................................................................6-3

6-4 Removing Nodes from the Chassis ................................................................ 6-3

6-5 Installing and Removing Hard Drives ............................................................. 6-4

6-6 Removing the Node Cover..............................................................................6-9

FatTwin F627R3-RTB+/R72B+ User's Manual

6-7 Node Confi guration .......................................................................................6-10

Overview of the Node ................................................................................... 6-10

6-8 Removing and Installing the Backplane .........................................................6-11

Removing the Backplane ...............................................................................6-11

Installing the Backplane ................................................................................ 6-13

6-9 Adapter Card Replacement...........................................................................6-14

6-10 Installing the Motherboard ........................................................................... 6-15

Compatible Motherboards ............................................................................. 6-15

Permanent and Optional Standoffs ...............................................................6-15

6-11 Installing Expansion Cards ...........................................................................6-17

PCIE Slot Setup ............................................................................................ 6-17

SCF424 PCIE Slot Confi gurations ................................................................ 6-18

Installing a Rear Low-Profi le Expansion Card .............................................. 6-18

Installing a Rear Micro LP Expansion Card ..................................................6-19

Installing a Front Low-Profi le Expansion Card ............................................. 6-20

6-12 Installing the Air Shroud ................................................................................6-22

6-13 Checking the Airfl ow .....................................................................................6-23

Installation Complete .....................................................................................6-23

6-14 Replacing System Fans ................................................................................ 6-24

6-15 Replacing the Power Supply .........................................................................6-26

Power Supply Replacement ..........................................................................6-26

6-16 Power Distributor Board Replacement ..........................................................6-27

Chapter 7 BIOS

7-1 Introduction ......................................................................................................7-1

Starting BIOS Setup Utility ..............................................................................7-1

How To Change the Confi guration Data ......................................................... 7-1

Starting the Setup Utility ................................................................................. 7-2

7-2 Main Setup ...................................................................................................... 7-2

7-3 Advanced Settings Menu ................................................................................ 7-4

7-4 Event Logs .................................................................................................... 7-27

7-5 IPMI ............................................................................................................... 7-29

7-6 Boot ............................................................................................................... 7-31

7-7 Security ......................................................................................................... 7-32

7-8 Save & Exit ................................................................................................... 7-33

Appendix A BIOS Error Beep Codes
Appendix B System Specifi cations

ix

Table of Contents

x

Notes

FatTwin F627R3-RTB+/R72B+ User's Manual

Chapter 1

Introduction

1-1 Overview

The FatTwin F627R3-RTB+/R72B+ is a high-end server comprised of two main
subsystems: the SCF424AS-R1K28B 4U server chassis and the X9DRFR dual
processor serverboard in four hot-swap nodes. Please refer to our web site for
information on operating systems that have been certifi ed for use with the system
(www.supermicro.com).

In addition to the serverboard and chassis, various hardware components have been
included with the FatTwin F627R3-RTB+/R72B+ server, as listed below:

• Heat Sinks

Four (4) 2U passive CPU heat sinks for rear CPU (SNK-P0048P)
Four (4) 2U passive CPU heat sinks for front CPU (SNK-P0048PS)

• Four (4) Plastic air shrouds (MCP-310-42401-0B)

• Eight (8) 80x80x38-mm chassis middle cooling fans (FAN-0129L4)

• Four (4) Round 20" 20-to-20-pin ribbon front control cables (CBL-0047L)

• Four (4) 4-pin 40-cm PDB-to-MB HF power cables (CBL-0480L)

• SAS/SATA Backplane:

Four (4) Backplanes for two (2) 3.5" HDD (BPN-SAS-F424-A2)
Four (4) Backplanes for six (6) 3.5" HDD (BPN-SAS-F424-A6)
Eight (8) 29cm 30AWG SATA cables (CBL-0483L)
Thirty-two (32) hot-swap 3.5" HDD trays (MCP-220-00094-0B)

F627R3-RTB+ only:

Eight (8) 27-cm PBF cables for SGPIO (CBL-0157L-02)
Twelve (12) 81-cm SATA 30AWG cables (CBL-0481L)
Twelve (12) 55-cm 30AWG SATA-SATA cables (CBL-0484L)

F627R3-R72B+ only:

Four (4) SAS add-on cards (BPN-ADP-S2208L-H8IR-O-P)
Four (4) 23-cm, w/25.5-cm 30AWG Ipass-to-4 SATA cables (CBL-0118L-03)
Eight (8) 43-cm SATA round S-RA PBF cables (CBL-0226L)
Four (4) 27-cm PBF cables for SGPIO (CBL-0157L-02)

• One (1) F418/F424 Rail set (MCP-290-41803-0N)

Chapter 1: Introduction

1-1

1-2

FatTwin F627R3-RTB+/R72B+ User's Manual

Note: For your system to work properly, please follow the links below to download
all necessary drivers/utilities and the user’s manual for your server.

• Supermicro product manuals: http://www.supermicro.com/support/manuals/

• Product drivers and utilities: ftp://ftp.supermicro.com

• Product safety information:

http://super-dev/about/policies/safety_information.cfm

• If you have any questions, please contact our support team at:

[e-mail]

1-2 Serverboard Features

At the heart of the FatTwin F627R3-RTB+/R72B+ lies the
X9DRFR, a dual processor serverboard based on the Intel®
C602 chipset and designed to provide maximum performance. Two of these
serverboards can be mounted in the SCF424AS-R1K28B chassis.

The sections below cover the main features of the X9DRFR serverboard (see Figure
1-1 for a block diagram of the chipset).

Processors

The X9DRFR supports single or dual Intel® Xeon® E5-2600 series processors
(Socket R LGA 2011). Each processor supports four full-width Intel QuickPath
Interconnect (QPI) links, with support of up to 25.6 GT/s per QPI link and with
Data Transfer Rate of up to 8.0 GT/s per direction. Please refer to the serverboard
description pages on our web site for a complete listing of supported processors
(www.supermicro.com).

Memory

Each X9DRFR serverboard node has sixteen (16) DIMM slots supporting up to
512 GB of DDR3-1600/1333/1066/800 MHz speed RDIMM/LDIMM registered ECC
or 128 GB of DDR3-1600/1333/1066/800 MHz speed UDIMM SDRAM in up to
1 GB, 2 GB, 4 GB, 8 GB, 16 GB or 32 GB sizes at 1.35V or 1.5V voltages. See
Chapter 5 for details.

Note: For the latest CPU/memory updates, please refer to our website at

http://www.supermicro.com/products/motherboard.

1-3

Chapter 1: Introduction

Serial ATA

A Serial ATA controller is integrated into the C602 to provide up to a ten-port SATA
subsystem, (two SATA 3 (6 Gb/s), four SATA 2 (3 Gb/s and four SCU SATA2 (3
Gb/s)) which is either RAID 0, 1, 5 and 10 (AHCI SATA2), RAID 0 and 1 (AHCI
SATA3) or RAID 0 and 1 (SCU SATA2) supported. The SATA drives are hot­swappable units.

Note: The operati ng system yo u use must h ave R AID su ppor t to e nable t he hot­swap capability and RAI D function of the SATA drives.

SAS

An LSI® SAS2208 SAS2 controller is integrated into the BPN-ADP-S2208L-H8IR­O-P expansion card to provide an eight port 6 Gb/s SAS2 (Serial Attached SCSI)
subsystem, which is RAID 0, 1, 5, 6, 10, 50 and 60 supported. The SAS drives are
hot-swappable units.

Note: The operating system you use must have RAID support to enable the
hotswap c apabil ity an d R AID fu ncti on of the SA S drive s.

Note: The BPN-ADP-S2208L-H8IR-O-P SAS expansion cards for the FatTwin
F627R3-R72B+ have an OPTIONAL battery backup system for each motherboard
node that will keep the hard drives running for a short period of time in the case
of a power supply failure or power interruption. The battery backup system is not
activated by default, so it needs to be confi gured to activate its use.

These can be purchased optionally from Supermicro as part numbers BTR-022L­LSI00279 and MCP-450-00001-ON, one each per node.

PCI Expansion Slots

Each node of the FatTwin F627R3-RTB+/R72B+ has 1x PCI-E 3.0 x16 low-profi le
and 1x PCI-E 3.0 x8 micro low-profi le slot on the motherboard.

Onboard Controllers/Ports

One Fast UART 16550 serial port, one 9-pin RS-232 port are located on the
serverboard. The color-coded I/O ports include one COM port, a VGA (monitor)
port, two USB 2.0 ports, an IPMI dedicated LAN port and two Gigabit Ethernet ports.

Note: For IPMI Confi guration Instructions, please refer to the Embedded IPMI
Configuration User's Guide available @ http://www.supermicro.com/support/

manuals/.

1-4

FatTwin F627R3-RTB+/R72B+ User's Manual

Graphics Controller

The X9DRFR features an integrated Matrox G200eW Video Controller.

Nuvoton WPCM450 Controller

Note: The term "IPMI controller" and the term "BMC controller" can be used

interchangeably in this section.
The Nuvoton WPCM450R Controller, a Baseboard Management Controller (BMC),

supports 2D/VGA-compatible Graphic Cores with PCI interface, creating multi-media
virtualization via Keyboard/Video/Mouse Redirection (KVMR). The WPCM450R
Controller is ideal for remote system management.

The WPCM450R Controller interfaces with the host system via PCI connections
to communicate with the graphics cores. It supports USB 2.0 and 1.1 for remote
keyboard/mouse/virtual media emulation. It also provides LPC interface support to
control Super IO functions. The WPCM450R Controller is connected to the network
via an external Ethernet PHY module or shared NCSI connections.

The WPCM450R communicates with onboard components via six SMBus
interfaces, PECI (Platform Environment Control Interface) buses, and General
Purpose I/O ports.

WPCM450R DDR2 Memory Interface

The WPCM450R supports a 16-bit DDR2 memory module with a speed of up to 220
MHz. For best signal integrity, the WPCM450R provides point-to-point connection.

WPCM450R PCI System Interface

The WPCM450R provides 32-bit, 33 MHz 3.3V PCI interface, which is compliant
with the PCI Local Bus Specifi cation Rev. 2.3. The PCI system interface connects
to the onboard PCI Bridge used by the graphics controller.

Other Features Supported by the WPCM BMC Controller

The WPCM450R supports the following features:

• IPMI 2.0

• Serial over LAN

• KVM over LAN

• LAN Alerting-SNMP Trap

• Event Log

• X-Bus parallel interface for I/O expansion

1-5

Chapter 1: Introduction

• Multiple ADC inputs, Analog and Digital Video outputs

• SPI Flash Host BIOS and fi rmware bootstrap program supported

• Reduced Media Independent Interface (RMII)

• OS (Operating System) Independency

• Provides remote Hardware Health Monitoring via IPMI. Key features

• Provides Network Management Security via remote access/console redirection.

• Supports the following Management tools: IPMIView, CLI (Command Line

Interface)

• RMCP+ protocol supported

Note: For more information on IPMI confi guration, please refer to the IPMI User's
Guide posted on our website at http://www.supermicro.com/support/manuals/.

Power Supply

The power supply cables are wired on the motherboard, which is connected by an
onboard power cable to the SMC-Proprietary Adaptor (BPN-ADP-F418) to provide
power to the system.

Super I/O

The Super I/O provides functions that comply with ACPI (Advanced Confi guration
and Power Interface), which includes support of legacy and ACPI power
management through an SMI or SCI function pin. It also features auto power
management to reduce power consumption.

1-3 Server Chassis Features

The following is a general outline of the main features of the SCF424AS server
chassis.

System Power

Each SCF424AS chassis model includes four high-effi ciency 95-plus Platinum
certifi ed redundant power supplies, each rated at 1280 Ws. In the unlikely event your
power supply fails, replacement is simple and can be accomplished without tools.

1-6

FatTwin F627R3-RTB+/R72B+ User's Manual

SAS/SATA Subsystem

The SCF424AS supports up to eight 3.5" hot-swap SAS/SATA drives in trays for
each node for a total of thirty-two (32) drives. These drives are hot-swappable
units and are connected to two backplanes (one for six and one for two HDD) that
provides power and control.

Note: The operating system you use must have RAID support to enable the hot­swap capability of the drives. For more information, visit our Web site at: http://
www.supermicro.com.

Front Control Panel

SCF424AS-R1K28B chassis includes four front panels on the handles of the
chassis which control each of the systems. Each control panel on the FatTwin
F627R3-RTB+/R72B+ provides you with system monitoring and control for one
server node. LEDs indicate system power, HDD activity, network activity, system
overheat and power supply failure. A main power button and a system reset button
are also included.

I/O Ports

The SCF424AS is an proprietary form factor chassis designed to be used in a 4U
rackmount confi guration. The SCF424AS chassis provides a low-profi le add-on
card slot, a VGA port, two USB 2.0 ports, one IPMI Ethernet port and two gigabit
Ethernet ports per node.

Cooling System

The SCF424AS chassis accepts (two (2) 8-cm system fans per node, powered
from either backpane or the serverboards, for eight fans total. When one of the
motherboard nodes is removed, another motherboard will continue to operate the
fans.

Air Shrouds

The SCF424AS chassis requires mylar air shrouds for each node to direct the airfl ow
where cooling is needed. The air shroud will differ for different motherboards. If using
a motherboard which is not the default in the chassis, refer to the optional parts in
the Appendix of this manual, or the Supermicro Web site at www.supermicro.com
to puchase the proper air shroud.

1-7

Chapter 1: Introduction

Mounting Rails

The SCF424AS includes a set of rails, and can be placed in a rack for secure
storage and use. To setup your rack, follow the step-by-step instructions included
in this manual.

1-4 Advanced Power Management

Intel® Intelligent Power Node Manager (NM)

The Intel® Intelligent Power Node Manager (IPNM) provides your system with
real-time thermal control and power management for maximum energy effi ciency.
Although IPNM Specifi cation Version 1.5 is supported by the BMC (Baseboard
Management Controller), your system must also have IPNM-compatible
Manageability Engine (ME) fi rmware installed to use this feature.

Manageability Engine (ME)

The Manageability Engine, which is an ARC controller embedded in the IOH (I/O
Hub), provides Server Platform Services (SPS) to your system. The services
provided by SPS are different from those proveded by the ME on client platforms.

1-8

FatTwin F627R3-RTB+/R72B+ User's Manual

Figure 1-1. Intel C602 Chipset:

System Block Diagram

Note: This is a general block diagram and may not exactly repre-

sent the features on your motherboard. See the previous pages for

the actual specifi cations of your motherboard. This block diagram is

intended for your reference only.

#2

#2

E5-2600(v2)

E5-2600(v2)

QPI

DDR3 DIMM

DDR3 DIMM

#2

DDR3 DIMM

#1

G

SSB

C602J

PEG0

DMI

PEG1_4:1
PEG1_8:5

PCI-32bit

USB

I350

LAN

LAN

AT25321

LPC

CPU FRONT

FAN Side

CPU REAR
(I/O Side)

USB

100 pin MicroLP Slot

REAR

0,1

H

F

E

Socket 0

Socket 1

#2

DDR3 DIMM

#1

P0

P0

P1

P1

PE3 PE2 PE1 DMI

PE2 PE3 PE1 DMI

Gen3 x8

Gen3 x8

Gen2

VGA BMC

WPCM450

DDR2

TPM Header

LAN

RTL8201F

SPI

SATA DOM
PWR CONN

S-SATA

I-SATA

PCI

Samtec 100 pin PCI-E

Samtec 160 pin PCI-E

PCI-E x16 Slot

Gen3 x16

SATA2 #0

SATA2 #1

SATA3 #0

SATA3 #1

SATA2 #2

SATA2 #3

SATA2 #4

SATA2 #5

6/3/1.5

3/1.5

3/1.5

3/1.5

3/1.5

6/3/1.5

QPI

VGA CONN

#2

DDR3 DIMM

#1

C

#2

DDR3 DIMM

#1

D

#2

#2

DDR3 DIMM

DDR3 DIMM

A

B

#1

#1

#1

#1

SATA2 #2

SATA2 #3

SATA DOM
PWR CONN

1-9

Chapter 1: Introduction

1-5 Contacting Supermicro

Headquarters

Address: Super Micro Computer, Inc.

980 Rock Ave.

San Jose, CA 95131 U.S.A.
Tel: [phone]
Fax: [phone]
Email: [e-mail] (General Information)

[e-mail] (Technical Support)
Website:

www.supermicro.com

Europe

Address: Super Micro Computer B.V.

Het Sterrenbeeld 28, 5215 ML

's-Hertogenbosch, The Netherlands
Tel: [phone]
Fax: [phone]
Email: [e-mail] (General Information)

[e-mail] (Technical Support)

[e-mail] (Customer Support)
Website:

www.supermicro.nl

Asia-Pacifi c

Address: Super Micro Computer, Inc.

3F, No. 150, Jian 1st Rd.
Zhonghe Dist., New Taipei City 235

Taiwan (R.O.C)
Tel: [phone]
Fax: [phone]
Email: [e-mail]
Website:

www.supermicro.com.tw

1-10

FatTwin F627R3-RTB+/R72B+ User's Manual

1-6 Fat Twin: System Notes

As a Fat Twin confi guration, the FatTwin F627R3-RTB+/R72B+ is a unique server
system. With eight system boards incorporated into a single chassis acting as eight
separate nodes, there are several points you should keep in mind.

Nodes

Each of the four serverboards act as a separate node in the system. As independant
nodes, each may be powered off and on without affecting the others. In addition,
each node is a hot-swappable unit that may be removed from the front of the chassis.

Note: A guide pin is located between the upper and lower nodes on the inner chassis
wall. This guide pin also acts as a “stop” when a node is fully installed. If too much
force is used when inserting a node this pin may break off. Take care to slowly slide
a node in until you hear the “click” of the locking tab seating itself.

System Power

Four 1280 Watt power supplies are used to provide the power for all serverboards.
Each serverboard however, can be shut down independently of the other with the
power button on its own control panel.

SAS/SATA Backplane/Drives

As a system, the FatTwin F627R3-RTB+/R72B+ supports the use of up to thirty­two (32) SAS/SATA drives. Each of the eight backplanes in the system (one for
six drives and one for two for each node) works to apply system-based control for
power and fan speed functions, yet at the same time logically connects a set of
eight SAS/SATA drives to each backplane/serverboard. Consequently, RAID setup
is limited to an eight-drive scheme (RAID cannot be spread across all drives). See
the Drive Bay Installation/Removal section in Chapter 6 for the logical hard drive
and node confi guration.

Chapter 2: Server Installation

2-1

Chapter 2

Server Installation

2-1 Overview

This chapter provides a quick setup checklist to get your FatTwin F627R3-RTB+/R72B+
up and running. Following these steps in the order given should enable you to have
the system operational within a minimum amount of time. This quick setup assumes
that your system has come to you with the processors and memory preinstalled. If
your system is not already fully integrated with a serverboard, processors, system
memory etc., please turn to the chapter or section noted in each step for details on
installing specifi c components.

2-2 Unpacking the System

You should inspect the box the FatTwin F627R3-RTB+/R72B+ was shipped in and
note if it was damaged in any way. If the server itself shows damage you should
fi le a damage claim with the carrier who delivered it.

Decide on a suitable location for the rack unit that will hold the FatTwin
F627R3-RTB+/R72B+. It should be situated in a clean, dust-free area that is well
ventilated. Avoid areas where heat, electrical noise and electromagnetic fi elds are
generated. You will also need it placed near a grounded power outlet. Read the
Rack and Server Precautions in the next section.

2-3 Preparing for Setup

The box the FatTwin F627R3-RTB+/R72B+ was shipped in should include two
sets of rail assemblies, two rail mounting brackets and the mounting screws you
will need to install the system into the rack. Follow the steps in the order given to
complete the installation process in a minimum amount of time. Please read this
section in its entirety before you begin the installation procedure outlined in the
sections that follow.

2-2

FatTwin F627R3-RTB+/R72B+ User's Manual

2-4 Cautions!

Choosing a Setup Location

• Leave enough clearance in front of the rack to enable you to open the front door

completely (~25 inches) and approximately 30 inches of clearance in the back
of the rack to allow for suffi cient airfl ow and ease in servicing.

• This product is for installation only in a Restricted Access Location (dedicated

equipment rooms, service closets and the like).

• This product is not suitable for use with visual display work place devices

acccording to §2 of the the German Ordinance for Work with Visual Display Units.

Rack Precautions

• Ensure that the leveling jacks on the bottom of the rack are fully extended to

the fl oor with the full weight of the rack resting on them.

• In single rack installation, stabilizers should be attached to the rack. In multiple

rack installations, the racks should be coupled together.

• Always make sure the rack is stable before extending a component from the

rack.

• You should extend only one component at a time - extending two or more

simultaneously may cause the rack to become unstable.

Server Precautions

• Review the electrical and general safety precautions in Chapter 4.

• Determine the placement of each component in the rack before you install the

rails.

• Install the heaviest server components on the bottom of the rack fi rst, and then

work up.

• Use a regulating uninterruptible power supply (UPS) to protect the server from

power surges, voltage spikes and to keep your system operating in case of a
power failure.

• Allow any hot plug drives and power supply modules to cool before touching

them.

• Always keep the rack's front door and all panels and components on the servers

closed when not servicing to maintain proper cooling.

Chapter 2: Server Installation

2-3

Rack Mounting Considerations

Warning! To prevent bodily injury when mounting or servicing this unit in a

rack, you must take special precautions to ensure that the system remains stable.
The following guidelines are provided to ensure your safety:

• This unit should be mounted at the bottom of the rack if it is the only unit in

the rack.

• When mounting this unit in a partially fi lled rack, load the rack from the bottom

to the top with the heaviest component at the bottom of the rack.

• If the rack is provided with stabilizing devices, install the stabilizers before

mounting or servicing the unit in the rack.

Ambient Operating Temperature

If installed in a closed or multi-unit rack assembly, the ambient operating
temperature of the rack environment may be greater than the ambient temperature
of the room. Therefore, consideration should be given to installing the equipment
in an environment compatible with the manufacturer’s maximum rated ambient
temperature (Tmra).

Reduced Airfl ow

Equipment should be mounted into a rack so that the amount of airfl ow required
for safe operation is not compromised.

Mechanical Loading

Equipment should be mounted into a rack so that a hazardous condition does not
arise due to uneven mechanical loading.

Circuit Overloading

Consideration should be given to the connection of the equipment to the power
supply circuitry and the effect that any possible overloading of circuits might have
on overcurrent protection and power supply wiring. Appropriate consideration of
equipment nameplate ratings should be used when addressing this concern.

2-4

FatTwin F627R3-RTB+/R72B+ User's Manual

Reliable Ground

A reliable ground must be maintained at all times. To ensure this, the rack
itself should be grounded. Particular attention should be given to power supply
connections other than the direct connections to the branch circuit (i.e. the use of
power strips, etc.).

2-5 Rack Mounting Instructions

This section provides information on installing the chassis into a rack unit with the
rails provided. There are a variety of rack units on the market, which may mean that
the assembly procedure will differ slightly from the instructions provided. You should
also refer to the installation instructions that came with the rack unit you are using.

Note: This rail will fi t a rack between 26.5" and 36.4" deep. The SCF418 is not
designed for installation into a Telco post-style rack unit.

Warning: Do not pick up the server with the front handles. They are

designed to pull the system from a rack only.

Stability Hazard: The rack stabilizing mechanism must be in place, or the
rack must be bolted to the fl oor before you slide the unit out for servicing. Failure
to stabilize the rack can cause the rack to tip over.

Warning: When initially installing the server to a rack, test that the rail locking tabs
engage to prevent the server from being overextended. Have a rack lift in place as
a precaution in case the test fails.

Warning: In any instance of pulling the system from the rack, always use a rack
lift and follow all associated safety precautions.

Identifying the Sections of the Rack Rails

The chassis package includes two rail assemblies in the rack mounting kit. Each
assembly consists of two sections: A front section which secures to the front post
of the rack and a rear section which adjusts in length and secures to the rear post
of the rack. These assemblies are specifi cally designed for the left and right side
of the chassis (see Figure 2-1).

Adjusting the Rails

Each rail assembly has an adjusting screw. loosening this screw allows you to adjust
the length of the rail to fi t a variety of rack sizes.

Chapter 2: Server Installation

2-5

Figure 2-1: Identifying the Outer Rail and Inner Rails

(Left Rail Assembly Shown)

Inner Rail

This Side Faces

Outward

Adjusting Screw

Outer Rail

Locking Tab

Locking Tabs

Each inner rail has a locking tab. This tab locks the chassis into place when installed
and pushed fully into the rack. These tabs also lock the chassis in place when fully
extended from the rack. This prevents the server from coming completely out of
the rack when when the chassis is pulled out for servicing.

2-6

FatTwin F627R3-RTB+/R72B+ User's Manual

Installing the Rails on a Rack

Installing the Rails

1. Adjust the length of both rails as described on the previous page.

2. Align the front section of the outer rail with the slots on the front post of the

rack. Secure the front of the outer rail to the rack with two screws.

3. Pull out the rear section of the outer rail, adjusting the length until it fi ts within

the posts of the rack.

4. Align the rear section of the rail with the slots on the rear post of the rack.

Secure the rear of the outer rail to the rear of the rack with two screws.

5. Repeat steps 1-4 for the remaining rail.

Figure 2-2: Attaching the Rails to a Rack

Chapter 2: Server Installation

2-7

Note: The fi gure above is for illustration purposes only. Always install servers to
the bottom of the rack fi rst.

Figure 2-3: Installing into a Rack

Chassis Installation

Installing the Chassis into a Rack

1. Confi rm that the rails are correctly installed on the rack.

2. Align the bottom of the chassis with the bottom of the rails.

3. Insert the chassis into the rails, keeping the pressure even on both sides,
pushing the chassis into the rack until it clicks into the locked position.

4. Secure the chassis handles to the front of the rack.

2-8

FatTwin F627R3-RTB+/R72B+ User's Manual

2-6 Checking the Serverboard Setup

After you install the FatTwin F627R3-R TB+/R72B+ in the rack, you will need to open
the unit to make sure the serverboard is properly installed and all the connections
have been made.

Accessing the inside of the System

Before operating the server for the fi rst time, it is important to remove the protective
fi lm covering the top of the chassis, in order to allow for proper ventilation and

cooling.

Warning: Except for short periods of time, do NOT operate the server without
the cover in place. The chassis cover must be in place to allow proper airfl ow
and prevent overheating.

Checking the Components and Setup

1. You may have one or two processors already installed into the serverboard.
Each processor needs its own heat sink. See Chapter 5 for instructions on
processor and heat sink installation.

2. Your FatTwin F627R3-RTB+/R72B+ server system may have come with
system memory already installed. Make sure all DIMMs are fully seated in
their slots. For details on adding system memory, refer to Chapter 5.

3. If desired, you can install add-on cards to the system. See Chapter 5 for
details on installing PCI add-on cards.

4. Make sure all power and data cables are properly connected and not blocking
the chassis airfl ow. Also make sure that no cables are positioned in front of
the fans. See Chapter 5 for details on cable connections.

Chapter 2: Server Installation

2-9

2-7 Checking the Drive Bay Setup

Next, you should check to make sure the peripheral drives and the SATA drives
have been properly installed and all connections have been made.

Checking the Drives

1. All drives are accessable from the front and rear of the server. A hard drive
can be installed and removed from the front of the chassis without removing
the top chassis cover.

2. Depending upon your system's confi guration, your system may have one or
more drives already installed. If you need to install hard drives, please refer to
Chapter 6.

Checking the Airfl ow

1. Make sure there are no objects to obstruct airfl ow in and out of the server. In
addition, if you are using a front bezel, make sure the bezel's fi lter is replaced
periodically.

2. Do not operate the server without drives or drive trays in the drive bays. Use
only recommended server parts.

3. Make sure that no wires or foreign objects obstruct air fl ow through the
chassis. Pull all excess cabling out of the airfl ow path or use shorter cables.
The control panel LEDs inform you of the system status. See “Chapter 3
System Interface” for details on the LEDs and the control panel buttons.

Providing Power

1. Plug the power cord(s) from the power supply unit(s) into a high-quality
power strip that offers protection from electrical noise and power surges. It is
recommended that you use an uninterruptible power supply (UPS).

2. Depress the power on button on the front of the chassis.

2-10

FatTwin F627R3-RTB+/R72B+ User's Manual

Notes