Supermicro FatTwin F628G3-FT+, FatTwin F628G3-FTPT+ User Manual

FatTwin

®

F628G3-FT+

F628G3-FTPT+

USER’S MANUAL

Revision 1.0

The information in this User’s Manual has been carefully reviewed and is believed to be accurate.
The vendor assumes no responsibility for any inaccuracies that may be contained in this document,
makes no commitment to update or to keep current the information in this manual, or to notify any
person or organization of the updates. Please Note: For the most up-to-date version of this

manual, please see our web site at

www.supermicro.com.

Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this manual at any time and without notice. This product, including software and
documentation, is the property of Supermicro and/or its licensors, and is supplied only under a
license. Any use or reproduction of this product is not allowed, except as expressly permitted by
the terms of said license.

IN NO EVENT WILL SUPERMICRO BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL,
SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO
USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF
SUCH DAMAGES. IN PARTICULAR, SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY
HARDWARE, SOFTW ARE, OR DA TA STORED OR USED WITH THE PRODUCT, INCLUDING THE
COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH
HARDWARE, SOFTWARE, OR DATA.

Any disputes arising between manufacturer and customer shall be governed by the laws of Santa
Clara County in the State of California, USA. The State of California, County of Santa Clara shall
be the exclusive venue for the resolution of any such disputes. Super Micro's total liability for all
claims will not exceed the price paid for the hardware product.

FCC Statement: This equipment has been tested and found to comply with the limits for a Class
A digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide
reasonable protection against harmful interference when the equipment is operated in a commercial
environment. This equipment generates, uses, and can radiate radio frequency energy and, if not
installed and used in accordance with the manufacturer’s instruction manual, may cause harmful
interference with radio communications. Operation of this equipment in a residential area is likely
to cause harmful interference, in which case you will be required to correct the interference at your
own expense.

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate
warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See

www.dtsc.ca.gov/hazardouswaste/perchlorate”

WARNING: Handling of lead solder materials used in this
product may expose you to lead, a chemical known to
the State of California to cause birth defects and other
reproductive harm.

Revision 1.0
Release Date: June 25, 2015

Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.

Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.

Copyright © 2015 by Super Micro Computer, Inc.
All rights reserved.

Printed in the United States of America

iii

Preface

Preface

About This Manual

This manual is written for professional system integrators and PC technicians. It
provides information for the installation and use of the FatTwin™ F628G3-FT+/FTPT+.
Installation and maintainance should be performed by experienced technicians only .

The FatTwin F628G3-FT+/FTPT+ is a high-end server based on the
F424AG-R2K04BP 4U rackmount chassis and a dual processor X10DRFF-iG/iTG
serverboard. All models have four serverboard nodes, each node with an IPMI
LAN port and two (2) hot-swap hot-swap 3.5" SATA Hard Disk Drives (HDD).
The only difference between the two server models is that the F628G3-FTPT+
has 10-Gigabit LAN ports, wheras the F628G3-FT+ only has Gigabit LAN ports.

Manual Organization

Chapter 1: Introduction

The fi rst chapter provides a checklist of the main components included with
the server system and describes the main features of the X10DRFF-iG/iTG
serverboards and the F424AG-R2K04BP chassis.

Chapter 2: Server Installation

This chapter describes the steps necessary to install the FatTwin F628G3-FT+/FTPT+
into a rack and check out the server confi guration prior to powering up the system.
If your server was ordered without processor and memory components, this chapter
will refer you to the appropriate sections of the manual for their installation.

Chapter 3: System Interface

Refer here for details on the system interface, which includes the functions and
information provided by the control panel on the chassis as well as other LEDs
located throughout the system.

Chapter 4: Standardized Warning Statements for AC Systems

You should thoroughly familiarize yourself with this chapter for a general overview
of safety precautions that should be followed when installing and servicing the
FatTwin F628G3-FT+/FTPT+.

FatTwin F628G3-FT+/FTPT+ User's Manual

iv

Chapter 5: Advanced Serverboard Setup

Chapter 5 provides detailed information on the X10DRFF-iG/iTG serverboards,
including the locations and functions of connections, headers and jumpers. Refer
to this chapter when adding or removing processors or main memory and when
reconfi guring the serverboard.

Chapter 6: Advanced Chassis Setup

Refer to Chapter 6 for detailed information on the F424AG-R2K04BP server chassis.
You should follow the procedures given in this chapter when installing, removing or
reconfi guring SATA or peripheral drives and when replacing system power supply
units and cooling fans.

Chapter 7: BIOS

The BIOS chapter includes an introduction to BIOS and provides detailed information
on running the CMOS Setup Utility.

Appendix A: System Specifi cations

v

FatTwin F628G3-FT+/FTPT+ User's Manual

Notes

vi

Table of Contents

Chapter 1 Introduction

1-1 Overview .........................................................................................................1-1

1-2 Serverboard Features .....................................................................................1-2

Processors ......................................................................................................1-2

Memory ...........................................................................................................1-2

Serial ATA ....................................................................................................... 1-3

PCI Expansion Slots .......................................................................................1-3

Onboard Controllers/Ports .............................................................................. 1-3

Graphics Controller .........................................................................................1-3

Aspeed AST2400 Controller .......................................................................... 1-3

Other Features Supported by the Aspeed AST2400 Controller ................1-4

Power Supply .................................................................................................. 1-4

Super I/O ......................................................................................................... 1-5

1-3 Server Chassis Features ................................................................................ 1-5

System Power ................................................................................................. 1-5

SATA Subsystem ............................................................................................. 1-5

I/O Ports ..........................................................................................................1-5

Cooling System ............................................................................................... 1-5

Air Shrouds ..................................................................................................... 1-6

Mounting Rails ................................................................................................ 1-6

1-4 Advanced Power Management ....................................................................... 1-6

Intel® Intelligent Power Node Manager (NM) .................................................1-6

Manageability Engine (ME) ............................................................................. 1-6

1-5 Contacting Supermicro ....................................................................................1-8

1-6 Fat Twin: System Notes .................................................................................. 1-9

Nodes ..............................................................................................................1-9

System Power ................................................................................................. 1-9

SATA Backplane/Drives ................................................................................... 1-9

Chapter 2 Server Installation

2-1 Overview .........................................................................................................2-1

2-2 Unpacking the System .................................................................................... 2-1

2-3 Preparing for Setup ......................................................................................... 2-1

2-4 Warnings and Precautions .............................................................................. 2-2

Choosing a Setup Location .............................................................................2-2

Rack Precautions ............................................................................................ 2-2

Server Precautions ..........................................................................................2-2

FatTwin F628G3-FT+/FTPT+ User's Manual

vii

Rack Mounting Considerations ....................................................................... 2-3

Ambient Operating Temperature ................................................................ 2-3

Reduced Airfl ow ......................................................................................... 2-3

Mechanical Loading ................................................................................... 2-3

Circuit Overloading ..................................................................................... 2-3

Reliable Ground ......................................................................................... 2-4

2-5 Rack Mounting Instructions .............................................................................2-4

Identifying the Sections of the Rack Rails ...................................................... 2-4

Adjusting the Rails ..........................................................................................2-5

Locking Tabs ................................................................................................... 2-5

Installing the Rails on a Rack ......................................................................... 2-6

Chassis Installation .........................................................................................2-7

2-6 Checking the Serverboard Setup ....................................................................2-8

2-7 Checking the Drive Bay Setup ........................................................................2-9

Chapter 3 System Interface

3-1 Overview .........................................................................................................3-1

3-2 F424AG Front I/O Control Panel .................................................................... 3-1

Control Panel Buttons ..................................................................................... 3-2

3-3 Drive Carrier LEDs .......................................................................................... 3-3

Chapter 4 Standardized Warning Statements for AC Systems

4-1 About Standardized Warning Statements ....................................................... 4-1

Warning Defi nition ...........................................................................................4-1

Installation Instructions ....................................................................................4-4

Circuit Breaker ................................................................................................ 4-5

Power Disconnection Warning ........................................................................ 4-6

Equipment Installation ..................................................................................... 4-8

Restricted Area ................................................................................................ 4-9

Battery Handling ............................................................................................4-10

Redundant Power Supplies .......................................................................... 4-12

Backplane Voltage ........................................................................................4-13

Comply with Local and National Electrical Codes ........................................ 4-14

Product Disposal ........................................................................................... 4-15

Hot Swap Fan Warning .................................................................................4-16

Power Cable and AC Adapter ...................................................................... 4-18

Table of Contents

viii

Chapter 5 Advanced Serverboard Setup

5-1 Handling the Serverboard ............................................................................... 5-1

Precautions .....................................................................................................5-1

Unpacking .......................................................................................................5-1

5-2 Connecting Cables .......................................................................................... 5-2

Connecting Data Cables ................................................................................. 5-2

5-3 Control Panel Connectors and I/O Ports ........................................................ 5-2

5-4 Processor and Heatsink Installation................................................................5-3

Installing a Passive CPU Heatsink ................................................................. 5-7

Removing the Passive Heatsink ..................................................................... 5-8

5-5 Installing Memory ............................................................................................5-9

Removing Memory Modules ........................................................................... 5-9

Memory Support ............................................................................................5-10

5-6 Serverboard Details ...................................................................................... 5-12

5-7 Connector Defi nitions ....................................................................................5-15

5-8 Jumper Settings ............................................................................................ 5-19

Explanation of Jumpers ................................................................................ 5-19

5-9 Onboard Indicators ........................................................................................5-22

5-10 Serial ATA and SAS Connections .................................................................5-24

5-11 Installing Drivers ............................................................................................5-25

SuperDoctor 5 ............................................................................................... 5-26

5-12 Serverboard Battery ......................................................................................5-28

Chapter 6 Advanced Chassis Setup

6-1 Static-Sensitive Devices ..................................................................................6-1

Precautions .....................................................................................................6-1

Unpacking .......................................................................................................6-1

6-2 Control Panel ..................................................................................................6-2

6-3 Removing the Power Cord ..............................................................................6-3

6-4 Removing Nodes from the Chassis ................................................................ 6-3

6-5 Installing and Removing Hard Drives ............................................................. 6-4

Removing Hard Drives from the Front of the Node ........................................6-5

Installing 3.5" Hard Drives into the Drive Carriers ..........................................6-6

6-6 Node Confi gurations ....................................................................................... 6-8

6-7 Removing the Node Cover..............................................................................6-9

6-8 Removing and Installing the Backplane ........................................................6-10

Removing the Backplane .............................................................................. 6-10

Installing the Backplane .................................................................................6-11

6-9 Power Distributor Board Replacement ..........................................................6-12

FatTwin F628G3-FT+/FTPT+ User's Manual

6-10 Installing the Serverboard ............................................................................ 6-14

Compatible Motherboards ............................................................................. 6-14

Permanent and Optional Standoffs ...............................................................6-14

6-11 Installing Front and Rear Expansion Cards .................................................. 6-16

PCI-E Slot Setup ........................................................................................... 6-16

F424AG PCI-E Slot Confi gurations ............................................................... 6-16

Installing a Low-Profi le Expansion Card ....................................................... 6-17

6-12 Installing Internal GPUs ................................................................................6-18

Installing a Front Nvidia GPUs/Intel Xeon Phi into the GPU Bracket ......... 6-18

Installing a Front Nvidia GPUs/Intel Xeon Phi into the Node ......................6-18

Installing Rear Nvidia GPUs/Intel Xeon Phi into the Bracket ...................... 6-19

Installing Rear Nvidia GPUs/Intel Xeon Phi into a Node ............................ 6-20

6-13 Installing the Air Shroud ................................................................................6-21

Air Shrouds ................................................................................................... 6-21

6-14 Checking the Airfl ow ....................................................................................6-22

Installation Complete .....................................................................................6-22

6-15 Replacing System Fans ................................................................................ 6-23

6-16 Replacing the Power Supply .........................................................................6-24

Power Supply Replacement ..........................................................................6-24

Chapter 7 BIOS

7-1 Introduction ......................................................................................................7-1

Starting BIOS Setup Utility ..............................................................................7-1

How To Change the Confi guration Data ......................................................... 7-1

Starting the Setup Utility .................................................................................7-2

7-2 Main Setup ...................................................................................................... 7-2

7-3 Advanced Setup Confi gurations...................................................................... 7-3

7-4 Event Logs .................................................................................................... 7-41

7-5 IPMI ............................................................................................................... 7-43

7-6 Security Settings ........................................................................................... 7-45

7-7 Boot Settings ................................................................................................. 7-46

7-8 Save & Exit ................................................................................................... 7-48

Appendix A System Specifi cations

ix

Table of Contents

x

Notes

FatTwin F628G3-FT+/FTPT+ User's Manual

Chapter 1

Introduction

1-1 Overview

The FatTwin F628G3-FT+/FTPT+ is a high-end server comprised of four main
subsystems: the F424AG-R2K04BP 4U server chassis and the X10DRFF-iG/iTG
dual processor serverboard in four hot-swap nodes. Please refer to our web site for
information on operating systems that have been certifi ed for use with the system
(www.supermicro.com).

In addition to the serverboard and chassis, various hardware components have
been included with the SuperServer F628G3-FT+/FTPT+ server, as listed below:

• Heatsinks:

Four (4) 1U passive high-performance CPU heat sinks with narrow ILM
(SNK-P0057PS)
Four (4) 1U passive CPU heat sinks with narrow ILM (SNK-P0047PSC)

• Four (4) air shrouds for F424AG/BG chassis (MCP-310-42405-0B)

• Four (4) Air blocks for F424AG/BG systems (MCP-310-42406-0B)

• Power Adapter Boards:

Four (4) FatTwin power adapter boards (BPN-ADP-F418L-O-P)
Four (4) FatTwin 2U GPU power adapter boards (BPN-ADP-2UGPU-O-P)

• SATA Backplane:

Four (4) 10-cm and 7-cm 18AWG 8-pin male to two 4-pin male power cables
(CBL-0460L-02)
Four (4) 35-cm 16AWG 8-pin female to 8-pin female 12V CPU power cables
(CBL-PWEX-0705)
Eight (8) 21-cm 30AWG SATA S-S cables (CBL-0473L)
Eight (8) black hot swap 3.5" HDD trays (MCP-220-00094-0B)

• Riser Cards:

Four (4) riser cards (RSC-F2F-6-O-P)
Four (4) riser cards (RSC-R2UFF-2E16B-O-P)

• One (1) F418/F424 rail set (MCP-290-41803-0N)

Chapter 1: Introduction

1-1

1-2

FatTwin F628G3-FT+/FTPT+ User's Manual

Note: For your system to work properly, please follow the links below to download
all necessary drivers/utilities and the user’s manual for your server.

• Supermicro product manuals: http://www.supermicro.com/support/manuals/

• Product drivers and utilities: ftp://ftp.supermicro.com

• Product safety information:

http://www.supermicro.com/about/policies/safety_information.cfm

• If you have any questions, please contact our support team at:

[e-mail]

1-2 Serverboard Features

At the heart of the FatTwin F628G3-FT+/FTPT+ lies the X10DRFF-iG/iTG, a
dual processor serverboard based on the Intel® C612 chipset and designed to
provide maximum performance. Two of these serverboards can be mounted in the
F424AG-R2K04BP chassis.

The sections below cover the main features of the X10DRFF-iG/iTG serverboard
(see Figure 1-1 for a block diagram of the chipset).

Processors

The X10DRFF-iG/iTG supports single or dual Intel® Xeon® E5-2600 v3 family
processors (Socket R3 LGA 2011). Each processor supports four full-width Intel
QuickPath Interconnect (QPI) links, with support of up to 25.6 GT/s per QPI link
and with Data Transfer Rate of up to 9.6 GT/s per direction. Please refer to the
serverboard description pages on our web site for a complete listing of supported
processors (www.supermicro.com).

Memory

Each X10DRFF-iG/iTG serverboard node has sixteen (16) DIMM slots supporting
up to 1 TB of LRDIMM registered ECC or up to 512 GB of RDIMM ECC at
DDR4-2133/1866/1600 MHz speeds and up to 4 GB, 8 GB, 16 GB or 32 GB sizes
at 1.2V voltages. See Chapter 5 for details.

Note: For the latest CPU/memory updates, please refer to our website at

http://www.supermicro.com/products/serverboard.

1-3

Chapter 1: Introduction

Serial ATA

A Serial ATA controller is integrated into the C612 to provide up to ten (10) SATA

3.0 connections, including six (6) SATA 3.0 ports supported by Intel PCH (I-SATA
0-5) and four (4) SATA 3.0 with 4 connections supported by the PCH (S-SATA 0-3) .

These drives support RAID 0, 1, 5 and 10 capabiltiy. The SATA drives are hot­swappable units.

Note: The operati ng system yo u use must h ave R AID su ppor t to e nable t he hot­swap capability and RAI D function of the SATA drives.

PCI Expansion Slots

Each node in the the FatTwin F628G3-FT+/FTPT+ server has the following available
PCI-E slots for the node:

• 1x PCI-E 3.0 x16 slot

• 2x PCI-E 3.0 x8 low-profi le, half-length slots

• 1x PCI-E 3.0 x32 right riser slot

Onboard Controllers/Ports

One Fast UART 16550 serial port is located on the serverboard. The I/O ports
include one VGA (monitor) port, two USB 3.0 ports, an IPMI dedicated LAN port
and either two Gigabit or two 10GBased-T Ethernet ports.

Note: For IPMI Confi guration Instructions, please refer to the Embedded IPMI
Configuration User's Guide available at http://www.supermicro.com/support/

manuals/.

Graphics Controller

The X10DRFF-iG/iTG features an integrated Aspeed AST2400 BMC Controller for
onboard graphics capability.

Aspeed AST2400 Controller

Note: The term "IPMI controller" and the term "BMC controller" can be used

interchangeably in this section.
The Aspeed AST2400 Controller, a Baseboard Management Controller (BMC),

supports 2D/VGA-compatible Graphic Cores with PCI interface, creating multi-media
virtualization via Keyboard/Video/Mouse Redirection (KVMR). The WPCM450R
Controller is ideal for remote system management.

1-4

FatTwin F628G3-FT+/FTPT+ User's Manual

The Aspeed AST2400 Controller interfaces with the host system via PCI connections
to communicate with the graphics cores. It supports USB 3.0 and 2.0 for remote
keyboard/mouse/virtual media emulation. It also provides LPC interface support to
control Super IO functions. The Aspeed AST2400 is connected to the network via
an external Ethernet PHY module or shared NCSI connections.

The Aspeed AST2400 communicates with onboard components via six SMBus
interfaces, PECI (Platform Environment Control Interface) buses, and General
Purpose I/O ports.

Other Features Supported by the Aspeed AST2400 Controller

The Aspeed AST2400 supports the following features:

• IPMI 2.0

• Serial over LAN

• KVM over LAN

• LAN Alerting-SNMP Trap

• Event Log

• X-Bus parallel interface for I/O expansion

• Multiple ADC inputs, Analog and Digital Video outputs

• SPI Flash Host BIOS and fi rmware bootstrap program supported

• Reduced Media Independent Interface (RMII)

• OS (Operating System) Independency

• Provides remote Hardware Health Monitoring via IPMI. Key features

• Provides Network Management Security via remote access/console redirection.

• Supports the following Management tools: IPMIView, CLI (Command Line

Interface)

• RMCP+ protocol supported

Note: For more information on IPMI confi guration, please refer to the IPMI User's
Guide posted on our website at http://www.supermicro.com/support/manuals/.

Power Supply

Please connect the power cable from the SMC-Proprietary Adaptor (BPN-ADP­F418L) to the serverboard in order to provide power to the system.

1-5

Chapter 1: Introduction

Super I/O

The Super I/O provides functions that comply with ACPI (Advanced Confi guration
and Power Interface), which includes support of legacy and ACPI power
management through an SMI or SCI function pin. It also features auto power
management to reduce power consumption.

1-3 Server Chassis Features

The following is a general outline of the main features of the F424AG server chassis.

System Power

The F424AG chassis model includes four high-effi ciency 96%+ Titanium certifi ed
redundant 2000 Watt power supplies. In the unlikely event your power supply fails,
replacement is simple and can be accomplished without tools.

SATA Subsystem

Each node in F424AG chassis supports two (2) hot-swap 3.5" SATA drives in trays
for for a total of eight (8) drives in the system. These drives are hot-swappable units
and are connected to backplanes (that provides power and control).

Note: The operating system you use must have RAID support to enable the
hot-swap capability of the drives. For more information, visit our Web site at:

http://www.supermicro.com.

I/O Ports

The F424AG is an proprietary form factor chassis designed to be used in a 4U
rackmount confi guration. The F424AG chassis provides two low-profi le add-on card
slots, a VGA port, two USB 3.0 ports, one IPMI Ethernet port and either two Gigabit
(F628G3-FT+) or 10-Gigabit (F628G3-FTPT+) Ethernet ports per node.

Cooling System

The F424AG chassis accepts eight (8) 8-cm system fans powered from either the
backpane or the serverboards. When one of the serverboard nodes is removed,
another serverboard will continue to operate the fans.

1-6

FatTwin F628G3-FT+/FTPT+ User's Manual

Air Shrouds

The F424AG chassis requires mylar air shrouds for each node to direct the airfl ow
where cooling is needed. The air shroud will differ for different motherboards. If using
a serverboard which is not the default in the chassis, refer to the optional parts in
the Appendix of this manual, or the Supermicro Web site at

www.supermicro.com

to puchase the proper air shroud.

Mounting Rails

The F424AG includes a set of rails, and can be placed in a rack for secure storage
and use. To setup your rack, follow the step-by-step instructions included in this
manual.

1-4 Advanced Power Management

Intel® Intelligent Power Node Manager (NM)

The Intel® Intelligent Power Node Manager (IPNM) provides your system with
real-time thermal control and power management for maximum energy effi ciency.
Although IPNM Specifi cation Version 1.5 is supported by the BMC (Baseboard
Management Controller), your system must also have IPNM-compatible
Manageability Engine (ME) fi rmware installed to use this feature.

Manageability Engine (ME)

The Manageability Engine, which is an ARC controller embedded in the IOH (I/O
Hub), provides Server Platform Services (SPS) to your system. The services
provided by SPS are different from those proveded by the ME on client platforms.

1-7

Chapter 1: Introduction

Figure 1-1. Intel C612 Chipset:

System Block Diagram

Note: This is a general block diagram and may not exactly repre-

sent the features on your serverboard. See the previous pages for

the actual specifi cations of your serverboard. This block diagram is

intended for your reference only.

SPI

LAN3

RGRMII

Debug Card

FRONT PANEL

SYSTEM POWER

CTRL

FAN SPEED

PCI-E X1 G2

USB 2.0

X10DRFF-iG Rev. 1.00

PCH

6.0 Gb/S

LPC

SATA

RTL8211E

-VB-CG

RJ45

BIOS

SPI

SPI

Temp Sensor

EMC1402-1 *2 at di SMBUS

TPM HEADER

USB 3.0

USB

BIOS

HEADER

SPI

AST2400

BMC

RMII/NCSI

COM1

VGA CONN

BMC
Boot Flash

DDR3

5 PHASE
145W

P1

P1

P0

VR12.5

P0

QPI

9.6G

DMI2

PCI-E X16 G3

DMI2

DMI2

SNB CORE

DDR4

SNB CORE

DDR4

QPI

9.6G

5 PHASE
145W

VR12.5

#3

I350/
X540

LAN

PCI-E X8

SBX2 PCI-E X16 X16 Proprietary Slot

SLOT2 PCI-E x8

PCI-E X8 G3

PCI-E X16 G3

PCI-E X16 G3

#1

#2-8

SXB1; PCI-E X16 Proprietary Slot

PCI-E X8 G3

Slot1 PCI-E X8

SLOT3 PCI-E X4 in X8

PCI-E X4 G2

LSI3008

SAS3

PCI-E X8 G3

Port 4-7

AHCI

SCU

6.0 Gb/S

#2 #3A #1 #2 #3

CPU1

CPU2

#2-7

#2-6

#2-5

#2-4

#2-3

#2-2

1600/2133

DDR4

#2-1

1600/2133

DDR4

#1-4

#1-3

#1-2

#1-1

#1-5

#1-6

#1-7

#1-8

Header

Mini SAS

Port 0-3

0-5

SATA

0-3

RJ45

RJ45

HD

Mini SAS

HD

1-8

FatTwin F628G3-FT+/FTPT+ User's Manual

1-5 Contacting Supermicro

Headquarters

Address: Super Micro Computer, Inc.

980 Rock Ave.

San Jose, CA 95131 U.S.A.
Tel: [phone]
Fax: [phone]
Email: [e-mail] (General Information)

[e-mail] (Technical Support)
Website:

www.supermicro.com

Europe

Address: Super Micro Computer B.V.

Het Sterrenbeeld 28, 5215 ML

's-Hertogenbosch, The Netherlands
Tel: [phone]
Fax: [phone]
Email: [e-mail] (General Information)

[e-mail] (Technical Support)

[e-mail] (Customer Support)
Website:

www.supermicro.nl

Asia-Pacifi c

Address: Super Micro Computer, Inc.

3F, No. 150, Jian 1st Rd.

Zhonghe Dist., New Taipei City 235

Taiwan (R.O.C)
Tel: [phone]
Fax: [phone]
Email: [e-mail]
Website:

www.supermicro.com.tw

1-9

Chapter 1: Introduction

1-6 Fat Twin: System Notes

As a FatTwin confi guration, the FatTwin F628G3-FT+/FTPT+ is a unique server
system. With four system boards incorporated into a single chassis acting as four
separate nodes, there are several points you should keep in mind.

Nodes

Each of the four serverboards act as a separate node in the system. As independant
nodes, each may be powered off and on without affecting the others. In addition,
each node is a hot-swappable unit that may be removed from the rear of the chassis.
The nodes are connected to the server backplane by means of an adapter card.

Note: A guide pin is located between the upper and lower nodes on the inner chassis
wall. This guide pin also acts as a “stop” when a node is fully installed. If too much
force is used when inserting a node this pin may break off. Take care to slowly slide
a node in until you hear the “click” of the locking tab seating itself.

System Power

Four 2000 Watt power supplies are used to provide the power for all serverboards.
Each serverboard however, can be shut down independently of the other with the
power button on its own control panel.

SATA Backplane/Drives

As a system, the FatTwin F628G3-FT+/FTPT+ supports the use of eight (8) 3.5"
Hot-swap SATA drives. Each of the four backplanes in the system works to apply
system-based control for power and fan speed functions, yet at the same time
logically connects a set of two (2) hot-swap SATA drives to each backplane/
serverboard. Consequently, RAID setup is limited to a two drive scheme (RAID
cannot be spread across all drives). See Chapter 6 for the logical hard drive and
node confi guration.

1-10

FatTwin F628G3-FT+/FTPT+ User's Manual

Notes

Chapter 2: Server Installation

2-1

Chapter 2

Server Installation

2-1 Overview

This chapter provides a quick setup checklist to get your FatTwin F628G3-FT+/­FTPT+ up and running. Following these steps in the order given should enable
you to have the system operational within a minimum amount of time. This quick
setup assumes that your system has come to you with the processors and memory
preinstalled. If your system is not already fully integrated with a serverboard,
processors, system memory etc., please turn to the chapter or section noted in
each step for details on installing specifi c components.

2-2 Unpacking the System

You should inspect the box the FatTwin F628G3-FT+/-FTPT+ was shipped in and
note if it was damaged in any way. If the server itself shows damage you should
fi le a damage claim with the carrier who delivered it.

Decide on a suitable location for the rack unit that will hold the FatTwin F628G3­FT+/-FTPT+. It should be situated in a clean, dust-free area that is well ventilated.
Avoid areas where heat, electrical noise and electromagnetic fi elds are generated.
You will also need it placed near a grounded power outlet. Read the Rack and
Server Precautions in the next section.

2-3 Preparing for Setup

The box the FatTwin F628G3-FT+/-FTPT+ was shipped in should include two sets
of rail assemblies, two rail mounting brackets and the mounting screws you will
need to install the system into the rack. Follow the steps in the order given to
complete the installation process in a minimum amount of time. Please read this
section in its entirety before you begin the installation procedure outlined in the
sections that follow.

2-2

FatTwin F628G3-FT+/-FTPT+ User's Manual

2-4 Warnings and Precautions

Choosing a Setup Location

• Leave enough clearance in front of the rack to enable you to open the front door

completely (~25 inches) and approximately 30 inches of clearance in the back
of the rack to allow for suffi cient airfl ow and ease in servicing.

• This product is for installation only in a Restricted Access Location (dedicated

equipment rooms, service closets and the like).

• This product is not suitable for use with visual display work place devices

acccording to §2 of the the German Ordinance for Work with Visual Display Units.

Rack Precautions

• Ensure that the leveling jacks on the bottom of the rack are fully extended to

the fl oor with the full weight of the rack resting on them.

• In single rack installation, stabilizers should be attached to the rack. In multiple

rack installations, the racks should be coupled together.

• Always make sure the rack is stable before extending a component from the

rack.

• You should extend only one component at a time - extending two or more

simultaneously may cause the rack to become unstable.

Server Precautions

• Review the electrical and general safety precautions in Chapter 4.

• Determine the placement of each component in the rack before you install the

rails.

• Install the heaviest server components on the bottom of the rack fi rst, and then

work up.

• Use a regulating uninterruptible power supply (UPS) to protect the server from

power surges, voltage spikes and to keep your system operating in case of a
power failure.

• Allow any hot plug drives and power supply modules to cool before touching

them.

• Always keep the rack's front door and all panels and components on the servers

closed when not servicing to maintain proper cooling.

Chapter 2: Server Installation

2-3

Rack Mounting Considerations

Warning! To prevent bodily injury when mounting or servicing this unit in a

rack, you must take special precautions to ensure that the system remains stable. The
following guidelines are provided to ensure your safety:

• This unit should be mounted at the bottom of the rack if it is the only unit in

the rack.

• When mounting this unit in a partially fi lled rack, load the rack from the bottom

to the top with the heaviest component at the bottom of the rack.

• If the rack is provided with stabilizing devices, install the stabilizers before

mounting or servicing the unit in the rack.

Ambient Operating Temperature

If installed in a closed or multi-unit rack assembly, the ambient operating
temperature of the rack environment may be greater than the ambient temperature
of the room. Therefore, consideration should be given to installing the equipment
in an environment compatible with the manufacturer’s maximum rated ambient
temperature (Tmra).

Reduced Airfl ow

Equipment should be mounted into a rack so that the amount of airfl ow required
for safe operation is not compromised.

Mechanical Loading

Equipment should be mounted into a rack so that a hazardous condition does not
arise due to uneven mechanical loading.

Circuit Overloading

Consideration should be given to the connection of the equipment to the power
supply circuitry and the effect that any possible overloading of circuits might have
on overcurrent protection and power supply wiring. Appropriate consideration of
equipment nameplate ratings should be used when addressing this concern.

2-4

FatTwin F628G3-FT+/-FTPT+ User's Manual

Reliable Ground

A reliable ground must be maintained at all times. To ensure this, the rack
itself should be grounded. Particular attention should be given to power supply
connections other than the direct connections to the branch circuit (i.e. the use of
power strips, etc.).

2-5 Rack Mounting Instructions

This section provides information on installing the chassis into a rack unit with the
rails provided. There are a variety of rack units on the market, which may mean that
the assembly procedure will differ slightly from the instructions provided. You should
also refer to the installation instructions that came with the rack unit you are using.

Note: This rail will fi t a rack between 26.5" and 36.4" deep. The SCF418 is not
designed for installation into a Telco post-style rack unit.

Warning: Do not pick up the server with the front handles. They are designed

to pull the system from a rack only.

Stability Hazard: The rack stabilizing mechanism must be in place, or the
rack must be bolted to the fl oor before you slide the unit out for servicing. Failure to
stabilize the rack can cause the rack to tip over.

Warning: Slide rail mounted equipment is not to be used as a shelf or a work
space.

Warning: When initially installing the server to a rack, test that the rail locking tabs
engage to prevent the server from being overextended. Have a rack lift in place as
a precaution in case the test fails.

Warning: In any instance of pulling the system from the rack, always use a rack
lift and follow all associated safety precautions.

Identifying the Sections of the Rack Rails

The chassis package includes two rail assemblies in the rack mounting kit. Each
assembly consists of two sections: A front section which secures to the front post
of the rack and a rear section which adjusts in length and secures to the rear post
of the rack. These assemblies are specifi cally designed for the left and right side
of the chassis (see Figure 2-1).

Chapter 2: Server Installation

2-5

Figure 2-1: Identifying the Outer Rail and Inner Rails

(Left Rail Assembly Shown)

Inner Rail

This Side Faces

Outward

Adjusting Screw

Outer Rail

Locking Tab

Adjusting the Rails

Each rail assembly has an adjusting screw. loosening this screw allows you to adjust
the length of the rail to fi t a variety of rack sizes.

Locking Tabs

Each inner rail has a locking tab. This tab locks the chassis into place when installed
and pushed fully into the rack. These tabs also lock the chassis in place when fully
extended from the rack. This prevents the server from coming completely out of
the rack when when the chassis is pulled out for servicing.

2-6

FatTwin F628G3-FT+/-FTPT+ User's Manual

Installing the Rails on a Rack

Installing the Rails

1. Adjust the length of both rails as described on the previous page.

2. Align the front section of the outer rail with the slots on the front post of the
rack. Secure the front of the outer rail to the rack with two screws.

3. Pull out the rear section of the outer rail, adjusting the length until it fi ts within
the posts of the rack.

4. Align the rear section of the rail with the slots on the rear post of the rack.
Secure the rear of the outer rail to the rear of the rack with two screws.

5. Repeat steps 1-4 for the remaining rail.

Figure 2-2: Attaching the Rails to a Rack

Chapter 2: Server Installation

2-7

Note: The fi gure above is for illustration purposes only. Always install servers to
the bottom of the rack fi rst.

Figure 2-3: Installing into a Rack

Chassis Installation

Installing the Chassis into a Rack

1. Confi rm that the rails are correctly installed on the rack.

2. Align the bottom of the chassis with the bottom of the rails.

3. Insert the chassis into the rails, keeping the pressure even on both sides,
pushing the chassis into the rack until it clicks into the locked position.

4. Secure the chassis handles to the front of the rack.

2-8

FatTwin F628G3-FT+/-FTPT+ User's Manual

2-6 Checking the Serverboard Setup

After you install the FatTwin F628G3-FT+/-FTPT+ in the rack, you will need to open
the unit to make sure the serverboard is properly installed and all the connections
have been made.

Accessing the inside of the System

Before operating the server for the fi rst time, it is important to remove the protective
fi lm covering the top of the chassis, in order to allow for proper ventilation and

cooling.

Warning: Except for short periods of time, do NOT operate the server without
the cover in place. The chassis cover must be in place to allow proper airfl ow
and prevent overheating.

Checking the Components and Setup

1. You may have one or two processors already installed into the serverboard.
Each processor needs its own heat sink. See Chapter 5 for instructions on
processor and heat sink installation.

2. Your FatTwin F628G3-FT+/-FTPT+ server system may have come with
system memory already installed. Make sure all DIMMs are fully seated in
their slots. For details on adding system memory, refer to Chapter 5.

3. If desired, you can install add-on cards to the system. See Chapter 5 for
details on installing PCI add-on cards.

4. Make sure all power and data cables are properly connected and not blocking
the chassis airfl ow. Also make sure that no cables are positioned in front of
the fans. See Chapter 5 for details on cable connections.

Chapter 2: Server Installation

2-9

2-7 Checking the Drive Bay Setup

Next, you should check to make sure the peripheral drives and the SATA drives
have been properly installed and all connections have been made.

Checking the Drives

1. All drives are accessable from the front of the server. A hard drive can be
installed and removed from the front of the chassis without removing the top
chassis cover.

2. Depending upon your system's confi guration, your system may have one or
more drives already installed. If you need to install hard drives, please refer to
Chapter 6.

Checking the Airfl ow

1. Make sure there are no objects to obstruct airfl ow in and out of the server. In
addition, if you are using a front bezel, make sure the bezel's fi lter is replaced
periodically.

2. Do not operate the server without drives or drive trays in the drive bays. Use
only recommended server parts.

3. Make sure that no wires or foreign objects obstruct air fl ow through the
chassis. Pull all excess cabling out of the airfl ow path or use shorter cables.
The control panel LEDs inform you of the system status. See “Chapter 3
System Interface” for details on the LEDs and the control panel buttons.

Providing Power

1. Plug the power cord(s) from the power supply unit(s) into a high-quality
power strip that offers protection from electrical noise and power surges. It is
recommended that you use an uninterruptible power supply (UPS).

2. Depress the power on button on the front of the chassis.

2-10

FatTwin F628G3-FT+/-FTPT+ User's Manual

Notes