The information in this User’s Manual has been carefully reviewed and is believed to be accurate.
The vendor assumes no responsibility for any inaccuracies that may be contained in this document,
makes no commitment to update or to keep current the information in this manual, or to notify any
person or organization of the updates. Please Note: For the most up-to-date version of this
manual, please see our web site at www.supermicro.com.
Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this manual at any time and without notice. This product, including software, if any,
and documentation may not, in whole or in part, be copied, photocopied, reproduced, translated or
reduced to any medium or machine without prior written consent.
IN NO EVENT WILL SUPERMICRO BE LIABLE FOR DIRECT, INDIRECT , SPECIAL, INCIDENTAL,
SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO
USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF
SUCH DAMAGES. IN PARTICULAR, SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY
HARDWARE, SOFTW ARE, OR DA TA STORED OR USED WITH THE PRODUCT, INCLUDING THE
COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH
HARDWARE, SOFTWARE, OR DATA.
Any disputes arising between manufacturer and customer shall be governed by the laws of Santa
Clara County in the State of California, USA. The State of California, County of Santa Clara shall
be the exclusive venue for the resolution of any such disputes. Super Micro's total liability for
all claims will not exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class
A digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide
reasonable protection against harmful interference when the equipment is operated in a commercial
environment. This equipment generates, uses, and can radiate radio frequency energy and, if not
installed and used in accordance with the manufacturer’s instruction manual, may cause harmful
interference with radio communications. Operation of this equipment in a residential area is likely
to cause harmful interference, in which case you will be required to correct the interference at your
own expense.
California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate
warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”
WARNING: Handling of lead solder materials used in this
product may expose you to lead, a chemical known to
the State of California to cause birth defects and other
reproductive harm.
Manual Revision 1.0a
Release Date: July 20, 2009
Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.
Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.
This manual is written for professional system integrators and PC technicians.
It provides information for the installation and use of the SuperServer 6016TTTF/6016TT-IBXF/6016TT-IBQF. Installation and maintenance should be performed
by experienced technicians only.
The SuperServer 6016TT-TF/6016TT-IBXF/6016TT-IBQF is a 1U Twin (two serverboards in a 1U chassis) rackmount server based on the SC808T-1200B chassis
and two Super X8DTT-F/X8DTT-IBXF/X8DTT-IBQFserverboards.
Manual Organization
Preface
Chapter 1: Introduction
The fi rst chapter provides a checklist of the main components included with the
server system and describes the main features of the Super X8DTT-F/X8DTT-IBXF/
X8DTT-IBQF serverboard and the SC808T-1200B chassis.
Chapter 2: Server Installation
This chapter describes the steps necessary to install the SuperServer 6016TTTF/6016TT-IBXF/6016TT-IBQF into a rack and check out the server confi guration
prior to powering up the system. If your server was ordered without the processor
and memory components, this chapter will refer you to the appropriate sections of
the manual for their installation.
Chapter 3: System Interface
Refer to this chapter for details on the system interface, which includes the functions
and information provided by the control panel on the chassis as well as other LEDs
located throughout the system.
You should thoroughly familiarize yourself with this chapter for a general overview
of safety precautions that should be followed when installing and servicing the
SuperServer 6016TT-TF/6016TT-IBXF/6016TT-IBQF.
Chapter 5: Advanced Serverboard Setup
Chapter 5 provides detailed information on the X8DTT-F/X8DTT-IBXF/X8DTT-IBQF
serverboard, including the locations and functions of connectors, headers and jumpers. Refer to this chapter when adding or removing processors or main memory
and when reconfi guring the serverboard.
Chapter 6: Advanced Chassis Setup
Refer to Chapter 6 for detailed information on the SC808T-1200B 1U rackmount
server chassis. You should follow the procedures given in this chapter when installing, removing or reconfi guring SAS/SATA or peripheral drives and when replacing
system power supply units and cooling fans.
Chapter 7: BIOS
The BIOS chapter includes an introduction to BIOS and provides detailed information on running the CMOS Setup Utility.
Appendix A BIOS Error Beep Codes
Appendix B Installing the Windows OS
Appendix C System Specifi cations
viii
Chapter 1: Introduction
Chapter 1
Introduction
1-1 Overview
The SuperServer 6016TT-TF/6016TT-IBXF/6016TT-IBQF is a "1U Twin" server
comprised of the SC808T-1200B 1U chassis and two (twin) X8DTT-F/X8DTT-IBXF/
X8DTT-IBQF serverboards. Please refer to our web site for information on operating
systems that have been certifi ed for use with the 6016TT-TF/6016TT-IBXF/6016TT -
IBQF (www.supermicro.com).
In addition to the serverboard and chassis, various hardware components may have
been included with the 6016TT-TF/6016TT-IBXF/6016TT-IBQF, as listed below.
Four (4) CPU heatsinks (SNK-P0037)
•
SATA Accessories: •
Four (4) SATA hard drive carriers [MCP-220-00001-03(01)]
One (1) internal SATA backplane (BPN-SAS-808)
One (1) SATA cable set (CBL-0201L)
Two (2) PCI Express x16 riser cards (RSC-R1U-E16R)
•
Six (6) 4-cm high-performance fans (FAN-0085L4) •
Rackmount hardware with screws (CSE-PT51L): •
Two (2) rack rail assemblies
Six (6) brackets for mounting the rack rails in a rack/telco rack
At the heart of the SuperServer 6016TT-TF/6016TT-IBXF/6016TT-IBQF lies two
X8DTT-F/X8DTT-IBXF/X8DTT-IBQF dual processor serverboards, which are based
on Intel's 5520 (North Bridge) + ICH10R (South Bridge) chipset. (For OEM only, the
Intel 5500 is also available for the North Bridge portion of the chipset.) Below are
the main features of the serverboards. Note that the features on each board are
doubled for the server, which includes two nodes.
Processors
Each X8DTT-F/X8DTT-IBXF/X8DTT-IBQF supports two Intel® 5500 Series processors in LGA1366 sockets. Please refer to our web site for a complete listing of
supported processors (www.supermicro.com).
Memory
Each X8DTT-F/X8DTT-IBXF/X8DTT-IBQF has six 240-pin DIMM sockets that can
support up to 48 GB of registered ECC DDR3-1333/1066/800 SDRAM (96 GB for
the system). See Chapter 5 Section 6 for more details on installing memory into
the system.
Serial ATA
The Sout h Br idg e (ICH10R) of the c hips et inc lude s a Ser ial ATA cont rol ler fo r six
Gb/s SATA drives . The hot-swappable SATA drives are connected to a backplane
that provides power, bus termination and confi guration settings. RA ID 0, 1, 10 and
5 are suppo r ted. Refe r to the su ppo r t area o f our web si te for p roc edur es on s etting up RAID on your system.
PCI Expansion Slots
Each X8DTT-F/X8DTT-IBXF/X8DTT-IBQF board has one PCI Express 2.0 x16
slot, so two PCI Express 2.0 x16 slots are provided in the server. In the 6016TTTF/6016TT-IBXF/6016TT-IBQF server confi guration, riser cards have been pre-
installed to support two low-profi le add-on cards.
Ethernet Ports
An Intel® network controller is integrated into each of the serverboards to support
two Gigabit LAN ports (100/1000Base-T/1000BaseTX, RJ45 output).
1-2
Chapter 1: Introduction
Onboard Controllers/Ports
Onboard I/O backpanel ports on each serverboard include one COM port, a VGA
port, two USB ports, a dedicated IPMI LAN port and two Gigabit LAN (NIC) ports.
An Infi niBand port is also included on the X8DTT-IBXF/X8DTT-IBQF serverboards
(the 6016TT-IBXF and 6016TT-IBQF only). There are two sets of I/O ports included
in the server (one set for each serverboard).
Graphics Controller
The X8DTT-F/X8DTT-IBXF/X8DTT-IBQF features an integrated Matrox G200eW
graphics chip, which includes 8 MB of DDR2 memory.
Other Features
Other onboard features that promote system health include voltage monitors, autoswitching voltage regulators, chassis and CPU overheat sensors, virus protection
and BIOS rescue.
Infi niBand
Both th e 6 016TT-IBXF a n d 6 016TT-IBQ F i nc l u de a n In fi niBand port at DDR (dual
data rate) and QD R (quad dat a r ate) speed s, re s pe c t ive ly. Infi niBand is a scalable
serial communications link intended for connecting processors with high-speed
peripherals. (Infi niBand requires a QSFP connector.)
Model Variations (Differences between X8DTT models)
Note: This is a general block diagram. Please see Chapter 5 for details.
1-4
Chapter 1: Introduction
1-3 Server Chassis Features
The following is a general outline of the main features of the SC808T-1200B 1U
chassis. Details on the chassis can be found in Chapter 6.
System Power
When confi gured as a SuperServer 6016TT-TF/6016TT-IBXF/6016TT-IBQF, the
SC808T-1200B includes a single high-effi ciency (Gold Level) 1200W cold-swap
power supply, which provides the power to both serverboards housed in the chassis.
SATA Subsystem
The SC808T-1200B chassis was designed to support four SAT A hard drives, which
are hot- swappa ble unit s.
Control Panel
The SC808T-1200B features two independant control panels associated with each
node (serverboard). Each control panel has LEDs to indicate power on, network
activity, hard disk drive activity and system overheat conditions. Each control panel
also includes a main power button and a system reset button.
Rear I/O Panel
The SC808T-1200B is a 1U rackmount chassis. Its I/O panel provides a slots for
two low-profi le PCI-E x16 expansion cards, two COM ports, four USB ports, two
VGA ports and four Gb Ethernet ports. See Chapter 6 for details.
Cooling System
The SC808T-1200B chassis has an innovative cooling design that features an air
shroud and three sets of 4-cm counter-rotating fans per node (confi gured as six
fans placed back to back in pairs). A fan speed control setting in BIOS allows fan
speed to be determined by system temperature.
As a 1U Twin confi guration, the 6016TT-TF/6016TT-IBXF/6016TT-IBQF is a unique
server system. With two nodes incorporated into a single chassis, there are several
points you should keep in mind.
System Power
A single power supply is used to provide the power for both serverboards. Each
serverboard however, can be shut down independently of the other with the power
button on its own control panel.
Although they share a common power supply , the I
monitoring are received by the primary serverboard only. (When viewed from the
front of the chassis, the serverboard on the left is referred to as the primary board
and the serverboard on the right as the secondary.)
2
C signals used for power supply
SATA Backplane/Drives
As a system, the 6016TT-TF/6016TT-IBXF/6016TT-IBQF supports the use of four
SATA drives. The SATA backplane works as a single backplane divided into two
sections. This means that while a single power connector is used and functions
such as overheating apply to both sections together, each pair of SATA drives is
logically connected to its own serverboard. Consequently, RAID setup is limited to
a two-drive scheme (RAID cannot be spread across all four drives).
This chapter provides a quick setup checklist to get your 6016TT-TF/6016TTIBXF/6016TT-IBQF up and running. Following these steps in the order given
should enable you to have the system operational within a minimum amount of
time. This quick setup assumes that your system has come to you with the processors and memory preinstalled. If your system is not already fully integrated with a
serverboard, processors, system memory etc., please turn to the chapter or section
noted in each step for details on installing specifi c components.
2-2 Unpacking the System
Y ou should inspect the box the 6016TT -TF/6016TT -IBXF/6016TT -IBQF was shipped
in and note if it was damaged in any way. If the server itself shows damage you
should fi le a damage claim with the carrier who delivered it.
Decide on a suitable location for the rack unit that will hold the 6016TT-TF/6016TTIBXF/6016TT-IBQF. It should be situated in a clean, dust-free area that is well
ventilated. Avoid areas where heat, electrical noise and electromagnetic fi elds are
generated. You will also need it placed near a grounded power outlet. Be sure to
read the Rack and Server Precautions in the next section.
2-3 Preparing for Setup
The box the 6016TT-TF/6016TT-IBXF/6016TT-IBQF was shipped in should include
two sets of rail assemblies, two rail mounting brackets and the mounting screws
you will need to install the system into the rack. Follow the steps in the order given
to complete the installation process in a minimum amount of time. Please read this
section in its entirety before you begin the installation procedure outlined in the
sections that follow.
Choosing a Setup Location
Leave enough clearance in front of the rack to enable you to open the front •
door completely (~25 inches).
Leave approximately 30 inches of clearance in the back of the rack to allow for •
suffi cient airfl ow and ease in servicing.
This product is for installation only in a Restricted Access Location (dedicated
•
equipment rooms, service closets and the like).
•
This product is not suitable for use with visual display work place devices according to §2 of the the German Ordinance for Work with Visual Display Units.
Warnings and Precautions!
Rack Precautions
Ensure that the leveling jacks on the bottom of the rack are fully extended to •
the fl oor with the full weight of the rack resting on them.
In single rack installation, stabilizers should be attached to the rack.
•
In multiple rack installations, the racks should be coupled together.•
Always make sure the rack is stable before extending a component from the •
rack.
You should extend only one component at a time - extending two or more si-
•
multaneously may cause the rack to become unstable.
Server Precautions
Review the electrical and general safety precautions in Chapter 4.•
Determine the placement of each component in the rack • before you install the
rails.
Install the heaviest server components on the bottom of the rack fi rst, and then
•
work up.
Use a regulating uninterruptible power supply (UPS) to protect the server from
•
power surges, voltage spikes and to keep your system operating in case of a
power failure.
Allow the hot plug SATA drives and power supply modules to cool before touch-
•
ing them.
2-2
Chapter 2: Server Installation
Always keep the rack's front door and all panels and components on the servers •
closed when not servicing to maintain proper cooling.
Make sure all power and data cables are properly connected and not blocking
•
the chassis airfl ow. See Chapter 5 for details on cable connections.
Rack Mounting Considerations
Ambient Operating Temperature
If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the ambient temperature of the
room. Therefore, consideration should be given to installing the equipment in an
environment compatible with the manufacturer’s maximum rated ambient temperature (Tmra).
Reduced Airfl ow
Equipment should be mounted into a rack so that the amount of airfl ow required
for safe operation is not compromised.
Mechanical Loading
Equipment should be mounted into a rack so that a hazardous condition does not
arise due to uneven mechanical loading.
Circuit Overloading
Consideration should be given to the connection of the equipment to the power
supply circuitry and the effect that any possible overloading of circuits might have
on overcurrent protection and power supply wiring. Appropriate consideration of
equipment nameplate ratings should be used when addressing this concern.
Reliable Ground
A reliable ground must be maintained at all times. To ensure this, the rack itself
should be grounded. Particular attention should be given to power supply connections other than the direct connections to the branch circuit (i.e. the use of power
strips, etc.).
This section provides information on installing the 6016TT-TF/6016TT -IBXF/6016TT IBQF into a rack unit with the rack rails provided. If the system has already been
mounted into a rack, you can skip ahead to Sections 2-5 and 2-6.
There are a variety of rack units on the market, which may mean the assembly
procedure will differ slightly. You should also refer to the installation instructions that
came with the rack unit you are using.
Identifying the Sections of the Rack Rails
You should have received two rack rail assemblies in the rack mounting kit. Each
assembly consists of two sections: an inner fi xed chassis rail that secures directly
to the server chassis and an outer fi xed rack rail that secures directly to the rack
itself (see Figure 2-1). Two pairs of short brackets to be used on the front side of
the outer rails are also included.
Installing the Inner Rails
Both the left and right side inner rails have been pre-attached to the chassis. Proceed to the next step.
Figure 2-1. Identifying the Sections of the Rack Rails
(right side rail shown)
2-4
Chapter 2: Server Installation
Installing the Outer Rails
Begin by measuring the distance from the front rail to the rear rail of the rack. Attach
a short bracket to the front side of the right outer rail and a long bracket to the rear
side of the right outer rail. Adjust both the short and long brackets to the proper
distance so that the rail can fi t snugly into the rack. Secure the short bracket to the
front side of the outer rail with two M4 screws and the long bracket to the rear side
of the outer rail with three M4 screws. Repeat these steps for the left outer rail.
Locking Tabs
Both chassis rails have a locking tab, which serves two functions. The fi rst is to
lock the server into place when installed and pushed fully into the rack, which is
its normal position. Secondly, these tabs also lock the server in place when fully
extended from the rack. This prevents the server from coming completely out of
the rack when you pull it out for servicing.
You should now have rails attached to both the chassis and the rack unit. The next
step is to install the server into the rack. Do this by lining up the rear of the chassis
rails with the front of the rack rails. Slide the chassis rails into the rack rails, keeping
the pressure even on both sides (you may have to depress the locking tabs when
inserting). See Figure 2-3.
When the server has been pushed completely into the rack, you should hear the
locking tabs "click".
Installing the Server into a Telco Rack
To install the SuperServer 6016TT-TF/6016TT-IBXF/6016TT-IBQF into a Telco type
rack, use two L-shaped brackets on either side of the chassis (four total). First,
determine how far the server will extend out the front of the rack. Larger chassis
should be positioned to balance the weight between front and back. If a bezel is
included on your server, remove it. Then attach the two front brackets to each side
of the chassis, then the two rear brackets positioned with just enough space to
accommodate the width of the rack. Finish by sliding the chassis into the rack and
tightening the brackets to the rack.
2-5 Checking the Serverboard Setup
After you install the 6016TT-TF/6016TT-IBXF/6016TT-IBQF in the rack, you will
need to open the top cover to make sure the serverboard is properly installed and
all the connections have been made.
Accessing the Inside of the System
Grasp the two handles on either side and pull the system straight out until it 1.
locks (you will hear a "click").
Remove the four screws (two on the sides and two on the top) that secure 2.
the top cover to the chassis. Place your thumbs in the two rectangular recesses and push the cover away from you (toward the rear of the chassis) until it
stops. You can then lift the top cover from the chassis to gain full access to
the inside of the server (see Figure 2-4).
To remove the system from the rack completely, depress the locking tabs in 3.
the chassis rails (push the right-side tab down and the left-side tab up) to
continue to pull the system out past the locked position.
2-6
Chapter 2: Server Installation
Figure 2-3. Installing the Server into a Rack
Checking the Components and Setup
You may have one or two processors already installed in each of the two 1.
serverboards. Each processor needs its own heatsink. See Chapter 5 for
instructions on processor and heatsink installation.
Your server system may have come with system memory already installed. 2.
Make sure all DIMMs are fully seated in their slots. For details on adding
system memory, refer to Chapter 5.
You can install two add-on cards to the system. See Chapter 5 for details on 3.
installing PCI add-on cards.
Make sure all power and data cables are properly connected and not blocking 4.
the chassis airfl ow. See Chapter 5 for details on cable connections.
Next, you should check to make sure the peripheral drives and the SATA drives
and SATA backplane have been properly installed and all connections have been
made.
Checking the SATA drives
The SATA disk drives are accessable from the front of the server and can be 1.
installed and removed from the front of the chassis without removing the top
chassis cover.
Depending upon your system's confi guration, your system may have one or 2.
more drives already installed. If you need to install SATA drives, please refer
to Chapter 6.
Checking the Airfl ow
Airfl ow is provided by an air shroud and three sets (six fans back to back) of 1.
4-cm counter-rotating PWM fans per node [for a total of two air shrouds and
six sets of fans (12 total) in the system]. The system component layout was
carefully designed to direct suffi cient cooling airfl ow to the components that
generate the most heat.
Note that all power and data cables have been routed in such a way that they 2.
do not block the airfl ow generated by the fans.
Providing Power
Plug the power cords from the power supplies unit into a high-quality power 1.
strip that offers protection from electrical noise and power surges.
It is recommended that you use an uninterruptible power supply (UPS).2.
Finally, depress the power on button on the front of the chassis.3.
There are several LEDs on the two control panels as well as others on the SATA
drive carriers to keep you constantly informed of the overall status of the system as
well as the activity and health of specifi c components. There are also two buttons
on each control panel. This chapter explains the meanings of all LED indicators and
the appropriate response you may need to take. Note that the server has two control
panels, one for each node in the system. This allows each node (serverboard) to
be controlled independently of the other.
3-2 Control Panel Buttons
There are two push-buttons located on each control panel: a reset button and a
power on/off button.
Reset
Depressing the reset button will reboot only the serverboard it is associated with.
Power
This is the main power button, which is used to apply or turn off the main system
power only to the node (serverboard) it is associated with. Depressing this button
removes the main power but keeps standby power supplied to the serverboard.
Each of the two control panels located on the front of the SC808T-1200B chassis has
fi ve LEDs. Each LED provides you with critical information related its own specifi c
serverboard. This section explains what each LED indicates when illuminated and
any corrective action you may need to take.
Overheat/Fan Fail
When this LED fl ashes, it indicates a fan failure. When on continuously it indicates
an overheat condition, which may be caused by cables obstructing the airfl ow in
the system or the ambient room temperature being too warm. Check the routing of
the cables and make sure all fans are present and operating normally. You should
also check to make sure that the chassis covers are installed. Finally, verify that
the heatsinks are installed properly (see Chapter 5). This LED will remain fl ashing
or on as long as the indicated condition exists.
2
NIC2
Indicates network activity on LAN2 when fl ashing
1
NIC1
Indicates network activity on LAN1 when fl ashing.
HDD
Channel activity for the hard disk drives. This light indicates SATA drive activity on
the 6016TT-TF/6016TT-IBXF/6016TT-IBQF when fl ashing.
3-2
Chapter 3: System Interface
Power
Indicates power is being supplied to the system's power supply unit. This LED should
normally be illuminated when the system is operating.
3-4 SATA Drive Carrier LEDs
Each SATA drive carrier has two LEDs.
Green:
• When illuminated, the green LED on the front of the SATA drive carrier
indicates drive activity. A connection to the SATA backplane enables this LED
to blink on and off when that particular drive is being accessed.
Red:
• There is no function associated with the red LED.