The information in this User’s Manual has been carefully reviewed and is believed to be accurate.
The vendor assumes no responsibility for any inaccuracies that may be contained in this document,
makes no commitment to update or to keep current the information in this manual, or to notify any
person or organization of the updates. Please Note: For the most up-to-date version of this
manual, please see our web site at www.supermicro.com.
Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this manual at any time and without notice. This product, including software and documentation, is the property of Supermicro and/or its licensors, and is supplied only under a license.
Any use or reproduction of this product is not allowed, except as expressly permitted by the terms
of said license.
IN NO EVENT WILL SUPERMICRO BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL,
SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO
USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF
SUCH DAMAGES. IN PARTICULAR, SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY
HARDWARE, SOFTW ARE, OR DA TA STORED OR USED WITH THE PRODUCT, INCLUDING THE
COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH
HARDWARE, SOFTWARE, OR DATA.
Any disputes arising between manufacturer and customer shall be governed by the laws of Santa
Clara County in the State of California, USA. The State of California, County of Santa Clara shall
be the exclusive venue for the resolution of any such disputes. Super Micro's total liability for all
claims will not exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class A
digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable
protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio frequency energy and, if not installed
and used in accordance with the manufacturer’s instruction manual, may cause harmful interference
with radio communications. Operation of this equipment in a residential area is likely to cause harmful
interference, in which case you will be required to correct the interference at your own expense.
California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”
WARNING: Handling of lead solder materials used in this
product may expose you to lead, a chemical known to the
State of California to cause birth defects and other reproductive harm.
Manual Revision 1.0
Release Date: November 16, 2010
Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.
Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.
This manual is written for professional system integrators and PC technicians. It
provides information for the installation and use of the SuperServer 6026TT-GTRF/
GIBXRF/GIBQRF. Installation and maintenance should be performed by experienced technicians only.
The SuperServer 6026TT-GTRF/GIBXRF/GIBQRF is a GPU-ready, 2U Twin (two
serverboards/nodes in a 2U chassis) rackmount server based on the SC827HDR1400B server chassis and four Super X8DTT-HF+/X8DTT-HIBXF+/X8DTTHIBQF+ serverboards. The "(H)" in the product name indicates that the system is
cableless.
The main differences between the various serverboards and the servers they are
in is shown in the table below:
Preface
Model Variations (Differences between X8DTT-x Models)
X8DTT-HF+X8DTT-HIBXF+X8DTT-HIBQF+
IPMI 2.0 w/ KVM
Over LAN
Infi niBand
Connection
DDR IB
QDR IB
YesYesYes
NoYesYes
NoYesNo
NoNoYes
Manual Organization
Chapter 1: Introduction
The fi rst chapter provides a checklist of the main components included with the
server system and describes the main features of the Super X8DTT-HF+/X8DTTHIBXF+/X8DTT-HIBQF+ serverboard and the SC827HD-R1400B chassis.
Chapter 2: Server Installation
This chapter describes the steps necessary to install the SuperServer 6026TTGTRF/HDIBXRF/HDIBQRF into a rack and check out the server confi guration prior
to powering up the system. If your server was ordered without the processor and
memory components, this chapter will refer you to the appropriate sections of the
manual for their installation.
Refer to this chapter for details on the system interface, which includes the functions
and information provided by the control panel on the chassis as well as other LEDs
located throughout the system.
Chapter 4: System Safety
You should thoroughly familiarize yourself with this chapter for a general overview
of safety precautions that should be followed when installing and servicing the
SuperServer 6026TT-GTRF/HDIBXRF/HDIBQRF.
Chapter 5: Advanced Serverboard Setup
Chapter 5 provides detailed information on the X8DTT-HF+/X8DTT -HIBXF+/X8DTT HIBQF+ serverboard, including the locations and functions of connectors, headers
and jumpers. Refer to this chapter when adding or removing processors or main
memory and when reconfi guring the serverboard.
Chapter 6: Advanced Chassis Setup
Refer to Chapter 6 for detailed information on the SC827HD-R1400B 2U rackmount
server chassis. You should follow the procedures given in this chapter when installing, removing or reconfi guring SATA or peripheral drives and when replacing system
power supply units and cooling fans.
Chapter 7: BIOS
The BIOS chapter includes an introduction to BIOS and provides detailed information on running the CMOS Setup Utility.
Appendix A: BIOS Error Beep Codes
Appendix B: Installing Windows
Appendix C: System Specifi cations
B-1 Installing Windows for a RAID System ...........................................................B-1
B-2 Installing Windows for a Non-RAID System ...................................................B-2
viii
Chapter 1: Introduction
Chapter 1
Introduction
1-1 Overview
The SuperServer 6026TT-GTRF/GIBXRF/GIBQRF is a "2U Twin" server comprised
of the SC827HD-R1400B 2U chassis and two X8DTT-HF+/X8DTT-HIBXF+/X8DTTHIBQF+ serverboards. Please refer to our web site for information on operating
systems that have been certifi ed for use with the server (www.supermicro.com).
In addition to the serverboard and chassis, various hardware components may have
been included with the system, as listed below.
Four passive CPU heatsinks (SNK-P0037P; two for each node))
•
Four 8-cm cooling fans (FAN-0111L4)•
Two air shrouds•
SATA Accessories: •
Twelve hard drive carriers (six per node) (MCP-220-00075-0B)
One internal HDD backplane (BPN-SAS-827HD)
At the heart of the SuperServer 6026TT are four X8DTT-HF+/X8DTT-HIBXF+/
X8DTT-HIBQF+ dual processor serverboards. The X8DTT-HF+ is based on Intel's
5500 (North Bridge) + ICH10R (South Bridge) chipset while the X8DTT-HIBXF+/
X8DTT-HIBQF+ is based on Intel's 5520 (North Bridge) + ICH10R (South Bridge)
chipset. Below are the main features of the serverboards. Note that the features on
each board are doubled for the server, which includes two nodes.
Processors
Each X8DTT-HF+/X8DTT-HIBXF+/X8DTT-HIBQF+ supports two Intel® 5600/5500
Series processors in LGA1366 sockets. Please refer to our web site for a complete
listing of supported processors (www.supermicro.com).
Memory
Each X8DTT-HF+/X8DTT-HIBXF+/X8DTT-HIBQF+ has twelve DIMM sockets that
can support up to 192 GB of registered ECC DDR3-1333/1066/800 SDRAM, or
48 GB of Unbuffered ECC/Non-ECC 1333/1066/800 MHz memory. See Chapter 5
Section 6 for more details on installing memory into the system.
Serial ATA
The Sout h Br idg e (ICH10R) of the c hips et inc lude s a Ser ial ATA contr olle r for s ix
Gb/s SATA d rives. The hot-swappable SATA drives are connected to a backplane
that provides power, bus termination and confi guration settings. RAI D 0, 1, 10 and
5 are suppo r ted. Refe r to the su ppo r t area o f our web si te for p roc edur es on s etting up RAID on your system.
PCI Expansion Slots
Each X8DTT-HF+/X8DTT-HIBXF+/X8DTT-HIBQF+ has included riser cards that
allow it to support one full-sized PCI Express x16 expansion card, or two total for
the server. (Double-width GPU cards are also supported.)
Ethernet Ports
An Intel® network controller is integrated into each of the serverboards to support
two Gigabit LAN ports (100/1000Base-T/1000BaseTX, RJ45 output).
1-2
Chapter 1: Introduction
Onboard Controllers/Ports
Onboard I/O backpanel ports on each serverboard include one COM port, a VGA
port, two USB ports, a dedicated IPMI LAN port and two Gigabit LAN (NIC) ports.
An Infi niBand port is also included on the X8DT T- HIBXF+/HIB QF+ serverboards
(the 6026TT-GIBXRF and 6026TT-GIBQRF only). Up to fo ur USB 2.0 (Unive rsal
Serial Bus) connections are on each of the servers. There are four sets of I/O ports
included in the server (one set for each serverboard).
Graphics Controller
The X8DTT-HF+/X8DTT-HIBXF+/X8DTT-HIBQF+ features an integrated Matrox
G200eW graphics chip, which includes 16 MB of DDR2 memory.
Other Features
Other onboard features that promote system health include voltage monitors, autoswitching voltage regulators, chassis and CPU overheat sensors, virus protection
and BIOS rescue.
Infi niBand
Both the 6026TT-GIBXRF and 6026TT-GIBQRF include an Infi niBand port at
DDR (dual dat a rate) and QDR (quad data rate) speed s, respect ively. Infi niBand
is a scalable serial communications link intended for connecting processors with
high-speed peripherals. (Infi niBand requires a QSFP connector.)
Note1: This is a general block diagram. Please see Chapter 5 for details.
Note2: The Intel 5500 (IOH-24D) chipset is available for OEM only.
1-4
Chapter 1: Introduction
1-3 Server Chassis Features
The following is a general outline of the main features of the SC827HD-R1400B 2U
chassis. Details on the chassis can be found in Chapter 6.
System Power
When confi gured as a SuperServer 6026TT-GTRF/GIBXRF/GIBQRF , the SC827HD-
R1400B includes a redundant (dual) 1400W power supply, which provides power
to all four serverboards (nodes). If either power supply failes, the other will allow
the system to continue to run.
SATA Subsystem
The SC827HD-R1400B chassis was designed to support twelve SATA hard
drives , which a re hot- swappabl e units. T here are s ix hard dr ives pe r node in t he
system.
Control Panel
The SC827HD-R1400B features two independant control panels associated with
each serverboard (node) in the chassis. Each control panel has LEDs to indicate
power on, network activity, power fail, fan fail, system overheat conditions and the
UID LED. Each control panel also includes a main power button and a UID button.
Rear I/O Panel
The SC827HD-R1400B is a 2U rackmount chassis. Each node supports two
full-height, full-length PCI expansion cards (or one double-width card), one COM
port, two USB ports, one VGA port and two Gb Ethernet ports. See Chapter 6 for
details.
Cooling System
The SC827HD-R1400B chassis has an innovative cooling design that features four
8-cm high-performance fans. A fan speed control setting in BIOS allows fan speed
to be determined by system temperature. See Chapter 6 for details.
As a 2U Twin confi guration, the 6026TT-GTRF/GIBXRF/GIBQRF is a unique server
system. With two system boards incorporated into a single chassis acting as two
separate nodes, there are several points you should keep in mind.
Nodes
Each of the two serverboards act as a separate node in the system. As independant
nodes, each may be powered off and on without affecting the others. In addition,
each node is a hot-swappable unit that may be removed from the rear of the chassis.
The nodes are connected to the server backplane by means of an adapter card.
System Power
The server has an additional 1400W power supply module (two total) for power
redundancy. If a power supply module fails the other backup module will keep the
system running until it can be replaced.
SATA Backplane/Drives
As a system, the 6026TT-GTRF/GIBXRF/GIBQRF supports the use of twelve SAT A
drives (six per node). A single backplane works to apply system-based control for
power and fan speed functions, yet at the same time logically connects a set of
six SATA drives to each serverboard. Consequently, RAID setup is limited to a
six-drive scheme (RAID cannot be spread across all twelve drives). See the Drive Bay Installation/Removal section in Chapter 6 for the logical hard drive and node
confi guration.
1-5 GPU Subsystem
The 6026TT-GTRF/GIBXRF/GIBQRF is a GPU-ready server. It can support two
GPUs (one in each node) with multiple x16 non-blocking native Gen2 PCI-Express
connectivity.
Notes: The GPUs process complex image calculations and then route the data out
through the VGA port on the serverboard.
This chapter provides a quick setup checklist to get the 6026TT-GTRF/GIBXRF/
GIBQRF up and running. Following these steps in the order given should enable
you to have the system operational within a minimum amount of time. This quick
setup assumes that your system has come to you with the processors and memory
preinstalled. If your system is not already fully integrated with a serverboard, processors, system memory etc., please turn to the chapter or section noted in each
step for details on installing specifi c components.
2-2 Unpacking the System
You should inspect the box the system was shipped in and note if it was damaged
in any way. If the server itself shows damage you should fi le a damage claim with
the carrier who delivered it.
Decide on a suitable location for the rack unit that will hold the server. It should be
situated in a clean, dust-free area that is well ventilated. Avoid areas where heat,
electrical noise and electromagnetic fi elds are generated. You will also need it placed
near a grounded power outlet. Be sure to read the Rack and Server Precautions
in the next section.
2-3 Preparing for Setup
The box the server was shipped in should include the rackmount hardware needed
to install the system into the rack. Follow the steps in the order given to complete
the installation process in a minimum amount of time. Please read this section in
its entirety before you begin the installation procedure outlined in the sections that
follow.
Leave enough clearance in front of the rack to enable you to open the front •
door completely (~25 inches).
•
Leave approximately 30 inches of clearance in the back of the rack to allow for
suffi cient airfl ow and ease in servicing.
This product is for installation only in a Restricted Access Location (dedicated
•
equipment rooms, service closets and the like).
This product is not suitable for use with visual display work place devices accord-
•
ing to §2 of the the German Ordinance for Work with Visual Display Units.
Warnings and Precautions!
Rack Precautions
Ensure that the leveling jacks on the bottom of the rack are fully extended to •
the fl oor with the full weight of the rack resting on them.
In single rack installation, stabilizers should be attached to the rack.
•
In multiple rack installations, the racks should be coupled together.•
Always make sure the rack is stable before extending a component from it.•
You should extend only one component at a time - extending two or more si-•
multaneously may cause the rack to become unstable.
Server Precautions
Review the electrical and general safety precautions in Chapter 4.•
Determine the placement of each component in the rack • before you install the
rails.
Install the heaviest server components on the bottom of the rack fi rst, and then
•
work up.
Use a regulating uninterruptible power supply (UPS) to protect the server from
•
power surges, voltage spikes and to keep your system operating in case of a
power failure.
2-2
Chapter 2: Server Installation
Allow the hot plug SATA drives and power supply modules to cool before touch-•
ing them.
Always keep the rack's front door and all panels and components on the servers
•
closed when not servicing to maintain proper cooling.
•
Make sure all power and data cables are properly connected and not blocking
the chassis airfl ow. See Chapter 5 for details on cable connections.
Rack Mounting Considerations
Ambient Operating Temperature
If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the ambient temperature of the
room. Therefore, consideration should be given to installing the equipment in an
environment compatible with the manufacturer’s maximum rated ambient temperature (Tmra).
Reduced Airfl ow
Equipment should be mounted into a rack so that the amount of airfl ow required
for safe operation is not compromised.
Mechanical Loading
Equipment should be mounted into a rack so that a hazardous condition does not
arise due to uneven mechanical loading.
Circuit Overloading
Consideration should be given to the connection of the equipment to the power
supply circuitry and the effect that any possible overloading of circuits might have
on overcurrent protection and power supply wiring. Appropriate consideration of
equipment nameplate ratings should be used when addressing this concern.
Reliable Ground
A reliable ground must be maintained at all times. To ensure this, the rack itself
should be grounded. Particular attention should be given to power supply connections other than the direct connections to the branch circuit (i.e. the use of power
strips, etc.).
Before operating the server for the fi rst time, it is important to remove the protec-
tive fi lm covering the top of the chassis, in order to allow for proper ventilation and
cooling.
Removing the Protective Film
Peel off the protective fi lm covering the top cover and the top of the chassis1.
Check that all ventilation openings on the top cover and the top of the chassis 2.
are clear and unobstructed.
Figure 2-1: Removing the Protective Film
1
1
Check Ventilation
Openings
2
1
Warning: Except for short periods of time, do NOT operate the server
without the cover in place. The chassis cover must be in place to
allow proper airfl ow and prevent overheating.
2-4
Chapter 2: Server Installation
2-4 Rack Mounting Instructions
This section provides information on installing the SC827 chassis into a rack unit
with the quick-release rails provided. There are a variety of rack units on the market,
which may mean the assembly procedure will differ slightly. Y ou should also refer to
the installation instructions that came with the rack unit you are using.
Note: This rail will fi t a rack between 26" and 33.5" deep.
Separating the Sections of the Rack Rails
The chassis package includes two rail assemblies in the rack mounting kit. Each
assembly consists of two sections: an inner fi xed chassis rail that secures directly
to the server chassis and an outer fi xed rack rail that secures directly to the rack
itself.
Figure 2-2. Separating the Rack Rails
1
1
2
1
3
1
4
1
Rail Assembly
Extending the Rails
Quick-
Release Tab
Separating
the Inner Rail
Extension
Separating the Inner and Outer Rails
Locate the rail assembly in the chassis 1.
packaging.
Extend the rail assembly by pulling it 2.
outward.
Press the quick-release tab.3.
Separate the inner rail extension from 4.
the outer rail assembly.
The SC827 chassis includes a set of inner rails in two sections: inner rails and inner
rail extensions. The inner rails are pre-attached to the chassis, and do not interfere
with normal use of the chassis if you decide not to use a server rack. The inner rail
extension is attached to the inner rail to mount the chassis in the rack.
Installing the Inner Rails
Place the inner rail extensions on the side of the chassis aligning the hooks 1.
of the chassis with the rail extension holes. Make sure the extension faces
"outward" just like the pre-attached inner rail.
Slide the extension toward the front of the chassis.2.
Secure the chassis with 2 screws as illustrated. Repeat steps for the other 3.
inner rail extension.
Figure 2-3. Installing the Inner Rail Extensions
3
1
1
1
2
1
3
1
2-6
Chapter 2: Server Installation
3
1
1
1
2
1
Figure 2-4: Assembling the Outer Rails
Outer Rack Rails
Outer rails attach to the rack and hold the chassis in place. The outer rails for the
SC827 chassis extend between 30 inches and 33 inches.
Installing the Outer Rails to the Rack
Secure the back end of the outer rail to the rack, using the screws provided. 1.
Press the button where the two outer rails are joined to retract the smaller 2.
outer rail.
Hang the hooks of the rails onto the rack holes and if desired, use screws to 3.
secure the front of the outer rail onto the rack.
Align the inner rails of the chassis with the outer rails on the rack.2.
Slide the inner rails into the outer rails, keeping the pressure even on both 3.
sides. When the chassis has been pushed completely into the rack, it should
click into the locked position.
Optional screws may be used to secure the to hold the front of the chassis to 4.
the rack.
2-8
Chapter 2: Server Installation
2-5 Checking the Serverboard Setup
After you install the system in the rack, you will need to access the inside of the
nodes to make sure the serverboard is properly installed.
Accessing the Inside of a Node (Figure 2-6)
Before removing a node, unplug all the cables that connect to that node.1.
To remove a node, fi rst push the two latches (located near the handles) 2.
inward.
Grasp the handles and pull the node out from the rear of the chassis.3.
To remove the system from the rack completely, depress the locking tabs in 4.
the chassis rails (push the right-side tab down and the left-side tab up) to
continue to pull the system out past the locked position.
Checking the Components and Setup
You may have one or two processors already installed in each of the two 1.
serverboards. Each processor needs its own heatsink. See Chapter 5 for
instructions on processor and heatsink installation.
Your server system may have come with system memory already installed. 2.
Make sure all DIMMs are fully seated in their slots. For details on adding
system memory, refer to Chapter 5.
You can install one add-on card to each node for a total of two for the 3.
system. See Chapter 5 for details on installing PCI add-on cards.
Make sure all power and data cables are properly connected and not blocking 4.
the chassis airfl ow. See Chapter 5 for details on cable connections.
Next, you should check to make sure the SA TA drives and the backplane have been
properly installed and all connections have been made.
Checking the SATA drives
The SATA disk drives are accessable from the front of the server and can be 1.
installed and removed from the front of the chassis without removing the top
chassis cover.
Depending upon your system's confi guration, your system may have one or 2.
more drives already installed. If you need to install SATA drives, please refer
to Chapter 6.
Checking the Airfl ow
Airfl ow is provided by four 8-cm PWM fans and (for each serverboard) one 1.
air shroud. The system component layout was carefully designed to direct
suffi cient cooling airfl ow to the components that generate the most heat.
Note that all power and data cables have been routed in such a way that they 2.
do not block the airfl ow generated by the fans.
Providing Power
Plug the power cords from the power supplies unit into a high-quality power 1.
strip that offers protection from electrical noise and power surges.
It is recommended that you use an uninterruptible power supply (UPS).2.
Finally, depress the power on button on the front of the chassis.3.
There are LEDs on the control panels and on the SATA drive carriers to keep you
constantly informed of the overall status of the system as well as the activity and
health of specifi c components. There are also two buttons on each control panel.
This chapter explains the meanings of all LED indicators and the appropriate response you may need to take. Note that the server has two control panels, one for
each serverboard (node) installed in the system. This allows each severboard to
be controlled independently of the other.
3-2 Control Panel Buttons
There are two push-buttons located on each control panel: a power on/off button
and a UID button.
Power
This is the main power button, which is used to apply or turn off the main system
power only to the node it is connected to. Depressing this button removes the main
power but keeps standby power supplied to the serverboard. This button has an
LED built into it, which will illuminate when its node is powered on.
UID
Depressing the UID (unit identifi er) button illuminates an LED on both the front and
rear of the chassis for easy system location in large stack confi gurations. The LED
will remain on until the button is pushed a second time. Another UID button on the
rear of the chassis serves the same function. This button has an LED built into it,
which will illuminate when either the front or rear UID button is pushed.
In addition to the LEDs built into the power and UID buttons, each of the four control
panels located on the front of the SC827HD-R1400B chassis has two LEDs that
provide you with critical information related their own node. This section explains
what each LED indicates when illuminated and any corrective action you may need
to take.
Overheat/Fan Fail
When this LED is solid on it indicates an overheat condition. When it fl ashes quickly
(~ once every second), it indicates a fan failure. When it fl ashes slowly (~ once every
four seconds) on the node A control panel, it indicates a power supply failure. An
overheat condition may be caused by cables obstructing the airfl ow in the system
or the ambient room temperature being too warm. Check the routing of the cables
and make sure all fans are present and operating normally. You should also check
to make sure that the chassis cover is properly installed. Finally, verify that the
heatsinks are installed properly (see Chapter 5). This LED will remain fl ashing or
on as long as the indicated condition exists.
NIC
Indicates network activity on any of the LAN ports when fl ashing
3-4 SATA Drive Carrier LEDs
Each SATA drive carrier has two LEDs.
Green:
• When illuminated, the green LED on the front of the SATA drive carrier
indicates drive activity. A connection to the SATA backplane enables this LED
to blink on and off when that particular drive is being accessed.
Red:
• The red LED serves two functions:
When solid on (not fl ashing), this LED indicates a hard drive failure.
•
When this LED fl ashes on and off it indicates the HDD is rebuilding.•
3-2
Loading...
+ 74 hidden pages
You need points to download manuals.
1 point = 1 manual.
You can buy points or you can get point for every manual you upload.