The information in this User’s Manual has been carefully reviewed and is believed to be accurate.
The vendor assumes no responsibility for any inaccuracies that may be contained in this document,
makes no commitment to update or to keep current the information in this manual, or to notify any
person or organization of the updates. Please Note: For the most up-to-date version of this
manual, please see our web site at www.supermicro.com.
Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this manual at any time and without notice. This product, including software and documentation, is the property of Supermicro and/or its licensors, and is supplied only under a license.
Any use or reproduction of this product is not allowed, except as expressly permitted by the terms
of said license.
IN NO EVENT WILL SUPERMICRO BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL,
SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO
USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF
SUCH DAMAGES. IN PARTICULAR, SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY
HARDWARE, SOFTW ARE, OR DA TA STORED OR USED WITH THE PRODUCT, INCLUDING THE
COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH
HARDWARE, SOFTWARE, OR DATA.
Any disputes arising between manufacturer and customer shall be governed by the laws of Santa
Clara County in the State of California, USA. The State of California, County of Santa Clara shall
be the exclusive venue for the resolution of any such disputes. Super Micro's total liability for all
claims will not exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class A
digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable
protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio frequency energy and, if not installed
and used in accordance with the manufacturer’s instruction manual, may cause harmful interference
with radio communications. Operation of this equipment in a residential area is likely to cause harmful
interference, in which case you will be required to correct the interference at your own expense.
California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”
WARNING: Handling of lead solder materials used in this
product may expose you to lead, a chemical known to the
State of California to cause birth defects and other reproductive harm.
Manual Revision 1.0
Release Date: August 7, 2013
Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.
Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.
This manual is written for professional system integrators and PC technicians. It
provides information for the installation and use of the SuperServer 5038ML-H8TRF .
Installation and maintenance should be performed by experienced technicians only .
Preface
The SuperServer 5038ML-H8TRF is an 8-node, MicroCloud
on the SC938BH-R1620B 3U chassis and eight X10SLD-F motherboards.
TM
server system based
Manual Organization
Chapter 1: Introduction
The fi rst chapter provides a checklist of the main components included with the
system and describes the main features of the Super X10SLD-F motherboard and
the SC938BH-R1620B chassis.
Chapter 2: Server Installation
This chapter describes the steps necessary to install the server into a rack and
check out the server confi guration prior to powering up the system. If your server
was ordered without the processor and memory components, this chapter will refer
you to the appropriate sections of the manual for their installation.
Chapter 3: System Interface
Refer to this chapter for details on the system interface, which includes the functions
and information provided by the control panel on the chassis as well as other LEDs
located throughout the system.
Chapter 4: Standardized Warning Statements
You should thoroughly familiarize yourself with this chapter for a general overview
of safety precautions that should be followed when installing and servicing the
SuperServer 5038ML-H8TRF.
iii
SUPERSERVER 5038ML-H8TRF User's Manual
Chapter 5: Advanced Motherboard Setup
Chapter 5 provides detailed information on the X10SLD-F motherboard, including
the locations and functions of connectors, headers and jumpers. Refer to this chapter when adding or removing processors or main memory and when reconfi guring
the motherboard.
Chapter 6: Advanced Chassis Setup
Refer to Chapter 6 for detailed information on the SC938BH-R1620B 3U server
chassis. You should follow the procedures given in this chapter when installing,
removing or reconfi guring drives and when replacing system power supply units
and cooling fans.
Chapter 7: BIOS
The BIOS chapter includes an introduction to BIOS and provides detailed information on running the CMOS Setup Utility.
7-8 Save & Exit ................................................................................................... 7-30
Appendix A BIOS Error Beep Codes
Appendix B System Specifi cations
viii
Chapter 1: Introduction
Chapter 1
Introduction
1-1 Overview
The SuperServer 5038ML-H8TRF is an eight node, MicroCloud server system
comprised of two main subsystems: the SC938BH-R1620B 3U chassis and eight
X10SLD-F motherboards. Please refer to our web site for information on operating
systems that have been certifi ed for use with the 5038ML-H8TRF (www.supermicro.
com).
In addition to the motherboards and chassis, various hardware components have
been included with the 5038ML-H8TRF, as listed below:
• Four chassis fans (FAN-0133L4)
• One passive heatsink, each node (SNK-P0047PS+)
• One air shroud, each node (MCP-310-93804-0B)
• One riser card, each node (RSC-RR1U-E8)
• One add-on card, each node (AOC-CGP-i2)
• SATA Accessories
One SATA backplane (BPN-SAS-938H)
Sixteen hot-swap hard drive carriers (MCP-220-00094-0B)
• One rail kit (MCP-290-00057-0N)
1-1
SUPERSERVER 5038ML-H8TRF User's Manual
1-2 Motherboard Features
The 5038ML-H8TRF includes a total of eight X10SLD-F single processor motherboards, which are based on the Intel C224 PCH chipset. Below are the main features
of the X10SLD-F. (See Figure 1-1 for a block diagram of the chipset).
Processors
Each X10SLD-F supports a single Intel® Xeon® E3-1200 v3 family or Intel 4th
Gen Core™ i3, Pentium or Celeron processor in an LGA 1150 socket (Socket H3).
Please refer to the motherboard description pages on our web site for a complete
listing of supported processors (www.supermicro.com).
Memory
The X10SLD-F has four DIMM slots that can support up to 32 GB of ECC UDIMM
DDR3-1600/1333/1066 memory. This equates to a maximum of 256 GB for the
system. Memory modules of the same size and speed should be used. See Chapter
5 for details.
SATA
Each X10SLD-F has a SA TA controller integrated into the chipset to provide four onboard SA T A 3.0 ports. T wo of these can be connected to the system's hot-swappable
SATA drives (two from each node for 16 total in the system).
Rear I/O Ports
The rear I/O panel includes one KVM connector, an IPMI port, a power LED and
buttons for UID (Unit Identifi cation) and power.
IPMI
IPMI (Intelligent Platform Management Interface) is a hardware-level interface specifi cation that provides remote access, monitoring and administration for Supermicro
server platforms. IPMI allows server administrators to view a server’s hardware
status remotely, receive an alarm automatically if a failure occurs, and power cycle
a system that is non-responsive.
Other Features
Other onboard features that promote system health include onboard voltage monitors, a chassis intrusion header, auto-switching voltage regulators, chassis and CPU
overheat sensors, virus protection and BIOS rescue.
1-2
Chapter 1: Introduction
Figure 1-1. Intel C224 Chipset:
System Block Diagram
Note: This is a general block diagram. See Chapter 5 for details.
PCIe x8 SLOT
PCIe x8 Micro-LP SLOT
SVID
VRM 12.5
MISC VRs
4 SATA PORTS
1 SATA PORT
1 USB PORT (Type A)
2 USB PORTS
2 USB PORTS (KVM)
TPM1.2 Header
FLASH SPI 128Mb
PCIe3.0_x8
PCIe3.0_x8
8.0Gb/s
USB2.0 X 1
480Mb/s
SATA-III
6.0Gb/s
SATA-II
(3.0Gb/s for-F, 6.0Gb/s for-HF)
USB3.0 X 1
5.0Gb/s
USB3.0 X 1
5.0Gb/s
USB2.0 X 3
480Mb/s
LPC
SPI
Haswell
(H3)
5.0Gb
x4 DMI II
Lynx Point
C224/C226
PCH
LPC
DDR3 (CHA)
1600/1333MHz
DDR3 (CHB)
1600/1333MHz
PCIe2.0 x1
LPC
ASPEED
ASP2400
RGMII
RTL8211E
PHY
RJ45
(1Gb)
DIMM1
DIMM2 (Far)
DIMM1
DIMM2 (Far)
VGA PORT
(KVM)
COM1 (KVM)
HEALTH
INFO
NCT6776D
LPC I/O
1-3
SUPERSERVER 5038ML-H8TRF User's Manual
1-3 Server Chassis Features
The following is a general outline of the main features of the SC938BH-R1620B
server chassis.
System Power
The SC938BH-R1620B features a redundant (two separate power modules) 1620W
Platinum Level, high-effi ciency power supply . This power redundancy feature allows
you to replace a failed power supply without shutting down the system.
Front Control Panel
The control panel on the 5038ML-H8TRF features a power button/LED, a power fail
LED and eight LEDs to indicate the status of each node in the system.
Cooling System
The SC938BH-R1620B chassis includes four 8-cm fans located behind the backplane. Each fan is associated with and controlled by two nodes. Each node also
has an air shroud to channel the airfl ow from the system fans to effi ciently cool the
components that generate the most heat. See Chapter 6 for details.
1-4
1-4 Contacting Supermicro
Headquarters
Address: Super Micro Computer, Inc.
980 Rock Ave.
San Jose, CA 95131 U.S.A.
Tel:+1 (408) 503-8000
Fax: +1 (408) 503-8008
Email: marketing@supermicro.com (General Information)
This chapter provides a quick setup checklist to get your 5038ML-H8TRF up and
running. Following these steps in the order given should enable you to have the
system operational within a minimum amount of time. This quick setup assumes
that your system has come to you with the processors and memory preinstalled.
2-2 Unpacking the System
You should inspect the box the 5038ML-H8TRF was shipped in and note if it was
damaged in any way. If the server itself shows damage you should fi le a damage
claim with the carrier who delivered it.
Decide on a suitable location for the rack unit that will hold the 5038ML-H8TRF.
It should be situated in a clean, dust-free area that is well ventilated. Avoid areas
where heat, electrical noise and electromagnetic fi elds are generated. You will also
need it placed near a grounded power outlet. Be sure to read the Rack and Server
Precautions in the next section.
2-3 Preparing for Setup
The 5038ML-H8TRF may have come with hardware to mount it into a server rack. If
mounting to a rack with the rail kit, follow the steps in the order given to complete the
installation process in a minimum amount of time. Please read this section in its entirety before you begin the installation procedure outlined in the sections that follow.
Choosing a Setup Location
• Leave enough clearance in front of the rack to enable you to open the front door
completely (~25 inches) and approximately 30 inches of clearance in the back
of the rack to allow for suffi cient airfl ow and ease in servicing.
• This product is for installation only in a Restricted Access Location (dedicated
equipment rooms, service closets and the like).
2-1
SUPERSERVER 5038ML-H8TRF User's Manual
• This product is not suitable for use with visual display work place devices
acccording to §2 of the the German Ordinance for Work with Visual Display Units.
2-4 Warnings and Precautions
Rack Precautions
• Ensure that the leveling jacks on the bottom of the rack are fully extended to
the fl oor with the full weight of the rack resting on them.
• In single rack installation, stabilizers should be attached to the rack. In multiple
rack installations, the racks should be coupled together.
• Always make sure the rack is stable before extending a component from it.
• You should extend only one component at a time - extending two or more si-
multaneously may cause the rack to become unstable.
Server Precautions
• Review the electrical and general safety precautions in Chapter 4.
• Determine the placement of each component in the rack before you install the
rails.
• Install the heaviest server components on the bottom of the rack fi rst, and then
work up.
• Use a regulating uninterruptible power supply (UPS) to protect the server from
power surges, voltage spikes and to keep your system operating in case of a
power failure.
• Allow the SATA drives and power supply modules to cool before touching them.
• Always keep the rack's front door and all panels and components on the servers
closed when not servicing to maintain proper cooling.
Rack Mounting Considerations
Ambient Operating Temperature
If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the ambient temperature of the
2-2
Chapter 2: Server Installation
room. Therefore, consideration should be given to installing the equipment in an
environment compatible with the manufacturer’s maximum rated ambient temperature (Tmra).
Reduced Airfl ow
Equipment should be mounted into a rack so that the amount of airfl ow required
for safe operation is not compromised.
Mechanical Loading
Equipment should be mounted into a rack so that a hazardous condition does not
arise due to uneven mechanical loading.
Circuit Overloading
Consideration should be given to the connection of the equipment to the power
supply circuitry and the effect that any possible overloading of circuits might have
on overcurrent protection and power supply wiring. Appropriate consideration of
equipment nameplate ratings should be used when addressing this concern.
Reliable Ground
A reliable ground must be maintained at all times. To ensure this, the rack itself
should be grounded. Particular attention should be given to power supply connections other than the direct connections to the branch circuit (i.e. the use of power
strips, etc.).
Warning! To prevent bodily injury when mounting or servicing this unit in a
rack, you must take special precautions to ensure that the system remains
stable. The following guidelines are provided to ensure your safety:
• This unit should be mounted at the bottom of the rack if it is the only unit in
the rack.
• When mounting this unit in a partially fi lled rack, load the rack from the bottom
to the top with the heaviest component at the bottom of the rack.
• If the rack is provided with stabilizing devices, install the stabilizers before
mounting or servicing the unit in the rack.
2-3
SUPERSERVER 5038ML-H8TRF User's Manual
2-5 Installing the System into a Rack
This section provides information on installing the chassis into a rack unit with the
rails provided. There are a variety of rack units on the market, which may mean
that the assembly procedure will differ slightly from the instructions provided. You
should also refer to the installation instructions that came with the rack unit you are
using. Note: This rail will fi t a rack between 26.5" and 36.4" deep.
Identifying the Sections of the Rack Rails
The chassis package includes two rail assemblies in the rack mounting kit. Each
assembly consists of three sections: An inner chassis rail that secures directly to
the chassis, an outer rail that secures to the rack, and a middle rail, which extends
from the outer rail. These assemblies are specifi cally designed for the left and right
side of the chassis.
Rail Assembly
(Shown with Rails
Retracted)
This Side Faces
Outward
Figure 2-1. Identifying the Outer, Middle and Inner Rails
Outer Rail
Middle Rail
Locking Tab
Inner Rail
(Left Rail Assembly Shown)
Warning: do not pick up the server with the front handles. They are de-
signed to pull the system from a rack only.
2-4
Chapter 2: Server Installation
Locking Tabs
Each inner rail has a locking tab. This tab locks the chassis into place when installed
and pushed fully into the rack. These tabs also lock the chassis in place when fully
extended from the rack. This prevents the server from coming completely out of
the rack when when the chassis is pulled out for servicing.
Releasing the Inner Rail
Releasing Inner Rail from the Outer Rails
1. Identify the left and right outer rail assemblies as described on the previous
page.
2. Pull the inner rail out of the outer rail until it is fully extended as illustrated
below.
3. Press the locking tab down to release the inner rail.
4. Repeat steps 1-3 for the remaining outer rail.
1
1
2
1
3
1
Figure 2-2. Extending and Releasing the Inner Rail
2-5
4
1
SUPERSERVER 5038ML-H8TRF User's Manual
4
1
Figure 2-3. Installing the Inner Rails
Inner Rails
2
1
3
1
1
4
Figure 2-4. Inner Rails Installed on the Chassis
Installing The Inner Rails on the Chassis
Installing the Inner Rails
1. Confi rm that the left and right inner rails have been correctly identifi ed.
2. Place the inner rail fi rmly against the side of the chassis, aligning the hooks
on the side of the chassis with the holes in the inner rail.
3. Slide the inner rail forward toward the front of the chassis until the rail clicks
into the locked position, which secures the inner rail to the chassis.
4. Secure the inner rail to the chassis with the screws provided.
5. Repeat steps 1 through 4 above for the other inner rail.
2-6
Chapter 2: Server Installation
1
1
4
1
2
1
3
1
Figure 2-5. Extending and Releasing the Outer Rails
Installing the Outer Rails on the Rack
Installing the Outer Rails
1. Press upward on the locking tab at the rear end of the middle rail.
2. Push the middle rail back into the outer rail.
3. Hang the hooks of the front of the outer rail onto the slots on the front of
the rack. If necessary, use screws to secure the outer rails to the rack, as
illustrated above.
4. Pull out the rear of the outer rail, adjusting the length until it fi ts within the
posts of the rack.
5. Hang the hooks of the rear portion of the outer rail onto the slots on the rear
of the rack. If necessary, use screws to secure the rear of the outer rail to the
rear of the rack.
6. Repeat steps 1-5 for the remaining outer rail.
Stability hazard. The rack stabilizing mechanism must be in place, or the
rack must be bolted to the fl oor before you slide the unit out for servicing.
Failure to stabilize the rack can cause the rack to tip over.
2-7
SUPERSERVER 5038ML-H8TRF User's Manual
Ball-Bearing
Shuttle
Figure 2-6. Installing the Chassis into a Rack
Standard Chassis Installation
1. Confi rm that the inner rails are properly installed on the chassis.
2. Confi rm that the outer rails are correctly installed on the rack.
3. Pull the middle rail out from the front of the outer rail and make sure that the
ball-bearing shuttle is at the front locking position of the middle rail.
4. Align the chassis inner rails with the front of the middle rails.
5. Slide the inner rails on the chassis into the middle rails, keeping the pressure
even on both sides, until the locking tab of the inner rail clicks into the front of
the middle rail, locking the chassis into the fully extended position.
6. Depress the locking tabs of both sides at the same time and push the chassis
all the way into the rear of the rack.
7. If necessary for security purposes, use screws to secure the chassis handles
to the front of the rack.
2-8
Chapter 2: Server Installation
Optional Quick Installation Method
The following quick installation method may be used to install the chassis onto a
rack.
1. Install the inner rails on the chassis as previously described on page 2-6.
2. Install the whole rail assembly onto the rack as described on page 2-7.
3. Release the inner rail without retracting the middle rail.
4. Install the chassis onto the middle rail as described in the previous section.
Note that these fi gures are for illustrative purposes only. Servers should always be
installed to racks from the bottom up.
Figure 2-7. Installing the Chassis into a Rack
2-9
SUPERSERVER 5038ML-H8TRF User's Manual
Notes
2-10
Chapter 3: System Interface
Chapter 3
System Interface
3-1 Overview
LEDs are included on the control panel, the motherboard nodes and on the drive
carriers to keep you constantly informed of the overall status of the system. The
SC938BH-R1620B features four separate control panels on the handles of the
chassis to control the nodes.
This chapter explains the meanings of all LED indicators and the appropriate response you may need to take.
3-2 Control Panel Buttons
Power Button/LED
The main power button on the control panel functions as both an on/off switch and
as an LED. The LED illuminates green when powered-on and is not illuminated
when powered-off.
• A quick press of less than fi ve seconds will sequentially power-on all of the
nodes in order from one to eight.
• Pressing the button for longer than fi ve seconds will sequentially power-
down the nodes in order from one to eight.
Turning off system power with this button removes the main power, but keeps
standby power supplied to the system. Therefore, you must completely unplug
system from any power source before servicing the chassis. This does not apply
to hot-swappable hard drives, motherboard nodes and system fans.
3-1
SUPERSERVER 5038ML-H8TRF User's Manual
3-3 LEDs
Power Failure LED
This red LED is illuminated only when a power failure occurs. The LED will illuminate
when any node is powered-on and one of the power supplies fails. This LED is off
during normal operation.
Node Status LEDs
The SC938BH-R1620B control panel features eight numbered node status LEDs,
which indicate the status of each motherboard node.
Figure 3-1. Node Status LEDs
LED AppearanceDescription
Solid GreenThe node is powered on and operating normally
Blinking GreenThe node is in the process of shutting down
Solid RedThe node is detecting an overheated condition
1Hz Blinking RedThe node is detecting a fan failure
.25Hz Blinking RedThe node is detecting a power failure
Solid BlueThe node local UID is on
1Hz Blinking BlueThe node remote UID is on
No IlluminationThe node is powered-down
3-2
Chapter 3: System Interface
3-4 Hard Drive Carrier LEDs
The hard drives ued in the SC938BH-R1620B chassis are installed in drive carriers.
Each drive carrier has two LEDs located on the front of the carrier.
• Green: Each drive carrier has a green LED. When illuminated, this LED indicates
drive activity. A connection to the SATA backplane enables this LED to blink on
and off when that particular drive is being accessed.
• Red: Indicates a drive failure. If one of the drives fail, you should also be notifi ed
by your system management software.
Figure 3-2. Hard Drive Carrier LEDs
Hard Drive Carrier LEDs
3-5 Node LEDs
Individual LEDS are located on the back of each motherboard node on the rear
of the chassis.
3-3
SUPERSERVER 5038ML-H8TRF User's Manual
Figure 3-3. Rear Node LED Indicators
Power Button
and LED
(Green)
UIO Button
and LED
(Blue)
Failure LED
(Red)
Power Button and LED
This button will power on the node individually . It is illuminated green when the node
is powered on, it is off (unilluminated ) when the node is powered off.
UIO Button and LED
This button is used to identify the node within the system. It is illuminated blue when
activated, it is off when inactive.
Failure LED
This LED is illuminated red when a failure has occurred and off during normal operation. If illuminated, check that the two corresponding hard drives are fully inserted
into their bays with their handles completely pushed in. Check also that the fan is
operating properly and that the node is fully inserted into its bay.
3-4
Chapter 4: Warning Statements for AC Systems
Chapter 4
Standardized Warning Statements for AC Systems
4-1 About Standardized Warning Statements
The following statements are industry standard warnings, provided to warn the user
of situations which have the potential for bodily injury. Should you have questions
or experience difficulty, contact Supermicro's Technical Support department
for assistance. Only certifi ed technicians should attempt to install or confi gure
components.
Read this appendix in its entirety before installing or confi guring components in the
Supermicro chassis.
These warnings may also be found on our web site at http://www.supermicro.com/
about/policies/safety_information.cfm.
Warning Defi nition
Warning!
This warning symbol means danger. You are in a situation that could cause bodily
injury. Before you work on any equipment, be aware of the hazards involved with
electrical circuitry and be familiar with standard practices for preventing accidents.
Warnung
WICHTIGE SICHERHEITSHINWEISE
Dieses Warnsymbol bedeutet Gefahr. Sie befi nden sich in einer Situation, die zu
Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den
Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung
vor Unfällen vertraut. Suchen Sie mit der am Ende jeder Warnung angegebenen
Anweisungsnummer nach der jeweiligen Übersetzung in den übersetzten
Sicherheitshinweisen, die zusammen mit diesem Gerät ausgeliefert wurden.
BEWAHREN SIE DIESE HINWEISE GUT AUF.
INSTRUCCIONES IMPORTANTES DE SEGURIDAD
Este símbolo de aviso indica peligro. Existe riesgo para su integridad física. Antes
de manipular cualquier equipo, considere los riesgos de la corriente eléctrica y
familiarícese con los procedimientos estándar de prevención de accidentes. Al
fi nal de cada advertencia encontrará el número que le ayudará a encontrar el texto
traducido en el apartado de traducciones que acompaña a este dispositivo.
GUARDE ESTAS INSTRUCCIONES.
IMPORTANTES INFORMATIONS DE SÉCURITÉ
Ce symbole d'avertissement indique un danger. Vous vous trouvez dans une
situation pouvant entraîner des blessures ou des dommages corporels. Avant
de travailler sur un équipement, soyez conscient des dangers liés aux circuits
électriques et familiarisez-vous avec les procédures couramment utilisées pour
éviter les accidents. Pour prendre connaissance des traductions des avertissements
fi gurant dans les consignes de sécurité traduites qui accompagnent cet appareil,
référez-vous au numéro de l'instruction situé à la fi n de chaque avertissement.