The trademarks mentioned in this manual are legally registered to their respective owners.
Disclaimer
Information in this manual is protected by copyright laws and is the property of GIGABYTE.
Changes to the specications and features in this manual may be made by GIGABYTE without prior
notice. No part of this manual may be reproduced, copied, translated, transmitted, or published in any
form or by any means without GIGABYTE's prior written permission.
Documentation Classications
In order to assist in the use of this product, GIGABYTE provides the following types of documentation:
User Manual: detailed information & steps about the installation, conguration and use this
product (motherboard), covering hardware & BIOS
Service Guide: detailed information & steps about the installation, conguration and use of
this product (server barebones), covering hardware & BIOS
User Guide: information about a particular rmware or software package that can be used
with this product (such as BMC rmware)
Quick Installation Guide: a short guide with visual diagrams that you can reference easily for
installation purposes
Please see the support section of the online product page to check the current availability of these documents
For More Information
For related product specications, the latest rmware and software, and related information, please visit our
website at:
http://www.gigabyte.com
For GIGABYTE distributors and resellers, additional sales & marketing materials are available from our re-
seller portal:
http://reseller.b2b.gigabyte.com
- 2 -
Conventions
The following conventions are used in this user's guide:
NOTE!
Pieces of additional
information related to the current topic.
CAUTION!
Precautionary measures to
avoid possible hardware or software problems.
WARNING!
Alerts to any damage that might
result from doing or not doing specic actions.
Server Warnings and Cautions
Before installing a server, be sure that you understand the following warnings and cautions.
WARNING!
To reduce the risk of electric shock or damage to the equipment:
• Do not disable the power cord grounding plug. The grounding plug is an important safety
feature.
• Plug the power cord into a grounded (earthed) electrical outlet that is easily accessible at all
times.
• Unplug the power cord from the power supply to disconnect power to the equipment.
• Do not route the power cord where it can be walked on or pinched by items placed against it.
Pay particular attention to the plug, electrical outlet, and the point where the cord extends from
the server.
WARNING!
To reduce the risk of personal injury from hot surfaces, allow the drives and the internal
system components to cool before touching them.
WARNING!
This server is equipped with high speed fans. Keep away from hazardous moving fan
blades during servicing.
CAUTION!
• Do not operate the server for long periods with the access panel open or removed. Operat-
ing the server in this manner results in improper airow and improper cooling that can lead to
thermal damage.
• Danger of explosion if battery is incorrectly replaced.
• Replace battery with the same or equivalent type recommended by the manufacturer.
• Dispose of used batteries according to the manufacturer’s instructions.
CAUTION!
Risk of explosion if battery is replaced incorrectly or with an incorrect type. Replace the battery
only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer’s instructions.
Electrostatic Discharge (ESD)
CAUTION!
ESD CAN DAMAGE DRIVES, BOARDS, AND OTHER PARTS. WE RECOMMEND THAT YOU
PERFORM ALL PROCEDURES AT AN ESD WORKSTATION. IF ONE IS NOT AVAILABLE,
PROVIDE SOME ESD PROTECTION BY WEARING AN ANTI-STATIC WRIST STRAP ATTACHED TO CHASSIS GROUND -- ANY UNPAINTED METAL SURFACE -- ON YOUR SERVER
WHEN HANDLING PARTS.
Always handle boards carefully, they can be extremely sensitive to ESD. Hold boards only by
their edges without touching any components or connectors. After removing a board from its
protective ESD bag or from the system, place the board component side up on a grounded, static
free surface. Use a conductive foam pad if available but not the ESD bag. Do not slide the board
over any surface.
System power on/off: To service components within the server, please ensure the power has
been disconnected.
e.g. Remove the node from the server chassis (to disconnect power) or disconnect the power
from the server chassis.
Make sure the system is removed from the rack before opening the chassis, adding, or removing
any non hot-plug components.
Hazardous conditions, devices and cables: Hazardous electrical conditions may be present
on power, telephone, and communication cables. Turn off the system chassis and disconnect the
cables attached to the system before servicing the chassis. Otherwise, personal injury or equip-
ment damage can result.
Electrostatic discharge (ESD) and ESD protection: ESD can damage drives, boards, and
other parts. We recommend that you perform all procedures in this chapter only at an ESD work-
station. If one is not available, provide some ESD protection by wearing an antistatic wrist strap
attached to chassis ground (any unpainted metal surface on the server) when handling parts.
ESD and handling boards: Always handle boards carefully. They can be extremely sensi-tive to
electrostatic discharge (ESD). Hold boards only by their edges. After removing a board from its
protective wrapper or from the system, place the board component side up on a grounded, static
free surface. Use a conductive foam pad if available but not the board wrapper. Do not slide
board over any surface.
Installing or removing jumpers: A jumper is a small plastic encased conductor that slips over
two jumper pins. Some jumpers have a small tab on top that can be gripped with n-gertips or
with a pair of ne needle nosed pliers. If the jumpers do not have such a tab, take care when us-
ing needle nosed pliers to remove or install a jumper; grip the narrow sides of the jumper with the
pliers, never the wide sides. Gripping the wide sides can dam-age the contacts inside the jumper,
causing intermittent problems with the function con-trolled by that jumper. Take care to grip with,
but not squeeze, the pliers or other tool used to remove a jumper, or the pins on the board may
1. 2933MHz for 2nd Generation Intel® Xeon® Scalable Processors only
2. Intel® Optane™ DC Persistent Memory for 2nd Generation Intel® Xeon®
Scalable Processors only
3. The maximum numb er of DCPMM that can be i nstalled is based on a ma ximum
operating (ambient) temperature of 35°C
4. To enquire about installing a greater number of DCPMM, please consult with
your GIGABYTE technical or sales representative
LANPer Node:
1 x Dedicated management port
Per Node:
4 x Dedicated management ports 1 x 10/100/1000 *CMC global management port
* CMC: Chassis Management Controller, to monitor all status of computing nodes
* Please contact FAE if NCSI function of OCP mezzanine card is needed
Hardware Installation- 13 -
Expansion Slots Per node:
Riser Card CRSH010:
1 x Half-length low-prole slot with PCIe x16 (Gen3 x16 bus)
Riser Card CRSH011:
1 x Half-length low-prole slots with PCIe x8 (Gen3 x8 bus)
1 x OCP mezzanine slot with PCIe Gen3 x16 bus
Tot al:
4 x Half-length low-prole slots with PCIe x16 (Gen3 x16 bus) 4 x Half-length low-prole slots with PCIe x8 (Gen3 x8 bus) 4 x OCP mezzanine slots with PCIe Gen3 x16 bus
Video Integrated in Aspeed® AST2500
2D Video Graphic Adapter with PCIe bus interface 1920x1200@60Hz 32bpp, DDR4 SDRAM
Management chip on CMC board:
Integrated in Aspeed® AST2520A2-GP
Storage
(H261- NO0)
(H261-PC0)Per node:
Per node:
6 x U.2 hot-swappable bays
Onboard SATA DOM support (PIN_7, PIN_8 or external cable)
Tot al:
24 x U.2 hot-swappable bays
6 x 2.5" SAS/SATA hot-swappable HDD/SSD bays
Onboard SATA DOM support (PIN_7, PIN_8 or external cable)
Tot al:
24 x 2.5" SAS/SATA hot-swappable HDD/SSD bays
SAS card is required for SAS devices support
RAID
(H261- NO0)
(H261-PC0) Intel® SATA RAID 0/1/5/10
For SATA drives: Intel® SATA RAID 0/1/5/10 For U.2 drives: Intel® Virtual RAID On CPU (VROC) RAID 0, 1, 10, 5
Note:
1. VROC module is compatible for Intel®SSD only
2. Default 1 PCS VROC module for one 2U 4 Nodes server syste
- 14 -Hardware Installation
m
Internal I/OPer Node:
1 x COM header 2 x SATA 7-pin connectors 1 x TPM header 1 x BMC SGPIO header 1 x JTAG BMC header 1 x PLD header 1 x Clear CMOS jumper 1 x IPMB connector 1 x Buzzer
Front I/OPer node:
1 x Power button with LED 1 x ID button with LED 1 x Status LED 1 x Reset button
Tot al:
4 x Power button with LED 4 x ID button with LED 4 x Status LED 4 x Reset button
*1 x CMC Status LED
*1 x CMC Reset button
*Only one CMC Status LED and Reset button per system
Rear Panel I/O Per node:
2 x USB 3.0 1 x VGA 1 x RJ45 MLAN 1 x ID LED
Tot al:
8 x USB 3.0 4 x VGA 4 x RJ45 MLAN 4 x ID LEDs
*1 x CMC global management port
*Only one CMC global management port per system
- 15 -Hardware Installation
Backplane I/O
(H261- NO0)
(H261-PC0) 24 x ports
TPM 1 x TPM header with LPC interface
System
Management
Power Supply 2 x 2200W redundant PSUs
24 x ports 12Gb/s & 6Gb/s compatible
PCIe Gen3 x4 U.2 port
Optional TPM2.0 kit: CTM000
Aspeed® AST2500 management controller Avocent® MergePoint IPMI 2.0 web interface: Network settings Network security settings Hardware information Users control Services settings IPMI settings Sessions control LDAP settings Power control Fan proles Voltages, fans and temperatures monitoring System event log Events management (platform events, trap settings, email settings) Serial Over LAN vKVM & vMedia (HTML5)
Operating temperature: 10°C to 35°C Operating humidity: 8-80% (non-condensing)
Relative
Humidity
* We reserves the right to make any changes to the product specications and product-related information without prior
notice.
Non-operating temperature: -40°C to 60°CNon-operating humidity: 20%-95% (non-condensing)
Hardware Installation- 17 -
1-3 System Block Diagram
• Please Go to Chapter 4 Motherboard Components for Riser Slot information.
- 18 -Hardware Installation
Chapter 2 System Appearance
2-1 Front View
H261-NO0
H261-PC0
11
NODE1
RST
NODE2
RST
HDD #0
HDD #1
HDD #2
HDD #3
HDD #4
HDD #5
HDD #6
HDD #7
HDD #8
HDD #9
HDD #10
HDD #11
HDD #12
HDD #13
HDD #14
HDD #18
HDD #15
HDD #19
HDD #16
HDD #17
HDD #20
HDD #21
HDD #22
HDD #23
11
NODE1
RST
NODE2
RST
HDD #0
HDD #1
HDD #2
HDD #3
HDD #4
HDD #5
HDD #6
HDD #7
HDD #8
HDD #9
HDD #10
HDD #11
HDD #12
HDD #13
HDD #14
HDD #18
HDD #15
HDD #19
HDD #16
HDD #17
HDD #20
HDD #21
HDD #22
HDD #23
No.Decription
Front Panel LEDs and buttons
1.
Orange HDD Latches Support NVMe
NODE3
RST
NODE4
RST
C
RST
NODE3
RST
NODE4
RST
C
RST
• Please Go to Chapter 2-3 Front Panel LED and Buttons for detail description of
function LEDs.
- 19 -System Appearance
2-2 Rear View
1
No.Decription
1.CMC LAN Port
2.USB 3.0 Port x 2
3.PCIe Card Slot #1
4.Mezzanine Card Slot
5.ID LED
6.VGA Port
7.PCIe Card Slot #2
8.10/100/1000 Server management LAN port
2346578
PSU2
PSU1
(Optional/Supports OCP V2.0 Card)
System Appearance- 20 -
2-3 Front Panel LED and Buttons
NODE1
RST
RST
2
4
2
4
11
3
NODE2
1
3
No. NameColorStatusDescription
GreenOnSystem is operating normally.
On
System
1.
Status LED
Reset Button----Press this button to reset the system.
2.
Power button
3.
with LED
ID Button
4.
with LED
Enclosure
5.
CMC
6.
Reset Button
Amber
Blink
N/AOff
GreenOnSystem is powered on
GreenBlink System is in ACPI S1 state (sleep mode)
N/AOff
BlueOnSystem identication is active.
N/AOffSystem identication is disabled.
GreenOnSystem is operating normally.
On
Amber
Blink
----Press this button to reset the CMC.
NODE3
RST
2
RST
4
2
4
C
RST
6
3
NODE4
1
3
5
Critical condition, may indicates:
System fan failure
System temperature
Non-critical condition, may indicates:
Redundant power module failure
Temperature and voltage issue
Non-critical condition, may indicates:
Redundant power module failure
Temperature and voltage issue
• System is not powered on or in ACPI S5 state (power
off)
• System is in ACPI S4 state (hibernate mode)
Critical condition, may indicates:
Power module failure
System fan failure
Power supply voltage issue
System temperature
Non-critical condition, may indicates:
Redundant power module failure
Temperature and voltage issue
- 21 -System Appearance
2-4 Rear System LAN LEDs
No.NameColorStatusDescription
Yel l owOn1Gbps data rate
GreenOn100 Mbps data rate
N/AOff10 Mbps data rate
OnLink between system and
Green
BlinkData transmission or receiving is occurring
N/AOffNo data transmission or receiving is occurring
network or no access
1.
2.
1GbE
Speed LED
1GbE
Link/
Activity LED
12
System Appearance- 22 -
2-5 Hard Disk Drive LEDs
RAID SKU
Disk LED
(LED on
No RAID configuration
(via HBA)
RAID configuration
(via HW RAID Card or
SW RAID Card)
Back Panel)
Removed HDD Slot
(LED on Back Panel)
Disk LED
Removed HDD Slot
/('/('
OFF
OFF
OFF
OFF
ON
OFF
ON
Rebuilding
(Low Speed: 2 Hz)
(*3)
(*3)
LED1
Locate
ON(*1)
Green
Amber
ON(*1)OFF--
Green
Amber
Green
Amber
ON(*1)
Green
Amber
HDD Fault
OFF
OFF
ON
OFF
OFF
HDD
Access
BLINK (*2)
OFF
--
--
BLINK (*2)
OFF
--
--
HDD Present
(No Access)
OFF
OFF
--
OFF
OFF
--
--
LED 2
Green
HDD PresentNo HDD
ON
OFF
NOTE:
*1: Depends on HBA/Utility Spec.
*2: Blink cycle depends on HDD's activity signal.
*3: If HDD is pulled out during rebuilding, the disk status of this HDD is regarded as faulty.
- 23 -System Appearance
2-6 Power Supply LED Behavior
Power Supply LED
State
OFFNo AC power to all power supplies
1Hz Green BlinkingAC present / only standby on / Cold redundant mode
2Hz Green BlinkingPower supply rmware updateing mode
AC cord unplugged or AC power lost; with a second
Amber
1Hz Amber Blinking
power supply in parallel still with AC input power
Power supply critical event causing shut down:
failure, OCP, OVP, fan failure and UVP
Power supply warning events where the
power supply continues to operate:
high temp, high power, high current and slow fan
Description
System Appearance- 24 -
Chapter 3 System Hardware Installation
Pre-installation Instructions
Computer components and electronic circuit boards can be damaged by discharges of static
electricity. Working on computers that are still connected to a power supply can be extremely
dangerous. Follow the simple guidelines below to avoid damage to your computer or injury to
yourself.
• Always disconnect the computer from the power outlet whenever you are working inside the
computer case.
• If possible, wear a grounded wrist strap when you are working inside the computer case.
Alternatively, discharge any static electricity by touching the bare metal system of the computer
case, or the bare metal body of any other grounded appliance.
• Hold electronic circuit boards by the edges only. Do not touch the components on the board
unless it is necessary to do so. Do not ex or stress the circuit board.
• Leave all components inside the static-proof packaging until you are ready to use the component
for the installation.
- 25 -System Hardware Installation
3-1 Installing the Hard Disk Drive
Read the following guidelines before you begin to install the Hard disk drive:
• Take note of the drive tray orientation before sliding it out.
• The tray will not t back into the bay if inserted incorrectly.
• Make sure that the HDD is connected to the HDD connector on the backplane.
Follow these instructions to install the Hard disk drive:
1. Press down the colored release button.
2. Pull out the black locking lever.
3. Use the black locking lever to slide out the HDD tray.
4. Place one side of the HDD at a 45 degree angle into the tray, and align the guiding stand-offs in the
tray with the installation holes of the HDD.
5. Once aligned, push down the other side of the HDD and press it until it clicks.
1
Press
2
Pull
2
5
6
System Hardware Installation- 26 -
4
3-2 Removing the Node
Follow these instructions to remove a node:
1. Press the release retaining clip on the right side of the node along the direction of the arrow,
2. Pulling out the node using its handle.
1
2
Press
Pull
- 27 -System Hardware Installation
3-3 Removing Chassis Cover
Before you remove or install the system cover
• Make sure the system is not turned on or connected to AC power.
Follow these instructions to remove the system cover:
1. Loosen and remove the six screws securing the back cover.
2. Slide the cover to the rear of the system and remove the cover in the direction of the arrow.
1
1
1
1
2
1
1
System Hardware Installation- 28 -
3-4 Removing and Installing the Fan Duct
Follow these instructions to remove/install the fan duct:
1. Remove the two screws securing the fan ducts.
2. Lift up to remove the fan ducts
3. To install the fan duct, align the fan duct with the guiding groove. Push down the fan duct into
chassis until its rmly seats, then install the four screws to secure the fan ducts in place.
1
1
- 29 -System Hardware Installation
3-5 Removing and Installing the Heatsink
Read the following guidelines before you begin to install the heatsink:
• Always turn off the computer and unplug the power cord from the power outlet before
installing the heatsink to prevent hardware damage.
• Unplug all cables from the power outlets.
• Disconnect all telecommunication cables from their ports.
• Place the system unit on a at and stable surface.
• Open the system according to the instructions.
WARNING!
Failure to properly turn off the server before you start installing components may cause seri-
ous damage. Do not attempt the procedures described in the following sections unless you
are a qualied service technician.
Follow these instructions to remove the heatsink:
1. Loosen the four captive screws securing the heatsink to the system.
2. Lift and remove the heatsink.
WARNING!
CPU0 and CPU1 use different CPU heatsinks. See the following images for
using the correct heatsink.
Failure to observe the warning could result in damage to the equipment.
• When installing the heatsink to CPU, use PHILLIPS #2-Lobe driver to tighten 4 captive