ADLINK aTCA-9710 User Manual

aTCA-9710

Dual Intel Xeon E5-2658 v3
40G AdvancedTCA Processor Blade
User’s Manual
Advance Technologies; Automate the World.

Revision History

Revision Release Date Description of Change(s)
0.10 27/01/2015 Preliminary release
Copyright 2015 ADLINK Technology, Inc. All Rights Reserved.
The information in this document is subject to change without prior notice in order to improve reliability, design, and function and does not represent a commitment on the part of the manufacturer.
In no event will the manufacturer be liable for direct, indirect, special, incidental, or consequential damages arising out of the use or inability to use the product or documentation, even if advised of the possibility of such damages.
This document contains proprietary information protected by copyright. All rights are reserved. No part of this manual may be reproduced by any mechanical, electronic, or other means in any form without prior written permission of the manufacturer.
Trademarks
Product names mentioned herein are used for identification purposes only and may be
trademarks and/or registered trademarks of their respective companies.
2

Table of Contents

Revision History ......................................................................................................................2
1 Overview ...........................................................................................................................5
1.1 Introduction .................................................................................................................................5
1.2 Block Diagram.............................................................................................................................6
1.3 Package Contents.......................................................................................................................7
2 Specifications ...................................................................................................................8
2.1 aTCA-9710 Specifications...........................................................................................................8
2.1.1 CPU/ Chipset/ Memory........................................................................................................................ 8
2.1.2 Standard and Interface ........................................................................................................................ 8
2.1.3 Software............................................................................................................................................... 9
2.1.4 Mechanical & Environmental ............................................................................................................... 9
2.2 Power Consumption..................................................................................................................10
2.3 Board Layout............................................................................................................................. 11
2.3.1 aTCA-9710 Board Layout - Component Side.....................................................................................11
2.3.2 aTCA-9710 Board Layout - Solder Side............................................................................................ 12
2.3.3 aTCA-9710 Front Panel..................................................................................................................... 13
2.3.4 Status LED Definitions ....................................................................................................................... 14
2.4 Compliance ...............................................................................................................................17
3 Functional Description...................................................................................................18
3.1 CPU, Memory and Chipset .......................................................................................................18
3.1.1 CPU ................................................................................................................................................... 18
3.1.2 Memory.............................................................................................................................................. 19
3.1.3 Intel® C612 Chipset Overview .......................................................................................................... 19
3.1.4 Silicon Motion SM750 Graphics Controller........................................................................................ 20
3.2 Peripherals................................................................................................................................20
3.2.1 Reset ................................................................................................................................................. 20
3.2.2 SMBus Devices ................................................................................................................................. 21
3.3 I/O Interfaces ............................................................................................................................22
3.3.1 USB ................................................................................................................................................... 22
3.3.2 VGA Interface .................................................................................................................................... 23
3.3.3 Ethernet Connection .......................................................................................................................... 23
3.3.4 Serial Port .......................................................................................................................................... 24
3.3.5 Onboard mSATA Module ................................................................................................................... 24
3.3.6 Switch And Jumper Settings .............................................................................................................. 25
4 Intelligent Platform Management System.........................................................................26
4.1 IPMI Sensors ............................................................................................................................26
4.1.1 Sensor Reading (FRU Hotswap Sensor)........................................................................................... 28
4.1.2 Get Sensor Reading (Physical IPMB-0 Sensor)................................................................................ 29
4.1.3 Watchdog Timer Sensor .................................................................................................................... 30
4.1.4 Version Change Sensor..................................................................................................................... 31
4.1.5 System Firmware Progress Sensor................................................................................................... 32
4.1.6 Get Sensor Reading Command ........................................................................................................ 33
4.2 IPMI Commands .......................................................................................................................35
5 Getting Started................................................................................................................37
5.1 Safety Requirements.................................................................................................................37
5.2 Installing and Removing the aTCA-9710 ..................................................................................38
5.2.1 Installing the Blade ............................................................................................................................ 38
5.2.2 Removing the Blade .......................................................................................................................... 42
3
5.3 Firmware Update Procedure.....................................................................................................45
5.3.1 Update Over Serial Interface ............................................................................................................. 45
5.3.2 Update over KCS............................................................................................................................... 46
5.3.3 Update over LAN ............................................................................................................................... 47
6 BIOS ................................................................................................................................48
6.1 Entering the BIOS Setup Screen ..............................................................................................48
6.1.1 Navigation.......................................................................................................................................... 48
6.2 Main BIOS Setup Screen..........................................................................................................50
6.3 Advanced Setup Screen ...........................................................................................................52
6.3.1 ACPI Settings .................................................................................................................................... 54
6.3.2 NCT5104D Super IO Configuration................................................................................................... 55
6.3.3 Serial Port Console Redirection ........................................................................................................ 57
6.3.4 PCI Subsystem Settings.................................................................................................................... 60
6.3.5 Network Stack Configuration ............................................................................................................. 61
6.3.6 CSM Configuration ............................................................................................................................ 62
6.3.7 Trusted Computing ............................................................................................................................ 63
6.3.8 ADLINK IPMI settings........................................................................................................................ 64
6.4 Intel RC Setup...........................................................................................................................66
6.4.1 Processor Configuration .................................................................................................................... 66
6.4.2 Advanced Power Management Configuration................................................................................... 69
6.4.3 Common RefCode Configuration ...................................................................................................... 71
6.4.4 Memory Configuration ....................................................................................................................... 72
6.4.5 IIO Configuration................................................................................................................................ 74
6.4.6 PCH Configuration............................................................................................................................. 76
6.5 Server Mgmt Setup Screen.......................................................................................................78
6.6 Boot Setup Screen....................................................................................................................79
6.7 Security Setup Screen ..............................................................................................................79
6.8 Save & Exit Setup Screen.........................................................................................................81
7 Serial Over LAN ..............................................................................................................83
7.1 Preparation For SOL Connection..............................................................................................83
7.2 Configure The Remote Client....................................................................................................83
7.2.1 Install IPMItool For The Remote Client.............................................................................................. 83
7.3 Configure The Target aTCA-9710 .............................................................................................84
7.3.1 BIOS Configuration............................................................................................................................ 84
7.3.2 Linux grub Setting.............................................................................................................................. 84
7.3.3 Linux System Setting......................................................................................................................... 85
7.4 Establish SOL Connection ........................................................................................................85
8 Drivers.............................................................................................................................87
Safety Instructions ................................................................................................................88
Getting Service ......................................................................................................................89
4

1 Overview

1.1 Introduction

The ADLINK aTCA-9710 is a high performance AdvancedTCA® (ATCA) processor blade featuring dual 12-core Intel® Xeon® Processor E5-2658 v3, Intel® C612 Chipset, eight­channel memory up to 256GB of DDR4 memory and 400W power supply subsystem. Versatile connectivity includes four 40GbE Fabric Interfaces, dual GbE Base Interfaces, dual front panel 10GbE egress ports, front panel dual COM and USB 2.0 ports and front panel VGA connector. An onboard SATA connector supports a mSATA up to 256GB and the optional RTM (aTCA­R9700) supports six 10GbE SFP+ ports and one hot-swappable SATA bay providing additional network throughput and storage capacities.
The aTCA-9710's thermal solution (including VRM heat sink) ensures stable operation under extreme operating environments and allows for compliance to the NEBS Level 3 standard (design only). The robust computing power and reliability of the aTCA-9710 meets the requirements of telecom equipment manufacturers (TEMs) and network equipment providers (NEPs), allowing them to build the next-generation telecom networks and communication infrastructures.
Detailed features are outlined below and a functional block diagram is shown in the next section.
Two 12-core Intel® Xeon® processor E5-2658 v3  Server-class Intel® C612 Chipset  DDR4-2133 JEDEC standard VLP RDIMM (REG/ECC), up to 256 GB  Onboard bootable 32GB mSATA module (max. 256GB)  One Intel® I350 AM2 dual-port PCI Express Gigabit Ethernet controller  Two Intel® XL-710-AM2 dual-port PCI Express 40Gigabit Ethernet controllers  One Intel 82599ES 10Gigabit Ethernet Controller to front panel via SFP+ ports  Optional three Intel® 82599ES 10Gigabit Ethernet Controllers (6 SFP+ ports) on RTM
(aTCA-R9700)
Optional SATA 6G interface drive bay on RTM (aTCA-R9700)  PICMG 3.1 Option 9-KR four Fabric Interface channels supporting dual dual-star  Failover system BIOS  Analog VGA output up to 1920x1440 resolution
5

1.2 Block Diagram

6

1.3 Package Contents

Before opening, please check the shipping carton for any damage. If the shipping carton and contents are damaged, notify the dealer for a replacement. Retain the shipping carton and packing material for inspection by the dealer. Obtain authorization before returning any product to ADLINK.
Check that the following items are included in the package. If there are any missing items, contact your dealer:
aTCA-9710 AdvancedTCA processor blade (CPU, RAM specifications may differ
depending on options selected)
USB Mini-B to DB-9 cable (for front panel serial port)
7

2 Specifications

2.1 aTCA-9710 Specifications

2.1.1 CPU/ Chipset/ Memory

CPU
Chipset Memory
Dual 12-core Intel® Xeon® Processor E5-2658 v3, (2.2/2.9GHz QPI 9.6GT/s, 30MB L2 cache, LGA2011 Socket)
Intel® C612 Chipset Registered ECC DDR4-1600/1866/2133 VLP RDIMM
16x RDIMM sockets Up to 256GB

2.1.2 Standard and Interface

Standards
Networking
Display
USB Serial
Storage
Front Panel I/O
Rear I/O (aTCA-R9700)
PICMG 3.0 R3.0 AdvancedTCA PICMG 3.1 AdvancedTCA Ethernet, Option 9-KR 1x dual-port Intel® I350 AM2 Gigabit Ethernet Controller 1x dual-port Intel® 82599ES 10Gigabit Ethernet Controller 2x 10GbE SFP+ ports on face plate 2x 10/100/1000BASE-T Base Interface channels 4x 10GBASE-KR4 Fabric Interface channels via two XL-710-AM2
40G Ethernet Controllers (Option 9-KR) 6x 10GBASE SFP+ ports on RTM (aTCA-R9700) Silicon Motion SM750 graphics controller Front panel analog VGA connector supports up to 1920x1440 resolution 2x USB 2.0 ports on front panel, two USB 2.0 ports to RTM 1x IPMC serial debug port (USB Mini-B) 1x RS-232 ports on front panel (USB Mini-B) 1x RS-232 port to RTM Onboard mSATA module 32GB, up to 256GB 2x SATA channels to RTM 1x VGA port (DB-15) 3x USB 3.0 port (Type-A) 1x IPMC serial debug port (USB Mini-B connector) 1x RS-232 port (USB Mini-B connector) 2x 10GbE ports (SFP+) LEDs: OOS, BIOS/OS boot OK, IPMC payload power authorization and IPMC chassis identify command Recessed reset button 6x SFP+ ports (three Intel® 82599ES 10G Ethernet Controllers) 1x SATA port from Intel® C612 PCH
8

2.1.3 Software

BIOS Supported OS
AMI BIOS with 8Mbit flash memory Microsoft Windows Server 2012 R2 Red Hat Enterprise Linux 6.x/7.0 Contact ADLINK for other OS availability

2.1.4 Mechanical & Environmental

Dimensions Operating Temperature Storage Temperature Humidity Shock Vibration
Compliance
322.25mm x 280mm x 30.48mm (H x D x W) - 6HP slot Standard: 0°C to 55°C NEBS short-term: 0°C to 61°C (sea level)
-40°C to 85°C
5% to 90% non-condensing 15G peak-to-peak, 11ms duration, non-operation Non-operating: 1.88 Grms, 5 to 500 Hz, each axis Operating: 0.5 Grms, 5 to 500Hz, each axis CE, FCC Class A, UL, NEBS Level 3 (design)
9

2.2 Power Consumption

This section provides information on the power consumption of the aTCA-9710.
System configuration
(1) Memory: 16x 8GB DDR4-2133 ECC REG (2) Graphics: Silicon Motion SM750 (3) Power Supply: Chroma DC Power supply 62012P-80-60 (4) CPU: 2x 12-core Intel® Xeon® processor E5-2658 v3
The following table lists power consumption under different operating systems and applications with a 48V power rail.
OS and Application Power Consumption
Windows Server 2008 R2, idle 81.12 W
Windows Server 2008 R2, BurnIn Test, CPU 100% usage 316.32 W
Windows Server 2008 R2, Power Thermal Utility, CPU 100% Usage 365.76 W
10

2.3 Board Layout

2.3.1 aTCA-9710 Board Layout - Component Side

SW3
DIMM_EF
SW1
CPU2
E2 F2
DIMM_CD
DIMM_AB
CPU1
C1 D1
C2 D2
SW4
PSU1
A2
A1
B2
CN7
Location Description Location Description CN1 CN2 CN7 DIMM_AB/CD DIMM_EF/GH J3/4 PSU1 PSU2
XL710 JTAG debug header XL710 JTAG debug header Ground connection DDR4 DIMM A-D DDR4 DIMM E-H Zone 3 to RTM 400W -48V DC/DC module 400W Hot Swap Power Module
SW1 SW2 SW3 SW4 SW6 SW7 SW8
Reserved for PCH debug Clear CMOS IPMC Programming mode IPMC Mode Select HW Reset Button Reserved for XL710 debug Reserved for XL710 debug
B1
DIMM_GH
G2
H2
SW7
SW8
PSU2
J3
J4
H1 G1 E1 F1
CN2
CN1
11

2.3.2 aTCA-9710 Board Layout - Solder Side

Location Description SW2 SW6
Clear CMOS HW Reset Button
SW6
SW2
12

2.3.3 aTCA-9710 Front Panel

BIOS/OS Boot OK
IPMC Payload Power Authorized
IPMC Chassis Identify Command
OOS LED
10GbE (SFP)
IPMC Serial Debug Port
RS-232 Serial Port
VGA
Hot-Swap LED
USB
Reset button
Base and Fabric Channel LEDs
13

2.3.4 Status LED Definitions

The following sections describe the front panel Status LEDs: Hot-swap LED, OOS LED, BIOS/OS Boot OK LED, IPMC Payload Power Authorized LED and IPMC Chassis Identify Command LED.
2.3.4.1 Out of Service (OOS) LED
Out of Service LED (Red) State Remark
Blinking During BIOS POST M4 Off BIOS POST OK M4 On After OS shutdown M1
2.3.4.2 BIOS/OS Boot OK
BIOS/OS Boot OK (Green) State Remark
Blinking During OS Boot Off During BIOS POST On OS Boot OK
2.3.4.3 IPMC Payload Power Authorized
IPMC Payload Power Authorized (Amber)
On Payload Power Authorized Off Payload Power Not
Authorized
State Remark
14
2.3.4.4 IPMC Chassis Identify Command LED
IPMC Chassis Identify Command (Amber)
Off Default Off Blinking Chassis Identify Command
Active
State Remark
2.3.4.5 Hot-swap LED
Hot-swap LED (Blue)
Off M0 FRU not installed On M1 FRU inactive Long blink M2 FRU activation request Off M3 FRU activation in process Off M4 FRU active Short blink M5 FRU deactivation request Short blink M6 FRU deactivation in process
FRU State
number
FRU State Name
15
2.3.4.6 Base and Fabric Channels LEDs
Base and Fabric Channels LEDs
FCH1 ACT (Amber)
Blink when accessing Ethernet I/O
FCH 3 ACT (Amber) Blink when accessing Ethernet I/O
Fabric 1 Link (Amber)
40Gbps – ON
Fabric 3 Link (Amber) 40Gbps – ON
FCH 2 ACT (Amber)
Blink when accessing Ethernet I/O
FCH 4 ACT (Amber) Blink when accessing Ethernet I/O
Fabric 2 Link (Amber) 40Gbps – ON
Fabric 4 Link (Amber) 40Gbps – ON
BCH1 ACT (Amber)
Blink when accessing Ethernet I/O
BCH1 Speed and Link 100 Mbps: Green
BCH2 ACT (Amber) Blink when accessing Ethernet I/O
1Gbps: Amber
2.3.4.7 Front Panel 10GbE SFP+ LEDs
Left LED: Speed and Link
1Gbps: Amber, 100Mbps: Green
Right LED: ACT
Blinking while data exchanging Color: Amber
BCH2 Speed and Link 100 Mbps: Green 1Gbps: Amber
16

2.4 Compliance

The aTCA-9710 conforms to the following specifications:
PICMG 3.0 R2.0 ECN0002 AdvancedTCA PICMG 3.1 Ethernet over AdvancedTCA Option 9-KR NEBS Level 3 (design)
17

3 Functional Description

3.1 CPU, Memory and Chipset

3.1.1 CPU

The Intel® Xeon® processor E5-2658 v3 implements several key technologies:
Four channel Integrated Memory Controller supporting DDR4 Integrated I/O with up to 40 lanes for PCI Express Generation 3.0 Two point-to-point link interface based on Intel® QuickPath Interconnect (Intel® QPI) up
to 9.6GT/s
30 MB of shared cache
The Intel® Xeon® processor E5-2658 v3 supports several advanced technologies:
Intel® 64 Technology Enhanced Intel® SpeedStep® Technology Intel® Virtualization Technology (Intel® VT) Intel® Hyper-Threading Technology (Intel® HT Technology)
The Intel® Xeon® processor E5-2658 v3 has a maximum TDP of 105W and has an elevated case temperature specification. The elevated case temperatures are intended to meet the short-term thermal profile requirements of NEBS Level 3. The Intel® Xeon® processor E5­2658 v3 is ideal for thermally constrained form factors in embedded servers, communications and storage markets.
Supported Processors, Maximum Power Dissipation
The following table describes the Intel® Xeon® processor E5 family CPUs supported by the aTCA-9710:
Name E5-2658 v3
L2 cache 30MB Clock 2.2GHz QPI 9.6 GT/s TDP 105W
18

3.1.2 Memory

The aTCA-9710 is a dual processor system with each Intel® Xeon® processor E5 2600 v3 series providing four memory channels supporting DDR4, 1600, 1866, 2133 MT/s DIMMs. The maximum memory capacity is 256GB with memory interleaving support. The 400/533/667/800/933 MHz differential memory clocks are driven by the Intel® Xeon® processor E5-2658 v3 CPU with length-matching and impedance controlled through all the DIMM slots.
The DDR4 DIMMs support the I2C interface. They are connected together and routed to the PCH for the management.
Memory configuration changes are only permitted to be performed at the factory. Failure to comply with the above may result in damage to your board or improper operation.

3.1.3 Intel® C612 Chipset Overview

The Intel® C612 Chipset provides a connection point between various I/O components and DMI based processors. Functions and capabilities include:
PCI Express Base Specification, Revision 2.0 support for up to eight ports with transfers
up to 5 GT/s.
  ACPI Power Management Logic Support, Revision 4.0a Enhanced DMA controller,
interrupt controller, and timer functions
Integrated Serial ATA host controller switch independent DMA operation on up to 10 ports. USB host interface with two EHCI high-speed USB 2.0 Host controllers and 2 rate
matching hubs provide support for support for up to fourteen USB 2.0 ports
Integrated 10/100/1000 Gigabit Ethernet MAC with System Defense System Management Bus (SMBus) Specification, version 2.0 with additional support for
2
C devices
I
Intel® High Definition Audio Supports Intel® Rapid Storage Technology enterprise (Intel® RSTe) Intel® Active Management Technology (Intel® AMT) Intel® Virtualization Technology for Directed I/O (Intel® VT-d) Intel® Trusted Execution Technology (Intel® TXT) Low Pin Count (LPC) interface Firmware Hub (FWH) interface Serial Peripheral Interface (SPI) Intel® Anti-Theft Technology (Intel® AT) JTAG Boundary Scan support
19

3.1.4 Silicon Motion SM750 Graphics Controller

The aTCA-9710 provides an analog VGA port on the front panel powered by a Silicon Motion SM750 2D graphics controller with the following features:
PCI-Express x1 architecture
16MB integrated video DDR memory
Low power consumption < 1.5W
300 MHz DAC supports up to 1920x1440 resolution
128-bit 2D graphic engine
ROPs, BitBLT, transparent BLT, pattern BLT, Color expansion, and Line drawing
YUV-16/32-bit RGB conversion
Support 7 layers of display frames (2 hardware cursors, primary graphic, video, video
alpha, alpha, and secondary graphic)
Two 8-bit portsorone16-bitvideocaptureportsupportsITU601
and ITU 656 specifications UV-16/32-bit RGB conversion
ReduceOn Power Management Technology
Quick-Rotation features allow for 90°, 180°, and 270° rotation of on-screen images

3.2 Peripherals

The following peripherals are available on the aTCA-9710 blade

3.2.1 Reset

The aTCA-9710 is automatically reset by a precision voltage monitoring circuit that detects a drop in voltage below the acceptable operating limit of 4.85V for the 5V line and below 3.2V for the 3.3V line. Other reset sources include the Watchdog Timer, the face plate push-button switch and also the RESET signal from the IPMC. The aTCA-9710 responds to any of these sources by initializing local peripherals.
A reset will be generated by the following conditions:
Power failure, +5 V supply falls below 4.1 V (typ.) or +3.3 V supply falls below
2.93 V (typ.)
Pushbutton "RESET" pressed Watchdog time-out IPM controller reset
20

3.2.2 SMBus Devices

The aTCA-9710 provides a System Management Bus (SMBus) hosted by the Intel® C612 PCH. The topology is shown in the diagram below.
PCHHostI2CBus
PCH
IPMCI2CBus
IPMC
SMBus
I2CCLK_IPM I2CDAT_IPM
SMBus I/ O PCA9555
SMBUSADD RESS = SUBMS04x0 ADDR ESS= 0xA6
SMBus I/ O PCA9555
SMBUSADDRES S=0x42
SMBus I/ O PCA9555
SMBUSADD RESS =0x46
EEPROM (FRU) 24C256
CPU DDR I2CBus
CPU 0
CPU 1
EEPROM(SEL) 24C256
SMBUSADD RESS =0xAA
PCA9617
PCA9617
PCA9617
PCA9617
HOT SW AP IQ65033 PIM400KZ
SMBUSADDRESS= 0x5E
DIMM A1
DIMM A2
DIMM B1
DIMM B2
DIMM C1
DIMM C2
DIMM D1
DIMM D2
DIMM E1
DIMM E2
DIMM F1
DIMM F2
DIMM G1
DIMM G2
DIMM H1
DIMM H2
SMBUS ADDRES S =0x90/92/94
0xA0
0xA2
0xA8
0xAA
0xA0
0xA2
0xA8
0xAA
0xA0
0xA2
0xA8
0xAA
0xA0
0xA2
0xA8
0xAA
RTC
DS1339U-33
SMBUSADD RESS =0xD0
Thermal Sensor
LM73 x3
HW Monitor
NCT7904D
SMBUSADD RESS =0x5A
Thermal Sensor
LM73 x3
SMBUS ADDRES S = 0x90/92/9 4 SMBUS ADD RESS = 0x 90/92/94
I2C SWI TCH
PCA9545A
SMBUSADDRESS= 0xE0
Thermal Sensor
LM73 x3
21

3.3 I/O Interfaces

3.3.1 USB

The aTCA-9710 supports Five USB 2.0 ports:
3x Type-A ports on front panel Two ports routed to RTM (available on the aTCA-R6280 RTM)
On the USB 2.0 front panel port, a USB cable up to 5 meters in length can be used.
On the USB 2.0 Rear I/O ports, it is strongly recommended to use a cable less than 3 meters in length for USB 2.0 devices.
The USB 2.0 ports are high-speed, full-speed, and low-speed capable. Hi-speed USB 2.0 allows data transfers of up to 480 Mb/s, 40 times faster than a full-speed USB (USB 1.1). One USB peripheral may be connected to each port.
With the aTCA-R6280 RTM, the aTCA-9710 supports two additional USB ports on the I/O panel of the RTM.
USB Connector Pin Definition (Type A)
Pin Signal
1 5V USB VCC 2 USB­3 USB+
Note: The aTCA-9710 host interfaces can be used with a maximum 500mA continuous load current as specified in the Universal Serial Bus Specification, Revision 2.0. Short circuit protection is provided. All the signal lines are EMI filtered.
4 GND USB
22

3.3.2 VGA Interface

A DB-15 female connector on the front panel provides analog display output.
Front Panel VGA Pin Definition (DB-15)
Pin Name Pin Name
1 RED 9 +5v 2 GREEN 10 GND 3 BLUE 11 NC 4 NC 12 DDC_DATA 5 GND 13 HSYNC 6 GND 14 VSYNC 7 GND 15 DDC_CLK 8 GND

3.3.3 Ethernet Connection

The aTCA-9710 is equipped with one Intel® 82599ES 10Gigabit Ethernet Controller and one dual-port Intel® I350AM2 Gigabit Ethernet Controller which provide 2x 10GbE ports and 2x GbE ports in total. In default configuration, two ports from the Intel® 82599ES 10Gigabit Ethernet Controller are connected to the front panel SFP+ ports. Two GbE ports from the Intel® I350AM2 Gigabit Ethernet Controller are connected to Zone 2 Base Channels 1 and 2 (BCH1/BCH2).
Two Intel XL-710-AM2 40G network controllers are installed on the aTCA-9710 providing four 40GBASE KR4 links to Fabric Channels 1, 2, 3 and 4. The four 40GBASE-KR4 links are divided into two groups. FCH1/3 are connected to one of the XL-710-AM2 40G network controllers while FCH2/4 are connected to the other.
Note: The bandwidth of each XL-710 40G network controller is limited by the PCIe x8 Gen3 link to the CPU. The total bandwidth of each XL-710 40G network controller is approximately 50Gb/s.
With the aTCA-R9700 RTM installed, the aTCA-9710 supports six 10GbE SFP+ ports from the Intel 82599ES Network Interface Controllers.
23

3.3.4 Serial Port

Two serial ports are output to USB Mini-B connectors on the front panel for use as service terminals. The port labeled IPMI is an "IPMC" debug port and the port labeled CPU" is connected to COM 1 of the Super IO chip.
Serial Port Pin Definition (USB Mini-B)
PIN Signal Name In/Out
1 Signal Ground 2 Transmitted Data (TxD) Out 3 Received Data (RxD) In 4 Signal Ground 5 Signal Ground

3.3.5 Onboard mSATA Module

The aTCA-9710 is equipped with an mSATA flash module (32GB, up to 256GB available) which supports a SATA 6.0Gb/s interface with sustained read to 550MB per second and sustained write up to 500MB per second.
24

3.3.6 Switch And Jumper Settings

3.3.6.1 Set Blade Operation Mode
Use switch SW4 to set the Blade Operation Mode. Normal operation requires a shelf manager for the blade to boot. Standalone mode allows the blade to boot without a shelf manager.
SW4 Blade Operation Pin 1 Pin 2 Pin 3 Pin 4
Normal Mode (default) OFF OFF OFF OFF
Standalone Mode OFF OFF ON OFF
3.3.6.2 IPMC JTAG Signal
The switch SW3 is designed for hardware debug purposes. Do not change the default settings. Doing may result in an abnormal boot, failure to boot, and or damage to the board.
SW3 IPMC JTAG Pin 1 Pin 2 Pin 3 Pin 4
Default Setting OFF ON ON ON
3.3.6.3 Shelf/Logic Ground Jumper
Use CN7 to short Shelf Ground to Logic Ground.
Shelf/Logic GND CN7 Setting
Shorted 1-2
Open (default) 2-3
The locations of SW3, SW4 and CN7 are shown below:
SW12
SW4
CN7
25

4 Intelligent Platform Management System

The purpose of the intelligent platform management system is to monitor, control, and assure proper operation of AdvancedTCA® Boards and other Shelf components. The intelligent platform management system watches over the basic health of the system, reports anomalies, and takes corrective action when needed. The intelligent platform management system can retrieve inventory information and sensor readings as well as receive event reports and failure notifications from Boards and other Intelligent FRUs. The intelligent platform management system can also perform basic recovery operations such as reset of managed entities.
The IPMC controller on aTCA-9710 supports an “intelligent” hardware management system, based on the Intelligent Platform Management Interface Specification. The intelligent management system provides the ability to manage the power, cooling, and interconnect needs of intelligent devices; to monitor events; and to log events to a central repository.

4.1 IPMI Sensors

The following table lists all the sensors supported by the aTCA-9710. Six thresholds including Lower Non-Recoverable (LNR), Lower Critical (LC), Lower Non-Critical (LNC), Upper Non­Critical (UNC), Upper Critical (UC) and Upper Non-Critical (UNR) are defined for each voltage or temperature sensor.
Sensor Type
LNR LC LNC UNC UC UNR
Hot Swap Discrete na na na na na na IPMB Physical Discrete na na na na na na BMC Watchdog Discrete na na na na na na Version change Discrete na na na na na na
System FW PROG
Health Status Discrete na na na na na na BIOS Boot Discrete na na na na na na 48V Current(A) Amps na na na na na na 48V_A Power(V) Volts 75.075 72.15 57.2 43.225 39 36.075 48V_B Power(V) Volts 75.075 72.15 57.2 43.225 39 36.075
1.8V I350 Volts 1.985 1.945 1.915 1.695 1.665 1.625
0.85V XL710_1 Volts 1.235 1.215 1.205 0.605 0.585 0.565
0.85V XL710_2 Volts 1.235 1.215 1.205 0.605 0.585 0.565
1.05V PCH Volts 1.215 1.155 1.105 0.995 0.945 0.895
1.50V PCH Volts 1.655 1.625 1.595 1.305 1.245 1.215
1.20V VGA Volts 1.385 1.345 1.315 1.095 1.065 1.025
3.30V MGMT Volts 3.633 3.573 3.513 3.105 3.044 2.984
3.30V SYS Volts 3.633 3.573 3.513 3.105 3.044 2.984
5.00V SYS Volts 5.502 5.408 5.314 4.703 4.609 4.515
Discrete na na na na na na
Threshold
26
Sensor Type
Threshold
LNR LC LNC UNC UC UNR
12.0V SYS Volts 13.24 13 12.76 11.32 11.08 10.84
1.05V VCCIO Volts 1.216 1.168 1.104 0.992 0.96 0.896
1.80V VCCIN_CPU0
1.80V VCCIN_CPU1
Volts 1.856 1.84 1.824 1.6 1.536 1.456
Volts 1.856 1.84 1.824 1.6 1.536 1.456
1.20V VDDQ_AB Volts 1.392 1.344 1.312 1.104 1.056 1.024
1.20V VDDQ_CD Volts 1.392 1.344 1.312 1.104 1.056 1.024
1.20V VDDQ_EF Volts 1.392 1.344 1.312 1.104 1.056 1.024
1.20V VDDQ_GH Volts 1.392 1.344 1.312 1.104 1.056 1.024
0.60V VTT_AB Volts 0.72 0.688 0.64 0.576 0.528 0.496
0.60V VTT_CD Volts 0.72 0.688 0.64 0.576 0.528 0.496
0.60V VTT_EF Volts 0.72 0.688 0.64 0.576 0.528 0.496
0.60V VTT_GH Volts 0.72 0.688 0.64 0.576 0.528 0.496
CPU1 Temp
CPU2 Temp
PCH Temp
DC/DC Temp
XL710 Temp
CPU1 VRM1 Tem p CPU1 VRM2 Tem p CPU1 VRM3 Tem p CPU2 VRM1 Tem p CPU2 VRM2 Tem p CPU2 VRM3 Tem p
degrees C degrees C degrees C degrees C degrees C degrees C degrees C degrees C degrees C degrees C degrees C
107 97 87 -5 -10 -15
107 97 87 -5 -10 -15
95 85 75 0 -5 -10
95 85 75 0 -5 -10
95 85 75 0 -5 -10
95 85 75 0 -5 -10
95 85 75 0 -5 -10
95 85 75 0 -5 -10
95 85 75 0 -5 -10
95 85 75 0 -5 -10
95 85 75 0 -5 -10
27
Loading...
+ 63 hidden pages