Fujitsu D3144, CPUMEMR D3145, PCIR D3146 Technical Manual

Technical Manual - English

Baseboard D3144, CPUMEMR D3145,
PCIR D3146 for PRIMERGY RX900 S2

Technical Manual

Edition May 2011

Comments… Suggestions… Corrections…

The User Documentation Department would like to
know your opinion of this manual. Your feedback helps
us optimize our documentation to suit your individual
needs.

Feel free to send us your comments by e-mail to

[e-mail].

Certified documentation
according to DIN EN ISO 9001:2008

To ensure a consistently high quality standard and
user-friendliness, this documentation was created to
meet the regulations of a quality management system
which complies with the requirements of the standard
DIN EN ISO 9001:2008.

cognitas. Gesellschaft für Technik-Dokumentation mbH

www.cognitas.de

© cognitas. Gese llschft für Technik-Dokument ation mbH 2011 Pfad: C:\Pro gramme\FCT\tim _app\tim_loc al\work\WALTER\OBJ_DOK U-12022-001.fm

Copyright and Trademarks

Copyright © 2011 Fujitsu Technology Solutions GmbH.

All rights reserved.
Delivery subject to availability; right of technical modifications reserved.

All hardware and software names used are trademarks of their respective manufacturers.

– The contents of this manual may be revised without prior notice.

– Fujitsu assumes no liability for damages to third party copyrights or other rights arising from

the use of any information in this manual.

– No part of this manual may be reproduced in any form without the prior written permission

of Fujitsu.

Microsoft, Windows, Windows Server, and Hyper V are trademarks or registered trademarks of
Microsoft Corporation in the USA and other countries.

Intel and Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries
in the USA and other countries.

Before reading this manual

For your safety

This manual contains important information for safely and correctly using this
product.

Carefully read the manual before using this product. Pay particular attention to
the accompanying manual "Safety Notes and Regulations" and ensure these
safety notes are understood before using the product. Keep this manual and the
manual "Safety Notes and Regulations" in a safe place for easy reference while
using this product.

Radio interference

This product is a "Class A" ITE (Information Technology Equipment). In a
domestic environment this product may cause radio interference, in which case
the user may be required to take appropriate measures. VCCI-A

Aluminum electrolytic capacitors

The aluminum electrolytic capacitors used in the product's printed circuit board
assemblies and in the mouse and keyboard are limited-life components. Use of
these components beyond their operating life may result in electrolyte leakage
or depletion, potentially causing emission of foul odor or smoke.

As a guideline, in a normal office environment (25°C) operating life is not
expected to be reached within the maintenance support period (5 years).
However, operating life may be reached more quickly if, for example, the
product is used in a hot environment. The customer shall bear the cost of
replacing replaceable components which have exceeded their operating life.
Note that these are only guidelines, and do not constitute a guarantee of
trouble-free operation during the maintenance support period.

High safety use

This product has been designed and manufactured to be used in commercial
and/or industrial areas as a server.

When used as visual display workplace, it must not be placed in the direct field
of view to avoid incommoding reflections (applies only to TX server systems).

The device has not been designed or manufactured for uses which demand an
extremely high level of safety and carry a direct and serious risk of life or body
if such safety cannot be assured.

D3144, D3145, D3146 (RX900 S2) Technical Manual 3

These uses include control of nuclear reactions in nuclear power plants,
automatic airplane flight control, air traffic control, traffic control in mass
transport systems, medical devices for life support, and missile guidance
control in weapons systems (hereafter, "high safety use"). Customers should
not use this product for high safety use unless measures are in place for
ensuring the level of safety demanded of such use. Please consult the sales
staff of Fujitsu if intending to use this product for high safety use.

Measures against momentary voltage drop

This product may be affected by a momentary voltage drop in the power supply
caused by lightning. To prevent a momentary voltage drop, use of an AC
uninterruptible power supply is recommended.

(This notice follows the guidelines of Voltage Dip Immunity of Personal
Computer issued by JEITA, the Japan Electronics and Information Technology
Industries Association.)

© cognitas. Gese llschft für Technik-Dokument ation mbH 2011 Pfad: C:\Pro gramme\FCT\tim _app\tim_loc al\work\WALTER\OBJ_DOK U-12022-001.fm

Control Law of Japan

Documents produced by Fujitsu may contain technology controlled by the
Foreign Exchange and Foreign Trade Control Law of Japan. Documents which
contain such technology should not be exported from Japan or transferred to
non-residents of Japan without first obtaining authorization in accordance with
the above law.

Harmonic Current Standards

This product conforms to harmonic current standard JIS C 61000-3-2.

Only for the Japanese market:
About SATA hard disk drives

The SATA version of this server supports hard disk drives with SATA / BC-SATA
storage interfaces. Please note that the usage and operation conditions differ
depending on the type of hard disk drive used.

Please refer to the following internet address for further information on the
usage and operation conditions of each available type of hard disk drive:

Technology controlled by the Foreign Exchange and Foreign Trade

http://primeserver.fujitsu.com/primergy/harddisk/

4 Technical Manual D3144, D3145, D3146 (RX900 S2)

Only for the Japanese market:

I Although described in this manual, some sections do not apply to the

Japanese market. These options and routines include:

– USB Flash Module (UFM)

– CSS (Customer Self Service)

– Replacing the lithium battery

D3144, D3145, D3146 (RX900 S2) Technical Manual 5

© cognitas. Gese llschft für Technik-Dokument ation mbH 2011 Pfad: C:\Pro gramme\FCT\tim _app\tim_loc al\work\WALTER\OBJ_DOK U-12022-001.fm

6 Technical Manual D3144, D3145, D3146 (RX900 S2)

Contents

1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

2 Important information . . . . . . . . . . . . . . . . . . . . . 11

2.1 CE conformity . . . . . . . . . . . . . . . . . . . . . . . . . 11

2.2 Environmental protection . . . . . . . . . . . . . . . . . . . 12

3 Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

3.1 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

3.2 Main memory . . . . . . . . . . . . . . . . . . . . . . . . . . 21

3.2.1 CPU Memory Riser (CPUMEMR) configuration . . . . . . . . . 21

3.2.1.1 DIMM slot population order . . . . . . . . . . . . . . . . . 23

3.2.1.2 DIMM slot population rules for differently ranked DIMMS . . 24

3.2.1.3 QPI topology . . . . . . . . . . . . . . . . . . . . . . . . . 25

3.2.2 Memory configuration modes . . . . . . . . . . . . . . . . . . 28

3.2.2.1 Memory mirroring . . . . . . . . . . . . . . . . . . . . . . 28

3.2.2.2 Hemisphere mode . . . . . . . . . . . . . . . . . . . . . . 31

3.2.2.3 Memory interleaving . . . . . . . . . . . . . . . . . . . . . 32

3.3 Memory board configuration table . . . . . . . . . . . . . . 32

3.4 PCIe slots . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

3.4.1 PCI interrupt assignment . . . . . . . . . . . . . . . . . . . . 35

3.4.2 PCIe slot to CPUMEMR assignment . . . . . . . . . . . . . . 35

3.4.3 Expansion card configuration table . . . . . . . . . . . . . . . 38

3.5 I/O space . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41

3.5.1 I/O space requirements . . . . . . . . . . . . . . . . . . . . . 41

3.5.2 I/O space limitation . . . . . . . . . . . . . . . . . . . . . . . 42

3.6 Screen resolutions . . . . . . . . . . . . . . . . . . . . . . . 46

3.7 Temperature / System monitoring . . . . . . . . . . . . . . . 46

3.8 Connectors and indicators . . . . . . . . . . . . . . . . . . 47

3.8.1 Onboard connectors and indicators . . . . . . . . . . . . . . . 48

3.8.1.1 Baseboard D3144 . . . . . . . . . . . . . . . . . . . . . . 48

3.8.1.2 CPU Memory Riser (CPUMEMR) D3145 . . . . . . . . . . 51

D3144, D3145, D3146 (RX900 S2) Technical Manual 7

Contents

3.8.1.3 PCI Riser (PCIR) D3146 . . . . . . . . . . . . . . . . . . . 52

3.8.1.4 I/O board . . . . . . . . . . . . . . . . . . . . . . . . . . . 53

3.8.2 Onboard DIP switch . . . . . . . . . . . . . . . . . . . . . . . . 54

3.8.3 External connectors and indicators . . . . . . . . . . . . . . . . 55

3.8.3.1 Baseboard D3144 . . . . . . . . . . . . . . . . . . . . . . . 55

3.8.3.2 I/O board . . . . . . . . . . . . . . . . . . . . . . . . . . . 59

© cognitas. Gese llschft für Technik-Dokument ation mbH 2011 Pfad: C:\Pro gramme\FCT\tim _app\tim_loc al\work\WALTER\OBJ_DOK U-12023-001.fm

8 Technical Manual D3144, D3145, D3146 (RX900 S2)

1 Introduction

This technical manual describes the key characteristics and the board layout of
the boards for the PRIMERGY RX900 S2 server. The basic elements of this
server are the Baseboard D3144, 4 to 8 CPU Memory Risers (CPUMEMR)
D3145, and the PCI Riser (PCIR) D3146.

For additional driver information (if available), refer to the Readme files located
on the server hard disk and on the supplied DVDs, see Installation DVD of
ServerView Suite - ServerView Software Products.

You will find detailed information about the BIOS setup in the "D3144 BIOS
Setup Utility for RX900 S2" manual.

I PRIMERGY manuals are available in PDF format on the

ServerView Suite DVD 2. The ServerView Suite DVD 2 is part of the
ServerView Suite supplied with every server.

PRIMERGY Abbreviations and Glossary can also be found on the
ServerView Suite DVD 2.

Notational conventions

The following notational conventions are used in this manual:

Text in italics indicates commands or menu items.

"Quotation marks" indicate names of chapters and terms that are being

emphasized.

Ê describes activities that must be performed in the order

shown.

V CAUTION! pay particular attention to texts marked with this symbol.

Failure to observe this warning may endanger your life,
destroy the system or lead to the loss of data.

I indicates additional information, notes and tips.

D3144, D3145, D3146 (RX900 S2) Technical Manual 9

Introduction

© cognitas. Gese llschft für Technik-Dokument ation mbH 2011 Pfad: C:\Pro gramme\FCT\tim _app\tim_loc al\work\WALTER\OBJ_DOK U-12024-001.fm

10 Technical Manual D3144, D3145, D3146 (RX900 S2)

2 Important information

V CAUTION!

With the system board installed you must open the system to access the
system board. How to access the system board of your system is
described in the appropriate Upgrade and Maintenance Manual of your
server.

When handling the system board, refer to the specific notes on safety in
the Upgrade and Maintenance Manual of your server.

2.1 CE conformity

The system complies with the requirements of the EC directives
2004/108/EC regarding "Electromagnetic Compatibility" and
2006/95/EC "Low Voltage Directive". This is indicated by the CE
marking (CE = Communauté Européenne).

D3144, D3145, D3146 (RX900 S2) Technical Manual 11

Important information

2.2 Environmental protection

Environmentally-friendly product design and development

This product has been designed in accordance with the Fujitsu standard for
"environmentally friendly product design and development". This means that
key factors such as durability, selection and labeling of materials, emissions,
packaging, ease of dismantling and recycling have been taken into account.

This saves resources and thus reduces the harm done to the environment.
Further information can be found at:

– http://ts.fujitsu.com/products/standard_servers/index.html (for the EMEA market)
– http://primeserver.fujitsu.com/primergy/concept/ (for the Japanese market)

Energy-saving information

Devices that do not need to be constantly switched on should be switched off
until they are needed as well as during long breaks and after completion of work.

© cognitas. Gese llschft für Technik-Dokument ation mbH 2011 Pfad: C:\Pro gramme\FCT\tim _app\tim_loc al\work\WALTER\OBJ_DOK U-12025-001.fm

Packaging information

This packaging information doesn’t apply to the Japanese market.

Do not throw away the packaging. You may need it later for transporting the
system. If possible, the equipment should only be transported in its original
packaging.

Information on handling consumables

Please dispose of printer consumables and batteries in accordance with the
applicable national regulations.

In accordance with EU directives, batteries must not be disposed of with
unsorted domestic waste. They can be returned free of charge to the
manufacturer, dealer or an authorized agent for recycling or disposal.

12 Technical Manual D3144, D3145, D3146 (RX900 S2)

Important information

All batteries containing pollutants are marked with a symbol (a crossed-out
garbage can). They are also marked with the chemical symbol for the heavy
metal that causes them to be categorized as containing pollutants:

Cd Cadmium
Hg Mercury
Pb Lead

Labels on plastic casing parts

Please avoid sticking your own labels on plastic parts wherever possible, since
this makes it difficult to recycle them.

Returns, recycling and disposal

Please handle returns, recycling and disposal in accordance with local
regulations.

The device must not be disposed of with domestic waste. This
device is labeled in compliance with European directive
2002/96/EC on waste electrical and electronic equipment (WEEE).

This directive sets the framework for returning and recycling used
equipment and is valid across the EU. When returning your used
device, please use the return and collection systems available to
you. Further information can be found at

http://ts.fujitsu.com/recycling.

Details regarding the return and recycling of devices and consumables within
Europe can also be found in the "Returning used devices" manual, via your local
Fujitsu branch or from our recycling center in Paderborn:

Fujitsu Technology Solutions
Recycling Center
D-33106 Paderborn

Tel. [phone]

Fax [phone]

D3144, D3145, D3146 (RX900 S2) Technical Manual 13

Important information

© cognitas. Gese llschft für Technik-Dokument ation mbH 2011 Pfad: C:\Pro gramme\FCT\tim _app\tim_loc al\work\WALTER\OBJ_DOK U-12025-001.fm

14 Technical Manual D3144, D3145, D3146 (RX900 S2)

3 Features

3.1 Overview

This section provides an overview of the key characteristics for the baseboard
D3144, the CPU Memory Risers (CPUMEMRs) D3145, and the PCI Riser
(PCIR) D3146.

Processors

● Up to 8 Intel Xeon® E7-8xxx series (Westmere-EX) processors (up to

130 W); one processor per CPUMEMR

● 4 Intel QuickPath Interconnects; up to 6,4 GT/s in each direction

● Hyper-Threading technology with up to 20 threads/CPU (2 threads/core,

10 cores/CPU)

● Up to 2.0 MB L2 cache and 30 MB L3 cache (Westmere-EX)

● Supports x2APIC

Main memory

● Up to 128 slots for DDR3 memory modules (1333 MHz) with 2 GB, 4 GB,

8 GB, 16 GB and 32 GB capacity; 16 slots per CPUMEMR

● 4 SMI links per CPU and up to 4 DDR3 DIMM memory modules per SMI link;

memory modules connected to CPU via memory buffer named Millbrook2;
Intel® Scalable Memory Interconnect (SMI) link connects CPU and
Millbrook2

● Maximum configuration: 4 TB memory with availability of 32 GB memory

modules

● Basic configuration: 32 GB memory; 4 CPUMEMRs with 4 memory modules

per CPUMEMR

● Maximum 32 Gbit/s band width (DDR3)

● Supports +1.5 V and +1.35 V memory modules

● Hardware memory scrubbing

● Single Device Data Correction (SDDC) function (Chipkill™)

D3144, D3145, D3146 (RX900 S2) Technical Manual 15

Features

● Memory interleaving function

● Memory mirroring function

Chipset devices on the baseboard

● Intel Xeon® E7-8800 platform:

– 4x Boxboro-EX® I/O Hubs
– Intel Southbridge ICH10R
– ServerEngines® Pilot II®
– 3x GbE dual channel LAN controller (Kawela)
– 1x 10 GbE dual channel LAN controller (Niantec)

Internal connectors

● 1x SATA connector

● 1x USB 2.0 connector

© cognitas. Gese llschft für Technik-Dokument ation mbH 2011 Pfad: C:\Pro gramme\FCT\tim _app\tim_loc al\work\WALTER\OBJ_DOK U-12026-001.fm

● 1x Trusted Platform Module (TPM)

● 1x USB Flash Module (UFM)

External connectors

● Front side:

– 1x video connector
– 3x USB 2.0 connectors

● Rear side:

– 2x 10 GB SFP+ System LAN connectors
– 5x 1 GB 1000Base-T System LAN connectors
– 1x 1 GB 1000Base-T Shared LAN connector
– 1x 100 MB 100Base-TX Management LAN connector
– I/O board:

– 1x serial connector
– 4x USB 2.0 connectors
– 1x video connector

16 Technical Manual D3144, D3145, D3146 (RX900 S2)

PCIe slots

● Baseboard

– 4x PCI Express 2.0 slots (x8 connector) with PCI Hot-Plug (PHP)

capability
– 4x PCI Express 2.0 slots (x8 connector) without PHP capability
– 1x PCI Express 2.0 slots (x4 connector) without PHP capability
– 1x PCI Express 2.0 slots (x8 connector) without PHP capability for a

Modular RAID controller

● PCI Riser

– 6x PCI Express 2.0 slots (x8 connector) without PHP capability
– 1x PCI Express 2.0 slots (x4) without PHP capability

Server management controller iRMC S2

The following features are integrated into iRMC S2:

Features

● Server class Super I/O (SIO)

● Remote KVMS

● Baseboard Management Controller (BMC) including the following

functionality:

– 250MHz 32-bit ARM9 processor
–IPMI 2.0
–6x I2C SMBus
– Power Consumption Control/Limiting (PCC/PCL)
– Two 10/100 Ethernet controllers with RMII support
– LPC ROM interface
– SPI Flash interface
– USB Device
– One Serial Port
– Three UART interfaces
– DDR2 16-bit 667 MHz memory
– Chassis intrusion logic
– PWM Control and Fan Tach Monitor
– Voltage Level Monitor and Temperature Monitor
– Real-Time Clock (RTC)
– Two Watchdog Timers
– System and Clock Control
– Three Multi-Purpose Timers
– Interrupt Controller

D3144, D3145, D3146 (RX900 S2) Technical Manual 17

Features

–JTAG interface

● Graphics controller including the following features:

– Integrated Graphics Core
– 2D hardware graphics acceleration
– DDR2 memory interface supports up to 128 MB of memory
– Supports all display resolutions up to 1600x1200 16bpp @ 75Hz
– High-speed integrated 24-bit RAMDAC
– Single-lane PCI Express host interface

LAN GbE controller Intel 82576

This controller supports the following features:

● Two connector standard IEEE 802.3 Ethernet interface for 10BASE-T,

100BASE-TX, and 1000BASE-T (802.3, 802.3u, and 802.3ab) applications.

● Serializer-Deserializer (SerDes) to support 1000BASE-SX/LX (optical fiber)

and gigabit backplane applications.

© cognitas. Gese llschft für Technik-Dokument ation mbH 2011 Pfad: C:\Pro gramme\FCT\tim _app\tim_loc al\work\WALTER\OBJ_DOK U-12026-001.fm

● SGMII for external PHY or SFP module.

● Management of MAC and PHY Ethernet layer functions.

● Management of PCI Express packet traffic across its transaction, link, and

physical/logical layers.

● External SPI (4-wire) serial interface to Flash EEPROM devices up to 8 MB

memory.

● NI-SI / SMBus interface to BMC

● Wake on LAN

● SR-IOV for virtulization on Intel NIC

10 GbE LAN controller Intel 82599

This controller supports the following features:

● Remote PXE boot

● iSCSI / iSCSI BOOT(SW) support

● VT-c support as standard

● Adapter fault tolerance, Load Balancing and Switch fault tolerance in

combination with existing GB PCIe card is supported, based on the
functionality (SW Kit) of onboard GB LAN controllers.

18 Technical Manual D3144, D3145, D3146 (RX900 S2)