INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH Intel® PRODUCTS. NO LICENSE, Express* OR IMPL IED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER, AND INTEL DISCLAIMS ANY Expres s* OR IMPL IE D WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT.UNLESS OTHERWISE AGREED IN WRITING BY INTEL, THE INTEL PRODUCTS ARE NOT DESIGNED NOR INTENDED FOR ANY APPLICATION IN WHICH THE FAILURE OF THE INTEL PRODUCT COULD CREATE A SITUATION WHERE PERSONAL INJURY OR DEATH MAY OCCUR.
INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED,
BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS
PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER
AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING T O S ALE AND/OR USE OF INTEL PRODUCT S INCLUDING
LIABILITY OR WARRANTIES RELA TING T O FITNES S FOR A PARTICULAR PURPOSE, MERCHANT ABILITY, OR INFRINGEMENT OF ANY
PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT.
UNLESS OTHERWISE AGREED IN WRITING BY INTEL, THE INTEL PRODUCTS ARE NOT DESIGNED NOR INTENDED FOR ANY
APPLICATION IN WHICH THE FAILURE OF THE INTEL PRODUCT COULD CR EA TE A SITUA TION WHERE PERSONAL INJURY OR DEATH
MAY OCCUR.
Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the
absence or characteristics of any features or instructions marked "reserved" or "undefined." Intel reserves these for future
definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. The
information here is subject to change without notice. Do not finalize a design with this information.
The Intel® Xeon® Processor E5-1600 v2/E5-2600 v2 Product Families, Intel® C600 Series chipset, and the Intel® Xeon®
Processor E5-1600 v2/E5-2600 v2 Product Families-based platform described in this document may contain design defects or
errors known as errata which may cause the product to deviate from published specifications. Current characterized errata are
available on request.
Contact your local Intel sales office or your distributor to obtain the latest specifications and before placing your product order.
Copies of documents which have an order number and are referenced in this document, or other Intel literature, may be obtained
by calling 1-800-548-4725, or go to: http://www.intel.com/#/en_US_01
Hyper-Threading Technology requires a computer system with a processor supporting HT Technology and an HT Technology
enabled chipset, BIOS and operating system. Performance will vary depending on the specific hardware and so ftware you use. For
more information including details on which processors support HT Technology, see
Enabling Execute Disable Bit functionality requires a PC with a processor with Execute Disable Bit capability and a supporting
operating system. Check with your PC manufacturer on whether your system delivers Execute Disable Bit functionality.
Intel® Virtualization Technology requires a computer system with an enabled Intel® processor, BIOS, virtual machine monitor
(VMM) and, for some uses, certain computer system software enabled for it. Functionality, performance or other benefits will vary
depending on hardware and software configur ations and may re quire a BIOS update. S oftware applicatio ns may not be compatible
with all operating systems. Please check with your application vendor.
Intel® Turbo Boost Technology requires a PC with a processor with Intel Turbo Boost Technology capability. Intel Turbo Boost
Technology performance varies depending on hardware, software and overall system configuration. Check with your PC
manufacturer on whether your system delivers Intel Turbo Boost Technology. For more information, see
http://www.intel.com/technology/turboboost/.
64-bit computing on Intel architecture requires a computer system with a processor, chipset, BIOS, operating system, device
drivers and applications enabled for Intel® 64 architecture. Performance will vary depending on your hardware and software
configurations. Consult with your system vendor for more information.
Δ Intel processor numbers are not a measure of performance. Processor numbers differentiate features within each processor
family, not across different processor families. See http://www.intel.com/products/processor%5Fnumber/ for details.
2
C is a two-wire communications bus/protocol developed by Philips. SMBus is a subset of the I2C bus/protocol and was developed
I
by Intel. Implementations of the I
North American Philips Corporation.
2
C bus/protocol may require licenses from various entities, including Philips Electronics N.V. and
Intel, Xeon, Enhanced Intel SpeedStep Technology, and the Intel logo are trademarks of Intel Corporation in the U. S. and/or
other countries.
The Intel® Xeon® processor E5-1600 v2/E5-2600 v2 product families datasheetVolume One provides DC electrical specifications, signal integrity, differential signaling
specifications, land and signal definitions, and an overview of additional processor
feature interfaces.
This document is intended to be distributed as a part of the complete document which
consists of two volumes. The structure and scope of the two volumes are provided in
Table 1-2.
The Intel® Xeon® processor E5-1600 v2/E5-2600 v2 product families are the next
generation of 64-bit, multi-core enterprise processors built on 22-nanometer process
technology. Throughout this document, the Intel® Xeon® processor E5-1600 v2/E52600 v2 product families may be referred to as simply the processor. Where
information differs between the EP SKUs, this document uses specific Intel® Xeon®
processor E5-1600 v2 product family and Intel® Xeon® processor E5-2600 v2 product
family notation. Based on the low-power/high performance 3rd Generation Intel®
Core™ Processor Family microarchitecture, the processor is designed for a two-chip
platform as opposed to the traditional three-chip platforms (processor, MCH, and ICH).
The two-chip platform consists of a processor and the Platform Controller Hub (PCH)
and enables higher performance, easier validation, and improved x-y footprint.
This generation of processor introduces the High-Core count (HCC), Mid-Core count
(MCC), and Low-Core count (LCC) die size terminology to the SKU models. The table
below summarizes the die size associated with the processor TDP, Model Number, and
Core Count.
Table 1-1.HCC, MCC, and LCC SKU Table Summary
Die SizeTDP (W)Model NumberCore Count
High-Core Count130W 1UE5-2697 v212
115W 1UE5-2695 v212
Mid-Core Count150W WSE5-2687W v28
130W 1UE5-2690 v210
130W 2UE5-2687W v2
130W 2UE5-2643 v26
115W 1UE5-2680 v2
95W 1U E5-2660 v210
95W 1U E5-2650 v2
70W 1U E5-2650L v2 10
8
E5-2667 v2
10
E5-2670 v2
8
E5-2640 v2
Intel® Xeon® Processor E5-1600 v2/E5-2600 v2 Product Families11
Datasheet Volume One of Two
Table 1-1.HCC, MCC, and LCC SKU Table Summary
Die SizeTDP (W)Model NumberCore Count
Low-Core Count 130W 2UE5-2637 v2 4
130W 1SE5-1660 v2
130W 1SE5-1620 v2 4
95W 1U E5-2630 v26
80W 1U E5-2630 v2
80W 1U E5-2609 v2
60W 1U E5-2630L v26
Some processor features are not available on all platforms. Refer to the Intel® Xeon® Processor E5 v2 Product Family Specification Update for details of each processor SKU.
The Intel® Xeon® processor E5-1600 v2/E5-2600 v2 product families support these
segments.
• The Intel® Xeon® processor E5-1600 v2 product family is designed for single
processor Workstation platforms only.
• The Intel® Xeon® processor E5-2600 v2 product family is designed for dual
processor Workstation, Efficient Performance server and HPC platforms.
Overview
6
E5-1650 v2
6
E5-2620 v2
4
E5-2603 v2
These processors feature per socket, two Intel® QuickPath Interconnect point-to-point
links capable of up to 8.0 GT/s, up to 40 lanes of PCI Express* 3.0 links capable of
8.0 GT/s, and 4 lanes of DMI2/PCI Express* 2.0 interface with a peak transfer rate of
5.0 GT/s. The processor supports up to 46 bits of physical address space and 48-bit of
virtual address space.
Included in this family of processors is an integrated memory controller (IMC) and
integrated I/O (IIO) (such as PCI Express* and DMI2) on a single silicon die. This single
die solution is known as a monolithic processor.
Figure 1-1 shows the processor 2-socket platform configuration. The “Legacy CPU” is
the boot processor that is connected to the PCH component, this socket is set to
NodeID[0].
Table 1-2.Volume Structure and Scope (Sheet 1 of 2)
Volume 1: Electrical, Mechanical and Thermal Specification
• Data burst length of eight cycles for all memory organization modes
• Memory DDR3 data transfer rates of 800, 1066, 1333, 1600, and 1866 MT/s
• 64-bit wide channels plus 8-bits of ECC support for each channel
• DDR3 standard I/O Voltage of 1.5 V and DDR3 Low Voltage of 1.35 V
• 1-GB, 2-GB, and 4-GB DDR3 DRAM technologies supported for these devices:
— UDIMMs x8, x16
— RDIMMs x4, x8
— LRDIMM x4, x8 (2-Gb and 4-Gb only) LR-DIMMs are supported only on server
specific SKUs (Intel® Xeon® processor E5-1600 v2/E5-2600 v2 product
families). LR-DIMMs are not supported in workstation specific SKUs such as the
Intel® Xeon® processor E5-1600 v2 product family.
• Up to 8 ranks supported per memory channel: 1, 2 or 4 ranks per DIMM
• Open with adaptive idle page close timer or closed page policy
• Per channel memory test and initialization engine can initialize DRAM to all logical
zeros with valid ECC (with or without data scrambler) or a predefined test pattern
• Isochronous access support is not available on any CPU model containing two home
agents.
• Minimum memory configuration: independent channel support with 1 DIMM
populated
• Integrated dual SMBus master controllers
• Command launch modes of 1n/2n
• RAS Support (including and not limited to):
Note: RAS support depends on processor SKU. For example, Workstation SKUs do
not support sparing or tagging, lockstep mode, mirroring mode, channel
mirroring mode within a socket, error containment.
— Rank Level Sparing and Device Tagging
— Demand and Patrol Scrubbing
— DRAM Single Device Data Correction (SDDC) for any single x4 or x8 DRAM
— Lockstep mode where channels 0 & 1 and channels 2 & 3 are operated in
lockstep mode
— The combination of memory channel pair lockstep and memory mirroring is not
supported
— Data scrambling with address to ease detection of write errors to an incorrect
address.
— Error reporting via Machine Check Architecture
— Read Retry during CRC error handling checks by iMC
— Channel mirroring within a socket
— Channel Mirroring mode is supported on memory channels 0 & 1 and channels
Intel® Xeon® Processor E5-1600 v2/E5-2600 v2 Product Families15
Datasheet Volume One of Two
• Memory thermal monitoring support for DIMM temperature via two memory
signals, MEM_HOT_C{01/23}_N
1.2.2PCI Express*
• The PCI Express* port(s) are fully-compliant to the PCI Express* Base
Specification, Revision 3.0 (PCIe 3.0)
• Support for PCI Express* 3.0 (8.0 GT/s), 2.0 (5.0 GT/s), and 1.0 (2.5 GT/s)
• Up to 40 lanes of PCI Express* interconnect for general purpose PCI Express*
devices at PCIe* 3.0 speeds that are configurable for up to 10 independent ports
• 4 lanes of PCI Express* at PCIe* 2.0 speeds when not using DMI2 port (Port 0),
also can be downgraded to x2 or x1
• Negotiating down to narrower widths is supported, see Figure 1-3:
— x16 port (Port 2 & Port 3) may negotiate down to x8, x4, x2, or x1.
— x8 port (Port 1) may negotiate down to x4, x2, or x1.
— x4 port (Port 0) may negotiate down to x2, or x1.
— When negotiating down to narrower widths, there are caveats as to how lane
reversal is supported.
• Non-Transparent Bridge (NTB) is supported by PCIe Port3a/IOU1. For more details
on NTB mode operation refer to PCI Express Base Specification - Revision 3.0:
— x4, x8 or x16 widths and at PCIe* 1.0, 2.0, 3.0 speeds
— Two usage models; NTB attached to a Root Port or NTB attached to another
NTB
— Supports three 64-bit BARs
— Supports posted writes and non-posted memory read transactions across the
NTB
— Supports INTx, MSI and MSI-X mechanisms for interrupts on both side of NTB
in upstream direction only
• Address Translation Services (ATS) 1.0 support
• Hierarchical PCI-compliant configuration mechanism for downstream devices.
• Traditional PCI style traffic (asynchronous snooped, PCI ordering).
• PCI Express* extended configuration space. The first 256 bytes of configuration
space aliases directly to the PCI compatibility configuration space. The remaining
portion of the fixed 4-KB block of memory-mapped space above that (starting at
100h) is known as extended configuration space.
• PCI Express* Enhanced Access Mechanism. Accessing the device configuration
space in a flat memory mapped fashion.
• Automatic discovery, negotiation, and training of link out of reset.
• Supports receiving and decoding 64 bits of address from PCI Express*.
— Memory transactions received from PCI Express* that go above the top of
physical address space (when Intel VT -d is enabled, the check would be against
the translated HPA (Host Physical Address) address) are reported as errors by
the processor.
— Outbound access to PCI Express* will always have address bits 63 to 46
cleared.
• Re-issues Configuration cycles that have been previously completed with the
Configuration Retry status.
• Message Signaled Interrupt (MSI and MSI-X) messages
• Degraded Mode support and Lane Reversal support
• Static lane numbering reversal and polarity inversion support
• Support for PCIe* 3.0 atomic operation, PCIe 3.0 optional extension on atomic
read-modify-write mechanism
• Additional read buffers for point-point transfers. This increases the number of
outstanding transactions in point-point transfers across same processor sockets,
from previous generation of 16 to 64 in this generation.
Figure 1-3. PCI Express* Lane Partitioning and Direct Media Interface Gen 2 (DMI2)
1.2.3Direct Media Interface Gen 2 (DMI2)
Intel® Xeon® Processor E5-1600 v2/E5-2600 v2 Product Families17
Datasheet Volume One of Two
• Serves as the chip-to-chip interface to the Intel® C600 Chipset
• The DMI2 port supports x4 link width and only operates in a x4 mode when in DMI2
• Operates at PCI Express* 1.0 or 2.0 speeds
• Transparent to software
• Processor and peer-to-peer writes and reads with 64-bit address support
• APIC and Message Signaled Interrupt (MSI) support. Will send Intel-defined “End of
Interrupt” broadcast message when initiated by the processor.
• Downstream System Management Interrupt (SMI), SCI, and SERR error indication
• Static lane numbering reversal support
• Supports DMI2 virtual channels VC0, VC1, VCm, and VCp
1.2.4Intel® QuickPath Interconnect (Intel® QPI)
• Compliant with Intel QuickPath Interconnect v1.1 standard packet formats
• Implements two full width Intel QPI ports
• Full width port includes 20 data lanes and 1 clock lane
• 64 byte cache-lines
• Isochronous access support is not available on any CPU model containing two home
agents.
Note: RAS support depends on processor SKU. For example, Workstation SKUs do
not support sparing or tagging, lockstep mode, mirroring mode, channel
mirroring mode within a socket, error containment.
• Home snoop based coherency
•4-bit Node ID
• 46-bit physical addressing support
• No Intel QuickPath Interconnect bifurcation support
• Differential signaling
• Forwarded clocking
• Up to 8.0 GT/s data rate (up to 16 GB/s direction peak bandwidth per port)
— All ports run at same operational frequency
— Reference Clock is 100 MHz
— Slow boot speed initialization at 50 MT/s
• Common reference clocking (same clock generator for both sender and receiver)
• Intel® Interconnect Built-In-Self-Test (Intel® IBIST) for high-speed testability
• Polarity Inversion and Lane reversal (Rx side only)
Overview
1.2.5Platform Environment Control Interface (PECI)
The PECI is a one-wire interface that provides a communication channel between a
PECI client (the processor) and a PECI master (the PCH).
• Supports operation at up to 2 Mbps data transfers
• Link layer improvements to support additional services and higher efficiency over
PECI 2.0 generation
• Services include CPU thermal and estimated power information, control functions
for power limiting, P-state and T-state control, and access for Machine Check
Architecture registers and PCI configuration space (both within the processor
package and downstream devices)
• PECI address determined by SOCKET_ID configuration
• ACPI C-states as implemented by the following processor C-states:
— Package: PC0, PC1/PC1e, PC2, PC3, PC6 (Package C7 is not supported)
— Core: CC0, CC1, CC1E, CC3, CC6 (Processor Core C7 is not supported)
• Enhanced Intel SpeedStep® Technology
1.3.2System States Support
• S0, S1, S3, S4, S5
1.3.3Memory Controller
• Multiple CKE power down modes
• Multiple self-refresh modes
• Memory thermal monitoring via MEM_HOT_C01_N and MEM_HOT_C23_N Signals
1.3.4PCI Express*
• L0s is not supported
• L1 ASPM power management capability
1.3.5Intel® QPI
• L0s is not supported
• L0p and L1 power management capabilities
1.4Thermal Management Support
• Digital Thermal Sensor with multiple on-die temperature zones
• Adaptive Thermal Monitor
• THERMTRIP_N and PROCHOT_N signal support
• On-Demand mode clock modulation
• Open and Closed Loop Thermal Throttling (OL T T/CLTT) support for system memory
in addition to Hybrid OLTT/CLTT mode
• Fan speed control with DTS
• Two integrated SMBus masters for accessing thermal data from DIMMs
• New Memory Thermal Throttling features via MEM_HOT_C{01/23}_N signals
• Running Average Power Limit (RAPL), Processor and DRAM Thermal and Power
Optimization Capabilities
1.5Package Summary
The processor socket type is 52.5 x 45 mm or 52.5 x 51 mm FCLGA12 package
(LGA2011-0).
Intel® Xeon® Processor E5-1600 v2/E5-2600 v2 Product Families19
Datasheet Volume One of Two
1.6Terminology
TermDescription
ASPMActive State Power Management
BMCBaseboard Management Controllers
CboCache and Core Box. It is a term used for internal logic providing ring interface to
DDR3Third generation Double Data Rate SDRAM memory technology that is the
DMADirect Memory Access
DMIDirect Media Interface
DMI2Direct Media Interface Gen 2
DTSDigital Thermal Sensor
ECCError Correction Code
Enhanced Intel
SpeedStep® Technology
(EIST)
Execute Disable BitThe Execute Disable bit allows memory to be marked as executable or non-
FlitFlow Control Unit. The Intel QPI Link layer’s unit of transfer; 1 Flit = 80-bits.
Functional OperationRefers to the normal operating conditions in which all processor specifications,
IMC
IIOThe Integrated I/O Controller. An I/O controller that is integrated in the
Intel® VT-dIntel® Virtualization Technology (Intel® VT) for Directed I/O. Intel VT-d is a
Overview
LLC and Core.
successor to DDR2 SDRAM
Allows the operating system to reduce power consumption when performance is
not needed.
executable, when combined with a supporting operating system. If code
attempts to run in non-executable memory the processor raises an error to the
operating system. This feature can prevent some classes of viruses or worms
that exploit buffer overrun vulnerabilities and can thus help improve the overall
security of the system. See the Intel® 64 and IA-32 Architectures Software Developer's Manuals for more detailed information.
including DC, system bus, signal quality, mechanical, and thermal, are satisfied.
The Integrated Memory Controller. A Memory Controller that is integrated in the
processor die.
processor die.
Intel QuickData Technology is a platform solution designed to maximize the
throughput of server data traffic across a broader range of configurations and
server environments to achieve faster, scalable, and more reliable I/O.
A cache-coherent, link-based Interconnect specification for Intel processors,
chipsets, and I/O bridge components.
architecture and programming model can be found at
http://developer.intel.com/technology/intel64/.
Intel® Turbo Boost Technology is a way to automatically run the processor core
faster than the marked frequency if the part is operating under power,
temperature, and current specifications limits of the Thermal Design Power
(TDP). This results in increased performance of both single and multi-threaded
applications.
Processor virtualization which when used in conjunction with Virtual Machine
Monitor software enables multiple, robust independent software environments
inside a single platform.
hardware assist, under system software (Virtual Machine Manager or OS)
control, for enabling I/O device virtualization. Intel VT-d also brings robust
security by providing protection from errant DMAs by using DMA remapping, a
key feature of Intel VT-d.
ProcessorThe 64-bit, single-core or multi-core component (package)
Processor CoreThe term “processor core” refers to silicon die itself which can contain multiple
RDIMMRegistered Dual In-line Module
RankA unit of DRAM corresponding four to eight devices in parallel, ignoring ECC.
SCISystem Control Interrupt. Used in ACPI protocol.
SSEIntel® Streaming SIMD Extensions (Intel® SSE)
Intel’s 22-nm processor design, is the follow-on to the 3rd Generation Intel®
Core™ Processor Family design. It is the next generation processor for use in
Intel® Xeon® processor E5-1600 v2/E5-2600 v2 product families-based
platforms. Intel® Xeon® processor E5-1600 v2 product family supports
workstation platforms only.
Intel’s 22-nm processor design, is the follow-on to the 3rd Generation Intel®
Core™ Processor Family design. It is the next generation processor for use in
Intel® Xeon® processor E5-1600 v2/E5-2600 v2 product families-based
platforms. Intel® Xeon® processor E5-2600 v2 product family supports
workstation, Efficient Performance server, and HPC platforms.
A component of the processor package used to enhance the thermal
performance of the package. Component thermal solutions interface with the
processor at the IHS surface.
(UI).
this surface mount, LGA2011-0 contact socket.
critical reserved, so the loss of the solder joint continuity at end of li fe condition s
will not affect the overall product functionality.
environmental design guidelines applied to telecommunications equipment in the
United States.
capabilities including the main I/O interfaces along with display connectivity,
audio features, power management, manageability, security and storage
features.
of PCI Express* 2.0 (8 Gb/s); however, PCI Express* 3.0 is completely backward
compatible with PCI Express* 1.0 and 2.0.
Physical Unit. An Intel® QPI terminology defining units of transfer at the physical
layer. 1 Phit is equal to 20 bits in ‘full width mode’ and 10 bits in ‘half width
mode’
execution cores. Each execution core has an instruction cache, data cache, and
256-KB L2 cache. All execution cores share the L3 cache. All DC and signal
integrity specifications are measured at the processor die (pads), unless
otherwise noted.
These devices are usually, but not always, mounted on a single side of a DDR3
DIMM.
Intel® Xeon® Processor E5-1600 v2/E5-2600 v2 Product Families21
Datasheet Volume One of Two
Overview
TermDescription
SKUA processor Stock Keeping Unit (SKU) to be installed in either server or
workstation platforms. Electrical, power and thermal specifications for these
SKU’s are based on specific use condition assumptions. Server processors may
be further categorized as Efficient Performance server, workstation and HPC
SKUs. For further details on use condition assumptions, please refer to the latest
Product Release Qualification (PRQ) Report available via your Customer Quality
Engineer (CQE) contact.
SMBusSystem Management Bus. A two-wire interface through which simpl e system and
power management related devices can communicate with the rest of the
system. It is based on the principals of the operation of the I2C* two-wire serial
bus from Philips Semiconductor.
Storage ConditionsA non-operational state. The processor may be installed in a platform, in a tray,
or loose. Processors may be sealed in packaging or exposed to free air. Under
these conditions, processor landings should not be connected to any supply
voltages, have any I/Os biased or receive any clocks. Upon exposure to “free air”
(that is, unsealed packaging or a device removed from packaging material) the
processor must be handled in accordance with moisture sensitivity labeling
(MSL) as indicated on the packaging material.
TACThermal Averaging Constant
TDPThermal Design Power
TSODThermal Sensor on DIMM
UDIMMUnbuffered Dual In-line Module
UncoreThe portion of the processor comprising the shared cache, IMC, HA, PCU, UBox,
Unit IntervalSignaling convention that is binary and unidirectional. In this binary signaling,
V
CC
V
SS
V
_01, VCCD_23Variable power supply for the processor system memory interface. VCCD is the
CCD
and Intel QPI link interface.
one bit is sent for every edge of the forwarded clock, whether it be a rising edge
or a falling edge. If a number of edges are collected at instances t
then the UI at instance “n” is defined as:
UI
= t n - t n - 1
n
, t2, tn,...., t
1
k
Processor core power supply
Processor ground
generic term for VCCD_01, VCCD_23.
x1Refers to a Link or Port with one Physical Lane
x4Refers to a Link or Port with four Physical Lanes
x8Refers to a Link or Port with eight Physical Lanes
x16Refers to a Link or Port with sixteen Physical Lanes
1.7Related Documents
Refer to the following documents for additional information.
Intel® C600 Series Chipset Datasheethttp://www.intel.com
Advanced Configuration and Power Interface Specification 3.0http://www.acpi.info
PCI Local Bus Specification 3.0 http://www.pcisig.com/specifications
PCI Express Base Specification - Revision 2.1 and 1.1
PCI Express Base Specification - Revision 3.0
System Management Bus (SMBus) Specificationhttp://smbus.org/
DDR3 SDRAM Specificationhttp://www.jedec.org
Low (JESD22-A119) and High (JESD-A103) Temperature Storage
Life Specifications
Intel® 64 and IA-32 Architectures Software Developer's Manuals
• Volume 1: Basic Architecture
• Volume 2A: Instruction Set Reference, A-M
• Volume 2B: Instruction Set Reference, N-Z
• Volume 3A: System Programming Guide
• Volume 3B: System Programming Guide
Intel® 64 and IA-32 Architectures Optimization Reference Manual
Intel® Virtualization Technology Specification for Directed I/O
Architecture Specification
Intel® Trusted Execution Technology Software Development Guide http://www.intel.com/technology/security/
National Institute of Standards and Technology NIST SP800-90http://csrc.nist.gov/publications/PubsSPs.html
Intel® Xeon® processor E5-1600 v2/E5-2600 v2 product families do not retain any
end-user data when powered down and/or the processor is physically removed from
the socket.
1.9State of Data
The data contained within this document is the most accurate information available by
the publication date of this document.
§
Intel® Xeon® Processor E5-1600 v2/E5-2600 v2 Product Families23
Datasheet Volume One of Two
This chapter describes the interfaces supported by the processor.
2.1System Memory Interface
2.1.1System Memory Technology Support
The Integrated Memory Controller (IMC) supports DDR3 protocols with four
independent 64-bit memory channels with 8 bits of ECC for each channel (total of
72-bits) and supports 1 to 3 DIMMs per channel depending on the type of memory
installed. The type of memory supported by the processor is dependent on the target
platform:
— ECC registered DIMMs: with a maximum of three DIMMs per channel allowing
up to eightdevice ranks per channel.
— ECC and non-ECC unbuffered DIMMs: with a maximum of two DIMMs per
channel thus allowing up to four device ranks per channel. Support for mixed
non-ECC with ECC un-buffered DIMM configurations.
2.1.2System Memory Timing Support
The IMC supports the following DDR3 Speed Bin, CAS Write Latency (CWL), and
command signal mode timings on the main memory interface:
• tCL = CAS Latency
• tRCD = Activate Command to READ or WRITE Command delay
• tRP = PRECHARGE Command Period
• CWL = CAS Write Latency
• Command Signal modes = 1n indicates a new command may be issued every clock
and 2n indicates a new command may be issued every 2 clocks. Command launch
mode programming depends on the transfer rate and memory configuration.
Intel® Xeon® Processor E5-1600 v2/E5-2600 v2 Product Families25
Datasheet Volume One of Two
Transaction
Data Link
Physical
Logical Sub-Block
Electrical Sub-Block
RXTX
Transaction
Data Link
Physical
Logical Sub-Block
Electrical Sub-Block
RXTX
Transaction
Data Link
Physical
Logical Sub-Block
Electrical Sub-Block
RXTX
Transaction
Data Link
Physical
Logical Sub-Block
Electrical Sub-Block
RXTX
2.2PCI Express* Interface
Interfaces
This section describes the PCI Express* 3.0 interface capabilities of the processor. See
the PCI Express* Base Specification for details of PCI Express*
2.2.1PCI Express* Architecture
Compatibility with the PCI addressing model is maintained to ensure that all existing
applications and drivers operate unchanged. The PCI Express* configuration uses
standard mechanisms as defined in the PCI Plug-and-Play specification.
The PCI Express* architecture is specified in three layers: T ransaction Layer, Data Link
Layer, and Physical Layer. The partitionin g in the component is not necessarily along
these same boundaries. Refer to Figure 2-1 for the PCI Express* Layering Diagram.
PCI Express* uses packets to communicate information between components. Packets
are formed in the Transaction and Data Link Layers to carry the information from the
transmitting component to the receiving component. As the transmitted packets flow
through the other layers, they are extended with additional information necessary to
handle packets at those layers. At the receiving side, the reverse process occurs and
packets get transformed from their Physical Layer representation to the Data Link
Layer representation and finally (for Transaction Layer Packets) to the form that can be
processed by the Transaction Layer of the receiving device.
Datasheet Volume One of Two
Framing
Sequence
Number
HeaderDateLCRCECRCFraming
Data Link Layer
Transaction Layer
Physical Layer
Framing
Sequence
Number
HeaderDateLCRCECRCFraming
Data Link Layer
Transaction Layer
Physical Layer
Interfaces
Figure 2-2. Packet Flow through the Layers
2.2.1.1Transaction Layer
The upper layer of the PCI Express* architecture is the Transaction Layer. The
Transaction Layer's primary responsibility is the assembly and disassembly of
Transaction Layer Packets (TLPs). TLPs are used to communicate transactions, such as
read and write, as well as certain types of events. The Transaction Layer also manages
flow control of TLPs.
2.2.1.2Data Link Layer
The middle layer in the PCI Express* stack, the Data Link Layer, serves as an
intermediate stage between the Transaction Layer and the Physical Layer.
Responsibilities of Data Link Layer include link management, error detection, and
error correction.
The transmission side of the Data Link Layer accepts TLPs assembled by the
Transaction Layer, calculates and applies data protection code and TLP sequence
number, and submits them to Physical Layer for transmission across the Link. The
receiving Data Link Layer is responsible for checking the integrity of received TLPs and
for submitting them to the T ransaction Layer for further processing. On detection of TLP
error(s), this layer is responsible for requesting retransm ission of TLPs until information
is correctly received, or the Link is determined to have failed. The Data Link Layer also
generates and consumes packets which are used for Link management functions.
2.2.1.3Physical Layer
The Physical Layer includes all circuitry for interface operation, including driver and
input buffers, parallel-to-serial and serial-to-parallel conversion, PLL(s), and impedance
matching circuitry . It also includes logical functions related to interface initialization and
maintenance. The Physical Layer exchanges data with the Data Link Layer in an
implementation-specific format, and is responsible for converting this to an appropriate
serialized format and transmitting it across the PCI Express* Link at a frequency and
width compatible with the remote device.
2.2.2PCI Express* Configuration Mechanism
Intel® Xeon® Processor E5-1600 v2/E5-2600 v2 Product Families27
Datasheet Volume One of Two
The PCI Express* link is mapped through a PCI-to-PCI bridge structure.
PCI Express* extends the configuration space to 4096 bytes per-device/function, as
compared to 256 bytes allowed by the Conventional PCI Specification. PCI Express*
configuration space is divided into a PCI-compatible region (which consists of the first
256 bytes of a logical device's configuration space) and an extended PCI Express*
region (which consists of the remaining configuration space). The PCI-compatible
region can be accessed using either the mechanisms defined in the PCI specification or
using the enhanced PCI Express* configuration access mechanism described in the PCI
Express* Enhanced Configuration Mechanism section.
The PCI Express* Host Bridge is required to translate the memory-mapped PCI
Express* configuration space accesses from the host processor to PCI Express*
configuration cycles. To maintain compatibility with PCI configuration addressing
mechanisms, it is recommended that system software access the enhanced
configuration space using 32-bit operations (32-bit aligned) only.
See the PCI Express* Base Specification for details of both the PCI-compatible and PCI
Express* Enhanced configuration mechanisms and transaction rules.
2.3DMI2/PCI Express* Interface
Direct Media Interface 2 (DMI2) connects the processor to the Platform Controller Hub
(PCH). DMI2 is similar to a four-lane PCI Express* supporting a speed of 5 GT/s per
lane. This interface can be configured at power-on to serve as a x4 PCI Express* link
based on the setting of the SOCKET_ID[1:0] and FRMAGENT signal for processors not
connected to a PCH.
Interfaces
Note:Only DMI2 x4 configuration is supported.
2.3.1DMI2 Error Flow
DMI2 can only generate SERR in response to errors, never SCI, SMI, MSI, PCI INT, or
GPE. Any DMI2 related SERR activity is associated with Device 0.
2.3.2Processor/PCH Compatibility Assumptions
The processor is compatible with the PCH and is not compatible with any previous MCH
or ICH products.
2.3.3DMI2 Link Down
The DMI2 link going down is a fatal, unrecoverable error. If the DMI2 data link goes to
data link down, after the link was up, then the DMI2 link hangs the system by not
allowing the link to retrain to prevent data corruption. This is controlled by the PCH.
Downstream transactions that had been successfully transmitted across the link
prior to the link going down may be processed as normal. No completions from
downstream, non-posted transactions are returned upstream over the DMI2 link after a
link down event.
2.4Intel® QuickPath Interconnect (Intel® QPI)
The Intel® QuickPath Interconnect is a high speed, packetized, point-to-point
interconnect used in the 3rd Generation Intel® Core™ Processor Family. The narrow
high-speed links stitch together processors in distributed shared memory and
integrated I/O platform architecture. It offers much higher bandwidth with low latency.
The Intel® QuickPath Interconnect has an efficient architecture allowing more
interconnect performance to be achieved in real systems. It has a snoop protocol
optimized for low latency and high scalability, as well as packet and lane structures
enabling quick completions of transactions. Reliability, availability, and serviceability
features (RAS) are built into the architecture.
The physical connectivity of each interconnect link is made up of twenty differential
signal pairs plus a differential forwarded clock. Each port supports a link pair consisting
of two uni-directional links to complete the connection between two components. This
supports traffic in both directions simultaneously. To facilitate flexibility and longevity,
the interconnect is defined as having five layers: Physical, Link, Routing, Transport,
and Protocol.
• The Physical layer consists of the actual wires carrying the signals, as well as
circuitry and logic to support ancillary features required in the transmission and
receipt of the 1s and 0s. The unit of transfer at the Physical layer is 20-bits, which
is called a Phit (for Physical unit).
• The Link layer is responsible for reliable transmission and flow control. The Link
layer’s unit of transfer is 80-bits, which is called a Flit (for Flow control unit).
• The Routing layer provides the framework for directing packets through
the fabric.
• The Transport layer is an architecturally defined layer (not implemented in
the initial products) providing advanced routing capability for reliable
end-to-end transmission.
• The Protocol layer is the high-level set of rules for exchanging packets of data
between devices. A packet is comprised of an integral number of Flits.
The Intel® QuickPath Interconnect includes a cache coherency protocol to keep the
distributed memory and caching structures coherent during system operation. It
supports both low-latency source snooping and a scalable home snoop behavior. The
coherency protocol provides for direct cache-to-cache transfers for optimal latency.
2.5Platform Environment Control Interface (PECI)
The Platform Environment Control Interface (PECI) uses a single wire for self-clocking
and data transfer. The bus requires no additional control lines. The physical layer is a
self-clocked one-wire bus that begins each bit with a driven, rising edge from an idle
level near zero volts. The duration of the signal driven high depends on whether the
bit value is a logic ‘0’ or logic ‘1’. PECI also includes variable data transfer rate
established with every message. In this way , it is highly flexible even though underlying
logic is simple.
The interface design was optimized for interfacing to Intel processor and chipset
components in both single processor and multiple processor environments. The single
wire interface provides low board routing overhead for the multiple load connections in
the congested routing area near the processor and chipset components. Bus speed,
error checking, and low protocol overhead provides adequate link bandwidth and
reliability to transfer critical device operating conditions and configuration information.
The PECI bus offers:
• A wide speed range from 2 Kbps to 2 Mbps
• CRC check byte used to efficiently and atomically confirm accurate data delivery
• Synchronization at the beginning of every message minimizes device timing
accuracy requirements
Intel® Xeon® Processor E5-1600 v2/E5-2600 v2 Product Families29
Datasheet Volume One of Two
Interfaces
Generic PECI specification details are out of the scope of this document. What follows is
a processor-specific PECI client definition, and is largely an addendum to the PECI
Network Layer and Design Recommendations sections for the PECI specification.
Note:The PECI commands described in this document apply primarily to the Intel® Xeon®
processor E5-1600 v2/E5-2600 v2 product families. The processors utilizes the
capabilities described in this document to indicate support for four memory channels.
Refer to
Table 2-1 for the list of PECI commands supported by the processors.
Table 2-1.Summary of Processor-specific PECI Commands
CommandSupported on the Processor
Ping()Yes
GetDIB()Yes
GetTemp()Yes
RdPkgConfig()Yes
WrPkgConfig()Yes
RdIAMSR()Yes
WrIAMSR()No
RdPCIConfig()Yes
WrPCIConfig()No
RdPCIConfigLocal()Yes
WrPCIConfigLocal()Yes
2.5.1PECI Client Capabilities
The processor PECI client is designed to support the following sideband functions:
• Processor and DRAM thermal management
• Platform manageability functions including thermal, power, and error monitoring
— The platform ‘power’ management includes monitoring and control for both the
processor and DRAM subsystem to assist with data center power limiting.
2.5.1.1Thermal Management
Processor fan speed control is managed by comparing Digital Thermal Sensor (DTS)
thermal readings acquired via PECI against the processor-specific fan speed control
reference point, or T
CONTROL
via the processor PECI client. These variables are referenced to a common
temperature, the TCC activation point, and are both defined as negative offsets from
that reference.
PECI-based access to the processor package configuration space provides a means for
Baseboard Management Controllers (BMCs) or other platform management devices to
actively manage the processor and memory power and thermal features. Details on the
list of available power and thermal optimization services can be found in
Section 2.5.2.6.
2.5.1.2Platform Manageability
PECI allows read access to certain error registers in the processor MSR space and
status monitoring registers in the PCI configuration space within the processor and
downstream devices. Details are covered in subsequent sections.