Page 1
MLU100-C Series Intelligent P rocessing Card User Manual
Cambricon, MLU100-C Series Intelligent Processing Card User Manual, 2018-09
Page 2
Revision History
Documen t Name
Created Date
MLU100-C Series Intelligent Processing Card User Manual
Revision
Revision No.
Draft Date Revision No. Notes:
0 2018.09.01 V1.0.0 Fir st Re lease
1 2018.09.06 V1.0.1
2 2018.10.22 V1.0.2
3 2018.12.1 V1.0.3 Coding/decoding related descriptions updated.
4
Technical supports contact: [email protected]
www.cambricon.com
Power consumption, heat dissip ation and
power supplies updated
Peak Processing Capacit y and PCIe B AR
updated
V1.0.1
2018-09-01
Cambricon, MLU100-C Series Intelligent Processing Card User Manual, 2018-09
Page 3
Content
1. Product Brief ..........................................................................................................................................4
2. Product specifications...........................................................................................................................5
2.1 Performance specifications .....................................................................................................5
2.2 Software specifications ...........................................................................................................6
2.3 Working Environm ent Specifications ...................................................................................7
2.4 Outli ne Dimension Specifications .........................................................................................7
2.5 Heat Dissipation S pecifications .............................................................................................7
2.6 Power Supplies Specifications ...............................................................................................8
3. Software Development Environment .............................................................................................. 11
4. FCC notes ............................................................................................................................................ 11
Cambricon, MLU100-C Series Intelligent Processing Card User Manual, 2018-09
Page 4
1. Product Brief
Figure. 1 MLU100-C Series Intelligent Processing Card appearance
Cambricon MLU100-C Series Intelligent Processing Card
The MLU100-C Series is the third generation of Intelligent Processing Cards provided by
Cambricon Technologies, on which populated one p iece of Cambricon MLU100 chip. It can provide
extr emel y high calculating and video co ding/decoding capacities to the Cloud In ference. Compared
with classical general-purpose CPU, MLU100-C can achieve a much bigger Performance/Powerconsumption ratio whe n handling the AI (Art ificial Intelligence) related works, which makes it a real
AI-read y processor.
MLU100-C Series Intelligent Processing Card has a theoretical equivalent Peak Processing
Capacity of about 128TOPS(INT8), and it can be integrated into a server or workstation by a PCIe Gen3
x16 single slot. The Card’s heat dissipation solution is passive so the server (workstation) system should
be in charge of providing cooling airflow. T he typica l power co nsumption of the card is about 60-90W.
MLU100-C Series Intelligent Processing Card can support up to 16GB DDR4 with ECC capacity.
Cambricon MLU100-C Series Intelligent Processing Card’s key features:
1. Versatility —— As a u niver sa l inte llige nt pr oces so r, it can support many kinds of Deep Learning
technologies and mult i mo da l int e l l igent p ro c es sin g such as vision, voice and nature language, and
it can be used in a wide range.
2. Sparsification —— By bringing sparsity techno logy into AI chip, it can achieve a theoretical peak
performance of 128TOPS (INT8).
3. High efficiency —— Co mpa re d wit h GP U, it ha s featured special Instruction Set and processor
architecture dedicated to deep learning and AI, so it has much higher Performance/Power-
consumption ratio.
4. Perfect software development environment —— Cambric on Techn ologies provi des a thorough and
Cambricon, MLU100-C Series Intelligent Processing Card User Manual, 2018-09
Page 5
mature development environment Cambricon NeuW are for MLU100-C series processors, and it has
included a full set of tools such as A pplication Development, Function Debugging and Perf ormance
Optimizations.
5. CE, FCC, UL certificates.
2. Product specifications
2.1 Performance specifications
Table 1 describes the performance specifications of Cambricon MLU100-C Series Intelligent
Processing Card.
Card Type MLU100-C3/C4
Processor Architecture Cambricon MLUv01
Core Clock 1 GHz
Peak FP16
Peak INT8
Video Coding/Decoding Support Yes
Total Memory Size 8GB/16GB
Memory Bus Width 256-bit
Memory Bandwidth 102.4 GB/s
System Interfaces PCI Expre ss Gen3, x16, Support ing Lane Reversal
PCIe ID
Outline 267mm(L)*111.15mm(W), Single-Slot
Typical Power 60-90W
TDP 110W
ECC Supporting Yes
Table 1 PCIe Card hardware Specifications
16 TFLOPS (Without Sparsity)
64 TFLOPS (With Sparsity)
32 TOPS (Without Sparsity)
128 TOPS (With Sparsity)
PCIe Vendor ID 0xCABC
PCIe Device ID 0x0100
PCIe Sub-Vendor ID 0xCABC
PCIe Sub-System I D 0x00C3/0x00C4
Cambricon, MLU100-C Series Intelligent Processing Card User Manual, 2018-09
Page 6
2.2 Software specifications
PF （1，64bit）:
>
REGISTER A DDR ESS
PCIE Vendor ID and
Vendor ID and
Table 2 Describes the so ftwar e specifications of MLU100-C Series Card：
BAR0: 256MB prefetchable
BAR2: 16MB prefetchable
PCIe Base address（MLU100）
ECC Protect Yes (Enabled by default)
SMBus (8bit Address) 0x8E (write) 0x8F (read)
Table 2 P CIE Card Software Specifications
SMBUS R egist e r is 32-bit wide, and Table 3 describes how to read a register:
DIRECTION M->S M->S S->M M->S S->M
BITS 1 8 1 8 1
CONTENT S SLAV E
ADDRESS
（Write）
M->S
1 8 1 8 1 8 1 8 1 8 1 1
Sr SLAVE
M->S S->M S->M M->S S->M M->S S->M M->S S->M M->S M-
ACK DATA[
ADDRESS
（Read）
BAR4: 64MB prefetchable
VF（4，64bit）：
BAR0: 16MB prefetchable
BAR2: 16MB prefetchable
BAR4: 16MB prefetchable
ACK
ACK DATA[
7:0]
15:8]
ACK DATA[
23:16]
ACK
ACK DATA[
31:24]
S
N P
Table 3 SMBUS register reading
Table 4 describes the definit io n a nd addr ess o f SMBUS r egisters:
Registers Address Access Description
Total Card Power 0x01 RO Card Power consumption, Float Data, Unit W
Card Tem perature 0x02 RO Card Temperature, Float Data, Unit ℃
Chip T emperature 0x03 RO Chip Temperature, Float Data, Unit ℃
0xA0 RO [15:0] Vendor ID
Device ID
PCIE Sub-
Sub-Sy st em ID
Device Name 0xF0 RO
0xA1 RO [15:0] Sub-Vendor ID
[31:16] Device ID
[31:16] Sub-Syst em ID
Cambricon, MLU100-C Series Intelligent Processing Card User Manual, 2018-09
Page 7
Vendor Name 0xF1 RO
Hardware Revision 0xF2 RO
Firmware Revision 0xF3 RO
Manufacturing Time 0xF4 RO
Device ID 0xF5 RO
Table 4 SMBUS Registers Descript ion
2.3 Wo r king Environment Specifications
Operating Temperature
Storage Temperature
Operating Humidity
Storage Humidity
Table 5 P CIE Card Working Environment
2.4 Out line Dimension Spe cifica tions
0℃～45°C
-40℃～75℃
5%—95% Relative Humidity
5%—95% Relative Humidity
Figure 2 MLU100-C out line dimension
2.5 Heat Dissipation Specifications
MLU100-C Series Intelligent Process ing Card is using a passive heat dissipation method. The s yst em
designers should pay attentions to b elow for the Ai rf low Volume at the entrance and Temperature
of Ambient relationship, so as to design a cooling syste m for the card and guarantee t he card is
operating within the green reco mmendation area. The core clock frequency of the chip will be
decreased to half when the te mperat ur e o f chip is over 87℃, a nd shut down when over 90℃.
Cambricon, MLU100-C Series Intelligent Processing Card User Manual, 2018-09
Page 8
Figure 3 Tem perature of Ambient vs Airflow Volume
Below is the supporte d direction of airflo w: I t supports either of directions.
Figure 4 Supported direction of airflow
2.6 Powe r Supplies Spe cifica tions
Refer to below, MLU100-C Series Intelligent Processing Card provides an 8-pin CPU Power
Supply Socket:
Cambricon, MLU100-C Series Intelligent Processing Card User Manual, 2018-09
Page 9
Figure 5 8-Pin CPU Power socket
Users can use the 8-Pin CPU Power Socket within a Server direct ly, or use the 8-Pin PCIe Power
Socket, along wit h a One-to-Two cable.
Refer to below for a One-To-Two cable:
Figure 6 One-To-Two Cable
8-Pin CPU Socket 8-Pin PCIe Socket 1 8-Pin PCIe Socket 2 Color
12V 5 3 Yellow
Cambricon, MLU100-C Series Intelligent Processing Card User Manual, 2018-09
Page 10
12V 6 1,2 Yellow
12V 7 3 Yellow
12V 8 1,2 Yellow
GND 1 7,8 Black
GND 2 5,6 Black
GND 3 7,8 Black
GND 4 5,6 Black
Table 6 Cable Wire s rela tionship
Figure 7 Adapter Cable Connection Relationship
Note : The fir s t p in (Pin N o.1 ) of every sockets sho uld have an obvious d is ting uishable mark a t the side .
Attentions should be paid to it.
Power Supply Min (V) Normal(V) Max(V) Current
PCIe edge connecter（12V）
PCIe 8-pin connecter（12V）
PCIe edge connecter（3V3）
Table 7 Power Supplies - Voltages a nd Curr ent s Sp ecifications
Avg (A)
10.8 12 13.2 2 3
10.8 12 13.2 7.5 11.25
3.0 3.3 3.6 0.2A 0.3A
Current
Peak (A)
Cambricon, MLU100-C Series Intelligent Processing Card User Manual, 2018-09
Page 11
3. Software Development Environment
Cambricon Technologies provides a software development environ ment : Cambricon NeuWare
NeuWare can fully support all kinds of mainstream programming framewo rk, such as TensorFlow,
Caffe, Caffe2, MXNet and ONNX. With above mentioned Programming Framework s, users can easily
and conveniently develop and deploy their Deep Learning A pplications on Cambricon MLU100-C Series
Inte llig e nt Pro ce ss ing Car ds. At the sa me t ime, NeuWare pro vides complete ru ntime sys tem and driver
software to speed up the system integration procedure.
NeuWare also provides a full set of software tools such as Application Development, Function
Debugging and Performance Optimizations. The Application Development Tools include Machine
Learning Library , Runtime Library, Compiler, Model retraining tools and Domain-Specific (for example
Video Ana lys is ) SDK; The F unctio n Debugg ing Tools ca n fulfil l all the require ments fro m differe nt
levels of Programming Framework and Function Libr ary; The Performance Optimization Tools include
tools for perfo rmanc es analys i s and system monitoring.
Figure 8 Cambricon NeuWare
For more infor mation, please refer to: www.cambricon.com
Tel: +86-10-83030003
Email: [email protected]
Address: 11 Floors, Block D, Zhizhen Building, 7 Zhichun Road, Haidian District, Beijing
4. FCC notes
This device complies with Part 1 5 of the FCC Rules.
Operation is subject to the following two conditions: (1) This device may not cause harmful
interference, and (2) t his device must accept any interference rece ived, including inter ference that may
cause undesired operat ion.
NOTE: This equipment has been tested and found to comply with the limits for a Class B digital
device, pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection
against harmful interference in a residential installat ion. This equipment generat es, uses and can radiate
radio frequenc y energy and, if not installed in accordance with the instructions, may cause harmful
Cambricon, MLU100-C Series Intelligent Processing Card User Manual, 2018-09
Page 12
interference to radio communications. However, there is no guarantee t hat inter ference wi l l not occur in
a particular installation. I f th is equipment does cause interference to radio or television recept ion, which
can be determined by turning the equ ipment off and on, the user is encouraged to try to correct the
interference by one or more o f the following measur es:
Reorient or relocat e the receiving ant en na
Increase the separat ion between t he equ ipment and r eceiver
Connect the equipment into an outlet on a circuit different fro m that to which the receiver is
connected
Consult the dealer or an experienced r adio/TV technician for help
Information User:
Changes or modifications not expressly approved by the party responsible for compliance
could void the user's authority to operate the equipment.
Cambricon, MLU100-C Series Intelligent Processing Card User Manual, 2018-09
Loading...