Cambricon Technologies MLU270 S User Manual

MLU270-S Series Intelligent Processing
Card User Manual
V1.0.0
Cambricon Technologies, MLU270-S Series Intelligent Processing Card User Manual
Revision History
Document Name
Revision
V1.0.0
Created Date
2019.08.20
Revision History
Date
Revision No.
Notes
0
2019.08.20
V1.0.0
First Release
1
2
3
4
5
Technical Supports contacts: service@cambricon.com
www.cambricon.com
Cambricon Technologies, MLU270-S Series Intelligent Processing Card User Manual
Content
1. Product Brief
2. Product Specifications
2.1 Performance specifications
2.2 Software specifications
2.3 Operating Environment
2.4 Mechanical Specifications
2.5 Package Size and Weight
2.6 Thermal Specifications
2.7 Power Supplies Specifications
...................................................................................................................................
...................................................................................................................
.................................................................................................
........................................................................................................
......................................................................................................
...................................................................................................
...................................................................................................
........................................................................................................
..........................................................................................
3. Cambricon NeuWare Development Environment
4. Compliance
..................................................................................................................................
...................................................................
4 6 6 6 8 8 9
9 12 13 14
Cambricon Technologies, MLU270-S Series Intelligent Processing Card User Manual

1. Product Brief

Figure.1 MLU270-S Series Intelligent Processing Card
Specially designed MLU270-S series dedicated to AI inferences and data center
accelerations with high EER (Energy Efficiency Rate)
The SIYUAN 270 ASIC has been designed based on several innovative technologies in the architecture of processors owned by Cambricon. Along with it, many up-to-date features have been integrated into a standard HHHL PCIe card, which can be inserted into a modern AI PC/server so as to provide a huge extension of calculation power of AI inferences. MLU270-S series has a moderate TDP of 70W and it can provide a calculation power as high as 4 times of the previous generation. It can be widely used in applications such as vision, voice, natural language processing, legacy machine learning, and many other AI scenarios, and it can be used in an AI inferences platform to make it work with even higher EER.
Brand-new Cambricon MLUv02 Architecture
The MLUv02 architecture is not just a simple update from previous generation, but a brand new design based on NOC (Network on Chip), which will guarantee the parallel efficiency of execution of 16 NPU cluster within the SIYUN 270 ASIC. The dataflow will be compressed within the chip by dedicated hardware engine and this will increase the volume and bandwidth effectively. The new architecture can fully support all the AI accuracies such as INT16, INT8, INT4, FP32, FP16, and provide necessary calculation power to many kinds of Neural Network. In a word, the new architecture can provide both good universality and best performances to customers at the same time.
One more step on the performances of inferences
When using INT8 accuracy for AI inference calculations, the performance of non-sparse networks is improved up to 4 times as much as that of the previous generation. MLU270-S series can provide a great EER as high as 40 times of a normal CPU. There are embedded newly designed code/decode hardware for videos and pictures, so when the system have to handle this kind of tasks, MLU270-S series will decrease the load of CPU and the occupation
Cambricon Technologies, MLU270-S Series Intelligent Processing Card User Manual
for PCIe bandwidth, so as to increase the performances even more.
Calculating flexibility and programmability
SIYUAN 270 ASIC can provide supports to many kinds of Neural Networks. Cambricon NeuWare software stack can easily deploy inference environment.BANG Lang.CHENG environment can be directly customized for computing resources ,meeting all kinds of AI customization requirements,professional but not specialized.
Cambricon Technologies, MLU270-S Series Intelligent Processing Card User Manual
Loading...
+ 9 hidden pages