Lattice EVDK, LF-EVDK1-EVN User Manual
User Guide
FPGA-UG-02073-1.0
September 2018
EVDK Based Vehicle Classification
EVDK Based Vehicle Classification
User Guide
Contents
Acronyms in This Document ................................................................................................................................................. 4
1. Introduction .................................................................................................................................................................. 5
2. Functional Description .................................................................................................................................................. 6
3. Demo Setup .................................................................................................................................................................. 8
3.1. Hardware Requirements ..................................................................................................................................... 8
3.2. Software and Firmware Requirements ............................................................................................................... 8
3.3. Board Settings ..................................................................................................................................................... 8
4. Programming the Demo ............................................................................................................................................. 11
4.1. Programming the MicroSD Card Firmware ....................................................................................................... 11
5. Running the Demo ...................................................................................................................................................... 13
Technical Support ............................................................................................................................................................... 15
Revision History .................................................................................................................................................................. 16
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
2 FPGA-UG-02073-1.0
© 2018 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
EVDK Based Vehicle Classification
User Guide
Figures
Figure 2.1. Lattice EVDK with MicroSD Card Adapter Board ................................................................................................ 6
Figure 2.2. Vehicle Classification Demo Diagram ................................................................................................................. 7
Figure 3.1. Back View of ECP5 VIP Input Bridge Board ......................................................................................................... 9
Figure 3.2. Top View of CrossLink VIP Input Bridge Board ................................................................................................. 10
Figure 4.1. Connecting the MicroSD Card ........................................................................................................................... 11
Figure 4.2. Win32 Disk Imager ............................................................................................................................................ 12
Figure 5.1. Example Output with Car Image ....................................................................................................................... 13
Figure 5.2. Example Output with Truck Image ................................................................................................................... 14
Figure 5.3. Example Output with Motorbike Image ........................................................................................................... 14
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-UG-02073-1.0 3
© 2018 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
EVDK Based Vehicle Classification
Acronym
Definition
CNN
Convolutional Neural Network
EVDK
Embedded Vision Development Kit
FPGA
Field-Programmable Gate Array
LED
Light-emitting diode
MLE
Machine Learning Engine
SDHC
Secure Digital High Capacity
SDXC
Secure Digital eXtended Capacity
SPI
Serial Peripheral Interface
VIP
Video Interface Platform
USB
Universal Serial Bus
NN
Neural Network
User Guide
Acronyms in This Document
A list of acronyms used in this document.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
4 FPGA-UG-02073-1.0
© 2018 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
EVDK Based Vehicle Classification
User Guide
1. Introduction
This document provides technical information and instructions for setting up and running the EVDK Based Vehicle
Classification Demo. This demo is designed to utilize the Lattice Machine Learning Engine (MLE) IP and is implemented
on the Lattice Embedded Vision Development Kit (EVDK). The EVDK based vehicle classification demo takes image data
from one of the cameras on the EVDK and feeds it through a CNN and outputs the input image with a bounding box
overlay through the HDMI Output. The color of the bounding box and a letter indicate the vehicle class.
Refer to the following documents for detailed information on Lattice development boards and kit:
Lattice Embedded Vision Development Kit User Guide (FPGA-UG-02015)
CrossLink VIP Input Bridge Board Evaluation Board User Guide (FPGA-EB-02002)
ECP5 VIP Processor Board Evaluation Board User Guide (FPGA-EB-02001)
HDMI VIP Output Bridge Board Evaluation Board User Guide (FPGA-EB-02003)
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-UG-02073-1.0 5
© 2018 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
EVDK Based Vehicle Classification
CrossLink VIP
Input Bridge Board
ECP5 VIP
Processor Board
HDMI VIP Output
Bridge Board
MicroSD Card
Adapter Board
Camera Sensor CN2
Camera Sensor CN1
User Guide
2. Functional Description
The EVDK Based Vehicle Classification Demo is designed to utilize the Lattice Embedded Vision Development Kit with
MicroSD Card Adapter Board, as shown in Figure 2.1.
The Lattice Embedded Vision Development Kit features a stackable modular architecture consisting of three boards:
CrossLink Video Interface Platform (VIP) Input Bridge Board
ECP5 VIP Processor Board
HDMI VIP Output Bridge Board
Figure 2.1 shows Revision C of the Embedded Vision Development Kit. For earlier revisions, refer to the user guide of
the specific evaluation board. For more information on the Embedded Vision Development Kit, visit the Lattice website
Embedded Vision Development Kit page.
The firmware, which holds the CNN training results (from Caffe tool) is stored inside the SD card. The MLE classifies
input images and generates a bounding box and class designation which is shown as an overlay on the output image.
As shown in Figure 2.2, the video data taken by the camera sensor (CN2) on the CrossLink VIP Input Bridge Board are
fed into the ECP5 VIP Processor Board where the MLE processes the image data. This data, with weights and biases
from the firmware, is used to create the bounding box and classification overlay.
The implementation of this demo in ECP5-85 consists of 8 Neural Network engines (NN) engines.
Figure 2.1. Lattice EVDK with MicroSD Card Adapter Board
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
6 FPGA-UG-02073-1.0
© 2018 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
Loading...