Application Note
RE01 256KB Group
Ultra-Low Consumption Voice Recognition Wearable User Interface, Home
Appliance Remote Control (Bluetooth® communication)
Introduction
Conventional voice recognition devices often require AC power, but the ultra-low power RE family
enables voice recognition remote controls and wearable device user interfaces that can run without external
power sources for long periods of time on small batteries.
This application note describes the sample code, which combines voice recognition using the RECAIUS
Speech recognition middleware Voice Trigger, Bluetooth
Target Device
RE01 256KB Group
TM
・ RECAIUS
Corporation. Below, it is described as Voice Trigger.
Speech recognition middleware Voice Trigger is a product of Toshiba Digital Solutions
®
communication, and RGB light sensor processing.
TM
TM
・ RECAIUS
other countries.
・ Bluetooth
Bluetooth.
is a registered trademark or trademark of Toshiba Digital Solutions Corporation in Japan or
®
is a registered trademark or trademark of Bluetooth SIG, inc. USA. Below, it is described as
R01AN5686EJ0101 Rev.1.01 Page 1 of 11
Feb.19.21
RE01 256KB Group Ultra-Low Consumption Voice Recognition Wearable User Interface,
Home Appliance Remote Control (Bluetooth® communication)
Contents
1. Specifications .......................................................................................................................... 3
1.1 Description of Sample Code .................................................................................................................... 3
1.1.1 Menu Selection ...................................................................................................................................... 3
1.1.2 Voice: Voice Recognition Mode ............................................................................................................ 3
1.1.3 Brightness: RGB Light Sensor Mode .................................................................................................... 4
1.2 Pins Used ................................................................................................................................................ 5
2. Operating conditions ................................................................................................................ 5
3. Discription of Software ............................................................................................................. 6
3.1 System configuration diagram ................................................................................................................. 6
3.2 Software Structure ................................................................................................................................... 6
3.3 Flowchart ................................................................................................................................................. 7
3.4 Clock Settings for each Mode ................................................................................................................. 9
3.5 Current Consumption .............................................................................................................................. 9
4. Get Sample Code .................................................................................................................... 9
5. Reference Documents ........................................................................................................... 10
Revision History .......................................................................................................................... 11
R01AN5686EJ0101 Rev.1.01 Page 2 of 11
Feb.19.21
RE01 256KB Group Ultra-Low Consumption Voice Recognition Wearable User Interface,
Home Appliance Remote Control (Bluetooth® communication)
1. Specifications
1.1 Description of Sample Code
This application note describes the sample code that combines voice recognition using Voice Trigger,
Bluetooth communication, and RGB light sensor processing. In the voice recognition mode, assuming handsfree operation like a smartwatch or smart glasses, the system recognizes the voice input to the microphone
and display the relevant information on the LCD according to the word detected by the voice recognition
software. The RGB light sensor mode is included as an additional feature as an example of sensor
processing in IoT edge devices. The application calculates the illuminance from the value obtained by the
sensor, and outputs the illuminance value via the LCD and also by BLE communication.
1.1.1 Menu Selection
Use the APP_SET (SW2) and APP_MODE (SW1) buttons to select a demo to run from the menu. The
selectable menus are "Voice" and "Brightness".
APP_SET (SW2): Decide (demo with triangle on the left edge is performed)
APP_MODE (SW1): Select the next demo (the left triangle moves)
Figure 1 shows the menu screen, Figure 2 shows the location of the buttons on the board.
Figure 1 Menu screen
Figure 2 Button position
1.1.2 Voice: Voice Recognition Mode
When " Voice " is selected from the menu, the demo transitions to the voice recognition mode. In this
mode, the Voice Trigger recognizes the voice input to the microphone and displays information on the LCD
depending on the word or phrase detected. The speech recognition result is also transmitted via Bluetooth
and displayed on the tablet PC running an Android app created by Renesas.
R01AN5686EJ0101 Rev.1.01 Page 3 of 11
Feb.19.21
RE01 256KB Group Ultra-Low Consumption Voice Recognition Wearable User Interface,
Output Result
LCD
Tablet PC
Turn on TV
TURN ON TV
Turn on TV
Turn off TV
TURN OFF TV
Turn off TV
Loud sound
LOUD SOUND
Loud sound
Small sound
SMALL SOUND
Small sound
Channel up
CHANNEL UP
Channel up
Channel down
CHANNEL DOWN
Channel down
Home Appliance Remote Control (Bluetooth® communication)
Figure 3 shows the operation in voice recognition mode, and Table 1 shows the words to be recognized
and the output results.
Figure 3 Recognition mode
Table 1 Correspondence between recognized words and output results*
Voice commands
1.1.3 Brightness: RGB Light Sensor Mode
When "Brightness" is selected from the menu, the illuminance value is calculated from the data obtained
from the RGB light sensor and displayed on the LCD. In addition, the illuminance value is transmitted via
Bluetooth and displayed time series graph of it on the tablet PC running an Android app created by Renesas.
Figure 4 shows the operation in RGB light sensor mode.
R01AN5686EJ0101 Rev.1.01 Page 4 of 11
Feb.19.21
RE01 256KB Group Ultra-Low Consumption Voice Recognition Wearable User Interface,
Features
Terminal name
Contents
Switch
P509
APP_ MODE push switch - KRM01_B
P508
APP_SET push switch - IRQ4-C
RGB Light Sensor
P808
IIC communication for illuminance sensor - INT
P809
IIC communication for illuminance sensor - SDA
P810
IIC communication for illuminance sensor - SCL
LCD
P814
Serial communication for LCD - VCOM
P813
Serial communication for LCD - RST
P011
Serial communication for LCD - SCLK
P010
Serial communication for LCD - MOSI
P015
Serial communication for LCD - SCS
Bluetooth module
P702
UART Communication - RXD
P703
UART Communications - TXD
Microphone module
P003
AD analog signal
Item
Description
Microcontroller used
R7F0E01182CFP 100pin
Home Appliance Remote Control (Bluetooth® communication)
Figure 4 RGB light sensor mode
1.2 Pins Used
The pins used by this sample code are as shown in Table 2.
Table 2 Pins used
2. Operating conditions
The operation of the sample code provided with this application note has been tested under the following
conditions (Table 3).
R01AN5686EJ0101 Rev.1.01 Page 5 of 11
Feb.19.21
Table 3 Operating Conditions
RE01 256KB Group Ultra-Low Consumption Voice Recognition Wearable User Interface,
Operating
HOCO is selected as
• HOCO: 64MHz
•
•
•
is divided by 32)
Operating voltage
• 3.3V
Integrated
e² studio
Renesas e² studio 2020-10
GNU 6-2017-q2-update
Debugger
Segger J-Link OB
Demo
Target board
Evaluation Kit RE01 256KB
(Part name: RTK70E0118CXXXXBJ)
LCD expansion board
Included with Evaluation Kit RE01 256KB
(LCD part name: TN0181ANVNANN-AN00)
Microphone module
SparkFun MEMS Microphone Breakout ADMP401
RGB light sensor
SparkFun RGB Light Sensor - ISL29125
Bluetooth module
RL78/G1D Module Pmod™ Interface evaluation board
(Part name: RY7011A0000DZ00)
Tablet PC
NEC LAVIE Tab S PC-508FAM(OS: Android 6.0)
CMSIS driver package version
Rev1.00
Sample code version
Rev1.00
RGB
Light Sens or
RE01 256KB
AD
CPUIIC UART
AGT
DMAC
Voic e
MW
SPI MIP
-LCD
Bluetooth
Module
MIC Module
MIC OPAMP
Tabl et
PC
Voice
Blightness
Input Process in g Output
Home Appliance Remote Control (Bluetooth® communication)
frequency
Development
Environment
components
the system clock
System Clock (ICLK): 64MHz(HOCO)
Peripheral module clock A (PCLKA): 64MHz (HOCO
frequency is not divided)
Peripheral module clock B (PCLKB): 2MHz (HOCO frequency
C Compiler: GCC ARM Embedded Version 6.3.1.20170620
3. Discription of Software
3.1 System configuration diagram
Figure 5 shows a system configuration diagram.
3.2 Software Structure
The sample code for this application has the structure shown in Figure 6
R01AN5686EJ0101 Rev.1.01 Page 6 of 11
Feb.19.21
Figure 5 System Configuration Diagram
RE01 256KB Group Ultra-Low Consumption Voice Recognition Wearable User Interface,
Home Appliance Remote Control (Bluetooth® communication)
Figure 6 Software Structure
3.3 Flowchart
The flowchart of this application is shown in Figure 7.
R01AN5686EJ0101 Rev.1.01 Page 7 of 11
Feb.19.21
RE01 256KB Group Ultra-Low Consumption Voice Recognition Wearable User Interface,
Key inputs?
Mode
selected?
Key inputs?
Key judgement
Key inputs?
Key judgement
APP_MODE
(SW1)
APP_SET
(SW2)
2 seconds?
Home Appliance Remote Control (Bluetooth® communication)
Power ON
Initialization
Demo menu
No
LCD display
APP_MODE(SW1)
Change menu selection
- If in “Voice” mode:
Change to “Brightness” mode
- If in “Brightness” mode:
Change to “Voice” mode
Yes
Key judgement
APP_SET(SW2)
Voice
Bluetooth initialization
Voice recognition Lib
initialization
TMR0,ADC(CH3) initialization
Start AD conversion
Enter sleep mode
Acquire and pre-
process voice data
Brightness
Bluetooth initialization
IIC, AGT0 initialization
Sleep
No
Yes
Read light data via IIC
Brightness calculation
R01AN5686EJ0101 Rev.1.01 Page 8 of 11
Feb.19.21
Process voice
recognition
Brightness value
LCD display
Voice recognition result
Bluetooth transmission
LCD display
Bluetooth transmission
No
No
Yes
Yes
APP_MODE(SW1)
APP_SET(SW2)
Figure 7 Flowchart
RE01 256KB Group Ultra-Low Consumption Voice Recognition Wearable User Interface,
LOCO
32KHz
SOSC
32KHz
MOCO
2MHz
MOSC
32MHz
HOCO
64MHz
Power
control mode
Power supply
mode
After reset released
Operate
Stop
Stop
Stop
Operating
Boost
ALLPWON
After startup executed
Operate
Stop
Stop
Stop
Operating
Boost
ALLPWON
Demo menu
Operate
Stop
Stop
Stop
Operating
Boost
ALLPWON
Voice recognition
demo
Brightness sensor
demo
LOCO
32KHz
SOSC
32KHz
MOCO
2MHz
MOSC
32MHz
HOCO
64MHz
Power
control mode
Power supply
mode
Demo menu
Operate
Stop
Stop
Stop
Operating
Boost
ALLPWON
Voice recognition
demo
Operate
Stop
Stop
Stop
Boost
SLEEP
ALLPWON
Brightness sensor
demo
Operate
Stop
Stop
Stop
Boost
SLEEP
ALLPWON
State
Power consumption of current(mA)
Demo menu
1.1
M
Voice recognition
demo
Brightness sensor
demo
Home Appliance Remote Control (Bluetooth® communication)
3.4 Clock Settings for each Mode
The application layer manages the clock and operating mode during each demo mode operation to reduce
the current consumption.
- Clock and operation mode during operation: Managed by the application layer
- Clock and operation mode during the standby period in menu control: Managed by the application layer
- Clock and operation mode during the standby period in the demo control: Managed by the middleware layer
Table 4 shows the clock and operation mode during operation in each state. In the application layer, the
state during "menu control" is the basic state, and after each state, the clock and operation mode transitions
to the same as during menu control.
Table 4 List of clocks and operation modes in operation
State
Mode
Operate
Operate
Stop Stop Stop
Stop Stop Stop
Operating
Operating
Boost ALLPWON
Boost ALLPWON
During the waiting period of AD conversion of acquiring audio data, or the waiting period for user action, the
software is transitioned to the low-power mode (Sleep) by application layer to reduce current consumption.
Table 5 shows an example of the clock and operation mode during the waiting period.
Table 5 List of clocks and operation modes in waiting period
State
Mode
Operating
Operating
3.5 Current Consumption
Table 6 shows the power consumption of each operation modes.
Table 6 power consumption of each operation modes
4. Get Sample Code
We provide the sample code for RE01 256KB along with the Android app for tablet PC.
Please contact your local Renesas Electronics sales office or distributor.
www.renesas.com/contact/
R01AN5686EJ0101 Rev.1.01 Page 9 of 11
Feb.19.21
ode
1.2
1.2
RE01 256KB Group Ultra-Low Consumption Voice Recognition Wearable User Interface,
Home Appliance Remote Control (Bluetooth® communication)
For more information about Voice Trigger, please contact Toshiba Digital Solutions Corporation.
https://www.toshiba-sol.co.jp/en/contact/index.html
5. Reference Documents
User's Manual: Hardware
RE01 1500KB Group User's Manual Hardware R01UH0796
RE01 256K Group User's Manual Hardware R01UH0894
(The latest version can be downloaded from the Renesas Electronics website.)
RE01 1500KB, 256KB CMSIS Package Startup Guide
RE01 1500KB, 256KB Group Startup Guide to Development Using CMSIS Package R01AN4660
(The latest version can be downloaded from the Renesas Electronics website.)
Technical Update/Technical News
(The latest version can be downloaded from the Renesas Electronics website.)
User’s Manual: Development Tools
(The latest version can be downloaded from the Renesas Electronics website.)
R01AN5686EJ0101 Rev.1.01 Page 10 of 11
Feb.19.21
RE01 256KB Group Ultra-Low Consumption Voice Recognition Wearable User Interface,
Rev.
Date
Description
Page
Summary
1.00
Jan.25.21
First released
1.01
Feb.19.21
- 5 Voice recognition demo supported English commands.
middleware Voice Trigger was added.
Home Appliance Remote Control (Bluetooth® communication)
Revision History
The contact information of RECAIUSTM Speech recognition
R01AN5686EJ0101 Rev.1.01 Page 11 of 11
Feb.19.21
General Precautions in the Handling of Microprocessing Unit and Microcontroller Unit Products
The following usage notes are applicable to all Microprocessing unit and Microcontroller unit products from Renesas. For detailed usage notes on the
products covered by this document, refer to the relevant sections of the document as well as any technical updates that have been issued for the products.
1. Precaution against Electrostatic Discharge (ESD)
A strong electrical field, when exposed to a CMOS device, can cause destruction of the gate oxide and ultimately degrade the device operation. Steps
must be taken to stop the generation of static electricity as much as possible, and quickly dissipate it when it occurs. Environmental control must be
adequate. When it is dry, a humidifier should be used. This is recommended to avoid using insulators that can easily build up static electricity.
Semiconductor devi ces must be stored and transported in an anti-static container, static shielding bag or conductive material. All test and
measurement tools including work benches and floors must be grounded. The operator must also be grounded using a wrist strap. Semiconductor
devices must not be touched with bare hands. Similar precautions must be taken for printed circuit boards with mounted semiconductor devices.
2. Processing at power-on
The state of the product is undefined at the time when power is supplied. The states of internal circuits in the LSI are indeterminate and the states of
register settings and pins are undefined at the time when power is supplied. In a finished product where the reset signal is appli ed to the external reset
pin, the states of pins are not guaranteed from the time when pow er is supplied until the reset process is completed. In a similar way, the states of pins
in a product that is reset by an on-chip power-on reset function are not guaranteed from the time when power is supplied until the power reaches the
level at which resetting is specifi ed.
3. Input of signal during power-off state
Do not input signals or an I/O pull-up power supply while the device is powered off. The current injection that results from input of such a signal or I/O
pull-up power supply may cause malfunction and the abnormal current that passes i n the device at this time may cause degradation of internal
elements. Follow the guideline for input signal during power-off state as described in your product documentation.
4. Handling of unused pins
Handle unused pins in accordance with the directi ons given under handling of unused pins in the manual. The input pins of CMOS products are
generally in the high-impedance state. In operation with an unused pin in the open-circuit state, extra electromagnetic noise is induced in the vicinity of
the LSI, an associated shoot-through current flows internally, and malfunctions occur due to the false recognition of the pin state as an input signal
become possible.
5. Clock signals
After applying a reset, only release the reset line after the operating clock signal becomes stable. When switching the clock signal during program
execution, wait until the target clock signal is stabilized. When the clock signal is generated with an external resonator or from an external oscillator
during a reset, ensure that the reset line is only released after full stabilization of the clock signal. Additionally, when switching to a clock signal
produced with an external resonator or by an external oscillator while program execution is in progress, wait until the target clock signal is stable.
6. Voltage application waveform at input pin
Waveform distortion due to input noise or a reflected wave may cause malfunction. If the input of the CMOS device stays in the area between V
(Max.) and V
input level is fixed, and also in the transition period when the input level passes through the area between V
7. Prohibition of access to reserved addresses
Access to reserved addresses is prohibited. The reserved addresses are provided for possible future expansion of functions. Do not access these
addresses as the correct operation of the LSI is not guaranteed.
8. Differences between products
Before changing from one product to another, for example to a product with a different part number, confirm that the change will not lead to problems.
The characteristics of a microprocessing unit or microcontroller unit products in the same group but having a different part number might differ in terms
of internal memory capacity, layout pattern, and other factors, w hich can affect the ranges of electrical characteristics, such as characteristic values,
operating margins, immunity to noise, and amount of radiated noise. When changing to a product with a different part number, implement a system-
evaluation test for the given product.
(Min.) due to noise, for example, the device may malfunction. Take care to prevent chattering noise from entering the device when the
IH
(Max.) and VIH (Min.).
IL
IL
Corporate Headquarters
Contact information
www.renesas.com
Trademarks
of their respective owners.
Notice
1. Descriptions of circuits, software and other related information in this document are provided only to illustrate the operation of semiconductor products
and application examples. You are fully responsible for the incorporation or any other use of the circuits, software, and information in the design of your
product or system. Renesas Electronics disclaims any and all liability for any l osses and damages incurred by you or third parties arising from the use
of these circuits, software, or information.
2. Renesas Electronics hereby expressly disclaims any warranties against and liability for infringement or any other claims involving patents, copyrights,
or other intellectual property rights of third parties, by or arising from the use of Renesas Electronics products or technical information described in this
document, including but not limited to, the product data, drawings, charts, programs, algorithms, and application examples.
3. No license, express, implied or otherwise, is granted hereby under any patents, copyrights or other intellectual property rights of Renesas Electronics
or others.
4. You shall be responsible for determining what licenses are required from any third parties, and obtaining such licenses for the lawful import, export,
manufacture, sales, utilization, distribution or other disposal of any products incorporating Renesas Electronics products, if required.
5. You shall not alter, modify, copy, or reverse engineer any Renesas Electronics product, whether in whole or in part. Renesas Electronics disclaims any
and all liability for any losses or damages incurred by you or third parties arising from such alteration, modification, copying or reverse engineering.
6. Renesas Electronics products are classified accordi ng to the following two quality grades: “Standard” and “High Quality”. The intended applications for
each Renesas Electronics product depends on the product’s quality grade, as indicated below.
"Standard": Computers; office equipment; communications equipment; test and measurement equipment; audio and visual equipment; home
"High Quality": Transportation equipment (automobiles, trains, ships, etc.); traffic control (traffic lights); large-scale communication equipment; key
Unless expressly designated as a high reliability product or a product for harsh environments in a Renesas Electronics data sheet or other Renesas
Electronics document, Renesas Electronics products are not intended or authorized for use in products or systems that may pose a direct threat to
human life or bodily injury (artificial life support devices or systems; surgical implantations; etc.), or may cause serious property damage (space
system; undersea repeaters; nuclear power control systems; aircraft control systems; key plant systems; military equipment; etc.). Renesas Electronics
disclaims any and all liability for any damages or losses incurred by you or any third parties arising from the use of any Renesas Electronics product
that is inconsistent with any Renesas Electronics data sheet, user’s manual or other Renesas Electronics document.
7. No semiconductor product is absolutely secure. Notwithstanding any security measures or features that may be impl emented in Renesas Electronics
hardware or software products, Renesas Electronics shall have absolutely no liability arising out of any vulnerability or security breach, including but
not limited to any unauthorized access to or use of a Renesas Electronics product or a system that uses a Renesas Electronics product. RENESAS
ELECTRONICS DOES NOT WARRANT OR GUARANTEE THAT RENESAS ELECTRONICS PRODUCTS, OR ANY SYSTEMS CREATED USING
RENESAS ELECTRONICS PRODUCTS WILL BE INVULNERABLE OR FREE FROM CORRUPTION, ATTACK, VIRUSES, INTERFERENCE,
HACKING, DATA LOSS OR THEFT, OR OTHER SECURITY INTRUSION (“Vulnerability Issues”). RENESAS ELECTRONICS DISCLAIMS ANY AND
ALL RESPONSIBILITY OR LIABILITY ARISING FROM OR RELATED TO ANY VULNERABILITY ISSUES. FURTHERMORE, TO THE EXTENT
PERMITTED BY APPLICABLE LAW, RENESAS ELECTRONICS DISCLAIMS ANY AND ALL WARRANTIES, EXPRESS OR IMPLIED, WITH
RESPECT TO THIS DOCUMENT AND ANY RELATED OR ACCOMPANYING SOFTWARE OR HARDWARE, INCLUDING BUT NOT LIMITED TO
THE IMPLIED WARRANTIES OF MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE.
8. When using Renesas Electronics products, refer to the latest product information (data sheets, user’s manuals, application notes, “General Notes for
Handling and Using Semiconductor Devices” in the reliability handbook, etc.), and ensure that usage conditions are within the ranges specified by
Renesas Electronics with respect to maximum ratings, operating power supply voltage range, heat dissipation characteristics, installation, etc. Renesas
Electronics disclaims any and all liability for any malfunctions, failure or accident arising out of the use of Renesas Electronics products outside of such
specified ranges.
9. Although Renesas Electronics endeavors to improve the quality and reliability of Renesas Electronics products, semiconductor products have specific
characteristics, such as the occurrence of failure at a certain rate and malfunctions under certain use conditions. Unless designated as a high reliability
product or a product for harsh environments in a Renesas Electronics data sheet or other Renesas Electronics document, Renesas Electronics
products are not subject to radiation resistance design. You are responsible for implementing safety measures to guard against the possibility of bodily
injury, injury or damage caused by fire, and/or danger to the public in the event of a failure or malfunction of Renesas Electronics products, such as
safety design for hardware and software, including but not limited to redundancy, fire control and malfunction prevention, appropriate treatment for
aging degradation or any other appropriate measures. Because the evaluation of microcomputer software alone is very difficult and impractical, you are
responsible for evaluating the safety of the final products or systems manufactured by you.
10. Please contact a Renesas Electronics sales office for details as to environmental matters such as the environmental compatibility of each Renesas
Electronics product. You are responsible for carefully and sufficiently investigating applicable laws and regulations that regulate the inclusion or use of
controlled substances, including without limitation, the EU RoHS Directive, and using Renesas Electronics products in compliance with all these
applicable laws and regulations. R enesas Electronics disclaims any and all liability for damages or losses occurring as a result of your noncompliance
with applicable law s and regulations.
11. Renesas Electronics products and technologies shall not be used for or incorporated into any products or systems whose manufacture, use, or sale is
prohibited under any applicable domestic or foreign laws or regulations. You shall comply with any applicable export control laws and regulations
promulgated and administered by the governments of any countries asserting jurisdiction over the parties or transactions.
12. It is the responsibility of the buyer or distributor of Renesas Electronics products, or any other party who distributes, disposes of, or otherwise sells or
transfers the product to a third party, to notify such third party in advance of the contents and conditions set forth in this document.
13. This document shall not be reprinted, reproduced or duplicated in any form, in whole or in part, without prior written consent of Renesas Electronics.
14. Please contact a Renesas Electronics sales office if you have any questions regarding the information contained in this document or Renesas
Electronics products.
(Note1) “Renesas Electronics” as used in this document means Renesas Electronics Corporation and also includes its directly or indirectly controlled
(Note2) “Renesas Electronics product(s)” means any product developed or manufactured by or for Renesas Electronics.
subsidiaries.
electronic appliances; machine tools; personal electronic equipment; industrial robots; etc.
financial terminal systems; safety control equipment; etc.
(Rev.5.0-1 October 2020)
TOYOSU FORESIA, 3-2-24 Toyosu,
Koto-ku, Tokyo 135-0061, Japan
Renesas and the Renesas logo are trademarks of Renesas Electronics
Corporation. All trademarks and registered tradem arks are the property
For further information on a product, technology, the most up-to-date
version of a document, or your nearest sales office, please visit:
www.renesas.com/contact/
.
© 2021 Renesas Electronics Corporation. All rights reserved.
Loading...