STMicroelectronics UM2800, STEVAL-VOICE-UI User Manual

UM2800

User manual

Getting started with the STEVAL-VOICE-UI voice user interface evaluation kit

Introduction

The STEVAL-VOICE-UI Amazon™ qualified evaluation kit is designed to allow evaluation of a cost-effective way to integrate

AVS for AWS IoT Services® into smart devices, so they can implement state-of-art, hands-free voice control based on natural language comprehension.

Users will therefore enjoy a heightened experience with target IoT end products, with the ability to talk to Amazon Alexa and control smart home devices, get assistance, listen to the news, check the weather forecast, play music, etc.

The software package implements audio front-end, Amazon wake word, audio playback and Amazon Alexa® communication protocol software. The SDK runs on internal memories only, offering maximum integration and cost-effective solutions.

The STEVAL-VOICE-UI is built with a modular approach for easy prototyping and debugging purposes as well as easy adaptation to specific microphone spacings, user interface and audio output requirements.

Figure 1. STEVAL-VOICE-UI voice user interface evaluation kit

UM2800 - Rev 1 - November 2020	www.st.com
For further information contact your local STMicroelectronics sales office.

UM2800

Overview

1Overview

The STEVAL-VOICE-UI kit features:

•STM32H753VIT6E high-performance MCU with 2 MB embedded Flash, 1 Mb embedded SRAM and in cost-effective LQFP package

•2.4 GHz Wi-Fi subsystem with Murata 1DX module used in bypass mode coupled to ISSI IS25LP016D 2 MBytes NOR Flash memory

•3 x MP23DB01HP MEMS microphones with 36 and 30 mm spacing

•FDA903D class D digital input automotive audio amplifier

•8 Ohm loudspeaker

•4 RGB LEDs and 4 simple LEDs

•Joystick, reset and user push buttons

•High modularity with mother/daughter board

•Small 36x65 mm² footprint with simple and cost-effective PCB design

1.1Kit components

The STEVAL-VOICE-UI kit package includes:

•STEVAL-VUIMB02V1: VUI mother board embedding the STM32H753VIT6E MCU and the Wi-Fi module

•STEVAL-VUIDB01V1: VUI daughter board including the audio front-end (MP23DB01HP microphones and FDA903D audio amplifier) and the user interface (buttons, joystick, LEDs and USB)

•8 Ohm speaker

•Mechanical parts

•STLINK-V3MINI debugger/programmer for STM32 with programming cable

•A to C connector cable

1.2Functional block diagram

Figure 2. STEVAL-VOICE-UI functional block diagram

STEVAL-VUIMB02V1

STEVAL-VUIDB01V1

STM32H753VIT6E

PDM

STDC14

Digital microphone

Cortex-M7F@480MHz

MP23DB01HP

1MB RAM

2MB Flash

40pin

I2S

I2S

Speaker

Audio OUT

conn

PDM

output

(CN1) I2C

I2C

FDA903D

connector

I2C

ST1S12GR

UART

STSAFE

I2C

700mA DC-DC

LED1202

4x RGB

(Optional)

(Optional)

UART

Led driver

LED

SPI

Wi-Fi sub-system
Wi-Fi Module		2MB NOR		2x Buttons
				Joystick
(bypass mode)		Flash
Murata 1DX		ISSI IS25LP016D

USB-C		4 LED

UM2800 - Rev 1	page 2/34

UM2800

System requirements

1.3System requirements

•Windows® OS (7, 8 and 10), Linux® 64-bit, or MacOS®

•html5 web browser version

•Companion app requires Android 7

1.4Development toolchains

•IAR Systems - IAR Embedded Workbench® EWARM

1.5Power supply

The easiest way to power the STEVAL-VOICE-UI kit is via the USB-C connector.

Table 1. Power supply options

J1

J8

Description

CLOSE

CLOSE

Single power supply from USB. Do not connect V_PA (J2)

CLOSE

OPEN

Single power supply from V_PA (J2) → up to 5 V

Dual power supply:

OPEN

CLOSE

•

5 V from USB

•

V_PA from J2 → Up to 18 V

OPEN

OPEN

5 V from external source (CN1)

Figure 3. STEVAL-VOICE-UI power supply block diagram

STEVAL-VUIDB02V1

STEVAL-VUIMB01V1

VBUS

USB-C

5V

J8

U4

3V3

STM32H7

V_PA

ST1S12

J2

J1

STSAFE

MP23DB01HP

FDA903D

Wi-Fi sub-module

Audio Amplifier

LED1202

2MB NOR

Murata 1DX

UM2800 - Rev 1	page 3/34

UM2800

User interfaces

1.6User interfaces

Figure 4. STEVAL-VOICE-UI user interfaces

1.4 LEDs

2.Reset button

3.4 RGB LEDs

4.J8

5.J1

6.Loudspeaker terminals

7.Programming connector (STDC14)

8.User button

9.Joystick

UM2800 - Rev 1	page 4/34

UM2800

Demo firmware

2Demo firmware

2.1Pre-requisites

The pre-installed ST_VOICE_UI flashed demo firmware demonstrates a voice service solution able to connect to AVS for AWS IoT.

A direct Internet connection is needed (without proxy).

As an Alexa® device, you need an Amazon™ account to connect to AVS for AWS IoT service. The account can be created on www.amazon.com or other local versions.

The users who have registered to Amazon Music service will be able to play music on the device.

2.2Device setup

Step 1. Power the device through a USB C cable.

Step 2. Configure the network connection.

Step 3. Register to AVS for AWS IoT service.

2.2.1Android users

For Android users, the stvsSmartConfig companion app is available on Google Store and allows configuring the device. The application is also available in the software delivery package for manual installation.

UM2800 - Rev 1	page 5/34

UM2800

Device setup

Step 1. To configure a new device, push the [Onboarding new device] button and follow the instructions.

Figure 5. stvsSmartConfig procedure

2.2.2Other users - HTTP UI

The device embeds an HTTP service that the consumer can connect to via smartphone or PC and an HTML5 browser (Safari or Chrome). To connect to the server, the smartphone must be connected to the same Wi-Fi spot of the board.

The HTTP UI interface tab allows checking the service status and changing some configurations. Two cases must be distinguished:

1.Wi-Fi connection

2.Other connections (Wi-Fi information already logged in)

2.2.2.1Wi-Fi connection

Step 1. Ensure the device is in Access Point (AP) mode.

Step 1a. Check the current mode using the RGB LEDs (see Table 2).

Step 1b. If not in AP mode, refer to Section 2.9 .

Step 2. Connect your phone/PC navigator to 192.168.0.1.

Step 3. Follow the procedure described in Section 2.2.2.1.1 .

2.2.2.1.1Wi-Fi configuration

By default, the device comes in Wi-Fi AP mode and offers a hotspot whose name looks like stvs-xxxx.

Step 1. Connect your PC or smartphone to the hotspot and then connect the browser to the address

192.168.0.1.

UM2800 - Rev 1	page 6/34

UM2800

Device setup

Step 2. Go to STVS UI [Setup] tab.

Figure 6. STVS user interface

Step 3. Push the [Wi-Fi-Scan] button.

All visible spots will be listed in the scan results.

Step 4. Scroll down and select your home network (in this case the hotspot is called [Netbook]).

Step 5. Scroll back and type the Wi-Fi password.

Step 6. Scroll down and select the connection type ([Wi-Fi STA].

Step 7. To connect the board, scroll up and select [Re-connect].

Step 8. Check RGB LEDs on the board (see Table 2).

After few seconds, the Wi-Fi state should switch from “disconnected” to “connected “.

The board reboots and connects to the network via Wi-Fi using a new IP address.

2.2.2.2Connection to Wi-Fi STA

In this case, hotspot Wi-Fi information has already been configured and the board is properly connected to it (refer to Section 2.2.2.1.1 , step 6).

UM2800 - Rev 1	page 7/34

UM2800

Device registration

	Step 1.	Get the board IP address available in the serial console.
	Step 2.	Refer to Section 2.11	to access the traces.
Note:	Traces with the IP address looks like:
	00:00:00 : 192.168.X.X :		06:STVS_EVT_NETWORK_IP(0x3001D5BC)
	The IP is no longer in the AP mode (address = 192.168.0.1).

Step 3. Connect to the UI using the given address.

Step 4. If there is no serial console connected to the board, scan the network using a free application.

Once installed, the application shows all STVS devices available in the neighborhood and allows connecting to them:

–iPhone users can install “Bonjour HTTP search” from the App Store;

–Android users can download “BonjourBrowser” from the Android Store;

–PC users can install “bonjour browser” from www.tildesoft.com.

2.3Device registration

Step 1. From www.amazon.com or local Amazon server, create an Amazon account.

Step 2. Under [Setup] tab, click [Registration](HTML5 browser required).

The browser will display a code and a link (amazon.com/code).

UM2800 - Rev 1	page 8/34

UM2800

Device registration

Step 3. Copy the code and click on the link.

Figure 7. CBL device registration code

You will be redirected to an Amazon sign-in page.

Figure 8. Amazon sign-in page

Step 4. Enter you Amazon credentials.

If credentials are correct, you will be redirected to the following page.

Figure 9. Register device page

UM2800 - Rev 1	page 9/34

UM2800

Privacy mode

Step 5. Past or enter the code given in the previous page and click on continue.

If this step is successful, the board connects to AVS for AWS IoT and the LEDs turns off after few seconds.

Figure 10. Successful registration

Now you can test the device. You can talk to Alexa (for example, asking: “Alexa, what time is it ?”)

2.4Privacy mode

The device enters privacy mode when you briefly push the white user button.

A red LED switches on and the device does not send any other audio request to the cloud, even when saying "Alexa".

2.5Alarms

When an alarm or a timer is set and the device rings, you have to press the joystick to acknowledge and stop the alert.

Example of voice requests:

•“Alexa set a timer for 2 minutes”;

•“Alexa set an alarm at 5 pm”;

•“Alexa set alarm” → Alexa will ask for details.

2.6Amazon music control

If the Amazon account used to register the board is registered to Amazon music, it is possible to ask Alexa to play some songs or playlists and navigate it.

The joystick is also used to navigate music playlists.

2.7LED UI animations

Table 2. RGB LED animations indicating device state

Effects	Color	Internal service ID	Animation	Comment
				Just after the reset.
	Blue	Restarting	Solid	It remains like this
				until the first event is
				dispatched.
				It remains like this
	Blue/Cyan	Booting	Normal beat	during the basic
				system initialization.

UM2800 - Rev 1	page 10/34

					UM2800
					LED UI animations
	Effects	Color	Internal service ID	Animation	Comment
					It signals a
					configuration state,
		Cyan/Orange	configuration_changes	Normal beat	mainly when the
					board is in Access
					Point mode.
					During the boot, it
		Blue/Yellow	has_ip	Very fast blinking	signals by a sort
					event that the network
					has an IP address.
					It signals an error,
					the system needs
					AWS and AVS
		Red/Purple	error_need_credentials	Fast blinking	credentials. It should
					occur only during
					test and development
					configuration.
					It signals an error.
		Green/Red	error_need_registration	Slow rotation	The system needs an
					AVS registration (refer
					to Section 2.3 ).
					It signals a
		Yellow/Green	connecting	Fast counterclockwise rotation	reconnection to the
					AVS for AWS IoT
					service.
		Red	Privacy	Very long pulsation	It signals the privacy
					mode is ON.
		Blue/Black	Wakeup	Very fast rotation	Short signal when a
					Wakeup occurs.
		Black	Idle	All off	It signals the board is
					ready for interactions.
					The AVS for AWS IoT
		Blue	activeListening	Very long pulsation	service is listening for
					utterance.
		Black	stopListening	All off	Not signalled yet.
		Black	startListening	All off	Not signalled yet.
					The AVS for AWS IoT
		Cyan	activeSpeaking	Very very long pulsation	service is speaking or
					playing.
		Black	stopSpeaking	All off	Not signalled yet.
		Black	startSpeaking	All off	Not signalled yet.
		Black	thinking	All off	Not signalled yet.
					A timer/alarm/
		Red/Black	alerting	Slow counterclockwise rotation	notification/remember
					is triggered.

UM2800 - Rev 1	page 11/34