Getting Started ...................................................................................................................................................... 5
Step One: Installing USB Drivers ........................................................................................................................ 5
Default Setting of DIP Switches and Jumper Blocks ......................................................................................... 15
ON/OFF Switch and the Power Supply Circuit .................................................................................................. 15
IO Summary and Allocations ............................................................................................................................. 16
LEDs and Pushbuttons ...................................................................................................................................... 17
Serial Memory ICs ............................................................................................................................................. 17
Parallel Memory IC ............................................................................................................................................ 17
USB .................................................................................................................................................................... 18
NLP-5x Demo/Emulation Board Parts Locator .................................................................................................. 19
Welcome to the NLP-5x an d the world of low-cost, high-performance s peech recognition! T he resources in the
NLP-5x Demo/Emulation Toolkit will allow you to produce innovative and powerful products that feature a high
level of system inte gration us ing low-cost leading-edg e speech tech nologies. This manual disc usses the use of
these resources for evaluation an d development purposes. It assum es the reader is an experienced s oftware
developer who understands C langu age program ming and em bedded s ystems developm ent methods , but who
may not be specifically familiar with Sensory’s ICs.
This Toolkit supports the NLP-5x only. It cannot be used to develop products for the RSC-164, 264, 364,
4128 or SVC families of chips.
Included in the NLP-5x Demo/Emulation Toolkit
NLP-5x Demo/Emulation board (60-0258), featuring a NLP-5x running in emulation mode and all of the
components necessary to evaluate Sensory’s speech technologies.
USB Cable
(2) Speakers
Wall-Mount Power Supply (120V) 9VDC
NLP-5x Toolkits Installer (Download from ftp://ftp4.sensoryinc.com/software/nlp5x/nlp5xtoolkit.zip)
Complete Documentation including NLP-5x Demo/Emulation Manual (80-0314-x)
(this manual) — For use as a Quick Start Guide
FluentChip™ 5 for NLP-5x Technology (FC5) Library, with speech recognition technologies
including T2SI™ speaker-independent (SI), speaker-dependent (SD), speaker-verification (SV),
plus speech and music synthesis, MP3 decoding, and a variety of other technologies
“QuickSynthesis™ 5” (QS5), which allows speech to be compressed for low data-rate synthesis
“SensoryLoader5” (SL5), which is used to download programs to the NLP-5x
Programming/Verification Board
This toolkit works in conjunction with:
ZView Tools for NLP-5x, which includes the ZViewIDE and the ZView C compiler.
Quick T2SI™ Toolkit for NLP-5x (sold separatel y), which can be used to create speaker-independent
recognition sets by simply typing the vocabulary into a PC based GUI and downloading it to the NLP-5x
Demo/Emulation board.
The NLP-5x provides the following technology features important for low-cost consumer products:
Wide operating voltage range (2.0 to 3.6V)
Power-down sleep mode to conserve power
Pulse Width Modulator (PWM) to directly drive an 8-ohm speaker
Stereo D/A converters (DACs)
Integrated microphone amplifiers requiring only a few additional passive components
Ability to interface to optional external parallel and serial memories
Developing a product that effectively integrates Sensory’s speech technologies requires hardware platform
development, software development, product integration, and human-interaction testing. For the best speech
recognition performance, each of these design areas should be error-free. Sensory helps to facilitate successful
implementation by providing free design consultations and product reviews. Refer to the Speec h Rec og nit io n
Hardware Design Guide (80-0073-x) for more details.
Check for updates and the most recent versions of the technology libraries on the Sensory website at
The NLP-5x Demo/Emulation board uses the FT232B(L) USB UART IC chip manufactured by Future
Technology Devices Int’l (FTDI). In order to interface to a PC, you need to download and install their USB
drivers. These drivers make the NLP-5x Demo/Emulation board appear as a Virtual COM Port. If you have
used other Sensory boards in the past, you may already have drivers installed that will work with the NLP-5x
Demo/Emulation board.
For more information, refer to the Future Technology Devices Int’l website at:
http://www.ftdichip.com
In the above installation guides, you will be instructe d to
our case, this “device” is the Demo/Emulation board. The USB circuit for the PC loader is powered from the USB
connector, so you do not need to turn on the Demo/Emulation board. Simply connect the USB cable to the USB
connector located on the bottom of the board near the lower-left corner, which is labeled “PC LOADER”. There are
three USB connectors near the lower-left corner, so be careful to connect to the correct one.
Note: The port number assigned to th e Virtua l COM Port m ay change if you plug the USB c able into a d iff erent
USB connector on your computer!
Note: If a problem occurs with the USB connection to the NLP-5x Demo/Em ulation board, try connecting the
USB cable to a different connector on your computer, and try to bypass USB hubs if possible.
Uninstalling USB Drivers
If you need to remove the drivers, go to the Windows Control Panel, choose “Add or Remove Programs”, and
then remove “FTDI USB Serial Converter Drivers.”
“connect the device to a spare USB port on your PC”. In
Step Two: Installing Sensory Tools
We recommend that you read all of the documents available in this archive before attempting to install
any software or connect the Demo/Emulation bo ard to your PC.
1) Navigate to the Main Window in the installer program.
2) Click “Install FluentChip™ 5” This will install Sensory’s speech technology libraries.
3) Click “Install QuickSynthesis™5”. This will install the tool that allows you to compress speech files for
playback.
4) Click “Install SensoryLoader5.” This will allow you to download demos and applications from your PC to the
Demo/Emulation board.
When the NLP-5x D emo/Emulation board is connected to your c omputer, a COM port number is automatically
assigned to the Virtual CO M Port driver. The Se nsory software tools must be configure d to use this COM port
number. The follo wing screen shots show wher e to view and/or change the COM port in the Device Ma nager
and the various Sensory tools.
Note: The port number assigned to th e Virtua l COM Port m ay change if you plug the U SB ca ble into a d iff erent
USB connector on your computer!
To find out the port number selected for the Virtual COM Port driver, use the Device Manager in your PC’s
Administrative Tools Co ntrol Pane l under Com puter Managem ent/System Tools—or—System Properties on My
Computer. In the Device M anager, the Virtual COM P ort will appear in the secti on for Ports (CO M & LPT) as a
USB Serial Port. In this example you will see that the USB Serial Port was assigned to COM5.
If for some reason you want to change the assigned port number, double-click on the USB Serial Port in the
Device Manager list for access to the Properties window for that device, and then click on the Port Settings tab.
The Advanced Settings window allows you to change the COM Port number. While not neces sary, you can also
change the latency setting to the minimum value (1) to improve upload performance.
SensoryLoader5 is a utility program for downloading executable and data files to the NLP-5x Demo/Emulation
board. Use the pull-down menu to select the correct COM port number.
QuickSynthesis™ 5.
QuickSynthesis5 (QS5) is the tool used to compress speech and sound eff ects for NLP-5x projects. It has the
ability to download pr ojec ts to the NLP-5x Demo/Emulation boar d f or lis ten ing tests. In order to us e th is feature,
you will need to select the correct COM port. From QS5, click on the File menu, and then select Options.
In the Options W indow, select the COM port for the NLP-5x Demo/Emulation Board. To use the download
feature, you will also need to select the FluentC hip ™ 5 for NLP-5x path. The easiest way to do this is to click on
the Find button in the Options window after you have installed the FluentChip™ 5 Library.
Step Three: Running Programs on the Demo/Emulation Board
The Sensory Demo/Emulation Toolk it allows developers to quick ly grasp how Sensory’s speech technologies
work. The Toolkit includes sample programs that use many of the Sensory technology functions.
Note: Although most sample programs will run with the defau lt board DIP switch and jum per settings, some
sample programs requir e different settings or additi onal hardwar e. Read the ac compan ying sample instructions
before you download the sample program. The default DIP switch and jumper settings are found in the
Demo/Emulation Hardware section.
Note: You can downl oad and run previously compiled sample and app lication programs without installing the
ZView tools.
1) Setting up the Hardware:
Place the On/Off switch (S4) of the Demo/Emulation board to the OFF position.
Connect the 9VDC power supp l y to J1 of t h e Demo/Emulation board, or install three A A b atteri es in the
Demo/Emulation board if you want to power the board with batteries.
Connect a speaker to one of the speaker outputs of the Demo/Em ulation board. Most dem os use the
SPKR PWM output. O ther demos use two speaker s connected to the stereo DAC o utputs, SPKR L
and SPKR R.
If required, connect other hardware to the Demo/Emulation board per the demo instructions.
Connect the USB connector from the com puter to the USB connector (CN6) on the D emo/Emulation
board, which is labeled as “PC LOADER”. When the computer recognizes that a USB device is
connected, you will hear t he USB device con nect sound. If you don’t hear this s ound, or see the err or
message on the computer, something went wrong. If this happens, it is probably because the FTDI
USB drivers were not installed correctly. Uninstall the FTDI USB drivers, then install them again.
Place the On/Off switch (S4) in the ON position, and confirm that the green LED “POWER” turns on.
2) Downloading the sample:
Open SensoryLoader5.
Maker sure that the correct COM port number is selected.
In the file type box, click on the button lab ele d “NLP-5x Program (*.out)”.
In the destination box, click on the button labeled “NLP-5x”.
Click “…”, then browse an d select the desired executable file. Downloadable NLP-5x executable files
have a “.out” extension.
Click on the “Download” button.
If downloading does not start imm ediatel y, press the “ PROGRAM” but ton on De mo/ Emulation boar d to
switch to download mode.
Note: Some sample programs r equire an additional data file to be downloaded to external m emory; either
serial or parallel flash. If this is the case, follow the procedure written in the sample instructions.
Note: If the USB c able was not conn ected before you opened Sensor yLoader5, the actu al COM port m ight
not be available to select. If this is the case, close Sen s oryLoader5, and re-open i t af ter you have con nec te d
the USB cable.
Note: When you c lick on th e “Downloa d” button in the SL5 window or press the “ PROGRAM” button on t he
D/E board, the 4 LEDs on the D/E board should flash once with the left-to-right sequence. If they blink
quickly and continu ously, turn off the board with the ON/OFF s witch (S4), wait a couple of s econds, power
on again, and then press the “PROGRAM” button.
3) Running the Sample:
Press the “RUN” button on the Demo/Emulation board.
Step Four: Installing and getting a license for the ZView Tools for NLP-5x
Refer to the Installation Instruction for ZView (80-0320-x), for installation and licensing.
Step Five: Building a Sample Program with the ZViewIDE
Sample programs with s our ce codes are included i n the FluentChip™ 5 for NLP-5x library. You can find t hem in
the library’s “samples” folder. For example, the T2SI sample program is found at:
C:\Sensory\FC5_0_3\samples\t2si
Note: “FC5_0_3” i ndicates that the librar y is FC5 and the version is 0.3. The library’s fol der name will
change accordingly to its version.
Building a sam ple pro gr am using the ZViewIDE is a great way to get going. The easiest wa y to s tart c o din g i s to
edit one of the sample programs that use the technology that your project will use.
The Workspace Folder
An empty folder named “w orks pace” is pr ovided at th e root of librar y, which is where you should k eep all pr ojec t
folders. The folder is found at:
C:\Sensory\FC5_0_3\workspace
Copying the T2SI Sample Project to the Workspace Folder
Let’s start with the t2s i sample. C op y the entire t2s i fol der to the works pace folder. After this has been done, the
t2si folder will be a sub-folder of workspace:
C:\Sensory\FC5_0_3\workspace\t2si
Note: In addition to the c ode and applicat ion data, each sample folder i ncludes the fairl y complicated
configuration data for the ZViewIDE, which is the essential information for compiling and building a
project. Starting a new proj ect by copying and then ed iting an existing sam ple program for your project
will significantly simplify the process and save you time.
Note: When the library is updated, simply copy the project folder to the updated library, like this:
C:\Sensory\FC5_0_4\workspace\t2si
As long as you keep this format, no configuration files will need to be changed.
Opening the ZViewIDE
Double click on the ZViewIDE icon. When you do, the “W orkspace Launcher” window will open. At “select a
workspace”, browse to:
C:\Sensory\FC5_0_3\workspace
The ZViewIDE should then be open.
For a project to be acces sible by the ZViewIDE, it must be im ported i nto a wor k space. From the “ File” pull down
menu, select “Import.” The Import Window will then be opened. Select “Existing Project into Workspace”, and
browse to find the folder containing the project.
C:\Sensory\FC5_0_3\Workspace\t2si
Note: The “Project name:” box is high lighte d in gray, and you will not b e a ble to enter the ne w tex t. This
is because the proj ect name is a part of the IDE co nfiguration, and it is already includ ed in the project
folder. In this case, t he project f older is “t2si”. W hen the proj ect folder is s elected, the project nam e will
be displayed. In this case, it is “t2si”.
When the project is loaded, the icon with the name of the project folder will appear the “DSP Projects” window.
Click the “+” icon next to the “t2si” icon. This will expand the icon and will display the content at the root of the
t2si folder. To view the application source code, double click on “t2siApp.c”.
Renaming a Project
While it is not neces s ar y to r ename a sample projec t th at you ha ve copi ed to t he workspace f older and imported,
it may be a good idea to do so. You can’t cop y the same sample program to the workspace again without
renaming or deletin g the first version. To renam e a project, just right-click on the project name in the “DSP
Projects” window, and select “Rename.”
Renaming the project also renames the project folder name on your disk, however, the executable name
created by t he com piler and linker tools wi ll not change. If you want to chang e the executable file name, rightclick on the project nam e in the “DSP Projects” wind ow again and select “ Properties”. In the Projec t Properties
window, click on Build Options. The Active Configuration should be shown to be DebugG1. Click on the
“Manage…” button n ext to the conf iguration name. T his window has a text box labele d “Artifact name:” whic h
contains the name of the executable file produced by the compiler and linker tools.
Compiling and Linking a Project
To compile and link the t2si project, right click on “t2si” in the “DSP Projects” window, and select “Rebuild
Project”.
Note: Her e we use “Rebuild Project” inst ead of “Build Project” because “Build Proj ect” will not compile
source files that ha ve not changed since t h e last c ompilation. “Rebu ild Pr oj ect” compiles all sour c e f iles
(*.c, *.s) in the project folder and subfolders of the project folder whether they have changed or not.
The executable f ile is located in the “DebugG1” folder in the project f older, and the n ame of file (if you have not
changed it as described in the above section) is “t2si.out”.
Note: It is always a good idea to c heck the tim e that the f ile was c reated to m ake sure tha t the fi le was
actually created. To do that, right, click on the “.out” file, and select “properties”. In the properties
window, you will find it in the “Last modified” column.
Confirm that the DIP switches and jumpers are set to the default settings
Connect the speaker, and power up the Demo/Emulation board.
Connect the USB cable from the computer to the “PC LOADER” connector of the Demo/Emulation
board.
Open SensoryLoader5. Select the COM port, click on the buttons labeled “NLP-5x Program (*.out)”
and “NLP-5x” if these butto ns are not already selec ted, then click on “… ” to browse to the execut able
file “t2si.out” in the DebugG1 folder.
Click the “Download” button.
If downloading does not begin automatically, press the PROGRAM button on the NLP-5x
Demo/Emulation board.
Note: There is a shortcut for opening SensoryLoader5 and selecting the executable file. Right click
“t2si.out” in the “DSP Projects” window and select “Open with”, then select “SensoryLoader5”.
Note: When you click on th e “Do wnload” bu tton in the SL5 windo w or press the “PR OGRAM” butt on on
the D/E board, th e 4 LEDs on the D/E b oard should f lash once with the lef t-to-right sequence. If they
blink quickly and continuously, turn off the board with the ON/OFF switch (S4), wait a couple of
seconds, power on again, and then press the “PROGRAM” button.
Running the t2si Sample Program
Press the “RUN” button to start the t2si demo.
You will hear a beep followed by a speec h prompt.
The trigger word is:
Sensory
The command words are:
Appliance
Blue genie
MP3 player
Natural oven set
Natural time set
Recognition
Speech output
Say “Sensory,” and after the beep, say one of the command words. The demo will respond with the
corresponding speech prompt.
For more details on how to use the ZViewIDE for NLP-5x development, refer to the “Operational Instructions for
the ZViewIDE for NLP-5x” instructions.
On the NLP-5x Demo/Emulation board, four chips are used to emulate an actual NLP-5x. These chips are:
•NLP-5x (U4) configured in emulation mode. This chip emulates all NLP-5x features except for the
processor, on-chip memories, and the external address/data bus.
•A Verisilicon VSI403LP(U3) that emulates the NLP-5x processor and on-chip Instruction RAM,
Instruction OTP, and Data RAM.
•A Xilinx FPGA XC3250AN (U1) that emulates the NLP-5x external parallel address/data bus, including
signals A[22:0], D[15:0], –RD, -WR, -CS0 and –CS1.
•A 64Kx16 SRAM (U6) that emulates the NLP-5x Expansion OTP memory.
For application development purposes, you should consider the four chips listed above as a single NLP-5x.
WARNING
The NLP-5x Demo/Emulation board is not an exact duplicate of an actual NLP-5x. As much as
possible, the FluentChip™ 5 for NLP-5x lib rary tries to mask differences between the emulator
and the real NLP-5x chip from application level programmers. Because differences do exi st, it is
necessary to verify all programs by programming an NLP-5x IC and running it on your
application hardware, or by using the NLP-5x Program/Verification board (60-0263).
The Demo/Emulation board has another NLP-5x (U8), which with the USB interface IC FT232BL (U13), is used
for downloading the programs and data from a PC. All com ponents which are not applic at ion-related are placed
on the bottom side of the board. The ICs which are necessary parts for emulating the NLP-5x: XC3250AN (U1),
VSI403LP (U3), 64Kx16 SRAM (U6) are also placed on the bottom of the board.
All ICs and components such as memory ICs, buttons, LEDs, microphones, etc. that allow application
developers to create hardware mockups of their final product are located on the top side of the board.
WARNING
Do NOT change the jumpers while the power is turned on. Before changing any jumpers, turn off
the ON/OFF switch (S4).
The first time that you use the Demo/Emulation board, confirm that all jumper blocks are
installed at the default settings before turning on the power.
All three DIP switches (S1, S9, and S10) at ON position
Jumper Blocks
JP1 at CS0
JP5 at AUTO
JP6 at NC
JP7 shorting block in place
JP3 at Manual
Connectors are labeled as CN. They do not need jumper blocks.
ON/OFF Switch and the Power Supply Circuit
The Demo/Emulation board can be powered by an external 9VDC power supp ly or by on-board batteries. To
use the external power supply, connect the adapter pl ug into J1 locate d near the upper-right corner of the board.
To use batteries, install 3 AA batteries into the battery holder located on the bottom side of the board.
The On/Off switch ( S4) is also loca ted near the upper-right corner of the board. W hen this switch is in the ON
position:
If the external power supply is plugged in, the board is powered from the external power supply.
If the external power supply is not plugged in, the board is powered from the on-board batteries.
When the power is applied to the board, the green LED (D8) will turn on.
The power supply circ uit is located in the upper -right area of the board, and there are 5 po wer supply outputs
with test points:
VCCA: 3.3V, powers the application analog circuit
VCCB: 3.3V, powers the application digital circuit
VCCC: 3.3V, powers supporting circuits
VCCINT: 1.2V, used for XC3250AN (U1) and VSI403LP (U3)
VCCBAT: 5V if external power supply is used, and 4.5V if the battery is used.
There are four LEDs a nd four pushbuttons connect ed to the NLP-5x’s IO ports . Refer to the c hart for the IO
summary and allocations.
LED SW Default DIP Switch (S9)
The LED SW default DIP S witch (S9) is provided to allow each LED and pushbutton to be disconnected from
the NLP-5x IO pins so that the IO pins can be used for a different purpose. To disconnect them, place the
switches on the OFF positions.
Connector (CN9)
This connector is pr o vided t o int erf ac e with t he ex ter n al de vices which will be connected t o in p ar alle l with L EDs
and switches.
Connector (CN8)
This connector is provid ed to connect different port pins to th e LEDs and switches. To do this , place the LED
SW default DIP switch to the OFF position, an d make connections with hook-up wires to CN8 from the CN3
connector.
Serial Memory ICs
We have pr o vided one 32Mbit Seri al F las h IC, AT45DB321D, (U23) and one 128Kbit Serial EEPROM, 24LC128
(U24). Their connections can be disconnected by Serial Memory DIP switch (S10) in the OFF position.
If you are going to connect an external device with a SPI interface:
Disconnect the on-board serial flash, or
Use a dedicated port pin for –CS signal for the external device.
Parallel Memory IC
We have provided one 32Mbit parallel memory IC, AT49BV322D (U2).
The NLP-5x has one PWM audio output and two DAC audio outputs, which can be used for stereo applications.
On the Demo/Emulation board, we have provided one audio jack for PWM (J6), and two audio jacks for DAC
outputs (J4 and J5).
DAC Amplifier and Volume Control
To amplify the NLP-5x's differential DAC outputs, we have provided a fully differential stereo audio amplifier, the
TPA6021A4 (U22). Because each channel has differential outputs (bridge-ti ed lo ads) there is no common
ground connection, so there are separate speaker jacks for each channel. Do not use a Y cable that shorts one
of the outputs of each channel together.
The volume of the DAC outputs is controlled with the dial (R88). When a shorting block is placed at Manual at
the “Audio Shutdown” header (JP3), the audio shutdown is controlled with this dial.
Adding Volume Control for PWM
To add volume control to the PWM output of the board:
Disconnect the spe aker cord from the m ini-plug jack on
the PCB.
Cut into one side of the cord and insert a 200 Ohm
potentiometer in series with the wire.
Microphone Circuit
There are two on-board microphones. To use the external microphone, plug the microphone cable into the
microphone jack. If you do, the on-board microphone will be disconnected from the circuit.
Microphone Power
The microphones are powered with VCCA. If you can power the microphones with a IO port, remove the
shorting block from MIC PWR (JP7), and connect the IO port to pin 2 of JP7.
Microphone Bias Resistors
MIC 1 has a 2.2K O hms microphone bias resistor ( R84), and MIC2 also has a 2.2K Ohms microphone bias
resistor (R85). If you need to change the value of microphone bias resistor, replace these resistors. For
selecting a microphone and bi as res is tor, r ef er to the design note – NLP-5x Microphone Se lecti on D esi gn G u ide
(80-0318).
USB
There are three USB conn ectors on Demo/Emulation board. T hey are labeled “PC LOADER”, “DE BUG”, and
“APP USB”. “PC LOAD ER” is used to download the code and data i nto the Demo/Emulation board. The one
used for the application is “APP USB”. “DEBUG” is reserved for future use.
1. Optional. This capacitor MAY reduce noise coupled into the AFE on a noisy PCB.
2. If used, this capacitor MUST be placed close to the VPC AVSS and MICP1 pads.
3. Place close to NLP-5x pads
4. Optional. These capacitors may be used to reduce high frequency response. The
tradeoff is reduced amplitude.
5. For reducing system ESD susceptibility.
6. Typical value. Refer to Sensory Design Note 80-0318 "Selecting a Microphone for
NLP-5x" to determine proper value for your application
7. SETTING RESISTOR AND CAPACITOR VALUES IN THE MICROPHONE POWER LINE FILTER CIRCUIT:
The capacitor value should be between 220 and 30 ufd.
The resistor value should be between 150 and 2000 ohms.
Within these ranges;
Select the largest capacitor consistent with other constraints (cost, size,etc.)
For this capacitor, select a resistor such that the RC time constant is ~60msec.
8 *Refer to Sensory Design Note 80-0073 "Speech Recognition Hardware Design" for
information on proper microphone selection and housing design, PCB layout, as well as
test and evaluation procedures to verify proper design and operation.
9. Optional. These capacitors may serve to reduce EMI ratiation that could result from
long speaker wires. Exact values should be determined empirically. In typical
applications these caps will not be needed.
* Sensory offers a FREE Design Review Service. Detatils of this service are also
included in 80-0073.
Developing NLP-5x Applicat ions on the NLP-5x Demo/Emulation Boa rd
There are several differences between the way the NLP-5x Demo/Emulation board operates and the actual
NLP-5x chip. The differences arise because the board uses a chip set to em ulate the actual NLP-5x. The
chipset consists of a Verisilicon VSI403 Processor, a 64KW SRAM, an FPGA, and a NLP-5x configured for
emulation mode. The NLP-5x chip in the above-named chipset emulat es all the f unctions of the NLP-5x except
for the processor, on-chip mem or i e s, and external parallel memory interface.
The NLP-5x’s process or is em ulated by the VSI403 . It has 32KW of on-chip code RAM that em ulates the NLP5x’s 1KW Instruction RAM and 31KW (out of 32KW ) of the NLP-5x’s Instruc tion OTP. It also has 16KW of onchip data RAM that emulates, and exceeds, the 11KW data RAM of the NLP-5x.
The NLP-5x’s 32KW Expansion OTP mem or y is emula ted by the first half of the 64KW SRAM in the chipset (the
upper half is reserved).
The FPGA in the chipset emulates the NLP-5x’s External Memory Bus.
The major differences between the NLP-5x Demo/Emulation Board and the actual NLP-5x:
Access Speed for Instruction OTP Memory
When the NLP-5x is c onf ig ur ed to ru n at 40 MHz or less, it does not ha ve to be i n T ur bo Mode, s o th e NLP-5x’s
Instruction OTP can be accessed at full speed. In this case the VSI403 and NLP-5x throughput are matched.
When the NLP-5x is c onfigured to run faster th an 40MHz, it m ust be in Tur bo Mode. In this mode the NLP-5x
processor can run at full speed from Instruction RAM, or when executing tight loops of 8 instructions or less from
the processor’s cac he. When running from Instruction OTP, throughput is r educed by as much as one third
because wait states will be inserted when reading the Instruction OTP memory.
The NLP-5x Demo/Emulation boar d will run faster tha n the real NLP-5x when ex ecuting from Instruction OT P.
For most applications that do not approac h the per form anc e limits of the NLP-5x, this is not an issue. Ho wever,
applications that approach and might exceed the limits of the NLP-5x must be verified on an actual NLP-5x chip.
Access Speed for Expansion OTP, Exter n al Memory, and Peripherals
Because these resour ces a re all ex ternal t o the pr oces sor chip in th e NLP-5x Dem o/Emulation c hips et, they are
accessed somewhat s lower than with the re al NLP-5x. Thus f or applicati ons that mak e heavy use of Expansion
OTP or External Parallel Flash, the NLP-5x-DE emulator will run somewhat slower than the real NLP-5x, all
other factors being equal.
Timers #0, #1 and # 3 will run twice as fast in T urbo Mode on the NLP-5x Demo/Em ulation chipse t than on the
actual NLP-5x. When not in Turbo Mode, they run at the same rate on both platforms.
A global variable platf orm can be tes ted by soft ware to deter mine when the program is running on the NLP-5xDE. This is don e automatically in librar y functions such as _Setu pTimer0(). Here is an ex ample of explicitly
setting up timer 3 when in Turbo Mode, where the prescale value is selected based on the platform. This
example is from the Timers sample in the FluentChip™ 5 for NLP-5x library.
• XM Mode (i.e., internal OTP memories disabled) is not emulated by the NLP-5x Demo/Emulation board .
• The Low Voltage Detect NMI Interrupt is not emulated.
• The NLP-5x has more interrupt channels than are emulated by the NLP-5x Demo/Emulation board.
Normally, applications will not need to use these additional interrupt channels. The FluentChip™ 5 for
NLP-5x library will not use interrupt channels that cannot be emulated.
•The External Memory Interface is not electrically identical to the real NLP-5x, because it is emulated by
an FPGA chip that has somewhat different characteristics, such as drive strength etc. The NLP-5xDemo/Emulation board has permanent 200K-ohm pull-up resistors on the address, data, and control
signals of the External Me mory Interface, whereas the real NLP-5x can control whether each pull-up is
present when the address and/or data lines are used as general purpose I/O pins.
• The NLP-5x Demo/Emulation board operat ing vol tag e is fixed at 3.3V.
• VSI403 Errata: the VSI403 chip uses an earlier version of the ZSP processor than that used in the
NLP-5x. There are some problems in the VSI403 that have been fixed in the NLP-5x processor. Some
of these are discussed in the Emulator Features chapter of the NLP-5x datasheet. The most important
issue is that using a bitc, bits, or biti with the %ireq register may cause interrupts to be lost, and since
the processor in the VSI403 uses edge-sensitive interrupts, the program may appear to “lock up” for
lack of interrupts. The solution is to re-register interrupts after using one of the listed problematic
instructions. Writing 0x1f to the miStatus register will re-register the 5 merged interrupt sources. Most
application level programs will not need to modify the %ireq register.
Important: This software end user license agreement ("EULA") is a legal agreement between you and Sensory. Read it
carefully before completing the installation process and using the software. It provides a license to use the software and
contains warranty information and liability disclaimers. By installing and using the software, you are confirming your
acceptance of the software and agreeing to become bound by the terms of this agreement. If you do not agree to be bound
by these terms, then select the "cancel" button and do not install the software.
1. Definitions
(a) "Sensory" means Sensory, Inc. and its suppliers and licensors, if any.
(b) "Not For Resale (NFR) Version" means a version of the Software, so identified, to be used to review and evaluate
the Software, only.
(c) "Software" means the software program supplied by Sensory herewith, which may also include documentation,
associated media, printed materials, and online and electronic documentation.
2. License
This EULA allows you to:
(a) Install and use the Software on a single computer; OR install and store the Software on a storage device, such as a
network server, used only to run or install the Software on your other computers over an internal network, provided
you have a license for each separate computer on which the Software is installed or run from the storage device. A
license for the Software may not be shared or used concurrently on different computers.
(b) Make one copy of the Software in machine-readable form solely for backup purposes. You must reproduce on any
such copy all copyright notices and any other proprietary legends on the original copy of the Software.
3. License Restrictions
(a) Other than as set forth in Section 2, you may not make or distribute copies of the Software, or electronically transfer
the Software from one computer to another or over a network.
(b) You may not decompile, reverse engineer, disassemble, or otherwise reduce the Software to a human-perceivable
form.
(c) You may not sell, rent, lease, transfer or sublicense the Software.
(d) You may not modify the Software or create derivative works based upon the Software.
(e) You may not export the Software into any country prohibited by the United States Export Administration Act and the
regulations there under
(f) In the event that you fail to comply with this EULA, (1) Sensory may terminate the license and you must destroy all
copies of the Software, and (2) You may be held liable for any claims by or damage to Sensory, Inc., whether
incidental or consequential.
4. Upgrades
If this copy of the Software is an upgrade from an earlier version of the Software, it is provided to you on a license exchange
basis. You agree by your installation and use of this copy of the Software to voluntarily terminate your earlier EULA and that
you will not continue to use the earlier version of the Software or transfer it to another person or entity.
5. Ownership
The foregoing license gives you limited rights to use the Software. Sensory and its suppliers retain all right, title and interest,
including all copyrights, in and to the Software and all copies thereof. All rights not specifically granted in this EULA,
including Federal and International Copyrights, are reserved by Sensory and its suppliers.
6. Limited warranty and disclaimer
(a) Limited warranty. Sensory warrants that, for a period of ninety (90) days from the date of delivery (as evidenced by
a copy of your receipt): (i) when used with a recommended hardware configuration, the software will perform in
substantial conformance with the documentation supplied with the software; and (ii) that the physical media on
which the software is furnished will be free from defects in materials and workmanship under normal use.
(b) No other warranty, except as set forth in the foregoing limited warranty, Sensory and its suppliers disclaim all other
warranties, either express or implied, or otherwise including the warranties of merchantability and fitness for a
particular purpose. Also, there is no warranty of noninfringement, title or quiet enjoyment. If applicable law implies
any warranties with respect to the software, all such warranties are limited in duration to ninety (90) days from the
date of delivery. No oral or written information or advice given by Sensory, its dealers, distributors, agents or
employees shall create a warranty or in any way increase the scope of this warranty.
(c) Some states (USA only) do not allow the exclusion of implied warranties, so the above exclusion may not apply to
you. This warranty gives you specific legal rights and you may also have other legal rights that vary from state to
state.
Your exclusive remedy under Section 6 is to return the Software to the place you acquired it, with a copy of your receipt and
a description of the problem. Sensory will use reasonable commercial efforts to supply you with a replacement copy of the
Software that substantially conforms to the documentation, provide a replacement for defective media, or refund to you your
purchase price for the Software, at its option. Sensory shall have no responsibility if the Software has been altered in any
way, if the media has been damaged by accident, abuse or misapplication, or if the failure arises out of use of the Software
with other than a recommended hardware configuration.
8. Limitation of liability.
(a) Neither Sensory nor its suppliers shall be liable to you or any third party for any indirect, special, incidental or
consequential damages (including damages for loss of business, loss of profits, business, interruption or the like),
arising out of the use or inability to use the software or this EULA based on any theory of liability including breach of
contract, breach of warranty, tort (including negligence), product liability or otherwise, even if Sensory or its
representatives have been advised of the possibility of such damages and even if a remedy set forth herein is found
to have failed of its essential purpose.
(a) Sensory’s total liability to you for actual damages for any cause whatsoever will be limited to the greater of $500 us
dollars or the amount paid by you for the software that caused such damage.
(b) (USA only) some states do not allow the limitation or exclusion of liability for incidental of consequential damages,
so the above limitation or exc lusion may not apply to you and you may also have other legal rights that vary from
state to state.
9. Basis of Bargain
The Limited Warranty, Exclusive Remedies and Limited Liability set forth above are fundamental elements of the basis of the
agreement between Sensory and you. Sensory would not be able to provide the Software on an economic basis without
such limitations.
10. U.S. GOVERNMENT RESTRICTED RIGHTS LEGEND
This Software and the doc umentati on are provided with "RESTRICTED RIGHTS". Use, duplication, or disclosure by the
U.S. Government is subject to restrictions as set forth in this EULA and as provided in DFARS 227.7202-1(a) and 227.72023(a) (1995), DFARS 252.227-7013 (c)(1)(ii)(OCT 1988), FAR 12.212(a)(1995), FAR 52.227-19, or FAR 52.227-14, as
applicable. Manufacturer: Sensory, Inc., 575 N. Pastoria Avenue, Sunnyvale, CA 94085.
11. Consumer End Users Only (outside of the USA)
The limitations or exclusions of warranties and liability contained in this EULA do not affect or prejudice the statutory rights of
a consumer, i.e., a person acquiring goods otherwise than in the course of a business.
12. General Provisions
This EULA shall be governed by the internal laws of the State of California. This EULA contains the complete agreement
between the parties with respect to the subject matter hereof, and supersedes all prior or contemporaneous agreements or
understandings, whether oral or written. All questions concerning this EULA shall be directed to: Sensory, Inc., 575 N.
Pastoria Avenue, Sunnyvale, CA 94085 Attention: General Counsel.
Demo/Emulation Manual
NLP-5x Toolkits
(408) 625-3300
(408) 625-3350
property of their respective owners.
The Interactive Speech™ Pr oduc t Line
Sensory’s Interactive Speech™ product line makes consumer electronics more intelligent by enabling them to talk, hear,
move and interact with the external world using naturally sounding spoken commands-all without training and even in noisy
environments! Sensory offers both chip and software solutions that offer advanced speech recognition with hands-free
functionality, biometric speaker verification, text-to-speech (TTS) synthesis, high quality stereo music and sound effects,
robotics and LCD controls, and interactive sensing capabilities. These technologies are designed for integration into costsensitive consumer electronic applications such as home appliances, smart toys, music players and personal communication
devices. The hardware line includes the NLP-5x Natural Language Processor, the RSC-4x family of mixed signal processors,
and the SC-691 music and speech synthesis slave processor. Embedded software options include the FluentSoft™
Recognizer, which offers speech recognition technologies for non-Sensory processors and DSPs. Sensory’s BlueGenie™
Voice Interface, the first speech recognition, TTS and synthesis option for BlueTooth® enabled devices, offers hands-free
control of headsets, music players and other BlueTooth® devices.
NLP-5x Natural Language Processor and Development Tools
The NLP-5x features a high-performance 80MHz 16-bit DSP with on-chip ADC, hi-fidelity stereo DAC, microphone
preamplifiers, RAM, OTP code and constant memory, and many kinds of peripheral interfaces and control blocks. With
Sensory’s FluentChip™ 5 firmware, it provides a single chip solution capable of accurate speech recognition; text-to-speech
(TTS) synthesis with morphing; compressed speech; high fidelity music; motor and LCD control; and man-machine
interfaces (MMI) with interactive sensors. Sensory offers a complete suite of evaluation and development tools that include
the ability to create complex grammars with a natural language interface in multiple languages.
RSC-4x Family of Microcontrollers and Developer Tools
The RSC-4x (Recognition, Synthesis and Control) product family contains low-cost 8-bit speech-optimized
microcontrollers that are fully integrated and include A/D, pre-amplifier, D/A, RAM, and ROM circuitry. With Sensory’s
FluentChip™ fi rmware, the RSC family offers speech recognition, speaker verification, speech and music synthesis, voice
recording and playback, and an entire suite of interactive robotic and sonic networking technologies. The family is supported
by a complete suite of evaluation and development toolkits that include the ability to quickly create speaker independent
recognition sets in many languages.
SC6 Slave Processor and Tools
The SC-691 is a standard slave synthesizer that accepts compressed speech data from other microprocessors or
microcontrollers and converts it to speech. The chip operates up to 12.32 MIPS, and provides high-quality, low data-rate
speech compression and MIDI music synthesis, with unlimited speech duration using external memory. Sensory offers
hardware and software tools for analyzing speech files, editing speech data and generating coded speech.
FluentSoft™ Recognizer
The FluentSoft™ Recognizer is the engine powering the FluentSoft™ SDK. It provides a noise-robust, large-vocabulary,
speaker-independent solution with continuous digit recognition and word-spotting capabilities. This small-footprint software
recognizes thousands of words and runs on non-Sensory processors including Intel XScale, TI OMAP, and ARM9, and
supports operating systems such as MS Windows, Linux, and Symbian.
BlueGenie™ Voice Interface
The BlueGenie Voice Interface software suite runs on CSR’s BC-5 MM Kalimba DSP, and enables manufacturers of
Bluetooth products to integrate full voice control and synthetic speech output without the need for visual displays or complex
user interfacing. It frees designers to pack functionality onto small form factor Bluetooth devices and answers consumer
demand for a “Truly Hands-Free” experience.
Important notices:
Sensory Incorporated (Sensory, Inc.) reserves the right to make change s, without notice, including cir cuits, standard cells, and/or software, described or
contained herein i n order to improve desig n and/or performanc e. S ensory, Inc. assume s no responsibility nor l iability for the use of any of these products,
conveys no license o r title und er any pate nt, copyrig ht, or mask -work right t o these p roducts, and m akes no representati ons or war ranties th at these p roducts
are free from pat ent , c op yri g ht, o r m ask-work right i nfringement, unless otherwise specified. Applications that are described herein for a ny of these pro du ct s a re
for illustrative purposes onl y. Sensory, Inc. makes no representation or warranty that such applicati ons will be suitable for the specified use without furt her
testing or modification.
Safety Policy:
Sensory, Inc. prod uc ts are no t d esig ned for use in any systems where mal f un cti on of a Sensory, Inc. p ro duc t ca n re a s on abl y be expected to resul t i n a personal
injury, includin g but not lim ited t o life support appli ances a nd dev ices. Sensor y, Inc. c ustom ers using or selling Sensory Incorporated products for use in such
applications do so at their own risk and agree to fully indemnify Sensory, Inc. for any damages resulting from such improper use or sale.