PARROT FC6050W User Manual

PARROT PRODUCT DATASHEET
Parrot
FC6050
FC6050B and FC6050W
Version 1.67
August 2011
Confidential information
Ref: EL-
2009-009
Parrot FC6050B
Full connectivity platform Bluetooth 3.0
Application:
Telephony
Bluetooth 3.0
Audio streaming
USB, SD
IPod management
The FC6050B includes the latest version of the Parrot Bluetooth software stack (Blues). Blues provides a very high level of compatibility with most of the phones available on the market today. It also provides phonebook and call list synchronization. The FC6050B also includes Concertos, a Parrot proprietary database management library used for the management of audio files. Concertos facilitates management of audio from all available storage media such as USB/IPOD, SD, PHONE/A2DP. Concertos manages the media devices, builds a database with metadata, browses the compressed audio files by artist/genre/title and plays them. FC6050 offers the possibility to use a Speaker Independent Voice Recognition (SIVR) and a Text To Speech algorithm (TTS).The FC6050B software is built upon the Linux operating system. The library RAP gives the possibility to recognize song titles or artist name
FEATURES
Bluetooth 3.0 qualified module IPod chip management, SD card management Piconet and scatternet support Standard single 3.3V supply UARTs, I²C, USB 2.0 High Speed, Digital audio input and output Analog audio input and output Module dimension 34.5 x 41.35 mm x
4.60mm Automotive qualified.
Description:
The Parrot FC6050B is a complete connectivity solution. It offers a large variety of interfaces for easy integration in most applications.
Parrot
Bluetooth Antenna
BT3.0
P6i
FLASH
SDRAM
2*UART
SD card
1*I²C
2*I²S out/ 2*I²S in
2*Analog microphone input
1*Stereo Analog line in
1*Stereo Analog line out
1*USB 2.0 High Speed
DATASHEET Confidential Information 2/84
Ref: EL-
2009-009
Parrot FC6050W
Full connectivity platform Bluetooth 3.0+HS, Wi-Fi (802.11 b/g/i)
Application:
Telephony
Wi-Fi
Bluetooth 3.0+HS
Audio streaming
USB
IPod management
UPNP server synchronization
In addition to the features supported by the FC6050B, the FC6050W supports also WiFi connections (ad Hoc, station, AP) and Bluetooth 3.0 + HS.
FEATURES
Bluetooth 3.0+HS qualified module IPod chip management, Wi-Fi b/g/i/j Piconet and scatternet support Standard single 3V3 supply UARTs, I²C, USB 2.0 High Speed, Digital audio input and output Analog audio input and output Module dimension 34.5 x 41.35 mm x
4.60mm Automotive qualified.
Description:
The Parrot FC6050W is a complete connectivity solution. It offers a large variety of interfaces for easy integration in most applications.
Bluetooth
Antenna
Wi-Fi Antenna
Parrot
P6i
WIFI/BT3.0+HS
FLASH
SDRAM
2*UART
3*GPIO
1*I²C
2*I²S out/ 2*I²S in
2*Analog microphone input
1*Stereo Analog line in
1*Stereo Analog line out
1*USB 2.0 High Speed
DATASHEET Confidential Information 3/84
Ref: EL-
2009-009
Table of contents
1 Product overview ............................................................................................................................ 7
1.1 FC6050B/W features: .............................................................................................................. 7
2 Software specifications ................................................................................................................. 10
2.1 Bluetooth stack...................................................................................................................... 10
2.2 Bluetooth profile supported.................................................................................................. 10
2.3 FC6050W Wi-Fi summary...................................................................................................... 11
3 Bluetooth 3.0+HS use cases (FC6050W) ....................................................................................... 11
4 USB Hub......................................................................................................................................... 11
5 Wi-Fi features and main scenarios (FC6050W) ............................................................................. 12
5.1 Share internet connectivity (AP) ........................................................................................... 12
5.2 Bluetooth High Speed (AP and client) ................................................................................... 12
5.3 Universal Plug and play (AP and client)................................................................................. 13
5.4 Wi-Fi tethering (client) .......................................................................................................... 13
6 Internet connectivity solutions ..................................................................................................... 14
6.1 Internet sources - Overview.................................................................................................. 14
6.2 Parrot router: ........................................................................................................................ 15
6.3 Miscellaneous........................................................................................................................ 15
7 Host to FC6050B/W interface details............................................................................................ 16
7.1 UART...................................................................................................................................... 16
7.2 Protocols used....................................................................................................................... 17
7.3 Standard networking over USB protocol for data transmission ........................................... 17
8 Software interface, HSTI Library.................................................................................................... 17
8.1 Parrot’s HSTI protocol for network connectivity................................................................... 18
9 Memory configurations................................................................................................................. 20
10 Speaker Independent Voice Recognition and Text to Speech ...................................................... 21
10.1 Voice Recognition principles ................................................................................................. 21
10.2 Text To Speech (TTS) ............................................................................................................. 21
10.3 Voice Recognition for Phonebook Access ............................................................................. 22
10.4 Voice Recognition for Music Data on external sources......................................................... 22
10.4.1 RAP ................................................................................................................................ 22
10.4.2 Gracenote® for Music Data on external sources........................................................... 22
10.4.3 Natural Language Understanding (NLU) ....................................................................... 23
10.5 Remote speech to text engine .............................................................................................. 24
11 Electrical specifications ................................................................................................................. 25
11.1 Hardware architecture FC6050B ........................................................................................... 25
11.2 Hardware architecture FC6050W.......................................................................................... 26
11.3 Pinout (FC6050W and FC6050B) ........................................................................................... 27
11.3.1 Pinout table 40 pins version.......................................................................................... 27
11.3.2 FC6050W Pinout table................................................................................................... 28
12 Electrical specifications ................................................................................................................. 30
12.1 Absolute maximum ratings ................................................................................................... 30
12.2 Power Supply......................................................................................................................... 30
12.2.1 Power Pin....................................................................................................................... 30
12.2.2 Power consumption ...................................................................................................... 30
12.3 Reset pin................................................................................................................................ 31
12.4 Firmware Update................................................................................................................... 31
12.5 GPIOs ..................................................................................................................................... 32
12.6 UART...................................................................................................................................... 32
12.7 I2C.......................................................................................................................................... 33
12.8 Audio ..................................................................................................................................... 34
DATASHEET Confidential Information 4/84
Ref: EL-
2009-009
12.8.1 Analog out ..................................................................................................................... 34
12.8.2 Analog in........................................................................................................................ 34
12.8.3 Microphone input.......................................................................................................... 34
12.9 I2S .......................................................................................................................................... 35
12.10 SDIO ................................................................................................................................... 37
12.11 USB .................................................................................................................................... 38
12.12 Wifi .................................................................................................................................... 39
12.13 Bluetooth........................................................................................................................... 41
12.14 Recommended external components schematics ............................................................ 42
12.14.1
12.14.2
12.14.3
12.14.4
12.14.5
13 Mechanical specifications ............................................................................................................. 47
13.1 FC6050W Horizontal version................................................................................................. 48
........................................................................................................................................................... 48
13.2 PCB footprint for FC6050W horizontal module .................................................................... 49
13.3 PCB footprint for FC6050W vertical module......................................................................... 50
13.4 FC6050B PCB ......................................................................................................................... 51
13.5 PCB footprint for FC6050B horizontal module...................................................................... 52
13.6 PCB footprint for FC6050B vertical module .......................................................................... 53
13.7 Connectors specifications (FC6050 B/W).............................................................................. 54
13.7.1 Vertical connector specification.................................................................................... 54
13.7.2 Horizontal connector specification ............................................................................... 55
13.7.3 Host connectors specification ....................................................................................... 55
14 Connectivity use cases overview................................................................................................... 56
14.1 Phone use cases .................................................................................................................... 56
14.1.1 Head Unit (FC6050B/W) paired with Mobile phone..................................................... 56
14.1.2 Head Unit (FC6050B/W) simultaneously connected to Mobile phone and headset
device ....................................................................................................................................... 58
14.1.3 Head Unit paired with two Mobile phones................................................................... 59
14.1.4 Audio Streaming and Handsfree working together ...................................................... 60
14.1.5 Head Unit (FC6050 B/W) paired with Mobile phone and Music Player with Bluetooth
dongle: ....................................................................................................................................... 62
14.1.6 Head Unit paired with a stereo Headphone ................................................................. 63
14.1.7 Head Unit paired with two stereo Headphones............................................................ 63
14.1.8 Head Unit (FC6050 B/W) paired with Mobile phone: Data transfer............................. 64
14.2 USB/iPod Use Cases............................................................................................................... 65
14.2.1 Head Unit (FC6050 B/W) with an iPod connected through the USB............................. 65
14.2.2 IPod & iPhone use cases................................................................................................ 66
14.2.3 Head Unit (FC6050B/W) paired with a connected USB Mass storage device............... 67
14.3 Head unit (FC6050 B/W) BT/USB/Wi-Fi software update..................................................... 68
14.4 Wi-Fi use cases ...................................................................................................................... 70
14.4.1 Wi-Fi access point.......................................................................................................... 70
14.4.2 Wi-Fi station .................................................................................................................. 72
14.4.3 Internet access with mobile phone tethering............................................................... 73
14.4.4 DLNA and UPNP............................................................................................................. 74
14.4.5 Future use cases ............................................................................................................ 75
15 Workbench .................................................................................................................................... 77
15.1 Bloc Diagram.......................................................................................................................... 77
15.2 Connection & Jumpers Settings ............................................................................................ 78
16 Interoperability management during mass production................................................................ 79
Analog out ................................................................................................................. 42
Analog in.................................................................................................................... 42
Microphone input...................................................................................................... 43
USB ............................................................................................................................ 45
Supply FC6050B/W version ....................................................................................... 46
DATASHEET Confidential Information 5/84
Ref: EL-
2009-009
16.1 Blues interoperability testing (compatible phones).............................................................. 79
16.2 Pilot phone testing of the gateway (Final product)............................................................... 80
17 Approval / Certifications ............................................................................................................... 82
17.1 Bluetooth 3.0+HS qualification.............................................................................................. 82
17.2 Wi-Fi qualification ................................................................................................................. 82
17.3 EMC certification................................................................................................................... 82
17.4 RoHS declaration. .................................................................................................................. 82
18 Communicate with FC6050 from PC: WxHipHop.......................................................................... 83
19 FCC and IC Requirements for module application ........................................................................ 84
DATASHEET Confidential Information 6/84
Ref: EL-
2009-009
1 Product overview
The FC6050 is a full connectivity platform designed to ease the integration of connectivity applications in car audio systems, car telematics systems or any system requiring a complete embedded connectivity solution.
1.1
FC6050B/W features:
Bluetooth connectivity
Bluetooth Power Class 2 Radio Embedded Bluetooth V3.0+HS (FC6050W only) Multiple profiles running in parallel. Pairing and connection with all Bluetooth Devices: Phones, Smartphones,
PDA, etc. Multiple user support: Up to 15 paired phones
Wi-Fi (FC6050W)
IEEE 802.11b/g/i compliant (n compliant from 2012) Data rates of 1–54 Mbps for 802.11g (270 Mbps starting 2012) Security support for WPS, WPA2, WPA Ad hoc, station, or Access Point mode Up to 8 devices can simultaneously be connected in AP mode.
SD card management (FC6050B)
Full internet access
Internet Access via Wi-Fi (FC6050W only) or HSDPA using USB Dongle or
modules or Bluetooth
UPNP server access over Wi-Fi. (FC6050W)
DATASHEET Confidential Information 7/84
Ref: EL-
2009-009
Personal files (music, pictures, etc ) can be downloaded from personal server
at home to the car
Browsing, Streaming and download interfaces
Phone
Pick-up, Hang-up, Redial Automatic answer (from host via dial command) Send DTMF during calls Private Mode Multiparty call
Phone Book
Automatic Phone book synchronization over Bluetooth (up to 15 paired
phones, more than 10,000 contacts per phone, depending on memory available)
Call history (dialed number, received calls, missed calls) All Synchronization Methods Supported Specific behaviors applied for the best possible interoperability Full Unicode for compatibility with numerous characters sets (European,
Russian, Chinese, Japanese…)
Digital Signal Processing
Microphone(s): the module can manage two configurations:
Single microphone Two microphones with AMS (Automatic Microphone Selection): 1 for
the driver and 1 for the front seat passenger. The best microphone is automatically selected during the call.
Noise Reduction (NR)
Maximal NR is 25dB. Typical NR is 15dB. No musical noise No fluctuation of the residual noise level Automatic adaptation of the Noise Reduction to the Signal-to-noise
ratio (SNR) to keep the best voice quality in idle and remove more noise in noisy conditions.
Acoustic Echo Cancellation (AEC)
The level of echo attenuation, called ERLE is 45dB (measured
according to the VDA process).
Comfort Noise feature so that the background noise is adjusted after
AEC algorithm, in order to keep it constant for enhanced communication experience.
Possibility to accept up to 100ms of delay in the speaker path for digital
amplifiers.
Full duplex
Automatic Level Control (ALC)
Different phones can have different Speaker volumes (up to 20dB of
difference). It adapts the signal level received from the phone to the target level, quickly and precisely.
Equalizer
9 bands equalizer for microphones and speaker paths.
Tuning
Car independent tuning if the microphone position and specifications
are the same.
Possibility to tune all parameters of the audio algorithms according to
Customer preferences.
Wideband speech (from 2012)
Support of HFP 1.6 All speech processing algorithms will work @ 16 kHz.
DATASHEET Confidential Information 8/84
Ref: EL-
2009-009
Audio Streaming
Embedded SBC decoder Embedded MP3 decoder from Thomson Licensing (optional) Embedded AAC decoder from Via Licensing (optional) Stereo audio output
Concertos
Concertos is a software Library which acts as a multi-source media player. Concertos enables DISCO playlist browsing on USB, iPod, SD and AVRCP1.4
devices
Speaker Independent Voice Recognition (SIVR)
Miscellaneous
Provides Phone Battery Level, Network Signal Level and Carrier Name
(depends on phone) to host
Embedded test pattern (test commands)
Software Update
Full standard software available (free upgrade from Parrot homepage) Software can be updated via Bluetooth, USB, UART Software updates provide long term compatibility with latest Phones,
Smartphones, PDAs and Music players
External Bluetooth Antenna diagnostic
HSTI
Parrot provides a library called “HSTI” that facilitates the integration and communication with FC6050 (see §8).
Communication between the host and the FC6050 over UART
DATASHEET Confidential Information 9/84
Ref: EL-
2009-009
2 Software specifications
2.1
Bluetooth stack
HCI (Host Controller interface),
L2CAP (Logical Link Control and Adaptation Protocol),
RFCOMM
SDP (Service Discovery Protocol),
OBEX (IrDA Object Exchange).
Channel manager, AMP Manager, HCI AMP (BT 3.0+HS software).
2.2
Bluetooth profile supported
Generic Access Profile
Phone Management
HFP 0.96 - 1.0 - 1.5 HSP 1.0 SAP (SIM Access Profile, optional)
Message Management
MAP 1.0
Phone Book
PBAP 1.0 SYNC 1.1 (IrMC SYNC over BT) SYNCML OPP 1.0 Server/Client (Vcard 3.0) GSM 07.07 AT Commands Nokia synchronization protocol (MBUS)
Multimedia
A2DP (Audio) SBC decoding (optional MP3 decoding) AVDTP AVRCP1.0 / AVRCP1.3 / AVRCP1.4
Internet connectivity
DUN 1.1 BNEP, PAN
Others
SPP 1.1 BIP SDP FTP 1.0 Image transfer over OPP Software update over SPP Remote configuration
DATASHEET Confidential Information 10/84
Ref: EL-
2009-009
Yes
802.11d - "World Mode"
No
Yes
802.11h - 5GHz interferrence avoid
No
802.11i - Security
Yes
802.11j - Japan Standard
No
802.11n - 2.4GHz WiFi 150Mbps
Yes(1)
No
Access Point support
on reset -frimware change
Yes
Client
Yes
PAN - like Intel Cliffside multi point access
No
WPA2 / WPA
Yes
Yes(2)
Supported
2.3
FC6050W Wi-Fi summary
802.11b - 2.4GHz WiFi 11Mbps
802.11g - 2.4GHz WiFi 54Mbps
802.11y - High Power WiFi
Ad-Hoc
WAPI (China)
Coexistence
2.4GHz
(1): FC6050 will be capable from 2012:
Support Wi-Fi 802.11n: Higher throughput in preparation for LTE and longer range for
additional use cases.
Ability to assist in beam forming from the external hotspot
Supporting simultaneous AP and STA
(2) Available from 2012
3 Bluetooth 3.0+HS use cases (FC6050W)
BT3.0+HS speeds-up Bluetooth profiles (~8 times faster)
OPP (phonebook), FTP (transfer) and BIP (pictures) profiles already available.
PBAP (phonebook) and MAP (messaging) will be available from 2012.
4 USB Hub
The FC6050W and FC6050B have one USB port It is mandatory to use a USB hub external to the module if more than one USB device is connected to the FC6050B/W
DATASHEET Confidential Information 11/84
Ref: EL-
2009-009
5 Wi-Fi features and main scenarios (FC6050W)
The Parrot module can either be configured as a Wi-Fi Access Point (AP), a Wi-Fi station (client) or can be used in ad-hoc mode. As an access point, up to 8 devices can be connected simultaneously.
The host is responsible for:
enabling/disabling Wi-Fi
configuring the security level (WEP, WPA, WPA2), and associated passes
retrieving network information as needed (example: which users are connected)
The FC6050W manages the Wi-Fi network according to the host commands. Regardless, the FC6050W is responsible for:
taking care of low-level networking tasks
keeping the host informed of networking events
There are a lot of different possible use cases, you’ll find below an overview of the main ones. For more details, please refer to the part 14
5.1
Share internet connectivity (AP)
Internet access granted to portable devices in the vehicle
5.2
Bluetooth High Speed (AP and client)
The use of the Wi-Fi radio for Bluetooth profiles (see § 3)
DATASHEET Confidential Information 12/84
Ref: EL-
2009-009
5.3
Universal Plug and play (AP and client)
Download or stream video and audio files from a UPnP server
5.4
Wi-Fi tethering (client)
The mobile device acts as a modem and provides internet connection to the host
DATASHEET Confidential Information 13/84
Ref: EL-
2009-009
6 Internet connectivity solutions
The FC6050 “full connectivity” modules offer the widest range of internet sources:
Internet source Transmission to the FC module HW requesite
Phone Bluetooth DUN Any FC module
Phone Bluetooth PAN AP Any FC module
NAD USB
3G USB modem USB
Phone Tethering over USB FC6050
Phone Tethering over WiFi FC6050W
Hospot WiFi Tethering over WiFi FC6050W
FC6050
NAD module
FC6050
3G USB modem
6.1
Internet sources - Overview
DUN, dial-up-network
The mobile device acts as a modem and provides the data to the module. DUN profile is currently widely supported on the market.
PAN, personal area network
The mobile device supporting PAN-AP (access point) provides the data directly on Bluetooth L2CAP layer in IP packets. The module acts as PAN-U (user).
NAD, network access device, optional feature
An external NAD can be integrated on the customer motherboard. Parrot module manages Telephony, data call, SAP, Phonebook and messaging features of the NAD. All these features are provided to the host using the same upper level commands. The Hardware integration and monitoring are under the customer responsibility. NAD supplier choice shall be jointly agreed with Parrot.
DATASHEET Confidential Information 14/84
Ref: EL-
2009-009
3G USB Dongle
Parrot currently supports over 200 3G dongles worldwide. Compatibility testing is done continually to verify interoperability with new dongles on the market. Test teams are present is in the US, Europe, Japan, Korea and China.
USB Tethering As for DUN and PAN, the device acts as a modem and provides the data to the module over USB. Feature availability is provider and OS dependant. Parrot currently supports Android, iOS, RIM and Symbian OS.
Wi-Fi Tethering Any mobile device supporting Wi-Fi access point feature can be used by Parrot module as an additional internet source. This feature has to be enabled by the network provider.
6.2
Parrot router
In order to provide flexible network handling and configuration, Parrot developed a router embedded on the FC6050. It allows the host to connect any network interface available on the FC6050 (Wi-Fi, 3G modem, DUN/PAN via BT, Tethering over USB, HOST). It is configurable through a user friendly set of AT commands (Parrot’s HSTI) and makes it possible to enable internet services (ftp, vnc, http, for example) on each interface.
:
6.3
Miscellaneous
The FC6050W needs to be informed of the provider’s DNS (Domain Name Server) IP address. This information is transmitted to the FC6050W via an HSTI command. Parrot's FC6050W does not do filtering (firewalling) on the host provided network transactions, except what may be needed for its own safety. Hence, if some filtering must be done for network operator or any other reason, it shall be done by the host. Thus, the host is responsible for the incoming network traffic. Examples include blocking incoming connections, restricting use to http and https protocols, forbidding POP/IMAP use, blocking VOIP etc. (these examples come from common phone operator contractual regulations).
DATASHEET Confidential Information 15/84
Ref: EL-
2009-009
7 Host to FC6050B/W interface details
The architecture relies on 4 key features:
1. Using USB as a fast, standard physical medium – USB is used to exchange commands, events, and user data between the host and Parrot's Wi-Fi enabled FC6050W. A USB 2.0 High Speed link has a bandwidth of 480 Megabits per second (60 Megabytes per second). Even with upper layer protocol overhead needed by the USB physical medium, there is more than enough room for a quality network connection. [As a point of reference, a typical PC network interface card (NIC) is 100Mbs. A full-blown heavy duty network server has 1000Mbs (1Giga bit per second) NICs.]
2. Standard networking over USB protocols - Just as serial lines have been used as the physical medium for networking for years (reference Point-to-Point Protocol), USB can be used as the physical medium for standard TCP/IP networking. CDC ECM (Communication Device Class, Ethernet Control Model) is the USB - Implementers Forum standard for such use. Using such protocols, the USB connection appears to the operating system as a Network Interface Card (NIC), ready to carry Ethernet frames. From then on, all rich TCP/IP protocol stacks are available.
3. Parrot's HSTI library uses networking as its logical medium - The Parrot Host Software Interface (HSTI) library (see section 8) uses a network socket interface, allowing command and event communication as on a network.
4. An inner, user-hidden network – This connection simply consists of just two nodes:
the host processor
Parrot’s Wi-Fi enabled OEM module.
The car information and entertainment system can be referred to as the host, and Parrot's FC6050W module as the target. However, from a USB bus perspective (i.e. according to USB standard terminology):
the host is considered a “USB device”
the Parrot's FC6050W target module is considered a “USB host”
The USB terminology of “USB host” and “USB device” does not interfere with the notion of master / slave from a system perspective, but rather is a matter of hardware and operating system stack configuration.
The networking architecture can be done using FC6050W as an USB device, and the host as the USB host. However, in such a case, the use of USB media devices (for example, MTP or USB flash drive with media files) cannot be done by the FC6050W, even if a USB hub is used.
7.1
UART
Alternatively, if no USB port is available on the Host side, a serial port can be used to control the FC6050 using Parrot’s HSTI command and control interface over UART.
DATASHEET Confidential Information 16/84
Ref: EL-
2009-009
7.2
Protocols used
Two types of protocols are used:
1. Standard networking over USB protocol, carrying both HTSI and internet data.
2. The Parrot's HSTI command and events protocol.
7.3
Standard networking over USB protocol for data transmission
The FC6050W handles a USB protocol named CDC ECM (Communication Device Class, Ethernet Control Model) for networking over USB.
CDC ECM is the USB-Implementers Forum SIG standard for networking Ethernet over USB. Widely used for cable DSL modem and USB-Ethernet dongles before the domestic use of NIC became widespread, it has been an official part of the Linux OS since 2003.
CDC ECM goal is to use a USB connection to mimic NICs cards between a USB host and a USB device, with their MAC and configurable IP addresses, able to convey any Ethernet frames. These NICs can then be set up and used as any regular network card would be. From a Linux application point of view, there isn’t any difference between a USB CDC ECM network connection and a regular one. Actually, the Linux application is not even aware of physical media used (USB rather Ethernet), since this media is hidden behind the networking stack of the Linux OS.
RNDIS (Remote Network Driver Interface Specification) is Microsoft vendor-specific, non-standard way to carry Ethernet over USB. Although RNDIS is not recommended, RNDIS may be used as a replacement for CDC ECM.
8 Software interface, HSTI Library
The FC6050x software interface, HSTI Library, is defined by a high level command set on top of Parrot Libraries.
This interface software is based on the HSTI commands defined by Parrot. These commands are fully documented and the software library is provided by Parrot for easy implementation in the host CPU.
Some commands are used to manage Bluetooth related functions like device pairing and connection management as well as the acoustic and speech recognition functions. Other commands are used to manage Music connected on USB ports.
The HSTI Command List and Bluetooth AT Command Software Specification are available upon request.
The Bluetooth software stack, BLUES, supports Unicode, which allows the management of language accents and allows for phonebook management in any language.
DATASHEET Confidential Information 17/84
Ref: EL-
2009-009
8.1
Parrot’s HSTI protocol for network connectivity
HSTI is Parrot's standard API used over its product range. It provides a rich yet simple, fully documented set of more than 250 high-level commands to pilot the FC6050. The host sends AT commands, and registers to events to be notified of changes occurring in the FC6050.
HSTI is available and used on Linux operating system. HSTI can be used over a network socket or a serial line (UART). Some HSTI commands are specifically designed to handle network connectivity. For
examples, see the document “Parrot Host Software Interface Specification”. Some networking commands are exemplified below.
The following steps are required in order for the host CPU to establish a dialog and take command of the FC6050;
1. Setup the USB link to FC6050 as CDC ECM.
2. Configure this new Ethernet interface (IP address, netmask, broadcast address). For ease of use, and since there is no added value in making these parameters dynamic, these IP parameters should be fixed in the product (example 192.168.64.1) - to be discussed with Parrot.
3. In the host application, open a standard internet socket. This socket will be used to communicate with the FC6050 via HSTI. The port used for this socket should be a fixed one, that does not interfere with any commonly used protocol (example value:
23000) – to be discussed with Parrot. From this point, regarding communication to the FC6050, the host application will not have to care about networking any more. The socket and USB network connection will be used transparently between the 2 CPUs to carry all HSTI dialog.
4. Register to HSTI events for notification. Events can either be responses from FC6050 to explicit host commands, or unsolicited, asynchronous events such as “new USB stick insertion”, or “3G dongle insertion”.
5. The host can then send commands to the FC6050 using the HSTI API.
Regarding networking, some additional steps are required. As an example, if the internet connectivity comes from a 3G dongle plugged into the FC6050 (see section 4, scenario
2):
The FC6050 shall notify the host of the availability of the 3G dongle by sending an event.
If the host decides to enable the internet connection, it prompts the user, for the PIN code. The prompt and PIN entry is done through the host user interface (screen and keyboard or touch screen).
The host sends the PIN code to the FC6050, via an HSTI command.
The FC6050 manages the 3G dongle, and reports connection status to the host
(example: connection established, or PIN code rejected)
DATASHEET Confidential Information 18/84
Ref: EL-
2009-009
Some things to notice:
The host may choose to make the internet connection available to the FC6050 Wi-Fi access point or not. In all cases, the host is in command to dynamically enable or disable capabilities via the FC6050.
If the internet connectivity comes from the host (section 4, scenario 1), then the DNS IP address has to be sent to the FC6050, using the dedicated HSTI command.
If the host requires internet connectivity for itself from the FC6050 (section 4, third scenario), then it should do so explicitly and query the FC6050 for the DNS address, again using the dedicated HSTI commands.
Internet connectivity provided by the FC6050 (second and third use case) is not “all or nothing”. It can be used for;
o Wi-Fi access point only o host only o both Wi-Fi access point and host use o disabled
In all relevant cases, the internet networking traffic between the host and the FC6050 will use the same network interface established before via USB CDC ECM to carry HSTI commands. This is done transparently so that applications, either on host or on the FC6050, do not need to handle it (unless of course the host application is willing to do so).
As a benefit inherited from its rooted serial line interface, the network traffic generated by the HSTI dialog is extremely low: a typical HSTI query or reply ends up in a dozen or less bytes of payload. Thus, this HSTI traffic does not interfere with the network bandwidth available to Wi-Fi users or the host.
Here is an example demonstrating a typical host-side HSTI sequence to setup Wi-Fi, choose a security level and setup a Wi-Fi network name:
/* set the Wi-Fi “on”, Access Point mode : */ HSTI_CmdAPI_Send_WSWM(AP); /* Send access point configuration : set the security protocol to WPA */ HSTI_CmdAPI_SendWAPC(SET, SECURITY, WPA); /* Access point configuration : the SSID naming the Wi-Fi network is “my car network” */ HSTI_CmdAPI_SendWAPC_STR(SET, SSID, “my car network”);
DATASHEET Confidential Information 19/84
Ref: EL-
2009-009
FC6050B&W Configurations:
9 Memory configurations
The below table provides an idea of the standard memory configuration. This configuration shall be adjusted with Parrot team depending on your features and requirements.
-Telephony, Phonebook, Audio streaming, BT, Wifi
- up to 10 phonebooks of up to 5000 contacts each,
5 numbers per contact, 300 SMS
-Concertos: up to 4 Databases with 40 000 songs each
RAP: voice recognition multimedia (up to 20 000 artists or albums)
-Gracenote European or US database
RAP(*)
Gracenote
can be
added
Memory
Configuration
Nuance
VR & SVOX
TTS
Concertos
Number of
Languages
with
VR & TTS
Memory Size
FLASH
(NAND)
MDDR
Mbits
version 1
  
­2561Gb
version 2
version 3
version 4


 

 

-
1 to 4 2Gb 512

5124Gb1 to 12
version 5
Notes:
The use of some codecs require that a specific fee to be paid directly to the proper organization
An iPod chip must be externally connected to the module (via I²C interface)
Concertos limitation of 3 x 10.000 songs for version 2.
  
DATASHEET Confidential Information 20/84
Ref: EL-
2009-009
10 Speaker Independent Voice Recognition and Text to
Speech
10.1
Voice Recognition principles
NUANCE VoCon 3200 V3.3 is a training-less speaker independent speech recognition engine offered on both FC6050B and FC6050W. VoCon 3200 V3.3 features include:
Voice recognition: words are recognized without previous training
Acoustic models provide accuracy improvement, especially for digits recognition
Continuous voice recognition: no need for blanks between words
New words learning (Voice tags), speaker dependent speech recognition (100 Voice
tags, 2kbytes by Voice tag)
Noise robustness and accuracy in an automotive environment: engine, click-button etc…
Significant improvement in recognition rate
Unsupervised speaker adaptation
User-friendly flexibility for calling phonebook entries, digit dialing, and common
command and control
Supporting the possibility to recognize multimedia names (artists, albums, genres, playlists)
Users can also control other vehicle functions by voice such as door locks, window motors, and climate control settings
Simple command and control voice interfaces for AM/FM radio, TV/DAB channels and CDs replace several button presses;
o “radio ninety seven point nine” o “CD play track twelve”
10.2
Text To Speech (TTS)
Text to Speech (TTS) on FC6050B & FC6050W is based on SVOX Automotive Speech. SVOX Automotive TTS solutions are tailored for noisy car environments and enjoy a reputation for industry-leading quality. They power many of the most advanced and successful in-dash infotainment systems in the market. SVOX TTS technology is characterized by natural and clear sound as well as unique polyglot capability – the same voice can speak multiple languages like a native speaker.
SVOX TTS is not limited in vocabulary. It can be used to confirm the orders identified by a voice recognition process or for reading vehicle commands, songs titles or phonebook entries.
Abbreviations, tags, symbols (emoticons) are converted into readable text (grapheme-to­grapheme conversion). In addition, the SVOX TTS engine contains an advanced text pre-processor that automatically handles common specifications for date and time.
SVOX provides an excellent quality prosody (i.e. sentence intonation) using state-of-the­art prosody modelling technology. Accent values, phrase types, and phrase boundary positions are taken into account for the determination of the speech melody (pitch contour) and sound durations.
DATASHEET Confidential Information 21/84
Ref: EL-
2009-009
Voice Recognition and TTS voice is available in both FC6050B and FC6050W for the following languages:
01) US English
02) CA French
03) N.A. Spanish
04) UK English
05) French
06) Italian
07) German
10.3
Voice Recognition for Phonebook Access
08) Spanish
09) Dutch
10) Danish
11) Swedish
12) Portuguese
13) Brazilian Portuguese
14) Turkish
15) Russian
16) Polish
17) Czech
18) Mandarin Chinese
19) Korean
20) Japanese
The FC6050B and FC6050W support the use of Nuance VoCon 3200 version 3.3 voice recognition algorithms to access phonebook entries. Up to 9 languages can reside simultaneously depending on the size of the flash and RAM (See section 9). Only one language can be active at a time.
10.4
Voice Recognition for Music Data on external sources
10.4.1 RAP
RAP is an optional Parrot-developed voice recognition gateway. In combination with the voice recognition option and the CONCERTOS software option it provides the user the ability to select music on multiple external sources and to operate player functionalities by voice commands. RAP allows recognition by album title, music type (genre) or artist name regardless of where the media file resides.
The voice recognition latency is, on average, 1.8 seconds for a database size of 20,000 Albums or Artists. The latency can be improved by reducing the number of Albums or Artists (~1s for 10 000). Based on trials with the French Parrot test database the voice recognition accuracy is ~ 85 %.
The maximum number of recognizable items depends on the available memory.
10.4.2 Gracenote® for Music Data on external sources
Gracenote's technology is being relied on by many of the world's leading consumer electronic devices and media software applications. Gracenote uses a multi-step recognition method to enable identification, categorization, and organization of digital music. Regardless of source or format, Gracenote gives music fans the tools to manage and enjoy their music collections.
10.4.2.1 MediaVOCS TM
MediaVOCS, provided by Gracenote, is an advanced speech-based media database. This database includes phonetic transcriptions for alternate artist, album and track names. Even common names are often multiethnic, abbreviated or nicknames which cannot be recognized by a standard voice recognition database. Based on Parrot studies, adding Gracenote MediaVOCS to the voice recognition improves the recognition rate by a factor of 33% on artist names and 16% on album names.
Gracenote MediaVOCS is available in the following languages:
US English UK English French
Italian German Spanish
DATASHEET Confidential Information 22/84
Canadian French Mexican Spanish
Ref: EL-
2009-009
10.4.2.2 Playlist Plus
Parrot also offers an additional tool from Gracenote known as Playlist PlusTM. Designed to work with MediaVOCS, Playlist Plus analyzes the metadata for music brought into the vehicle and offers a variety of playlists for the music library. These playlists may be either pre-set or user customized. In addition, the user may select “More Like This” and hear other songs in the music library of a similar genre to the song currently playing.
10.4.3 Natural Language Understanding (NLU)
The Parrot FC6XX0 product line offers an advanced voice recognition system based on Grammar based NLU (Natural Language Understanding, VoCon3200 version 3.3 ) With NLU, the user has the ability to control various vehicle feature by voice without "being constrained" by traditional voice recognition menu trees or categories (music, phone book, ...). All Parrot features and other vehicle functions can be controlled via voice from the press of a single “push-to-talk” (PTT) button. With NLU, the user can skip the step of narrowing the choices:
Selection of Phone Number from Phonebook
“I want to call John Smith”
“Call John Smith”
“Call John Smith at home”
“Call Smith at the office”
“Call John Smith on Mobile
Selection of Music from Music Library
“Play something from John Mayer”
“Play Parachutes from Coldplay”
“Play Bob Marley” [Note: this command works even though the official artist name is
“Bob Marley and the Whalers”]
“Play Jazz”
“Play Alternative”
“Play Super Hits of Miles Davis
These are just a sample of what is possible with NLU.
Other features, not residing on the Parrot FC6XX0 module can also benefit from NLU. This includes use cases such as tuning of a radio station or activating a rear-camera image:
“Tune to 97.1 Megahertz”
“Tune to 950 AM”
“Switch to FM”
“Seek”
“Play AM preset 3
DATASHEET Confidential Information 23/84
Ref: EL-
2009-009
10.4.3.1 Nuance Music Pre-Processor (MPP)
The Parrot RAP multimedia library option includes Nuance Music Pre-Processor (MPP) to facilitate flexible voice recognition access to music. Specifically, Nuance MPP allows the user to speak only a portion of the album title or artist name and find the intended song. Flexible music selection allows users to speak the most common variations and still be understood. “Avia” for “Avia feat. Raz Ohara” “Nuage” for “Nuage (Take 2)” “Police” for “The Police” With Nuance MPP, users can speak album titles are artist’s names that they know are present on their own music player without looking at any visual prompt.
10.4.3.2 ddG2P / CLC MP3
Nuance ddG2P MP3 and CLC MP3 are Nuance’s high speed, small footprint Graphemes to Phonemes converters (G2P, converting the text to phonetics) dedicated to the music domain.
10.5
Remote speech to text engine
Parrot is evaluating different solutions of remote voice recognition. Based on a client-server model, they will allow the end user to use off-board voice recognition engines, running on centralized servers, accessible through an internet connection.
The benchmark includes:
o Dragon from Nuance o Google o Text Friendly
Feature available on FC6050 from 2012.
DATASHEET Confidential Information 24/84
Ref: EL-
2009-009
11 Electrical specifications
11.1
Hardware architecture FC6050B
DATASHEET Confidential Information 25/84
Ref: EL-
2009-009
11.2
Hardware architecture FC6050W
DATASHEET Confidential Information 26/84
Loading...
+ 58 hidden pages