Sony RD0071 User Guide

A1ll (Everest) UX Blueprint
Sony Mobile 2014-12-05 Status: [Draft]
CONFIDENTIAL
The content of this document is the property of Sony Mobile Communications AB and may not be communicated to any other party,
in any form, without the prior written consent of Sony Mobile Communications AB.
Table of Contents
Table of Contents
UXP X
CONFIDENTIAL
ASW001
1 Document status 4
2 Introduction 5
2.1 Background 5
2.2 Constant values & Abbreviations 6
2.3 Product brief 7
2.4 Prioritized use cases 8
3 Hardware requirements 9
4 Interactions Overview 10
4.1 Interactions 10
4.2 Interactions (cont.) 11
5 Incoming events Overview 12
5.1 Incoming events 12
5.2 Incoming events (cont.) 13
8.5 Second time pairing, bonding and connecting 24
8.6 General bonding and connecting through NFC: UI flow 25
9 Disconnect and reconnect 26
10 Power ON A1ll 27
10.1 Power ON A1ll for the first time or after factory data reset 27
10.2 Power ON A1ll when already bonded 27
10.3 Connection status when turned on 28
11 Turning OFF and Factory data reset 29
11.1 Turning OFF A1ll 29
11.2 Factory data reset 29
12 OTA and DFU mode 30
12.1 OTA sequence 30
13 Automatic logging of physical activities - an overview 31
5.3 Incoming events Do Not Disturb mode 14
6 Gesture interactions - Example of partner possibilities 15
6.1 Show yourself to others 15
7 Detailed interaction and event states 16
7.1 LED sequence key interactions 16
7.2 Vibration feedback 17
7.3 State diagram normal mode 18
7.4 State diagram do not disturb mode 19
8 Setting up 20
8.1 Pairing, bonding and connecting 20
8.2 Sync with phone 20
8.3 First time pairing and connecting through NFC 21
8.4 First time pairing and connecting manually 23
14 Remote mode 32
14.1 Overview 32
14.2 Remote mode - LED and vibration feedback 33
14.3 Application mode - extension guidelines 34
14.4 Remote mode - Life bookmark (Selected per default or not?) 35
14.5 Remote mode - Media Player 36
14.6 Remote mode - Functionality supported by AHA 37
15 Control mode 38
15.1 Overview 38
15.2 Key interactions in control mode 39
16 Heart rate measurements 40
16.1 Automatic HR(V) measurement 40
16.2 Manual HR(V) measurement 41
IxD BlueprintUXC
17 Alarm 42
17.1 Xperia alarm and Smart wake up 42
17.2 Alarm vibration and LED patterns 43
18 Incoming call 44
19 Notifications 45
19.1 General notification 45
19.2 Low battery notification 46
20 Charging battery TBD!! 47
20.1 Charging battery 47
UXP X
CONFIDENTIAL
2014-12-05 3 / 55
20.2 Turning off when running out of battery 48
21 Xperia at hand features 49
21.1 New generation proximity unlock 49
21.2 Out-of-range alert 50
22 Document history 51
IxD BlueprintUXC

1 Document status

UXP X
CONFIDENTIAL
2014-12-05 4 / 55
Responsible persons
Concept Lead
Johan Helgertz/Peter Johansson
User Experience Design
Sofia Dahlgren
Visual Design
TBD
Technical Interaction Designer Nils Hellstrand
About this document
The Product aims to work with Android phones that support the 4.0 Bluetooth low energy standard.
Document author:
Sofia Dahlgren
sofia2.dahlgren@sonymobile.com
Related document:
IXD-Blueprint_Everest_Device app.pdf
Status
Draft
Approved by UXC
Development
Integrated
IxD BlueprintUXC

2 Introduction

2.1 Background

UXP X
CONFIDENTIAL
2014-12-05 5 / 55
General description
A1ll (Everest) isan activity bracelet that combines 24/7 activity tracking with theconnectiontoXperia’s entertainment and communicationfeatures. A1ll is defined as one of the smart wearables that together with the data that the phone logs can provide information about how the user lives her life. The phone app Lifelog is used as the main interface for reading out life tracking data. There are LEDs and vibrations on the bracelet that mainly serve as indicators of phone activities (incoming call, notifications) and alarms.
The main feature for A1ll is the heart rate/pulse measurement and stress indication through heart rate variability that the HR sensor provide. The measurements are done continuously without the user having to do anything.
Everyday functionality
Remote mode functionality - for a customized experience (e.g. media
control can be selected)
Use SmartBand together with external applications
Next generation proximity unlock
Capacitive sensor descoped
Smart wake up
Scope
This document specifies the A1ll UI at functional level, so no technical details. Although, if technical limitations influence the usability and/or functional behaviour, they shall be defined.
The UI of the Lifelog app and Host app are defined in separate blueprints.
Designed for life
As A1ll is designed to be worn all the time it has to be unintrusive,
comfortable and durable
Know the best of you
24/7 activity tracking
Find patterns
Set goals in Lifelog and follow up
Heart Rate Variations and pulse logging (continuously)
IxD BlueprintUXC

2.2 Constant values & Abbreviations

UXP X
CONFIDENTIAL
2014-12-05 6 / 55
ASW013 ASW011 ASW010 ASW009 ASW008 ASW007
Constant values
KEY PRESS
Short press Released within 2000 ms after pressed Long press Pressed for more than 2000-5 000 ms Very long press Pressed for more than 5000-10 000 ms Very very long press Pressed for more than 10 000 ms Double click press Max. 500 ms between the release of a short press and
the down of the next short press.
Abbreviations and terms
AHA Accessory Host Application
BT Bluetooth
BLE Bluetooth Low Energy
Device The device that A1ll connects with (mobile phone or tablet)
GUI Graphical User Interface
N/A Not Applicable
TBD To Be Decided/Defined
UI User Interface
HRV Heart Rate Variability
HR Heart Rate
IxD BlueprintUXC

2.3 Product brief

UXP X
CONFIDENTIAL
2014-12-05 7 / 55
ASW201 ASW200 ASW124
A1ll isan activity bracelet that is meant to be worn all the time. As a whole the purpose of the product and Lifelog app is to support users in becoming more aware of their own lifestyles and to be alerted by important phone activities.
5 important usage goals are
1) To log and become aware of stress/intensity levels
Users should be able to create awareness of what makes them stressed/ exalted, relaxed and get motivated to stress less. Heart rate variability measurements are done continuously and can be viewed in Lifelog app.
2) To log and become aware of how much I move physically
4) To use it together with external apps
Users should be able to control or interact with external apps through e.g. tapping or gestures. An API makes it possible for external apps to get live sensor data and communicate through LEDs and vibrations.
5) To use it as a mobile phone extension
Users should be able to use the product as an extension to the mobile phone. For instance by being alerted of phone activities (notifications, calls, alarms). It should also be possible to control certain functionality on the phone by tapping in remote mode, e.g. media control or find phone.
Competitive strengths
Users should be able to log and set goals for physical activities such as steps, walking, running, swimming. Number of stairs and elevator riding should also be displayed in Lifelog. Other activities that are measured in Lifelog are various transports. While training it should be possible to measure pulse.
3) To log and become aware of sleep cycles
Users should be able to enter sleep mode automatically and log how many hours of sleep they have had, to understand the quality of sleep and look at a sleep cycle for detailed information.
Users will buy the product to become more aware of how they spend their time and to live a healthier, less stressful and more active life. The main differentiator and competitive strength of this product in comparison to similar products is the stress/exalted indications provided by the HRV sensor.
IxD BlueprintUXC

2.4 Prioritized use cases

UXP X
CONFIDENTIAL
2014-12-05 8 / 55
ASW128 ASW063 ASW200 ASW148 ASW139
Logging - discover life patterns so that I can change my behavior and live healthier
AS A: user I WANT TO: log my stress level continuously in everyday life and view the result in Lifelog (partly Lifelog req)
AS A: user I WANT TO: be able to log the following activities automatically using my accessory ­steps, running, walking, sleep, swimming, standing, sitting, car, train, bike, airplane can be detected by the phone/cloud (partly Lifelog req).
AS A: user I WANT TO: log my pulse when doing physical activities
AS A: user I WANT TO: be able to read out my sleep cycles in Lifelog that informs me about my sleep quality. E.g. if I’m stressed, if I toss and turn, how many hours of sleep etc. (partly Lifelog req)
AS A: user I WANT TO: be able to be informed about what impact various contexts (for instance music listening, entertainment, calendar events) has on my stress level (Lifelog req)
AS A: user I WANT TO: be encouraged in changing my behavior to the better. E.g. through notifications, weekly summaries etc. (Lifelog req)
stairs, elevator. Being transported by
Support in everyday life
AS A: user I WANT TO: be notified when there is a phone alarm, smart wake up, incoming call or notifications such as e-mail, sms/mms or facebook.
AS A: user I WANT TO: be able to silence or reject an incoming call.
Product customization and SDK
AS A: user I WANT TO: use external apps that support my SmartBand for logging in real time and communicate through LEDs, vibrations and tap/gesture interaction.
AS A: user I WANT TO: control selected functionality from A1ll by tapping. E.g. manual logging of a certain activity or media player control.
AS A: user I WANT TO: be able to meet new people that also are Lifeloggers.
AS A: user I WANT TO: be able to have the logged data accessible for other applications. For instance, sport applications that can use A1ll data as input for more exact reading of activities. TBD
Offline cases
AS A: user I WANT TO: have all physical activities (listed above) logged in offline.
AS A: user I WANT TO: log stress level/ heart rate measurement in offline
AS A: user I WANT TO: be able to use smart wake up - both to be alerted, to snooze the alert and turn off the alert in offline.
AS A: user I WANT TO: have my logged data that is stored during offline saved 24 hours.
AS A: user I WANT TO: be able to cancel or snooze a phone alarm or smart wake up.
AS A: user I WANT TO: be alerted by a smart wake up alarm that wakes me up at a set time when I am in light sleep.
AS A: user I WANT TO: be reminded when I leave my phone behind (off per default).
AS A: user I WANT TO: have a safe way of unlocking the phone by using the bracelet. No one else should be able to access my phone with my bracelet. Note: Capacitive sensor descoped!
AS A: user I WANT TO: be able to meet new people that also are Lifeloggers. (TBD Work on
finding use cases)
IxD BlueprintUXC

3 Hardware requirements

One hardware button
Accelerometer
BLE (Bluetooth Low Energy)
NFC (Near Field Communication)
Built-in battery
Memory
Vibrator
UXP X
CONFIDENTIAL
ASW255 ASW198 ASW195 ASW159 ASW108 ASW025 ASW006
2014-12-05 9 / 55
3 RGB LEDs
Dimmer
Heart rate sensor (HRV enabler)
Galvanic skin sensor (GSR)
DESCOPED
Altimeter (barometric pressure sensor)
Capacitive sensor
DESCOPED
Improved Activity Engine
IP68 + IP66
LED A
LED B
LED C
IxD BlueprintUXC

4 Interactions Overview

4.1 Interactions

Key interactions
Long press (in off mode) Short press
UXP X
CONFIDENTIAL
2014-12-05 10 / 55
ASW019
Tap interactions
4.1.1 Turn on A1ll
If in OFF mode long press the key or use NFC to turn on A1ll. When turned on all three LEDs are lit in the white start up animation, then turned off.
Short press and tap (in idle or control mode)
4.1.3 Remote mode interactions
Short press and tap to enter remote mode. Single, double and triple tap may be used to interact with the phone, the initial tapping sequence is treated as interaction. In remote mode all LEDs are green until the automatic time out.
4.1.2 Check connection status
Short press to view if A1II is turned on and connected. If it is connected the connected animation is seen in cyan. If it is not connected the connected animation is seen in white.
IxD BlueprintUXC

4.2 Interactions (cont.)

UXP X
CONFIDENTIAL
2014-12-05 11 / 55
Touch interactions
NFC touch to turn on, pair and connect
4.2.1 Turn on A1ll, pair and connect
NFC touch in off mode/no AHA: Guide the user to AHA on Google Play/Bai-Du. A1II starts up in bonding mode.
From AHA can the user BT scan and connect to A1II as long as A1II is still in bonding mode, but a second NFC touch after installing AHA will always pair and connect A1II. A1II is now bonded to the phone.
NFC touch to open AHA
4.2.2 Open AHA
NFC touch phone when connected to open AHA.
NFC touch to reconnect
4.2.3 NFC touch to reconnect
If A1II has been paired and connected but lost the connection can NFC be used to reconnect.
IxD BlueprintUXC

5 Incoming events Overview

5.1 Incoming events

UXP X
CONFIDENTIAL
2014-12-05 12 / 55
Event interactions
1
2
Incoming call (short press or long press)
Smart wake up/alarm (short press and long press)
5.1.1 Silence incoming call
Vibration and all LEDs blinking in white continuously indicate incoming call. Short press or long press to silence incoming call.
5.1.2 Snooze and dismiss Smart Wake up alarm
Vibration and all LEDs blinking in white continuously indicate Xperia alarm, Smart wake up only have the vibration. The LED animation and vibration pattern should differ slightly from Incoming call. Short press to snooze. Long press to dismiss the alarm. Long press is indicated with a short final vibration.
IxD BlueprintUXC

5.2 Incoming events (cont.)

UXP X
CONFIDENTIAL
2014-12-05 13 / 55
Event interactions
Battery low (short press to end notification)
5.2.1 Battery low
Battery low indication is indicated through vibration and blinking a red LED. The warning will be given at least once before running out of battery, but will not be given in “do not disturb” mode. The red LED continues to blink every 6 second for up to 5 minutes.
TBD exactly when to give battery warning depending on current
Battery charging (no key press)
5.2.2 Charging
Battery charging is indicated by a red, changing to yellow, RGB light. When battery is fully charged the same LED is green instead. A1ll is turned off during charging.
battery consumption!
Incoming notification (short press to end notification)
5.2.3 Notification
Incoming notification is shown by the first LED blinking in white and the bracelet vibrates. It continues to blink every 6 second until the user looks at the notification in the phone or press the key. This continues for up to 5
minutes.
IxD BlueprintUXC

5.3 Incoming events Do Not Disturb mode

Don Not Disturb mode (DND)
A1II can be set in Do Not Disturb mode from AHA. DND can be scheduled and should work even if A1II is disconnected. In DND are all notifications turned off except for smart wake up and xperia alarm.
Note: Low battery warning should not be given during DND, independent of if A1II is connected or not.
UXP X
CONFIDENTIAL
2014-12-05 14 / 55
ASW208 ASW207 ASW206
IxD BlueprintUXC
UXP X

6 Gesture interactions - Example of partner possibilities

Not for RTL!

6.1 Show yourself to others

Bracelet users can select to turn on a social state that allows contact/info exchange between users that also are A1ll users. The “show yourself to others setting is turned on in AHA and can be triggered when doing a certain gesture.
Gesture interactions
CONFIDENTIAL
2014-12-05 15 / 55
1
6.1.1 Turn on the setting
A1ll Settings
Show myself to others
2 3
6.1.2 Meet people
6.1.3 Identify yourself to others
The “show yourself to others” setting is turned on in AHA. This will make your contact information available to others.
When meeting a person you want to share your contact info with and discover that the other person also is wearing a bracelet your contact info can easily be exchanged.
With a handshake the contact info is exchanged.
Note: only mutual infosharing should be possible.
TBD: decide what kind of gesture/s we should support. Handshake, hi-five?
Another example: users can have it connected to Facebook. When doing a hi-five both persons are tagged and this can be posted on the persons walls. What is triggered is decided by the various apps.
IxD BlueprintUXC
UXP X
CONFIDENTIAL
2014-12-05 16 / 55

7 Detailed interaction and event states

7.1 LED sequence key interactions

Mode Power off Idle Remote mode App mode Notification Incoming call Alarm/Smart wake up
ASW019
Short press
Short press + tap
N/A View status (turned on/connected).
If connected LEDs are lit in cyan. If not connected LEDs are lit in white.
TBD! Are they visible in all colored wristbands??
N/A Enter remote mode. All LEDs lit in
green.
Exit remote mode, go to previous mode.
N/A (Exit remote mode on short press and ignore the tap)
Double press N/A Manual HR(V) measurement. Exit remote mode. Start manual
HR(V) measurement.
Long press Power on and
reconnect - all LEDs in white until connected, then cyan.
N/A Exit remote mode, go to idle
mode.
View status for connected Stop blinking Silence ring signal Snooze
Enter remote mode. Enter remote mode. Silence ring signal and enter
remote mode.
Manual HR(V) measurement. Manual HR(V)
measurement.
Exit app mode, go to idle mode. Stop blinking Silence ring signal Turn off alarm
Silence ring signal. Manual HR(V) measurement.
Snooze and enter remote mode.
Snooze. Manual HR(V) measurement.
Very long press
Very very long
press
Combined press
5 short press, then 15
sec longpress
Power on and reconnect - all LEDs in white until connected, then blue.
Factory data reset & bonding mode
Combined press for DFU mode and OTA. The start of the OTA sequence LED animation indicate 15 sec.
Power off - LEDs shut down one by one (ref. Ellis)
N/A N/A N/A N/A N/A N/A
N/A N/A N/A N/A N/A N/A
Power off Power off Power off Power off Power off
IxD BlueprintUXC
UXP X
CONFIDENTIAL

7.2 Vibration feedback

TYPE ORIGIN NAME VIBRATION COMMENT
System Power ON/OFF Single vibration
2014-12-05 17 / 55
ASW210 ASW028 ASW027
500 ms
500 ms
System Factory data reset Three short vibrations, then one
100 ms
500 ms
longer 500 ms
System Forgot phone warning A sequence of 3 short vibrations.
250 ms 750 ms
Then silence
System Bonded and connected Single vibration
250 ms
AHA Event notification (contact customizable?) 1 vibration (E-mail, SMS/MMS,
400 ms
calendar events etc)
System Manual HRV successful Single vibration
250 ms
System Manual HRV failure Double vibration
250 ms 200 ms
System Long press verification at alarm and app
mode
250 ms
Single vibration
AHA Incoming call (contact customizable?) Continues to vibrate until user
1000 ms1000 ms
interacts or caller hangs up
System/AHA Smart wake up and alarm Continues to vibrate up to
800 ms 200 ms 800 ms
3 minutes
System Battery is low indication Five vibrations
200 ms
100 ms
System Feedback for single, double or triple taps Single, double or triple vibrations
100 ms 200 ms
IxD BlueprintUXC
Loading...
+ 38 hidden pages