A1ll (Everest) UX Blueprint Sony Mobile 2014-12-05 Status: [Draft] CONFIDENTIAL The content of this document is the property of Sony Mobile Communications AB and may not be communicated to any other party, in any form, without the prior written consent of Sony Mobile Communications AB.
Table of Contents UXP X CONFIDENTIAL 2014-12-05 2 / 55 ASW001 Table of Contents 1 Document status 4 8.5 Second time pairing, bonding and connecting 24 2 Introduction 5 8.6 General bonding and connecting through NFC: UI flow 25 2.1 Background 5 9 2.2 Constant values & Abbreviations 6 10 Power ON A1ll 2.3 Product brief 7 10.1 Power ON A1ll for the first time or after factory data reset 27 2.4 Prioritized use cases 8 10.
UXP X 17 Alarm 42 17.1 42 Xperia alarm and Smart wake up 17.2 Alarm vibration and LED patterns CONFIDENTIAL 2014-12-05 3 / 55 43 18 Incoming call 44 19 Notifications 45 19.1 General notification 45 19.2 Low battery notification 46 20 Charging battery TBD!! 47 20.1 Charging battery 47 20.2 Turning off when running out of battery 48 21 Xperia at hand features 49 21.1 New generation proximity unlock 49 21.
1 Document status Responsible persons Concept Lead Johan Helgertz/Peter Johansson User Experience Design Sofia Dahlgren Visual Design TBD Technical Interaction Designer Nils Hellstrand UXP X About this document Status The Product aims to work with Android phones that support the 4.0 Bluetooth low energy standard. Draft CONFIDENTIAL 2014-12-05 4 / 55 Approved by UXC Development Document author: Integrated Sofia Dahlgren sofia2.dahlgren@sonymobile.
2 Introduction 2.1 Background General description A1ll (Everest) is an activity bracelet that combines 24/7 activity tracking with the connection to Xperia’s entertainment and communication features. A1ll is defined as one of the smart wearables that together with the data that the phone logs can provide information about how the user lives her life. The phone app Lifelog is used as the main interface for reading out life tracking data.
UXP X 2.2 Constant values & Abbreviations CONFIDENTIAL 6 / 55 2014-12-05 ASW013 ASW011 ASW010 ASW009 ASW008 ASW007 Constant values Abbreviations and terms KEY PRESS AHA Short press Released within 2000 ms after pressed Long press Pressed for more than 2000-5 000 ms Very long press Pressed for more than 5000-10 000 ms Very very long press Pressed for more than 10 000 ms Double click press Max. 500 ms between the release of a short press and the down of the next short press.
2.3 Product brief A1ll is an activity bracelet that is meant to be worn all the time. As a whole the purpose of the product and Lifelog app is to support users in becoming more aware of their own lifestyles and to be alerted by important phone activities. 5 important usage goals are 1) To log and become aware of stress/intensity levels Users should be able to create awareness of what makes them stressed/ exalted, relaxed and get motivated to stress less.
UXP X 2.4 Prioritized use cases CONFIDENTIAL 8 / 55 2014-12-05 ASW128 ASW063 ASW200 ASW148 ASW139 Logging - discover life patterns so that I can change my behavior and live healthier AS A: user I WANT TO: log my stress level continuously in everyday life and view the result in Lifelog (partly Lifelog req) AS A: user I WANT TO: be able to log the following activities automatically using my accessory steps, running, walking, sleep, swimming, standing, sitting, stairs, elevator.
3 Hardware requirements UXP X CONFIDENTIAL 2014-12-05 9 / 55 ASW255 ASW198 ASW195 ASW159 ASW108 ASW025 ASW006 • One hardware button • Accelerometer • BLE (Bluetooth Low Energy) • NFC (Near Field Communication) • Built-in battery • Memory • Vibrator • 3 RGB LEDs • Dimmer • Heart rate sensor (HRV enabler) • Galvanic skin sensor (GSR) DESCOPED • Altimeter (barometric pressure sensor) • Capacitive sensor DESCOPED • Improved Activity Engine • IP68 + IP66 LED A LED B LED C UXC IxD Blueprint
4 Interactions Overview 4.1 Interactions Key interactions UXP X 10 / 55 2014-12-05 ASW019 Long press (in off mode) 4.1.1 Turn on A1ll If in OFF mode long press the key or use NFC to turn on A1ll. When turned on all three LEDs are lit in the white start up animation, then turned off. Tap interactions CONFIDENTIAL Short press 4.1.2 Check connection status Short press to view if A1II is turned on and connected. If it is connected the connected animation is seen in cyan.
UXP X 4.2 Interactions (cont.) Touch interactions CONFIDENTIAL 2014-12-05 NFC touch to turn on, pair and connect NFC touch to open AHA 4.2.1 Turn on A1ll, pair and connect NFC touch in off mode/no AHA: Guide the user to AHA on Google Play/Bai-Du. A1II starts up in bonding mode. 4.2.2 Open AHA NFC touch phone when connected to open AHA.
5 Incoming events Overview 5.1 Incoming events Event interactions 1 UXP X CONFIDENTIAL 12 / 55 2014-12-05 Incoming call (short press or long press) Smart wake up/alarm (short press and long press) 5.1.1 Silence incoming call Vibration and all LEDs blinking in white continuously indicate incoming call. Short press or long press to silence incoming call. 5.1.
UXP X 5.2 Incoming events (cont.) Event interactions Battery low (short press to end notification) 5.2.1 Battery low Battery low indication is indicated through vibration and blinking a red LED. The warning will be given at least once before running out of battery, but will not be given in “do not disturb” mode. The red LED continues to blink every 6 second for up to 5 minutes. CONFIDENTIAL 2014-12-05 13 / 55 Battery charging (no key press) 5.2.
5.3 Incoming events Do Not Disturb mode UXP X CONFIDENTIAL 2014-12-05 14 / 55 ASW208 ASW207 ASW206 Don Not Disturb mode (DND) A1II can be set in Do Not Disturb mode from AHA. DND can be scheduled and should work even if A1II is disconnected. In DND are all notifications turned off except for smart wake up and xperia alarm. Note: Low battery warning should not be given during DND, independent of if A1II is connected or not.
6 Gesture interactions - Example of partner possibilities 6.1 Show yourself to others Not for RTL! UXP X CONFIDENTIAL 2014-12-05 15 / 55 Bracelet users can select to turn on a social state that allows contact/info exchange between users that also are A1ll users. The “show yourself to others” setting is turned on in AHA and can be triggered when doing a certain gesture. Gesture interactions 1 A1ll Settings 2 3 Show myself to others 6.1.
7 Detailed interaction and event states 7.1 LED sequence key interactions UXP X CONFIDENTIAL 2014-12-05 16 / 55 ASW019 Mode Power off Idle Remote mode App mode Notification Incoming call Alarm/Smart wake up Short press N/A View status (turned on/connected). If connected LEDs are lit in cyan. If not connected LEDs are lit in white. TBD! Are they visible in all colored wristbands?? Exit remote mode, go to previous mode.
UXP X 7.2 Vibration feedback CONFIDENTIAL 17 / 55 2014-12-05 ASW210 ASW028 ASW027 TYPE ORIGIN NAME System Power ON/OFF VIBRATION COMMENT Single vibration 500 ms 500 ms System Factory data reset 500 ms 100 ms System Forgot phone warning 250 ms System Three short vibrations, then one longer 500 ms A sequence of 3 short vibrations.
CONFIDENTIAL UXP X 7.3 State diagram normal mode 2014-12-05 18 / 55 ASW227 OFF 7.3.1 State diagram normal mode Notification and incoming call alerts in normal mode. Low battery warning and automatic HR(V) not included in the image.
UXP X 7.
8 Setting up UXP X CONFIDENTIAL 2014-12-05 20 / 55 ASW012 ASW003 8.1 Pairing, bonding and connecting 8.2 Sync with phone AS A: user I WANT TO: experience that the setup including pairing and Whenever the user enters the Lifelog app she should see that activities are up to date. connecting is smooth and easy. AS A: user I WANT TO: experience that A1ll keeps track of my activities and syncs with the phone without noticing it.
UXP X 8.3 First time pairing and connecting through NFC CONFIDENTIAL 2014-12-05 21 / 55 ASW230 ASW066 ASW065 Apps MOVE A1ll Installed 8.3.1 A1ll can be ON or OFF A1ll can be either ON or OFF if the user wants to connect through NFC. NOTE: Inform the user that A1ll needs be fully charged before starting to use it (if necessary?). 8.3.2 Unlock the device The user needs to make sure that the phone has NFC on. 8.3.3 NFC touch Hold A1ll to the NFC detection area of the device.
UXP X CONFIDENTIAL 2014-12-05 22 / 55 8.3.5 Use case 1: NFC touching When NFC touching a second time, after having downloaded AHA, it will trigger AHA to start and try to connect to Everest. Note: AHA will open even if already connected. 8.3.7 A1II is paired, bonded and connected 8.3.6 Use case 2: Opening AHA manually If the user chooses to open AHA directly instead of NFC touch a second time a setup guide will tell the user to NFC touch a second time or do a manual Bluetooth pairing from AHA.
UXP X 8.4 First time pairing and connecting manually CONFIDENTIAL 2014-12-05 23 / 55 Apps MOVE A1ll Installed BT CONNECTED DEVICES A1ll [Everest setup: Welcome screen] AVAILABLE BT DEVICES Device 1 Device 2 OK Get started 8.4.1 A1ll app download The user downloads AHA. Having installed the application it will be placed on the app tray. 8.4.2 Setup guide When the user opens AHA for the first time there is a welcome screen. 8.4.
8.5 Second time pairing, bonding and connecting UXP X CONFIDENTIAL 2014-12-05 24 / 55 ASW203 ASW012 ASW067 BONDING AND CONNECTING WITH A NEW ANDROID DEVICE AS A: user I WANT TO: bond and connect my A1II with a new phone. AS A: user I WANT TO: know which phone A1II automatically reconnects with. A1II can only be bonded and connected with one android device at a time.
UXP X 8.
9 Disconnect and reconnect AS A: user I WANT TO: experience that the logged data is always up to date in Lifelog. UXP X CONFIDENTIAL 26 / 55 2014-12-05 ASW261 ASW260 ASW259 ASW120 ASW088 ASW087 ASW086 ASW083 ASW059 A1ll will advertise for reconnection in the following cases: • Advertise automatically when disconnected If A1ll looses connection with the bonded device the following should happen 1) A1ll disconnected icon should appear in the status bar.
10 Power ON A1ll UXP X CONFIDENTIAL 2014-12-05 27 / 55 ASW258 ASW251 ASW249 ASW228 ASW205 ASW067 ASW060 ASW022 10.1 Power ON A1ll for the first time or after factory data reset The power on vibration indicates that A1II is starting up. When the user presses the key to turn on A1II for the first time A1II will enter bonding mode and LED A will blink continuously until connected. When A1II is connected bonding mode stops with a short vibration and a connected status animation is displayed.
10.3 Connection status when turned on UXP X CONFIDENTIAL 2014-12-05 28 / 55 ASW204 Key short press when A1II is turned on generates a connected status LED animation. The LEDs are lit in cyan if A1II is connected and white if not connected. LED C LED B LED A 300 ms 300 ms 300 ms 10.3.1 Short press when connected The connected status animation uses cyan when connected. LED C LED B LED A 300 ms 300 ms 300 ms 10.3.
11 Turning OFF and Factory data reset 11.1 Turning OFF A1ll The user needs to very long press the key in order to turn A1ll OFF. If there is a HRV measurement going on then the HRV should be interrupted and the device should be turned off. 11.1.1 Very Long press the key to turn off A1ll UXP X 11.2 Factory data reset CONFIDENTIAL 2014-12-05 29 / 55 ASW250 ASW236 ASW067 ASW024 Factory data reset can only be done from power OFF mode.
12 OTA and DFU mode 12.1 OTA sequence UXP X CONFIDENTIAL 2014-12-05 30 / 55 ASW237 ASW136 ASW102 ASW101 The different modes during a OTA sequence have the same LED indication, constant white blinking. When the update is completed A1II enters bonding mode and AHA can reconnect. Firmware update shall not be possible if the battery level is too low, A1II must then indicate this to AHA. LED A 600 ms 600 ms Enter OTA 12.1.
13 Automatic logging of physical activities - an overview A1ll should be able to log steps, walking, running, swimming, number of stairs, elevator riding and sleeping. All activity tracking should work offline. Other activities e.g. transportation and app usage are detected by the phone. What and how the logged data is visualized is decided by the Lifelog team. Ask Lifelog team about which activities they commit to. Some short time logged data will also be visualized in AHA.
14 Remote mode 14.1 Overview UXP X CONFIDENTIAL 2014-12-05 32 / 55 ASW224 ASW256 ASW223 ASW215 AS A: user I WANT TO: control certain functionality from A1ll by tapping. AS A: user I WANT TO: design which functionality should be linked to tapping. Examples AS A: user I WANT TO: have a simple way to control the media player. It is possible to control a set of up to three actions from A1ll by tapping one, two or three times. In AHA it is possible to select which set of actions that should be controlled.
CONFIDENTIAL UXP X 14.2 Remote mode - LED and vibration feedback 33 / 55 2014-12-05 ASW219 ASW218 ASW217 ASW216 ASW170 ASW169 ASW168 When connected A1II enters remote mode if the user taps within 5000 ms after key short press. Remote mode has a time out 10 000 ms after the last tap sequence. Key short or long press will exit remote mode directly. A1II goes back to idle or control mode depending on previous mode. LED C LED B LED A Double and triple tap must have less than 500 ms between the taps.
14.3 Application mode - extension guidelines UXP X CONFIDENTIAL 34 / 55 2014-12-05 Open extension protocol descoped and replaced by native remote mode Extensions can get raw accelerometer data from A1ll, this will enable extensions to use A1ll for e.g. gaming or guitar playing. A small protocol for tap interaction is provided but counted steps and sleep data is not provided.
14.4 Remote mode - Life bookmark (Selected per default or not?) UXP X CONFIDENTIAL 2014-12-05 35 / 55 Life bookmark Removed! AS A: user I WANT TO: to tag the moment from my A1II and have it saved for personal remembrance. When adding a Life bookmark from A1ll a Heart Rate Variation (HRV) measurement is done and logged together with the time and place in Lifelog. The purpose of Life bookmark is to tag a memorable moment.
UXP X 14.5 Remote mode - Media Player CONFIDENTIAL 36 / 55 2014-12-05 AS A: user I WANT TO: to be able to control media by using the bracelet. The user can select media player actions in AHA as the set of actions to be controlled through tapping in remote mode. Media player actions will control the last used player that supports play/pause, previous and next intents. All three LEDs are constantly lit in green while in remote mode.
14.
15 Control mode 15.1 Overview UXP X CONFIDENTIAL 2014-12-05 38 / 55 ASW222 ASW221 ASW227 ASW220 ASW184 ASW109 AS A: user I WANT TO: use external apps that are compatible with my SmartBand Interrupting control mode for real time logging and interaction through LEDs, vibrations, tapping and gesture. The user can long press the key to stop control mode, the external app can then not take control over A1II again until the user has accepted it from the phone.
UXP X 15.2 Key interactions in control mode CONFIDENTIAL 2014-12-05 39 / 55 ASW226 ASW225 • Short press - View connection status • Long press - Exit control mode In control mode can the app take control over the LEDs. Key short press will however always override the app and the LEDs animate connection status. The app resumes control over the LEDs directly after the animation. Long press in control mode will stop control mode and set A1II in idle mode.
16 Heart rate measurements 16.1 Automatic HR(V) measurement UXP X CONFIDENTIAL 2014-12-05 40 / 55 ASW252 ASW254 AS A: user I WANT TO: be able to log Heart rate level automatically on a regular basis AS A: user I WANT TO: be able to decide when the Heart rate measurements should be done i.e. in what contexts. E.g. during physical activities, entertainment, every day etc. There is no indication on the bracelet to signal that an automatic HRV is going on.
UXP X 16.2 Manual HR(V) measurement CONFIDENTIAL 2014-12-05 41 / 55 ASW253 ASW255 ASW212 ASW211 ASW210 ASW209 AS A: user I WANT TO: be able to initiate a single Heart rate measurement from my A1II. AS A: user I WANT TO: get an indication whether my manual HRV measurement finished LED C successful or not. LED B A manual HRV measurement can be initiated from AHA when connected, but also by key double press on A1II when e.g. disconnected.
17 Alarm 17.1 Xperia alarm and Smart wake up UXP X CONFIDENTIAL 42 / 55 2014-12-05 ASW257 ASW247 ASW246 ASW245 ASW243 ASW242 ASW241 ASW240 ASW239 ASW167 AS A: user I WANT TO: be alerted by xperia alarms and Smart wake up Schedule several Smart wake up alarms AS A: user I WANT TO: be able to choose between snoozing or turning off the alarm from the bracelet. It shall be possible to add up to five (5) Smart wake up alarms with a weekly repeat function.
UXP X 17.2 Alarm vibration and LED patterns CONFIDENTIAL 2014-12-05 43 / 55 ASW246 ASW244 ASW239 ASW238 LED C LED C LED B LED B LED A LED A 200 ms 800 ms 250 ms 800 ms 17.2.1 Xperia alarm vibration and LED blinking intervals Continuous vibration and white blinks from all LEDs. 17.2.3 Long press during alerting alarm A short vibration is used as long press feedback when turning off an alerting alarm. LED C LED B LED A 200 ms 800 ms 800 ms 17.2.
18 Incoming call UXP X CONFIDENTIAL 2014-12-05 44 / 55 ASW232 ASW231 AS A: user I WANT TO: be alerted when there is an incoming call. AS A: user I WANT TO: be able to silence an incoming call Notification for incoming call consists of continuous vibrations with all 3 LEDs blinking in white until the user short or long press the A1II key. This will silence the incoming call signal/vibration on the phone and stop the vibration and LED blinking on A1II. LED C LED B 1 2 LED A 1000 ms 1000 ms 18.2.
19 Notifications 19.1 General notification AS A: user I WANT TO: be alerted by A1ll for incoming notifications in the phone. A1ll supports notifications from Android and iOS devices via a vibration and LED pattern (view image). The first time the LED blinks it comes with a vibration, then one LED blink every 6 second. If the user press the key or reads the notification in the phone the LED will stop blinking.
UXP X CONFIDENTIAL 2014-12-05 46 / 55 ASW100 ASW099 19.2 Low battery notification AS A: user I WANT TO: be alerted by the bracelet when the battery is low. TBD how to handle low battery warning during incoming call, app mode etc. AS A: user I WANT TO: not be disturbed by the low battery warning during do not disturb mode. 1. A1ll is ON. (Charger is not connected) 2. When battery level is beneath a certain level A1ll will vibrate five times combined with a red LED.
20 Charging battery TBD!! 20.1 Charging battery UXP X CONFIDENTIAL 2014-12-05 47 / 55 ASW096 ASW093 ASW092 ASW097 ASW095 ASW094 AS A: user I WANT TO: know when battery is fully charged and ready to use. A1ll can be charged using a usb wall charger or a computer. 1. A1ll is ON or OFF (Charger is connected) 2. LED A is constantly on in red and then in orange as long as the charger is connected and battery is not fully charged.
20.2 Turning off when running out of battery UXP X CONFIDENTIAL 2014-12-05 48 / 55 ASW064 AS A: user I WANT TO: be notified when A1ll is automatically turned off due to empty battery. When A1ll is ON and out of battery the regular turning off animation/ vibration is initiated. This will happen when battery level is below 1%. LED C LED B LED A 500 ms 500 ms 500 ms 20.2.1 Notification when turning off due to low battery LED and vibration indication when turning off because of empty battery.
21 Xperia at hand features 21.1 New generation proximity unlock Descoped since the capacitive sensor is descoped! AS A: user I WANT TO: have a safe way of unlocking the phone by using the bracelet. No one else should be able to access my phone with my bracelet. When the distance between A1ll and the device is xx meter away it should be possible to unlock the phone without using a pin code or pattern etc.
UXP X 21.2 Out-of-range alert CONFIDENTIAL 2014-12-05 50 / 55 ASW185 ASW138 ASW081 When the distance between A1ll and the device causes a disconnection, A1ll will warn the user with vibrations. Due to the uncertainties of connectivity and signal strength it is impossible to set a fixed distance. The function will be set to OFF in AHA per default.
22 Document history UXP X Document Name /Metadoc revision Changes Document Author Modification Date IXD-Blueprint_A1ll_Accessory.pdf • First draft Sofia Dahlgren 2014-05-07 IXD-Blueprint_A1ll_Accessory.pdf • Heart rate measurement is clarified Sofia Dahlgren 2014 w 26.2 IXD-Blueprint_A1ll_Accessory.pdf • Updated document based on review comments from 27/6 -14 Sofia Dahlgren 2014 w 27.3 IXD-Blueprint_A1ll_Accessory.pdf • Startup flow updated Sofia Dahlgren 2014 w 33.
UXP X Document Name /Metadoc revision Changes Document Author Modification Date IXD-Blueprint_A1ll_Accessory.
UXP X Document Name /Metadoc revision Changes Document Author Modification Date IXD-Blueprint_A1ll_Accessory.pdf • 3. Hardware requirement - HRV sensor added. • 5.3 Do Not Disturb added • 15.2 Key interactions in application mode added • Logging sitting/standing descoped • 7.2 Vibration feedback - Long press verification added for incoming call, alarm, remote and application mode. Nils Hellstrand 2014-10-13 IXD-Blueprint_A1ll_Accessory.pdf • 3. Hardware requirement details updated. • 15.
UXP X Document Name /Metadoc revision Changes Document Author Modification Date IXD-Blueprint_A1ll_Accessory.pdf • 7.2 Vibration feedback for tapping and manual HRV added. • 8.5 Second time pairing and connecting added. • 10.3 Connection status when turned on added. • 14.1 Remote control mode initiated by short press and tap • 14.2 Remote control mode - LED and vibration feedback added. • 14.6 Remote control mode Functionality supported by AHA added. • 16.
UXP X Document Name /Metadoc revision Changes Document Author Modification Date IXD-Blueprint_A1ll_Accessory.pdf • Life bookmark removed. • Manual HR(V) LED dimming updated. • 7.1 LED sequence key interactions Combined press for DFU mode added. • 17.1 only support for up to 5 smart wake up alarms. • 8.6 Open AHA at NFC touch when connected.
