loomo.png

LOOMO

“Hi, I’m Loomo,  

 I’m sent from the Future. ”

Story about Loomo

A Really Mobile Robot Sidekick

Bring you Fun, Convenience, Practical Function and Emotional Connection

Since the launch, loomo has been integrated into the lives of Over 1000 satisfied customers, with multiple tasks.

室内载物.gif
白天骑行.gif
路萌在酒吧做服务生.gif
Enjoy sunlight with Loomo
Service at the party
Bathhouse helper
开发-为盲人带路.gif
开发-在室内运输工具.gif
路萌跟随小男孩.gif
Lead the way for blind
Transport items in workshop
Interact with kids

Loomo meets the expectations of customers

资源 4.png

TIMELINE

资源 36.png
未标题-2.png

Loomo achieved 1000+ satisfied customers and excellent media evaluations also defined the future of personal robots.

What did I do in the Loomo Team? I'll share 3 Parts with you. 

Story 1. 

 

Loomo Status

WHY A PERSONAL ROBOT NEEDS PERSONALITY?

资源 5.png

It is easy to understand people's expectations of robots for more than just cold tools. After all, too many films and novels convey the concept of ‘Robots have feelings’ to people, from robots to AI.

User Expectation

BB8
Star Wars
WALL·E
Blade Runner 2049

Product Definition

In CES 2017, loomo already has some great features including Follow, Camera, etc. However, personal robot products should not only provide actual functions, but also full of emotional interactions. Our team's expectations for robots are:

Fun, Responsible, Friendly but NOT Flattering portrait.

资源 7.png
资源 6.png
Portrait of Loomo
Personality Dimensions

We define Loomo as a half wolf half boy, naughty, curious, occasionally making mistakes, and passionate about the items and people he likes.

We also give Loomo various emotions, sound and special preferences, which make he more vivid and interesting.

apple2.gif
Loomo likes apple
资源 9.png
Loomo enmotions

Besides,  functions also determines his role.

资源 10.png
Reliable shooting assistant
Inseparable follower
Efficient transportation partner

We now have features, emotions, preferences, and without a set of logic to organize these events, robots cannot have the personality, and some problems will occur.

3. Chaos - Events without priority, unordered feedback interferes with the user's true intentions. 

资源 11.png

2. Blurring triggers - People come to interact but the robot is in a daze.

1. Too active - Be active when no one is present thus robot is constantly draining.

资源 12.png
资源 13.png

Designing the Loomo State to support robot personality and respond to the user's expectations.  

Here's my three-step:  Comb, Construct and Design in achieving this.    

As FEEDBACK is a very comprehensive composition, I’m wondering what can Loomo do to contribute to his perfomance.

1. COMB - WHAT WE HAVE

Comb all elements by classification and refer to activity levels.

2. CONSTRUCT - BEHAVIOR DEFINITION

For the idle state of the robot, more definitions are needed, otherwise: 

资源 14.png

Complete the construction

资源 18.png

Auto-searching

Status construction: Transition relationship between status

资源 16.png

Activity Status:

3. DESIGN - CREATION AND DETAIL

Status Workflow

page_2.png

New Event: Automatically search for human

giphy (1).gif

When Superman or people are looking for someone, the behavior looks like this. I hope that loomo can quickly find targets outside the field of vision while exploring, To make this action design more humanized, I designed a set of searching movements and logic .

Stop the search after finding the target, follow the target move and wait for the interactive command.

资源 19.png
资源 20.png
13.gif
11.gif

Automatically Search

Automatically find people after the target is lost.

Random position principle:

1. Synthesize the random head horizontal position, with random +, - angle, random 0-75 number.

2. The angle between the two positions needs to be greater than 45 degrees.

3. The searching angle is always controlled within the range of +75 to -75.

Automatically Search

ACHIEVEMENTS AND SUPPLEMENTS

sleep2.gif
资源 23.png

Sleeping Status

Exploring timeouts without interaction, transforming into sleeping status.

search.gif
资源 24.png

Exploring Status 

Continue to find the target after the target lost or the interaction over.

tracking apple.gif

Interactive Status 

Automatically follow people or objects (such as apples) after finding the target.

资源 25.png
waken.gif
资源 26.png

Waken

Expressing the passion of concentration, and ready to receive commands.

Priority: Define Events Dispose Based on Status

Since both mobile apps and robots can trigger events, definition of priority is essential. We define the user's last operation to the robot as the highest priority, usually the last operation on the robot-end. 

资源 28.png

Detail addition: based on the state, defines the dispose of the intersection of all events. 

资源 30.png
 

Story 2. 

Meet Loomo: OOBE (Out-of-box Experience)

BUILD EMOTIONAL CONNECTIONS from the first MEET

The design of OOBE including a spontaneously interactive tutorial conducted by Loomo and instruction about out of package and starting up, allowing users to master the basic operations of the product and establish positive emotional connections. How the OOBE did you might ask? People’s sharing on Youtube explains everything. 

How the OOBE did you might ask? People’s sharing on Youtube explains everything.

youtube.png

WHY OOBE DESIGN

The process of unpacking and setting up for intelligent device is a lengthy and complicated process that consists of many steps. Some of the steps are difficult and can easily cause a bad experience for users.

资源 34.png

User sentiment ups and downs after receiving their robot

The pre-ordered customers have high expectations for Loomo, however, the complicated and difficult steps make their enthusiasm gradually decline. More Learning Costs required in the OOBE steps, less excitement users have.

Tutorial Mode - need a delightful teaching method for user satisfaction and later usage.

+ Quickly view key points

+ Catch user’s eye

 

- Limited coverage

Guide Pages

+ Comprehensive content

+ Contains safety instructions

- Many users do not read the instructions

Instruction Manual

Traditional metiods are not ideal

Spontaneously interactive tutorial conducted by Loomo itself

资源 39.png

- Quickly establish emotional connections with users

- Deliver the introductions of  basic operations

- Arouse users' interest in product features

INTERACTIVE TUTORIAL

Tutorial Construction

资源 40.png

Formulation

资源 41.png

Although loomo tutorial follows an established script, the user's interaction must be considered. 

The script should take into account the different responds of users. 

资源 42.png

Leave Room for User Failure

TUTORIAL SCENARIO
SCRIPT
Click to view full size
tutorial3.png
WORKFLOW
tutorial4.png
Click to view full size
OUTPUT

Launcher

launcher4.gif
未标题-2.png
launcher.gif

Push Sensor Instruction

push.gif
未标题-2.png
push.gif
01.gif

Ride Instruction

ride.gif
未标题-2.png
02.gif
skip.gif
iphone x.png

APP: Start and Skip

If the user is not convenient of want to try tutorial at this time, the tutorial can be skipped with APP.

USABILITY TESTING

Listening to the end users

 “Good product never excluding end users from the design process.”
资源 43.png

For collecting real user needs and feedbacks, our team organized internal testing for Interactive Tutorial.

 

Internal test is initiated every two weeks, each containing at least 5 testers close to the product portrait .

Because some tutorial steps required specified operation to pass, test users are esay to get stuck in the some step: 

Push touch sensor: Difficult to trigger push touch sensor

                               Exit touch mode before pushing displacement

                               Difficult to stabilize touch mode

 

Voice waken/voice command: If the voice recognition peogram is collapse, the process cannot continue  

 

Auto-shot:  If the camera module cannot be turned on, the process cannot continue

Balance Point Principle : Leave Room for User Error

As the tutorial process becomes more strict, the user's learning effectiveness gradually increases, but too strict tutorial will lead to negative user experience.

资源 44.png
ITERATIONS: BASED ON FEEDBACK COLLECTION
资源 45.png
资源 46.png
VERIFY: ITERATIVE OPTIMIZATION EFFECT

After 6  iterations, in later internal test of May 2018, the tutorial is the most satisfactory and favorite function for users in synchronization functions.

资源 47.png
Excerpt from May 2017 internal test report

Evaluation Standard:  SUS(System Usability Scale)

The SUS provides a “quick and dirty”, reliable tool for measuring the usability.   It consists of a 10 item questionnaire with five response options for respondents; from Strongly agree to Strongly disagree.  Originally created by John Brooke in 1986.

Calculating method:

Determine the conversion score for each question, ranging from 0-4, with an average score of Xi for each question.

Conversion scores calculating:

For the positive questions: original score minus 1 (Xi-1), for the negative questions: 5 minus original score (5- Xi).

Total SUS score: added  all conversion scores and multiplied by 2.5 .  (Ranges from 0 to 100 and is divided into 2.5 increments.)

资源 48.png
资源 49.png

SUS of Interactive Turorial

资源 50.png
 

Story 3. 

Gesture Interaction

资源 51.png
The Republic of Tatarstan President Praised Loomo and Gesture Function
in China Hi-tech Fair 2018
WHY GESTURE 

Gesture function is not just a exploration of a more natural interactive method, but also serve actual application scenario.

 

In noisy outdoor environment, voice interaction usually can not convey valid commands.

Gesture interaction is more effective and accurate way.

04.gif
DEFINE GETURE POSES

Customize gesture poses for potential commands,

           1. Poses semantics match the meaning of commands

           2. The posture should seem nature and comfortable

资源 53.png
FROM ALGORITHMIC TO EXPERIENCE
资源 58.png

Transforming the algorithmic language (recognition boxes on the image),

into experience under the user’s cognitive range.

 

Before start the UX process, I tried the recognition effect on algorithm dome.

And preparing for turning techniques into practical functionality.

algorithmic interface
EXCELLENT FEATURE BORN FROM ITERATIONS

Comparing with interface-only interaction, the gesture interaction is more likely to influenced by Multiple Factors. UX depends on synthetical combination of interactive flow, visual& sound feedback, precise algorithms, software logic details.

 

Before function finally released, I gave 3 Key Iterations and multiple optimizations.

1
Initial Vision: Test in Demo
资源 54.png

Select the gesture functions

 

Avoid overly complicated operations, the first version selects several cores, useful features.

资源 55.png
Auto-shot
Start Follow
Stop Follow

For the initial version, I add gesture response to Idle Status, for testing initial effect.

 

However,

recognition sensitively affected by environmental conditions, causing False Triggering and Recognition Failure, both lead to negative user experience.

资源 56.png
资源 57.png

False Triggering

Safety Risks

资源 59.png

Starting Follow gesture (putting the palm on the chest) is easily triggered by similar actions. Sudden follow-up caused by false triggering is a danger event for users.

wuchu.gif
2
2nd Version: Turn Algorithm to Function

Design Core:  

1. Security guarantee: solve the False Triggering

2. Experience adjustment: Feedback for gesture recognition

Investigated and tested other products with gesture interaction, e.g. X-Box

资源 60.png

 Wireframe v2.0

2 solutions for  False Triggering

资源 61.png

 Wireframe v2.0

资源 63.png
资源 62.png

Test result: 

Implementation 

v1.gif
3
3rd Version: Balance between Recognition Rate &  False Triggering

In order to avoid misidentification, I added a lot of restrictions to the identification, as a result, the recognition became difficult as well:  

 

In the 3rd version, I go back to Adjust the Balance for better/easier user experience.

 

             1. More agile feedback

             2. Flow adjustment: For easier waken

I worked closely with software engineer and algorithm engineer, kept digging about details of required gesture recognition time, how much continuous recognizition of images should be detected, and also the fault tolerance in the algorithm layer.

 Wireframe v3.4

资源 64.png

Implementation 

start.gif
未标题-2.png
02.gif
资源 66.png

Start Follow

stop.gif
未标题-2.png
03.gif
资源 65.png

Stop Follow

shot.gif
未标题-2.png
01.gif
资源 67.png

Auto-shot

GESTURE TUTORIAL

Without tutorial, guidance and notification, a new function is NOT completed.

Notification & guidance of new function 

Considering that the gesture is based on the CAMERA and FOLLOW, user's permission of using gesture control should be after unlocking & handle CAMERA and FOLLOW.

资源 68.png
Gesture Tutorial
资源 69.png

The most efficient way of teaching is to let the robot teach itself.

RELEASE

After multiple iterations and tests, the Gesture feature was released in Oct. 2018

And I received positive evaluate and sincere suggestions.

资源 70.png
资源 71.png
Screen-shot from support.loomo.com