A natural, quick way to solve outdoor interaction problem.
Loomo is a mobile robot sidekick, both a self-balance transporter and a personal assistant. Loomo went on sale in April 2018 worldwide and has been integrated into the lives of 30,000+ satisfied customers.
Solo Product Designer
Build gesture from0 to 1
Robot, iOS, Android
Gesture Quick View
Loomo has using scenarios both indoors and outdoors. Although it already got voice interaction, it's hard for voice commands to work in a noisy outdoor environment.
As users, they need an interaction method to quickly access outdoor high-frequency features like follow, take photos.
There were 2 reasons I thought gesture is an excellent fit:
1. Loomo is designed as a little buddy of users. Just like when people call their dog with gestures, users could call Loomo in the same way.
2. Gesture as a Long-distance interaction fits the high-frequency features like follow, take photos very well.
Goals of Gesture
Natural, quick, safe gestures for 3 feature: Follow, Stop Follow, Take Photo
High accuracy of gesture recognition
Easy to learn
Pre-design: Define Gestures
3 principles to choose gesture positions
Fit to life scenario, match the meaning of commands
Take future gesture plan into consideration
Evaluated by algorithm team
Final chosen gestures:
Take a Photo
CHALLENGE & SOLUTIONS
Challenge 1 - False Triggering
After gesture poses define, I put the gestures in robot idle states and started simplest testing.
What is False Triggering?
Like Alexa or Siri have false voice triggering when users did not call them, but they react. Gestures were also falsely triggered by mistakenly recognizing the random body language as the gesture commands and potentially starting to move suddenly!
False triggering is a very high-risk problem because it can cause security problems:
Smashes objects, potentially hurt people
Lost because followed wrong person…
KET DESIGN DECISION #1
I get inspiration from smart speakers, which always have a wake-up voice command like "Alexa", "Hey Siri ".
After testing, the wake-up gesture is an effective solution for false triggering; it’s like a barrier to prevent command gestures from being recognized accidentally.
Wake-up gestures can also save CPU usage by minimizing counts, reducing delays and crashes.