Voice Control on Wearables
Creating a new voice interaction design system for a novel hardware device
Date
July 2021 - January 2023
What I did
Conversation design, interaction design, visual UX design, prototyping, user research
🔒 The nature of this work remains confidential.
Background
For the last year and a half I was at Meta, I worked on integrating voice control for a new wearable device. I would love to go into more detail and share visuals, but for the time being I can provide an overview of the work I’ve done and my responsibilities on this project.
Similar to my experience working on Ray-Ban Stories, my role on this project was to bring the voice assistant product to life on a 0-to-1 hardware product.
Domains and Design Systems
This device happens to have a small visual display, so I worked very closely with our visual product designer to ensure that the visual + conversation design systems were seamlessly integrated into a cohesive experience. I worked with 1 other conversation designer on this project to establish a conversation design pattern library that outlined response patterns, invocation, errors, and sound design. My role covered the overall interaction model with voice, as well as 12 key domains for the device’s core feature set.
Prototyping
This was the project that allowed me to really go deeper in my prototyping skills, using Protopie as our main tool for interactive voice experiences. I was a strong advocate across our design team as well as across Meta to champion using Protopie for voice interactions. I gave presentations, tutorials, and even met with Protopie product leaders and designers to share feedback on our use cases.
Multi-device Ecosystem
Finally, the last area of focus for me on this project was to envision the future of how this device would leverage and empower other devices in Meta’s hardware ecosystem. I worked closely with product managers, user researchers, and other design teams in Reality Labs to brainstorm, prototype, and design concepts for what some of these hero use cases might end up being. This was a challenging but fun opportunity to do more strategy work thinking 5, 10 years into the future, and use the power of design and prototyping to influence product decisions.