Converting Autonomous Robotics sensor data into a human readable 3D environment 

Robotic Sensor Projection

Road Surface

Robotic Perception

Motion Planning

Strategy

00

Gather research evidence to define mental models required for teleguidance.

01

Evaluate research findings to establish principles for visualizing situational awareness for remote operators.

02

Establish baseline performance metrics for initial product launch.

Craft

Advocacy

Research

Converting Autonomous Robotics sensor data into a human readable 3D environment 

00

Research revealed that map surface areas beyond the sidewalk where pedestrians can directly access the road surface, are not required.

01

Road surface data should replicate public roads, as it optimized operator contextual awareness.

*Intentionally Blurred

00

Operator observation and inquiry provided task and information requirements, an essential element being the intended & modified behaviors of the AV Stack.

01

Visualization of errors, critical events and urgent status changes are required within the area of focus, a 15° field of view cone for each operator.

00

Operators when intervening with on-road scenarios, require accurate object footprints and proximity to resolve use cases.

01

Unique object shapes by classification type improved operators speed to obtain situational awareness.

Road Surface

Robotic Perception

Motion Planning

Results

-83%

Motional RVA

Reduced Remote Operator intervention times by 82.8% with single action UX solution.

1:2+ Ratio

Motional RVA

Increased Remote Operator to Autonomous Vehicle ratio beyond 1:1.

2 years

Accelerated Commercial Operations timeline with Uber and Lyft on the Las Vegas Strip.

*Video captures early product version of Remote Vehicle Assistance.

Collaborators

Remote Supervision

Gunnar Newquist, Product Manager

Shaurya Argawal, Head of Product

Engin Anil, VP of Software Engineering

Aastha Papneja, Lead Engineer

Remote Vehicle Assistance

Kezia Kong, Senior Product Designer

Mimi Weber, Design Manager

Krista Chauncey, Principal Researcher & Team Lead

Joanna Barth, UX Researcher

Janna Tenenbaum-Katan, Lead Product Manager

Obi Asinugo, Product Manager

Wan Jou Lim, Technical Program Manager

Rolan Summerville, Principal Technical Program Manager

Gregory Butron, Team Lead Engineering

Kelvin Robles, Lead Engineer

Ernesto Munoz, Lead Test Engineer

Swathi Venugopal, System Engineer

Cody White, Commercial Operations Manager

Kevin Davis, RVA Operations Manager

Designing for Data Intelligence

Interested in solving your Human Machine Interface design challenges? Let’s Connect