
Converting Autonomous Robotics sensor data into a human readable 3D environment

Road Surface
Robotic Perception
Motion Planning

Strategy
00
Gather research evidence to define mental models required for teleguidance.
01
Evaluate research findings to establish principles for visualizing situational awareness for remote operators.
02
Establish baseline performance metrics for initial product launch.
Craft
Advocacy

Research
Converting Autonomous Robotics sensor data into a human readable 3D environment

00
Research revealed that map surface areas beyond the sidewalk where pedestrians can directly access the road surface, are not required.
01
Road surface data should replicate public roads, as it optimized operator contextual awareness.
*Intentionally Blurred

00
Operator observation and inquiry provided task and information requirements, an essential element being the intended & modified behaviors of the AV Stack.
01
Visualization of errors, critical events and urgent status changes are required within the area of focus, a 15° field of view cone for each operator.

00
Operators when intervening with on-road scenarios, require accurate object footprints and proximity to resolve use cases.
01
Unique object shapes by classification type improved operators speed to obtain situational awareness.

Road Surface
Robotic Perception
Motion Planning

Results
-83%
Motional RVA
Reduced Remote Operator intervention times by 82.8% with single action UX solution.
1:2+ Ratio
Motional RVA
Increased Remote Operator to Autonomous Vehicle ratio beyond 1:1.
2 years
Accelerated Commercial Operations timeline with Uber and Lyft on the Las Vegas Strip.
*Video captures early product version of Remote Vehicle Assistance.

Collaborators
Remote Supervision
Gunnar Newquist, Product Manager
Shaurya Argawal, Head of Product
Engin Anil, VP of Software Engineering
Aastha Papneja, Lead Engineer
Remote Vehicle Assistance
Kezia Kong, Senior Product Designer
Mimi Weber, Design Manager
Krista Chauncey, Principal Researcher & Team Lead
Joanna Barth, UX Researcher
Janna Tenenbaum-Katan, Lead Product Manager
Obi Asinugo, Product Manager
Wan Jou Lim, Technical Program Manager
Rolan Summerville, Principal Technical Program Manager
Gregory Butron, Team Lead Engineering
Kelvin Robles, Lead Engineer
Ernesto Munoz, Lead Test Engineer
Swathi Venugopal, System Engineer
Cody White, Commercial Operations Manager
Kevin Davis, RVA Operations Manager