Autonomous Vehicle Pickup Visualization With Real-Time Context

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles often struggle to provide accurate and clear pick-up and drop-off experiences for users due to unclear vehicle location and wait time information, leading to frustration as users may search for their ride in vain, especially when vehicles are stuck or waiting in undesirable locations.

Innovation Solution

Implementing a system that leverages various sensors such as camera, GPS, LIDAR, and radar sensors to provide real-time or near-real-time visualizations and insights into the vehicle's location and behavior, including video feeds and contextual information, to enhance user experience through accurate tracking and map enhancements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If autonomous vehicles use basic location tracking without contextual information, then the system complexity is low, but user confusion and frustration increase due to inaccurate vehicle location and wait time information

Engineering Contradiction:
Improvevehicle location and behavior informationVSAvoidtracking system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the tracking information into multiple components: basic location data, vehicle state information (idle, picking up, dropped off), contextual data (traffic conditions, environment), and predictive information (estimated wait times). This segmentation allows the system to provide comprehensive information while organizing it in a manageable, user-friendly format that reduces confusion without overwhelming complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary processing layer between the autonomous vehicle and the user interface. This intermediary system collects raw sensor data from the vehicle, processes it through multiple sensors (cameras, GPS, LIDAR, radar), and transforms it into meaningful contextual information that explains vehicle behavior. This intermediary layer hides the underlying complexity while delivering rich information to users.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If the system provides comprehensive real-time visualizations of vehicle state and context, then user understanding improves, but the loss of time for data processing and transmission increases

Engineering Contradiction:
Improvecontextual information about vehicle behaviorVSAvoiddata processing and transmission time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system performs preliminary processing of sensor data on the vehicle itself before transmission. Sensors continuously collect and pre-process data about vehicle state, location, and environment, so that when data is transmitted to the user interface, it is already organized and ready for display. This preliminary action reduces the time needed for real-time visualization while maintaining comprehensive information quality.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements selective data transmission based on relevance. Not all sensor data is transmitted continuously; instead, the system transmits only the most relevant contextual information needed to explain vehicle behavior (such as traffic conditions, vehicle state, and location accuracy). This partial action approach provides sufficient contextual information to users while minimizing data transmission time and bandwidth requirements.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If the system uses multiple sensors for accurate tracking, then measurement precision improves, but the device complexity and energy consumption increase

Engineering Contradiction:
Improvevehicle location and state measurement accuracyVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges multiple sensor types (cameras, GPS, LIDAR, radar) into an integrated sensing system that shares processing resources and data pipelines. By combining these sensors under a unified processing framework, the system achieves high measurement precision for vehicle location and state while reducing overall system complexity compared to separate independent sensor systems. The merged system efficiently shares computational resources and data processing loads.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The sensor system is designed with multi-functionality where each sensor serves multiple purposes. For example, camera data is used both for visual context and for verifying vehicle state, while GPS provides both location tracking and movement pattern analysis. This universal approach allows accurate multi-parameter measurement using a relatively compact sensor suite, reducing device complexity while maintaining high measurement precision across multiple dimensions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11645629B2Real-time visualization of autonomous vehicle behavior in mobile applications
Publication Date: 2023.05.09 GM CRUISE HOLDINGS LLC
  • US11645629B2 patent drawing
  • US11645629B2 patent drawing
  • US11645629B2 patent drawing

AI summary

Technologies for providing real-time visualizations of a behavior of an autonomous vehicle (AV) associated with a ride request. In some examples, a method for providing real-time visualizations of a behavior of an AV associated with a ride request can include receiving a user request for a ride from an AV, wherein the user request specifies a pick-up location associated with a user; receiving sensor data from one or more sensors associated with the AV; determining, based on the sensor data, a state and context of the AV while the AV is en route to the pick-up location; and presenting, at a display interface, a map depicting one or more visual indicators of the state and context of the AV, the state and context of the AV including a location of the AV and one or more AV operations.