Autonomous Vehicle Object Display with Missing Sensor Packet Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Riders in autonomous vehicles often experience anxiety due to a lack of understanding about how the vehicle perceives its environment, leading to incomplete and unsupplemented situational-awareness views.
Innovation Solution
The dynamic transportation matching system supplements autonomous-vehicle sensor data with secondary data such as user-generated data, map data, inertial and orientation data, and video data to provide a smooth and accurate representation of the external environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If autonomous vehicle sensor data is used alone to display situational awareness, then device complexity is reduced, but the completeness and accuracy of environmental representation deteriorates
Solution Approach 1:
The patent combines multiple data sources including autonomous vehicle sensor data, secondary data from external sources, and historical data to create a comprehensive situational awareness display. This merging of diverse data streams compensates for the limitations of individual sensors and provides a more complete environmental representation without requiring complex real-time processing of all data sources.
Solution Approach 2:
The system performs preliminary data collection and processing by gathering secondary data and historical information in advance, before the actual situational awareness display is needed. This allows the system to have pre-processed information available that supplements real-time sensor data, reducing the complexity of real-time processing while maintaining information completeness.
2Measurement precision
If multiple data sources are integrated to supplement sensor data, then situational awareness accuracy is improved, but device complexity increases
Solution Approach 1:
The patent applies different data sources and processing methods to different aspects of situational awareness based on their specific requirements. For example, real-time sensor data is used for immediate hazard detection, while historical data and secondary sources supplement background environmental context. This localized application of different data qualities optimizes accuracy for each specific function while managing overall system complexity.
3Loss of information
If comprehensive sensor data processing is performed, then situational awareness completeness is improved, but processing time increases
Solution Approach 1:
The system pre-processes and stores historical data and secondary information in advance, so that when situational awareness display is needed, this pre-prepared information can be quickly integrated with real-time sensor data. This eliminates the need for time-consuming processing of all data sources in real-time while maintaining comprehensive environmental representation.
Solution Approach 2:
The patent selectively processes and displays the most relevant data for current situational needs rather than processing all available data comprehensively. The system identifies and prioritizes critical environmental information for display, providing sufficient situational awareness without the computational burden of processing every available data point in real-time.
Data Source
AI summary
In one embodiment, a method includes receiving sensor data associated with an object external to a vehicle. The sensor data includes a sequence of data packets. Each data packet corresponds to a time frame in a sequence of time frames. The method includes determining a classification of the object based at least on the sensor data, determining that a particular data packet corresponding to a particular time frame in the sequence of time frames is corrupt or missing, generating a replacement data packet based on one or more data packets that correspond to one or more time frames adjacent to the particular time frame, generating a sequence of visual representations of the object corresponding to the sequence of time frames. At least one visual representation in the sequence of visual representations corresponding to the particular time frame is generated based on the replacement data packet.