Asynchronous Observation Matching for Connected Vehicle Localization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In connected vehicles, the latency issue arises when an ego vehicle attempts to utilize observation data from remote vehicles, as the data received is outdated, making it ineffective for real-time environment understanding due to the delay in wireless communication.

Innovation Solution

The system analyzes a set of vectors describing the movement of objects in a two-dimensional space to infer a three-dimensional flow, allowing the ego vehicle to estimate current observation data from remote vehicles before actual receipt, thereby mitigating latency by using hypergraphs and digital twin simulations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the ego vehicle uses wireless communication to receive observation data from remote vehicles, then the system can share environmental data among vehicles, but the data arrives with latency making it outdated for real-time decision making

Engineering Contradiction:
Improveobservation data freshnessVSAvoidcommunication latency
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system performs preliminary actions by predicting future observation data based on historical data and motion models before the actual data is received. The ego vehicle generates predicted observation data at time t2 using motion models and historical observation data from time t1, so that when the actual observation data arrives after latency, the system already has prepared data to proceed with localization and environment understanding.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If the system estimates observation data using motion models and historical data, then real-time processing is enabled without waiting for actual data receipt, but the complexity of data processing and computation increases

Engineering Contradiction:
Improvereal-time environment understanding speedVSAvoiddata processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system creates a copy of the observation data by generating predicted observation data that replicates the structure and format of actual observation data. This predicted data is constructed using motion models and historical data, creating a virtual copy that can be processed immediately without waiting for the actual observation data to arrive, thus maintaining real-time processing capability.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs preliminary computational actions by pre-processing historical observation data and constructing motion models before the current time step. This preliminary preparation allows the system to quickly generate predicted observation data without performing complex computations in real-time, reducing the computational burden during critical decision-making moments.

Inventive Principle:
Principle #10Preliminary action

3Loss of time

If the system uses predicted observation data to determine object locations, then localization can proceed without waiting for actual data, but the accuracy may be affected by prediction errors

Engineering Contradiction:
Improvedata receipt delayVSAvoidobject location accuracy
Core Design Contradiction:
Loss of timeVSMeasurement precision

Solution Approach 1:

The system implements feedback mechanisms where the predicted observation data is continuously refined and updated as actual observation data becomes available. The motion models are adjusted based on actual vehicle positions and observed object movements, creating a feedback loop that corrects prediction errors. This feedback ensures that even when using predicted data, the localization accuracy remains high as the system learns from actual observations and refines its predictions.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system dynamically changes parameters in the motion models and prediction algorithms based on current environmental conditions and vehicle states. When actual observation data is received, the system updates the motion model parameters to better match actual object behavior, thereby improving the accuracy of subsequent predictions. This adaptive parameter adjustment allows the system to maintain high localization accuracy despite using predicted data during latency periods.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11564116B2Asynchronous observation matching for object localization in connected vehicles
Publication Date: 2023.01.24 TOYOTA JIDOSHA KK
  • US11564116B2 patent drawing
  • US11564116B2 patent drawing
  • US11564116B2 patent drawing

AI summary

The disclosure includes embodiments for asynchronous observation matching for object localization in connected vehicles. A method includes receiving a wireless message from the remote connected vehicle. The wireless message includes first observation data recorded by the remote connected vehicle and describing sensor measurements of the remote connected vehicle at a first time but not a second time. The method includes analyzing a set of vectors describing how a known object moves within a two-dimensional space to determine a two-dimensional flow of the known object in the two-dimensional space during a timespan. The method includes analyzing the two-dimensional flow of the object to infer a three-dimensional flow of the object in a three-dimensional space during the timespan. The method includes estimating second observation data recoded by the remote connected vehicle at the second time so that the impact of the latency is modified.