Surround Vehicle Tracking With Sensor Fusion and Motion Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Autonomous vehicles face challenges in accurately tracking and predicting the motion of surrounding vehicles, especially in complex traffic scenarios, due to sensor noise and the need for robust and long-term tracking for safe navigation and obstacle avoidance.
Innovation Solution
A computer-implemented method and system for surround multi-object tracking and motion prediction that fuses data from various sensors, including cameras and LiDAR, to generate accurate and robust object tracks, determine maneuver classes, and predict future trajectories using motion and probabilistic models, enabling effective navigation and obstacle avoidance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If data from multiple sensors is fused to improve tracking accuracy, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The patent combines data from multiple sensors (cameras, LiDAR, radar) to create a unified tracking system. The sensor fusion module integrates detections from different modalities to improve tracking accuracy and robustness, especially in challenging traffic scenarios where individual sensors may fail or produce noisy data.
Solution Approach 2:
The tracking system is designed to handle multiple sensor types and traffic scenarios through a universal framework. The motion prediction module uses maneuver classes that can be applied across different vehicle types and traffic conditions, making the system adaptable and versatile without requiring separate specialized systems for each scenario.
2Reliability
If long-term tracking is implemented to improve safety, then reliability is improved, but loss of time increases
Solution Approach 1:
The system performs preliminary motion prediction by generating multiple future trajectories and determining expected future positions of tracked vehicles. This allows the autonomous vehicle to plan ahead and prepare for potential obstacles before they become immediate threats, improving safety without excessive time loss through efficient parallel computation.
Solution Approach 2:
The tracking system dynamically adjusts its behavior based on traffic scenarios and object characteristics. The motion prediction module adapts prediction horizons and computational effort based on the maneuver class and situational context, maintaining reliability while optimizing time consumption through dynamic resource allocation.
3Reliability
If multiple future trajectories are predicted to improve safety, then reliability is improved, but computational power increases
Solution Approach 1:
The motion prediction process is segmented into distinct stages: generating multiple future trajectories based on motion models, classifying maneuver types, and selecting the most likely expected future trajectory. This segmentation allows the system to distribute computational effort across different modules, improving prediction reliability while managing computational power requirements through divided processing tasks.
Data Source
AI summary
A surround multi-object tracking and surround vehicle motion prediction framework is provided. A full-surround camera array and LiDAR sensor based approach provides for multi-object tracking for autonomous vehicles. The multi-object tracking incorporates a fusion scheme to handle object proposals from the different sensors within the calibrated camera array. A motion prediction framework leverages the instantaneous motion of vehicles, an understanding of motion patterns of freeway traffic, and the effect of inter-vehicle interactions. The motion prediction framework incorporates probabilistic modeling of surround vehicle trajectories. Additionally, subcategorizing trajectories based on maneuver classes leads to better modeling of motion patterns. A model takes into account interactions between surround vehicles for simultaneously predicting each of their motion.