Vehicle Object Detection Perception Model Training
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Autonomous vehicle object detection systems face challenges in achieving high accuracy and reliability due to oversensitivity and the inability to detect rare events, which can lead to accidents from missed or falsely detected objects.
Innovation Solution
A computer-implemented method and system that utilizes a user interface to visualize and annotate object detection scenes, allowing users to record adjusting events such as missing or falsely detected objects, generating datasets for training a neural network-based perception model to improve detection accuracy and sensitivity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If the object detecting system uses a perception model to detect objects in real-time driving scenes, then the detection speed and automation are improved, but the detection accuracy and reliability deteriorate due to oversensitivity and inability to detect rare events
Solution Approach 1:
The system implements a feedback mechanism where users can provide correction inputs for objects that are missed or falsely detected. The perception model uses this feedback to generate adjustment events and update its detection algorithms, continuously improving reliability based on real-world performance data.
Solution Approach 2:
The system performs preliminary detection using the perception model to identify potential objects in the driving scene. This preliminary action allows the system to pre-annotate detection results and prepare adjustment events before final confirmation, improving both speed and accuracy.
2Reliability
If the perception model detects all potential objects with high sensitivity, then the detection coverage is improved, but the false alarm rate increases leading to oversensitivity
Solution Approach 1:
The system dynamically adjusts detection sensitivity based on contextual information and confidence scores. The perception model can adapt its detection thresholds in real-time, increasing sensitivity for critical objects while maintaining lower sensitivity for ambiguous detections, thereby reducing false alarms while preserving detection coverage.
Solution Approach 2:
The system applies different detection criteria and sensitivity levels to different types of objects and different regions of the driving scene. Critical objects such as pedestrians or vehicles receive higher sensitivity and more rigorous verification, while less critical elements use lower sensitivity thresholds.
3Measurement precision
If the system annotates objects in real-time driving scenes, then the detection accuracy is improved, but the time required for annotation and training increases
Solution Approach 1:
The perception model performs self-annotation by automatically generating detection results and confidence scores for objects in the driving scene. This self-service capability eliminates the need for manual annotation of every detection case, significantly reducing time investment while maintaining high accuracy through automated confidence-based filtering.
Solution Approach 2:
The system performs full annotation only for detections that fall below a confidence threshold or are identified as adjustment events. High-confidence detections are accepted without additional annotation, applying partial annotation effort only where necessary to improve accuracy.
4Reliability
If the object detecting system monitors all objects in the driving scene continuously, then the detection completeness is improved, but the computational complexity and device complexity increase
Solution Approach 1:
The detection system segments the driving scene into multiple regions of interest and processes each region with appropriate detection algorithms. This segmentation allows the system to maintain high detection completeness in critical areas while reducing computational complexity in less critical areas.
Solution Approach 2:
The perception model serves multiple functions: real-time object detection, confidence scoring, adjustment event generation, and training data annotation. This multi-functionality reduces the need for separate specialized systems, thereby managing device complexity while maintaining detection completeness.
Data Source
Figure 1
Figure 2~3
Figure 4a~4b
AI summary
The disclosure relates to a computer-implemented method for training and/or operating an object detecting system (100) for a vehicle (500) and an object detecting system (100) for a vehicle. The method comprises the steps of visualizing (20) a first image or video scene (1511) in a first frame (151) of a user interface (150), converting (30) the first image or video scene (1511) to a second image or video scene (1521) for generating an annotation prompt (155) of the object (800) based on a perception model (185) of a perception module (180), visualizing (40) the second image or video scene (1521) and/or the annotation prompt, determining (60) an adjusting event for triggering and/or modifying the annotation prompt (155), and recording (70) the adjusting event by triggering and/or modifying the annotation prompt in the first frame and/or the second frame by the user.