Vehicle Object Detection Perception Model Training

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicle object detection systems face challenges in achieving high accuracy and reliability due to oversensitivity and the inability to detect rare events, which can lead to accidents from missed or falsely detected objects.

Innovation Solution

A computer-implemented method and system that utilizes a user interface to visualize and annotate object detection scenes, allowing users to record adjusting events such as missing or falsely detected objects, generating datasets for training a neural network-based perception model to improve detection accuracy and sensitivity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If the object detecting system uses a perception model to detect objects in real-time driving scenes, then the detection speed and automation are improved, but the detection accuracy and reliability deteriorate due to oversensitivity and inability to detect rare events

Engineering Contradiction:
Improveautomated object detectionVSAvoiddetection reliability
Core Design Contradiction:
Extent of automationVSReliability

Solution Approach 1:

The system implements a feedback mechanism where users can provide correction inputs for objects that are missed or falsely detected. The perception model uses this feedback to generate adjustment events and update its detection algorithms, continuously improving reliability based on real-world performance data.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary detection using the perception model to identify potential objects in the driving scene. This preliminary action allows the system to pre-annotate detection results and prepare adjustment events before final confirmation, improving both speed and accuracy.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the perception model detects all potential objects with high sensitivity, then the detection coverage is improved, but the false alarm rate increases leading to oversensitivity

Engineering Contradiction:
Improvedetection coverageVSAvoidfalse alarms
Core Design Contradiction:
ReliabilityVSObject-generated harmful factors

Solution Approach 1:

The system dynamically adjusts detection sensitivity based on contextual information and confidence scores. The perception model can adapt its detection thresholds in real-time, increasing sensitivity for critical objects while maintaining lower sensitivity for ambiguous detections, thereby reducing false alarms while preserving detection coverage.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system applies different detection criteria and sensitivity levels to different types of objects and different regions of the driving scene. Critical objects such as pedestrians or vehicles receive higher sensitivity and more rigorous verification, while less critical elements use lower sensitivity thresholds.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If the system annotates objects in real-time driving scenes, then the detection accuracy is improved, but the time required for annotation and training increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidannotation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The perception model performs self-annotation by automatically generating detection results and confidence scores for objects in the driving scene. This self-service capability eliminates the need for manual annotation of every detection case, significantly reducing time investment while maintaining high accuracy through automated confidence-based filtering.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs full annotation only for detections that fall below a confidence threshold or are identified as adjustment events. High-confidence detections are accepted without additional annotation, applying partial annotation effort only where necessary to improve accuracy.

Inventive Principle:
Principle #16Partial or excessive action

4Reliability

If the object detecting system monitors all objects in the driving scene continuously, then the detection completeness is improved, but the computational complexity and device complexity increase

Engineering Contradiction:
Improvedetection completenessVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The detection system segments the driving scene into multiple regions of interest and processes each region with appropriate detection algorithms. This segmentation allows the system to maintain high detection completeness in critical areas while reducing computational complexity in less critical areas.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The perception model serves multiple functions: real-time object detection, confidence scoring, adjustment event generation, and training data annotation. This multi-functionality reduces the need for separate specialized systems, thereby managing device complexity while maintaining detection completeness.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP4407482A1Training and operating an object detecting system for a vehicle
Publication Date: 2024.07.31 VOLVO CAR CORP
  • EP4407482A1 patent drawingFigure 1
  • EP4407482A1 patent drawingFigure 2~3
  • EP4407482A1 patent drawingFigure 4a~4b

AI summary

The disclosure relates to a computer-implemented method for training and/or operating an object detecting system (100) for a vehicle (500) and an object detecting system (100) for a vehicle. The method comprises the steps of visualizing (20) a first image or video scene (1511) in a first frame (151) of a user interface (150), converting (30) the first image or video scene (1511) to a second image or video scene (1521) for generating an annotation prompt (155) of the object (800) based on a perception model (185) of a perception module (180), visualizing (40) the second image or video scene (1521) and/or the annotation prompt, determining (60) an adjusting event for triggering and/or modifying the annotation prompt (155), and recording (70) the adjusting event by triggering and/or modifying the annotation prompt in the first frame and/or the second frame by the user.