3D Scene Projection for Autonomous Vehicle Sensor Verification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for verifying object detection and classification systems in autonomous vehicles are expensive, time-consuming, and limited to specific test scenarios, requiring physical setups that are not efficient for comprehensive performance evaluation.

Innovation Solution

A projection system that projects pre-captured three-dimensional scenes onto a surface in front of the vehicle, allowing the vehicle's controller to verify the object detection and classification routine by comparing generated results with expected outcomes, and adjusting for projection distortion to ensure accurate depth and location detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If physical scenes are used to test object detection systems, then verification accuracy is improved, but cost and time consumption increase

Engineering Contradiction:
Improveverification accuracyVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent uses virtual 3D scenes projected onto surfaces as copies of real-world scenarios to test object detection systems. Instead of physically setting up actual test environments with vehicles, pedestrians, and obstacles, the system projects synthesized 3D scenes that replicate various driving conditions, allowing comprehensive testing without the time and resource costs of physical setups.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces mechanical physical test setups with a projection-based virtual testing system. By substituting physical objects with projected 3D visual scenes, the system eliminates the need for cumbersome physical arrangements while maintaining verification accuracy through realistic visual simulations of various objects and scenarios.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If physical scenes are used to test object detection systems, then comprehensive test coverage is improved, but cost increases

Engineering Contradiction:
Improvetest scenario coverageVSAvoidtesting cost
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The projection system serves multiple testing functions using a single apparatus. The same projector can display various 3D scenes representing different objects, environments, and conditions, making the testing system universal and adaptable to multiple test scenarios without requiring separate physical setups for each scenario, thereby reducing overall testing costs.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

Virtual 3D scene projections serve as cost-effective copies of diverse real-world test scenarios. The system can project representations of various objects, weather conditions, lighting scenarios, and environmental conditions without the high costs associated with creating and maintaining physical versions of each scenario.

Inventive Principle:
Principle #26Copying

3Device complexity

If projection distortion is not corrected, then system complexity is reduced, but measurement precision deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoiddepth and location detection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system incorporates feedback mechanisms to detect and correct projection distortion. By monitoring the projected 3D scenes and identifying distortion patterns, the system automatically adjusts projection parameters or applies computational corrections to maintain accurate depth and location measurements, ensuring measurement precision without requiring overly complex hardware modifications.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11972612B2Techniques to automatically verify object detection, classification, and depth for automated driving systems
Publication Date: 2024.04.30 FCA US LLC
  • US11972612B2 patent drawing
  • US11972612B2 patent drawing
  • US11972612B2 patent drawing

AI summary

An object detection and classification verification system for a vehicle includes a projection system configured to project a three-dimensional (3D) scene pre-captured at a known distance and comprising at least one known object onto a surface in front of the vehicle a controller configured to verify a performance of an object detection and classification routine by performing the object detection and classification routine on the projected 3D scene to generate a set of results, comparing the set of results to a set of expected results associated with the projected 3D scene, and based on the comparing, determining whether the performance of the object detection and classification routine satisfies a predetermined threshold metric.