Data-to-Camera Filters for V2X Object Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Real-time object detection for vehicles faces challenges in balancing speed and accuracy, leading to potential safety hazards due to errors in object recognition, which can cause or prevent accidents while driving.

Innovation Solution

A method utilizing vehicle-to-everything (V2X) messages and data-to-camera (D2C) filters, generated in real-time using AI, to enhance object detection by providing modified images to Advanced Driver Assistance Systems (ADAS) with accurate location, size, and type of objects, reducing or eliminating driving hazards.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If real-time object detection is performed using traditional methods, then the system can process images, but the detection accuracy is insufficient leading to safety hazards

Engineering Contradiction:
Improveobject detection accuracyVSAvoidsafety reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent merges V2X communication data with camera image data to create a multi-source detection system. The V2X messages provide pre-detected object information (location, speed, heading) that is combined with visual data from cameras, creating a more reliable and accurate detection system that overcomes the limitations of single-sensor approaches

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces D2C filters as an intermediary processing layer between raw V2X data and the final detection output. These filters process and refine the object detection results by combining multiple data sources and applying computational logic to generate more accurate and reliable detection information

Inventive Principle:
Principle #24Intermediary (Mediator)

2Speed

If traditional object detection methods are used, then the system can operate, but the processing speed is too slow for real-time safety decisions

Engineering Contradiction:
Improveobject detection speedVSAvoidsafety reliability
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The patent utilizes V2X messages that contain pre-processed object detection information from other vehicles and infrastructure. This preliminary detection work is done by external systems, allowing the ego vehicle to receive ready-made detection data that reduces processing time and enables faster response for safety-critical decisions

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If D2C filters are generated and applied to image data, then object detection accuracy is improved, but the system complexity increases

Engineering Contradiction:
Improveobject detection precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent changes the parameters and format of detection data by generating D2C filters that transform raw V2X message data into a format optimized for camera image processing. This parameter transformation enables more precise detection by adapting external data to match the specific requirements of visual processing systems

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11113969B2Data-to-camera (D2C) based filters for improved object detection in images based on vehicle-to-everything communication
Publication Date: 2021.09.07 TOYOTA JIDOSHA KK
  • US11113969B2 patent drawing
  • US11113969B2 patent drawing
  • US11113969B2 patent drawing

AI summary

The disclosure describes a method for an ego vehicle. The method includes receiving a vehicle-to-everything (V2X) message that describes an object that is within proximity of an ego vehicle. The method further includes generating a set of data-to-camera (D2C) filters that are specific to the object described by the V2X message. The method further includes applying the set of D2C filters to image data that describes an initial image of the object. The method further includes generating a modified image, based on applying the set of D2C filters to the image data, wherein the modified image includes an indication of (1) a location and a size of the object in the initial image and (2) a type of object in the initial image.