Camera-Radar Coordinate Alignment for Accurate Object Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies do not adequately improve the accuracy of recognizing target objects using a combination of cameras and millimeter-wave radars.

Innovation Solution

A system that transforms captured images and sensor data to align coordinate systems, allowing for improved object recognition and subsequent control of mobile objects based on the aligned data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If coordinate transformation is performed to align captured image and sensor image, then object recognition accuracy is improved, but processing complexity increases

Engineering Contradiction:
Improveobject recognition accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent performs coordinate transformation preliminarily to align the captured image and sensor image before object recognition processing. By pre-aligning the coordinate systems, the system eliminates the need for complex real-time transformation during recognition, thus improving accuracy while managing processing complexity through advance preparation.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If multiple sensors (camera and millimeter-wave radar) are used for target object recognition, then recognition accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvetarget object recognition accuracyVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges the data from multiple sensors (camera and millimeter-wave radar) by transforming them into a common coordinate system and performing integrated object recognition. This combination allows the system to leverage the complementary strengths of different sensors, improving target object recognition accuracy while managing system complexity through unified processing.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentEP3893194B1Information processing device, information processing method, program, mobile body control device, and mobile body
Publication Date: 2025.09.03 SONY SEMICON SOLUTIONS CORP
  • EP3893194B1 patent drawingFigure 1
  • EP3893194B1 patent drawingFigure 2
  • EP3893194B1 patent drawingFigure 3

AI summary

The present technology relates to an information processing apparatus, an information processing method, a program, a mobile-object control apparatus, and a mobile object that make it possible to improve the accuracy in recognizing a target object. An information processing apparatus includes a geometric transformation section that transforms at least one of a captured image or a sensor image to match coordinate systems of the captured image and the sensor image, the captured image being obtained by an image sensor, the sensor image indicating a sensing result of a sensor of which a sensing range at least partially overlaps a sensing range of the image sensor; and an object recognition section that performs processing of recognizing a target object on the basis of the captured image and sensor image of which the coordinate systems have been matched to each other. The present technology is applicable to, for example, a system used to recognize a target object around a vehicle.