Image Processing Device Synthesizing Visible and Infrared Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Automobile headlights with different irradiation directions and ranges (high beam and low beam) result in varying visual recognition and image quality, making it difficult to present a high-quality image of the field of vision while driving.

Innovation Solution

An image processing device that synthesizes visible light images and infrared ray images, where the visible light image is obtained in a second direction and the infrared ray image is obtained in a first direction with a larger irradiation range, to generate a color image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a high beam with a large irradiation range is used, then the visibility range is improved, but the image quality deteriorates due to noise and color differences

Engineering Contradiction:
Improveirradiation rangeVSAvoidimage quality
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent combines a high beam image capturing device with a low beam image capturing device into a single system. The high beam device provides wide coverage while the low beam device provides high-quality images in the overlapping region. The images are then synthesized to create a final image that has both wide coverage and high quality, resolving the contradiction between irradiation range and image quality.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent applies different image processing strategies to different regions of the field of view. In the region where both high beam and low beam illuminate, the system uses the high-quality low beam image. In regions only illuminated by the high beam, it uses the high beam image. This local quality approach allows the system to maximize both coverage and image quality in different areas simultaneously.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If a low beam with a narrow irradiation range is used, then the image quality is improved, but the visibility range deteriorates

Engineering Contradiction:
Improveimage qualityVSAvoidirradiation range
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The patent merges the functionality of separate high beam and low beam image capturing devices. The low beam device captures high-quality images in its narrow field of view, while the high beam device captures wider area images. By combining these devices and synthesizing their outputs, the system achieves both high image quality and wide visibility range, resolving the contradiction between image quality and irradiation range.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent extends the solution from a two-dimensional trade-off (image quality vs. irradiation range) to a three-dimensional solution by adding the temporal dimension through image synthesis. The system captures images from both devices simultaneously or in rapid succession, then synthesizes them into a single composite image that exhibits both high quality and wide coverage properties, effectively resolving the contradiction by operating in an expanded solution space.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Loss of information

If only visible light is used for imaging, then the color information is preserved, but the sensitivity and noise performance deteriorate

Engineering Contradiction:
Improvecolor informationVSAvoidsensitivity
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The patent combines visible light imaging capabilities with infrared imaging capabilities in a single system. The visible light channel preserves color information while the infrared channel provides enhanced sensitivity and low-noise performance. By merging these two imaging modalities and synthesizing their outputs, the system achieves both color preservation and high sensitivity, resolving the contradiction between color information retention and sensitivity.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11410337B2Image processing device, image processing method and mobile body
Publication Date: 2022.08.09 SONY GROUP CORP
  • US11410337B2 patent drawing
  • US11410337B2 patent drawing
  • US11410337B2 patent drawing

AI summary

There is provided an image processing device to which a visible light image and an infrared ray image are input, the visible light image having been obtained corresponding to irradiation of a visible light in a second direction, the infrared ray image having been obtained corresponding to irradiation of an infrared ray in a first direction, which is a direction having an irradiation range larger than an irradiation range of the second direction, and which synthesizes the infrared ray image and the visible light image to generate a color image.