Image Processing Apparatus for Thermal and Sound Field Enhancement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Visible light images lack reality as they fail to differentiate between subjects in varying temperature states, and existing technologies cannot enhance image reality based on temperature or sound field information.

Innovation Solution

An image processing apparatus and method that acquires state information such as temperature and sound field information to perform effect processes on visible light images, including superimposing effect component images and modifying images based on temperature and sound, to enhance image reality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If visible light imaging is performed to acquire images, then the imaging process is simple and fast, but the reality of the image is poor because temperature and other state information are not reflected

Engineering Contradiction:
Improveimage realityVSAvoidimaging process complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines visible light imaging and infrared imaging into a single imaging system that captures both types of images simultaneously. The visible light image provides structural information while the infrared image provides temperature information, and these are integrated to generate an enhanced image that reflects both visual appearance and thermal state, thereby improving image reality without requiring separate imaging processes.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent uses an image processing unit as an intermediary that fuses information from visible light and infrared images. This processing unit applies algorithms to combine the structural data from visible light imaging with temperature data from infrared imaging, creating a composite image that represents both visual and thermal characteristics of the subject.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If only visible light imaging is used, then the imaging apparatus is simple, but state information such as temperature is not indicated on the image

Engineering Contradiction:
Improvestate information representationVSAvoidimaging apparatus complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent merges visible light imaging and infrared imaging capabilities into a single imaging apparatus. The visible light image captures visual information while the infrared image captures temperature distribution, and both are processed together to generate an enhanced image that displays both visual appearance and temperature information, thereby preventing loss of state information.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The imaging apparatus is designed with multi-functionality, capable of performing both visible light imaging and infrared imaging using the same device structure. This universal apparatus can capture multiple types of information (visual and thermal) simultaneously, eliminating the need for separate specialized devices while comprehensively representing subject state information.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If existing technologies are used to adjust image parameters, then image quality is improved, but the reality of the image is not improved because the adjustment does not correlate with actual subject state

Engineering Contradiction:
Improveimage realityVSAvoidsubject state correlation accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent employs feedback by using infrared-captured temperature information to dynamically adjust the visible light image. The temperature data serves as feedback about the actual subject state, and this information is used to modify the visual image accordingly, ensuring that the processed image accurately reflects the real thermal and visual characteristics of the subject.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The image processing unit acts as an intermediary that correlates temperature information with visual information. It uses algorithms to match temperature regions from the infrared image with corresponding regions in the visible light image, ensuring accurate spatial correlation and creating a composite image where visual adjustments are precisely aligned with actual subject thermal states.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10853648B2Image processing apparatus and image processing method
Publication Date: 2020.12.01 SONY GROUP CORP
  • US10853648B2 patent drawing
  • US10853648B2 patent drawing
  • US10853648B2 patent drawing

AI summary

State information corresponding to a subject on a visible light image, such as temperature information and sound field information, is acquired from state information indicating a subject state not indicated on the visible light image by an information acquisition unit. An effect processing unit performs an effect process on the visible light image on the basis of the state information acquired by the information acquisition unit. In the effect process, an effect component image is superimposed or a subject image is modified based on the type and temperature of the subject and an effect component image is superimposed or a subject image is modified based on the type of a sound source and the volume of a sound.