Image Processing Apparatus for Realistic Material Feel Reproduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image processing technologies are limited in reproducing the tactile feel of materials in videos, failing to accurately simulate the visual experience of viewing a subject in real life, particularly in enhancing highlight areas and maintaining image quality.

Innovation Solution

An image processing apparatus and method that extracts and analyzes physical and environmental information from images to control the material feel by optimizing reflection characteristics, enhancing specular reflections, and performing shadow control, thereby recreating a more realistic visual experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If basic image quality parameters such as contrast and delicacy are increased, then image quality is improved, but the ability to reproduce the tactile feel of materials is limited

Engineering Contradiction:
Improveimage qualityVSAvoidmaterial feel reproduction
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent changes the parameters of image processing by introducing material-specific parameters such as specular reflection intensity, highlight area distribution, and shadow characteristics. These parameters are adjusted according to the type of material being reproduced (e.g., metal, plastic, fabric) to enhance the tactile feel beyond basic image quality adjustments.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies local quality by differentiating processing parameters for different regions of the image based on material characteristics. Specifically, highlight areas, specular reflection regions, and shadow areas are processed differently according to the material type, allowing realistic reproduction of material feel in specific local regions rather than uniform processing across the entire image.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If highlight areas are enhanced to reproduce material feel, then realism is improved, but image processing complexity increases

Engineering Contradiction:
Improvematerial feel reproductionVSAvoidimage processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the image processing into distinct functional modules: a material feel generation unit that creates material-specific parameters, a highlight area extraction unit that identifies highlight regions, and a composite image generation unit that combines these elements. This segmentation reduces overall processing complexity by dividing the task into manageable, specialized components.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary action by pre-generating material feel parameters for different material types before actual image processing. The material feel generation unit creates lookup tables or parameter sets for various materials (metal, plastic, fabric) in advance, so that during image processing, only parameter selection and application are needed rather than computing material characteristics from scratch.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3300016B1Device and method for processing image
Publication Date: 2021.06.30 SONY GROUP CORP
  • EP3300016B1 patent drawingFigure 1
  • EP3300016B1 patent drawingFigure 2
  • EP3300016B1 patent drawingFigure 3

AI summary

The present disclosure relates to an image processing apparatus and method capable of reproducing a material feel just like a real thing is there. A reflection characteristic estimation unit estimates and analyzes, from a supplied input image, a reflection characteristic of the subject as a characteristic of a subject. The reflection characteristic estimation unit supplies a specular reflection component as a reflection characteristic estimation result to a characteristic information integrating unit and a highlight area detection unit as an image estimation information. The highlight area detection unit performs highlight area detection in parallel to processing with the reflection characteristic estimation unit by using the specular reflection component as the reflection characteristic estimation result from the reflection characteristic estimation unit, and supplies the highlight area detection result to a characteristic information integrating unit as the image estimation information. The present disclosure is applicable to an image processing apparatus, for example.