Image Generation Device Using Reciprocal Deformation Maps

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for imparting a transparent material perception to images, such as those of solids, are limited and often misrepresent the material as a fluid due to a lack of linear movement components in the image deformation process, leading to inaccurate perception by observers.

Innovation Solution

The use of three-dimensional deformation maps with reciprocal movement components is introduced, where horizontal and vertical deformation maps are applied to a target image to create a dynamically deformed image sequence that includes continuous linear movement, effectively simulating the perception of a solid transparent material.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If dynamic image deformation processing is applied to impart transparent material perception, then fluid-like transparent material perception can be achieved, but solid transparent material perception cannot be accurately represented

Engineering Contradiction:
Improvetransparent material perceptionVSAvoidmaterial perception accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent applies dynamic image deformation processing that evolves deformation maps over time to simulate the dynamic behavior of transparent materials. The deformation maps are updated frame-by-frame to create temporal coherence, allowing the system to adaptively represent both fluid and solid transparent materials through time-varying transformations rather than static deformation alone

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameters of the deformation maps by introducing reciprocal movement components that alternate between horizontal and vertical directions. This parameter variation enables the system to distinguish between fluid-like behavior (continuous deformation) and solid-like behavior (reciprocal movement patterns), thereby improving material perception accuracy

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If simple image processing is used to deform images, then ease of operation is improved, but the ability to accurately represent solid transparent materials deteriorates

Engineering Contradiction:
Improveimage processing simplicityVSAvoidmaterial perception accuracy
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent segments the deformation process into separate horizontal and vertical deformation maps that can be independently processed and then combined. This segmentation allows simple image processing operations to be applied to each component separately while achieving complex reciprocal movement patterns when combined, thus maintaining ease of operation without sacrificing material representation accuracy

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds a temporal dimension to the deformation maps, evolving them over multiple frames to create reciprocal movement patterns. By incorporating time as an additional dimension, the system can represent solid transparent materials through temporal coherence and reciprocal movement, while still using relatively simple frame-by-frame processing operations

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11514636B2Image generation device, image generation method, and program
Publication Date: 2022.11.29 NIPPON TELEGRAPH & TELEPHONE CORP
  • US11514636B2 patent drawing
  • US11514636B2 patent drawing
  • US11514636B2 patent drawing

AI summary

A visual perception of an arbitrary transparent material is imparted to an arbitrary image. In accordance with each element of each deformation map included in a sequence of deformation maps that correspond to a time series, each element of a target image is moved to obtain each deformed image of the time series. Each element of each of the deformation maps indicates a movement direction and a movement amount of each pixel of the target image corresponding to the element. Each deformation map included in a sequence of deformation maps corresponding to a first time interval in the time series corresponds to each of two-dimensional arrays obtained by moving, in a first direction, elements of two-dimensional arrays corresponding to immediately-previous deformation maps, and each deformation map included in a sequence of deformation maps corresponding to a second time interval in the time series corresponds to each of two-dimensional arrays obtained by moving, in a second direction, elements of two-dimensional arrays corresponding to immediately-previous deformation maps. Here, the first direction and the second direction differ from one another.