Parallax Map Generation for Image Processing Effect Visualization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users find it difficult to recognize and select areas with significant image processing effects in images due to limitations in screen size, resolution, and environmental conditions, making it challenging to adjust image processing settings effectively.

Innovation Solution

An image processing apparatus and method that acquire and process multiple viewpoint images to calculate associated parallax information, determine the effect of image processing for each area, and output this information, allowing for easier recognition and selection of effective image processing settings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If image processing is performed to enhance main object and shade foreground/background, then image processing effect is improved, but it is difficult for users to recognize and select areas with large effects due to screen size and resolution limitations

Engineering Contradiction:
Improveimage processing effectVSAvoidrecognition of processing effect area
Core Design Contradiction:
Manufacturing precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent introduces a new dimension of representation by displaying parallax information separately from the original image. Instead of trying to show processing effects within the constrained 2D image area, the system creates a third dimensional layer of information through parallax maps and difference images that reveal processing effects in a different visual space, allowing users to see both the processed image and the effect distribution simultaneously.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent uses parallax information as an intermediary to make processing effects visible. By calculating and displaying parallax between multiple viewpoint images, the system creates a mediator that highlights areas with large processing effects. This intermediary representation (parallax map) serves as a bridge between the processed image and the user's perception of processing intensity, making invisible effects visible without altering the original image quality.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Difficulty of detecting and measuring

If screen size and resolution are increased to improve recognition of processing effects, then recognition ability is improved, but device complexity and cost increase

Engineering Contradiction:
Improverecognition of processing effectVSAvoidscreen requirements
Core Design Contradiction:
Difficulty of detecting and measuringVSDevice complexity

Solution Approach 1:

The patent creates simplified copies or representations of the processing effects through parallax maps and difference images. Instead of requiring the original high-resolution image to display subtle processing effects, the system generates a separate simplified visual representation (parallax map) that copies only the essential information about processing intensity and distribution, making it visible on standard screens without requiring increased resolution.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent applies visual transformation techniques where parallax information is represented through color or intensity variations in the parallax map. By encoding processing effect magnitude into visual properties like brightness or color intensity, the system makes processing effects immediately recognizable on standard displays without requiring higher screen resolution, as the effects are amplified into visible visual differences.

Inventive Principle:
Principle #32Color changes

3Manufacturing precision

If multiple viewpoint images are acquired and processed, then image processing capability is improved, but processing time and computational load increase

Engineering Contradiction:
Improveimage processing capabilityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent extracts only the essential parallax information from multiple viewpoint images rather than processing all image data. By taking out and isolating the parallax component (the difference between viewpoints) and using only this extracted information to generate the parallax map, the system reduces computational load while maintaining the ability to identify processing effects, avoiding the need to process complete high-resolution images for effect detection.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by calculating parallax only for specific purposes (generating the parallax map for effect visualization) rather than performing complete image processing on all viewpoint images. The system performs excessive action in the sense that it processes multiple viewpoints beyond what a single-image system would use, but only to the extent necessary for creating the parallax representation, stopping before full processing would occur, thus balancing capability with efficiency.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10582129B2Image processing apparatus, image processing method, program, and storage medium
Publication Date: 2020.03.03 CANON KK
  • US10582129B2 patent drawing
  • US10582129B2 patent drawing
  • US10582129B2 patent drawing

AI summary

An image processing apparatus is provided that includes an acquisition unit configured to acquire a plurality of viewpoint images having different viewpoint; a calculation unit configured to calculate associated information associated with parallax from the plurality of viewpoint images; an image processing unit configured to generate an output image by performing an image process on image data based on the plurality of viewpoint images; a setting unit configured to set the image process using the image processing unit; and a determination unit configured to acquire the associated information, determine an effect of the image process for each area in the output image, and output the determination result.