Multi-Viewpoint Image Processing for Parallax Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional stereo image-capturing apparatuses require capturing left-eye and right-eye images in color, which complicates the process and may not efficiently produce high-definition parallax images due to the need for precise alignment and correlation of pixel values from different viewpoints.

Innovation Solution

An image processing apparatus and method that extracts pixel values from color image data corresponding to multiple viewpoints and calculates new pixel values to maintain correlation with the differences between pixel values from different viewpoints, allowing for the production of high-definition parallax images by interpolating and combining data from multiple viewpoints.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If pixel values from multiple viewpoints are captured in color using conventional stereo image-capturing apparatuses, then color images can be obtained, but the process becomes complicated and manufacturing precision deteriorates due to the need for precise alignment and correlation of pixel values from different viewpoints

Engineering Contradiction:
Improvealignment precisionVSAvoidprocess complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the necessary pixel values (specific color components from specific viewpoints) needed for generating the parallax image, rather than processing all color data from all viewpoints. This extraction approach simplifies the data processing while maintaining the essential information needed for accurate alignment and correlation.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the parameter selection by choosing specific pixel values (e.g., R component from one viewpoint, G and B components from other viewpoints) rather than processing all color components uniformly. This selective parameter approach reduces computational complexity while preserving the correlation needed for precise alignment.

Inventive Principle:
Principle #35Parameter changes

2Loss of information

If pixel values from multiple viewpoints are captured in color, then color information is obtained, but productivity deteriorates due to the complex processing required to maintain correlation between different viewpoints

Engineering Contradiction:
Improvecolor informationVSAvoidprocessing efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent extracts only the essential color information needed for parallax image generation by selecting specific pixel values from different viewpoints. This selective extraction maintains color information while significantly reducing the processing burden compared to handling all color data from all viewpoints.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by processing only a subset of available color data (specific components from specific viewpoints) rather than all color information. This partial processing approach maintains sufficient color information for quality parallax images while improving processing efficiency.

Inventive Principle:
Principle #16Partial or excessive action

3Loss of information

If all color components are processed from multiple viewpoints, then complete color information is obtained, but device complexity increases due to the need for precise correlation of all pixel values

Engineering Contradiction:
Improvecolor information completenessVSAvoidprocessing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent extracts the minimum necessary color information (specific components from specific viewpoints) required to generate high-quality parallax images. This extraction strategy maintains color information completeness for the intended application while avoiding the complexity of processing all color components from all viewpoints.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies different processing strategies to different color components and viewpoints based on their specific contributions to the final image quality. By treating each component locally according to its importance, the system maintains necessary color information while reducing overall processing complexity.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9727985B2Image processing apparatus, image-capturing apparatus, and storage medium having image processing program stored thereon
Publication Date: 2017.08.08 NIKON CORP
  • US9727985B2 patent drawing
  • US9727985B2 patent drawing
  • US9727985B2 patent drawing

AI summary

A technique is disclosed to calculate a new pixel value of a particular color of second-viewpoint color image data in such a manner that a difference between the new pixel value of the particular color of the second viewpoint and the pixel value of the particular color of the first-viewpoint color image data maintains correlation with a sum of a difference between the pixel value of a first color component of the second-viewpoint color image data and the pixel value of the first color component of third-viewpoint color image data and a difference between the pixel value of a second color component of the second-viewpoint color image data and the pixel value of the second color component of the third-viewpoint color image data.