Parallax Image Color Correction via Opening Mask Displacement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

When generating parallax images using a single image capturing system, color imbalances occur due to differences in the incident angle of subject light flux on each pixel of the image capturing element, leading to varying tones in the parallax images.

Innovation Solution

An image processing apparatus and method that includes an image data obtaining section to collect parallax image data from an image capturing element with color filters and opening masks, and a correcting section to address color imbalances based on the position of photoelectric conversion elements and opening mask displacements, ensuring accurate color representation across parallax images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If parallax images are generated using a single image capturing system with opening masks, then multiple parallax images can be obtained from one exposure, but color imbalance occurs due to different incident angles of light flux on each pixel

Engineering Contradiction:
Improvenumber of parallax images per exposureVSAvoidcolor consistency
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies local quality by making each pixel's opening mask individually adjustable in terms of opening displacement and opening direction. This allows each pixel to be optimized for its specific position in the image capturing element, compensating for position-dependent color imbalances while maintaining the ability to capture multiple parallax images from a single exposure.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes the parameters of the opening masks by allowing independent adjustment of opening displacement and opening direction for each pixel. This parameter optimization compensates for the incident angle differences caused by different pixel positions, thereby correcting color imbalance while preserving the multi-parallax image generation capability.

Inventive Principle:
Principle #35Parameter changes

2Loss of information

If opening masks are provided for all photoelectric conversion elements to generate parallax images, then parallax information is captured, but device complexity increases

Engineering Contradiction:
Improveparallax informationVSAvoidstructure complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent makes the opening masks universal by enabling them to serve multiple functions: capturing parallax information, enabling color balance correction, and supporting different viewing angles. The same opening mask structure is used across all pixels, but with individually optimized parameters, thereby reducing overall device complexity while maintaining information capture capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively corrects color imbalances in parallax images, enhancing their quality and consistency by accounting for the position and displacement of opening masks relative to photoelectric conversion elements, resulting in improved color fidelity and reduced distortion.

Implementation Method 1

color filters and opening masks so that one color filter and one opening mask correspond to one of at least a part of photoelectric conversion elements

Methodology Applied
Scientific EffectWavelength filtering: Filter (optical)

Implementation Method 2

photoelectric conversion elements that output the at least two pieces of parallax image data

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS9854224B2Image processing apparatus, image capturing apparatus, and image processing program
Publication Date: 2017.12.26 NIKON CORP
  • US9854224B2 patent drawing
  • US9854224B2 patent drawing
  • US9854224B2 patent drawing

AI summary

Images can be processed using an image processing apparatus including: an image data obtaining section that obtains at least two pieces of parallax image data from an image capturing element that includes color filters and opening masks so that one color filter and one opening mask correspond to one of at least a part of photoelectric conversion elements and outputs the at least two pieces of parallax image data; and a correcting section that corrects color imbalance of a corresponding pixel caused between the at least two pieces of parallax image data, based on at least one of a position of the at least a part of photoelectric conversion elements in the image capturing element and an opening displacement of the opening mask.