Image Capture Apparatus with Multi-Unit Pixels for Stereoscopic Parallax

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing stereoscopic image capture systems cannot generate and display images with a parallax direction that matches the user's eyes, leading to ineffective stereoscopic image appreciation when the image rotation angle does not align with the intended parallax direction.

Innovation Solution

An image capture apparatus with a solid state image sensor featuring a plurality of photo-electric conversion units and a recording unit that assigns identification information to each unit pixel, allowing for the generation and display of stereoscopic images with adjustable parallax direction independent of display orientation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If stereoscopic images are captured using conventional digital image capture apparatuses with fixed parallax direction, then the image capture structure is simple, but the adaptability to different display orientations is poor

Engineering Contradiction:
Improveadaptability to different display orientationsVSAvoidimage capture structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The image sensor is divided into multiple independent photoelectric conversion units (first, second, third, and fourth units) within each pixel, allowing selective reading of signals from different units to generate parallax images in different directions. This segmentation enables the system to capture stereoscopic images adaptable to various display orientations without requiring physically reconfigurable hardware.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically selects which photoelectric conversion units to read based on the desired parallax direction and display orientation. By controlling the reading operation to selectively access different photoelectric conversion units, the system can adapt to different display orientations (landscape, portrait, rotated angles) without physical reconfiguration, making the parallax direction flexible and dynamic rather than fixed.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If multiple photoelectric conversion units are added per pixel to enable multi-directional parallax capture, then the adaptability improves, but the device complexity increases

Engineering Contradiction:
Improveparallax direction flexibilityVSAvoidphotoelectric conversion unit structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Each photoelectric conversion unit within a pixel serves multiple functions depending on which units are activated. The same set of four photoelectric conversion units can generate parallax in horizontal directions (first and second units) or vertical directions (third and fourth units), or combinations thereof. This multi-functionality reduces the need for additional specialized components for each parallax direction.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system changes the operational parameters by selectively enabling different photoelectric conversion units based on the desired output. Rather than adding complex mechanical switching or physical reconfiguration mechanisms, the patent uses parameter changes in the electronic reading operation to achieve different parallax directions from the same physical structure.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If fixed parallax direction is used in conventional systems, then the device complexity is low, but the ease of operation for different display orientations is poor

Engineering Contradiction:
Improveoperation for different display orientationsVSAvoidsignal processing system
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system performs preliminary action by capturing all necessary photoelectric conversion signals simultaneously during a single exposure. All four photoelectric conversion units in each pixel are read during the same reading operation, storing the data for later processing. This preliminary capture of all possible parallax information simplifies subsequent operations, as the system only needs to selectively process already-captured data rather than physically reconfigure for different orientations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates multiple copies of image data from different photoelectric conversion units that can be processed independently for different parallax directions. The signal processing apparatus generates multiple sets of stereoscopic image data from the same captured frame, allowing flexible assignment to different display orientations without requiring additional physical capture operations.

Inventive Principle:
Principle #26Copying

4Adaptability or versatility

If selective reading of photoelectric conversion units is implemented, then the adaptability to parallax direction improves, but the loss of information increases due to selective data capture

Engineering Contradiction:
Improveparallax direction controlVSAvoidcaptured image signals
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system performs preliminary action by capturing and storing signals from all photoelectric conversion units simultaneously during the image reading operation. Rather than selectively capturing only the needed data (which would cause information loss), all data from first, second, third, and fourth photoelectric conversion units are read and stored in the image buffer memory during a single exposure, preserving complete information for later flexible processing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The captured data from all photoelectric conversion units serves multiple purposes. The same set of captured signals can be processed to generate parallax in horizontal directions, vertical directions, or any combination, depending on the display orientation requirements. This multi-functionality of the captured data set eliminates information loss, as all possible parallax information is preserved in the original capture.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the generation and display of stereoscopic images with a parallax direction suited to user appreciation, regardless of the image rotation angle, by selectively grouping and processing captured image signals from the image capture apparatus.

Implementation Method 1

image capture unit having a plurality of unit pixels each comprising a plurality of photo-electric conversion units per condenser unit

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS9800861B2Image capture apparatus and image signal processing apparatus
Publication Date: 2017.10.24 CANON KK
  • US9800861B2 patent drawing
  • US9800861B2 patent drawing
  • US9800861B2 patent drawing

AI summary

An image capture apparatus includes an image capture unit that has a plurality of unit pixels each including a plurality of photo-electric conversion units per condenser unit, and a recording unit that records captured image signals, which are captured by the image capture unit and are respectively read out from the plurality of photo-electric conversion units, and the recording unit records identification information which allows to identify each photo-electric conversion unit used to obtain the captured image signal in association with that captured image signal.