Light Field Image Display with Refocusability Color Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional techniques for light field photography cannot distinguish between refocusable and non-refocusable still images, making it difficult for users to determine if an image can be refocused unless they specify the subject to be in focus.

Innovation Solution

An image display apparatus and method that acquires and displays image files containing reconstructable light field data, allowing users to differentiate between reconstructable and non-reconstructable image data by displaying them in distinct modes, using a control unit to inform users of the image file's refocusability and employing a microlens array with photoelectric converting elements for image capturing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional light field photography techniques are used to capture refocusable images, then the capability to refocus after capture is achieved, but the user cannot distinguish between refocusable and non-refocusable images without specifying a subject

Engineering Contradiction:
Improveinformation on refocusabilityVSAvoiduser identification of refocusable images
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent applies color changes by displaying refocusable images with a specific color tone (e.g., yellowish tint) and non-refocusable images with a different color tone (e.g., bluish tint). This visual differentiation through color allows users to immediately identify which images can be refocused without needing to specify subjects or access additional menus, directly resolving the contradiction between preserving refocusability information and ease of user identification.

Inventive Principle:
Principle #32Color changes

2Reliability

If multiple images are captured to ensure different subjects are in focus, then complete coverage of all subjects is achieved, but the number of captures and processing time increases

Engineering Contradiction:
Improvefocus coverage of all subjectsVSAvoidnumber of captures required
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies preliminary action by capturing a single light field image that contains information about multiple subjects at different depths, then performing refocus processing afterward to bring different subjects into focus. This eliminates the need to capture multiple images beforehand, as all the necessary light field data is captured in one shot and can be processed later to achieve focus on any subject within the scene.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If refocus processing is performed on all captured images, then the ability to refocus any subject is achieved, but the processing complexity and time increase

Engineering Contradiction:
Improverefocus capability on any subjectVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies self-service by having the system automatically determine whether captured images are refocusable based on their characteristics (e.g., whether they were captured with a light field camera), and automatically applying appropriate color tones to indicate refocusability. This automated classification and marking system eliminates the need for complex manual processing or user intervention to determine which images can be refocused, reducing processing complexity while maintaining versatility.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables users to easily identify refocusable images and display them accordingly, reducing the need for multiple captures and enhancing user interaction by clearly indicating which images can be refocused.

Implementation Method 1

a microlens array is placed behind a main lens and a camera array in which small cameras are arranged. With both image capturing apparatuses, multi-viewpoint image data obtained by capturing images of subjects in different directions can be obtained through one capture.

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS10382676B2Image display apparatus, image capturing apparatus, image display method, and storage medium
Publication Date: 2019.08.13 CANON KK
  • US10382676B2 patent drawing
  • US10382676B2 patent drawing
  • US10382676B2 patent drawing

AI summary

An image display apparatus includes an acquisition unit configured to acquire an image file that includes reconstructable image data that includes information corresponding to a light field, a display unit configured to display the image data included in the image file acquired by the acquisition unit as an image, and a control unit configured to control the display unit so as to display an image and perform display for informing a user that the image file corresponding to the image is a reconstructable image file.