Light Field Image Processing for Destination-Specific Focus

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In light field camera technology, determining the correct focal distance for displaying refocused images is challenging, especially when multiple subjects are photographed, leading to blurred images upon transmission if the default focal distance is set based on the main object.

Innovation Solution

An image processing apparatus that detects objects in light field data, sets a focal distance based on photographing information, and updates it according to the destination's object information, ensuring the correct focal distance is used for refocusing and transmission.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the focal distance of the main object is determined as the default focal distance, then the main object is in focus, but other objects at different focal distances become blurred

Engineering Contradiction:
Improvefocus accuracyVSAvoidadaptability to different transmission destinations
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system performs preliminary detection of multiple objects and their respective focal distances during the image capture phase. It stores this object information (including focal distances of multiple objects) in advance, so that when light field data is transmitted to different destinations, the appropriate focal distance can be quickly retrieved and applied without requiring real-time adjustment or re-capture.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The default focal distance is made dynamic rather than fixed. The system automatically adjusts the default focal distance based on the transmission destination by detecting which object corresponds to the destination user and setting that object's focal distance as the default. This dynamic adaptation ensures the received image is always in focus for the intended recipient.

Inventive Principle:
Principle #15Dynamics

2Loss of information

If light field data with multiple objects at different focal distances is transmitted, then comprehensive scene information is preserved, but the received image may be blurred if the wrong focal distance is used

Engineering Contradiction:
Improvescene information completenessVSAvoidimage quality at destination
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The system incorporates feedback mechanisms where the transmission destination provides information about the intended recipient or target object. The transmitting device uses this feedback to identify which object's focal distance should be applied, ensuring the refocused image matches the destination's expectations and maintains high quality.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system changes the focal distance parameter dynamically based on transmission context. By detecting objects and their focal distances, then selecting and applying the appropriate focal distance parameter according to destination information, the system ensures reliable image quality while preserving complete scene information in the light field data.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If object detection and focal distance adjustment is performed for each transmission destination, then image quality is maintained, but processing complexity increases

Engineering Contradiction:
Improveimage quality consistencyVSAvoidprocessing system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

Object detection and focal distance measurement are performed in advance during image capture, and results are stored with the light field data. This preliminary processing creates a ready-to-use database of object information that can be quickly queried during transmission without requiring complex real-time processing at the destination.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates copies of object information (detected objects, their positions, and focal distances) and stores them as metadata with the light field data. This copying approach allows the destination to efficiently retrieve and apply the appropriate focal distance without needing to re-detect objects or perform complex analysis, thereby maintaining image quality while reducing processing complexity.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS9742981B2Image processing apparatus, image processing method and program, and image pickup apparatus for processing light field data
Publication Date: 2017.08.22 CANON KK
  • US9742981B2 patent drawing
  • US9742981B2 patent drawing
  • US9742981B2 patent drawing

AI summary

An image processing apparatus authenticates whether the same person as a person as a destination of transmission is photographed in light field data as an object, and when the person is photographed as the object, sets a focal distance of an object image of the person as the destination of transmission as a focal distance to be used for refocusing the light field data.