Lightfield Image Processing for Dynamic Focal Plane Adjustment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current holographic image technologies face challenges in maintaining a consistent and high-quality 3D perception across different perspectives, particularly in real-time applications such as teleconferencing, where focal plane adjustments are necessary to ensure clear communication and stable viewer experience.

Innovation Solution

The system processes a photoset of images from various perspectives to generate a lightfield image, utilizing feature detection and artificial intelligence to adjust the focal plane in real-time, allowing for accurate alignment and display of 3D images without the need for depth information, enabling real-time focal adjustments and enhanced viewer experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional holographic image technologies are used to generate 3D images, then depth information can be captured, but the focal plane cannot be adjusted dynamically and image quality degrades when perspectives change

Engineering Contradiction:
Improvefocal plane adjustment capabilityVSAvoidimage quality consistency
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent applies dynamics by enabling the focal plane to change dynamically based on detected subject features. The system processes images from multiple perspectives, detects subject features, and adjusts the focal plane in real-time to maintain subject focus across different viewing angles, transforming the static focal plane of traditional holographic systems into a dynamic one that adapts to content requirements

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements feedback by using detected subject features to inform focal plane adjustments. The system continuously analyzes images from the photoset, identifies subject features, and uses this information to determine optimal focal plane positions, creating a closed-loop system that maintains image quality consistency while enabling focal plane adaptability

Inventive Principle:
Principle #23Feedback

2Productivity

If depth information is used in traditional holographic processing, then 3D perception is achieved, but real-time focal plane adjustments are computationally complex and time-consuming

Engineering Contradiction:
Improvereal-time processing speedVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies taking out by extracting only the essential subject features from the images rather than processing complete depth information. By detecting and isolating key subject features, the system reduces the computational burden while maintaining the ability to perform real-time focal plane adjustments, effectively removing unnecessary processing complexity

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements partial action by performing focal plane adjustments based on subject feature detection rather than comprehensive depth map processing. This selective approach processes only the necessary portions of the image data required for focal plane determination, reducing overall processing complexity while maintaining real-time capability

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If multiple perspectives are captured to improve 3D perception, then lightfield information is enhanced, but aligning features across images becomes more difficult

Engineering Contradiction:
Improvefeature alignment accuracyVSAvoidimage processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by detecting subject features from the photoset before performing the alignment operation. By pre-identifying subject features across multiple perspectives, the system establishes reference points that guide the subsequent alignment process, making feature alignment more accurate and manageable despite the complexity of multiple perspectives

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11849102B2System and method for processing three dimensional images
Publication Date: 2023.12.19 LOOKING GLASS FACTORY INC
  • US11849102B2 patent drawing
  • US11849102B2 patent drawing
  • US11849102B2 patent drawing

AI summary

A system and method for lightfield communication can be configured to receive one or more images, determine one or more features in the one or more images, and generate a lightfield image from the one or more images where at least one of the one or more features is in a focal plane of the lightfield image.