Holographic Communication System Reducing Bandwidth via Lightfield Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies face challenges in efficiently capturing and displaying real-time three-dimensional images due to high bandwidth and processing requirements, often resulting in visual artifacts such as shadows and loss of information.

Innovation Solution

A communication system comprising a display subsystem and an image capture subsystem that generates and displays lightfield images by determining user parameters, segmenting views, and transmitting only necessary views, reducing processing power and bandwidth needs, while avoiding visual artifacts through a set of images representation rather than mesh or 3D models.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If three-dimensional images are captured and displayed in real-time, then image realism and user experience are improved, but bandwidth and processing requirements increase prohibitively

Engineering Contradiction:
Improveimage realismVSAvoidbandwidth requirements
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent segments the 3D image data into multiple two-dimensional image layers representing different focal depths. Instead of transmitting the entire light field data set, only the relevant 2D layers corresponding to the user's viewing distance are captured, processed, and transmitted. This segmentation reduces the data volume from prohibitively large 3D light field data to manageable 2D image layers while preserving the essential depth information for realistic display.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts only the necessary visual information required for real-time display by capturing multiple 2D images at different focal distances and selecting only those relevant to the current viewing conditions. This extraction process removes redundant data while retaining the critical depth and focus information needed for realistic 3D perception, thereby reducing bandwidth requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

2Manufacturing precision

If complete light field data is transmitted, then image quality is improved, but processing power and transmission bandwidth increase prohibitively

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing power
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent divides the complete light field data into segmented 2D image layers, each representing a specific focal plane. This segmentation allows the system to process and transmit only the necessary image layers rather than the entire light field data set, significantly reducing processing complexity while maintaining image quality for the relevant viewing distances.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by capturing and processing images at multiple focal distances with varying levels of detail. Images at different depths are processed with appropriate quality levels based on their relevance to the user's viewing position, optimizing the balance between image quality and processing requirements by focusing computational resources on the most visually important regions.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If high-resolution three-dimensional images are displayed, then visual realism is improved, but data transmission bandwidth and storage requirements increase prohibitively

Engineering Contradiction:
Improvevisual realismVSAvoiddata transmission bandwidth
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent segments high-resolution 3D visual information into multiple lower-resolution 2D image layers at different focal planes. Each layer contains essential visual information for a specific depth range, allowing the system to transmit multiple manageable 2D images instead of a single prohibitively large 3D data set, thereby maintaining visual realism while reducing bandwidth requirements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from three-dimensional light field data representation to two-dimensional image layer representation. By projecting the 3D information onto multiple 2D planes at different focal distances, the system reduces the data dimensionality and corresponding bandwidth requirements while preserving the essential depth and focus information needed for realistic visual perception through multi-planar display.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11415935B2System and method for holographic communication
Publication Date: 2022.08.16 LOOKING GLASS FACTORY INC
  • US11415935B2 patent drawing
  • US11415935B2 patent drawing
  • US11415935B2 patent drawing

AI summary

A holographic communication system and method can include: determining a user parameter for one or more users, generating a set of views based on the user parameter, and displaying the set of generated views.