Lightfield Capture via Distributed Camera Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current lightfield camera systems face significant delays in processing and displaying imagery due to high computational and bandwidth requirements, making real-time capture and viewing of lightfield data impossible, which hinders their usability in applications like filming and webcam functionality.

Innovation Solution

A distributed computing system that processes images locally at camera computing systems and generates lightfield frames in real or near-real time, reducing data size and transmission bandwidth, allowing for immediate quality assessment and enabling real-time capture and display of lightfield frames.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If lightfield camera arrays capture imagery from multiple camera positions, then the quality and completeness of lightfield data is improved, but the processing time and computational requirements increase significantly

Engineering Contradiction:
Improvelightfield data qualityVSAvoidprocessing delay
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent divides the lightfield camera array into multiple independent camera units, each capturing imagery from its own position. Each camera processes and encodes its captured data independently, then transmits only the encoded result to a central reconstruction system. This segmentation allows parallel processing of multiple camera feeds simultaneously, reducing overall processing time while maintaining complete lightfield data quality.

Inventive Principle:
Principle #1Segmentation

2Power

If high-end computers are used to process lightfield data, then processing capability is improved, but the time required to transfer and process data remains significant

Engineering Contradiction:
Improveprocessing capabilityVSAvoiddata transfer and processing time
Core Design Contradiction:
PowerVSLoss of time

Solution Approach 1:

The patent applies preliminary encoding and compression to the imagery data captured by each camera before transmission to the central reconstruction system. By pre-processing the data at the camera level (including encoding and reducing data size), the system minimizes the amount of data that needs to be transferred and processed centrally, significantly reducing data transfer time and overall processing delay even when using high-end computers.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If synchronized video files are recorded locally at each camera, then data capture completeness is improved, but bandwidth requirements for transferring image data increase significantly

Engineering Contradiction:
Improvedata capture completenessVSAvoidbandwidth requirements
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The patent extracts and removes redundant information from the captured video feeds through encoding and compression algorithms applied at each camera unit. By taking out only the essential encoded data rather than transmitting complete synchronized video files, the system maintains data capture completeness for lightfield reconstruction while dramatically reducing the bandwidth requirements for transferring image data from multiple cameras to the central system.

Inventive Principle:
Principle #2Taking out (Extraction)

4Productivity

If real-time processing is implemented, then usability for filming and webcam applications is improved, but computational complexity and resource requirements increase

Engineering Contradiction:
Improvereal-time capture capabilityVSAvoidcomputational complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the computational workload by distributing encoding tasks across multiple independent camera units rather than requiring one centralized system to process all data. Each camera performs its own encoding and prepares data for transmission, enabling parallel real-time processing. This segmentation reduces the computational complexity burden on any single device while maintaining real-time capture capability for filming and webcam applications.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11256214B2System and method for lightfield capture
Publication Date: 2022.02.22 LOOKING GLASS FACTORY INC
  • US11256214B2 patent drawing
  • US11256214B2 patent drawing
  • US11256214B2 patent drawing

AI summary

A system for generating holographic images or videos comprising a camera array, a plurality of processors, and a central computing system. A method for generating holographic images can include receiving a set of images and processing the images.