In-layer Signal Processing for Light Field Capture

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing electronic displays and cameras are limited in accurately capturing and displaying the full photonic environment, lacking integration and efficiency in recreating light fields, leading to bulky and uncomfortable devices with high complexity, cost, and power requirements.

Innovation Solution

An electronic display assembly with a sensor array, electronic display array, and logic unit layer on a circuit board, performing in-layer signal processing to directly capture and display light fields, utilizing microlens layers and plenoptic cells for accurate light field capture and display, and enabling flexible, 3D-shaped configurations for comfortable wear.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If separate camera and display systems are used to capture and reproduce light fields, then functional completeness is achieved, but device complexity and bulk increase

Engineering Contradiction:

Improvelight field capture and display capabilityVSAvoidsystem integration complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines the camera sensor array and display array into a single integrated electronic system on one circuit board. The sensor array captures light field data which is processed by logic units and directly displayed on the integrated display array, eliminating the need for separate camera and display devices. This merging reduces overall system complexity while maintaining full light field capture and reproduction functionality.

Inventive Principle:

Principle #5Merging (Combining)

2Adaptability or versatility

If traditional image processing and transformation are used to map sensor pixels to display pixels, then image adaptation is achieved, but processing complexity and power consumption increase

Engineering Contradiction:

Improveimage transformation capabilityVSAvoidpower consumption

Core Design Contradiction:

Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent divides the processing system into distributed logic units, with each logic unit handling signal processing for a specific region or set of pixels. This segmentation allows parallel processing of image data across multiple logic units, reducing the computational burden on any single unit and enabling more efficient power utilization while maintaining full image transformation capability.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces logic units as intermediary components between the sensor array and display array. These logic units receive signals from sensors, perform necessary image processing and transformations, and output processed signals to the display. This intermediary layer simplifies the overall processing architecture by breaking down complex transformations into manageable stages, reducing power consumption while maintaining adaptability.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Measurement precision

If high-resolution sensor arrays are used to capture detailed light fields, then measurement precision is improved, but data transmission bottlenecks and processing load increase

Engineering Contradiction:

Improvelight field capture resolutionVSAvoiddata processing efficiency

Core Design Contradiction:

Measurement precisionVSProductivity

Solution Approach 1:

The patent segments the high-resolution sensor array into multiple regions, with each region's data processed by dedicated logic units. This segmentation prevents data transmission bottlenecks by distributing the processing load across multiple parallel processing paths, maintaining measurement precision while improving overall data processing efficiency and throughput.

Inventive Principle:

Principle #1Segmentation

4Measurement precision

If bulky devices are used to ensure accurate light field capture and display, then measurement precision is maintained, but user comfort and portability deteriorate

Engineering Contradiction:

Improvelight field accuracyVSAvoiddevice weight

Core Design Contradiction:

Measurement precisionVSWeight of moving object

Solution Approach 1:

The patent merges the camera and display functions into a single lightweight integrated device, eliminating the need for bulky separate components. This integration maintains accurate light field capture and display capabilities while significantly reducing device weight and improving user comfort for portable applications.

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS11146781B2In-layer signal processing

Publication Date: 2021.10.12 LOCKHEED MARTIN CORP

AI summary

In one embodiment, an electronic display assembly includes a sensor array located on one side of a circuit board, an electronic display array located on an opposite side of the circuit board from the sensor array, and a logic unit layer coupled to one side of the circuit board. The logic unit layer is configured to receive first signals from the sensor array, perform at least one operation on the received first signals to create second signals, and transmit the second signals to the electronic display array. The first signals are communicated using a particular signal protocol and correspond to light captured by sensor pixels of the sensor array. The second signals are communicated using the particular signal protocol of the first signals and are operable to instruct the electronic display array to display light corresponding to the light captured by the plurality of sensor pixels.