Holographic Sensor-Projector with Feedback Loop for Interactive 3D

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for producing and displaying 3D holographic images are limited in their ability to create interactive and dynamic virtual environments where real objects can effectively engage with pre-recorded holographic interferograms, lacking a seamless feedback mechanism to interpret and respond to user interactions.

Innovation Solution

A system combining an image sensor, coherent light source, and LCD modulator to create, record, and reproduce free-standing 3D holographic images, where a pre-recorded hologram interacts with a real object, using a feedback loop to record and compare interferograms to trigger commands based on user input, such as interacting with a virtual keyboard.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional holographic recording methods are used, then 3D holographic images can be produced, but the system lacks interactive capability and feedback mechanisms to interpret user interactions

Engineering Contradiction:
Improveinteractive capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a feedback mechanism where the camera captures light scattered from the holographic interferogram, converts it to digital signals, and compares it with reference signals to generate control outputs that adjust the LCD modulator in real-time, enabling interactive capability

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system integrates multiple functions into a unified platform: the camera serves as both recording and sensing device, the LCD modulator functions as both hologram display and interactive interface, and the processing unit handles both holographic generation and interaction detection, reducing overall system complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If a feedback loop with computational processing is added to decode user interactions, then interactive responses are enabled, but computational effort and processing complexity increase

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidcomputational complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces complex computational decoding with optical computation: the holographic interferogram itself performs the computational task of encoding interaction information in the scattered light pattern, which is then directly captured and converted to control signals with minimal processing

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If real-time interaction detection is implemented, then dynamic responses to user inputs are achieved, but processing time and response latency increase

Engineering Contradiction:
Improvereal-time response capabilityVSAvoidprocessing latency
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system maintains continuous operation where the camera continuously captures scattered light, the processing unit continuously converts and compares signals, and the LCD modulator continuously adjusts based on feedback, eliminating idle time and reducing latency through uninterrupted processing

Inventive Principle:
Principle #20Continuity of useful action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the creation of immersive and interactive 3D holographic environments where user interactions can be decoded with minimal computational effort, allowing for dynamic responses to real-time inputs, enhancing the engagement with virtual objects.

Implementation Method 1

an array of pixels in the image sensor control transmission of light through a corresponding array of pixels in an LCD modulator

Methodology Applied
Scientific EffectElectro-optic modulation: Electro-Optic Effects

Implementation Method 2

Each pixel receives light from the coherent light source and light scattered from the object

Methodology Applied
Scientific EffectCoherent light interference: Interference

Implementation Method 3

light scattered from the object

Methodology Applied
Scientific EffectLight scattering: Scattering

Data Source

PatentUS8690339B2Complete digital holographic image sensor-projector computing unit having a modulator for receiving a fourier image
Publication Date: 2014.04.08 APTINA IMAGING CORP
  • US8690339B2 patent drawing
  • US8690339B2 patent drawing
  • US8690339B2 patent drawing

AI summary

A hologram projecting system includes a coherent light source for emitting a reference beam onto a real object; and an image sensor for receiving the reference beam and a scattered beam reflected from the real object, and recording a Fourier image of the real object. Also included is a modulator for receiving the Fourier image. The reference beam is passed through the modulator, and configured to interact with the Fourier image to form a virtual image of the real object. The image sensor includes an n×m pixel array, where n and m are numbers of rows and columns, respectively. The modulator includes an n×m pixel array corresponding to the n×m pixel array of the image sensor. The pixels in the n×m pixel array of the image sensor control transmissivity of light in corresponding pixels of the n×m pixel array of the modulator.