Plenoptic Camera Depth Control via Eye Accommodation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional cameras capture images focused at a specific depth, limiting user input in viewing or adjusting the depth of field, as users have no control over focusing on different planes of depth within a single image or video.

Innovation Solution

Incorporating a plenoptic camera with an embedded algorithm that uses the user's involuntary accommodation of the crystalline lens to adjust the focus, allowing automatic adjustment of the image's plane of depth without manual intervention, and utilizing multiple plenoptic cameras for long-range 3D imaging.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a conventional camera is used to capture images, then the image is focused at a specific depth, but the user has no control over viewing or adjusting different planes of depth

Engineering Contradiction:
Improveuser control over depth of fieldVSAvoidability to view different planes of depth
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The camera system is divided into multiple functional units: a plenoptic camera for capturing light field data, an accommodation sensor for detecting user focus intent, and a processor for generating refocused images. This segmentation allows each component to specialize in its function, enabling both ease of operation and adaptability

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements a feedback loop where the accommodation sensor continuously monitors the user's crystalline lens thickness to detect focusing intent, and this information is fed back to the processor which automatically adjusts the image focus accordingly. This closed-loop feedback enables intuitive user control without manual intervention

Inventive Principle:
Principle #23Feedback

2Extent of automation

If a plenoptic camera with embedded algorithm is used, then automatic adjustment of plane of depth is enabled, but the device complexity increases

Engineering Contradiction:
Improveautomatic focus adjustmentVSAvoidsystem structure
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The system performs self-service by automatically detecting user accommodation and adjusting image focus without requiring manual input. The accommodation sensor and processor work together to autonomously control the refocusing algorithm, eliminating the need for user interaction while maintaining simplicity of use

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The embedded algorithm acts as an intermediary between the plenoptic camera and the display, automatically processing the light field data and generating refocused images based on accommodation sensor input. This intermediary layer handles the complexity internally while presenting a simple interface to the user

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If multiple plenoptic cameras are used for long-range 3D imaging, then depth perception is enhanced, but the device complexity and size increase

Engineering Contradiction:
Improvedepth perception accuracyVSAvoidnumber of cameras
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Multiple plenoptic cameras are merged into a unified system with shared processing and display resources. The cameras work together to capture light field data from different viewpoints, and the processor integrates this data to generate enhanced 3D images with improved depth perception, achieving better measurement precision without proportionally increasing device complexity

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS9736461B2Method and apparatus for an attachable unit for a portable wireless system
Publication Date: 2017.08.15 LCTANK LLC
  • US9736461B2 patent drawing
  • US9736461B2 patent drawing
  • US9736461B2 patent drawing

AI summary

Plenoptic cameras and eye ports are separable units and can be attached to either the smart phone or to the eyeglasses by a mating surface. These separable units can be wireless coupled to a remote device, to a remote display, to other separable plenoptic cameras, or to other eyeglasses. The separable units can be mated to an eyeglass and positioned over the eye or eyes of the user. In addition, these separable cameras can be electrically wired through the mating device. The cameras can be separated and placed at various distances apart from one another to offer greater flexibility in analyzing the depth of images. These images from these cameras are shared within the system. The smart phone can be in wireless contact with a remote system. The remote system can be another server, the Internet, another smart phone, another camera system, or the camera mounted on the eyeglass.