Light Field Capture for Head-Mounted Displays

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Traditional surgical loupes are customized for individual users, limiting sharing and offering restricted magnification, narrow field of view, and shallow depth of field, with blind spots due to their bulky construction, and existing solutions for head-mounted displays are limited in image data rendering.

Innovation Solution

A light-field capture system comprising an array of cameras and a head-mounted display that processes and renders stereoscopic image data, allowing for enhanced mediated-reality visualization with features like non-planar focal planes, virtual cameras, and dynamic zoom, enabling improved visualization in surgical procedures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional surgical loupes are customized for individual users, then the image quality and comfort are improved, but the device cannot be shared among users and requires individual customization

Engineering Contradiction:

Improveimage qualityVSAvoiduser sharing capability

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent uses digital imaging sensors to capture optical images and creates digital copies that can be processed and displayed on multiple devices. The optical image from the surgical site is captured by an array of imaging devices, converted to digital form, and then can be shared across multiple head-mounted displays, eliminating the need for physical customization while maintaining image quality through digital processing

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical optical system of traditional loupes with a digital imaging and display system. Instead of using fixed optical lenses that require physical customization, the system uses digital sensors to capture images and electronic displays to present them, allowing for software-based adaptation to different users without physical customization

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If traditional loupes provide sharp image focus, then the image clarity is improved, but the depth of field becomes very shallow requiring frequent refocusing

Engineering Contradiction:

Improveimage clarityVSAvoiddepth of field

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The patent implements dynamic focus adjustment by capturing images at multiple focal planes using an array of imaging devices positioned at different distances. The system can dynamically shift focus between near and far planes by processing images from different sensors, providing a large depth of field while maintaining sharp focus through computational methods rather than fixed optical focus

Inventive Principle:

Principle #15Dynamics

3Measurement precision

If traditional surgical loupes are designed with magnification capability, then the visualization of small structures is improved, but the field of view becomes narrow and blind spots appear

Engineering Contradiction:

Improvevisualization detailVSAvoidfield of view

Core Design Contradiction:

Measurement precisionVSArea of stationary object

Solution Approach 1:

The patent divides the imaging function across multiple imaging devices arranged in an array, with each device capturing a portion of the surgical field. By combining images from multiple segmented views, the system achieves both magnification of specific areas and a comprehensive wide-field view without blind spots, as each device contributes to different regions of the overall image

Inventive Principle:

Principle #1Segmentation

4Strength

If traditional loupes are constructed with sufficient structural support, then the durability is improved, but the construction becomes bulky creating blind spots

Engineering Contradiction:

Improvestructural durabilityVSAvoiddevice size

Core Design Contradiction:

StrengthVSVolume of moving object

Solution Approach 1:

The patent uses thin-film display technologies and flexible circuit boards to create a head-mounted display that is extremely thin and lightweight. The display elements are constructed as thin films that can be mounted close to the user's eyes without requiring bulky structural support, eliminating blind spots while maintaining durability through the inherent strength of the thin-film construction

Inventive Principle:

Principle #30Flexible shells and thin films

Data Source

PatentUS12178403B2Light field capture and rendering for head-mounted displays

Publication Date: 2024.12.31 UNIV OF WASHINGTON

AI summary

Systems and methods for capturing and rendering light fields for head-mounted displays are disclosed. A mediated-reality visualization system includes a head-mounted display assembly comprising a frame configured to be mounted to a user's head and a display device coupled to the frame. An imaging assembly separate and spaced apart from the head-mounted display assembly is configured to capture light-field data. A computing device in communication with the imaging assembly and the display device is configured to receive light-field data from the imaging assembly and render one or more virtual cameras. Images from the one or more virtual cameras are presented to a user via the display device.