Adjustable Focus Camera System for Multi-User Telepresence Depth-of-Field Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing 3D telepresence technologies face challenges in generating high-quality, realistic images for multiple users due to depth-of-field issues in fixed-focus cameras and limitations of autofocus cameras, which result in low-quality images and inability to serve multiple users gazing at different optical depths.

Innovation Solution

A system and method utilizing a pair of cameras with adjustable optical focus and extended depth-of-field (EDOF) corrections, where a server receives optical depth information from users and adjusts camera focus to capture and correct images for each user, allowing multiple users to view high-quality, immersive images simultaneously.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If fixed-focus cameras are used for image capturing, then device complexity is reduced, but image quality deteriorates due to depth-of-field issues

Engineering Contradiction:
Improvecamera system complexityVSAvoidimage quality
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent employs autofocus cameras with adjustable optical focus instead of fixed-focus cameras, allowing the focusing distance range to be dynamically changed according to different optical depths. This enables the system to capture sharp images at various depths by adjusting the focal plane, thereby improving image quality while maintaining reasonable device complexity.

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If autofocus cameras are used to capture sharp images, then image quality improves, but the ability to serve multiple users gazing at different optical depths deteriorates

Engineering Contradiction:
Improveimage sharpnessVSAvoidmulti-user support capability
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent divides the field of view into multiple depth regions and captures images at different optical depths separately. By segmenting the depth space and capturing multiple images at different focal planes, the system can then process and combine these images to provide sharp views for multiple users gazing at different optical depths simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the optical focus parameter of the camera to capture images at different optical depths. By adjusting the focal length and focusing distance according to the desired optical depth, the system captures multiple images with different depth of field characteristics, which are then processed to serve multiple users with different gaze directions.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If focal length is increased to provide greater resolution, then image resolution improves, but depth of field decreases

Engineering Contradiction:
Improveimage resolutionVSAvoiddepth of field
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent captures multiple images at different optical depths before processing. By preliminarily capturing images at various focal planes with appropriate depth of field, the system ensures that sufficient information is available for subsequent processing to achieve both high resolution and adequate depth of field in the final composite image.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enables the generation of high-quality, immersive images for multiple users by adjusting camera focus and applying EDOF corrections, overcoming previous limitations and providing realistic images for users at different optical depths.

Implementation Method 1

each of the left camera and the right camera having an adjustable optical focus

Methodology Applied
Scientific EffectOptical focus adjustment: Lens

Implementation Method 2

Images of a real-world environment are sharply captured by a given fixed-focus camera only for a specific focal plane

Methodology Applied
Scientific EffectDepth of field: Depth of Field

Data Source

PatentUS12010442B1Systems and methods incorporating adjustable focus and extended depth-of-field correction
Publication Date: 2024.06.11 VARJO TECH OY
  • US12010442B1 patent drawing
  • US12010442B1 patent drawing
  • US12010442B1 patent drawing

AI summary

A system including server(s) configured to: receive, from N client devices, information indicating optical depths at which N users are gazing; send, to imaging device including left camera and right camera, information indicating N optical depths; and in each cycle of N consecutive pairs of left images and right images, for M ranging from 1 to N: receive Mth left image captured by focusing left camera at Mth optical depth; select such image for user(s) gazing within focusing range; generate extended depth-of-field (EDOF)-corrected Mth left images; receive Mth right image captured by focusing right camera according to another optical depth; select such image for other user(s) gazing within another focusing range; generate EDOF-corrected Mth right images; and send Mth left image, EDOF-corrected Mth left images, Mth right image, EDOF-corrected Mth right images to client device(s) of user(s), users other than user(s), other user(s), users other than other user(s), respectively.