Shiftable Optical Path Camera for Stable TOF Depth Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Camera devices equipped with Time of Flight (TOF) functionality face challenges in accurately extracting vein patterns due to hand shaking when operated single-handedly, requiring high-resolution and stable depth map extraction for biometric authentication.

Innovation Solution

A camera device with a light output unit, lens unit, image sensor, and image processing unit that utilizes a combination of shifting optical paths controlled by separate driving units for Super Resolution (SR) and Optical Image Stabilization (OIS) functions, including IR filters and liquid lenses, to achieve high-resolution and stable depth map extraction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If TOF method is used for vein pattern extraction, then depth map can be obtained, but hand shaking causes instability in close-distance photography

Engineering Contradiction:
Improvedepth map extraction accuracyVSAvoidphotography stability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent implements a dual driving unit system where the first driving unit dynamically shifts the optical path in a first direction to perform super resolution, while the second driving unit simultaneously shifts the optical path in a second direction perpendicular to the first to perform optical image stabilization. This dynamic dual-directional control compensates for hand shaking while maintaining depth map extraction accuracy

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent divides the optical path shifting function into two independent driving units: the first driving unit dedicated to super resolution by shifting in the first direction, and the second driving unit dedicated to optical image stabilization by shifting in the second direction. This segmentation allows each unit to independently optimize its function without interfering with the other

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If high resolution depth map extraction is performed, then biometric authentication accuracy improves, but device complexity increases due to multiple driving units

Engineering Contradiction:
Improvevein pattern extraction accuracyVSAvoidoptical system structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes the optical path shifter multi-functional by enabling it to perform both super resolution (first direction shifting) and optical image stabilization (second direction shifting) through two driving units. This universality allows a single optical component to serve multiple purposes, reducing the need for separate dedicated components and thereby managing device complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The device can simultaneously perform SR and OIS functions, resulting in high-quality and high-resolution depth map extraction, effectively mitigating hand shaking issues and enhancing biometric authentication accuracy.

Implementation Method 1

a light output unit that outputs an output light signal to be irradiated to an object

Methodology Applied
Scientific EffectLight modulation:

Implementation Method 2

a lens unit that condenses an input light signal reflected from the object

Methodology Applied
Scientific EffectOptical focusing: Lens

Implementation Method 3

an image sensor that generates an electric signal from the input light signal condensed by the lens unit

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Implementation Method 4

an image processing unit that extracts a depth information of the object using at least one of a time difference and a phase difference between the output light signal and the input light signal

Methodology Applied
Scientific EffectTime of flight measurement: Time of Flight

Implementation Method 5

a liquid lens disposed on the plurality of solid lenses, or disposed between the plurality of solid lenses

Methodology Applied
Scientific EffectVariable curvature lens: Lens

Data Source

PatentUS11528416B2Camera device having shiftable optical path
Publication Date: 2022.12.13 LG INNOTEK CO LTD
  • US11528416B2 patent drawing
  • US11528416B2 patent drawing
  • US11528416B2 patent drawing

AI summary

A camera device according to an embodiment of the present invention includes a light output unit that outputs an output light signal to be irradiated to an object, a lens unit that condenses an input light signal reflected from the object, an image sensor that generates an electric signal from the input light signal condensed by the lens unit and an image processing unit that extracts a depth map of the object using at least one of a time difference and a phase difference between the output light signal and the input light signal received by the image sensor, the lens unit including IR (InfraRed) filter, a plurality of solid lenses disposed on the IR filter and a liquid lens disposed on the plurality of solid lenses, or disposed between the plurality of solid lenses, the camera device further including a first driving unit that controls shifting of the IR filter or the image sensor and a second driving unit that controls a curvature of the liquid lens, an optical path of the input light signal being repeatedly shifted according to a predetermined rule by one of the first driving unit and the second driving unit, and the optical path of the input light signal being shifted according to predetermined control information by the other one of the first driving unit and the second driving unit.