Single Camera Depth Detection for Shadow-Free Projection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data input apparatuses that project an image for user input, such as keyboards, require multiple imaging means due to the need to reduce the shadow area of a user's hand, which is not feasible for devices with only one camera, like most laptops and cellular phones.

Innovation Solution

An information processing apparatus that includes an imaging unit, an image generation unit, and an image display unit, capable of generating a display image based on the distance between the imaging unit and an object by taking images at different focus distances, creating an image mask to prevent the display image from being projected on the user's hand, and optimizing the image mask to reduce extra projection and improve visibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If multiple imaging means are used to reduce shadow area, then visibility is improved, but device complexity increases

Engineering Contradiction:
ImprovevisibilityVSAvoiddevice complexity
Core Design Contradiction:
Illumination intensityVSDevice complexity

Solution Approach 1:

The patent transitions from using multiple cameras (spatial dimension) to using a single camera with multiple focus distances (depth dimension). By capturing images at different focal planes and synthesizing them, the system achieves comprehensive object detection without requiring multiple imaging devices, thus resolving the contradiction between visibility and device complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent changes the focus distance parameter of a single camera to capture images at multiple focal planes. This parameter variation allows the system to detect objects at different depths and synthesize a comprehensive view, replacing the need for multiple cameras while maintaining detection accuracy.

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If display image is projected on the plane of projection, then user input capability is improved, but power consumption increases due to unnecessary projection on user's hand

Engineering Contradiction:
Improveuser input capabilityVSAvoidpower consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The system uses feedback from depth information obtained through multi-focus image synthesis to dynamically control the projection. By detecting the user's hand position and depth, the system adjusts the projection to avoid the hand area, thereby reducing unnecessary power consumption while maintaining user input capability.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent applies local quality by selectively projecting the display image only in regions where it is needed (areas without the user's hand). The projection is adjusted based on local depth information, ensuring that power is consumed only for useful projection areas rather than uniformly across the entire projection plane.

Inventive Principle:
Principle #3Local quality

3Device complexity

If single camera is used, then device complexity is reduced, but ability to detect object configuration and reduce shadow area is worsened

Engineering Contradiction:
Improvedevice complexityVSAvoidobject configuration detection
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent compensates for the single camera limitation by utilizing the depth dimension through multiple focus distances. This allows the system to reconstruct three-dimensional object configuration information from two-dimensional images taken at different focal planes, maintaining measurement precision while using simpler hardware.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system performs preliminary image capture at multiple focus distances before synthesis. This preliminary action of capturing images at different focal planes provides the necessary depth information that enables accurate object configuration detection and shadow area reduction in the final synthesized image.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables efficient data input by preventing the display image from being projected on the user's hand, improving visibility and reducing power consumption, while being applicable to devices with a single camera.

Implementation Method 1

a distance detection unit configured to detect, based on a plurality of images taken by the imaging unit at a focus distance that is different for each imaging unit, a distance between an object and the imaging unit

Methodology Applied
Scientific EffectFocus distance variation: Focusing

Data Source

PatentUS9001034B2Information processing apparatus, program, and information processing method
Publication Date: 2015.04.07 SATURN LICENSING LLC
  • US9001034B2 patent drawing
  • US9001034B2 patent drawing
  • US9001034B2 patent drawing

AI summary

According to an illustrative embodiment, an information processing apparatus includes an imaging unit; and an image generation unit to generate a display image based on a distance between the imaging unit and an object, wherein the distance is detected by using a plurality of images obtained by the imaging unit at respective focus distances.