Depth Camera Projector Motion for Spatial Resolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D depth cameras face limitations in spatial resolution and minimal object size identification due to high energy consumption and the need for larger projectors and imagers, which increases size, cost, and power usage.

Innovation Solution

An apparatus with a projector performing controlled motion to project a light pattern on different scene portions at various time instances, coupled with an imaging device to generate pairs of images from different perspectives, and a processor to process these images for high-resolution depth image generation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional depth cameras use larger projectors and imagers to improve spatial resolution, then measurement precision improves, but device size and energy consumption increase

Engineering Contradiction:
Improvespatial resolutionVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent segments the scene into multiple depth ranges (near field, mid field, far field) and uses different imaging modes for each range. The imager operates in first imaging mode for far field objects and switches to second imaging mode for near field objects, allowing high-resolution depth measurement without requiring a uniformly large imager across all ranges.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs dynamic switching between different imaging modes based on the depth range of the target object. The system dynamically adjusts the imager's operating mode (first imaging mode for far field, second imaging mode for near field) and the projector's operation state, enabling adaptive resolution optimization without permanent hardware escalation.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If conventional depth cameras use larger projectors and imagers to identify smaller objects, then measurement precision improves, but device size increases

Engineering Contradiction:
Improveminimal object size identificationVSAvoiddevice size
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The patent divides the imaging space into different depth zones and applies specialized imaging techniques for each zone. The near field imaging mode uses optical magnification to resolve small objects in close proximity, while the far field mode handles distant objects, eliminating the need for a uniformly large imager sensor.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the optical parameters of the imager by switching between different imaging modes that have different focal lengths and magnification characteristics. The second imaging mode (for near field) uses optical magnification to enhance the ability to resolve small objects without increasing the physical size of the imager.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If conventional depth cameras operate continuously at high resolution, then measurement precision improves, but energy consumption increases

Engineering Contradiction:
Improvedepth image resolutionVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by stationary object

Solution Approach 1:

The patent implements periodic switching between different imaging modes based on the detected depth range of objects in the scene. Rather than operating continuously at maximum resolution, the system alternates between first imaging mode (lower power) and second imaging mode (higher resolution for near field), reducing overall energy consumption while maintaining precision when needed.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent dynamically changes the operational parameters of the imager and projector based on scene requirements. By adjusting the imager's imaging mode and the projector's operation state according to object depth and size, the system achieves high-resolution depth imaging only when necessary, thereby reducing average power consumption.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances depth image resolution and accuracy by reducing patch size, allowing for higher spatial resolution and independent depth measurements per pixel, while maintaining energy efficiency.

Implementation Method 1

a projector to perform a controlled steering, to project a light pattern on different portions of the scene at different time instances

Methodology Applied
Scientific EffectLight projection: Light

Implementation Method 2

an imaging device coupled with the projector, to generate pairs of images of the different portions of the scene in response to the projection of the light pattern on respective portions

Methodology Applied
Scientific EffectImage detection: Photography

Implementation Method 3

a processor coupled with the projector and the imaging device, to control the steering of the light pattern, and generate the depth image of the object in the scene, based at least in part on processing of the generated pairs of images

Methodology Applied
Scientific EffectDepth computation: Parallax

Data Source

PatentUS10609359B2Depth image provision apparatus and method
Publication Date: 2020.03.31 SONY GROUP CORP
  • US10609359B2 patent drawing
  • US10609359B2 patent drawing
  • US10609359B2 patent drawing

AI summary

Apparatuses, methods and storage media for providing a depth image of an object are described. In some embodiments, the apparatus may include a projector to perform a controlled motion, to project a light pattern on different portions of the scene at different time instances, and an imaging device coupled with the projector, to generate pairs of images (a first image of a pair from a first perspective, and a second image of the pair from a second perspective), of different portions of the scene in response to the projection of the light pattern on respective portions. The apparatus may include a processor coupled with the projector and the imaging device, to control the motion of the projector, and generate the depth image of the object in the scene, based on processing of the generated pairs of images of the portions of the scene. Other embodiments may be described and claimed.