Dynamic Depth Map Sampling Based on Scene Motion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current depth map generation in electronic devices is time-consuming and often down-sampled, leading to inaccuracies due to loss of scene details, which can result in abnormalities in image/video data, especially when real-time performance is required.

Innovation Solution

A method that dynamically adjusts the sampling of a depth map based on detected motion in a scene by synchronizing frames from multiple cameras, determining the rate of motion, and calculating a target resolution and frame rate to generate a real-time depth map, optimizing it for the current scene conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If down-sampling is applied to achieve real-time depth map generation, then processing speed is improved, but measurement precision deteriorates due to loss of scene details

Engineering Contradiction:
Improveprocessing speedVSAvoiddepth map accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies dynamic sampling adjustment based on scene motion characteristics. The system transitions from static fixed down-sampling to dynamic adaptive sampling that adjusts resolution and sampling rate according to detected motion in the scene, allowing real-time optimization between processing speed and measurement precision

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes sampling parameters (resolution and frame rate) dynamically based on motion detection results. When motion is detected, the system adjusts the sampling rate and resolution parameters to balance real-time performance requirements with the need to maintain scene details for accurate depth mapping

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If fixed down-sampling ratio is used, then device complexity is reduced, but adaptability deteriorates because it cannot adjust to different scene conditions

Engineering Contradiction:
Improvesampling configuration complexityVSAvoidscene condition adaptability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The system replaces fixed sampling configuration with dynamic adaptive sampling that automatically adjusts based on scene motion characteristics, enabling the depth map generation system to adapt to different scene conditions without increasing manual configuration complexity

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses motion detection feedback to automatically adjust sampling parameters. By continuously monitoring scene motion and using this feedback to modify sampling rate and resolution, the system achieves adaptability while maintaining automated operation

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10609355B2Dynamically adjusting sampling of a real-time depth map
Publication Date: 2020.03.31 MOTOROLA MOBILITY LLC
  • US10609355B2 patent drawing
  • US10609355B2 patent drawing
  • US10609355B2 patent drawing

AI summary

A method, a system, and a computer program product for dynamically adjusting sampling of a depth map based on detected motion in a current scene. The method includes capturing real-time scan data at a first resolution by a first camera and a second camera of an image capturing device. The method further includes synchronizing a first plurality of frames of the real-time scan data to create a plurality of synchronized frames at a first frame rate. The method further includes analyzing the synchronized frames to determine whether motion exists. The method further includes, in response to determining motion exists: determining, based on the plurality of synchronized frames, a rate of motion within the current scene; and dynamically calculating a target resolution and a target frame rate for a real-time depth map. The method further includes generating a real-time depth map at the target resolution and target frame rate.