Single-Lens Camera Depth Extraction via Motion Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for determining depth information in portable devices require additional hardware, such as range finding equipment or multiple lenses, which are not suitable for compact, portable devices, and often necessitate significant spacing between lenses, making them impractical for use in portable imaging applications.
Innovation Solution
A method that captures two images with a single lens camera unit and uses motion sensor data to calculate depth information by identifying points of interest and assigning depth values to regions within the images, allowing for depth extraction without the need for range finding hardware or multiple lenses.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If range finding hardware is used to determine depth information, then depth measurement precision is improved, but device complexity and power consumption increase
Solution Approach 1:
The patent replaces mechanical/optical range finding hardware with a computational approach using a single-lens camera and motion sensor. Depth information is derived by analyzing the displacement of feature points between sequential images and correlating this with measured device motion, eliminating the need for specialized depth-sensing hardware while maintaining depth measurement capability
Solution Approach 2:
The patent introduces motion sensor data as an intermediary element that bridges the gap between 2D image data and 3D depth information. By using the motion sensor to measure device displacement and combining this with feature point tracking in sequential images, the system derives depth without direct hardware measurement
2Measurement precision
If multiple lenses are used for stereoscopic analysis, then depth information accuracy is improved, but device complexity and size increase
Solution Approach 1:
The patent segments the depth measurement task into two independent components: a single-lens camera for capturing sequential images and a motion sensor for measuring device displacement. This segmentation allows each component to be optimized independently and avoids the complexity of multi-lens systems while achieving the same functional goal of depth extraction
Solution Approach 2:
The patent transitions from spatial separation (multiple lenses at different positions) to temporal separation (sequential images over time) combined with motion measurement. By capturing images at different times and measuring device motion between captures, the system achieves stereoscopic-like depth information using a single lens position
3Measurement precision
If multiple lenses spaced apart are used, then depth extraction capability is improved, but device volume and compactness are worsened
Solution Approach 1:
The patent merges the functions of multiple lenses into a single-lens system by combining image capture with motion sensing. The single lens captures sequential images while the motion sensor provides displacement data, and their combined information is processed to extract depth, reducing the device volume required compared to multi-lens configurations
Data Source
AI summary
Systems and methods are disclosed for extracting depth information for an image by identifying a point of interest appearing in at least two images, calculating depth information for the point of interest by evaluating positions of the point of interest within the images with a change in position of the portable device, defining an image region based on a shared characteristic and assigning the depth information calculated for the point of interest to the defined region.