Away-Facing Stereo Camera Scale Measurement for Monocular Vision
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Monocular vision in mobile devices suffers from scale ambiguity, making it difficult to accurately measure the metric scale of objects in images captured by front-facing cameras, which is crucial for extended reality applications.
Innovation Solution
Utilizing an away-facing stereo camera system on mobile devices to estimate relative pose information, enabling the calculation of absolute scale by capturing images from different positions and triangulating object features.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If monocular vision is used in mobile devices, then device complexity is reduced, but measurement precision of object scale deteriorates due to scale ambiguity
Solution Approach 1:
The patent introduces an away-facing stereo camera system as an intermediary to resolve the scale ambiguity of the front-facing monocular camera. The stereo camera captures images from different positions, and through triangulation of object features, it calculates absolute scale information that is then applied to enhance the monocular vision measurements.
2Measurement precision
If away-facing stereo camera system is used to determine object scale, then measurement precision improves, but device complexity increases
Solution Approach 1:
The away-facing camera system serves multiple functions: it captures stereo images for scale determination, provides spatial context for the monocular camera, and enables triangulation calculations. This multi-functionality justifies the added complexity by delivering comprehensive measurement capabilities across multiple applications.
3Measurement precision
If prior knowledge about the scene is used to determine scale, then measurement precision improves, but ease of operation deteriorates due to requirement of extra tools or assumptions
Solution Approach 1:
The system performs self-calibration and automatic scale determination using the stereo camera's intrinsic baseline information and automated triangulation algorithms. No manual input of prior knowledge, extra tools, or user assumptions are required - the system automatically captures stereo images and computes scale measurements through programmed processing.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Improves the accuracy and ease of use in determining the scale of objects, enhancing applications such as virtual try-on, 3D face modeling, and gaze tracking by providing true-scale measurements.
Implementation Method 1
capturing images from different positions and triangulating object features
Data Source
AI summary
Methods, systems, mobile devices, and non-transitory computer-readable mediums for determining a scale of an object with a mobile device. The mobile device includes at least one object-facing camera (e.g., a monocular camera) and an away-facing stereo camera system. Information captured using the away-facing stereo camera system is used to estimate relative pose information for determining the scale of the object in images captured by the object-facing camera. The proposed system leverages the scene images surrounding the mobile device to resolve scale ambiguity and calculate the absolute scale.