3D Model Generation Using Non-Synchronized Camera Frames
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods require time-synced camera systems to capture video images from two perspectives for generating 3D models, which are expensive and complex, limiting accessibility to more widely available technologies like camera phones.
Innovation Solution
An image processing method that identifies matching frame pairs in videos captured by non-time-synced cameras by determining the offset threshold, using 3D calibration and epipolar geometry to synchronize frames without the need for precise time synchronization, allowing the generation of 3D models using widely accessible cameras.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If time-synced camera systems are used to capture video images from two perspectives, then the quality and accuracy of 3D model generation is improved, but the device complexity and cost increase significantly
Solution Approach 1:
The patent replaces the mechanical/time-based synchronization system with a computational approach using epipolar geometry and frame matching algorithms. Instead of relying on hardware time-sync mechanisms, the system uses image processing and geometric constraints to identify corresponding frames from unsynchronized cameras, thereby reducing hardware complexity while maintaining 3D reconstruction accuracy.
Solution Approach 2:
The patent changes the parameter of frame selection from time-based indexing to geometry-based matching. By using epipolar lines and spatial constraints as matching criteria instead of temporal synchronization parameters, the system enables 3D model generation from cameras with different frame rates and capture times, reducing the need for complex time-synchronization hardware.
2Measurement precision
If time-synced camera systems are used to capture video images from two perspectives, then the quality and accuracy of 3D model generation is improved, but the cost of the system increases
Solution Approach 1:
The patent enables the use of inexpensive, widely-available camera phones instead of expensive specialized time-synced camera systems. By relying on computational frame matching rather than expensive hardware synchronization, the invention makes 3D model generation accessible using disposable or commonly-owned devices like smartphone cameras.
3Device complexity
If non-time-synced cameras are used to capture video images, then the device complexity and cost are reduced, but the ability to generate accurate 3D models deteriorates
Solution Approach 1:
The patent introduces epipolar geometry and frame matching algorithms as an intermediary computational layer between the unsynchronized camera inputs and the 3D model generation process. This intermediary system analyzes spatial constraints and geometric relationships in the captured frames to identify corresponding points and reconstruct 3D geometry, bridging the gap caused by lack of temporal synchronization.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An image processing method comprising: obtaining a first sequence of images of a moving point in a scene captured from a first perspective; obtaining a second sequence of images of the moving point in the scene captured from a second perspective; determining, from an image of the first sequence, a constraint on a position of the moving point in the scene at a capture time of the image; determining, in each of a plurality of images of the second sequence, an extent to which the constraint on the position of the moving point in the scene is satisfied; and determining the capture time of one of the plurality of images of the second sequence as corresponding to the capture time of the image of the first sequence depending on the extent to which the constraint in each of the plurality of images of the second sequence is satisfied.