Unsynchronized Rolling Shutter Cameras for Eyewear Motion Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing eyewear devices with synchronized rolling shutter cameras are unable to estimate velocity and gravity orientation effectively, as they require multiple stereo images to calculate these parameters.
Innovation Solution
The implementation of unsynchronized rolling shutter cameras in eyewear devices allows for the estimation of motion from a single stereo image pair, eliminating the need for additional images and enabling the calculation of velocity and gravity orientation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If synchronized rolling shutter cameras are used in eyewear devices, then the device can capture stereo images, but it cannot estimate velocity and gravity orientation effectively without multiple stereo images
Solution Approach 1:
The patent changes the synchronization parameter between the two rolling shutter cameras from synchronized to unsynchronized operation. This parameter change allows the system to estimate velocity and gravity orientation from a single stereo image pair by utilizing the temporal offset between the two cameras, eliminating the need for multiple stereo images while improving measurement precision for motion parameters
2Measurement precision
If multiple stereo images are used to calculate velocity and gravity orientation, then estimation accuracy improves, but processing time and computational requirements increase
Solution Approach 1:
By changing the operational parameter from synchronized to unsynchronized camera operation, the system can derive velocity and gravity orientation estimates from a single stereo image pair. This reduces the number of images that need to be processed, thereby decreasing processing time and computational requirements while maintaining estimation accuracy through the temporal information encoded in the unsynchronized rolling shutter capture mechanism
Data Source
AI summary
Eyewear having unsynchronized rolling shutter (RS) cameras such that images produced by each camera are unaligned, and a state that includes velocity and gravity orientation in the eyewear's reference system is calculated. The state is not limited to these two parameters as other parameters such as the acceleration bias, the gyroscope bias, or both may be included. Math solvers are used such that processing time to calculate the velocity and gravity orientation are acceptable. Arranging the RS cameras in an unsynchronized configuration allows estimating the motion of the eyewear from just one stereo image pair and removes the requirement of possessing more images.