Foldable Camera Image Stitching via Bending Angle Lookup
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image stitching algorithms, especially real-time ones, face challenges in meeting low-delay requirements due to the time-consuming process of scanning feature points to locate overlapping regions, which hampers image stitching speed, particularly in foldable multi-lens products where the computing device is unaware of the product's bending degree.
Innovation Solution
An electronic device with a bendable base equipped with camera modules, a sensing module to detect physical bending information, and a processing module that estimates the bending angle to quickly locate overlapping regions using a look-up table, thereby reducing the time needed for image stitching.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If real-time image stitching algorithms scan complete feature points to locate overlapping regions, then image stitching accuracy is improved, but image stitching speed deteriorates due to time consumption
Solution Approach 1:
The system performs preliminary actions by pre-calculating and storing overlapping region information in a lookup table before actual image stitching is needed. This allows the system to avoid time-consuming complete feature point scanning during real-time operation, instead directly querying pre-computed overlapping information from the lookup table based on bending angle, thus resolving the contradiction between accuracy and speed.
Solution Approach 2:
The lookup table serves as an intermediary mechanism between the bending angle detection and the image stitching process. Instead of directly scanning all feature points, the system uses the bending angle as an intermediate parameter to index into the lookup table, which provides pre-computed overlapping region information. This intermediary approach significantly reduces processing time while maintaining stitching accuracy.
2Reliability
If off-line image stitching algorithms calculate overlapping regions without knowing the bending degree, then computational completeness is improved, but computing resource consumption increases
Solution Approach 1:
The system transitions from static off-line processing to dynamic real-time processing adapted to the actual bending state. By incorporating bending angle detection, the system dynamically adjusts the image stitching process to match the physical state of the foldable device, calculating overlapping regions only for the actual bending condition rather than assuming a fixed state, thus reducing unnecessary computational resources.
Solution Approach 2:
The system changes the key parameter from fixed geometric relationships to bending angle-based dynamic relationships. Instead of using constant geometric parameters for overlap calculation, the system uses the detected bending angle as a variable parameter to determine overlapping regions, allowing the computing resources to be allocated efficiently based on the actual physical state of the device.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach significantly enhances image stitching speed by directly obtaining overlapping information from the estimated bending angle, allowing for faster image stitching without scanning complete feature points, thus meeting real-time viewing requirements.
Implementation Method 1
detecting a physical bending information of the base by the sensing module mounted on the base
Data Source
AI summary
An electronic device including a bendable base, a plurality of camera modules, a sensing module and a processing module is provided. The camera modules are mounted on the base, and may capture a plurality of images corresponding to different fields of view. The sensing module is coupled to the base for detecting a physical bending information of the base. The processing module is coupled to the camera module and the sensing module for estimating a bending angle of the base according to the physical bending information, obtaining an overlapping information of the images according to the bending angle, and stitching the images according to the overlapping information to create a stitched image.