Seamless Video Transition in Multi-Aperture Mobile Camera
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current multi-camera systems in mobile devices, such as smartphones, experience a discontinuity or 'jump' when switching between Wide and scanning Tele images during video operations due to differing points of view, leading to an undesirable user experience.
Innovation Solution
Implementing a camera controller that streams video images with a smooth transition by performing rotation corrections, registration, localization, and cropping techniques to align and blend Wide and scanning Tele images, ensuring accurate position matching and maintaining object position within the image stream.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a multi-camera system switches between Wide and scanning Tele cameras during video operation, then the field of view can be adjusted, but a discontinuity or jump occurs in the video stream due to different points of view
Solution Approach 1:
The patent introduces an intermediary processing system that includes rotation correction, registration, and localization modules. These intermediaries transform and align the images from different cameras before combining them, ensuring smooth transitions without jumps in the video stream while maintaining field of view adjustability.
Solution Approach 2:
The system performs preliminary actions by pre-calibrating the relative positions and orientations of the Wide and scanning Tele cameras. It also pre-processes images through rotation correction and registration before switching occurs, ensuring that transitions between cameras are seamless and maintain video continuity.
2Stability of the object's composition
If the points of view of Wide and scanning Tele cameras are aligned, then video continuity is improved, but the scanning capability and field of view coverage are reduced
Solution Approach 1:
The patent implements dynamic image processing where rotation correction and registration parameters are continuously adjusted based on the current camera being used and the desired field of view. This dynamic adaptation allows the system to maintain video continuity while preserving the full scanning capability of the tele camera by computationally aligning images rather than physically constraining camera orientations.
Solution Approach 2:
The system changes processing parameters such as rotation angles, registration offsets, and localization transformations depending on which camera is active and what field of view is required. These parameter changes enable smooth transitions and continuous video output while maintaining the ability to scan different areas with the tele camera.
3Measurement precision
If rotation correction and registration are applied to align images, then position matching accuracy is improved, but processing complexity and time increase
Solution Approach 1:
The patent performs preliminary calibration of the camera system during manufacturing or initial setup, storing pre-computed rotation and registration parameters for different camera configurations. This preliminary action reduces the complexity of real-time processing by avoiding the need to compute transformation parameters from scratch during video operation.
Solution Approach 2:
The system uses self-service by leveraging features detected within the images themselves (such as corners, edges, or distinctive patterns) to automatically determine alignment parameters through localization algorithms. This eliminates the need for complex external calibration equipment and reduces processing complexity while maintaining high position matching accuracy.
Data Source
AI summary
Systems and methods for obtaining a seamless, smooth transition between a Wide field of view (FOV) camera and a scanning Tele camera by correcting prism aberrations, matching Tele and Wide FOVs, localizing the associated Tele FOV. and zooming a Wide frame towards the localized Tele FOV.