Multi-Camera Video Frame Synthesis for Brightness and Clarity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional cameras face challenges in capturing balanced video frames due to limited aperture and increased noise with higher video frame resolutions, especially in smartphone cameras, making it difficult to set optimal camera parameters for clear video capture.
Innovation Solution
A video frame processing method that captures frames from multiple cameras with different parameters and adjusts candidate frames to generate a target single view video frame, improving video quality by selecting, interpolating, or warping frames based on quality thresholds and camera parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If exposure time is increased to improve image brightness, then image brightness is improved, but image blur occurs
Solution Approach 1:
The patent divides the image capture process into multiple segments by using multiple cameras with different exposure times. Instead of relying on a single long exposure that causes blur, the system captures multiple shorter exposure frames from different cameras and synthesizes them, achieving bright clear images without motion blur.
Solution Approach 2:
The patent merges video frames from multiple cameras with different exposure characteristics. By combining the strengths of each camera (one capturing brighter areas, another capturing darker areas), the system produces a synthesized frame that maintains both brightness and clarity without the blur that would result from any single camera's long exposure.
2Illumination intensity
If aperture is increased to improve light intake, then image brightness is improved, but depth of field control is reduced
Solution Approach 1:
The patent applies different aperture settings to different cameras in the system. Each camera is configured with optimal aperture for its specific function (one optimized for bright areas, another for darker areas), allowing the system to maintain both high light intake and appropriate depth of field control for each capture scenario.
3Measurement precision
If video frame resolution is increased to improve image quality, then image detail is improved, but noise increases
Solution Approach 1:
The patent combines multiple lower-resolution frames from different cameras to produce a single high-resolution frame. By merging frames captured at different exposure times and from different perspectives, the system achieves high image detail while the averaging effect reduces noise that would be present in any single high-resolution capture.
Solution Approach 2:
The system creates multiple copies of the scene from different cameras and exposure settings, then synthesizes them into a final high-quality image. This copying approach allows the system to gather more signal (reducing noise) while maintaining high resolution through the synthesis process.
4Adaptability or versatility
If stereo camera is used to capture multi-view video frames, then 3D video capability is improved, but processing complexity increases
Solution Approach 1:
The patent extracts and processes only the essential elements from the stereo camera data - specifically selecting and synthesizing frames based on exposure quality rather than processing all stereo parameters. This extraction approach maintains 3D video capability while reducing processing complexity by focusing only on the most critical frame selection and synthesis operations.
Data Source
AI summary
A video frame processing method, which comprises: (a) capturing at least one first video frame via a first camera; (b) capturing at least one second video frame via a second camera; and (c) adjusting one candidate second video frame of the second video frames based on one of the first video frame to generate a target single view video frame.