Multi-Camera Video Layout Using Free Areas in Wide-Angle Frames
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The challenge lies in efficiently generating and synchronizing video files captured by multiple cameras, including ultra-wide angle cameras, which often result in complicated combination and management of video data due to the generation of useless areas in standard recording formats.
Innovation Solution
A video processing apparatus and method that acquire main video data from a main picture capturing unit with an ultra-wide angle lens and sub-video data from sub-picture capturing units, combining and arranging the data to fit free areas in the main video frames, thereby generating a single moving picture file.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of moving object
If multiple cameras including ultra-wide angle cameras are used to capture video, then the coverage area and viewing angles are improved, but the complexity of combining and synchronizing video data increases
Solution Approach 1:
The patent combines video data from multiple cameras including ultra-wide angle cameras into a single composite video file. The combiner integrates main video data and sub-video data, arranging them in a coordinated manner within one file structure, thereby reducing the complexity of managing multiple separate video streams while maintaining comprehensive coverage.
Solution Approach 2:
The video processing apparatus is designed to handle multiple camera types and formats through a universal processing framework. The combiner can process both main video data from standard cameras and sub-video data from ultra-wide angle cameras, synchronizing and integrating them into a single standardized output format that works across different camera configurations.
2Area of moving object
If ultra-wide angle cameras are used, then the field of view is improved, but useless areas are generated when recording in standard rectangular formats
Solution Approach 1:
The patent transforms the circular video output from ultra-wide angle cameras into rectangular formats suitable for standard playback. The combiner processes the circular video data and rearranges it into rectangular frames, effectively converting between dimensional representations while preserving the wide field of view content without generating useless areas.
Solution Approach 2:
The video processing apparatus changes the geometric parameters of the video data by transforming circular coordinates from ultra-wide angle cameras into rectangular coordinate systems. This parameter transformation allows the full utilization of captured imagery in standard rectangular display formats, eliminating wasted pixels while maintaining the expanded field of view.
3Reliability
If video data from multiple cameras is recorded separately, then the data integrity of each camera is maintained, but the synchronization and reproduction process becomes complicated
Solution Approach 1:
The patent merges video data from multiple cameras into a single composite file structure that maintains the integrity of each camera's data while enabling simplified reproduction. The combiner creates a unified file where all video streams are synchronized and can be played back as a single coherent output, eliminating the need for complex external synchronization during reproduction.
4Area of moving object
If sub-video data is combined into free areas of main video frames, then the utilization of video space is improved, but the processing complexity increases
Solution Approach 1:
The patent segments the video frame into main video areas and free areas, assigning different camera data to different segments. The combiner divides the composite video file into regions where main video data occupies primary areas and sub-video data from ultra-wide angle cameras fills the free areas, thereby maximizing space utilization through systematic segmentation.
Data Source
Figure 1A~1B
Figure 2
Figure 3
AI summary
A main video acquisition unit (21) acquires main video data including a video area of a shape having a curved portion from a main picture-capturing unit (10) installed at a predetermined position in a moving object. A sub-video acquisition unit (22) acquires sub-video data from sub-picture capturing units (11) to (14) installed at different positions in the moving object. A combiner (25) combines video data that is generated on the basis of the sub-video data and has a shape fitting to a free area other than the video area of each frame of the main video data, and arranges the video data in the free area. A file generator (27) generates one moving picture file based on the combined video data.