Video Compression for Multi-Region Imaging with Variable Frame Rates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video compression technologies do not effectively handle frames captured under varying imaging conditions, such as different frame rates, across multiple imaging regions in imaging apparatuses, leading to inefficient compression and processing.
Innovation Solution
A video compression apparatus and method that acquires and compresses frames from multiple imaging regions with distinct frame rates, using a combination of frame generation and compression units to handle frames from regions set at different frame rates, such as 30fps and 60fps, by compensating for missing data and applying hybrid coding techniques to reduce processing load.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If frames from multiple imaging regions with different frame rates are compressed separately, then processing load is reduced, but video quality and natural appearance deteriorate
Solution Approach 1:
The imaging regions are segmented into first imaging regions (capturing at first frame rate) and second imaging regions (capturing at second frame rate). This segmentation allows independent processing of frames from different regions while maintaining their respective frame rates, thereby reducing overall processing load while preserving video quality through region-specific optimization.
Solution Approach 2:
The system dynamically generates first frames by combining image data from both first and second imaging regions at the first frame rate, while second frames are generated using only second imaging region data at the second frame rate. This dynamic frame generation adapts to different frame rate requirements of different regions, reducing processing complexity while maintaining natural video appearance.
2Speed
If frame rate is increased for all imaging regions, then video smoothness is improved, but processing requirements and data volume increase
Solution Approach 1:
Different frame rates are assigned to different imaging regions based on their specific requirements. Second imaging regions (e.g., focus detection regions) operate at a higher second frame rate for smooth tracking, while first imaging regions (main imaging regions) operate at a lower first frame rate. This local quality differentiation improves video smoothness where needed without increasing overall processing requirements.
Solution Approach 2:
Instead of increasing frame rate for all regions, the system applies higher frame rate (second frame rate) only to specific second imaging regions where it is most beneficial (e.g., for focus detection and tracking). This partial application of excessive frame rate improves smoothness in critical areas while keeping overall processing requirements manageable.
3Productivity
If different frame rates are used for different imaging regions, then processing efficiency is improved, but frame synchronization and data consistency become difficult
Solution Approach 1:
The system performs preliminary actions by generating first frames using image data from both first and second imaging regions before generating second frames using only second imaging region data. This preliminary frame generation establishes a temporal reference that facilitates subsequent frame synchronization and maintains data consistency across regions with different frame rates.
Solution Approach 2:
First frames serve as an intermediary between the first imaging regions and second imaging regions. By generating first frames that incorporate data from both regions at the first frame rate, the system creates a common reference framework that mediates the synchronization between regions operating at different frame rates, ensuring frame consistency.
Data Source
AI summary
A video compression apparatus is configured to compress a plurality of frames outputted from an imaging element having a plurality of imaging regions in which a subject is captured and that can set imaging conditions for each of the imaging regions, the video compression apparatus comprising: an acquisition unit configured to acquire data outputted from a first imaging region in which a first frame rate is set and data outputted from a second imaging region in which a second frame rate is set; a generation unit configured to generate a plurality of first frames on the basis of the data outputted from the first imaging region acquired and generate a plurality of second frames on the basis of the data outputted from the second imaging region; and a compression unit configured to compress the plurality of first frames generated and compress the plurality of second frames.