High-Frame-Rate Video Transmission via Averaged Sub-Layer Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional frame interpolation techniques for high-speed frame shutter images result in noticeable image degradation and high-load calculations, making it challenging to maintain image quality when transmitting high-frame-rate video data to conventional receivers.
Innovation Solution
A transmission device processes high-frame-rate image data by averaging consecutive frames to create a lower frame rate data stream, which is then encoded and transmitted, allowing receivers to decode and display the images efficiently without complex configuration, and includes identification information for adaptive frame interpolation based on shutter aperture time ratios.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If conventional frame interpolation technique is used for high-speed frame shutter images, then motion blurs are reduced and image sharpness is improved, but noticeable image degradation occurs and high-load calculation is required
Solution Approach 1:
The high-frame-rate image sequence is divided into multiple low-frame-rate sequences by selecting every Nth frame. This segmentation allows conventional receivers to process only a subset of frames, reducing calculation load while maintaining perceived image quality through the high temporal resolution of the original capture
Solution Approach 2:
The patent creates multiple copies of the high-frame-rate data stream, where each copy contains every Nth frame. This allows receivers to select appropriate frame subsets based on their processing capabilities, reducing the effective calculation load while preserving the option for high-quality reconstruction
2Manufacturing precision
If high-frame-rate moving image data is transmitted to conventional receivers, then image quality with high degree of sharpness is achieved, but compatibility with conventional receivers at normal frame rate is compromised
Solution Approach 1:
The transmission system is designed to serve multiple receiver types simultaneously. By structuring the data stream to contain regularly spaced frames, the system can accommodate both high-performance receivers that can process all frames and conventional receivers that can only handle normal frame rates, achieving universal compatibility
Solution Approach 2:
The patent changes the temporal sampling parameter by transmitting every Nth frame to conventional receivers instead of all frames. This parameter adjustment allows conventional receivers to operate at their designed frame rate while still receiving high-quality image data, maintaining compatibility without sacrificing image quality
3Adaptability or versatility
If frame rate is reduced for conventional receiver compatibility, then receiver compatibility is improved, but image quality degradation becomes noticeable
Solution Approach 1:
The high-frame-rate capture is performed in advance with the intention of supporting both conventional and advanced receivers. The data is structured during capture so that conventional receivers can extract every Nth frame for compatible playback, while the full high-frame-rate data remains available for high-quality reconstruction when needed
Data Source
AI summary
A reception device including processing circuitry is provided. The processing circuitry is configured to receive a video stream that includes, for each of a plurality of units of N consecutive pictures of a plurality of pictures, an encoded averaged picture and encoded N−1 of the N consecutive pictures of the respective unit. The averaged picture is generated based on an averaging process in which a non-linear average of the N consecutive pictures of the respective unit is calculated with different gains. The video stream includes a first sub-layer having the encoded averaged pictures and a second sub-layer having the encoded N−1 pictures of the plurality of units. The processing circuitry is configured to receive information including averaging process information indicating a method for the averaging process, and process the received video stream in accordance with the averaging process information.