Encoding Device Temporal Scalable Coding Complexity Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In video image encoding, existing techniques face challenges in maintaining image quality when encoding 8K 120p video data due to varying encoding complexity measures for pictures within the same temporal ID, leading to inappropriate rate control and potential reduction in image quality.
Innovation Solution
An encoding device that converts 8K 120p video data to 4K 60p, calculates correction coefficients based on distances between pictures to be encoded and referenced in the time direction, and adjusts encoding complexity measures to ensure accurate rate control and maintain image quality by referencing the corrected measures for encoding at the original frame rate.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If temporal scalable coding is executed on 8K 120p video data, then high-resolution high-frame-rate video can be encoded, but encoding complexity measures become inaccurate leading to inappropriate rate control
Solution Approach 1:
The patent introduces an intermediate process of converting 8K 120p video data to 4K 60p data as a mediator. This conversion creates a reference dataset at lower resolution and frame rate where encoding complexity can be accurately measured. These measured complexity values then serve as reference for correcting the encoding complexity measures of the original 8K 120p data, resolving the inaccuracy problem without sacrificing the high-quality encoding goal.
Solution Approach 2:
The patent changes the parameters of the video data (resolution from 8K to 4K, frame rate from 120p to 60p) to create a version suitable for accurate complexity measurement. By encoding the converted 4K 60p data and measuring its encoding complexity, the system obtains reliable reference values. These reference values are then used to correct the encoding complexity parameters of the original 8K 120p data through a correction coefficient calculation process.
2Speed
If rate control is executed based on inaccurate encoding complexity measures, then encoding speed is maintained, but image quality deteriorates
Solution Approach 1:
The patent implements a feedback mechanism where encoding complexity measures are obtained from converted 4K 60p data, used to calculate correction coefficients, and then applied to correct the encoding complexity measures of the original 8K 120p data. This corrected feedback information enables appropriate rate control that maintains both encoding speed and image quality by providing accurate complexity guidance for bit rate allocation.
3Device complexity
If encoding complexity measures are not corrected, then encoding process is simple, but inappropriate rate control reduces image quality
Solution Approach 1:
The patent performs preliminary conversion of 8K 120p video data to 4K 60p data before the main encoding process. This preliminary action enables accurate measurement of encoding complexity that would otherwise be difficult to obtain from the high-resolution high-frame-rate data directly. The correction coefficients calculated from this preliminary encoding are then applied to improve the main encoding process, ensuring appropriate rate control and maintained image quality.
Data Source
AI summary
An apparatus includes: a processor configured to: execute temporal-scalable coding on input-video-image data at a first frame rate; convert the input-video-image data to video-image data of a second frame rate lower than the first frame rate; execute temporal-scalable coding on the video-image data of the second frame-rate and output a second encoding-complexity measure of a picture subjected to the temporal-scalable coding at the second frame-rate; correct, when the temporal-scalable coding is executed on the input-video-image data at the first frame-rate, a first encoding-complexity measure, estimated based on the second encoding-complexity of the picture and to be referenced for a picture to be encoded, of the picture to be encoded, based on a distance between the picture to be encoded and the picture to be referenced in a time direction; and execute the temporal-scalable coding on the input-video-image data at the first frame-rate based on the corrected first encoding-complexity measure.