Video Coding In-Loop Super-Resolution for Higher Quality Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video compression techniques struggle with increasing data amounts due to higher image sizes, resolutions, and frame rates, necessitating improved coding efficiency and image enhancement through super-resolution techniques.
Innovation Solution
Implementing a deep learning-based resampling in-loop filter that upsamples reconstructed frames, replacing or interposing with deblocking, SAO, and adaptive loop filters to enhance video quality and coding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If image size, resolution, and frame rate are increased, then video quality is improved, but data amount and hardware resource requirements increase
Solution Approach 1:
The patent uses super-resolution technology to generate high-resolution video frames from low-resolution compressed frames. The decoder reconstructs high-quality video by copying and upscaling the compressed data through deep learning-based super-resolution models, achieving high video quality without transmitting large amounts of original high-resolution data
Solution Approach 2:
The patent changes the resolution parameter dynamically by applying different upscaling factors. The decoder receives low-resolution compressed frames and transforms them into high-resolution output frames by changing the resolution parameter through super-resolution algorithms, thereby improving video quality while maintaining efficient data transmission
2Productivity
If super-resolution techniques are applied in in-loop filtering, then video quality and coding efficiency are enhanced, but device complexity increases
Solution Approach 1:
The patent applies super-resolution filtering in the in-loop filter section of the video decoder, performing resolution enhancement as a preliminary action before final video output. This allows the super-resolution processing to be integrated into the existing decoding pipeline, improving coding efficiency while managing device complexity through systematic integration
Solution Approach 2:
The patent integrates multiple functions into the in-loop filter, combining traditional loop filtering operations with super-resolution enhancement. The filter performs both compression artifact reduction and resolution upscaling, achieving multi-functionality that improves coding efficiency without requiring completely separate processing systems
Data Source
AI summary
A method and an apparatus for video coding using a super-resolution in-loop filter utilize an in-loop filter based on upsampling or super-resolution techniques in processing a video signal through downsampling to the compression and upsampling to the reconstruction thereof. The video decoding method includes obtaining the reconstructed frame, obtaining a scale value representing a resolution difference between the reconstructed frame and the original frame, generating, based on the scale value, an upsampled reconstructed frame by inputting the reconstructed frame into a resampling in-loop filter that is deep learning-based, and storing an output frame as a reference frame once generated by the plurality of filters and the resampling in-loop filter in a decoded picture buffer (DPB).