Decoded Picture Buffer Inverse DRA for Lower Decoder Memory Load
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video decoding technologies face challenges in efficiently handling dynamic range adjustment (DRA) operations at the decoder side, leading to increased DPB size and computational complexity, particularly when dealing with High Dynamic Range (HDR) and Wide Color Gamut (WCG) video data.
Innovation Solution
Integrate inverse DRA operations within the video decoder, applying them during the bumping process or based on timing parameters, thereby eliminating the need to store pictures in both the DRA and original domains and performing on-the-fly conversions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If pictures are stored in both DRA domain and original domain at the decoder, then picture quality and flexibility are improved, but memory storage requirements and device complexity increase
Solution Approach 1:
The inverse DRA operation is performed preliminarily during the bumping process before the picture is output from the DPB. This ensures that when the picture is eventually output, it is already in the original domain without requiring separate storage of both DRA and original domain pictures, thus reducing memory requirements while maintaining picture quality
Solution Approach 2:
The inverse DRA operation is extracted from the picture output stage and integrated into the bumping process. This separation allows the conversion to happen at the optimal time when the picture is being prepared for output, eliminating the need for dual-domain storage and reducing decoder complexity
2Adaptability or versatility
If inverse DRA operations are performed externally to the video coder, then processing flexibility is improved, but computational overhead and processing time increase
Solution Approach 1:
The inverse DRA operation is merged with the bumping process within the video decoder. By combining these operations, the patent eliminates separate processing stages and reduces computational overhead, as the inverse DRA is performed as part of the existing bumping workflow rather than as an external operation
Solution Approach 2:
The bumping process is enhanced to serve multiple functions: it manages the DPB picture buffer and simultaneously performs the inverse DRA operation. This multi-functionality reduces the need for separate processing blocks and improves overall processing efficiency while maintaining flexibility
3Quantity of substance
If on-the-fly conversion from original domain to DRA domain is performed for inter-prediction, then memory storage requirements are reduced, but computational complexity increases
Solution Approach 1:
Pictures are pre-converted to the DRA domain during the encoding and decoding process, and stored in this domain within the DPB. This preliminary conversion eliminates the need for repeated on-the-fly conversions during inter-prediction operations, reducing computational complexity while maintaining efficient memory utilization
Solution Approach 2:
The patent changes the domain parameter of stored pictures from original domain to DRA domain. By storing pictures in the DRA domain and performing inverse DRA only when needed for output, the system optimizes both memory efficiency and computational requirements for inter-prediction operations
Data Source
Figure 1
Figure 2A~2B
Figure 3
AI summary
The disclosure describes example of performing an inverse dynamic range adjustment (DRA) to a picture as part of outputting the picture from memory. A device for decoding video data includes a memory configured to store a picture in a DRA domain and a processor configured to determine that the picture in the dynamic range adjustment (DRA) domain stored in the memory is to be output from the memory, subsequent to determining that the picture in the DRA domain is to be output, perform a process of outputting the picture in the DRA domain, and at the process of outputting the picture in the DRA domain from the memory, apply inverse DRA to the picture.