VCM Bitstream Purpose Signaling for Human and Machine Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video codecs lack an efficient means for signaling the purpose of a bitstream and performing appropriate encoding/decoding methods based on whether the bitstream is intended for human or machine consumption, as they are designed for a single purpose.
Innovation Solution
An image encoding/decoding method and apparatus that determines the purpose of a VCM bitstream, whether for human or machine tasks, and adjusts the encoding/decoding process accordingly, enabling the transmission and storage of bitstreams tailored for specific uses.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional video codecs are designed for a single purpose (human or machine), then the encoding/decoding process is simple and efficient, but there is no efficient means for signaling the purpose of a bitstream and performing appropriate encoding/decoding methods for different purposes
Solution Approach 1:
The video codec is designed to handle multiple purposes (human consumption and machine consumption) within a single unified structure. The codec includes a purpose determination module that identifies whether the bitstream is intended for human or machine consumption, and then applies appropriate encoding/decoding methods accordingly. This multi-functional design allows the same codec to adapt to different usage scenarios without requiring separate dedicated codecs for each purpose.
Solution Approach 2:
The codec dynamically adjusts its encoding/decoding behavior based on the determined purpose of the bitstream. When human consumption is detected, the codec applies human-optimized processing; when machine consumption is detected, it applies machine-optimized processing. This dynamic adaptation allows the codec to optimize performance for the specific purpose without requiring manual configuration or separate static designs.
2Reliability
If a VCM bitstream is reconstructed for human viewing, then the image quality is optimized for human perception, but the information may not be suitable for machine tasks requiring different characteristics
Solution Approach 1:
The codec applies different quality characteristics to different parts of the image reconstruction process based on the intended purpose. For human consumption, the reconstruction prioritizes perceptual quality and visual fidelity. For machine consumption, the reconstruction prioritizes preserving task-relevant features and information integrity. This localized quality adjustment ensures that each reconstruction type is optimized for its specific use case.
Solution Approach 2:
The codec changes key reconstruction parameters based on the determined purpose. Different decoding algorithms, filter settings, and feature preservation parameters are applied depending on whether the bitstream is intended for human or machine consumption. These parameter changes enable the same input bitstream to produce optimized output for different downstream applications.
3Ease of operation
If the codec processes bitstreams for both human and machine tasks with the same method, then the processing is consistent, but it cannot provide optimal reconstruction for each specific purpose
Solution Approach 1:
The codec performs preliminary determination of the bitstream purpose before executing the main reconstruction process. By identifying whether the bitstream is intended for human or machine consumption in advance, the codec can pre-configure the appropriate processing pipeline and parameters, ensuring both consistency in the decision-making process and optimality in the execution phase.
Data Source
AI summary
An image encoding/decoding method and apparatus are provided. An image decoding method performed by an image decoding apparatus according to the present disclosure is an image decoding method performed by an image decoding apparatus which reconstructs a VCM bitstream generated by video coding for machine (VCM), and may comprise the steps of determining a purpose of the VCM bitstream; and reconstructing the VCM bitstream on the basis of the determined purpose of the VCM bitstream, wherein the purpose of the VCM bitstream comprises at least one of a machine task and a human task.