Object Mask SEI Messaging for Precise Video Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards, such as HEVC and VVC, face challenges in efficiently encoding and decoding video data to maintain high compression efficiency while preserving image quality, particularly in applications requiring object-specific processing.
Innovation Solution
The implementation of an object mask information (OMI) supplemental enhancement information (SEI) message that allows for the detection and encoding of object masks within video sequences, using auxiliary pictures to represent object masks and generate SEI messages indicating their attributes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If video compression is applied to reduce storage memory and transmission bandwidth, then compression efficiency is improved, but image quality and object processing precision deteriorate
Solution Approach 1:
The patent segments the video processing into primary picture encoding and auxiliary picture encoding. The auxiliary picture contains only the object mask information (binary mask), while the primary picture contains the full image data. This segmentation allows the system to transmit compressed image data efficiently while preserving complete object mask information for precise object-based processing, thus resolving the contradiction between compression efficiency and image quality.
2Measurement precision
If object mask information is encoded in auxiliary pictures, then object detection precision is improved, but bitstream complexity increases
Solution Approach 1:
The patent extracts only the essential object mask information from the full image data and places it in the auxiliary picture. The auxiliary picture contains solely the binary mask data (0 or 1 values indicating object presence), removing unnecessary image information. This extraction approach improves object detection precision by providing clean, dedicated mask data while managing bitstream complexity through efficient coding of only essential information.
Solution Approach 2:
The auxiliary picture serves as an intermediary between the primary picture and the object detection process. It acts as a mediator that carries only the necessary mask information, allowing the decoding device to obtain precise object location data without processing the entire complex bitstream, thus reducing computational complexity while maintaining detection precision.
3Adaptability or versatility
If SEI messages are used to indicate mask attributes, then object processing flexibility is improved, but decoding complexity increases
Solution Approach 1:
The patent uses Supplemental Enhancement Information (SEI) messages with universal functionality to indicate various mask attributes (e.g., object type, location, size). The SEI message structure is standardized and can convey multiple types of metadata about the object mask without requiring separate encoding mechanisms. This multi-functional approach improves object processing flexibility while managing decoding complexity through a unified, standard-based information delivery mechanism.
Data Source
AI summary
Methods and apparatuses are provided for processing video data by using an object mask information (OMI) supplemental enhancement information (SEI) message. An exemplary encoding method includes: receiving a video sequence; and encoding one or more pictures of the video sequence to generate a bitstream, comprising: encoding an auxiliary picture indicating a mask of an object in a primary picture, the mask of the object being represented by a sample value of the auxiliary picture; and generating a supplemental enhancement information (SEI) message indicating an attribute of the mask of the object.