Video Coding SEI Messages for Orientation and Quality Metrics
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video encoding and decoding technologies lack efficient methods for handling picture orientation and quality metrics, leading to suboptimal display and processing of video data, particularly in scenarios requiring rotation, mirroring, or quality-based viewport switching.
Innovation Solution
Incorporating supplemental enhancement information (SEI) messages that include syntax elements for picture orientation and quality metrics, allowing for transformation and quality-based decisions in video encoding and decoding processes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If picture orientation and quality metrics are not explicitly coded in SEI messages, then the video encoding and decoding processes remain simple, but the display quality and processing efficiency deteriorate due to lack of orientation adjustment and quality-based decisions
Solution Approach 1:
The patent introduces SEI messages as an intermediary carrier that transports picture orientation and quality metrics information between the encoder and decoder. These messages contain syntax elements that convey transformation instructions and quality data without modifying the core video coding structure, thus improving display quality while maintaining relatively simple encoding/decoding processes.
Solution Approach 2:
The patent changes the parameter representation by encoding picture orientation information (such as rotation angles and mirroring flags) and quality metrics (such as PSNR, SSIM values) as explicit syntax elements in SEI messages. This allows the decoder to apply appropriate orientation transforms and make quality-based decisions without increasing fundamental coding complexity.
2Adaptability or versatility
If multiple transforms are supported for picture orientation, then the adaptability of video processing improves, but the complexity of selecting and applying the correct transform increases
Solution Approach 1:
The patent implements dynamic transform selection by including a transform type syntax element in the SEI messages that indicates which specific transform (e.g., 90-degree rotation, 180-degree rotation, mirroring) should be applied. This allows the system to adapt to different picture orientations while providing clear, unambiguous instructions to the decoder, avoiding the complexity of multiple possible transforms through explicit signaling.
Solution Approach 2:
The patent segments the orientation information into distinct syntax elements within the SEI message structure, including separate fields for rotation angle, mirroring flags, and transform type identification. This segmentation allows the decoder to process each aspect of the transformation independently, reducing the overall complexity of handling multiple transforms.
3Reliability
If quality metrics are included in SEI messages, then quality-based viewport switching and inter prediction selection improve, but the amount of data to be processed and transmitted increases
Solution Approach 1:
The patent extracts only the essential quality metrics (such as PSNR, SSIM, or other relevant quality measures) and places them in SEI messages, rather than transmitting complete quality assessment data. This extraction approach provides sufficient information for quality-based viewport switching and inter prediction selection while keeping the data volume increase minimal.
Solution Approach 2:
The patent applies quality metrics selectively to specific pictures or regions that benefit from quality-based processing, rather than uniformly processing all video data. This allows quality-based viewport switching and inter prediction selection to be performed only where necessary, improving reliability while minimizing the overall data volume increase from quality metric inclusion.
Data Source
AI summary
Video encoders and video decoders are configured to supplemental enhancement information (SEI) messages. The SEI messages may include picture orientation transform type syntax elements that indicate how a picture may be rotated and/or mirrored. The SEI messages may also include quality metrics.