Sketch-Video Compression With Adaptive Frame Rate for Low Bitrate Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video compression methods are inefficient in reducing redundancy while maintaining acceptable video quality, especially in low-bitrate transmission and storage scenarios, as they do not effectively differentiate between essential and non-essential information in video streams.
Innovation Solution
The method involves preprocessing color video signals to create monochromatic sketch streams with adaptive frame rates, encoding these streams, and using frame-hints along with service data for efficient transmission or storage, leveraging artificial neural networks for intelligent encoding and decoding to restore the original video quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If traditional video compression methods are used, then video quality is maintained at acceptable levels, but the compression efficiency is insufficient and redundant data remains in the video stream
Solution Approach 1:
The patent extracts only the essential visual information from video frames by converting them to sketch representations, removing redundant color and detail information. This extraction approach maintains the core visual content while significantly reducing data volume, directly addressing the contradiction between removing redundant data and preserving video quality
Solution Approach 2:
The patent applies different processing quality levels to different parts of the video content by using semantic segmentation to identify important regions (such as objects of interest) and preserving them in higher detail while compressing less important areas more aggressively, thereby maintaining overall video quality while reducing total redundancy
2Quantity of substance
If video bitrate is reduced for efficient transmission and storage, then data volume decreases, but video quality degradation occurs
Solution Approach 1:
The patent creates simplified sketch copies of video frames that capture the essential visual structure and content without replicating all the detail information of the original frames. These sketch copies serve as efficient representations that maintain visual quality while occupying minimal storage space and bandwidth, directly resolving the contradiction between reducing data volume and maintaining video quality
Solution Approach 2:
The patent fundamentally changes the representation parameters of video data by transitioning from full-color pixel-based representation to monochromatic sketch-based representation with reduced frame rates. This parameter transformation enables dramatically lower bitrates while preserving the perceptually important visual information, addressing the data volume versus quality trade-off
3Productivity
If frame rate is reduced to lower bitrate, then transmission efficiency improves, but dynamics of objects in the scene are lost
Solution Approach 1:
The patent implements dynamic frame rate adaptation by analyzing the motion content of video scenes and adjusting the sketch frame rate accordingly. During high-motion periods, the frame rate is increased to capture object dynamics, while during low-motion periods, the frame rate is reduced to improve transmission efficiency. This dynamic adjustment resolves the contradiction between transmission efficiency and preserving object dynamics
Solution Approach 2:
The patent employs feedback mechanisms where the encoder analyzes motion characteristics and scene complexity, then adjusts encoding parameters including frame rate in real-time. This feedback-driven adaptation ensures that object dynamics are preserved when necessary while maximizing transmission efficiency during stable scenes, directly addressing the contradiction between these two requirements
Data Source
AI summary
A method involves receiving a color video signal having a first frame rate. The color video signal is pre-processed to produce a pre-processed color video stream. The pre-processed color video stream is transformed into a monochromatic sketch stream. The first frame rate of the sketch stream is adapted to a second frame rate in accordance with dynamics of objects in a scene and are encoded to produce an encoded sketch stream. Frame-hints are produced using the pre-processed color video stream and are encoded to produce encoded frame-hints. The encoded sketch stream is multiplexed with the encoded frame-hints and service data to produce multiplexer output data which is transmitted via a communication channel or stored in a data storage system.