Video Frame Encoding Using Layered Resolution Scaling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video communication systems lack flexibility and functionality, particularly in optimizing video transmission based on device capabilities.
Innovation Solution
A method that involves capturing an original video frame, scaling it down, encoding the lower resolution frame using a first encoder, decoding and upsampling, obtaining differences, and encoding these differences using a second encoder, allowing for independent encoding steps and different video coding standards.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If video is transmitted at high resolution to maintain quality, then video quality is improved, but bandwidth usage increases
Solution Approach 1:
The video encoding process is segmented into multiple layers: a base layer encoded at lower resolution and enhancement layers that encode the differences between the original and base layer. This segmentation allows the base layer to consume less bandwidth while enhancement layers provide quality improvement, resolving the contradiction between video quality and bandwidth usage.
Solution Approach 2:
The patent changes the resolution parameter during encoding by downsampling the original video to create a base layer at lower resolution. This parameter change reduces the bandwidth requirement for the base layer while the difference encoding preserves quality information, thus resolving the contradiction between high video quality and low bandwidth usage.
2Productivity
If a single advanced video coding standard is used, then encoding efficiency is improved, but device compatibility deteriorates
Solution Approach 1:
The patent creates a multi-layer encoding structure where the base layer can be decoded by any device regardless of its capabilities, while enhancement layers provide additional efficiency for advanced devices. This universal base layer approach ensures device compatibility while maintaining encoding efficiency through optional enhancement layers.
Solution Approach 2:
The video stream is segmented into a base layer compatible with all devices and enhancement layers for advanced devices. This segmentation allows the same encoded video to serve both simple and advanced devices efficiently, resolving the contradiction between encoding efficiency and device compatibility.
3Productivity
If video is processed through multiple encoding and decoding steps, then video optimization is improved, but processing complexity increases
Solution Approach 1:
The base layer is encoded in advance at lower resolution, and the enhancement layers encode differences from this pre-encoded base layer. This preliminary encoding action simplifies the overall process by establishing a reference structure that reduces the complexity of subsequent encoding and decoding operations.
Data Source
AI summary
A system and method for optimizing video for transmission on a device includes, in one example, the method includes capturing an original video frame and scaling the original video frame down to a lower resolution video frame. The lower resolution video frame is downscaled using a first encoder to produce a first layer output and the first layer output is decoded. The decoded first layer output is upscaled to match a resolution of the original video frame. A difference is obtained between the upscaled decoded first layer output and the original video frame. The difference is independently encoded using a second encoder to create a second layer output. The first and second layer outputs may be stored or sent to another device.