Non-Scalable to Scalable Video Converter for Spatial Adaptation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding standards, such as MPEG-2 and H.264/AVC, lack effective techniques for achieving spatial scalability, making it difficult to adapt video signals to diverse end-user devices with varying resolutions and capabilities.
Innovation Solution
A Non-Scalable to Scalable Video (NSV2SV) converter system that decodes non-scalable video signals, segments spatial and motion data, down-samples and resizes spatial data, and uses encoding layers with motion/texture adaptation and refinement modules to generate a multi-layer bit stream with distinct resolutions, enabling scalable video transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If video coding standards such as MPEG-2 and H.264/AVC are used, then coding efficiency and bandwidth utilization are improved, but spatial scalability capability deteriorates
Solution Approach 1:
The patent segments the decoded video signal into spatial data and motion data components. The spatial data is then down-sampled to create multiple resolution layers (base layer and enhancement layers), while motion data is adapted and refined for each layer. This segmentation enables the system to generate scalable video streams from non-scalable input, resolving the contradiction between coding efficiency and spatial scalability.
2Ease of operation
If non-scalable video signals are transmitted, then transmission simplicity is improved, but adaptability to diverse end-user devices deteriorates
Solution Approach 1:
The patent performs preliminary action by converting non-scalable video signals into scalable video signals before transmission. The NSV2SV converter decodes the input signal, segments it into spatial and motion data, down-samples spatial data to create multiple resolution layers, and encodes them into a multi-layer bit stream. This preliminary conversion enables receiving devices to extract and use only the layers corresponding to their supported resolutions, achieving device adaptability while maintaining transmission efficiency.
3Adaptability or versatility
If multiple resolution layers are generated from non-scalable input, then spatial scalability is improved, but computational load deteriorates
Solution Approach 1:
The patent extracts and reuses motion data from the decoded non-scalable video signal for multiple resolution layers. Instead of performing full motion estimation for each layer, the system extracts motion data once and adapts it for different resolutions through scaling and refinement. This extraction approach significantly reduces computational load while maintaining spatial scalability across multiple layers.
4Adaptability or versatility
If video signals are adapted for various end-user devices, then device compatibility is improved, but system complexity deteriorates
Solution Approach 1:
The patent implements universality by creating a multi-layer bit stream that can serve multiple device types simultaneously. The scalable video signal contains base layers and enhancement layers that can be selectively decoded by different receiving devices based on their capabilities. A mobile phone can use only the base layer, while a television can utilize both base and enhancement layers, making the system universally compatible without requiring separate encoding for each device type.
Data Source
AI summary
Systems and methods are for implementing a NSV2SV converter that converts a non-scalable video signal to a scalable video signal. In an implementation, a non-scalable video signal encoded in H.264/AVC standard is decoded and segmented into spatial data and motion data. The spatial data is resized into a desired resolution by down-sampling the spatial data. The motion data is also resized in every layer, except in the top layer, of a scalable video coding (SVC) encoder by using an appropriate measure. Further, the motion data is refined based on the resized spatial data in every layer of the SVC encoder. The refined motion data and the down-sampled spatial data are then transformed and entropy encoded in the SVC standard in every layer. The SVC encoded output from every layer is multiplexed to produce a scalable video signal.