Auxiliary Frame Encoding for Video Stream Transformation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Surveillance systems face resource-intensive challenges when performing complex transformations on video streams due to geometrical distortions and vibrations, which often require special hardware and result in loss of original image data.
Innovation Solution
The method involves encoding a video stream using a format that supports auxiliary frames, where the auxiliary frame stores complementary image data not intended for display, but used to apply image transformations to the main frames, reducing the need for preprocessing and resource load, and allowing standard decoders to retrieve raw image data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If complex transformations (stitching, dewarping, DPTZ, EIS, BDC) are applied to correct geometrical distortions and vibrations, then image quality is improved, but system resource load increases and original field of view is lost
Solution Approach 1:
The patent extracts the transformation information from the complex image processing pipeline and stores it separately as motion vectors in auxiliary frames. This separates the correction function from the main encoding path, reducing the resource load on the surveillance system while maintaining image quality correction capabilities.
Solution Approach 2:
The patent performs preliminary encoding of the distorted image as an auxiliary frame before applying transformations to the main frame. This preliminary action stores the original transformation state, allowing standard decoders to retrieve it without requiring complex transformation hardware during decoding.
2Manufacturing precision
If complex transformations are applied to correct distortions, then image quality is improved, but parts of the original field of view are removed
Solution Approach 1:
The patent creates a copy of the original distorted image as an auxiliary frame before transformations are applied to the main frame. This copy preserves the complete original field of view, allowing standard decoders to retrieve undistorted image data without losing any original scene information.
3Manufacturing precision
If special hardware is used for complex transformations, then image quality is improved, but device complexity and cost increase
Solution Approach 1:
The patent replaces the need for special transformation hardware with a software-based solution using auxiliary frames and motion vectors. Standard decoders can retrieve the transformation information and apply corrections without requiring dedicated dewarping or stabilization hardware, reducing system complexity and cost.
4Manufacturing precision
If preprocessing transformations are applied before encoding, then image quality is improved, but processing time and resource load increase
Solution Approach 1:
The patent performs preliminary encoding of the distorted image as an auxiliary frame before applying transformations to the main frame. This preliminary action stores the original transformation state, allowing standard decoders to retrieve it without requiring complex transformation hardware during decoding.
Solution Approach 2:
The patent extracts the transformation information from the complex image processing pipeline and stores it separately as motion vectors in auxiliary frames. This separates the correction function from the main encoding path, reducing the resource load on the surveillance system while maintaining image quality correction capabilities.
Data Source
AI summary
A method and an encoder for encoding a video stream in a video coding format supporting auxiliary frames which includes receiving first image data captured by a video capturing device, using the first image data as image data of a first auxiliary frame, encoding the first auxiliary frame as an intra frame, and encoding a first frame as an inter frame referencing the first auxiliary frame, wherein motion vectors of the first frame are representing a first image transformation to be applied to the first image data.