Video Frame Delta Processing for Compressed Stream Threat Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video surveillance systems face inefficiencies in detecting events in compressed video streams due to the need for decompression before analysis, which requires significant computational resources and is costly, especially for systems with limited processing power and memory.
Innovation Solution
A system and method that utilize video frame delta information from a video encoder, such as an H.264 encoder, to detect objects and motion without decompression, employing artificial intelligence and image processing techniques on a cloud or local server, allowing for event detection directly in the compressed video stream.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If video streams are decompressed before analysis, then event detection accuracy is improved, but computational resource requirements increase significantly
Solution Approach 1:
The patent extracts and processes only the essential delta information (changed pixels) from compressed video frames rather than decompressing entire frames. This selective extraction of relevant data maintains event detection capability while dramatically reducing computational load by ignoring redundant unchanged regions.
Solution Approach 2:
The system performs partial decompression by only processing the delta portions of video frames that contain changes, rather than fully decompressing entire frames. This partial action approach provides sufficient information for event detection without the excessive computational cost of complete decompression.
2Loss of energy
If video compression is applied to reduce data transmission, then bandwidth usage is reduced, but processing complexity for event detection increases
Solution Approach 1:
The patent introduces an intermediary processing layer that operates directly on compressed video data structures without requiring full decompression. This intermediary approach processes the compressed format's inherent delta information, serving as a bridge between compressed transmission and event detection needs while avoiding the complexity of complete decompression pipelines.
3Reliability
If full video frames are processed for event detection, then detection completeness is improved, but processing time increases
Solution Approach 1:
The system extracts only the delta information (pixels that have changed) from compressed video frames and processes only this extracted subset for event detection. This maintains detection completeness for actual events while reducing processing time by excluding unchanged regions that contain no useful event information.
Data Source
AI summary
Apparatus and associated methods relate to identifying objects of interest and detecting motion to automatically detect a security threat as a function of video frame delta information received from a video encoder. In an illustrative example, the video encoder may be an H.264 encoder onboard a video camera. A cloud server may receive the video frame delta information in a compressed video stream from the camera. Threats may be detected by the cloud server processing the video frame delta information in the compressed video stream, without decompression, to identify objects and detect motion. The cloud server may employ artificial intelligence techniques to enhance threat detection by the cloud server. Various examples may advantageously provide increased capacity of a computer tasked with detecting security breaches, due to the significant reduction in the amount of data to be processed, relative to threat detection based on processing uncompressed video streams.