Event-Based Video Encoding Parameter Adaptation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video encoders, such as H.264/AVC or HEVC, often require preset coding parameters like frame rate and quantization parameter (QP) to be set manually, which can lead to suboptimal performance in computer vision applications like video surveillance, where dynamic adjustment of these parameters based on event signals from event-driven cameras is not effectively utilized.
Innovation Solution
An apparatus and method that use event signals from event-driven cameras to determine coding parameters such as frame rate, picture size, and quantization parameter (QP) dynamically, by detecting motion and object presence within the video image, allowing for adaptive encoding that optimizes spatial and temporal resolution based on the detected motion and object characteristics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If preset coding parameters are used for video encoding, then the encoding process is simple, but the encoding accuracy and performance are suboptimal
Solution Approach 1:
The encoder automatically determines coding parameters by analyzing event signals from event-driven cameras, eliminating the need for manual presetting. The system self-adjusts parameters like frame rate, picture size, and quantization parameter based on detected motion and object characteristics, achieving both high encoding accuracy and automated operation.
Solution Approach 2:
The patent dynamically changes coding parameters (frame rate, picture size, quantization parameter) based on event signal analysis. When motion is detected, the system adjusts parameters to capture fast-moving objects with higher temporal or spatial resolution, while reducing parameters for static scenes to optimize bitrate efficiency.
2Reliability
If high frame rate and picture size are used, then fast-moving objects are captured accurately, but the bitrate increases
Solution Approach 1:
The patent implements dynamic adjustment of frame rate and picture size based on real-time motion detection from event signals. When fast-moving objects are detected, the system increases frame rate or picture size to maintain detection accuracy. When scenes are static or motion is minimal, parameters are reduced to optimize bitrate, achieving adaptive balance between quality and efficiency.
Solution Approach 2:
The system applies different coding parameters to different regions or time periods based on local motion characteristics. Event signals indicate where motion occurs, allowing the encoder to allocate higher quality parameters only to regions with detected motion while using lower parameters for static regions, optimizing overall bitrate efficiency.
3Productivity
If event signals are utilized for parameter adjustment, then encoding efficiency is optimized, but the system complexity increases
Solution Approach 1:
The patent uses event signals from event-driven cameras as an intermediary to bridge scene content and encoding parameters. These compact event signals (indicating only locations of intensity change) provide motion information without requiring full-frame analysis, enabling efficient parameter adjustment with minimal additional processing complexity compared to traditional full-frame motion detection.
Data Source
AI summary
The present disclosure relates to encoding of video image using coding parameters, which are adapted based on events related to motion within the video image. Image content is captured by a standard image sensor and an event-triggered sensor, providing an event-signal indicating changes (e.g. amount and time-spatial location) of image intensity. Objects are detected within the video image, based on the event signal assessing motion of the object, and their textures extracted. The spatial-time coding parameters of the video image are determined based on the location and strength of the event signal, and the extent to which the detected objects moves.