Adaptive Frame Dropping Using Latency Buffer Timing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image processing systems face inefficiencies and generation of abnormal images due to excessive computation load when handling high-resolution images, leading to unnecessary frame dropping that affects computation efficiency.
Innovation Solution
An adaptive frame dropping control method that utilizes a latency buffer to compute average consuming periods of images and compares these periods to determine whether to drop frames, balancing system load and maintaining effective encoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If conventional image processing methods drop images at fixed intervals or when variation is small, then system load is reduced, but too many images are dropped and computation efficiency decreases
Solution Approach 1:
The patent implements dynamic frame dropping control by calculating the actual processing time consumed by each image and using this information to adaptively determine whether to drop subsequent frames. The system dynamically adjusts dropping decisions based on real-time processing performance data rather than using fixed thresholds, allowing the system to maintain optimal load management while preserving computation efficiency.
Solution Approach 2:
The patent introduces a feedback mechanism where the system monitors and records the actual processing time of each image, then uses this feedback information to adjust future frame dropping decisions. The feedback loop continuously refines the dropping strategy based on observed processing patterns, enabling the system to learn from past performance and make more intelligent decisions about which frames to retain or discard.
2Measurement precision
If the image processing system processes high-resolution images with advanced algorithms, then image quality and analysis precision are improved, but computation load increases and system capacity is exceeded
Solution Approach 1:
The patent changes the parameter of frame retention by introducing a dynamic retention decision based on actual processing time measurements. Instead of using fixed retention policies, the system adjusts the number of retained frames based on the measured processing characteristics of each image, allowing the system to optimize the balance between processing precision and computational resource consumption.
3Productivity
If the system processes images faster, then productivity is improved, but the latency buffer fills up and frames are dropped
Solution Approach 1:
The patent applies preliminary action by measuring and recording the processing time of each image before making dropping decisions. This advance measurement allows the system to prepare retention policies in advance based on observed processing patterns, enabling faster processing decisions without needing to wait for complete processing analysis.
Data Source
AI summary
An adaptive frame dropping control method is applied to an image processing system. The adaptive frame dropping control method includes utilizing a drop control module of the image processing system to acquire a first image without image processing from a latency buffer, utilizing the first image to compute a first average consuming period of the latency buffer, acquiring a second image without the image processing and later than the first image from the latency buffer for computing a left period of the second image, and determining whether to drop the second image in accordance with a comparison result of the left period and the first average consuming period.