Image Processing Apparatus Selective Frame Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Image processing systems face issues with frame drops and queue fullness when the decoding performance exceeds the preset limit, leading to intermittent image display on monitors.
Innovation Solution
An image processing apparatus and method that calculates decoding performance based on codec, resolution, and frame rate, and filters image frames to selectively decode only intra-frames, prioritizing cameras with higher or lower performance to prevent frame drops and queue fullness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all image frames from multiple cameras are decoded, then complete monitoring coverage is achieved, but decoding performance is exceeded causing frame drops and queue fullness
Solution Approach 1:
The patent segments the image frames into different types (intra-frames and inter-frames) and applies different decoding strategies to each segment. When decoding performance is exceeded, the system selectively decodes only intra-frames (key frames) while skipping inter-frames, thereby maintaining monitoring continuity with reduced decoding load.
Solution Approach 2:
The patent implements partial action by decoding only a subset of necessary frames (intra-frames) rather than all frames. This partial decoding approach provides sufficient monitoring information to maintain reliability while staying within the decoder's performance capacity, preventing queue fullness and frame drops.
2Reliability
If decoding performance limit is increased to handle all frames, then frame drops are reduced, but system resource consumption increases
Solution Approach 1:
The patent changes the parameter of frame selection by dynamically adjusting which frames are decoded based on performance conditions. When the decoding performance limit is approached, the system changes from decoding all frames to decoding only intra-frames, thereby maintaining reliability while reducing resource consumption.
3Speed
If frame rate is increased to reduce picture-gaps, then monitoring smoothness is improved, but decoding performance is exceeded causing queue fullness
Solution Approach 1:
The patent segments the frame processing task by identifying and prioritizing intra-frames over inter-frames. This segmentation allows the system to process frames at a higher effective rate by focusing computational resources on key frames, improving monitoring smoothness without exceeding decoder capacity.
Solution Approach 2:
The patent ensures continuous monitoring by maintaining a steady stream of decoded intra-frames. Even though not all frames are decoded, the continuous decoding of key frames provides uninterrupted monitoring coverage, eliminating picture-gaps while keeping the decoder operating within its capacity limits.
Data Source
AI summary
Provided are an image processing apparatus and method for processing images. The image processing apparatus is connected to at least one camera and includes: a performance calculating unit configured to calculate a decoding performance of the at least one camera based on information about at least one of a codec, a resolution and a frame rate of image frames which are received from the at least one camera, and a filtering unit configured to filter the received image frames to select image frames for decoding, based on a result of the calculation of the decoding performance of the at least one camera.