Frame Processing Pipeline for Image Beautification Hysteresis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional camera applications face frame hysteresis due to prolonged processing times, which exceed the 40 ms limit required to maintain a frame rate of 25 frames per second, leading to ineffective beautification processing.
Innovation Solution
A frame processing method and device that involves a first processing unit receiving frames and sending them to a second and third processing unit for simultaneous or sequential processing, ensuring regular intervals and efficient image processing to prevent frame hysteresis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If beautification processing is performed on each frame to enhance quality, then beautification effectiveness is improved, but processing time exceeds 40 ms causing frame hysteresis
Solution Approach 1:
The processing system is divided into multiple processing units (first processing unit, second processing unit, third processing unit) that operate in parallel on different frames. Each processing unit handles specific frames independently, allowing beautification processing to be performed on multiple frames simultaneously rather than sequentially, thus reducing overall processing time while maintaining quality.
Solution Approach 2:
The first processing unit performs preliminary processing on frames before they reach the second processing unit. This preliminary action includes basic processing steps that prepare frames for subsequent beautification processing, enabling the second processing unit to focus on quality enhancement while the overall pipeline maintains the required 40 ms frame rate.
2Manufacturing precision
If processing is performed on every frame to maintain quality, then image processing effectiveness is improved, but frame rate decreases below 25 fps
Solution Approach 1:
The frame processing pipeline is segmented into multiple processing units that operate in parallel. The first processing unit handles frames at intervals, the second processing unit performs beautification on selected frames, and the third processing unit handles additional frames. This segmentation allows the system to process multiple frames simultaneously at different processing stages, maintaining both quality and frame rate.
Solution Approach 2:
Not every frame receives full beautification processing. Instead, the system applies processing selectively - the first processing unit processes certain frames, the second processing unit enhances quality on specific frames, and the third processing unit handles other frames. This partial action approach ensures adequate image quality while maintaining the required 25 fps frame rate.
Data Source
AI summary
Provided are a frame processing method and device for use in image processing. The method includes: receiving a first frame by a first processing unit; sending, by the first processing unit and before receiving a second frame processed with a third processing unit, the first frame to a second processing unit, followed by processing the first frame with the second processing unit or processing the first frame with the second processing unit and another processing unit; and receiving a third frame by the first processing unit before the first processing unit receives the first frame processed with the second processing unit or the first frame processed with the second processing unit and the other processing unit. The method precludes frame hysteresis, at a fixed frame rate and with invariable frame processability of each frame.