Dynamic Video Frame Rate Adaptation for Scene Changes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video processing technologies in user equipment often use a fixed acquisition frame rate for video acquisition during screen sharing in video conferences, which fails to adapt to scene changes, leading to poor viewing experiences and inefficient energy consumption.
Innovation Solution
A video processing method and apparatus that dynamically determine the acquisition frame rate based on the scene change type of the video frame sequence, allowing for adaptive video acquisition and encoding to improve video quality and reduce energy consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a fixed acquisition frame rate is used for video acquisition, then the device complexity is reduced and energy consumption is minimized, but the video quality and viewing experience deteriorate when scene changes occur
Solution Approach 1:
The patent applies dynamics by transitioning from a fixed frame rate to a dynamic frame rate that adapts to scene changes. The system calculates scene change features between adjacent video frames and adjusts the acquisition frame rate accordingly - increasing it when scene changes are detected to maintain video quality, and keeping it fixed when scenes are stable to reduce complexity and energy consumption.
Solution Approach 2:
The patent changes the parameter of acquisition frame rate based on scene change detection. By calculating scene change features and determining scene change types, the system modifies the frame rate parameter dynamically - switching between different frame rates (e.g., first frame rate for normal scenes, second frame rate for scene changes) to optimize both quality and efficiency.
2Use of energy by moving object
If a fixed acquisition frame rate is used, then energy consumption is reduced, but video lag occurs during scene changes
Solution Approach 1:
The patent implements feedback by continuously monitoring scene change features between video frames and using this information to adjust the acquisition frame rate. The system feeds back the scene change detection results to the frame rate control mechanism, creating a closed-loop system that responds to real-time scene changes to prevent video lag while managing energy consumption.
Solution Approach 2:
The system dynamically adjusts the acquisition frame rate based on detected scene changes. When scene changes are detected, the frame rate is increased to maintain reliable video transmission and prevent lag. When scenes are stable, the frame rate is reduced to minimize energy consumption, thus balancing reliability and energy efficiency.
3Manufacturing precision
If the acquisition frame rate is increased to adapt to scene changes, then video quality improves, but energy consumption increases
Solution Approach 1:
The patent applies local quality by adjusting the acquisition frame rate locally in response to specific scene changes rather than maintaining a uniformly high frame rate throughout. The system identifies local regions of change within the video stream and applies higher frame rates only to those segments, while maintaining lower frame rates for stable portions, thus optimizing both quality and energy consumption.
Solution Approach 2:
The system uses partial action by increasing the frame rate only when and where scene changes occur, rather than continuously operating at high frame rate. This selective approach applies the necessary quality enhancement only to the extent needed for scene change adaptation, avoiding excessive energy consumption during stable periods.
Data Source
AI summary
The present disclosure provides a video processing method and apparatus, and a user equipment, and relates to the field of computer technology. The video processing method includes: determining a scene change type of a first video frame sequence of a previous acquisition; determining a frame rate of a current acquisition according to the scene change type of the first video frame sequence and a frame rate of the previous acquisition; controlling an acquisition module to acquire a second video frame sequence according to the frame rate of the current acquisition; encoding the second video frame sequence to obtain an encoding result; and transmitting the encoding result to a target device.