Video Effect Trajectory Smoothing via Limb Key Point Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies for adding effects to videos based on limb key points result in stiff and non-vivid effects, negatively impacting user experience due to the lack of smoothness in effect processing.
Innovation Solution
An image processing method and apparatus that determine target limb key points in current video frames, calculate current and historical effect key points, and match these points with preset effect parameters to create smoother, more natural effect trajectories across video frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If effects are added to multiple limb key points according to positions in multiple video frames, then the effect positioning accuracy is improved, but the effect smoothness deteriorates
Solution Approach 1:
The patent applies preliminary action by predicting future effect key points based on historical effect key points and current limb key points before processing the current video frame. This prediction mechanism ensures that effects transition smoothly across frames by anticipating the next position rather than simply reacting to current positions, thereby resolving the contradiction between positioning accuracy and smoothness
Solution Approach 2:
The patent implements dynamics by making the effect key points adaptive and time-dependent. The effect key points are dynamically adjusted based on the movement trajectory of limb key points across multiple frames, allowing the effects to follow the natural motion flow. This dynamic adjustment ensures both accurate positioning and smooth transitions, resolving the technical contradiction
2Productivity
If effects are added based on current video frame limb key points only, then the processing speed is improved, but the effect vividness deteriorates
Solution Approach 1:
The patent uses preliminary action by pre-calculating effect key points based on historical data before final rendering. The system predicts future effect positions using historical effect key points and current limb key points, allowing for optimized processing that maintains both speed and vividness by preparing effect trajectories in advance
Solution Approach 2:
The patent applies continuity of useful action by maintaining a continuous relationship between historical and current frame processing. The system continuously updates effect key points based on the sequence of historical and current limb key points, ensuring that effect processing flows smoothly across frames without interruption. This continuous approach enhances vividness while preserving processing efficiency
Data Source
AI summary
The present disclosure discloses an image processing method, an apparatus, an electronic device, and a storage medium. The method includes: determining at least one target limb key point of a current video frame; determining at least one current effect key point according to the at least one target limb key point and historical limb key points of at least one historical video frame adjacent to the current video frame; obtaining historical effect key points of the at least one historical video frame according to preset effect parameters, and determining, according to the at least one current effect key point and the historical effect key points, at least one group of target effects matching the preset effect parameters; and determining a target video frame corresponding to the current video frame based on the at least one group of target effects.