Video Frame 3D Effect Generation via 2D Limb Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 2D algorithms for determining key limb points in video processing are limited by poor follow-through effects due to their inability to obtain three-dimensional information, while 3D algorithms are performance-consuming and less universal.
Innovation Solution
A method and apparatus for processing video images that determine attribute information of objects using 2D point recognition algorithms, adjust datum display information based on this information, and scale target display information of mounted materials to achieve three-dimensional display, addressing both the limitations of 2D and 3D algorithms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a 3D algorithm is used to determine key limb points, then three-dimensional information can be obtained, but device performance consumption increases
Solution Approach 1:
The patent applies dimensionality change by using 2D algorithms to process video frames and generating three-dimensional display effects through virtual camera parameters and depth information calculation. Instead of directly using 3D algorithms to capture key limb points, the system processes 2D video data and synthesizes 3D effects through coordinate transformation and depth mapping, thereby obtaining three-dimensional information while avoiding the high performance consumption of direct 3D algorithms.
2Use of energy by moving object
If a 2D algorithm is used to determine key limb points, then device performance consumption is reduced, but three-dimensional information cannot be obtained
Solution Approach 1:
The patent introduces virtual camera parameters and depth information as intermediary elements between 2D video input and 3D display output. The system uses 2D algorithms to extract key limb points, then applies virtual camera modeling and depth calculation to generate three-dimensional display information. This intermediary processing layer enables the transition from 2D to 3D effects while maintaining low performance consumption of the original 2D algorithm.
3Measurement precision
If a 2D algorithm is used to determine key limb points, then accuracy of determined key body points is improved, but follow-through effect quality deteriorates
Solution Approach 1:
The patent changes parameters by introducing virtual camera parameters (such as field of view, camera position, and depth information) to the 2D algorithm output. By adjusting these parameters, the system maintains the high accuracy of 2D key limb point detection while generating three-dimensional display effects that improve follow-through quality. The parameter transformation enables the mounted materials to follow the movements accurately in a 3D space.
Data Source
AI summary
The present disclosure provides a method and an apparatus for processing a video image, an electronic device, and a non-transitory computer readable storage medium. The method for processing a video image includes: determining attribute information of an object to be processed in a video frame to be processed; determining datum display information of the object based on the attribute information of the object; and adjusting, based on the datum display information, target display information of a mounted material in the video frame to be processed, to obtain a processed video frame corresponding to the video frame to be processed.