Virtual Object Occlusion Mounting for Realistic Head Motion Fit
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual object mounting technologies fail to effectively conform to the user's body parts, particularly neck-mounted props, leading to stiff and unsatisfactory mounting effects due to insufficient adaptability with head motion.
Innovation Solution
A method and apparatus that involve obtaining an original video, selecting a virtual object, mounting it to a target part, removing occluded areas, and rendering the video to achieve better conformity with the target part, using motion and depth information to adjust the virtual object's position and shape.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the virtual object is mounted to the target part without removing occluded areas, then the mounting process is simple, but the virtual object cannot conform to the target part and the mounting effect is stiff
Solution Approach 1:
The patent extracts and removes the occluded area of the virtual object that overlaps with the target object. By identifying and removing this specific portion, the virtual object can properly conform to the target part without the stiff mounting effect, resolving the contradiction between mounting precision and processing complexity.
Solution Approach 2:
The patent applies dynamic adjustment by removing the occluded area and rendering the virtual object with updated position and shape information. This allows the virtual object to dynamically adapt to the target part's motion and geometry, improving conformity while maintaining reasonable processing complexity through efficient algorithms.
2Adaptability or versatility
If the virtual object is mounted without real-time motion adaptation, then the processing is fast, but the virtual object fails to conform to head motion and lacks realism
Solution Approach 1:
The patent performs preliminary actions by pre-processing the virtual object's position and shape information before mounting. By preparing the virtual object with appropriate transformation parameters in advance, the system achieves real-time motion adaptation without excessive processing time during the actual mounting operation.
Solution Approach 2:
The patent changes key parameters of the virtual object including position, shape, and orientation based on the target object's motion information. By dynamically adjusting these parameters, the virtual object adapts to head motion in real-time, balancing adaptability with processing efficiency through optimized parameter transformation algorithms.
3Adaptability or versatility
If the occluded area is not removed, then the rendering process is simple, but the virtual object cannot achieve better adaptability effect based on user head motion
Solution Approach 1:
The patent extracts and removes the occluded area from the virtual object before rendering. This extraction enables the virtual object to properly adapt to the target part's geometry and motion, achieving better adaptability effect while managing rendering complexity through efficient occlusion handling algorithms.
Solution Approach 2:
The patent creates a modified copy of the virtual object with the occluded area removed and updated position/shape information. This copy is then rendered with the target object, allowing the virtual object to adapt to head motion while the rendering system handles complexity through optimized compositing techniques.
Data Source
Figure 1
Figure 2~3a
Figure 3b~4a
AI summary
The disclosure discloses a virtual object mounting method and apparatus, a device, and a medium. In order to implement mounting of a virtual object, an original video is obtained, and a virtual object to be mounted is obtained based on a selection of a user. The virtual object selected by the user is mounted to a target part of a target object in the original video. Meanwhile, an occluded area of the virtual object is removed, and the video with the occluded area removed is rendered, to obtain a target video. That is, a part, occluded by the target object, of the virtual object is removed, so that the virtual object can conform to the target part. That is, with the technical solution provided by the disclosure, when the virtual object is mounted to the target part of the target object in the original video, the occluded area of the virtual object can be removed in a timely manner, allowing the virtual object to better conform to the target part, thereby improving the mounting effect.