Remote Human Action Reproduction With Pre-Constructed 3D Models
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote reproduction methods face challenges in real-time three-dimensional human body reconstruction, which is computationally intensive and requires significant network resources, leading to poor reconstruction effects and frame loss due to network quality issues, affecting interaction experience.
Innovation Solution
Pre-construct a realistic human body model in a preparation phase and generate action images using this model during remote reproduction, reducing the need for real-time image transmission and network resource consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If real-time three-dimensional human body reconstruction is performed using multi-angle images, then remote reproduction capability is achieved, but network resource consumption increases and frame loss occurs due to poor network quality
Solution Approach 1:
The patent pre-generates multiple viewpoint images from a single captured image before remote reproduction occurs. This preliminary action stores multiple perspective views in advance, eliminating the need for real-time multi-angle image transmission during actual remote reproduction, thus reducing network resource consumption while maintaining reliable remote reproduction capability
Solution Approach 2:
The patent creates synthetic copies of the target object from a single captured image by generating multiple viewpoint images through image processing algorithms. These copied views are then transmitted instead of actual multi-angle captured images, reducing network bandwidth requirements while achieving the same remote reproduction effect
2Reliability
If real-time three-dimensional human body reconstruction is performed, then remote reproduction is enabled, but reconstruction effect is poor due to computational intensity
Solution Approach 1:
The patent performs computationally intensive image processing and viewpoint synthesis in advance during a preparation phase, storing the processed results. During actual remote reproduction, only pre-processed images are transmitted and displayed, avoiding real-time computational requirements and ensuring high reconstruction quality without performance delays
Solution Approach 2:
The patent replaces the mechanical/computational process of real-time three-dimensional reconstruction with a pre-processing approach using image synthesis algorithms. Instead of performing complex 3D reconstruction computations during remote reproduction, the system uses predetermined viewpoint images generated from single-image analysis, substituting heavy real-time computation with pre-computed visual data
3Reliability
If multi-angle images are transmitted in real time for reconstruction, then remote reproduction is achieved, but frame loss and freezing occur due to network quality issues
Solution Approach 1:
The patent extracts only the essential viewpoint information from captured images and stores pre-generated viewpoint images locally. During remote reproduction, only lightweight image data is transmitted instead of continuous multi-angle video streams, extracting and transmitting only what is necessary for maintaining reliable remote reproduction without frame loss
Solution Approach 2:
The patent performs viewpoint synthesis and image processing in advance before remote reproduction sessions. This preliminary preparation creates a library of predetermined viewpoint images that can be quickly transmitted and displayed during actual use, ensuring smooth interaction experience without real-time processing delays or frame freezing
Data Source
Figure 1
Figure 2~3
Figure 4A
AI summary
This application provides a remote reproduction method, applied to a remote reproduction system, where the system includes a first terminal worn by a first user and a second terminal worn by a second user, and the first user and the second user are located in different geographical scenarios. The method includes: The second terminal obtains an action image of the first user, where the action image of the first user includes a sequence of at least one action formed by a pre-constructed human body model of the first user, and then the second terminal reproduces, for the second user, the action image of the first user to a geographical scenario in which the second user is located. According to the method, when the second terminal side reproduces the image of the first user, a multi-angle image does not need to be transmitted in real time, thereby reducing network resource occupation, avoiding frame loss and frame freezing when network quality is poor, and improving interaction experience.