3D Collaboration Rendering Instructions for Low-Latency Shared Viewing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional multi-person collaboration methods for 3D content face high rendering and transmission pressures due to the need for individual rendering and binocular stereoscopic effects, leading to increased latency and inefficient data transmission.
Innovation Solution
A method where a sharing provider device generates a universal rendering instruction for a shared rendering object, which is transmitted to a sharing demander device for rendering, reducing data transmission pressure and latency by replacing the transmission of rendered images with instructions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the sharing provider transmits rendered 3D pictures to sharing demanders, then the demanders can view 3D content, but the rendering pressure on the provider increases significantly with each additional demander
Solution Approach 1:
The patent extracts the rendering process from the sharing provider device and relocates it to the sharing demander device. Instead of the provider rendering pictures for all demanders, the provider only transmits 3D content data and control instructions, while each demander performs local rendering based on their own viewing parameters. This extraction eliminates the linear scaling of rendering pressure with the number of demanders.
Solution Approach 2:
The patent introduces a control instruction as an intermediary between the provider and demander. The provider sends control instructions containing viewing parameter adjustments rather than directly transmitting rendered images. These instructions mediate the interaction, allowing demanders to generate appropriate views locally without requiring the provider to pre-render all possible viewpoints.
2Reliability
If binocular content is transmitted for each frame to enable stereoscopic effect, then the 3D viewing experience is improved, but the transmission pressure and decoding pressure increase enormously
Solution Approach 1:
The patent uses parameter copying instead of content copying. Rather than transmitting duplicate binocular image data for each frame, the system transmits viewing parameters (such as viewpoint position, rotation, and focal length) that describe how the 3D content should be rendered. The actual binocular content is generated locally by copying the base 3D model and applying the transmitted parameters, dramatically reducing transmission volume.
3Reliability
If the provider receives user viewpoints, renders corresponding pictures, and transmits them with encoding/decoding, then the demanders can view from their specific viewpoints, but the overall latency increases
Solution Approach 1:
The patent implements preliminary action by having demanders pre-load base 3D content models and rendering engines before viewing is needed. When viewpoint changes occur, the provider only needs to send updated control instructions rather than complete rendered images. This preliminary preparation eliminates the need for time-consuming encoding, transmission, and decoding cycles for each viewpoint change.
Data Source
Figure 1~2
Figure 3~5
Figure 6~7
AI summary
The present disclosure relates to the technical field of computer systems, computer graphics, and human-computer interaction, and particularly to a multi-person collaboration method for three-dimensional content and a device. The method comprises: a sharing provider device being responsible for processing application logic, generating a rendering instruction for a shared rendering object, and then sending the rendering instruction to a sharing demander device; and the sharing demander device rendering the shared rendering object according to the received rendering instruction and view information of respective users. The method realizes the transmission of the rendering instruction replacing the transmission of a shared picture, reduces the data transmission pressure between the sharing provider device and the sharing demander device, lowers the transmission latency, and improves the multi-person sharing experience in a multi-person collaboration system.