Rendering interaction method for real-time interactive access of remote 3D scene by mobile terminal user

Abstract

The invention provides a rendering interaction method for a mobile terminal user to interactively access a remote 3D scene in real time, and belongs to the application of virtual reality in a mobile intelligent terminal. This method is implemented based on a three-layer rendering interaction framework. The communication channel between the mobile terminal and the cloud rendering cluster is established at the communication layer, the user access requests of the mobile terminal are distributed and sent to the cloud server, and the user operations are converted into corresponding operation instructions and transmitted to the cloud. Server: the rendering machine in the cloud rendering layer requests resource files from the resource management layer, constructs a virtual scene, adjusts the camera in the virtual scene for rendering according to the operation instructions, and sends the rendering results back to the file server in the form of pictures for storage, and transmitted to the user. The present invention realizes the fluency of playing dynamic scenes on the mobile terminal and good user experience by means of cloud service and continuous interval pictures, so that mobile terminal users can have user experience similar to that of PC terminal users when accessing remote 3D scenes.

Description

Technical field [0001] The invention belongs to the field of combining cloud rendering and application software architecture design, relates to the application of virtual reality in mobile intelligent terminals, and specifically relates to a method for mobile terminal users to conduct real-time interactive access to remote 3D scenes. Background technique [0002] With the rapid development of technologies such as computer vision, virtual reality, augmented reality, and augmented virtual environments, three-dimensional scenes of various scales have entered people’s lives, such as large-scale 3D online games, which support multiple simultaneous online games. Network virtual sacrificial platform, virtual fitting platform, scene display platform, virtual testing platform, etc. for their dead relatives to perform sacrificial activities. There is no doubt that the current mainstream PCs can directly perform roaming and related interactive operations on remote scenes of various scales; ...

AI Technical Summary

Problems solved by technology

[0003] 1. Hardware limitations: In order to solve the problem of insufficient rendering performance, the current mobile terminal has changed from the original CPU to undertake the rendering work to a dedicated GPU chip to undertake the rendering work

However, since there is no uniform standard in the field of mobile devices similar to that in the PC world, and the implementation of products launched by various manufacturers is different, so the effect of a set of rendering programs running on different mobile devices may be quite different.

Moreover, the price of mobile devices with better rendering performance is relatively high. It is difficult to let ordinary mobile phone users experience a better virtual scene interaction experience.

In addition, even some of the current top-level mobile devices, when faced with scenes with a large number of triangles and complex rendering algorithms, there will still be freezes and hardware unsupported situations;

[0004] 2. Dependence on third-party plug-ins: Currently, when running 3D scenes on the mobile terminal, most of them need to install software developed by a third party to run. Such a requirement is inconvenient for some projects, and some users may refuse to install these Third-party plug-ins, which hinder the promotion of related products;

[0005] 3. Restriction of browser technology: Currently, mainstream mobile browsers generally use WebGL technology to render 3D scenes, but this technology is not yet mature on mobile device browsers, and mainstream browsers also have various support for this technology. Are not the same

In this case, the effect of the rendering program running on different browsers may not only be inconsistent, but may also cause inefficiency and rendering errors during the running process;

[0006] 4. Limitation of network transmission speed: When the mobile terminal needs to render 3D scenes locally, it needs to download relevant material files from the server, and the current network transmission speed of mobile terminals is difficult to deal with these materials. Download, when the size of a single material file reaches the order of 10M, it will take a lot of time to download the material, which will affect the user experience

If the material files required for rendering are saved in the mobile device in advance, it is difficult to avoid the problem of material file update later, and taking up too much storage space of the user may also cause the user to refuse to use it.

[0007] The current bottleneck problem in mainstream mobile terminal devices: mobile browsers cannot roam smoothly and browse remote 3D scenes. How to enable more mobile terminal users to experience 3D scene interaction similar to that of PC is a problem that needs to be solved

Images