Rendering interaction method for real-time interactive access of remote 3D scene by mobile terminal user

Abstract

The invention provides a rendering interaction method for a mobile terminal user to interactively access a remote 3D scene in real time, and belongs to the application of virtual reality in a mobile intelligent terminal. This method is implemented based on a three-layer rendering interaction framework. The communication channel between the mobile terminal and the cloud rendering cluster is established at the communication layer, the user access requests of the mobile terminal are distributed and sent to the cloud server, and the user operations are converted into corresponding operation instructions and transmitted to the cloud. Server: the rendering machine in the cloud rendering layer requests resource files from the resource management layer, constructs a virtual scene, adjusts the camera in the virtual scene for rendering according to the operation instructions, and sends the rendering results back to the file server in the form of pictures for storage, and transmitted to the user. The present invention realizes the fluency of playing dynamic scenes on the mobile terminal and good user experience by means of cloud service and continuous interval pictures, so that mobile terminal users can have user experience similar to that of PC terminal users when accessing remote 3D scenes.

Description

Technical field [0001] The invention belongs to the field of combining cloud rendering and application software architecture design, relates to the application of virtual reality in mobile intelligent terminals, and specifically relates to a method for mobile terminal users to conduct real-time interactive access to remote 3D scenes. Background technique [0002] With the rapid development of technologies such as computer vision, virtual reality, augmented reality, and augmented virtual environments, three-dimensional scenes of various scales have entered people’s lives, such as large-scale 3D online games, which support multiple simultaneous online games. Network virtual sacrificial platform, virtual fitting platform, scene display platform, virtual testing platform, etc. for their dead relatives to perform sacrificial activities. There is no doubt that the current mainstream PCs can directly perform roaming and related interactive operations on remote scenes of various scales; ...

AI Technical Summary

Problems solved by technology

[0003] 1. Hardware limitations: In order to solve the problem of insufficient rendering performance, the current mobile terminal has changed from the original CPU to undertake the rendering work to a dedicated GPU chip to undertake the rendering work

However, since there is no uniform standard in the field of mobile devices similar to that in the PC world, and the implementation of products launched by various manufacturers is different, so the effect of a set of rendering programs running on different mobile devices may be quite different.

Moreover, the price of mobile devices with better rendering performance is relatively high. It is difficult to let ordinary mobile phone users experience a better virtual scene interaction experience.

In addition, even some of the current top-level mobile devices, when faced with scenes with a large number of triangles and complex rendering algorithms, there will still be freezes and hardware unsupported situations;

[0004] 2. Dependence on third-party plug-ins: Currently, when running 3D scenes on the mobile terminal, most of them need to install software developed by a third party to run. Such a requirement is inconvenient for some projects, and some users may refuse to install these Third-party plug-ins, which hinder the promotion of related products;

[0005] 3. Restriction of browser technology: Currently, mainstream mobil

Images