Mobile terminal real-time rendering system and method based on cloud platform

Abstract

The invention provides a mobile terminal real-time rendering system and method based on a cloud platform, and relates to the technical field of mobile terminal rendering. The system comprises a cloud platform layer, a mobile terminal layer and a data transmission layer, the cloud platform layer obtains multi-source heterogeneous data through an air-space-ground-time four-dimensional sensing technology, a digital twin base is constructed after fusion processing, and local dynamic updating of a model is achieved through an artificial intelligence micro-service system; and meanwhile, the cloud platform layer performs optimal distribution on rendering tasks and transmits processed lightweight data to the mobile terminal layer, and a mobile terminal completes real-time rendering through a high-definition rendering technology and realizes interaction between the urban entity and the four-dimensional digital twinborn body through a virtual-real interaction technology. The high-definition digital twin city scene can be smoothly displayed, the response time is controlled within 10 seconds, the user experience is good, and the requirement for real-time rendering of the mobile terminal in digital twin city construction is met.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of mobile terminal rendering, in particular to a mobile terminal real-time rendering system based on a cloud platform and a method thereof. BACKGROUND

[0002] With the continuous advancement of digital twin city construction, higher requirements are put forward for real-time rendering and display of city scenes. Mobile terminals, due to their portability, have become an important carrier for people to obtain digital twin city information. However, the current computing and storage capabilities of mobile terminals are limited, making it difficult to handle large-scale and high-precision digital twin scene data, resulting in poor real-time rendering effect and slow response speed.

[0003] At the same time, digital twin city construction involves multi-source heterogeneous data of air-space-ground-time four-dimensional perception, and the fusion processing of these data is difficult, and the existing data fusion method cannot meet the requirements of real-time and accuracy. In addition, the virtual-real interaction between city entities and digital twins is not smooth enough, affecting the user experience. Moreover, there is a lack of effective artificial intelligence micro-service system to support the intelligent processing and optimization of digital twin scenes.

[0004] Therefore, there is an urgent need for a mobile terminal real-time rendering system based on a cloud platform and a method thereof to solve the problems raised in the background. SUMMARY

[0005] The present application aims to overcome the shortcomings of the prior art and provide a mobile terminal real-time rendering system based on a cloud platform and a method thereof to improve the real-time rendering effect and response speed of mobile terminals on digital twin city scenes, realize effective fusion of multi-source heterogeneous data, enhance the virtual-real interaction experience between city entities and digital twins, and improve the intelligent level of digital twin scenes through an artificial intelligence micro-service system.

[0006] To achieve the above purpose, the present application realizes the following technical solutions: A mobile terminal real-time rendering system based on a cloud platform, comprising a cloud platform layer, a mobile terminal layer and a data transmission layer; The cloud platform layer comprises a data receiving module, a multi-source heterogeneous data fusion module, a digital twin base construction module, a four-dimensional perception model construction module, a local dynamic update module, an artificial intelligence micro-service module, a rendering instruction generation module, a cloud rendering module and a data compression module; The data receiving module is used to receive multi-source heterogeneous data obtained by air-space-ground-time four-dimensional perception; The multi-source heterogeneous data fusion module is connected with the data receiving module and is used to fuse and process the multi-source heterogeneous data by using a multi-source heterogeneous data fusion and scene digitization reconstruction method to generate fusion data; The digital twin base construction module is connected with the multi-source heterogeneous data fusion module, and is configured to construct a digital twin base based on space-time-ground-time four-dimensional perception based on the fused data; The four-dimensional perception model construction module is connected with the digital twin base construction module, and is configured to construct a four-dimensional perception model based on the digital twin base; The local dynamic update module is connected with the four-dimensional perception model construction module, and is configured to locally and dynamically update the four-dimensional perception model by using a local dynamic update technology of the four-dimensional perception model; The artificial intelligence micro-service module is connected with the local dynamic update module, and is configured to provide artificial intelligence micro-services for digital twin city construction, and process the updated four-dimensional perception model; The rendering instruction generation module is connected with the artificial intelligence micro-service module, and is configured to generate rendering instructions according to a request of a mobile terminal; The cloud rendering module is connected with the rendering instruction generation module, and is configured to render a digital twin scene according to the rendering instructions, and generate rendering data; The data compression module is connected with the cloud rendering module, and is configured to compress the rendering data.

[0007] The mobile terminal layer includes a request sending module, a data receiving and decompression module, a real-time rendering display module, a virtual-real interaction module, and a mobile platform high-definition rendering module; The request sending module is configured to send a rendering request to the cloud platform layer; The data receiving and decompression module is configured to receive compressed rendering data transmitted by the data transmission layer, and perform decompression; The real-time rendering display module is connected with the data receiving and decompression module, and is configured to perform real-time rendering display on the decompressed rendering data; The virtual-real interaction module is connected with the real-time rendering display module, and is configured to realize virtual-real interaction between a city entity and a four-dimensional digital twin entity.

[0008] The data transmission layer is configured to realize data transmission between the cloud platform layer and the mobile terminal layer.

[0009] Further, the multi-source heterogeneous data fusion module adopts a deep learning algorithm for feature fusion.

[0010] Further, the local dynamic update module triggers a local update mechanism when a difference between real-time perception data and historical data exceeds a preset threshold.

[0011] Further, the artificial intelligence micro-service module includes a data processing micro-service, a model analysis micro-service, and a rendering optimization micro-service, and is configured to provide model simplification, rendering optimization, and abnormality detection micro-services, wherein the model simplification micro-service simplifies a digital twin model by using a LOD technology.

[0012] Further, the mobile terminal layer further comprises a mobile platform high-definition rendering module connected with the real-time rendering display module, for improving the clarity of rendering display by using mobile platform high-definition rendering technology.

[0013] Further, a cloud platform-based mobile terminal real-time rendering method comprises the following steps: S1. The cloud platform layer receives multi-source heterogeneous data acquired by space-air-ground-time four-dimensional perception through a data receiving module; S2. A multi-source heterogeneous data fusion module adopts a multi-source heterogeneous data fusion and scene digital reconstruction method to fuse and process the multi-source heterogeneous data, to generate fused data; S3. A digital twin base construction module constructs a digital twin base based on space-air-ground-time four-dimensional perception based on the fused data; S4. A four-dimensional perception model construction module constructs a four-dimensional perception model based on the digital twin base; S5. A local dynamic update module adopts a local dynamic update technology of the four-dimensional perception model to perform local dynamic update on the four-dimensional perception model; S6. An artificial intelligence micro-service module provides artificial intelligence micro-services for digital twin city construction, and processes the updated four-dimensional perception model; S7. The mobile terminal layer sends a rendering request to the cloud platform layer through a request sending module; S8. A rendering instruction generation module of the cloud platform layer generates a rendering instruction according to the rendering request; S9. A cloud rendering module renders the digital twin scene according to the rendering instruction, to generate rendering data; S10. A data compression module compresses the rendering data, and transmits the compressed rendering data to the mobile terminal layer through a data transmission layer; S11. A data receiving and decompression module of the mobile terminal layer receives and decompresses the compressed rendering data; S12. A real-time rendering display module performs real-time rendering display on the decompressed rendering data, and a virtual-real interaction module realizes virtual-real interaction between city entities and four-dimensional digital twins.

[0014] Further, in step S5, the local dynamic update technology comprises real-time monitoring of data changes of the four-dimensional perception model, and when the change amount exceeds a preset threshold, the corresponding local area is dynamically updated.

[0015] Further, in step S9, the cloud rendering module adopts mobile platform high-definition rendering technology for rendering processing.

[0016] The present application provides a cloud platform-based mobile terminal real-time rendering system and method. 1. This invention provides a real-time rendering system and method for mobile terminals based on a cloud platform. By processing and rendering large-scale, high-precision digital twin scene data through the cloud platform, the computational burden of mobile terminals is reduced, and the real-time rendering effect and response speed of mobile terminals are improved. By adopting the fusion of multi-source heterogeneous data and scene digital reconstruction method, the effective fusion of four-dimensional perception multi-source heterogeneous data in space-air-ground-time is realized, providing a high-quality data foundation for the construction of digital twin base.

[0017] 2. This invention provides a real-time rendering system and method for mobile terminals based on a cloud platform. By utilizing the local dynamic update technology of the four-dimensional perception model, the four-dimensional perception model can be updated in a timely manner, ensuring the accuracy and timeliness of the model.

[0018] 3. This invention provides a real-time rendering system and method for mobile terminals based on a cloud platform. It introduces an artificial intelligence microservice system for the construction of digital twin cities, which improves the intelligent processing and optimization capabilities of digital twin scenarios, realizes virtual-real interaction between urban entities and four-dimensional digital twins, and enhances the user experience.

[0019] 4. This invention provides a real-time rendering system and method for mobile terminals based on a cloud platform, which adopts high-definition rendering technology for mobile platforms to improve the clarity of mobile terminal rendering and display. Attached Figure Description

[0020] Figure 1 This is a framework diagram of the cloud-based mobile terminal real-time rendering system of the present invention. Figure 2 This is a flowchart of the cloud-based mobile terminal real-time rendering method of the present invention. Detailed Implementation

[0021] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention. Example

[0022] like Figure 1 As shown, this embodiment of the invention provides a real-time rendering system for mobile terminals based on a cloud platform, including a cloud platform layer, a mobile terminal layer, and a data transmission layer; The cloud platform layer is deployed in a city data center. The data receiving module receives multi-source heterogeneous data of space-time four-dimensional perception through various sensors and monitoring equipment, including satellite remote sensing data, unmanned aerial vehicle aerial photography data, ground sensor data, and time series data, etc. The multi-source heterogeneous data fusion module processes the data by fusion, and uses a deep learning-based fusion algorithm to integrate different types and different accuracy data into unified fusion data. The digital twin base construction module constructs a city-level digital twin base based on the fusion data, which contains basic information of the city, such as topography, buildings, roads, and pipe networks. The four-dimensional perception model construction module constructs a four-dimensional perception model covering the fields of city traffic, environment, and energy based on the digital twin base. The local dynamic update module monitors the data changes in various fields of the city in real time, and when the traffic flow data changes exceed the preset threshold, it dynamically updates the four-dimensional perception model in the local area. The artificial intelligence micro-service module provides artificial intelligence micro-services such as traffic prediction and environmental assessment, and analyzes and processes the updated four-dimensional perception model. The rendering instruction generation module receives the rendering request sent by the mobile terminal, such as viewing the three-dimensional scene of a certain area, and generates the corresponding rendering instruction. The cloud rendering module uses mobile platform high-definition rendering technology to render the digital twin scene of the area according to the rendering instruction, and generates high-definition rendering data. The data compression module uses H.265 compression standard to compress the rendering data, reducing the data transmission amount.

[0023] The mobile terminal layer is a device such as a smart phone or a tablet computer. The request sending module sends a rendering request by user operation. The data receiving and decompression module receives and decompresses the compressed rendering data transmitted by the cloud platform layer. The real-time rendering display module displays the decompressed rendering data on the mobile terminal screen in real time. The virtual-real interaction module realizes the interaction between the user and the digital twin scene through the touch screen and the camera, such as clicking on a building to view detailed information, or scanning the physical building through the camera to match it with the digital twin. The mobile platform high-definition rendering module optimizes the rendering parameters of the mobile terminal to improve the clarity and smoothness of the rendering picture.

[0024] The data transmission layer uses 5G network to realize high-speed data transmission between the cloud platform layer and the mobile terminal layer.

[0025] As shown in Figure 2 , the specific implementation steps of the mobile terminal real-time rendering method are as follows: S1. The data receiving module continuously receives multi-source heterogeneous data, and updates the data every 10 minutes; S2. The multi-source heterogeneous data fusion module processes the received data by fusion, and the processing time is about 5 minutes; S3. The digital twin base construction module updates the digital twin base regularly according to the fusion data, and updates it once a week; S4. The four-dimensional perception model construction module constructs the four-dimensional perception model of each field based on the digital twin base; S5. The local dynamic update module monitors data changes in real time, and when the traffic flow of a road section increases by 20% compared with the historical same period, the four-dimensional perception model of the road section is locally updated, and the update time is about 1 minute; S6. The artificial intelligence micro-service module uses the updated traffic four-dimensional perception model to predict traffic congestion, and feeds back the prediction result to the relevant department; S7. The user sends a request to view the rendering request of the three-dimensional scene of a certain business district through the request sending module of the mobile terminal; S8. The rendering instruction generation module generates the corresponding rendering instruction within 1 second; S9. The cloud rendering module completes the rendering of the digital twin scene of the business district according to the rendering instruction within 3 seconds, and generates rendering data; S10. The data compression module compresses the rendering data, and the compression ratio is about 10:1, which is transmitted to the mobile terminal through the 5G network, and the transmission time is about 2 seconds; S11. The data receiving and decompression module of the mobile terminal completes data decompression within 1 second; S12. The real-time rendering display module displays the three-dimensional scene of the business district on the mobile terminal in real time, the frame rate reaches 30fps, the mobile platform high-definition rendering module makes the picture resolution reach 2K, and the user clicks the store in the business district through the virtual-real interaction module to view the commodity information, realizing virtual-real interaction.

[0026] Through the system and method of the application, the mobile terminal can smoothly display the high-definition digital twin city scene, the response time is controlled within 10 seconds, the user experience is good, and the demand for real-time rendering of the mobile terminal in the digital twin city construction is met.

[0027] In this paper, the following points need attention: 1. The drawings of the embodiments of the present disclosure only involve the structures involved in the embodiments of the present disclosure, and other structures can be referred to the general design.

[0028] 2. In the case of no conflict, the embodiments of the present disclosure and the features in the embodiments can be combined to obtain new embodiments.

[0029] Although the embodiments of the present application have been shown and described, it will be understood by those skilled in the art that various changes, modifications, replacements and variations of the embodiments can be made without departing from the principles and spirits of the present application, and the scope of the present application is defined by the appended claims and their equivalents. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

Claims

1. A real-time rendering system for mobile terminals based on a cloud platform, characterized in that, It includes the cloud platform layer, the mobile terminal layer, and the data transmission layer; The cloud platform layer includes: The data receiving module is used to receive multi-source heterogeneous data acquired by four-dimensional sensing in space, air, ground, and time. The multi-source heterogeneous data fusion module, connected to the data receiving module, is used to fuse multi-source heterogeneous data using multi-source heterogeneous data fusion and scene digital reconstruction methods to generate fused data; The digital twin base construction module is connected to the multi-source heterogeneous data fusion module and is used to build a digital twin base based on four-dimensional perception of space-sky-ground-time based on fused data; The four-dimensional perception model construction module is connected to the digital twin base construction module and is used to build a four-dimensional perception model based on the digital twin base. The local dynamic update module is connected to the four-dimensional perception model construction module and is used to perform local dynamic updates on the four-dimensional perception model using the local dynamic update technology of the four-dimensional perception model. The AI ​​microservice module, connected to the local dynamic update module, is used to provide AI microservices for the construction of digital twin cities and to process the updated four-dimensional perception model. The rendering instruction generation module, connected to the artificial intelligence microservice module, is used to generate rendering instructions based on the requests from the mobile terminal. The cloud rendering module, connected to the rendering instruction generation module, is used to render the digital twin scene according to the rendering instructions and generate rendering data. The data compression module, connected to the cloud rendering module, is used to compress rendering data. The mobile terminal layer includes: The request sending module is used to send rendering requests to the cloud platform layer; The data receiving and decompression module is used to receive compressed rendering data transmitted from the data transmission layer and decompress it. The real-time rendering and display module is connected to the data receiving and decompression module and is used to render and display the decompressed rendering data in real time. The virtual-real interaction module, connected to the real-time rendering and display module, is used to realize virtual-real interaction between urban entities and four-dimensional digital twins; The data transmission layer is used to enable data transmission between the cloud platform layer and the mobile terminal layer.

2. The real-time rendering system for mobile terminals based on a cloud platform according to claim 1, characterized in that, The multi-source heterogeneous data fusion module uses deep learning algorithms for feature fusion.

3. The real-time rendering system for mobile terminals based on a cloud platform according to claim 1, characterized in that, The local dynamic update module triggers a local update mechanism when the difference between real-time perceived data and historical data exceeds a preset threshold.

4. The real-time rendering system for mobile terminals based on a cloud platform according to claim 1, characterized in that, The artificial intelligence microservice module includes a data processing microservice, a model analysis microservice, and a rendering optimization microservice, which are used to provide model simplification, rendering optimization, and anomaly detection microservices. The model simplification microservice uses LOD technology to simplify the digital twin model.

5. The real-time rendering system for mobile terminals based on a cloud platform according to claim 1, characterized in that, The mobile terminal layer also includes a mobile platform high-definition rendering module, which is connected to the real-time rendering and display module and is used to improve the clarity of the rendering and display by using mobile platform high-definition rendering technology.

6. A real-time rendering method for mobile terminals based on a cloud platform, characterized in that, Includes the following steps: S1. The cloud platform layer receives multi-source heterogeneous data acquired from four-dimensional perception (space-air-ground-time) through the data receiving module; S2. The multi-source heterogeneous data fusion module uses a multi-source heterogeneous data fusion and scene digital reconstruction method to fuse multi-source heterogeneous data and generate fused data; S3. The digital twin base construction module constructs a digital twin base based on four-dimensional perception of space-sky-ground-time based on fused data; S4. The four-dimensional perception model construction module constructs a four-dimensional perception model based on the digital twin foundation; S5. The local dynamic update module uses the local dynamic update technology of the four-dimensional perception model to perform local dynamic updates on the four-dimensional perception model; S6. The AI ​​microservice module provides AI microservices for the construction of digital twin cities and processes the updated four-dimensional perception model; S7. The mobile terminal layer sends a rendering request to the cloud platform layer through the request sending module; S8. The rendering instruction generation module of the cloud platform layer generates rendering instructions based on the rendering request; S9. The cloud rendering module renders the digital twin scene according to the rendering instructions and generates rendering data; S10. The data compression module compresses the rendering data and transmits it to the mobile terminal layer through the data transmission layer. S11. The mobile terminal layer's data receiving and decompression module receives compressed rendering data and decompresses it; S12. The real-time rendering and display module renders and displays the decompressed rendering data in real time, while the virtual-real interaction module realizes the virtual-real interaction between the city entity and the four-dimensional digital twin.

7. The real-time rendering method for mobile terminals based on a cloud platform according to claim 6, characterized in that, In step S5, the local dynamic update technology includes real-time monitoring of data changes in the four-dimensional perception model, and dynamic updating of the corresponding local area when the amount of change exceeds a preset threshold.

8. The real-time rendering method for mobile terminals based on a cloud platform according to claim 6, characterized in that, In step S9, the cloud rendering module uses mobile platform high-definition rendering technology for rendering processing.

Images