High-precision scene cloud rendering optimization method based on digital twinning
By monitoring user click operations in real time in high-precision scene cloud rendering and prioritizing the matching of local attribute display information, the network complexity problem caused by frequent user interaction is solved, and faster and more efficient data display is achieved.
Patent Information
- Application Number
- CN202411565312.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-04
- Publication Date
- 2025-03-07
- Estimated Expiration
- 2044-11-04
AI Technical Summary
In high-precision scene cloud rendering, frequent interaction between users and rendered data leads to complex network communication and affects user experience, especially when it is necessary to frequently obtain relevant information of the model in the scene, the data transmission volume is large, resulting in delay in data display.
The rendering display unit monitors the user's click operation in real time, and prioritizes the matching of attribute display information in the local display file. If it does not exist, it will be transmitted to the cloud rendering unit for matching, reducing cloud interaction.
It effectively reduces interaction with the cloud, reduces interaction overhead, and displays information through local storage of frequently accessed attributes, reduces the amount of information transmitted, and optimizes the timely display of data.
Smart Images

Figure CN119579748A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of cloud rendering technology, and in particular to a high-precision scene cloud rendering optimization method based on digital twins. Background Art
[0002] With the rapid development of information technology, digital twin technology has been widely used in many fields, providing strong support for the accurate mapping and interaction between the physical world and the digital world. In the application of digital twins, cloud rendering of high-precision scenes is a key link; in today's digital age, the demand for high-precision scenes is growing. For example, in urban planning, it is necessary to accurately present the details of the city's buildings, roads, infrastructure, etc.; in the field of industrial manufacturing, the virtual display of complex mechanical equipment and production lines requires high realism; in the protection of cultural heritage, the digital reproduction of historical buildings and sites requires accurate restoration of every detail;
[0003] Currently, users will upload high-precision scene rendering files to the cloud in advance, and use the rich computing resources of the cloud to achieve efficient rendering processing, and ultimately achieve the purpose of online viewing. This measure not only ensures high standards and high efficiency of rendering effects, but also effectively reduces the pressure on local storage resources;
[0004] However, when users want to interact with rendered data, frequent cloud interaction requirements will undoubtedly increase the complexity of network communications, which may affect the overall user experience.
[0005] For example, when a user wants to learn relevant information about several models in a scene by clicking, he needs to click on the model to view the type of information he needs; for such data, if all is processed through the cloud, the amount of information transmitted needs to be increased, which is bound to be detrimental to the timely display of data.
[0006] In order to solve the above problems, the present invention proposes a solution. Summary of the invention
[0007] The purpose of the present invention is to provide a high-precision scene cloud rendering optimization method based on digital twins, in order to solve the problems raised in the above background technology;
[0008] The purpose of the present invention can be achieved through the following technical solutions:
[0009] The high-precision scene cloud rendering optimization method based on digital twins includes the following steps:
[0010] Step 1: The rendering display unit displays the rendering scene to the authorized user and monitors the click operation of the authorized user in the rendering scene in real time;
[0011] Step 2: When the authorized user clicks on a certain area in the rendering scene, a frame of image data corresponding to the area being clicked is obtained, and the position of the area in the image data is obtained, and a click event of the authorized user is generated based on the position of the image data;
[0012] Step three: Based on a click event of the authorized user, the attribute display information contained in the local display file is matched first. If it exists, the attribute display information that matches it is displayed to the authorized user for viewing. Otherwise, the click event is transmitted to the rendering display unit, and the rendering display unit matches the attribute display information that is consistent with it, and displays the attribute display information to the authorized user for viewing.
[0013] Furthermore, before completing step 1, you need to perform the following steps:
[0014] SS1: After the authorized user inputs the cloud rendering instruction, the rendering request unit transmits the cloud rendering instruction to the cloud rendering unit;
[0015] SS2: After receiving the cloud rendering instruction, the cloud rendering unit performs cloud rendering on the high-precision scene rendering file pre-stored therein to obtain rendering result data;
[0016] SS3: After receiving the rendering result data, the rendering display unit generates a rendering scene based on the rendering result data and displays it to the authorized user for viewing.
[0017] The high-precision scene rendering file contains scene description data, model data, material and texture data, environmental parameter data and subjective parameter data.
[0018] Furthermore, the scene description data includes the basic layout of the scene, the location, shape and size of the objects; the model data includes specific three-dimensional model files, including models of specific objects in the scene and the entire scene.
[0019] Beneficial effects of the present invention:
[0020] The present invention requests the cloud to render the pre-uploaded high-precision scene rendering file through the rendering request end, and the rendering display unit displays the rendering result data, and at the same time monitors the click operation of the authorized user in the high-precision scene in real time, and preferentially matches the attribute display information in the local display file to display it to the authorized user for matching. In this way, the interactive operations with the cloud can be effectively reduced, and the interactive overhead is reduced;
[0021] The attribute display information contained in the local display file of the present invention is based on the data capacity size and display times of the attribute display information. In this way, some frequently interacted attribute display information is stored locally for quick display and viewing, which effectively reduces the amount of information transmitted and optimizes the timely display of some data. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] The present invention will be further described below in conjunction with the accompanying drawings.
[0023] Figure 1 It is a flow chart of the method of the present invention. DETAILED DESCRIPTION
[0024] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0025] like Figure 1 As shown, a high-precision scene cloud rendering optimization method based on digital twins is performed by a high-precision scene cloud rendering optimization system based on digital twins, and the system includes a cloud rendering terminal and a rendering user terminal;
[0026] The rendering request end is used to authorize the user to render with the help of the cloud; the rendering request end includes a rendering request unit and a rendering display unit;
[0027] A cloud rendering terminal, used for cloud rendering of high-precision scene rendering files uploaded by authorized users, wherein the cloud rendering terminal includes a cloud rendering unit, an interactive analysis unit, and a rendering optimization unit;
[0028] After the authorized user inputs the cloud rendering instruction, the rendering request unit transmits the cloud rendering instruction to the cloud rendering terminal, and the cloud rendering terminal transmits the transmitted cloud rendering instruction to the cloud rendering unit after receiving it;
[0029] The cloud rendering unit includes a high-precision scene rendering file pre-stored by an authorized user, wherein the high-precision scene rendering file includes scene description data, model data, material and texture data, environmental parameter data, and subjective parameter data;
[0030] The scene description data includes the basic layout of the scene, the location, shape and size of the objects; the model data includes specific 3D model files, including models of specific objects in the scene and the entire scene; the material and texture data include material properties of the surface appearance of objects in the scene, including but not limited to color, glossiness, roughness and texture images, and the texture images include but are not limited to wood grain, masonry texture, etc.;
[0031] Environmental parameter data includes data on environmental factors such as lighting conditions, weather conditions, and time. Subjective parameter data includes the user's specific requirements for rendering quality, resolution, frame rate, etc. For example, the user specifies to observe the scene from a certain angle and requires rendering at 4K resolution.
[0032] After receiving the transmitted cloud rendering instruction, the cloud rendering unit performs cloud rendering on the high-precision scene rendering file of the corresponding authorized user to obtain rendering result data, wherein the rendering result data includes a plurality of frames of image data and an interactive capture script, and the plurality of frames of image data are used to generate a high-quality rendering scene for the authorized user to view;
[0033] The interactive capture script is used to identify the click action of the authorized user in the image data and locate the click area;
[0034] The cloud rendering unit transmits the rendering result data to the rendering display unit, which receives the rendering result data and generates a high-quality rendering scene based on the image data of several frames carried therein, and displays the rendered scene to the authorized user for viewing. At the same time, the interactive capture script is started to monitor the user's click operation in the rendering scene in real time.
[0035] When the authorized user clicks on a certain area in the rendering scene, a frame of image data corresponding to the clicked area is obtained, and the position of the area in the image data is obtained, a click event of the authorized user is generated according to the frame of image data and the position of the area in the image data, and the click event of the authorized user is transmitted to the cloud rendering unit;
[0036] After receiving the transmitted click event of the authorized user, the cloud rendering unit matches the corresponding attribute display information according to the image data carried therein and the position of the area in the image data, and transmits the attribute display information as feedback information of the click event to the rendering display unit;
[0037] After receiving the feedback information of the click event, the rendering and display unit displays it to the authorized user for viewing;
[0038] The interaction analysis unit analyzes all word click events of authorized users. The analysis steps are as follows:
[0039] S11: Obtain feedback information of all click events of the authorized user in the past, and select one attribute display information as data to be analyzed;
[0040] S12: Obtain the click weight A1 of the data to be analyzed, the calculation formula of the click weight is A1=B1 / C1, where B1 refers to the total number of the data to be analyzed displayed as feedback information in all past click events, and C1 refers to the total number of all past click events;
[0041] S13: Calculate and obtain the reserved evaluation amount E1 of the data to be analyzed using the formula E1=A1×ɑ1+D1×ɑ2, where ɑ1 and ɑ2 are respectively the preset first and second adjustment proportions, and D1 is the preset data capacity of the data to be analyzed;
[0042] S14: selecting the attribute display information included in all the feedback information of the click events of the authorized user in the past as the data to be analyzed in sequence according to S13, and calculating and obtaining the reserved evaluation amount of all the attribute display information in sequence;
[0043] Transmitting the reserved evaluation amount of the attribute display information contained in all the past click event feedback information of the authorized user to the rendering optimization unit;
[0044] The rendering optimization unit transmits the attribute display information corresponding to all reserved evaluation quantities whose values are greater than or equal to P1 as a local display file to the rendering display unit for pre-storage in the order of the reserved evaluation quantities from large to small, where P1 is the preset selected evaluation threshold;
[0045] The next time the authorized user clicks on a certain area in the rendering scene, the attribute display information contained in the local display file is matched first. If it cannot be found, a click event of the click is generated based on it, and the click event is transmitted to the cloud rendering unit;
[0046] In the description of the specification, the description with reference to the terms "one embodiment", "example", "specific example", etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.
[0047] The above contents are merely examples and explanations of the present invention. Those skilled in the art may make various modifications or additions to the specific embodiments described or replace them in a similar manner. As long as they do not deviate from the invention or exceed the scope defined by the claims, they shall all fall within the protection scope of the present invention.
[0048] The above is a detailed description of an embodiment of the present invention, but the content is only a preferred embodiment of the present invention and cannot be considered to limit the scope of implementation of the present invention. All equivalent changes and improvements made within the scope of the present invention should still fall within the scope of the patent coverage of the present invention.
Claims
1. A high-precision scene cloud rendering optimization method based on digital twins, characterized in that: The following steps are involved: Step 1: The rendering display unit displays the rendering scene to the authorized user and monitors the click operation of the authorized user in the rendering scene in real time; Step 2: When the authorized user clicks on a certain area in the rendering scene, a frame of image data corresponding to the area being clicked is obtained, and the position of the area in the image data is obtained, and a click event of the authorized user is generated based on the position of the image data; Step three: Based on a click event of the authorized user, the attribute display information contained in the local display file is matched first. If it exists, the attribute display information that matches it is displayed to the authorized user for viewing. Otherwise, the click event is transmitted to the rendering display unit, and the rendering display unit matches the attribute display information that is consistent with it, and displays the attribute display information to the authorized user for viewing.
2. The high-precision scene cloud rendering optimization method based on digital twins according to claim 1 is characterized in that: Before completing step 1, you need to do the following: SS1: After the authorized user inputs the cloud rendering instruction, the rendering request unit transmits the cloud rendering instruction to the cloud rendering unit; SS2: After receiving the cloud rendering instruction, the cloud rendering unit performs cloud rendering on the high-precision scene rendering file pre-stored therein to obtain rendering result data; SS3: After receiving the rendering result data, the rendering display unit generates a rendering scene based on the rendering result data and displays it to the authorized user for viewing.
3. The high-precision scene cloud rendering optimization method based on digital twins according to claim 1 is characterized in that: The high-precision scene rendering file contains scene description data, model data, material and texture data, environmental parameter data and subjective parameter data.
4. The high-precision scene cloud rendering optimization method based on digital twins according to claim 3 is characterized in that: The scene description data includes the basic layout of the scene, the location, shape and size of objects; the model data includes specific three-dimensional model files, including models of specific objects in the scene and the entire scene.
5. The high-precision scene cloud rendering optimization method based on digital twins according to claim 2 is characterized in that: The rendering result data also includes an interactive capture script, which is used to identify the click action of the authorized user in the image data and locate the click area.
6. The high-precision scene cloud rendering optimization method based on digital twins according to claim 1 is characterized in that: The steps for generating the local display file are as follows: S11: Obtain feedback information of all click events of the authorized user in the past, and select one attribute display information as data to be analyzed; S12: Obtain the click weight A1 of the data to be analyzed, the calculation formula of the click weight is A1=B1 / C1, where B1 refers to the total number of the data to be analyzed displayed as feedback information in all past click events, and C1 refers to the total number of all past click events; S13: Calculate and obtain the reserved evaluation amount E1 of the data to be analyzed using the formula E1=A1×ɑ1+D1×ɑ2, where ɑ1 and ɑ2 are respectively the preset first and second adjustment proportions, and D1 is the preset data capacity of the data to be analyzed; S14: selecting the attribute display information included in all the feedback information of the click events of the authorized user in the past as the data to be analyzed in sequence according to S13, and calculating and obtaining the reserved evaluation amount of all the attribute display information in sequence; The reserved evaluation amount of the attribute display information contained in the feedback information of all past click events of the authorized user; The rendering and display unit uses the attribute display information corresponding to all reserved evaluation quantities whose values are greater than or equal to P1 as a local display file in the order of the reserved evaluation quantities from large to small, where P1 is a preset selected evaluation threshold.
7. The high-precision scene cloud rendering optimization method based on digital twins according to claim 2 is characterized in that: The rendering display unit generates a high-resolution rendering scene according to the rendering result data and displays it to the authorized user for viewing, while starting the interactive capture script to monitor the user's click operation in the rendering scene in real time.
Citation Information
Patent Citations
WebGL-based large-scale scene rendering method
CN111415401A
High-definition rendering restoration system based on digital twinning L5-level simulation
CN116416386A
Intelligent logistics working method and system based on digital twinning and storage medium
CN116776627A
Method and system for replacing virtual scene resources by applying cloud rendering end, and storage medium
CN117395454A
Visual rendering method for digital twin fans based on WEBGL
CN117437341A