A method for generating a three-dimensional digital twin scene and a related device

Abstract

The present application discloses a method for generating a three-dimensional digital twin scene, including: adding a data acquisition node, a data processing node, and a three-dimensional model mapping node in an editor; using the data acquisition node to acquire real-time point data; using the data processing node to process the real-time point data; using the three-dimensional model mapping node to generate a three-dimensional rendering template according to the processing result of the data processing node; using a scene renderer to create a three-dimensional digital twin scene according to the three-dimensional rendering template. The application of this method can achieve low code complexity, high development efficiency, and real-time preview. The present application also discloses a generation device, equipment, and computer-readable storage medium for a three-dimensional digital twin scene, all of which have the above-mentioned technical effects.

Description

Technical Field

[0001] The present application relates to the field of scene visualization technology, and in particular to a method for generating a three-dimensional digital twin scene; it also relates to a device, equipment and computer-readable storage medium for generating a three-dimensional digital twin scene. Background Art

[0002] Digital twins use data such as physical models, sensor updates, and operation history to integrate multi-disciplinary, multi-physical, multi-scale, and multi-probability simulation processes, complete mapping in virtual space, and thus reflect the entire life cycle of the corresponding physical equipment. At present, the construction method of three-dimensional digital twin scenes mainly uses code development. During the development process, developers need to understand the relevant three-dimensional development knowledge, which has a very high learning cost. The real-time preview is insufficient during development, the development difficulty is high, the development efficiency is low, and the developed scenes are not reusable. When there is a new scene requirement, it needs to be redeveloped, which requires a lot of manpower.

[0003] In view of this, providing a three-dimensional digital twin scene generation solution with low code complexity, high development efficiency and real-time preview has become a technical problem that needs to be urgently solved by technical personnel in this field. Summary of the invention

[0004] The purpose of this application is to provide a method for generating a three-dimensional digital twin scene, which has low code complexity, high development efficiency and real-time preview. Another purpose of this application is to provide a device, equipment and computer-readable storage medium for generating a three-dimensional digital twin scene, all of which have the above technical effects.

[0005] In order to solve the above technical problems, the present application provides a method for generating a three-dimensional digital twin scene, comprising:

[0006] Add data acquisition nodes, data processing nodes, and 3D model mapping nodes in the editor;

[0007] Using the data acquisition node to acquire real-time point data;

[0008] Processing the real-time point data using the data processing node;

[0009] Using the three-dimensional model mapping node to generate a three-dimensional rendering template according to the processing result of the data processing node;

[0010] A scene renderer is used to create a three-dimensional digital twin scene based on the three-dimensional rendering template.

[0011] Optionally, the acquiring real-time point data by using the data acquisition node includes:

[0012] The data acquisition node is used to obtain real-time point data through the websocket protocol.

[0013] Optionally, also include:

[0014] Adding a simulation data generation node in the editor;

[0015] The simulation data generation node is used to generate simulation data.

[0016] Optionally, also include:

[0017] Add an event management node in the editor;

[0018] The event management node is used to process event operations and convert the processing results into event data streams.

[0019] Optionally, also include:

[0020] Adding a logic operation node and an arithmetic operation node in the editor;

[0021] Using the logic operation node to perform logic operation on the data stream;

[0022] The arithmetic operation node is used to perform an arithmetic operation on the data stream.

[0023] Optionally, also include:

[0024] Add a basic data type node in the editor;

[0025] Configuration data is created using the basic data type node.

[0026] In order to solve the above technical problems, the present application also provides a device for generating a three-dimensional digital twin scene, comprising:

[0027] A data acquisition node adding module is used to add data acquisition nodes, data processing nodes and 3D model mapping nodes in the editor;

[0028] A data acquisition module, used to acquire real-time point data using the data acquisition node;

[0029] A data processing module, used for processing the real-time point data using the data processing node;

[0030] A template generation module, used to generate a three-dimensional rendering template according to the processing result of the data processing node using the three-dimensional model mapping node;

[0031] The scene creation module is used to use a scene renderer to create a three-dimensional digital twin scene according to the three-dimensional rendering template.

[0032] Optionally, the data acquisition module is specifically used to utilize the data acquisition node to acquire real-time point data through a websocket protocol.

[0033] In order to solve the above technical problems, the present application also provides a device for generating a three-dimensional digital twin scene, including:

[0034] Memory for storing computer programs;

[0035] A processor is used to implement the steps of the method for generating a three-dimensional digital twin scene as described in any one of the above items when executing the computer program.

[0036] To solve the above technical problems, the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method for generating a three-dimensional digital twin scene as described in any one of the above items are implemented.

[0037] The method for generating a three-dimensional digital twin scene provided in the present application includes: adding a data acquisition node, a data processing node and a three-dimensional model mapping node in an editor; using the data acquisition node to acquire real-time point data; using the data processing node to process the real-time point data; using the three-dimensional model mapping node to generate a three-dimensional rendering template according to the processing result of the data processing node; and using a scene renderer to create a three-dimensional digital twin scene according to the three-dimensional rendering template.

[0038] It can be seen that the method for generating a three-dimensional digital twin scene provided by the present application can arrange nodes in a simple drag-and-drop manner, generate a three-dimensional rendering template using the nodes, and then render the three-dimensional digital twin scene according to the generated three-dimensional template by the scene renderer. The whole process does not require code development, achieving the effect of low code design complexity. In addition, the technical solution provided by the present application uses pre-defined nodes, and the free combination of nodes can flexibly configure the scene, and complex three-dimensional display scenes can be quickly constructed by dragging, which can greatly improve efficiency. In addition, in the technical solution provided by the present application, when the nodes are configured, the data will flow between the nodes and continuously transmit new data. The new data generates a new three-dimensional rendering template, and the scene renderer parses the new three-dimensional rendering template, so that the three-dimensional digital twin scene can be rendered in real time, achieving a real-time preview of the scene effect.

[0039] The three-dimensional digital twin scene generation device, equipment and computer-readable storage medium provided in this application all have the above-mentioned technical effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the prior art and the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0041] Figure 1 A schematic diagram of a flow chart of a method for generating a three-dimensional digital twin scene provided in an embodiment of the present application;

[0042] Figure 2 A schematic diagram of data flow provided in an embodiment of the present application;

[0043] Figure 3 A schematic diagram of a device for generating a three-dimensional digital twin scene provided in an embodiment of the present application;

[0044] Figure 4 A schematic diagram of a device for generating a three-dimensional digital twin scene provided in an embodiment of the present application. DETAILED DESCRIPTION

[0045] The core of this application is to provide a method for generating a three-dimensional digital twin scene, which has low code complexity, high development efficiency and real-time preview. Another core of this application is to provide a device, equipment and computer-readable storage medium for generating a three-dimensional digital twin scene, all of which have the above-mentioned technical effects.

[0046] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0047] Please refer to Figure 1 , Figure 1 A schematic diagram of a process for generating a three-dimensional digital twin scene provided in an embodiment of the present application, referring to Figure 1 As shown, the method mainly includes:

[0048] S101: Adding a data acquisition node, a data processing node, and a 3D model mapping node in the editor;

[0049] S102: using the data acquisition node to acquire real-time point data;

[0050] S103: Processing the real-time point data using the data processing node;

[0051] S104: using the 3D model mapping node to generate a 3D rendering template according to the processing result of the data processing node;

[0052] S105: Using a scene renderer to create a three-dimensional digital twin scene according to the three-dimensional rendering template.

[0053] The data acquisition node is responsible for acquiring real-time point data. In some embodiments, the use of the data acquisition node to acquire real-time point data includes: using the data acquisition node to acquire real-time point data using a websocket protocol. The real-time point data may include the location, size, state, displayed text, and video of the three-dimensional digital twin scene.

[0054] Specifically, the data acquisition node can convert different data acquisition addresses into websocket connections, use the websocket protocol to establish a secure data channel with the server, and obtain real-time point data. After establishing a secure data channel with the server, in order to realize the flow of real-time point data, the data can be converted into a data stream so that the data can be transferred to subsequent nodes.

[0055] The data processing node is responsible for processing real-time point data. The data processing nodes mainly include anti-shake nodes, throttling nodes, data connection nodes, statistics nodes, delay nodes, data extraction nodes, animation transition nodes, switch nodes and data type conversion nodes. Anti-shake nodes and throttling nodes are used to control data flow. Data connection nodes are used to connect two data together. Statistics nodes are used to count the amount of data flowing. Delay nodes are used to delay the data to the next node. Data extraction nodes are used to extract a certain data from the passed data. Animation transition nodes are used to process a single data into a string of continuously changing data. Switch nodes are used to switch between true values ​​(true in programming) and false values ​​(false) after data is passed in. Data type conversion nodes are used to convert data types from one type to another.

[0056] The 3D model mapping node is connected to the scene renderer, which is responsible for generating a 3D rendering template for scene rendering based on the processing results of the data processing node after obtaining the processing results. The 3D rendering template contains the configuration data of the 3D digital twin scene.

[0057] The scene renderer obtains the 3D rendering template and completes the rendering according to the 3D rendering template to obtain the 3D digital twin scene. In addition, the scene renderer will also update the scene data when the 3D rendering template is updated. The scene data includes the background image of the scene, the video to be displayed, text, etc.

[0058] When you need to generate a three-dimensional digital twin scene, you only need to drag the data acquisition node, data processing node and three-dimensional model mapping node into the editor. The data acquisition node, data processing node and three-dimensional model mapping node will each perform corresponding operations to obtain a three-dimensional rendering module, and finally use the scene renderer to create a three-dimensional digital twin scene according to the three-dimensional rendering template.

[0059] Based on the above embodiments, in some embodiments, the following further includes:

[0060] Adding a simulation data generation node in the editor;

[0061] The simulation data generation node is used to generate simulation data.

[0062] The simulation data generation node is responsible for generating simulation data. The simulation data is used for early scene testing and later model animation. The simulation data generation nodes mainly include timer nodes, random number nodes, jitter data nodes, random motion nodes and automatic rotation nodes. The timer node is used to generate timing values. The random number node is used to generate random numbers. The jitter data node is used to generate three-dimensional vector data that changes back and forth within a range. The random motion node is used to generate three-dimensional vector data that changes randomly within a range. The automatic rotation node is used to generate a four-dimensional vector of increasing rotation angles.

[0063] Based on the above embodiments, in some embodiments, the following further includes:

[0064] Add an event management node in the editor;

[0065] The event management node is used to process event operations and convert the processing results into event data streams.

[0066] The event management node is responsible for processing mouse operations, keyboard operations, etc. in the 3D digital twin scene, and processes the results into event data streams. The processed result refers to the event description object generated by the event operation. For example, the location of a mouse click. Drag the event management node into the editor, and you can use the event management node to perform operations such as processing mouse operations.

[0067] Based on the above embodiments, in some embodiments, the following further includes:

[0068] Adding a logic operation node and an arithmetic operation node in the editor;

[0069] Using the logic operation node to perform logic operation on the data stream;

[0070] The arithmetic operation node is used to perform an arithmetic operation on the data stream.

[0071] The logic operation node is responsible for performing logic operations on a single or multiple data streams and returning the logic operation result data stream for subsequent logic control. The arithmetic operation node is responsible for performing arithmetic operations on a single or multiple data streams and returning the arithmetic operation result data stream for subsequent data control.

[0072] Based on the above embodiments, in some embodiments, the following further includes:

[0073] Add a basic data type node in the editor;

[0074] Configuration data is created using the basic data type node.

[0075] The basic data type node is responsible for creating configuration data, such as the coordinate position and appearance color of the three-dimensional digital twin scene.

[0076] For details about the data flow between data acquisition nodes, basic data type nodes, simulation data generation nodes, event management nodes, arithmetic operation nodes, data processing nodes, logical operation nodes, 3D model mapping nodes, and scene renderers, please refer to Figure 2 shown. Figure 2 The 3D renderer in refers to the scene renderer mentioned above.

[0077] In summary, the method for generating a three-dimensional digital twin scene provided by the present application can arrange nodes in a simple drag-and-drop manner, generate a three-dimensional rendering template using the nodes, and then render the three-dimensional digital twin scene according to the generated three-dimensional template by the scene renderer. The whole process does not require code development, achieving the effect of low code design complexity. In addition, the technical solution provided by the present application utilizes pre-defined nodes, and the free combination of nodes can flexibly configure the scene, and complex three-dimensional display scenes can be quickly constructed by dragging, which can greatly improve efficiency. In addition, in the technical solution provided by the present application, when the nodes are configured, the data will flow between the nodes and continuously transmit new data. The new data generates a new three-dimensional rendering template, and the scene renderer parses the new three-dimensional rendering template, so that the three-dimensional digital twin scene can be rendered in real time, achieving a real-time preview of the scene effect.

[0078] The present application also provides a device for generating a three-dimensional digital twin scene. The device described below can be referenced in correspondence with the method described above. Figure 3 , Figure 3 A schematic diagram of a device for generating a three-dimensional digital twin scene provided in an embodiment of the present application, combined with Figure 3 As shown, the device comprises:

[0079] A data acquisition node adding module 10 is used to add data acquisition nodes, data processing nodes and three-dimensional model mapping nodes in the editor;

[0080] A data acquisition module 20, used to acquire real-time point data using the data acquisition node;

[0081] A data processing module 30, used for processing the real-time point data using the data processing node;

[0082] A template generation module 40, configured to generate a three-dimensional rendering template using the three-dimensional model mapping node according to the processing result of the data processing node;

[0083] The scene creation module 50 is used to create a three-dimensional digital twin scene according to the three-dimensional rendering template using a scene renderer.

[0084] Based on the above embodiment, as a specific implementation mode, the data acquisition module 20 is specifically used to use the data acquisition node to acquire real-time point data through the websocket protocol.

[0085] Based on the above embodiment, as a specific implementation method, it also includes:

[0086] A simulation data generation node adding module, used for adding a simulation data generation node in the editor;

[0087] The simulation data generation module is used to generate simulation data using the simulation data generation node.

[0088] Based on the above embodiment, as a specific implementation method, it also includes:

[0089] An event management node adding module, used for adding an event management node in the editor;

[0090] The event operation processing module is used to process event operations using the event management node and convert the processing results into event data streams.

[0091] Based on the above embodiment, as a specific implementation method, it also includes:

[0092] An operation node adding module, used for adding logic operation nodes and arithmetic operation nodes in the editor;

[0093] A logic operation module, used for performing logic operation on the data stream using the logic operation node;

[0094] The arithmetic operation module is used to perform arithmetic operation on the data stream using the arithmetic operation node.

[0095] Based on the above embodiment, as a specific implementation method, it also includes:

[0096] A basic data type node adding module, used for adding basic data type nodes in the editor;

[0097] The configuration data creation module is used to create configuration data using the basic data type node.

[0098] The generation device of the three-dimensional digital twin scene provided by the present application can arrange nodes in a simple drag-and-drop manner, generate a three-dimensional rendering template using the nodes, and then the scene renderer renders the three-dimensional digital twin scene according to the generated three-dimensional template. The whole process does not require code development, achieving the effect of low code design complexity. In addition, the technical solution provided by the present application uses pre-defined nodes, and the free combination of nodes can flexibly configure the scene, and complex three-dimensional display scenes can be quickly constructed by dragging, which can greatly improve efficiency. In addition, in the technical solution provided by the present application, when the nodes are configured, the data will flow between the nodes and continuously transmit new data. The new data generates a new three-dimensional rendering template, and the scene renderer parses the new three-dimensional rendering template, so that the three-dimensional digital twin scene can be rendered in real time, achieving a real-time preview of the scene effect.

[0099] This application also provides a device for generating a three-dimensional digital twin scene, referring to Figure 4 As shown, the device includes a memory 1 and a processor 2 .

[0100] Memory 1, used for storing computer programs;

[0101] Processor 2 is used to execute the computer program to implement the following steps:

[0102] Add data acquisition nodes, data processing nodes and three-dimensional model mapping nodes in the editor; use the data acquisition nodes to acquire real-time point data; use the data processing nodes to process the real-time point data; use the three-dimensional model mapping nodes to generate a three-dimensional rendering template according to the processing results of the data processing nodes; use the scene renderer to create a three-dimensional digital twin scene according to the three-dimensional rendering template.

[0103] For an introduction to the equipment provided in this application, please refer to the above method embodiments, and this application will not go into details here.

[0104] The present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the following steps can be implemented:

[0105] Add data acquisition nodes, data processing nodes and three-dimensional model mapping nodes in the editor; use the data acquisition nodes to acquire real-time point data; use the data processing nodes to process the real-time point data; use the three-dimensional model mapping nodes to generate a three-dimensional rendering template according to the processing results of the data processing nodes; use the scene renderer to create a three-dimensional digital twin scene according to the three-dimensional rendering template.

[0106] The computer-readable storage medium may include: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

[0107] For an introduction to the computer-readable storage medium provided in this application, please refer to the above method embodiment, and this application will not go into details here.

[0108] The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other. For the devices, equipment, and computer-readable storage media disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple, and the relevant parts can be referred to the method part description.

[0109] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0110] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0111] The above is a detailed introduction to the generation method, device, equipment and computer-readable storage medium of the three-dimensional digital twin scene provided by the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. It should be pointed out that for ordinary technicians in this technical field, without departing from the principles of the present application, several improvements and modifications can be made to the present application, and these improvements and modifications also fall within the scope of protection of the claims of the present application.

Claims

1. A method for generating a three-dimensional digital twin scene, characterized in that: include: Add data acquisition nodes, data processing nodes, and 3D model mapping nodes in the editor; Using the data acquisition node to acquire real-time point data; Processing the real-time point data using the data processing node; Using the three-dimensional model mapping node to generate a three-dimensional rendering template according to the processing result of the data processing node; Using a scene renderer to create a three-dimensional digital twin scene according to the three-dimensional rendering template; Wherein, the acquiring of real-time point data by using the data acquisition node comprises: Utilize the data acquisition node to acquire real-time point data through the websocket protocol; wherein the real-time point data includes the position, size, status, displayed text and video of the three-dimensional digital twin scene; Among them, the data processing node includes an anti-shake node, a throttling node, a data connection node, a statistics node, a delay node, a data extraction node, an animation transition node, a switch node and a data type conversion node; the anti-shake node and the throttling node are used to control the data flow; the data connection node is used to connect two data together; the statistics node is used to count the amount of data flowing; the delay node is used to delay the data and pass it to the next node; the data extraction node is used to extract a certain data from the passed data; the animation transition node is used to process a single data into a string of continuously changing data; the switch node is used to switch between true value and false value after the data is passed in; the data type conversion node is used to convert the data type from one type to another type; Wherein, the method for generating the three-dimensional digital twin scene further includes: Adding a logic operation node and an arithmetic operation node in the editor; Using the logic operation node to perform logic operation on the data stream; The arithmetic operation node is used to perform an arithmetic operation on the data stream.

2. The generation method according to claim 1, characterized in that: Also includes: Adding a simulation data generation node in the editor; Generate simulation data using the simulation data generation node; The simulation data is used for early scene testing and later model animation; Among them, the simulation data generation node includes a timer node, a random number node, a jitter data node, a random motion node and an automatic rotation node; the timer node is used to generate a timing value; the random number node is used to generate a random number; the jitter data node is used to generate three-dimensional vector data that varies within a range; the random motion node is used to generate three-dimensional vector data that randomly varies within a range; the automatic rotation node is used to generate a four-dimensional vector of increasing rotation angles.

3. The generation method according to claim 1, characterized in that: Also includes: Add an event management node in the editor; Processing event operations using the event management node and converting the processing results into event data streams; Among them, the event management node is responsible for processing external device operations in the three-dimensional digital twin scene, and processing the processing results into event data streams.

4. The generation method according to claim 1, characterized in that: Also includes: Add a basic data type node in the editor; Creating configuration data using the basic data type node; The configuration data is the configuration data of the three-dimensional digital twin scene, including coordinate position and appearance color.

5. A device for generating a three-dimensional digital twin scene, characterized in that: include: A data acquisition node adding module is used to add data acquisition nodes, data processing nodes and 3D model mapping nodes in the editor; A data acquisition module, used to acquire real-time point data using the data acquisition node; A data processing module, used for processing the real-time point data using the data processing node; A template generation module, used to generate a three-dimensional rendering template according to the processing result of the data processing node using the three-dimensional model mapping node; A scene creation module, used to create a three-dimensional digital twin scene according to the three-dimensional rendering template using a scene renderer; The data acquisition module is specifically used to use the data acquisition node to acquire real-time point data through the websocket protocol; wherein the real-time point data includes the position, size, state, displayed text and video of the three-dimensional digital twin scene; Among them, the data processing node includes an anti-shake node, a throttling node, a data connection node, a statistics node, a delay node, a data extraction node, an animation transition node, a switch node and a data type conversion node; the anti-shake node and the throttling node are used to control the data flow; the data connection node is used to connect two data together; the statistics node is used to count the amount of data flowing; the delay node is used to delay the data and pass it to the next node; the data extraction node is used to extract a certain data from the passed data; the animation transition node is used to process a single data into a string of continuously changing data; the switch node is used to switch between true value and false value after the data is passed in; the data type conversion node is used to convert the data type from one type to another type; Wherein, the device for generating the three-dimensional digital twin scene further includes: An operation node adding module, used for adding logic operation nodes and arithmetic operation nodes in the editor; A logic operation module, used for performing logic operation on the data stream using the logic operation node; The arithmetic operation module is used to perform arithmetic operation on the data stream using the arithmetic operation node.

6. A device for generating a three-dimensional digital twin scene, characterized in that: include: Memory for storing computer programs; A processor, used to implement the steps of the method for generating a three-dimensional digital twin scene as described in any one of claims 1 to 4 when executing the computer program.

7. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method for generating a three-dimensional digital twin scene as described in any one of claims 1 to 4 are implemented.

Images