A method, system and device for free combination and interaction of digital twin signals

Abstract

The present invention relates to the field of virtual reality technology, and specifically discloses a method, system and device for free combination and interaction of digital twin signals, by creating a visual interface that can be edited and connected, creating multiple digital twins in the visual interface, and selecting any two nodes of different digital twins for signal connection to complete signal interaction. At the same time, a digital twin signal free combination and interaction system is set, including a visual interface, a creation module, a parsing module, a system engine and a rendering engine to perform free combination and interaction of signals between any two digital twins. The present invention realizes the free combination and interaction of signals between digital twins through an editable and connectable visual interface, supports large-scale, flexible and combined real-time operation of digital twin systems, and improves the operation efficiency of signal interaction of digital twin systems.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and in particular to a method, system and device for free combination and interaction of digital twin signals. Background Art

[0002] A digital twin is an exact virtual copy of a physical entity in the digital world. The internal movement and change laws of the digital twin are the same as those of the physical object, that is, it lives like a physical object and corresponds to physical objects or processes in the real world. The appearance and internal structure model of the twin are consistent with the corresponding physical object, and the digital twin can autonomously receive, send and transmit signals, and can interact autonomously with other digital twins or physical machines.

[0003] XR (Extended Reality) is a general term for virtual reality (VR), augmented reality (AR) and mixed reality (MR), providing users with enhanced perception and interactive experience. With the rapid development of XR digital twin signal interaction technology, users can interact with digital twin models through signals, such as gesture recognition and tracking technology, eye tracking and gaze interaction technology, sound and voice interaction, object tracking and virtual-reality fusion.

[0004] In the field of digital twin technology, it is often necessary to build multiple digital twin models based on multiple physical models, and how to quickly realize the signal interaction between digital twins is a very important link. At present, the signal interaction between digital twins can be realized by programming, but the production efficiency is low, and this method requires the production staff to understand programming technology, which puts high demands on the production staff's programming technology and ability, resulting in great development difficulties. In addition, the interactive control programs between digital twins are tightly coupled, which makes it difficult to adapt to large-scale, flexible and changing combinations of real-time running digital twin systems. Summary of the invention

[0005] In order to overcome the problems of low efficiency and difficulty in signal interaction between digital twins in the prior art, the purpose of the present invention is to provide a method, system and equipment for free combination and interaction of digital twin signals, which supports large-scale, real-time and flexible free combination and interaction of twins in the digital twin system.

[0006] The present invention adopts the following technical solutions:

[0007] A method for free combination and interaction of digital twin signals, comprising the following steps:

[0008] S1: creating a visualization interface, where the visualization interface can be edited and connected, and multiple digital twins are created in the visualization interface;

[0009] S2: Select any two nodes of different digital twins to connect signals and complete signal interaction.

[0010] Furthermore, the digital twin includes parameter attributes, input attributes and output attributes.

[0011] The parameter attributes refer to the structural attributes of the inherent model of the physical object, such as mass, volume, length, geometric model structure shape, material, texture, etc.

[0012] The input attribute refers to the signal input of the twin.

[0013] The output attribute refers to the signal output of the twin,

[0014] When the data value types of the output attributes and input attributes of any two different twins in the digital twins are consistent, they can be directly connected. When the data value types of the output attributes and input attributes of any two different twins in the digital twins are different, they can be connected after the intermediate signal data value type conversion, so as to realize the free combination and interaction of the signals of any two digital twins.

[0015] Furthermore, the S2 step specifically includes:

[0016] S201: Parse the connection statement, collect the names and data types of the two ends of the connection line between the twin source node and the target node selected by the user on the visual editing interface, and obtain the data value types of the source node, the target node and the connection signal;

[0017] S202: According to the parsing result of S201, find the corresponding source node and target node by traversing the nodes of the twin;

[0018] S203: Find the output event of the source node, the system engine creates an event monitoring notification list for the output event, and adds the target node receiver to the event monitoring notification subscription list through the event notification interface, and establishes an automatic signal connection and transmission relationship between the output event signal and the target node receiver;

[0019] S204: extracting event data. When the output event of the source node has a signal output, the target node will receive the signal data of the event.

[0020] S205: Setting the target node data. The target node assigns the data of the source node output event to the corresponding input event of the target node through the data setting interface provided by the target node, thereby driving the internal operation of the target node, thereby realizing signal transmission between digital twins.

[0021] Furthermore, the S2 step further includes:

[0022] S206: Determine whether the basic properties of the target twin model have changed. The target node determines whether the input event is associated with the parameter property. If so, the model property is modified and updated and rendered. If not, the process ends.

[0023] Furthermore, the visualization interface can connect the signals of different twins by dragging the mouse.

[0024] The present invention also provides a digital twin signal free combination interaction system, which is used to execute the above-mentioned digital twin signal free combination interaction method.

[0025] Including visual interface, creation module, parsing module and system engine,

[0026] The creation module can create multiple different digital twins.

[0027] The analysis module collects and analyzes the data value types of the source nodes, target nodes and connection signals of any two twins.

[0028] The system engine connects and transmits signals between the source node and the target node.

[0029] Furthermore, a rendering engine is included for updating rendering.

[0030] Furthermore, the digital twin created by the creation module is set as a framework structure, including a data value type identifier, an output triangle number, and an input triangle number. The output triangle number of the corresponding numerical type of any two twins is selected by the mouse, and the mouse is dragged to the corresponding input triangle number of the other twin to generate a signal connection line and save it in the form of a connection statement.

[0031] Furthermore, the data value types of the digital twin include floating point numbers, integers, Booleans, time, strings, nodes, rotations, and three-dimensional vectors.

[0032] The present invention also provides a digital twin signal free combination interaction device,

[0033] including memory and processor,

[0034] The memory stores a program for free interaction of digital twin signals.

[0035] The processor executes the digital twin signal free combination interaction method according to the digital twin signal free interaction program in the memory.

[0036] The present invention has at least the following beneficial effects:

[0037] 1. The present invention provides a method for free combination and interaction of digital twin signals. By designing an editable and connectable visual interface, the signals of different twins can be connected by dragging the mouse. The operation is simple and the whole process is fast and efficient.

[0038] 2. The present invention provides a method for free combination and interaction of digital twin signals. The visual interface can create multiple digital twins for signal interaction, which reduces the high requirements on the programming technology and capabilities of the production personnel, improves the efficiency of signal interaction between digital twins, and supports large-scale, flexible and changing combinations of real-time running digital twins for signal interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 A flowchart of a method for free combination and interaction of digital twin signals provided by the present invention;

[0040] Figure 2 A specific step diagram of a method for free combination and interaction of digital twin signals provided by the present invention;

[0041] Figure 3 A digital twin diagram of a method for free interaction of digital twin signals provided in Example 2;

[0042] Figure 4 A visualization interface diagram of a method for free interaction of digital twin signals provided in Example 2. DETAILED DESCRIPTION

[0043] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0044] Embodiment 1

[0045] Combination Figure 1 , Figure 2 As shown, the method for free combination and interaction of digital twin signals disclosed in the present invention specifically includes two steps:

[0046] S1: creating a visualization interface, where the visualization interface can be edited and connected, and multiple digital twins are created in the visualization interface;

[0047] S2: Select any two nodes of different digital twins to connect signals and complete signal interaction.

[0048] The digital twin includes parameter attributes, input attributes and output attributes.

[0049] The parameter attributes refer to the structural attributes of the inherent model of the physical object, such as mass, volume, length, geometric model structure shape, material, texture, etc.

[0050] The input attribute refers to the signal input of the twin.

[0051] The output attribute refers to the signal output of the twin,

[0052] When the data value types of the output attributes and input attributes of any two different twins in the digital twins are consistent, they can be directly connected. When the data value types of the output attributes (source twins) and input attributes (target twins) of any two different twins in the digital twins are different, they are connected after the intermediate signal data value type conversion. The specific operation is to create a third digital twin node to convert the output attributes of the source twin to be transmitted into the data type of the input attributes of the target twin, so as to realize the free combination and interaction of the signals of any two digital twins.

[0053] Among them, data value types include floating point numbers, integers, Booleans, times, strings, nodes, rotations, and three-dimensional vectors.

[0054] The specific operations of step S2 are:

[0055] S201: Parse the connection statement, collect the names and data types of the two ends of the connection line between the twin source node and the target node selected by the user by dragging the mouse on the visual editing interface, and obtain the data value types of the source node, the target node and the connection signal;

[0056] S202: According to the parsing result of S201, find the corresponding source node and target node by traversing the nodes of the twin;

[0057] S203: Find the output event of the source node, the system engine creates an event monitoring notification list for the output event, and adds the target node receiver to the event monitoring notification subscription list through the event notification interface, and establishes an automatic signal connection and transmission relationship between the output event signal and the target node receiver;

[0058] S204: extracting event data. When the output event of the source node has a signal output, the target node will receive the signal data of the event.

[0059] S205: Setting target node data. The target node assigns the data of the source node output event to the corresponding input event of the target node through the data setting interface provided by the target node, thereby driving the internal operation of the target node, thereby realizing signal transmission between digital twins;

[0060] S206: Determine whether the basic properties of the target twin model have changed. The target node determines whether the input event is associated with the parameter property. If so, the model property is modified and updated and rendered. If not, the process ends.

[0061] The present invention discloses a method for free combination and interaction of digital twin signals. By designing a visual interface that can be edited and connected, multiple digital twins can be created at the same time. The data value types of any two twins can be selected by dragging the mouse to connect them and then the signals can be freely interacted.

[0062] Embodiment 2

[0063] The present invention discloses a method for free combination and interaction of digital twin signals, which creates a visual interface that can be edited and connected, creates a digital twin A and a digital twin B in the visual interface, selects a node of the digital twin A and a node of the digital twin B to perform signal connection to complete signal interaction,

[0064] like Figure 2 As shown, digital twin A and digital twin B include input attributes and output attributes. Signal input 1, signal input 2, ..., signal input m all belong to the input attribute type, and signal output 1, signal output 2, ..., signal output m belong to the output attribute type. Digital twin A and digital twin B are connected by a signal connection line.

[0065] like Figure 3 As shown, a framework diagram of digital twin A and digital twin B is created in a visual interface, both of which include a data value type identifier, an output triangle number and an input triangle number. The output triangle number is equivalent to the output attribute of the digital twin, and the input triangle number is equivalent to the input attribute of the digital twin. The signal connection line is generated by dragging the mouse to connect. Press the left button of the mouse and click the output triangle number. Drag the mouse to the corresponding input triangle number to be connected to generate a signal connection line. At this time, the data value type corresponding to the output triangle number is equivalent to the source node, and the data value type corresponding to the input triangle number is equivalent to the target node. The connection line information is saved in the form of a connection statement, and the specific operation of step S2 in Example 1 is started to complete the signal interaction between digital twin A and digital twin B.

[0066] When it is necessary to complete signal interaction of other data value types between digital twin A and digital twin B, just repeat the above steps.

[0067] Embodiment 3

[0068] The present invention also discloses a digital twin signal free combination interaction system, which is used to execute a digital twin signal free combination interaction method described in Embodiment 1 and Embodiment 2.

[0069] Including visual interface, creation module, parsing module, system engine and rendering engine,

[0070] Among them, the creation module can create multiple different digital twins. The created digital twins are set as a framework structure, including data value type identifier, output triangle number, and input triangle number. Use the mouse to select the output triangle number of the corresponding numerical type of one of any two twins, drag the mouse to the corresponding input triangle number of the other twin, generate a signal connection line, and save it in the form of a connection statement.

[0071] The parsing module collects and analyzes the data value types of the source nodes, target nodes and connection signals of any two twins.

[0072] The system engine connects and transmits signals between the source node and the target node.

[0073] Rendering engine, used to update rendering.

[0074] A digital twin signal free combination interaction system disclosed in the present invention completes the free interaction of signals between any two digital twins by setting a visualization interface, a creation module, a parsing module, a system engine and a rendering engine, thereby improving the development and operation efficiency of the digital twin system, and the operation is simple and efficient.

[0075] Embodiment 4

[0076] The invention also discloses a digital twin signal free combination interaction device, including a memory and a processor,

[0077] Among them, the memory stores a program for free interaction of digital twin signals.

[0078] The processor executes the digital twin signal free combination interaction method of embodiment one and embodiment two according to the digital twin signal free interaction program of the memory.

[0079] The method, system and device for free combination and interaction of digital twin signals disclosed in the present invention can complete signal interaction of different data value types between any two digital twins by creating digital twins in an editable and connected visual interface, support large-scale operation of digital twin systems, and flexibly change and combine the entire process, thereby significantly improving the development and operation efficiency of the digital twin system.

[0080] The above descriptions are merely embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A digital twin signal free combination interaction method, characterized in that: The following steps are involved: S1: creating a visualization interface, where the visualization interface can be edited and connected, and multiple digital twins are created in the visualization interface; S2: Select any two nodes of different digital twins to connect signals and complete signal interaction.

2. A digital twin signal free combination interaction method according to claim 1, characterized in that: The digital twin includes parameter attributes, input attributes and output attributes. When the data value types of the output attributes and input attributes of any two different twins in the digital twin are consistent, they can be directly connected. When the data value types of the output attributes and input attributes of any two different twins in the digital twin are different, they can be connected after the intermediate signal data value type conversion, so as to realize the free combination and interaction of signals of any two digital twins.

3. A digital twin signal free combination interaction method according to claim 2, characterized in that: The S2 step specifically includes: S201: Parse the connection statement, collect the names and data types of the two ends of the connection line between the twin source node and the target node selected by the user on the visual editing interface, and obtain the data value types of the source node, the target node and the connection signal; S202: According to the parsing result of S201, find the corresponding source node and target node by traversing the nodes of the twin; S203: Find the output event of the source node, the system engine creates an event monitoring notification list for the output event, and adds the target node receiver to the event monitoring notification subscription list through the event notification interface, and establishes an automatic signal connection and transmission relationship between the output event signal and the target node receiver; S204: extracting event data. When the output event of the source node has a signal output, the target node will receive the signal data of the event. S205: Setting the target node data. The target node assigns the data of the source node output event to the corresponding input event of the target node through the data setting interface provided by the target node, thereby driving the internal operation of the target node, thereby realizing signal transmission between digital twins.

4. A digital twin signal free combination interaction method according to claim 3, characterized in that: The S2 step also includes: S206: determining whether the basic properties of the target twin model have changed, the target node determining whether the input event is associated with the parameter properties, if so, modifying the model properties, and performing update rendering.

5. A digital twin signal free combination interaction method according to claim 1, characterized in that: The visualization interface can connect the signals of different twins by dragging the mouse.

6. A digital twin signal free combination interaction system, used to execute a digital twin signal free combination interaction method according to any one of claims 1 to 5, characterized in that: It includes a visualization interface, a creation module, an analysis module and a system engine. The creation module can create multiple different digital twins. The analysis module collects and analyzes the data value types of the source nodes, target nodes and connection signals of any two twins. The system engine connects and transmits signals between the source nodes and the target nodes.

7. A digital twin signal free combination interaction system according to claim 6, characterized in that: Also includes a rendering engine, for updated rendering.

8. A digital twin signal free combination interaction system according to claim 7, characterized in that: The digital twin created by the creation module is set as a framework structure, including a data value type identifier, an output triangle number, and an input triangle number. Use the mouse to select the output triangle number of the corresponding data value type of one of any two twins, drag the mouse to the corresponding input triangle number of the other twin, generate a signal connection line, and save it in the form of a connection statement.

9. A digital twin signal free combination interaction system according to claim 8, characterized in that: The data value types of the digital twin include floating point numbers, integers, Booleans, time, strings, nodes, rotations, and three-dimensional vectors.

10. A digital twin signal free combination interaction device, characterized in that: It includes a memory and a processor, the memory stores a program for free interaction of digital twin signals, and the processor executes the digital twin signal free combination interaction method described in any one of claims 1 to 5 according to the program for free interaction of digital twin signals in the memory.

Images