A real-time simulation method and system based on digital twin

By building and configuring digital twin models and scenarios, the real-time linkage problem of digital twin technology in real-time simulation of workshop equipment and production lines is solved, synchronous simulation of virtual and real scenarios is realized, and the real-time and efficiency of the simulation system is improved.

CN116861652BActive Publication Date: 2024-11-15INSPUR WORLDWIDE SERVICES LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310784107.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-06-29
Publication Date
2024-11-15
Estimated Expiration
2043-06-29

Smart Images

  • Figure CN116861652B_ABST
    Figure CN116861652B_ABST
Patent Text Reader

Abstract

The present invention belongs to the field of real-time simulation technology, and specifically discloses a real-time simulation method and system based on digital twins, including: constructing a corresponding twin model for an actual scene, and building a twin scene corresponding to the actual scene; configuring mapping files for the mapping relationships between collected signals and custom signals, custom signals and components of simulation models, and motion strategies and internal event responses; obtaining motion data of a target object, and associating and binding the data with a simulation model corresponding to the target object based on the mapping file; sending the data to the twin scene in chronological order, and converting the running data into simulation control parameters for the motion of the simulation model based on the association and binding; it has the following advantages: the association relationship between the actual scene and the twin scene can be quickly maintained, and after switching between the twin scene, the simulation model and the event response, the target can be quickly switched for simulation, and the motion logic of the actual scene and the twin scene can be closer by sending data in chronological order.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of real-time simulation technology, and in particular to a real-time simulation method and system based on digital twins. Background Art

[0002] Digital twin technology is to build virtual digital models of real-world entities, processes or systems to achieve real-time simulation, monitoring and analysis to provide decision support and optimize the efficiency and sustainability of various application areas. Currently, the twin cases for workshop equipment and production lines are still in the form of signal start-stop control process animation or direct playback of process animation, which cannot be linked with actual equipment in real time, resulting in the lack of the function of real-time simulation combining virtual and real.

[0003] To this end, a real-time simulation method and system based on digital twins are proposed to solve the above-mentioned problems. Summary of the invention

[0004] The present invention aims to provide a real-time simulation method based on digital twins to solve or improve at least one of the above-mentioned technical problems.

[0005] In view of this, a first aspect of the present invention is to provide a real-time simulation method based on digital twins.

[0006] A second aspect of the present invention is to provide a real-time simulation system based on digital twins.

[0007] The first aspect of the present invention provides a real-time simulation method based on digital twins, comprising the following steps: constructing a corresponding twin model for an actual scene, and building a twin scene corresponding to the actual scene; configuring mapping files for the mapping relationship between the acquisition signal of the actual scene and the custom signal of the twin scene, the mapping relationship between the custom signal of the twin scene and the components of the simulation model, and the mapping relationship between the motion strategy of the twin scene and the internal event response of the twin scene; acquiring the motion data of the target object in the actual scene through a data acquisition module, and associating and binding the motion data with the simulation model corresponding to the target object based on the mapping file; sending the data to the twin scene in chronological order, and converting the motion data into simulation control parameters for the motion of the simulation model based on the association and binding.

[0008] Specifically, the custom signal of the twin scene is a temporary signal maintained in the twin scene, and this signal is used as a transition to realize the association mapping association between the collected signal and the simulation model.

[0009] Specifically, the actual scene is the factory assembly line and its production equipment for scene simulation to be constructed by the real-time simulation method, such as a robotic arm on a transportation line.

[0010] Furthermore, the mapping file is a json file, and the json file includes: a first file, used to characterize the mapping relationship between the acquisition signal and the definition signal; a second file, used to characterize the mapping relationship between the definition signal and the simulation model; a third file, used to characterize the mapping relationship between the definition signal and the event response.

[0011] Furthermore, the data includes: Boolean quantity data for characterizing the response to the grab and release event of the movement of the target object; and data quantity data for characterizing the response to the posture feature of the movement of the target object.

[0012] Furthermore, the event response includes: a grasping event response, which includes: an operation item response, an operated item response, a response interval response, a multi-model response strategy response and a position posture correction response of the simulation model; a release time response, which includes: an operation item response, an operated item response, a placement item strategy response, an operated item placement strategy response and a model strategy response of the simulation model.

[0013] Furthermore, the characteristic response includes: a rotation response and a translation response of the simulation model.

[0014] Furthermore, the step of sending the data to the twin scene in chronological order includes: obtaining the timestamp of the data volume data and pre-storing data containing the data volume data, and arranging the priority of the data volume data according to the timestamp; calculating the time difference Δt between the timestamps of adjacent sorted data volume data, and marking the time difference Δt in the data volume data with lower priority; setting the sending interval according to the time difference Δt, and sending the data to the twin scene.

[0015] Further, when the simulation model executes a characteristic response, the time for executing the characteristic response is equal to the time difference Δt marked on the data volume data representing the characteristic response.

[0016] Furthermore, all the event responses in the twin scene are encapsulated in the twin scene, which are used to control the simulation model to respond to the corresponding grasping and releasing movement of the target object according to the Boolean data in the collected data; the twin scene is provided with a driving engine, which is used to control the simulation model to respond to the corresponding position and posture movement of the target object according to the digital data in the collected data.

[0017] Furthermore, at least one simulation model is set in each of the twin scenes, and a mapping file is configured for the mapping relationship between each of the simulation models and the twin scene in which it is located.

[0018] The second aspect of the present invention proposes a real-time simulation system based on digital twins, including: a data acquisition module, used to acquire collected data on the movement of a target object in an actual scene; a mapping allocation module, used to maintain the association between the actual scene and the twin scene; a time management module, used to send and sort the collected data in chronological order; a data conversion module, used to realize the movement of simulation models through strategy analysis according to Boolean and digital quantity types; a simulation control module, used to reproduce the motion characteristics of the actual scene based on the twin scene.

[0019] Compared with the prior art, the present invention has the following beneficial effects:

[0020] Formulate model capture / release strategies, including operation strategies, operation strategies, designated area response strategies and other application strategies, and quickly apply corresponding strategies through JSON format configuration;

[0021] Formulate a time domain sorting strategy, that is, set the time cache variable DATA_CACHE to carry the signal push information, use the signal entry and exit method to release the signal one by one according to the execution time Δt, and execute it through the motion execution strategy;

[0022] By formulating a mapping strategy, the relationship between the actual scene and the twin scene can be quickly maintained. After the twin scene, simulation model and event response are switched, the target can be quickly switched for simulation.

[0023] By maintaining json format files, the digital twin real-time simulation system can be quickly configured to respond to different action operation strategies, implement data-driven models, reproduce the operation trajectory and operation of real objects in real time, and realize real-time scene mapping between reality and virtuality.

[0024] Additional aspects and advantages of embodiments according to the present invention will become apparent in the following description or may be learned through practice of embodiments according to the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0026] Figure 1 It is a logic block diagram of the method of the present invention;

[0027] Figure 2 is a flow chart of the method of the present invention;

[0028] Figure 3 It is a data collection flow chart of the present invention;

[0029] Figure 4 It is the data collection workflow diagram of the present invention;

[0030] Figure 5 A schematic diagram of the twin construction of the present invention;

[0031] Figure 6 It is a schematic diagram of the twin scenario of the present invention. DETAILED DESCRIPTION

[0032] In order to more clearly understand the above-mentioned purpose, features and advantages of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.

[0033] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those described herein. Therefore, the protection scope of the present invention is not limited to the specific embodiments disclosed below.

[0034] See also Figure 1-6 , the following describes real-time simulation methods and systems based on digital twins according to some embodiments of the present invention.

[0035] The embodiment of the first aspect of the present invention proposes a real-time simulation method based on digital twins. In some embodiments of the present invention, Figure 1-6 As shown, the real-time simulation method includes:

[0036] S1, build a corresponding twin model for the actual scene and build a twin scene corresponding to the actual scene.

[0037] Specifically, to build a three-dimensional model that is consistent with the actual size ratio, you can use industrial design software such as soildwork, PROE, UG to design components, or you can use 3dmax, blender, etc. for modeling.

[0038] The construction of twin scenes relies on the Inspur Chengfang digital twin engine platform. The engine library development is mainly reflected in camera transformation control, model action execution, model loading and parsing, model event following, model special effects, external material matching algorithms, UI dashboards, etc. Relying on this platform, twin scenes can be quickly built with low code.

[0039] S2, configure mapping files for the mapping relationship between the actual scene and the twin scene, the mapping relationship between the twin scene and the simulation model, and the mapping relationship between the twin scene and its internal event response.

[0040] From the above, we can know that we can customize the signal name and signal type in the json file, and specify the response of the model in each scene according to the defined signal. Through event response, we can drive the scene operation. Through configuration, we can quickly complete the binding of the trigger signal definition and the relationship between the signal and the model.

[0041] S3, acquiring data of a target object in an actual scene through a data acquisition module, and calibrating the data with a simulation model corresponding to the target object based on a mapping file.

[0042] Specifically, the OPCUA protocol is used to achieve data collection. The general process of the OPCUA data collection system is to first connect to the server according to the configuration file. If the connection is successful, the data can be collected into the digital twin scene. Otherwise, if the connection is not successful, it will try to reconnect every 5 seconds until the connection is successful or the system is shut down. After the data is connected, the data will be remapped and forwarded. As long as the data collection system is not shut down, it will continue to connect and forward.

[0043] S4, sends the data to the twin scene in chronological order, and converts the data into simulation control parameters for simulating model motion based on the calibration results.

[0044] Considering the delay of signal transmission, a time domain sorting strategy is formulated, that is, the time cache variable DATA_CACHE is set to carry the signal push information, and the signal entry and exit method is used to release the signal one by one according to the execution time Δt, and the motion execution strategy is used. Furthermore, the twin scene signal access function is built through the Websocket communication protocol.

[0045] The real-time simulation method based on digital twins provided by the present invention realizes the mapping of virtual and real objects by constructing twin entity modeling with the same size as the real object, realizes real-time data collection through opcua protocol communication with a collection frequency of hundreds of milliseconds, realizes communication between the collection end and the twin interface through the websocket protocol, realizes the scene model motion logic through event response encapsulation, realizes data and event response triggering through signal binding, and finally realizes the real-time reproduction of the running trajectory and action instructions of the real object in the twin scene.

[0046] Through the configured mapping file, after the switching of the twin scene, simulation model and event response, the maintenance work can be quickly switched and simulated. Sending data in time sequence can make the movement of the actual scene and the twin scene closer.

[0047] In any of the above embodiments, after the simulation model is constructed, the following processing needs to be performed:

[0048] The model is lightweighted and simplified as much as possible without distorting the details of the model; the model structure tree is adjusted according to the actual movement of the object, and the movement joints of each moving part are set; texture materials are made to make the equipment model appear more realistic; the model format is converted to a binary glb format and obtained through Draco compression, which can greatly reduce the size of the 3D model, thereby reducing the cost of network transmission and storage.

[0049] In any of the above embodiments, the twin scene construction specifically includes the following steps:

[0050] Build a basic 3D scene: The basic scene mainly includes three objects, the scene Scene, the camera Camera and the renderer Render. At the same time, in normal application, it also needs to include the object Object, the controller Contro and the light Light.

[0051] Model loading and parsing: Model loading and parsing refers to reading model files into the system framework and translating them into usable data structures to create, edit, and use 3D models in applications.

[0052] Among them, the following are some commonly used model loading and parsing techniques:

[0053] Reading model file format: The present invention adopts the binary glb format of reading and loading Draco compression.

[0054] Parse model data: Read data such as 3D meshes, vertex coordinates, normal vectors, texture coordinates, and material properties in the model file, and then convert them into in-memory data structures to preserve, edit, and use the model data.

[0055] Determines the details of loading and displaying: the scene part of the loaded file.

[0056] In this embodiment, the loading adopts the binary glb format and is parsed by asynchronous loading. The specific parsing content includes: the relative position of the model, the BOM structure of the model assembly, the built-in animation of the model, etc.

[0057] In any of the above embodiments, the mapping file is a json file, and the json file includes:

[0058] The first file is used to characterize the mapping relationship between the collected signal and the defined signal;

[0059] The second file is used to characterize the mapping relationship between the defined signal and the simulation model;

[0060] The third file is used to characterize the mapping relationship and policy maintenance relationship between the defined signals and event responses.

[0061] In this embodiment, fast access to semaphores is achieved through json file configuration.

[0062] In any of the above embodiments, the data includes:

[0063] Boolean data for representing a response to a grab and release event of the movement of the target object;

[0064] The amount of data used to characterize the posture feature response of the target object's motion.

[0065] In this embodiment, for Boolean quantities, mainly for the model organization following (grab / release) characteristics in the scene, the rising and falling edges of the signal are parsed, and repeated signal sources irrelevant to the grab and release information are filtered out. The response to the attach and release_attach events is parsed through the json configuration file. The grab event response contains parameter configurations such as operation items, operated items, response intervals, multi-model response strategies, position and posture corrections; the placement event response contains parameter configurations such as operation items, operated items, placed item response strategies, operated item placement strategies, and model response strategies.

[0066] For the digital quantity of the signal, mainly for the characteristic responses such as model rotation and translation, considering the delay of the signal during transmission, a time domain sorting strategy is formulated, that is, the time cache variable DATA_CACHE is set to carry the signal push information, and the signal entry and exit method is used to release the signal one by one according to the execution time Δt, and it is carried out through the motion execution strategy.

[0067] In any of the above embodiments, the event response includes:

[0068] Grasping event response, grasping event response includes: simulation model operation item response, operated item response, response interval response, multi-model response strategy response and position posture correction response.

[0069] Release time response, the release time response includes: operation item response of the simulation model, operation item response, placement item strategy response, operation item placement strategy response and model strategy response.

[0070] In this embodiment, the grab event response is configured through attach, wherein operator configures the name of the operation object, obj_name configures the operated item, distance configures the response space of the grab, multi_selected configures multiple operated items and operation groups, and set_pos configures the position and posture correction information; the release event response is configured through de_attach, wherein operator configures the name of the operation object, obj_name configures the operated item, multi_selected configures multiple operated items and operation groups, and set_pos configures the placement position and placement object as well as the posture correction information.

[0071] Specifically, the configuration is as follows:

[0072]

[0073]

[0074] In any of the above embodiments, the characteristic response includes: a rotation response and a translation response of the simulation model.

[0075] In this embodiment, the digital quantity in the parsed signal is analyzed. When it is consistent with the previous value, the event stops, that is, the simulation model does not need to respond. When it is inconsistent with the previous value, the model action is inserted through the twin engine method, the initial frame is the last execution stop bit, the end frame is the parsed bit corresponding to the acquired value, and the number of inserted frames is execution time / 0.05, that is, 20ms per frame, to ensure smooth operation of the page.

[0076] In any of the above embodiments, the step of sending data to the twin scene in chronological order includes:

[0077] The timestamp of the data volume data is obtained and the data containing the data volume data is pre-stored, and the data volume data priority is arranged according to the timestamp.

[0078] The time difference Δt between the timestamps of the sorted adjacent data volumes is calculated, and the time difference Δt is marked on the data volume with a lower priority.

[0079] Set the sending interval according to the time difference Δt and send data to the twin scene.

[0080] In this embodiment, since the data volume data involves the specific movement of the simulation model, it is necessary to limit the data sending interval according to the data stamp carried by the data volume data. The time difference is calculated by the timestamp when the data is collected, and the sending time interval is set between two adjacent data in time to ensure that the time difference for the data to arrive at the twin scene is the same as the time difference for collecting the data, thereby ensuring that the simulation model can be consistent with the target object in terms of process when continuously simulating the target object.

[0081] In any of the above embodiments, when the simulation model executes a characteristic response, the time for executing the characteristic response is equal to the time difference Δt marked on the data volume data representing the characteristic response.

[0082] In this embodiment, when the simulation model executes the feature response, the time difference of the mark is obtained so that the time interval when the feature response is executed is the same as the time difference of collecting the target object, further ensuring that the movement process of the simulation model is consistent with the target object.

[0083] In any of the above embodiments, all event responses within the twin scene are encapsulated in the twin scene, and are used to control the simulation model to respond to the corresponding target object movement according to the Boolean data in the data.

[0084] The twin scene is equipped with a driving engine, which is used to control the simulation model to respond to the corresponding target object movement according to the data volume data in the data.

[0085] In this embodiment, a set of event response mechanisms is encapsulated in the three-dimensional scene, and the model movement can be driven by simply accessing the real-time signal quantity and calling the method by passing the value.

[0086] In any of the above embodiments, at least one simulation model is set in the twin scene, and a mapping file is configured for the mapping relationship between each simulation model and the twin scene in which it is located.

[0087] In this embodiment, the number of simulation models is set in the twin scene according to the number of target objects that need to be simulated in the actual scene, and to ensure that each simulation model can model the target object individually.

[0088] The embodiment of the second aspect of the present invention proposes a real-time simulation system based on digital twins. In some embodiments of the present invention, the system includes:

[0089] The data acquisition module is used to collect data on the movement of target objects in the actual scene.

[0090] Specifically, the data acquisition module mainly includes three parts: configuration file, data access and data forwarding.

[0091] Mapping allocation module, used to maintain the association between the actual scene and the twin scene;

[0092] A time management module, used to send and execute acquisition signals in time sequence;

[0093] Data conversion module, used to implement scene movement through strategy analysis according to Boolean and digital quantity types;

[0094] The simulation control module is used to reproduce the motion characteristics of the actual scene based on the twin scene.

[0095] The embodiment of the second aspect of the present invention proposes a real-time simulation system based on digital twins, which can observe and browse the actual operating conditions and equipment input status on site in the twin scene, and timely grasp the actual operating conditions. The whole process is presented in a visual way, which can not only see the real-time display of sensitive parameters on site, but also simulate and restore the actual component operation status in real time through model actions, realizing the combination of static and dynamic. Through the intuitive, clear and accurate description in the digital twin scene, the display method is closer to reality, more in line with the human habit of cognitive world, and the display is more intuitive.

[0096] In any of the above embodiments, the configuration file is in json format, and its content is mainly the mapping of the network communication address and the signal required by the scene. If there are multiple servers, a json structure containing "endpointUrl" and "opcuaNodeId" is written in the inner json array (where endpointUrl is the server URL + port, and opcuaNodeId stores the definition name of each signal, and multiple signals are separated by commas).

[0097] If the data acquisition system runs locally, you only need to change the port number in ws_port. If the data acquisition system runs as a server, you need to change the corresponding ws_ip value and set the inbound and outbound rules in the advanced firewall settings.

[0098] The signal type defined in the digital twin interface must be maintained under "VariableName". The data acquisition system will map the signal defined in opcuaNodeId according to the maintained structure, and finally forward it in the json format of acquisition time + signal.

[0099] The configuration file must be named "info.json" and is preferably written in the current path. If there is no such file in the current path, all subdirectories under the current path will be recursively traversed. If none is found, a configuration file "info.json" will be created in the current path. However, this configuration file is only a template file, and the addresses, mappings, and other contents in the file need to be supplemented according to the actual situation.

[0100] In any of the above embodiments, when the data access device changes, its related transformation parameters are collected, and a local mapping is added, and then forwarded using the Websocket communication protocol, and a data log can be retained to facilitate local testing.

[0101] According to the server address information and NodeId, you can subscribe to the server's messages. When the device parameters change, the server will monitor the changes. At the same time, the server will package and publish the currently monitored content, and the data acquisition system will subscribe to the server's published content. In order to improve the consistency of the device and the display model, you can change the data acquisition system parameters, including the acquisition frequency, sampling interval, priority, etc.

[0102] To facilitate local testing and error tracking, when data collection starts, a text file named after the current time will be created in the current DataLog folder. This file stores the collected data. Each piece of data contains the timestamp of the collection and the corresponding data, and is stored in json format for easy reading and use.

[0103] In any of the above embodiments, data forwarding is when a monitored value changes, the data acquisition system obtains the data sent by the current server and parses the data, and associates the obtained data with the signal name defined by the digital twin through a mapping relationship through the defined info.json file, and after reorganizing the data structure, sends it to the digital twin interface through the Websocket communication protocol.

[0104] When the digital twin interface is opened and running, the data acquisition system will send the current values ​​of all defined signals once to ensure that the initialization state of the twin interface page is consistent with the actual scene.

[0105] Taking into account that the digital twin page may miss important values ​​at the beginning when forwarding data, the data acquisition system defines a buffer variable triggered by the execution action to store the real-time data of the current scene action execution node. In order to prevent the excessive amount of buffer variable data from affecting the normal operation of the data acquisition system, only one copy of the latest data is retained under each execution node signal. When the signal changes, the data from the same signal source is replaced. This function runs continuously throughout the entire acquisition life cycle.

[0106] When the digital twin interface is refreshed, the data acquisition system connection identifier is changed. Through the verification of the identifier information, the current values ​​of all signals in the action execution node buffer variables defined by the data acquisition system are sent to the digital twin page in the organizational order, ensuring that key data will not be lost each time the page reconnects to the data acquisition system.

[0107] When the server is offline, the data collection system initiates a reconnection request every five seconds until it connects to the server.

[0108] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0109] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this disclosure.

[0110] In the embodiments provided in the present disclosure, it should be understood that the disclosed devices / electronic devices and methods can be implemented in other ways. For example, the device / electronic device embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation. Multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, indirect coupling or communication connection of devices or units, which may be electrical, mechanical or other forms.

[0111] The above embodiments are only used to illustrate the technical solutions of the present disclosure, rather than to limit them. Although the present disclosure has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should all be included in the protection scope of the present disclosure.

Claims

1. A real-time simulation method based on digital twins, It is characterized in that The method comprises the following steps: constructing a twin model corresponding to the actual scene, building a twin scene corresponding to the actual scene, and also comprising: performing lightweight processing on the twin model; adjusting the model structure tree according to the movement of the real object, and setting the movement joints of each moving part; making texture materials; converting the twin model into a binary glb format, and performing Draco compression acquisition; The mapping files are configured for the mapping relationship between the acquisition signal of the actual scene and the custom signal of the twin scene, the mapping relationship between the custom signal of the twin scene and the components of the simulation model, and the mapping relationship between the motion strategy of the twin scene and the internal event response of the twin scene. Acquire motion data of a target object in the actual scene through a data acquisition module, and associate and bind the motion data with a simulation model corresponding to the target object based on the mapping file; Sending the data to the twin scene in chronological order, and converting the motion data into simulation control parameters for simulating model motion based on association binding; The mapping file is a json file, and the json file includes: A first file, used to characterize the mapping relationship between the acquisition signal and the definition signal; A second file is used to characterize the mapping relationship between the definition signal and the simulation model; A third file is used to characterize the mapping relationship between the defined signal and the event response; The data include: Boolean data for representing a response to a grab and release event of the movement of the target object; Data volume data for characterizing the posture characteristic response of the target object movement; The event response includes: Grasping event response, the grasping event response includes: operation item response, operated item response, response interval response, multi-model response strategy response and position posture correction response of the simulation model; A release event response, wherein the release event response includes: an operation item response, an operated item response, a placed item strategy response, an operated item placement strategy response, and a model strategy response of the simulation model; Wherein, the characteristic response includes: the rotation response and translation response of the simulation model; The method further includes: analyzing the digital quantity in the signal, when it is consistent with the previous value, the event stops, that is, the simulation model does not need to respond; when it is inconsistent with the previous value, the model action is interpolated by the twin engine method, the initial frame is the stop bit of the last execution, the end frame is the parsed bit corresponding to the acquired value, and the number of interpolation frames is the execution time / 0.05, that is, 20ms per frame; Wherein, the step of sending the data to the twin scene in chronological order includes: Obtaining a timestamp of the data volume data and pre-storing data containing the data volume data, and arranging a priority of the data volume data according to the timestamp; Calculate the time difference Δt between the timestamps of the adjacent data volumes in the sorting order, and mark the time difference Δt on the data volume with a lower priority; Setting a sending interval according to the time difference Δt, and sending the data to the twin scene; When the simulation model executes a characteristic response, the time for executing the characteristic response is equal to the time difference Δt marked on the data volume data representing the characteristic response.

2. According to the real-time simulation method based on digital twins according to claim 1, It is characterized in that All the event responses in the twin scene are encapsulated in the twin scene, and are used to control the simulation model to respond to the corresponding target object grasping and releasing motion according to the Boolean data in the collected data; The twin scene is provided with a driving engine for controlling the simulation model to respond to the corresponding target object posture movement according to the digital quantity data in the collected data.

3. According to the real-time simulation method based on digital twins according to claim 1, It is characterized in that At least one simulation model is set in each twin scene, and a mapping file is configured for the mapping relationship between each simulation model and the twin scene in which it is located.

4. A real-time simulation system for implementing the real-time simulation method according to any one of claims 1 to 3, It is characterized in that include: A data acquisition module is used to acquire data on the movement of a target object in an actual scene; Mapping allocation module, used to maintain the association between the actual scene and the twin scene; Time management module, used to send and sort the collected data in chronological order; Data conversion module, used to realize simulation model movement through strategy analysis according to Boolean and digital types; The simulation control module is used to reproduce the motion characteristics of the actual scene based on the twin scene.