Transmission management and control system and transmission management and control method based on digital twinning

Abstract

The invention discloses a digital twinning-based transmission management and control method and transmission management and control system. The transmission management and control method comprises the following steps: constructing a scene model for a transmission workshop, and constructing a corresponding three-dimensional model for each physical device in the transmission workshop; importing the scene model and the three-dimensional model corresponding to each physical device into a digital twin system, and generating a virtual three-dimensional model corresponding to the transmission workshop; acquiring state data of each physical device in real time, wherein the virtual three-dimensional model judges whether the transmission state of each physical device in the transmission workshop is abnormal or not according to the state data; and if yes, analyzing in the virtual three-dimensional model, selecting an optimal parameter, and outputting the optimal parameter as a regulation and control instruction. The conveying accuracy, timeliness and the like of articles in the conveying workshop are ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of equipment monitoring, and particularly to a transmission control system and a transmission control method based on digital twin. Background Art

[0002] Digital twin is a technology for constructing a digital model of an object or a system in the real world, which can reflect the state, behavior, and performance of the object or system in the real world in real time. Currently, the research on digital twin platforms focuses on fields such as machining, construction, chemical industry, and textile. Take the display panel manufacturing as an example, there is less research and application in the field of panel transmission. Summary of the Invention

[0003] The purpose of the present invention is to provide a transmission control system and a transmission control method based on digital twin to solve the above problems.

[0004] To achieve the above purpose, the present invention provides a transmission control method based on digital twin, and the transmission control method includes:

[0005] Step A, constructing a scenario model for the transmission workshop, and constructing corresponding three-dimensional models for each physical device in the transmission workshop;

[0006] Step B, importing the scenario model and the three-dimensional models corresponding to each physical device into the digital twin system to generate a virtual three-dimensional model corresponding to the transmission workshop;

[0007] Step C, obtaining the status data of each physical device in real time, and the virtual three-dimensional model determines whether the transmission status of each physical device in the transmission workshop is abnormal according to the status data; if so, execute Step D; and

[0008] Step D, analyzing in the virtual three-dimensional model, selecting the optimal parameters, and outputting them as control instructions to the corresponding physical devices.

[0009] As an optional technical solution, constructing corresponding three-dimensional models for each physical device in Step A includes,

[0010] Step A1, respectively performing hierarchical analysis on each physical device in the transmission workshop, determining the parent-child relationship between the hierarchies, and combining the physical parameters in the two-dimensional layout diagram of each physical device, splitting the components in each physical device, and respectively performing three-dimensional modeling on each component; and

[0011] Step A2, assembling the three-dimensional models of each component and performing simulation verification, and determining whether the assembly simulation result is qualified; if qualified, exporting the three-dimensional model of the corresponding physical device; if not, reconstructing the three-dimensional models of each component and then executing Step A2 again.

[0012] As an alternative technical solution, in step A1, it includes performing a tree diagram analysis on each physical device in the transfer workshop, analyzing and disassembling each physical device modularly based on the assembly design principle to determine the parent-child relationship, and performing 3D modeling of each component through 3D software with the aid of the physical parameters of each physical device.

[0013] As an alternative technical solution, in step A2, if it is determined to be qualified, then based on the lightweight processing of the 3D max model, the 3D model of the corresponding physical device is exported and stored in the model library.

[0014] As an alternative technical solution, in step B, in the front-end and back-end separation mode, socket IO is used for the front-end and back-end full-duplex communication technology to generate the virtual 3D model corresponding to the transfer workshop.

[0015] As an alternative technical solution, the 3D models of each physical device are imported using the Three.js technology stack, combined with the scene model, and based on the front-end development framework Vue3.x, the virtual 3D model is generated; at the same time, using the axios interface technology, the status data of each physical device in the transfer workshop is obtained and received from the back-end data service interface.

[0016] As an alternative technical solution, in step C, the collected status data is hierarchically classified and integrated; the first-level classification is static data and dynamic data, and the second-level classification is further classified into data corresponding to each physical device according to the results of the first-level classification, a data table is established and integrated through the B / S architecture.

[0017] As an alternative technical solution, step D includes performing big data analysis and diagnosis, evaluating and optimizing with multi-intelligent optimization algorithms, and selecting the optimal parameters.

[0018] As an alternative technical solution, in step C, the abnormal transfer status of each physical device includes abnormal torque value, transfer timeout exception, or invalid delivery.

[0019] In addition, the present invention also provides a transmission control system based on digital twin. The transmission control system includes a model construction module, a digital twin system construction module, and a remote monitoring module. The model construction module is used to construct a scenario model for the transmission workshop and construct corresponding three-dimensional models for each physical device in the transmission workshop. The digital twin system construction module is used to import the constructed scenario model and the three-dimensional models of the corresponding physical devices into the digital twin system to generate a virtual three-dimensional model corresponding to the transmission workshop. The remote monitoring module is communicatively connected to the digital twin system construction module. The remote monitoring model is used to obtain the status data of each physical device in real time and determine whether the transmission status of each physical device in the transmission workshop is abnormal according to the status data. If so, analyze, select the optimal parameters, and output them as control instructions to the corresponding physical devices.

[0020] For the transmission control system and method based on digital twin of the present invention, after separately modeling each physical device in the transmission workshop, a virtual three-dimensional model corresponding to the transmission workshop is generated, that is, a unified visual control platform for transmission devices is established for each physical device in the transmission workshop. The status data of each physical device (this status data can be all-element information) is obtained in real time and mapped onto the virtual three-dimensional model. The virtual three-dimensional model can perform intelligent analysis and intelligent decision-making on the abnormal information in the status data, and output corresponding instructions to the corresponding physical devices to control each physical device, so as to ensure the accuracy and timeliness of item transmission in the transmission workshop.

[0021] The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments, but it is not intended to limit the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 is a schematic flow chart of the transmission control method based on digital twin of the present invention;

[0023] Figure 2 is a block diagram of the transmission control system based on digital twin of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0024] To further understand the purpose, structure, features and functions of the present invention, the following is a detailed description in conjunction with embodiments.

[0025] The descriptions of the following embodiments refer to the attached drawings to illustrate specific embodiments in which the present invention can be implemented. The directional terms mentioned in the present invention, such as "upper", "lower", "front", "rear", "left", "right", "side", etc., are only with reference to the directions of the attached drawings. Therefore, the directional terms used are for explaining and understanding the present invention, rather than for limiting the present invention.

[0026] Please refer toFigure 1 , Figure 1 is a schematic flow chart of the transmission control method based on digital twin of the present invention. As Figure 1 shown, the present invention discloses a transmission control method based on digital twin, which includes,

[0027] Step A (S110), constructing a scenario model for the transmission workshop and constructing corresponding three-dimensional models for each physical device in the transmission workshop;

[0028] Step B (S120), importing the scenario model and the three-dimensional models corresponding to each physical device into the digital twin system to generate a virtual three-dimensional model corresponding to the transmission workshop;

[0029] Step C (S130), obtaining the status data of each physical device in real time, and the virtual three-dimensional model determines whether the transmission status of each physical device in the transmission workshop is abnormal according to the status data; if so, execute Step D; and

[0030] Step D (S140), analyzing and selecting the optimal parameters in the virtual three-dimensional model and outputting them as control commands to the corresponding physical devices.

[0031] Please refer to Figure 2 , Figure 2 is a block diagram of the transmission control system based on digital twin of the present invention. As Figure 2 shown, the transmission control system based on digital twin of the present invention includes a model construction module 11, a digital twin system construction module 12, and a remote monitoring module 13. Among them, the model construction module 11 is used to construct a scenario model for the transmission workshop and construct corresponding three-dimensional models for each physical device in the transmission workshop. The digital twin system construction module 12 is used to import the constructed scenario model and the three-dimensional models corresponding to each physical device into the digital twin system to generate a virtual three-dimensional model corresponding to the transmission workshop. The remote monitoring model 13 is communicatively connected to the digital twin system construction module 12. The remote monitoring model 13 is used to obtain the status data of each physical device in real time and load the status data of each physical device into the virtual three-dimensional model to make the virtual three-dimensional model move synchronously with each physical device. By viewing the working condition information of the virtual three-dimensional model, the working conditions in the transmission workshop can be remotely monitored. Specifically, it can be determined whether the transmission status of each physical device in the transmission workshop is abnormal according to the status data. If so, after big data analysis and intelligent diagnosis, the optimal parameters are selected and output as control commands to the corresponding physical devices.

[0032] In one embodiment, the physical devices in the transfer workshop include a Kugel device, a cassette device, an overhead crane device, a monitoring device, a control device, etc. The monitoring device is arranged on the Kugel device, the cassette device and the overhead crane device. The control device is communicatively connected to the Kugel device, the cassette device and the overhead crane device. The control device is, for example, a PLC controller. Among them, the cassette device is used to carry the items to be transferred (such as display panels, etc.), and the overhead crane device is used to transfer the cassette device to the target position in the Kugel device. The monitoring device is used to collect the state data of physical devices such as the overhead crane device, the cassette device and the Kugel device, or so-called all-element information. The all-element information specifically includes the overhead crane device number, the overhead crane device speed, the implementation coordinates of the overhead crane device, the torque value of the overhead crane device, the cassette device type, the cassette device number, the cassette device number, the cassette device process, the storage state of the cassette device, the position information of the cassette device, the command information of the cassette device, the Kugel device number, the water level information of the Kugel device, etc.

[0033] In one embodiment, in step A, constructing a 3D model for each physical device in the transfer workshop includes:

[0034] Step A1, perform hierarchical analysis on each physical device in the transfer workshop and determine the parent-child relationship between the levels. Combine the physical parameters in the 2D layout diagram of each physical device, disassemble the components in each physical device, and perform 3D modeling on each component separately. Further, before the hierarchical analysis, it also includes the visualization requirement analysis of the transfer state of each physical device, the human-computer interaction function analysis of each physical device, and the data-driven function analysis of each physical device, etc.

[0035] Step A2, assemble the 3D models of each component and perform simulation verification to determine whether the assembly simulation result is qualified. If it is qualified, export the 3D model of the corresponding physical device. If not, after reconstructing the 3D models of each component, execute step A2 again. In one embodiment, if it is qualified, perform lightweight processing based on the 3D max model, then export the 3D model of the corresponding physical device, and store it in the model library.

[0036] In one embodiment, in step A1, perform hierarchical analysis on each physical device in the transfer workshop and determine the parent-child relationship between the levels. It further includes performing a tree diagram analysis on each physical device in the transfer workshop such as the overhead crane device, the cassette device and the Kugel device, and performing modular analysis and disassembly on each physical device according to the assembly design principle to determine the parent-child relationship. In step A2, perform 3D modeling on each component by means of the physical parameters of each device through 3D software.

[0037] In one embodiment, in step B, in the front-end and back-end separation mode, socket IO is used for full-duplex communication technology between the front-end and the back-end to generate a virtual three-dimensional model corresponding to the transfer workshop. The virtual three-dimensional model of the front-end visualization (i.e., the three-dimensional visualization control platform) is communicatively connected to the back-end data service interface. The virtual three-dimensional model of the transfer workshop generated by the front-end can visualize the status information of the crane device, the status information of the cassette device, the status information of the storage grid, the predicted transfer time, etc. The back-end data service, for example, uses a web API interface to receive and process the all-element information of each physical device in real time, classify and integrate it, so as to process the corresponding data of physical devices such as the crane device, the cassette device, and the storage grid device, in order to perform real-time mapping between the visual virtual three-dimensional model (virtual transfer workshop) and the physical transfer workshop. That is, the operating status of each physical device, etc., will be mapped to the corresponding twin model, constructing a real-time collaborative twin relationship between each physical device and the digital model, and the operating status of each physical device is displayed in real time through the virtual three-dimensional model. At the same time, each physical device can also be controlled by controlling the virtual three-dimensional model. Socket.IO is a real-time communication library based on Web Socket, which can provide simple and easy-to-use APIs to facilitate adding real-time communication functions to Web applications. The web API interface is a technology for communication and data exchange between different applications.

[0038] In one embodiment, in step B, after completing the three-dimensional modeling of physical devices such as the crane device, the cassette device, and the storage grid device, the Three.JS technology stack is imported, combined with the scene model. Based on the front-end development framework Vue3.x, using the axios interface technology, relevant information of each physical device in the transfer workshop is obtained and received from the back-end data service interface and processed. Based on the three.js technology stack, the relevant information, etc., is bound in the three-dimensional virtual model, and data-driven simulation is provided to achieve the mapping between the virtual and real spaces, thereby realizing the construction of the all-element three-dimensional visualization transfer control platform (i.e., the virtual three-dimensional model). In one embodiment, the back-end data service can use an SQL database to import multi-source data and use historical data to analyze past trends. This embodiment constructs a virtual three-dimensional model (i.e., the three-dimensional visualization control platform) corresponding to the transfer workshop based on the Three.JS technology stack and Vue3.X web development, providing an intuitive user interaction interface and real-time monitoring function, so that managers can operate the digital twin model and understand the operating conditions of the transfer workshop. Three.JS is a JavaScript library based on WebGL for creating and displaying 3D graphics on the browser, which can provide simple and easy-to-use APIs to build complex 3D scenes. Vue3.x is a modern JavaScript framework for building user interfaces.

[0039] In one embodiment, in step C, the status data of each physical device (which can be referred to as all-element information) is obtained in real time, and the back-end data service processes the all-element information including hierarchical classification and integration. For example, the all-element information is divided into two levels. The first-level classification is static data and dynamic data, and the second-level classification is further classified according to the first-level classification result. Specifically, when performing the second-level classification, both static data and dynamic data can be further subdivided into the corresponding data of each physical device. In this embodiment, when performing the second-level classification, the static data includes the corresponding data of the crane device, the cassette device, and the storage grid device, etc. Specifically, it can be the number and speed of the crane device, the number, path, and type of the cassette device, the storage grid number, etc.; the dynamic data includes the corresponding data of the crane device, the cassette device, and the storage grid device when performing the second-level classification. Specifically, it can be the command information, torque value, status, and position of the crane device, the process number, storage status, storage time, and position of the cassette device, the status and water level information of the storage grid device, etc. After the classification is completed, the background performs integration through the B / S architecture. Specifically, according to the characteristics of the workshop network communication architecture, an information mechanism is created to realize the integration of all-element information in the workshop, facilitate the processing of relevant data of physical devices such as crane devices, cassette devices, and storage grid devices, and realize the real-time mapping of the virtual three-dimensional model and the entity transfer workshop.

[0040] In one embodiment, in step B, after the virtual three-dimensional model corresponding to the transfer workshop is formed, the elements of the entire virtual three-dimensional model can be hierarchically sorted out. For example, four major hierarchical classifications are carried out in the relationship of single entity -> work station -> area -> workshop. At the same time, there are many sub-levels on the four major levels, and then multiple types of model hierarchical relationships are created. At the same time, for the transfer business process, four major view hierarchical relationships are created based on the four major hierarchical relationships. In the process of mapping the real to the virtual, for each physical device model, parent-child model management is established, and a motion trajectory equation is established through elements such as three-dimensional coordinates and speed to achieve the effect of mapping the physical device entity to the virtual model and achieve virtual-real synchronization; further, communication is established between the control device (such as a PLC controller) and the back-end data service interface of the virtual three-dimensional model of the transfer workshop for subsequent realization of the control of each physical device by the virtual three-dimensional model.

[0041] In one embodiment, after the hierarchical relationship of the virtual three-dimensional model corresponding to the transfer workshop is established, the parent-child relationship of the three-dimensional models of each physical device can be set to establish a motion trajectory equation, where the motion trajectory equation includes elements such as three-dimensional coordinates and speed. At the same time, the real-time database, PLC controller, and upper-layer system share data for data processing, processing, and analysis, and then the three-dimensional coordinates, speed, and other elements of each physical device are obtained. In this way, through real-time data acquisition, the movement of the virtual three-dimensional model in the information space can be controlled in real time, and the real-time mapping of the virtual three-dimensional model and the entity transfer workshop can be realized.

[0042] In one embodiment, after establishing the hierarchical relationship of the virtual 3D model corresponding to the transfer workshop, the view hierarchical relationship can be established, thereby visualizing the business process. When the virtual 3D model analyzes the real-time data and confirms the existence of abnormal information, parameter optimization is performed, and communication is carried out with the PLC controller through the backend interface to perform corresponding control adjustments on each physical device entity, so as to realize the control of the virtual model over the entity.

[0043] In one embodiment, in step C, the virtual 3D model calls the status data in real time for parameter update, analyzes the real-time data, and identifies abnormal situations. If it is determined that there are abnormal transfer information in each physical device in the transfer workshop (such as abnormal torque value of the crane device, transfer timeout abnormality, invalid delivery, etc.), then step D is executed. Step D includes performing big data analysis and diagnosis, such as transfer mechanism model analysis and transfer mechanism modeling, evaluating and optimizing with multi-intelligent optimization algorithms, selecting the optimal parameters, and outputting control instructions to the corresponding physical devices to adjust the parameters / instructions of each physical device. Among them, the algorithms used are, for example, genetic algorithms, bee colony algorithms, particle swarm algorithms, etc. In this way, combining big data analysis technology, artificial intelligence technology, and intelligent optimization algorithms, the abnormal information is diagnosed and analyzed, and based on the analysis results, optimal decisions are made for each physical device, such as adjusting the parameters and instructions of the physical device layer, to achieve the function of adaptive intelligent analysis and optimization decision-making for abnormal information.

[0044] In one embodiment, if the transfer workshop is used to transfer display panels, then all-element information during the transfer process of the display panel is monitored in real time, the status of each physical device is controlled online, and a visual 3D model of dynamic virtual-real mapping and virtual space feedback of the entity device can be built.

[0045] The transfer control system and transfer control method based on digital twin of the present invention generate a virtual 3D model corresponding to the transfer workshop after separately modeling each physical device in the transfer workshop, that is, a unified visual control platform for transfer devices is established for each physical device in the transfer workshop. The status data of each physical device is obtained in real time and mapped onto the virtual 3D model. The virtual 3D model can perform intelligent analysis and intelligent decision-making on the abnormal information in the status data, and output corresponding instructions to control each physical device, so as to ensure the accuracy and timeliness of item transfer in the transfer workshop.

[0046] Of course, the present invention can also have many other embodiments. Without departing from the spirit and essence of the present invention, those skilled in the art can make various corresponding changes and deformations according to the present invention, but these corresponding changes and deformations should all fall within the protection scope of the appended claims of the present invention.

Claims

1. A transmission control method based on digital twins, characterized in that: The transmission control method includes: Step A, constructing a scene model for a transmission workshop, and constructing a corresponding three-dimensional model for each physical device in the transmission workshop; Step B, importing the scene model and the three-dimensional models corresponding to each physical device into the digital twin system to generate a virtual three-dimensional model corresponding to the transmission workshop; Step C, obtaining the status data of each physical device in real time, and the virtual three-dimensional model determines whether the transmission status of each physical device in the transmission workshop is abnormal according to the status data; if so, executing step D; and Step D: Analyze and select the optimal parameters in the virtual three-dimensional model, and output them as control instructions to the corresponding physical equipment.

2. The transmission control method according to claim 1, characterized in that: In step A, a corresponding three-dimensional model is constructed for each physical device in the transmission workshop, including: Step A1, performing hierarchical analysis on each physical device in the transfer workshop, determining the parent-child relationship between the hierarchies, and combining the physical parameters in the two-dimensional layout diagram of each physical device, splitting the components in each physical device, and three-dimensionally modeling each component; as well as In step A2, the three-dimensional models of each component are assembled and simulated to determine whether the assembly simulation result is qualified; if qualified, the three-dimensional model of the corresponding physical device is exported; if not, the three-dimensional model of each component is reconstructed and step A2 is executed again.

3. The transmission control method according to claim 2, characterized in that: Step A1 includes performing a tree diagram analysis on each physical device in the transfer workshop, performing modular analysis and disassembly on each physical device based on assembly design principles, and determining parent-child relationships, and performing three-dimensional modeling of each component using three-dimensional software and the physical parameters of each physical device.

4. The transmission control method according to claim 2, characterized in that: In step A2, if it is determined to be qualified, it is lightweighted based on the 3D max model, and then the three-dimensional model of the corresponding physical device is exported and stored in the model library.

5. The transmission control method according to claim 1, characterized in that: In step B, in the front-end and back-end separation mode, socketIO is used for front-end and back-end full-duplex communication technology to generate the virtual three-dimensional model corresponding to the transmission workshop.

6. The transmission control method according to claim 5, characterized in that: The three-dimensional model of each physical device is imported into the Three.js technology stack, and matched with the scene model, the virtual three-dimensional model is generated based on the front-end development framework Vue3.x. At the same time, the axios interface technology is used to obtain and receive the status data of each physical device in the transmission workshop from the back-end data service interface.

7. The transmission control method according to claim 6, characterized in that: In step C, the collected status data is hierarchically classified and integrated; the first-level classification is static data and dynamic data, and the second-level classification is further classified into data corresponding to each physical device based on the results of the first-level classification, and a data table is established and integrated through the B / S architecture.

8. The transmission control method according to claim 7, characterized in that: Step D includes performing big data analysis and diagnosis, evaluating optimization with a multi-intelligent optimization algorithm, and selecting the optimal parameters.

9. The transmission control method according to claim 1, characterized in that: In step C, the transmission status abnormality of each physical device includes abnormal torque value, abnormal transmission timeout or invalid delivery.

10. A transmission control system based on digital twins, characterized in that: The transmission control system includes: A model building module is used to build a scene model for a transmission workshop and a corresponding three-dimensional model for each physical device in the transmission workshop; A digital twin system construction module, used to import the constructed scene model and the corresponding three-dimensional models of each physical device into the digital twin system to generate a virtual three-dimensional model corresponding to the transmission workshop; and The remote monitoring module is communicatively connected to the digital twin system building module. The remote monitoring model is used to obtain the status data of each physical device in real time and determine whether the transmission status of each physical device in the transmission workshop is abnormal based on the status data; if so, it analyzes and selects the optimal parameters, and outputs them as control instructions to the corresponding physical device.

Images