Multi-protocol integrated data processing device for industrial site digital twin operation

Abstract

The present invention relates to a multi-protocol integrated data processing device for industrial site digital twin operation. The device comprises: an industrial site digital twin generation unit for receiving industrial site data including operation data generated or detected in an operation process for at least one operation device and monitoring data generated by a monitoring device for an industrial site, and generating an industrial site digital twin; a dashboard unit for receiving the industrial site data through the industrial site digital twin to provide a user interface obtained by visualizing the industrial site digital twin, and providing a first control command for the at least one operation device or a second control command for the monitoring device through the user interface; and a central control unit for supporting multi-protocol-based data communication to communicate the industrial site data through a first protocol for supporting reliability, communicate the first control command and a first control response through a second protocol for real-time support, and communicate the second control command and a second control response through a third protocol for prompt transmission.

Description

Multi-protocol integrated data processing device for industrial site digital twin operation

[0001] The present invention relates to digital twin operation technology for industrial sites, and more specifically, to a multi-protocol integrated data processing device for industrial site digital twin operation that can provide a system capable of simultaneously ensuring low latency and reliability by efficiently transmitting and integrating various types of data, such as manufacturing process monitoring and the movement and status of mobile robots, using different protocols.

[0002]

[0003] Recently, equipment in industrial settings demands high productivity and reliability, and such productivity and reliability are closely related to the performance of the controllers in control platforms. In other words, high controller performance is required for high-speed, high-precision motion control of industrial robots, service robots, CNC machine tools, and semiconductor equipment. In such environments, low-latency data transmission is essential, and the optimal transmission method and protocol must be selected according to the nature of each data type.

[0004] However, conventional industrial equipment control technologies have limitations in applying transmission protocols optimized for the nature of various data. For example, existing systems primarily use a single protocol, making it difficult to strike a balance between speed and stability. Furthermore, they may experience degraded control performance due to their inability to effectively process large volumes of high-speed data. Consequently, these issues have a negative impact on the productivity and reliability of the equipment.

[0005] Korean Registered Patent No. 10-1308038 relates to an industrial network protocol integration module device and a control method thereof, comprising: an upper controller for selecting a first communication method for data communication among a plurality of different communication methods; an upper connector for connecting the upper controller to the outside; a plurality of master chips connected to the upper controller using the upper connector and each supporting the plurality of communication methods; a physical layer chip for receiving data from at least some of the plurality of master chips; a lower controller for receiving data from the physical layer chip and controlling at least one external device; and a lower connector connecting the lower controller and the physical layer chip.

[0006]

[0007] [Prior Art Literature]

[0008] [Patent Literature]

[0009] Korean Registered Patent No. 10-1308038 (September 6, 2013)

[0010]

[0011] One embodiment of the present invention aims to provide a multi-protocol integrated data processing device for industrial site digital twin operation capable of generating an industrial site digital twin based on industrial site data composed of operational data and monitoring data.

[0012] One embodiment of the present invention aims to provide a multi-protocol integrated data processing device for industrial site digital twin operation that can support multi-protocol-based data communication to communicate using a first protocol, a second protocol, and a third protocol according to industrial site data.

[0013]

[0014] Among the embodiments, a multi-protocol integrated data processing device for operating an industrial site digital twin includes: an industrial site digital twin generation unit that receives industrial site data consisting of operational data generated or detected during the operation of at least one operating device and monitoring data generated by a monitoring device for the industrial site, and generates an industrial site digital twin; a dashboard unit that receives the industrial site data through the industrial site digital twin and provides a user interface that visualizes the industrial site digital twin, and provides a first control command for the at least one operating device or a second control command for the monitoring device through the user interface; and a central control unit that supports multi-protocol-based data communication to communicate the industrial site data using a first protocol for reliability support, communicate the first control command and the first control response using a second protocol for real-time support, and communicate the second control command and the second control response using a third protocol for rapid transmission.

[0015] The above industrial site digital twin generation unit may request the above second control command by converting the above operational data from the above first protocol to the above second protocol and transmitting via FEC (Forward Error Correction) when the urgency of the above operational data exceeds a specific standard.

[0016] The above industrial site digital twin generation unit can set the operation data that detects an operational abnormality or emergency stop of at least one operating device such that the urgency is greater than the specific standard.

[0017] The above industrial site digital twin generation unit can provide an emergency notification by generating an accident report explaining the industrial accident when an industrial accident is detected during the analysis of the above monitoring data, transmitting the above monitoring data via the above first protocol, and converting and transmitting the above accident report via the above second protocol.

[0018] The above dashboard unit can generate reports for each of the at least one operating device and each of the monitoring devices during the visualization process of the industrial site digital twin, determine the necessity of control commands through reinforcement learning-based analysis of each report, and provide control command control for receiving the first and second control commands.

[0019] The central control unit above can temporarily create a session based on the second or third protocol while maintaining a session based on the TCP (Transmission Control Protocol) protocol for transmitting and receiving industrial site data.

[0020] The central control unit above can create an MQTT (Message Queuing Telemetry Transport) protocol-based session for real-time control and response to at least one operating device.

[0021] The central control unit above can create a session based on the UDP (User Datagram Protocol) protocol for rapid control and response to the monitoring device.

[0022]

[0023] The disclosed technology may have the following effects. However, this does not mean that a specific embodiment must include all of the following effects or only the following effects; therefore, the scope of the rights of the disclosed technology should not be understood as being limited by this.

[0024] A multi-protocol integrated data processing device for industrial site digital twin operation according to one embodiment of the present invention can generate an industrial site digital twin based on industrial site data composed of operation data and monitoring data.

[0025] A multi-protocol integrated data processing device for industrial site digital twin operation according to one embodiment of the present invention can support multi-protocol-based data communication to communicate using a first protocol, a second protocol, and a third protocol according to industrial site data.

[0026]

[0027] FIG. 1 is a diagram illustrating a multi-protocol integrated data processing system according to the present invention.

[0028] Figure 2 is a diagram illustrating the system configuration of the multi-protocol integrated data processing device of Figure 1.

[0029] Figure 3 is a diagram illustrating the functional configuration of the multi-protocol integrated data processing device of Figure 1.

[0030] FIG. 4 is a flowchart illustrating an embodiment of a multi-protocol integrated data processing method according to the present invention.

[0031] FIG. 5 is a diagram illustrating a transmission path according to an industrial site data type according to an embodiment of the present invention.

[0032]

[0033] The description of the present invention is merely an example for structural or functional explanation, and therefore the scope of the present invention should not be interpreted as being limited by the examples described in the text. That is, since the examples are subject to various modifications and may take various forms, the scope of the present invention should be understood to include equivalents capable of realizing the technical concept. Furthermore, the objectives or effects presented in the present invention do not imply that a specific example must include all of them or only such effects; therefore, the scope of the present invention should not be understood as being limited by them.

[0034] Meanwhile, the meaning of the terms described in this application should be understood as follows.

[0035] Terms such as "first," "second," etc., are intended to distinguish one component from another, and the scope of rights shall not be limited by these terms. For example, the first component may be named the second component, and similarly, the second component may be named the first component.

[0036] When it is stated that one component is "connected" to another component, it should be understood that it may be directly connected to that other component, or that there may be other components in between. Conversely, when it is stated that one component is "directly connected" to another component, it should be understood that there are no other components in between. Meanwhile, other expressions describing the relationships between components, such as "between" and "exactly between," or "adjacent to" and "directly adjacent to," should be interpreted in the same way.

[0037] A singular expression should be understood to include a plural expression unless the context clearly indicates otherwise, and terms such as "include" or "have" are intended to specify the existence of the implemented features, numbers, steps, actions, components, parts, or combinations thereof, and should be understood not to preclude the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0038] In each step, identifiers (e.g., a, b, c, etc.) are used for convenience of explanation and do not describe the order of the steps; the steps may occur differently from the specified order unless a specific order is clearly indicated in the context. That is, the steps may occur in the same order as specified, may be performed substantially simultaneously, or may be performed in the reverse order.

[0039] The present invention may be implemented as computer-readable code on a computer-readable recording medium, and the computer-readable recording medium includes all types of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. Additionally, the computer-readable recording medium may be distributed across networked computer systems, so that computer-readable code can be stored and executed in a distributed manner.

[0040] Unless otherwise defined, all terms used herein have the same meaning as generally understood by those skilled in the art to which this invention pertains. Terms defined in commonly used dictionaries should be interpreted as having meanings consistent with the context of the relevant technology and should not be interpreted as having an ideal or overly formal meaning unless explicitly defined in this application.

[0041]

[0042] FIG. 1 is a diagram illustrating a multi-protocol integrated data processing system according to the present invention.

[0043] Referring to FIG. 1, the multi-protocol integrated data processing system (100) may include an operating device (110), a monitoring device (111), a multi-protocol integrated data processing device (130), and a database (150).

[0044] The operating device (110) may correspond to a device that performs automation of manufacturing lines and equipment used in manufacturing processes at industrial sites, and may correspond to a robot as a representative example. The operating device (110) may include not only robots but also conveyors, automated machines, and assembly devices, and may include production support devices such as logistics equipment and inspection equipment, but is not necessarily limited thereto and may include various equipment capable of automating work or optimizing processes at industrial sites. In addition, the operating device (110) may be connected to a multi-protocol integrated data processing device (130) via a wired or wireless network and may transmit and receive data through the network.

[0045] In one embodiment, the operating device (110) may be implemented to include various sensors capable of monitoring the state or precisely controlling the operation. For example, the operating device (110) may include a temperature sensor, a pressure sensor, and a humidity sensor for monitoring the state of the operating device (110), and may further include a position sensor, a speed sensor, and an acceleration sensor for precise control of the operation process, without being limited thereto.

[0046] The monitoring device (111) may be implemented as a terminal device operated by a user and may include a camera module. In an embodiment of the present invention, the user may correspond to an industrial site worker or manager, wherein the user may be understood as one or more users, and each of the one or more users may correspond to one or more user terminals. The monitoring device (111) may be implemented as one device constituting a multi-protocol integrated data processing system (100) according to the present invention.

[0047] Additionally, the monitoring device (111) can be implemented as a smartphone, laptop, or computer that can be operated in connection with the multi-protocol integrated data processing device (130), and is not necessarily limited thereto, but can also be implemented as various devices including a camera module.

[0048] Meanwhile, the monitoring device (111) can be connected to the multi-protocol integrated data processing device (130) via a network, and multiple IoT cameras (110) can be connected to the multi-protocol integrated data processing device (130) simultaneously.

[0049] The multi-protocol integrated data processing device (130) may correspond to a computing device or server implemented to perform the multi-protocol integrated data processing method according to the present invention. The multi-protocol integrated data processing device (130) may be connected to an operating device (110) and a monitoring device (111) via a wireless network such as Bluetooth, WiFi, LTE, etc. to transmit and receive data, and may be implemented to operate by being connected to a plurality of operating devices (110) and monitoring devices (111) simultaneously.

[0050] The multi-protocol integrated data processing device (130) may be implemented to operate in conjunction with a separate external system (not shown in FIG. 1) for industrial site monitoring and industrial site data transmission according to the present invention. Here, industrial site data may correspond to data collected to monitor and analyze various equipment and process conditions, and may correspond, for example, to equipment operation data, process quality data, energy and resource usage data, etc. Additionally, the external system may include a Manufacturing Execution System (MES), Enterprise Resource Planning (ERP), and a cloud industrial site analysis platform. That is, the multi-protocol integrated data processing device (130) can be utilized not only for the purpose of collecting and monitoring industrial site data, but also provides scalability to be utilized for various purposes such as improving productivity, analyzing industrial site data, and predictive maintenance through linkage with an external system.

[0051] The database (150) may correspond to a storage device that stores various information required during the operation of the multi-protocol integrated data processing device (130). For example, the database (150) may store sensor data and status monitoring information collected from the operating device (110) and the monitoring device (111), or may store information for real-time control and maintenance management, but is not necessarily limited thereto, and may store information collected or processed in various forms during the process in which the multi-protocol integrated data processing device (130) performs the multi-protocol integrated data processing method according to the present invention.

[0052] In addition, in FIG. 1, the database (150) is shown as a device independent of the multi-protocol integrated data processing device (130), but it is not necessarily limited thereto and can be implemented as a logical storage device included in the multi-protocol integrated data processing device (130).

[0053]

[0054] Figure 2 is a diagram illustrating the system configuration of the multi-protocol integrated data processing device of Figure 1.

[0055] Referring to FIG. 2, the multi-protocol integrated data processing device (130) may include a processor (210), memory (230), user input / output unit (250), network input / output unit (270), and communication port unit (290).

[0056] The processor (210) can execute a multi-protocol integrated data processing procedure according to an embodiment of the present invention, manage memory (230) that is read or written during this process, and schedule the synchronization time between volatile memory and non-volatile memory in memory (230). The processor (210) can control the overall operation of the multi-protocol integrated data processing device (130) and can control the data flow between memory (230), user input / output unit (250), and network input / output unit (270) by being electrically connected to them. The processor (210) can be implemented as a CPU (Central Processing Unit) or GPU (Graphics Processing Unit) of the multi-protocol integrated data processing device (130).

[0057] The memory (230) may include an auxiliary storage device implemented as non-volatile memory such as an SSD (Solid State Disk) or HDD (Hard Disk Drive) and used to store all data required by the multi-protocol integrated data processing device (130), and may include a main memory device implemented as volatile memory such as RAM (Random Access Memory). Additionally, the memory (230) may store a set of instructions that execute the multi-protocol integrated data processing method according to the present invention by being executed by an electrically connected processor (210).

[0058] The user input / output unit (250) includes an environment for receiving user input and an environment for outputting specific information to the user, and may include an input device including an adapter such as a touch pad, touch screen, virtual keyboard, or pointing device, and an output device including an adapter such as a monitor or touch screen. In one embodiment, the user input / output unit (250) may correspond to a computing device connected via remote access, and in such case, the multi-protocol integrated data processing unit (130) may be performed as an independent server.

[0059] The network input / output unit (270) provides a communication environment for connecting to the operating device (110) through a network and may include an adapter for communication such as a LAN (Local Area Network), MAN (Metropolitan Area Network), WAN (Wide Area Network), and VAN (Value Added Network). Additionally, the network input / output unit (270) may be implemented to provide short-range communication functions such as WiFi and Bluetooth, or wireless communication functions of 4G or higher, for wireless transmission of data.

[0060] The communication port section (290) can be implemented as a port mapping table that performs data routing during the process of transmitting and receiving data through a network. Here, the communication port section (290) can distinguish communication sessions between the operating device (110) and the monitoring device (111) and the server by assigning unique source ports to the operating device (110) and the monitoring device (111), and prevent data collisions during the process of transmitting and receiving data.

[0061]

[0062] Figure 3 is a diagram illustrating the functional configuration of the multi-protocol integrated data processing device of Figure 1.

[0063] Referring to FIG. 3, a multi-protocol integrated data processing device (130) can perform a multi-protocol integrated data processing method according to the present invention. To this end, the multi-protocol integrated data processing device (130) may include an industrial site digital twin generation unit (310), a dashboard unit (330), a central control unit (350), and a control unit (370).

[0064] At this time, embodiments of the present invention are not required to include all of the above components simultaneously; depending on each embodiment, some of the components may be omitted, or some or all of the components may be selectively included. The operation of each component will be described in detail below.

[0065]

[0066] The industrial site digital twin generation unit (310) can generate an industrial site digital twin by receiving industrial site data composed of operational data generated or detected during the operation process of at least one operating device (110) and monitoring data generated from a monitoring device (111) for the industrial site. Here, the operational data may correspond to data that directly indicates the operating status and performance of the operating device (110) of the industrial site, and may include, for example, production speed, energy consumption, operating time, temperature value, pressure value, and location data. Additionally, the monitoring data may correspond to data collected by monitoring the environmental conditions surrounding the industrial site and the status of surrounding equipment or facilities by the monitoring device (111), and may include, for example, video data, worker location and entry / exit data.

[0067] In one embodiment, the industrial site digital twin generation unit (310) receives industrial site data from the operating device (110) and the monitoring device (110) and can generate an industrial site digital twin including the operating status, environmental conditions, and process flow of each operating device (110). For example, the industrial site digital twin generation unit (310) can digitize the operation of the operating device (110) based on the location and movement data of the operating device (110) and integrate visual information of the industrial site into the digital twin through the video data of the monitoring device (111).

[0068] In one embodiment, the industrial site digital twin generation unit (310) may request a second control command by converting the operational data from a first protocol to a second protocol and transmitting it via Forward Error Correction (FEC) when the urgency of the operational data exceeds a specific standard. Here, FEC transmission may correspond to a technology for transmitting data to correct errors that may occur during the data transmission process in advance. Additionally, the second control command may correspond to a command that can induce rapid action or change of situation regarding the operational device (110), and may include, for example, commands such as the occurrence of an abnormal phenomenon in the operational device (110), adjustment of work speed, inspection of the operational device (110), and process change. When the urgency of the operational data is below a specific standard, the industrial site digital twin generation unit (310) may transmit the operational data through a first protocol including a TCP (Transmission Control Protocol) protocol.

[0069] On the other hand, the industrial site digital twin generation unit (310) can convert and transmit operational data using a second protocol, such as the MQTT (Message Queuing Telemetry Transport) protocol, when the urgency of the operational data exceeds a certain standard. Here, the MQTT protocol may correspond to a lightweight message transmission protocol used in an IoT (Internet of Things) environment. That is, when the urgency of the operational data exceeds a certain standard, the industrial site digital twin generation unit (310) can convert and transmit using a second protocol that uses minimal network bandwidth and has a short latency for real-time communication.

[0070] In one embodiment, the industrial site digital twin generation unit (310) may set the urgency of the operation data that detects an operational abnormality or an emergency stop of at least one operating device (110) to be greater than a specific standard. For example, the industrial site digital twin generation unit (310) may set the urgency to be greater than a specific standard when the threshold set for specific indicators, such as the temperature, pressure, and speed of the operating device (110), is exceeded. In one embodiment, the industrial site digital twin generation unit (310) may monitor whether the temperature threshold of the operating device (110) is exceeded through a temperature sensor included in the operating device (110), and is not necessarily limited thereto, may determine the urgency of a specific operating device (110) through various sensors such as a pressure sensor and a speed sensor, and if the urgency is greater than a specific standard, may request a second control command for the operating device (110).

[0071] In one embodiment, the industrial site digital twin generation unit (310) may generate an accident report explaining the industrial accident when an industrial accident is detected during the analysis of monitoring data, and provide an emergency notification by transmitting the monitoring data using a first protocol and converting and transmitting the accident report using a second protocol. Here, the industrial accident may correspond to a fire, explosion, failure of operating equipment (110), collision accident, etc., occurring during the performance of work at the industrial site, and the accident report may correspond to a report providing an explanation regarding the type, time of occurrence, location, cause, and countermeasures of the industrial accident. The industrial site digital twin generation unit (310) may detect a specific industrial accident based on images collected from a monitoring device (111) and transmit an accident report including the cause and countermeasures of the industrial accident. Here, the industrial site digital twin generation unit (310) may transmit the monitoring data using a first protocol and convert and transmit the accident report using a second protocol for stable data transmission. Through this, the industrial site digital twin generation unit (310) can provide a real-time explanation of the industrial accident to the user by transmitting the accident report through the second protocol.

[0072] The dashboard unit (330) receives industrial site data through the industrial site digital twin and provides a user interface that visualizes the industrial site digital twin, and can provide a first control command for at least one operating device (110) or a second control command for a monitoring device (111) through the user interface. For example, the dashboard unit (330) can provide the user with an industrial site digital twin including the temperature, pressure, vibration, operating status, etc. of the operating device (110) by visualizing it through the user interface. Here, the dashboard unit (330) can provide the user with information such as the status, notifications, and work process steps of each operating device (110) and monitoring device (111) on the user interface, thereby providing the user with the industrial site situation and allowing them to request a control command according to the industrial site situation.

[0073] For example, the dashboard unit (330) may provide a first control command as a control command to control a specific operating device (110) and a second control command as a control command to control a specific monitoring device (111). Here, the dashboard unit (330) may change the operating state of the operating device (110) by providing a first control command to the specific operating device (110) that includes starting, stopping, speed control, and work process change. Additionally, the dashboard unit (330) may enable the monitoring device (1110) to perform tasks such as adjusting the sensitivity of the monitoring system, adjusting the update cycle of sensor data, and changing notification settings for specific situations by providing a second control command to the specific monitoring device (111).

[0074] In one embodiment, the dashboard unit (330) can generate reports for at least one operating device (110) and one monitoring device (111) during the visualization process of the industrial site digital twin, and determine the necessity of a control command through reinforcement learning-based analysis of each report, thereby providing a control command control for receiving first and second control commands. For example, the dashboard unit (330) can generate an operating device (110) report for each operating device (110) that includes operating device (110) information such as device name, device ID, location, operating status, etc., and real-time operating device (110) data such as current temperature, vibration status, current consumption, operating time, and energy efficiency. By providing the operating device (110) report as input to a reinforcement learning model, the dashboard unit (330) can determine whether to generate a control command to control a specific operating device (110) based on the operating device (110) report. For example, the dashboard unit (330) can monitor the status of a specific operating device (110) and generate control commands to control the operation of the operating device (110) by analyzing the operating device (110) report based on a reinforcement learning model.

[0075] Additionally, the dashboard unit (330) can generate reports for each monitoring device (111), including records of temperature and humidity fluctuations within the industrial site, air quality, fire and gas leak detection, etc. In one embodiment, the dashboard unit (330) can provide control command controls for controlling the operating device (110) and the monitoring device (111) based on the reports for each operating device (110) and the reports for each monitoring device (111).

[0076] For example, the dashboard unit (330) can allow the user to directly input control commands within the report by providing a user interface composed of buttons, drop-down menus, and input windows for the first and second control commands. Through this, the dashboard unit (330) can provide a second control command to control the temperature of the operating device (110) through control command control, for example, when the report of a specific operating device (110) includes content related to a temperature exceedance.

[0077] The central control unit (350) can support multi-protocol-based data communication by communicating industrial site data using a first protocol for reliability support, communicating first control commands and first control responses using a second protocol for real-time support, and communicating second control commands and second control responses using a third protocol for rapid transmission. Here, the third protocol may correspond to a protocol used in situations requiring rapid transmission, such as UDP (User Datagram Protocol). The central control unit (350) can perform communication based on the first protocol to support reliability during the process of verifying industrial site data or returning the results of command execution. For example, in the case of industrial site data including equipment operation data, process quality data, energy and resource usage data, etc., the central control unit (350) can accurately deliver industrial site data to the user by performing data transmission based on the first protocol, such as the TCP protocol.

[0078] Additionally, the central control unit (350) may perform communication based on a second protocol to provide real-time support to a specific operating device (110) in the event that real-time control of the specific operating device (110) is required due to the occurrence of industrial accidents, etc. For example, the central control unit (350) may transmit the first control command in real time by performing data transmission based on a second protocol, such as the MQTT protocol, in the case of a first control command for a specific operating device (110), including the operation of a cooling system, an emergency stop command, and an immediate change in work speed.

[0079] In one embodiment, the central control unit (350) may perform communication based on a third protocol to quickly transmit a second control command and a second control response. For example, the central control unit (350) may return the second control response in real time by performing data transmission based on a third protocol, such as a UDP protocol, to quickly provide the second control response to a user in accordance with a second control command for a specific operating device (110).

[0080] In one embodiment, the central control unit (350) may temporarily create a second or third protocol-based session while maintaining a TCP (Transmission Control Protocol) protocol-based session for transmitting and receiving industrial site data. That is, the central control unit (350) may temporarily create a second or third protocol-based session when a situation arises requiring real-time control of a specific operating device (110) due to the occurrence of an industrial accident, etc., while performing TCP protocol-based communication during the process of transmitting and receiving industrial site data. For example, the central control unit (350) may maintain a TCP protocol-based session during the process of collecting industrial site data generated from the operating device (110) and the monitoring device (111). Here, the central control unit (350) may temporarily create a second or third protocol-based session to request a second control command from the operating device (110) when it detects that the operating device (110) has exceeded a threshold set for a specific indicator.

[0081] In one embodiment, the central control unit (350) may create an MQTT (Message Queuing Telemetry Transport) protocol-based session for real-time control and response to at least one operating device (110). Here, the central control unit (350) may create an MQTT session and communicate with the operating device (110) when an industrial accident is detected, thereby transmitting and receiving an accident report, a first control command, and a first control response.

[0082] In one embodiment, the central control unit (350) may create a UDP (User Datagram Protocol) protocol-based session for rapid control and response to the monitoring device (111). Here, the central control unit (350) may create a UDP-based session for communication with the monitoring device (111) to receive monitoring data or transmit a second control command. For example, when the central control unit (350) detects a situation where the toxic gas concentration in a specific zone where the monitoring device (111) is located exceeds a threshold or the temperature rises rapidly, it may create a UDP protocol-based session to rapidly transmit a second control command to adjust the data collection cycle of the monitoring device (111).

[0083] The control unit (370) controls the overall operation of the multi-protocol integrated data processing unit (130) and can manage the control flow or data flow between the industrial site digital twin generation unit (310), the dashboard unit (330), and the central control unit (350).

[0084]

[0085] FIG. 4 is a flowchart illustrating an embodiment of a multi-protocol integrated data processing method according to the present invention.

[0086] Referring to FIG. 4, the multi-protocol integrated data processing device (130) can receive industrial site data consisting of operational data generated or detected during the operation of at least one operating device (110) and monitoring data generated from a monitoring device (111) for the industrial site through the industrial site digital twin generation unit (310), and can generate an industrial site digital twin (step S410). The multi-protocol integrated data processing device (130) can receive industrial site data through the industrial site digital twin based on the dashboard unit (330), provide a user interface that visualizes the industrial site digital twin, and provide a first control command for at least one operating device (110) or a second control command for the monitoring device (111) through the user interface (step S430).

[0087] In addition, the multi-protocol integrated data processing device (130) can support multi-protocol based data communication based on the central control unit (350) to communicate industrial site data using a first protocol for reliability support, communicate a first control command and a first control response using a second protocol for real-time support, and communicate a second control command and a second control response using a third protocol for rapid transmission (step S450).

[0088]

[0089] FIG. 5 is a diagram illustrating a transmission path according to an industrial site data type according to an embodiment of the present invention.

[0090] Referring to FIG. 5, the multi-protocol integrated data processing device (130) can provide a data transmission path according to the industrial site data type through a central control module, a protocol management module, and a packet loss correction module.

[0091] The multi-protocol integrated data processing device (130) can analyze network conditions and data types through a central control module to select an optimal communication protocol and coordinate data transmission. Here, the multi-protocol integrated data processing device (130) can monitor network conditions including bandwidth, latency, packet loss rate, etc., collect this as a dataset, and perform training of a machine learning model. For example, the multi-protocol integrated data processing device (130) can learn to automatically select an optimal protocol according to various network conditions based on a machine learning model that includes reinforcement learning (RL) techniques.

[0092] In one embodiment, the multi-protocol integrated data processing device (130) can perform dynamic protocol switching by dynamically switching between various protocols, such as UDP, TCP, WebSocket, and MQTT, depending on the nature of the industrial site data through a protocol management module. For example, the multi-protocol integrated data processing device (130) can receive reports from operating devices (110) and monitoring devices (111), and when a specific industrial accident is detected, create a session based on MQTT and UDP protocols. Through this, the multi-protocol integrated data processing device (130) can ensure the real-time nature and reliability of industrial site data by selecting and transmitting the optimal protocol according to network conditions and the conditions of the industrial site.

[0093] The multi-protocol integrated data processing device (130) can correct packet loss occurring during the communication process through a packet loss correction module and perform fast retransmission if necessary. For example, the multi-protocol integrated data processing device (130) can correct packet loss during the communication process using a Forward Error Correction (FEC) technique and perform fast retransmission if necessary, and is not limited to this, but can safely transmit important data through packet redundancy transmission. Here, the FEC technique may involve adding an error correction code that can detect and correct errors so that data can be recovered at the receiving end even if an error or packet loss occurs during transmission. Additionally, packet redundancy transmission may be a method of reducing the possibility of packet loss by transmitting important data with the same content multiple times.

[0094]

[0095] Although the present invention has been described above with reference to preferred embodiments, those skilled in the art will understand that various modifications and changes can be made to the invention without departing from the spirit and scope of the invention as described in the following claims.

[0096]

[0097] [National R&D projects that supported this invention]

[0098] [Project ID] 1711160596

[0099] [Project No.] 2022-0-00970

[0100] [Ministry Name] Ministry of Science and ICT

[0101] [Name of Project Management (Specialized) Agency] Korea Research Foundation of Information and Communications Technology Planning and Evaluation Institute

[0102] [Research Project Name] Smart Manufacturing Innovation Technology Development (R&D)

[0103] [Project Title] (Sub-project 6-2) Development of Multi-Image-Based 3D Virtual Space and Dynamic Object Reconstruction Technology for Manufacturing Site Support

[0104] [Name of Project Performing Organization] Immersive Cast Co., Ltd.

[0105] [Research Period] 2022-04-01 ~ 2025-12-31

[0106]

[0107] [Explanation of the symbol]

[0108] 100: Multi-protocol Integrated Data Processing System

[0109] 110: Operating device 111: Monitoring device

[0110] 130: Multi-protocol integrated data processing unit

[0111] 150: Database

[0112] 210: Processor 230: Memory

[0113] 250: User I / O Section 270: Network I / O Section

[0114] 290: Communication port section

[0115] 310: Industrial Site Digital Twin Generation Unit

[0116] 330: Dashboard Unit 350: Central Control Unit

[0117] 370: Control unit

Claims

1. An industrial site digital twin generation unit that receives industrial site data consisting of operational data generated or detected during the operation of at least one operating device and monitoring data generated from a monitoring device for the industrial site, and generates an industrial site digital twin; A dashboard unit that receives industrial site data through the industrial site digital twin, provides a user interface that visualizes the industrial site digital twin, and provides a first control command for at least one operating device or a second control command for the monitoring device through the user interface; and A multi-protocol integrated data processing device for operating an industrial site digital twin, comprising a central control unit that supports multi-protocol-based data communication to communicate the above industrial site data using a first protocol for reliability support, communicate the above first control command and first control response using a second protocol for real-time support, and communicate the above second control command and second control response using a third protocol for rapid transmission.

2. In paragraph 1, the industrial site digital twin generation unit A multi-protocol integrated data processing device for industrial site digital twin operation, characterized by converting the operation data from the first protocol to the second protocol and transmitting it via Forward Error Correction (FEC) to request the second control command when the urgency of the operation data exceeds a specific standard.

3. In paragraph 2, the above industrial site digital twin generation unit A multi-protocol integrated data processing device for industrial site digital twin operation, characterized by setting operation data that detects an operational abnormality or emergency stop of at least one operating device such that the urgency is greater than or equal to a specific standard.

4. In paragraph 2, the industrial site digital twin generation unit A multi-protocol integrated data processing device for industrial site digital twin operation, characterized by generating an accident report explaining the industrial accident when an industrial accident is detected during the analysis of the above monitoring data, transmitting the above monitoring data via the first protocol, and converting and transmitting the above accident report via the second protocol to provide an emergency notification.

5. In paragraph 1, the dashboard portion A multi-protocol integrated data processing device for industrial site digital twin operation, characterized by generating reports for at least one operating device and one monitoring device during the visualization process of the industrial site digital twin, determining the necessity of control commands through reinforcement learning-based analysis of each report, and providing control command controls for receiving the first and second control commands.

6. In paragraph 1, the central control unit A multi-protocol integrated data processing device for industrial site digital twin operation, characterized by maintaining a TCP (Transmission Control Protocol) protocol-based session for transmitting and receiving industrial site data while temporarily creating a session based on the second or third protocol.

7. In paragraph 6, the central control unit A multi-protocol integrated data processing device for industrial site digital twin operation, characterized by creating an MQTT (Message Queuing Telemetry Transport) protocol-based session for real-time control and response to at least one operating device.

8. In paragraph 6, the central control unit A multi-protocol integrated data processing device for industrial site digital twin operation, characterized by creating a UDP (User Datagram Protocol) protocol-based session for rapid control and response to the above-mentioned monitoring device.

Images