Method and system for providing time-critical services using a flow-controlled environment - Patents.com
The method and system provide reliable isolation and secure integration of virtualized control applications in industrial automation systems using flow-controlled environments and dedicated virtual networks, addressing communication disruptions and ensuring safe operations.
Patent Information
- Application Number
- JP2024508556
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-08-13
- Filing Date
- 2022-07-14
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2042-07-14
AI Technical Summary
Industrial automation systems face challenges in ensuring reliable isolation between virtualized control applications while maintaining low resource and management requirements, particularly in time-critical environments, leading to potential communication disruptions and unsafe operating states.
A method and system utilizing a flow-controlled environment with dedicated virtual communication networks for each server component, enabling isolation through software containers and reverse proxies, which manage network connections and access rights to ensure seamless integration and secure communication.
Enables reliable isolation and secure integration of virtualized control applications with reduced resource requirements, preventing communication disruptions and ensuring safe operating states in industrial automation systems.
Smart Images

Figure 0007577894000001
Abstract
Description
[Technical field]
[0001] The present invention relates to a method and system for providing time-critical services, especially in industrial automation systems.
[0002] Industrial automation systems generally comprise a number of automation devices networked with each other via industrial communication networks and are used for the open-loop or closed-loop control of plants, machines or devices within the framework of manufacturing or process automation. Due to the time-critical peripheral conditions in industrial automation systems, real-time communication protocols such as PROFINET, PROFIBUS, Real-Time-Ethernet or Time-Sensitive Networking (TSN) are primarily used for communication between the automation devices. In particular, multiple control services or control applications can be automatically distributed to currently available servers or virtual machines of the industrial automation system depending on their availability.
[0003] Interruptions of communication links between computer units of an industrial automation system or automation equipment can result in undesired or unnecessary repetition of transmission of service requests, and can, for example, prevent an industrial automation system from entering or remaining in a safe operating state if messages are not or are not transmitted completely.
[0004] In Ethernet-based communication networks, problems can occur when network resources for transmitting data streams or data frames with real-time requirements are competitively required for transmitting data frames with large useful data content that do not have special quality of service requirements, which can ultimately result in the data streams or data frames with real-time requirements not being transmitted in accordance with the requested or required quality of service.
[0005] From EP 3 751 421 A1 a method for providing a control application is known, in which a monitoring device queries the communication network address of a flow control component providing the control application and an identifier of the flow control component or an identifier of a server device on which the flow control component is executed. From the queried communication network address and identifier and the name of the control application a configuration control device generates configuration information for a forwarding device. The forwarding device receives queries from terminal devices for utilizing the control application and forwards the queries to the respective flow control components according to the configuration information.
[0006] The earlier application WO 2022 / 042905 relates to a method for providing time-critical services, each of which is associated with at least one server component, the server components being formed by a flow control component, which can be loaded into and executed in a flow control environment. For the server components, a respective functional unit for processing a communication protocol stack is made available, which is connected to a functional unit for processing a communication protocol stack, which is associated with the flow control environment. Each service includes a respective directory service component for identifying the services offered by the flow control environment. The directory service components are connected to each other via a separate communication interface, to which an aggregator component formed by a further flow control component is connected, which makes information about the services offered by the server components available outside the flow control environment.
[0007] Users of control applications for industrial automation systems, realised by container virtualisation or comparable virtualisation concepts, expect such applications to be integrated as easily as possible into the existing infrastructure. Access to such virtualised control applications is generally effected via a reverse proxy. To enable an easy and fast use of the virtualised control applications, it is important for users and developers alike to automatically integrate the virtualised control applications with the reverse proxy. Above all, a reliable separation between different virtualised control applications inside the application environment is crucial to be able to exclude critical feedback, especially access to the communications and data of other virtualised control applications. However, conventional IT solutions to this require very high resource and management requirements, which are extremely problematic in industrial automation systems.
[0008] The problem underlying the present invention is to provide a method for providing time-critical services, which allows reliable isolation between the services provided by container virtualization or a comparable virtualization concept and which can be implemented at low cost, and to provide a suitable device for implementing this method.
[0009] The above object is achieved according to the invention by a method having the features of claim 1 and by a system having the features of claim 12. Advantageous developments are set out in the dependent claims.
[0010] According to the method according to the invention for providing time-critical services using a flow-controlled environment, each service is respectively associated with a server component, which comprises at least one application instance and is formed by a flow-controlled component, which is loadable and executable in the flow-controlled environment. With the flow-controlled environment, a dedicated virtual communication network is made available for each server component. The virtual communication networks may in particular each comprise a virtual Ethernet point-to-point connection or may each be formed by a virtual bridge inside the flow-controlled environment.
[0011] The flow control component is, inter alia, a software container or includes a software container, which is executed on the host operating system of the server device inside the flow control environment, isolated from other software containers or container groups, e.g. pods, respectively. Basically, it is also possible to use alternative micro-virtualization concepts, such as Snaps, for the flow control component. In particular, one flow control component for each application instance can be loaded into and executed in the flow control environment. Advantageously, the software container utilizes the kernel of the host operating system of the server device together with other software containers, which are each executed on the server device. The memory map for the software container can be called from a storage and provisioning system, which is, for example, read-accessible or write-accessible by multiple users.
[0012] Advantageously, the flow control environment is a container engine that implements the creation, deletion, or binding of virtual resources, where the virtual resources include software containers, virtual communication networks, and associated connections. For example, the flow control environment may include a Docker Engine or Snap Core running on a server device.
[0013] According to the invention, a reverse proxy of a sub-network in which a flow control environment is included forwards service access requests for using services outside the sub-network to the respective server component according to predefined forwarding rules via the virtual communication network of the respective server component, where the virtual communication network is used to forward the service access requests respectively to all application instances of the respective server component. In this way, the invention allows for better and automatic network isolation of virtualized control applications or apps, in particular from control applications or apps of other providers.
[0014] In particular, users, application developers, and manufacturers of the controlled machines or equipment do not need expertise in correctly and securely integrating reverse proxies and applications of any provider into their respective application environments, and furthermore, for this, cluster orchestration systems, which typically have high resource requirements, are not needed.
[0015] According to the invention, a configuration unit for the reverse proxy determines globally valid access information, respectively, for addressing information associated with a server component or a virtual communication network of a server component, valid inside the sub-network, and transmits to the reverse proxy forwarding rules for mapping the access information. Preferably, at least one directory service component makes the globally valid access information available for utilizing the service outside the sub-network.
[0016] The globally valid access information may include, for example, addressing information and access rights, where the access rights are available after a successful user or device authentication. Advantageously, the forwarding rules map the access rights for a selected user or device to a selected service. The addressing information valid within the sub-network may be, for example, a communication network address, a port number, a host name, or a complete domain name.
[0017] According to the invention, the configuration unit evaluates an event message of the flow control environment as to whether a virtual communication network inside the flow control environment should be created or deleted. The configuration unit connects the virtual communication network to be newly created to the reverse proxy using a first control instruction directed to the flow control environment. In response, the configuration unit terminates the connection between the virtual communication network to be deleted and the reverse proxy using a second control instruction directed to the flow control environment. Furthermore, the configuration unit enables the removal of each server component from the flow control environment after the connection between the virtual communication network to be deleted and the reverse proxy is terminated using a third control instruction directed to the flow control environment. This ensures that the correct order for terminating the connection with the reverse proxy and for removing each server component is observed. This avoids the case where removal of a server component or a software container is impossible due to an existing connection with the reverse proxy.
[0018] Furthermore, the configuration unit, according to a particularly preferred embodiment of the invention, determines whether there is already an associated virtual communication network for the flow control component to be loaded into the flow control environment and executed therein. If there is an associated virtual communication network, the configuration unit instructs the flow control environment to bind the flow control component to the reverse proxy using said virtual communication network. On the other hand, if there is no associated virtual communication network, the configuration unit advantageously creates a virtual communication network inside the flow control environment for the server component formed by the flow control component and instructs the flow control environment to bind the flow control component to the reverse proxy using said virtual communication network. This allows for an appropriate network isolation for any virtualized control application or app depending on its classification.
[0019] A system according to the invention for providing time-critical services using a flow control environment, which is provided notably for implementing a method corresponding to the preceding embodiments, comprises a flow control environment, a sub-network in which the flow control environment is included, a reverse proxy of the sub-network, a configuration unit for said reverse proxy, and a number of server components each associated with a service, the server components each including at least one application instance and formed by a flow control component, which is loadable into and executable in the flow control environment.
[0020] The flow control environment of the system according to the present invention is configured and constructed such that one dedicated virtual communication network is available for each server component. Meanwhile, the reverse proxy is configured and constructed to forward service access requests for using services outside the sub-network to each server component according to a predetermined forwarding rule via the virtual communication network of each server component. Furthermore, the virtual communication network is configured and constructed to be utilized for forwarding service access requests to all application instances of each server component, respectively.
[0021] A configuration unit for the reverse proxy of the system according to the invention is configured and constructed to transmit to the reverse proxy forwarding rules that identify and map globally valid access information to addressing information valid within the sub-network and associated with the server component or the virtual communication network of the server component, respectively.Furthermore, the configuration unit is configured and constructed to evaluate an event message of the flow control environment as to whether a virtual communication network within the flow control environment should be created or deleted.
[0022] Furthermore, the configuration unit of the system according to the present invention is configured and constructed to connect the to-be-newly-established virtual communication network to the reverse proxy using a first control instruction directed to the flow control environment, and to terminate the connection between the to-be-deleted virtual communication network and the reverse proxy using a second control instruction directed to the flow control environment. Furthermore, the configuration unit is configured and constructed to enable removal of the respective server component from the flow control environment using a third control instruction directed to the flow control environment after termination of the connection between the to-be-deleted virtual communication network and the reverse proxy.
[0023] The invention will now be explained in more detail with reference to one embodiment on the basis of the drawings. [Brief description of the drawings]
[0024] [Figure 1] FIG. 1 illustrates an apparatus with a server component and a reverse proxy for providing services of an industrial automation system.
[0025] The device shown in the drawing includes a server device 110 for providing services or control and monitoring applications of an industrial automation system. The services or control and monitoring applications of an industrial automation system are an example of time-critical services. The services or control and monitoring applications can be provided, for example, based on OPC UA. The services or control and monitoring applications therefore include interface definitions that can be utilized for persistent access to the services or control and monitoring applications.
[0026] 1 further comprises a terminal device 10 associated with at least one user, which in this embodiment transmits service access requests 11 for utilizing a service to an automation system or sub-network 100, which includes a server device 110, via a communication network 20 and receives responses 12 or measurement values and status messages from the server device accordingly. The communication network 20 can for example be configured as a Time-Sensitive Network (TSN) according to IEEE 802.1Q, IEEE 802.1AB, IEEE 802.1AS, IEEE 802.1BA or IEEE 802.1CB, among others.
[0027] The server device 110 implements, in this embodiment, the functionality of a control device of an industrial automation system, such as a programmable logic controller, or the functionality of a field device, such as a sensor or an actuator, by means of a container virtualized server component 113. In this embodiment, the server device 110 is used for the exchange of control quantities and measurement quantities with a machine or device 200 controlled by the server device 110. In particular, the server device 110 is provided for identifying suitable control quantities from detected measurement quantities.
[0028] The terminal device 10 is in this example an operating and observation station and is used for visualizing process data or measured and controlled quantities which are processed or detected by the server device 110 or by other automation devices. Among other things, the terminal device 10 is used for displaying values of closed-loop control circuits and for changing closed-loop control parameters or programs.
[0029] Each service is associated with one server component 113, which includes at least one application instance and is formed by a flow control component, which is loadable and executable in the flow control environment 112. In this embodiment, one flow control component for each application instance is loaded and executed in the flow control environment 112. The flow control environment 112 is provided by the server device 110 and installed on the server device 110 as an application on the host operating system 111 of the server device 110.
[0030] In this embodiment, the flow control component is or includes a software container that runs on the host operating system 111 of the server device 110 within the flow control environment 112, isolated from other software containers, container groups, or pods, respectively. In this case, the software container utilizes the kernel of the host operating system 111 of the server device 110 along with other software containers that run on the server device 110, respectively. The flow control environment 112 is a container engine that, among other things, creates, deletes, or binds virtual resources. In this case, the virtual resources can include software containers, virtual communication networks, and their associated connections.
[0031] Isolation of flow control components from one another or selected operating system means from one another can be achieved using inter alia control groups and namespaces. Using control groups, process groups can be defined to limit the resources available for a selected group. Namespaces allow individual processes or control groups to be isolated or hidden from other processes or control groups. Memory maps for software containers can be retrieved from a storage and provisioning system that is read-accessible or write-accessible by multiple users, for example.
[0032] To provide time-critical services, the flow control environment 112 is used to make available one dedicated virtual communication network 114 for each server component 113. In particular, the virtual communication networks 114 may each include a virtual Ethernet point-to-point connection or may each be formed by a virtual bridge inside the flow control environment 112.
[0033] A reverse proxy 101 of a host system or sub-network 100 including a server device 110 and a flow control environment 112 forwards a service access request 11 for utilizing a service outside the host system or sub-network 100 to a respective server component 113 according to a predetermined forwarding rule 121 via a virtual communication network 114 of the respective server component 113. In this case, the virtual communication network 114 is respectively utilized to forward the service access request 11 to all application instances of the respective server component 113.
[0034] A configuration unit 102 for the reverse proxy 101 determines globally valid access information 131 for addressing information associated with the server component 113 or the virtual communication network 114 of the server component 113, respectively, valid within the host system or sub-network 100, and transmits forwarding rules 121 mapping this access information 131 to the reverse proxy 101. The addressing information valid within the host system or sub-network 100 is, for example, a communication network address, a port number, a host name or a complete domain name. The globally valid access information 131 is made available by the directory service component 103 for utilizing services outside the host system or sub-network 100.
[0035] The globally valid access information 131 preferably includes addressing information and access rights, which are only available after successful user or device authentication. The access rights for a selected user or device to a selected service are also advantageously mapped by the forwarding rules 121.
[0036] Additionally, the configuration unit 102 determines whether there is already an associated virtual communication network 114 for the flow control component to be loaded and executed in the flow control environment 112. To determine this, the configuration unit 102 accesses flow control information 122 stored in the database 120 relating to the server component 113 or the flow control component associated with the server component 113.
[0037] If the associated virtual communication network 114 exists, the configuration unit 102 instructs the flow control environment 112 using the flow control information 122 derived from the database 120 to bind the flow control component to the reverse proxy 101 using the virtual communication network 114. On the other hand, if the associated virtual communication network 114 does not exist, the configuration unit 102 instructs the flow control environment 112 to build a virtual communication network 114 inside the flow control environment 112 for the server component 113 formed by the flow control component, and to bind the flow control component to the reverse proxy 101 using the virtual communication network 114.
[0038] Furthermore, the configuration unit 102 evaluates an event message 123 of the flow control environment 112 as to whether a virtual communication network 114 inside the flow control environment 112 should be created or deleted. The configuration unit connects the to-be-newly-created virtual communication network to the reverse proxy 101 using a first control instruction C1 directed to the flow control environment 112.
[0039] In response, the configuration unit 102 uses a second control command C2 directed to the flow control environment 112 to terminate the connection between the virtual communication network 114 to be deleted and the reverse proxy 101. Furthermore, the configuration unit 102 uses a third control command C3 directed to the flow control environment 112 to enable removal of each server component 113 from the flow control environment 112 after the connection between the virtual communication network 114 to be deleted and the reverse proxy 101 is terminated.
Claims
1. 1. A method for providing time-critical services using a flow controlled environment, comprising: - each service is associated with a server component (113), said server component (113) including at least one application instance and formed by a flow control component, said flow control component being loadable into and executable in said flow control environment (112); Using the flow control environment, one dedicated virtual communication network (114) is available for each server component; a reverse proxy (101) of a sub-network (100) in which the flow control environment is included, forwarding a service access request (11) for using the service outside the sub-network to each of the server components according to a predetermined forwarding rule (121) via the virtual communication network of each of the server components; the virtual communication network is utilized to forward the service access requests to all application instances of each of the server components, respectively; a configuration unit (102) for the reverse proxy (101) identifying globally valid access information (131) for addressing information associated with the server component (113) and / or the virtual communication network (114) of the server component (113) valid within the sub-network (100) and transmitting forwarding rules (121) for mapping the access information to the reverse proxy; said configuration unit (102) evaluating event messages (123) of said flow control environment (112) as to whether a virtual communication network (114) inside said flow control environment should be created or deleted; the configuration unit connects the virtual communication network to be newly constructed to the reverse proxy (101) using a first control command (C1) directed to the flow control environment; the configuration unit uses a second control command (C2) directed to the flow control environment to terminate the connection between the virtual communication network to be deleted and the reverse proxy; the configuration unit (102) enables, after termination of the connection between the virtual communication network (114) to be deleted and the reverse proxy (101), the removal of each of the server components (113) from the flow control environment (112) using a third control instruction (C3) directed to the flow control environment (112); method.
2. said globally valid access information (131) including addressing information and access rights; The access rights are available after successful user authentication and / or device authentication. The method of claim 1.
3. The method of claim 2, wherein the forwarding rules (121) map access rights for selected users and / or devices to selected services.
4. said addressing information valid within said sub-network (100) being a communication network address, a port number, a host name and / or a complete domain name; 3. The method according to claim 1 or 2.
5. 3. The method of claim 1, wherein the configuration unit (102) determines whether a virtual communication network (114) is already associated with a flow control component to be loaded into the flow control environment (112) and executed in the flow control environment (112), and if the associated virtual communication network exists, the configuration unit instructs the flow control environment to use the virtual communication network to link the flow control component to the reverse proxy (101).
6. 6. The method of claim 5, wherein if an associated virtual communication network (114) does not exist, the configuration unit (102) instructs the flow control environment (112) to create a virtual communication network within the flow control environment for a server component (113) formed by the flow control component and to link the flow control component to the reverse proxy using the virtual communication network.
7. the flow control component is or comprises a software container; The software containers are executed on a host operating system (111) of a server device (110) within the flow control environment (112) in isolation from each other software container or group of containers.
3. The method according to claim 1 or 2.
8. the flow control environment being a container engine that performs the creation, deletion, and / or binding of virtual resources; The virtual resources include software containers, virtual communication networks, and associated connections. The method of claim 7.
9. 3. The method of claim 1, wherein a respective flow control component for each application instance is loaded into and executed in the flow control environment.
10. 3. The method of claim 1, wherein at least one directory service component (103) makes said globally valid access information (131) available for use of said services outside said sub-network.
11. The method of claim 1 or 2, wherein said virtual communication networks (114) each comprise a virtual Ethernet point-to-point connection and / or are each formed by a virtual bridge within said flow control environment (112).
12. 1. A system for providing time-critical services using a flow controlled environment, the system comprising: - Flow control environment (112), a sub-network (100) in which said flow control environment is included, - a reverse proxy (101) of said sub-network, A configuration unit (102) for said reverse proxy (101), a plurality of server components (113) each associated with a service, each of the server components (113) including at least one application instance and formed by a flow control component, the flow control component being loadable into the flow control environment (112) and executable in the flow control environment (112); Equipped with The flow control environment is configured and constructed such that one dedicated virtual communication network (114) is available for each server component; the reverse proxy is configured and constructed to forward service access requests (11) for utilizing the service outside the sub-network to the respective server component according to predetermined forwarding rules via the virtual communication network of the respective server component, the virtual communication network is configured and constructed to be utilized for forwarding the service access requests to all application instances of each of the server components, respectively; the configuration unit (102) for the reverse proxy (101) is configured and constructed to identify globally valid access information (131) for addressing information associated with the server component (113) and / or the virtual communication network (114) of the server component (113) valid within the sub-network (100) and to transmit to the reverse proxy forwarding rules (121) for mapping the access information, the configuration unit is further configured and constructed to evaluate event messages (123) of the flow control environment (112) as to whether a virtual communication network (114) inside the flow control environment should be created or deleted; said configuration unit is further configured and constructed to connect a virtual communication network to be newly constructed to said reverse proxy (101) using first control instructions (C1) directed to said flow control environment; the configuration unit is further configured and constructed to terminate a connection between the virtual communication network to be deleted and the reverse proxy using a second control instruction (C2) directed to the flow control environment; the configuration unit is further configured and constructed to enable, after termination of a connection between the virtual communication network (114) to be deleted and the reverse proxy (101), a removal of each of the server components (113) from the flow control environment (112) using a third control instruction (C3) directed to the flow control environment (112); system.
Citation Information
Patent Citations
Method and apparatus for load balancing in a cloud-radio access network
CN111557109A
Method for providing control applications and configuration control device
EP3751421A1
Control apparatus, control system, control method, and program
JP2018169978A
Virtual network system, virtual network control method, control device, and program thereof
JP2020074604A
Failure recovery control method, communication device, communication system, and program
WO2020032169A1
