Automated human-machine interface following method and system

Abstract

The application discloses an automatic man-machine interactive interface following method and system, wherein the method comprises encoding all man-machine interactive interfaces and all data components in the man-machine interactive interfaces; all man-machine interactive interfaces in all display devices are converted into man-machine interactive entity interfaces, all man-machine interactive entity interfaces form an interface entity database and are stored into an edge display server; a near field label is arranged on a desktop display device and a cabinet display device, and a near field acquisition node is arranged in a mobile display device; the near field sampling node in the mobile display device judges whether the near field label is recognized in real time, if the mobile display device and a target display device are recognized, a communication connection is established, and interface transfer is performed through a preset interface transfer mode. The method can effectively reduce repeated work of workers in multiple display devices, improve production efficiency and reduce work load.

Description

Technical Field

[0001] This invention relates to the field of automation control technology, and in particular to an automated human-machine interface following method and system. Background Technology

[0002] Programmable logic controllers (PLCs) in production lines or machinery have been commercialized and used in numerous fields related to mechanical automation, such as power, mining, manufacturing, metallurgy, and chemicals. Along with the development of PLCs, human-machine interfaces (HMIs) convert the electronic data from PLCs into human-readable data, making it easier and simpler to display the data on devices such as touchscreen control panels.

[0003] A Human Machine Interface (HMI) is the medium through which a system and a user interact and exchange information. It converts information from its internal form to a human-readable format, and HMIs exist in any field involving human-machine communication. Large-scale automated control systems contain various HMI devices, and operators may need to interact with multiple display devices within a short period. While existing distributed control systems can centralize the operation of numerous display devices within a defined operating environment, these systems still require operators to constantly move between devices, presenting operational difficulties and increasing operating costs. Summary of the Invention

[0004] The technical problem to be solved by this invention is that existing automated control systems, when operating multiple display devices in a short period of time, need to move between each display device, which increases the difficulty of operation.

[0005] To address the aforementioned technical problems, this invention provides an automated human-machine interface following method, comprising:

[0006] All human-computer interaction interfaces of all display devices in the target system are encoded to give them a unique interface number in the target system, and all data components in all human-computer interaction interfaces are encoded to give each data component a unique component code in its respective human-computer interaction interface.

[0007] All human-computer interaction interfaces in all display devices are converted into human-computer interaction entity interfaces. The human-computer interaction entity interfaces can be displayed on all display devices in the target system. All the human-computer interaction entity interfaces form an interface entity database, and the interface entity database is stored in the edge display server.

[0008] Near-field tags are installed on all desktop display devices and all rack display devices of the target system, and near-field acquisition nodes are installed in all mobile display devices of the target system;

[0009] The near-field sampling node in the mobile display device determines in real time whether a near-field tag is identified. If it is identified, the display device to which the identified near-field tag belongs is taken as the target display device, a communication connection is established between the mobile display device and the target display device, and the interface is transferred through a preset interface transfer method. Otherwise, the near-field sampling node in the mobile display device re-determines in real time whether a near-field tag is identified.

[0010] Interface transfer via preset interface transfer methods includes:

[0011] When the mobile display device receives a first type of interface transfer instruction, the mobile display device sends the interface information of the currently displayed human-computer interaction interface to the target display device. The target display device reads the corresponding human-computer interaction entity interface from the edge display server based on the interface information, and displays the interface based on the corresponding human-computer interaction entity interface and the interface information.

[0012] When the mobile display device receives the second type of interface transfer instruction, the mobile display device sends an interface data acquisition request to the target display device. Based on the interface data acquisition request, the target display device returns the interface information of the currently displayed human-computer interaction interface to the mobile display device. Based on the interface information, the mobile display device reads the corresponding human-computer interaction entity interface from the edge display server and displays the interface based on the corresponding human-computer interaction entity interface and the interface information.

[0013] The interface information includes the interface number of the human-computer interaction interface, the interface state of the human-computer interaction interface, the component code of all data components in the human-computer interaction interface, and the data source connection or data value displayed by all data components.

[0014] Preferably, reading the corresponding human-computer interaction entity interface from the edge display server based on the interface information, and displaying the interface based on the corresponding human-computer interaction entity interface and the interface information includes:

[0015] Based on the human-computer interaction interface number in the interface information, the corresponding human-computer interaction entity interface is read from the edge display server;

[0016] The interface is displayed based on the interface status of the human-computer interaction interface and the interface information, the component codes of all data components in the human-computer interaction interface, and the data source connection or data value displayed by all data components.

[0017] Preferably, the desktop display device, the rack display device, and the edge display server are connected to each other via wired or wireless communication, and the mobile display device is connected to the desktop display device, the rack display device, and the edge display server via wireless communication.

[0018] Preferably, the wired communication method is Ethernet, and the wireless communication method is WLAN, Bluetooth, Infrared Data Association, Ultra Wideband, or ZigBee.

[0019] Preferably, the mobile display device includes a touch screen, the first type of interface transfer instruction is a finger sliding from the center of the touch screen of the mobile display device to the periphery, and the second type of interface transfer instruction is a finger sliding from the periphery of the touch screen of the mobile display device to the center.

[0020] Preferably, during the interface transfer process between the target display device and the mobile display device, the mobile display device does not move, so that the communication connection between the target display device and the mobile display device is not interrupted.

[0021] Preferably, the near-field tags are installed above, below, to the left, and to the right of the desktop display device and the rack display device, and near-field acquisition nodes are installed above, below, to the left, and to the right of the mobile display device.

[0022] Preferably, the target system is an automated control system.

[0023] To address the aforementioned technical problems, this invention provides an automated human-machine interface following system, comprising an edge display server and all desktop display devices, rack display devices, and mobile display devices in a target system respectively connected to the edge display server;

[0024] The edge display server is used to store the interface entity database, which includes all human-computer interaction entity interfaces after conversion in the target system.

[0025] The desktop display device is equipped with a near-field tag, which, after establishing a communication connection with the mobile display device, returns the interface information of the currently displayed human-computer interaction interface to the mobile display device when it receives an interface data acquisition request, or reads the corresponding human-computer interaction entity interface from the edge display server based on the received interface information, and displays the interface based on the human-computer interaction entity interface and the interface information.

[0026] The cabinet display device is equipped with a near-field tag, which is used to return the interface information of the currently displayed human-computer interaction interface to the mobile display device when a request for interface data acquisition is received after establishing a communication connection with the mobile display device, or to read the corresponding human-computer interaction entity interface from the edge display server based on the received interface information, and to display the interface based on the human-computer interaction entity interface and the interface information.

[0027] The mobile display device has a near-field acquisition node for real-time identification of near-field tags. When a near-field tag is identified, the display device to which the identified near-field tag belongs is taken as the target display device. Based on a first type of interface transfer instruction, the interface information of the currently displayed human-computer interaction interface is sent to the target display device, or an interface data acquisition request is sent to the target display device. Based on the interface information returned by the target display device, the corresponding human-computer interaction entity interface is read from the edge display server, and the interface is displayed based on the corresponding human-computer interaction entity interface and the interface information.

[0028] In this system, all human-computer interaction interfaces on all display devices have a unique interface number, and all data components in all human-computer interaction interfaces also have a unique component code in their respective human-computer interaction interfaces. The human-computer interaction entity interfaces can be displayed on all display devices in the target system. The interface information includes the interface number of the human-computer interaction interface, the interface status of the human-computer interaction interface, the component code of all data components in the human-computer interaction interface, and the data source connection or data value displayed by all data components.

[0029] Preferably, the mobile display device includes a touch screen, the first type of interface transfer instruction is a finger sliding from the center of the touch screen of the mobile display device to the periphery, and the second type of interface transfer instruction is a finger sliding from the periphery of the touch screen of the mobile display device to the center.

[0030] Compared with the prior art, one or more embodiments of the above solutions may have the following advantages or beneficial effects:

[0031] The automated human-machine interface following method provided in this invention assigns numbers to all human-machine interfaces and all data components within them. Simultaneously, it transforms all human-machine interfaces into physical human-machine interfaces that can be displayed on all display devices. Then, based on the assigned numbers and the physical human-machine interfaces, it enables interface transfer between desktop or rack-mounted display devices and mobile display devices. This reduces the need for operators to move between different display devices and lowers operational complexity. In other words, this invention effectively reduces repetitive work on multiple display devices, improves production efficiency, and reduces workload.

[0032] Other features and advantages of the invention will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention may be realized and obtained by means of the structures particularly pointed out in the description, claims, and drawings. Attached Figure Description

[0033] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used in conjunction with the embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings:

[0034] Figure 1 A flowchart illustrating the automated human-machine interface following method according to Embodiment 1 of the present invention is shown;

[0035] Figure 2 This diagram illustrates a near-field tag structure on a desktop display device according to Embodiment 1 of the present invention.

[0036] Figure 3 This diagram illustrates the structure of a near-field acquisition node within a mobile display device according to Embodiment 1 of the present invention.

[0037] Figure 4 This diagram illustrates the interface transition when a finger slides from the center of the touchscreen to the upper edge in Embodiment 1 of the present invention.

[0038] Figure 5 This diagram illustrates the interface transition when a finger slides from the center of the touchscreen down to the lower edge in Embodiment 1 of the present invention.

[0039] Figure 6 This diagram illustrates the interface transfer when a finger slides from the center of the touchscreen to the left in Embodiment 1 of the present invention.

[0040] Figure 7 This diagram illustrates the interface transfer when a finger slides from the center of the touchscreen to the right in Embodiment 1 of the present invention.

[0041] Figure 8 This diagram illustrates the interface transition when a finger slides from the top edge of the touchscreen towards the center, as shown in Embodiment 1 of the present invention.

[0042] Figure 9 This diagram illustrates the interface transfer when a finger slides from the bottom edge of the touchscreen toward the center, as shown in Embodiment 1 of the present invention.

[0043] Figure 10 This diagram illustrates the interface transition when a finger slides from the left edge of the touchscreen towards the center, as shown in Embodiment 1 of the present invention.

[0044] Figure 11This diagram illustrates the interface transition when a finger slides from the right edge of the touchscreen towards the center, as shown in Embodiment 1 of the present invention.

[0045] Figure 12 A schematic diagram of the structure of the automated human-machine interface following system according to Embodiment 2 of the present invention is shown;

[0046] 1 represents the near-field tag, and 2 represents the near-field acquisition node. Detailed Implementation

[0047] The embodiments of the present invention will be described in detail below with reference to the accompanying drawings and examples, so that the process of how the present invention uses technical means to solve technical problems and achieve technical effects can be fully understood and implemented accordingly. It should be noted that, as long as there is no conflict, the various embodiments and features in the various embodiments of the present invention can be combined with each other, and the resulting technical solutions are all within the protection scope of the present invention.

[0048] In a typical large system, a human-machine interface (HMI) system communicates with a controller to acquire data to be used, controlled, and / or monitored when the user configures screens and menus, and then displays this data on the screen. When the HMI receives a request from the user for an operation command on a specific device, it receives the data value of the object corresponding to the requested operation command from the programmable logic controller (PLC), receives the response data corresponding to the requested operation command from the PLC, and displays the received response data on a display device such as a touch screen control panel. Therefore, users can effectively monitor, use, and control automated equipment using the HMI system.

[0049] However, existing large-scale automated control systems, with their corresponding edge servers deployed in different network physical areas, also contain numerous display devices. These range from the control of individual server racks to the overall DSC system, encompassing a large number of human-machine interfaces (HMIs). Each display device includes its own unique HMI, but these interfaces often overlap. In some cases, operators need to switch between the HMIs of different devices, and even more so, some operating parameters need to be manually copied from one interface to another, resulting in cumbersome operations and reduced work efficiency.

[0050] Example 1

[0051] To address the technical problems existing in the prior art, embodiments of the present invention provide an automated human-machine interface following method.

[0052] Figure 1 A flowchart illustrating the automated human-machine interface following method according to Embodiment 1 of the present invention is shown; see reference. Figure 1As shown, the automated human-machine interface following method of this invention includes the following steps.

[0053] Step S101: Encode all human-computer interaction interfaces of all display devices in the target system so that each interface has a unique number in the target system, and encode all data components in all human-computer interaction interfaces so that each data component has a unique component code in its respective human-computer interaction interface.

[0054] Specifically, taking an automated control system as an example, the automated control system is considered the target system, and all human-machine interfaces (HMIs) within it are archived. Since the display devices in the automated control system include multiple cabinet displays, multiple desktop displays, and multiple mobile displays, and each of these devices has multiple HMIs, all HMIs across all display devices in the automated control system need to be encoded to give each HMI a unique interface number. Simultaneously, all data components within each HMI are encoded to give each data component a unique component code within its respective HMI. This combination of interface encoding and component encoding allows for the unique location of HMI data within the automated control system. A data component is the smallest unit for storing interface states within a HMI.

[0055] The connection method among the rack display devices, desktop display devices, edge display servers, and mobile display devices in the automated control system is as follows: each desktop display device, rack display device, and edge display server is connected to each other via wired or wireless communication. The mobile display devices are connected to each of the desktop display devices, rack display devices, and edge display servers via wireless communication. Further, the wired communication method is Ethernet, and the wireless communication method is WLAN, Bluetooth, Infrared Data Association, Ultra Wideband, or ZigBee. It should be noted that this embodiment of the invention is also applicable to other systems with rack display devices, desktop display devices, mobile display devices, and other display devices, which will not be elaborated upon here.

[0056] Step S102: Convert all human-computer interaction interfaces in all display devices into human-computer interaction entity interfaces. The human-computer interaction entity interfaces can be displayed on all display devices in the target system. All human-computer interaction entity interfaces form an interface entity database and are stored in the edge display server.

[0057] Specifically, all human-machine interfaces on all display devices in the automated control system are transformed into physical human-machine interfaces, which can be displayed on rack-mounted, desktop, and mobile display devices within the automated control system. All these physical interfaces are then compiled into an interface entity database, which is stored on an edge display server.

[0058] It should be noted that the interface entity database can also be stored simultaneously in at least one of the cabinet display devices, desktop display devices, and mobile display devices in the automated control system, depending on the actual storage situation.

[0059] Step S103: Set near-field tags on all desktop display devices and all rack display devices of the target system, and set near-field acquisition nodes in all mobile display devices of the target system.

[0060] Specifically, in the automated control system, near-field tags 1 are installed on all desktop and cabinet display devices, and near-field acquisition nodes 2 are installed in all mobile display devices. This allows the near-field tags 1 on a mobile display device to be read by the near-field acquisition nodes 2 when the mobile display device is close enough to the desktop or cabinet display device. It should be noted that the near-field tag 1 stores the device code of its associated display device. When the near-field acquisition node 2 of the mobile display device reads the near-field tag 1 on the desktop or cabinet display device, it can obtain the device code of the desktop or cabinet display device to which the near-field tag 1 belongs. The mobile display device then establishes a communication connection with the desktop or cabinet display device to which the near-field tag 1 belongs via wireless communication based on the obtained device code. Preferably, the near-field tag 1 is an RFID tag, and the near-field acquisition node 2 is a card reader.

[0061] During startup, mobile display devices, desktop display devices, and rack-mount display devices register their device ID, communication address, and near-field tag code with the edge display server. Simultaneously, when each human-computer interaction interface is created within a mobile, desktop, or rack-mount display device, its device ID, the newly created interface ID, and the window handle generated by the operating system are registered with the edge display server. The specific process by which a mobile display device establishes a wireless communication connection with the desktop or rack-mount display device associated with near-field tag 1 is as follows: After obtaining the near-field tag code from the desktop or rack-mount display device, the mobile display device uses the near-field tag code to obtain the corresponding device ID and network service address from the registration information on the edge display server. Based on the device ID and network service address, the mobile display device then establishes a wireless connection with the corresponding desktop or rack-mount display device.

[0062] Figure 2 This diagram illustrates a near-field tag structure on a desktop display device according to Embodiment 1 of the present invention. Figure 3 This diagram illustrates a near-field acquisition node within a mobile display device according to Embodiment 1 of the present invention; see reference. Figure 2 and Figure 3 As shown, furthermore, multiple near-field tags 1 are respectively installed on the desktop display device and the rack display device, and the near-field tags 1 are respectively installed around the desktop display device and the rack display device, that is, above, below, left and right of the desktop display device and the rack display device. Similarly, multiple near-field acquisition nodes 2 are also installed inside the mobile display device, and the multiple near-field acquisition nodes 2 are also installed around the mobile display device, that is, above, below, left and right of the mobile display device.

[0063] In step S104, the near-field sampling node in the mobile display device determines in real time whether a near-field tag is identified. If it is identified, the display device to which the identified near-field tag belongs is taken as the target display device, a communication connection is established between the mobile display device and the target display device, and the interface is transferred through a preset interface transfer method. Otherwise, the near-field sampling node in the mobile display device re-determines in real time whether a near-field tag is identified.

[0064] Specifically, the near-field sampling nodes within the mobile display device continuously detect whether they can identify near-field tag 1, which falls within a certain range due to sufficient proximity. If identified, the display device to which near-field tag 1 belongs is designated as the target display device, and the mobile display device that identified near-field tag 1 is designated as the target mobile display device. The target mobile display device then reads the device number and communication address from the identified near-field tag 1 and establishes a communication connection with the target display device based on the device number and communication address. An interface transfer between the target mobile display device and the target display device is then achieved through a preset interface transfer method. If none of the near-field sampling nodes within the mobile display device detects near-field tag 1, it continues to continuously determine whether near-field tag 1 has been identified.

[0065] Furthermore, the interface transfer between the target mobile display device and the target display device through the preset interface transfer method specifically includes: when the target mobile display device receives a first type of interface transfer instruction, it means that the operator needs to transfer the current human-computer interaction interface on the target mobile display device to the target display device for operation. At this time, the interface information of the currently displayed human-computer interaction interface needs to be sent to the target display device. The target display device reads the corresponding human-computer interaction entity interface from the edge display server based on the interface information, and displays the interface based on the corresponding human-computer interaction entity interface and interface information. When the target mobile display device receives a second type of interface transfer instruction, it means that the operator needs to transfer the current human-computer interaction interface on the target display device to the target mobile display device for operation. At this time, an interface data acquisition request needs to be sent to the target display device. The target display device returns the interface information of the currently displayed human-computer interaction interface to the mobile display device based on the interface data acquisition request. The mobile display device reads the corresponding human-computer interaction entity interface from the edge display server based on the interface information, and displays the interface based on the corresponding human-computer interaction entity interface and interface information. The interface information includes the interface number of the human-computer interaction interface, the interface state of the human-computer interaction interface, the component codes of all data components within the human-computer interaction interface, and the data source connection or data value displayed by all data components. It is important to note that during the interface transfer between the target display device and the target mobile display device, the mobile display device remains stationary to ensure uninterrupted communication between the two devices.

[0066] Furthermore, in both of the above scenarios, the process of reading the corresponding human-computer interaction entity interface from the edge display server based on the interface information and displaying the interface based on the corresponding human-computer interaction entity interface and interface information specifically includes: reading the human-computer interaction entity interface corresponding to the human-computer interaction interface number from itself or the edge display server based on the human-computer interaction interface number in the interface information; and then setting or reflecting the read human-computer interaction entity interface based on the human-computer interaction interface state, the component code of all data components in the human-computer interaction interface, and the data source connection or data value displayed by all data components in the interface information, so as to obtain a human-computer interaction interface that corresponds to the human-computer interaction interface to be transferred and its display state.

[0067] Preferably, a touchscreen is provided on the mobile display device. In this case, a first type of interface transfer instruction can be set as a finger sliding from the center of the touchscreen outwards, and a second type of interface transfer instruction can be set as a finger sliding from the periphery of the touchscreen towards the center. Further, the first type of interface transfer instruction may include instructions for a finger to slide from the center of the touchscreen outwards, more specifically, instructions for a finger to slide from the center of the touchscreen to the upper, lower, left, and right edges; similarly, the second type of interface transfer instruction may also include instructions for a finger to slide from the center of the touchscreen to the upper, lower, left, and right edges. Figures 4-7 The diagrams show the interface transitions as a finger slides from the center of the touchscreen to the top edge, bottom edge, left edge, and right edge, respectively. Figures 8-11 The diagrams show the interface transitions as a finger slides from the top edge, bottom edge, left edge, and right edge of the touchscreen toward the center.

[0068] The automated human-machine interface following method provided in this invention assigns numbers to all human-machine interfaces and all data components within them, transforming all interfaces into physical human-machine interfaces that can be displayed on all display devices. Then, based on these numbers and the physical interfaces, it enables interface transfer between desktop or rack-mounted display devices and mobile display devices. This reduces the need for operators to move between different display devices and lowers operational complexity. In other words, this method effectively reduces repetitive work on multiple display devices, improves productivity, and reduces workload.

[0069] Example 2

[0070] To address the technical problems existing in the prior art, embodiments of the present invention provide an automated human-machine interface following system.

[0071] This system is used to execute the automated human-machine interface following method in Embodiment 1. That is, the implementation of the automated human-machine interface following method in Embodiment 1 is the working mode of the automated human-machine interface following system in this embodiment. For details, please refer to Embodiment 1, which will not be repeated here.

[0072] Figure 11 A schematic diagram of the structure of the automated human-machine interface following system according to Embodiment 2 of the present invention is shown. (Refer to...) Figure 11 As shown, the automated human-machine interface following system of this invention includes an edge display server and all desktop display devices, rack display devices and mobile display devices in the target system that are respectively connected to the edge display server.

[0073] The edge display server is used to store the interface entity database, which includes all human-computer interaction entity interfaces after conversion in the target system.

[0074] The desktop display device is equipped with a near-field tag, which, after establishing a communication connection with the mobile display device, returns the interface information of the currently displayed human-computer interaction interface to the mobile display device when it receives an interface data acquisition request, or reads the corresponding human-computer interaction entity interface from the edge display server based on the received interface information, and displays the interface based on the human-computer interaction entity interface and the interface information.

[0075] The rack display device is equipped with a near-field tag, which is used to return the interface information of the currently displayed human-computer interaction interface to the mobile display device when a request for interface data acquisition is received after establishing a communication connection with the mobile display device, or to read the corresponding human-computer interaction entity interface from the edge display server based on the received interface information, and to display the interface based on the human-computer interaction entity interface and the interface information.

[0076] The mobile display device has a near-field acquisition node for real-time identification of near-field tags. When a near-field tag is identified, the display device to which the identified near-field tag belongs is taken as the target display device. Based on the first type of interface transfer instruction, the interface information of the currently displayed human-computer interaction interface is sent to the target display device, or an interface data acquisition request is sent to the target display device. Based on the interface information returned by the target display device, the corresponding human-computer interaction entity interface is read from the edge display server, and the interface is displayed based on the corresponding human-computer interaction entity interface and interface information.

[0077] In this system, all human-computer interaction interfaces on all display devices have a unique interface number, and all data components in all human-computer interaction interfaces also have a unique component code in their respective human-computer interaction interfaces. The human-computer interaction entity interface can be displayed on all display devices in the target system. The interface information includes the interface number of the human-computer interaction interface, the interface status of the human-computer interaction interface, the component code of all data components in the human-computer interaction interface, and the data source connection or data value displayed by all data components.

[0078] Furthermore, the mobile display device includes a touchscreen. The first type of interface transfer instruction is for a finger to slide from the center of the touchscreen of the mobile display device to the periphery, and the second type of interface transfer instruction is for a finger to slide from the periphery of the touchscreen of the mobile display device to the center.

[0079] The collaboration methods between the various parts are as described in Implementation Example 1, and will not be repeated here.

[0080] The automated human-machine interface following system provided in this invention assigns numbers to all human-machine interfaces and all data components within them. Simultaneously, it transforms all human-machine interfaces into physical human-machine interfaces that can be displayed on all display devices. Then, based on the numbering and the physical human-machine interfaces, it enables interface transfer between desktop or rack-mounted display devices and mobile display devices. This reduces the need for operators to move between different display devices and lowers operational complexity. In other words, this system effectively reduces repetitive work on multiple display devices, improves production efficiency, and reduces workload.

[0081] While the embodiments disclosed in this invention are as described above, the content is merely for the purpose of facilitating understanding of the invention and is not intended to limit the invention. Any person skilled in the art to which this invention pertains may make any modifications and changes in form and detail of the implementation without departing from the spirit and scope disclosed herein; however, the scope of protection of this invention shall still be determined by the scope defined in the appended claims.

Claims

1. An automated human-computer interaction interface following method, comprising: All human-computer interaction interfaces of all display devices in the target system are encoded to give them a unique interface number in the target system, and all data components in all human-computer interaction interfaces are encoded to give each data component a unique component code in its respective human-computer interaction interface. All human-computer interaction interfaces in all display devices are converted into human-computer interaction entity interfaces. The human-computer interaction entity interfaces can be displayed on all display devices in the target system. All the human-computer interaction entity interfaces form an interface entity database, and the interface entity database is stored in the edge display server. Near-field tags are installed on all desktop display devices and all rack display devices of the target system, and near-field acquisition nodes are installed in all mobile display devices of the target system; The near-field sampling node in the mobile display device determines in real time whether a near-field tag is identified. If it is identified, the display device to which the identified near-field tag belongs is taken as the target display device, a communication connection is established between the mobile display device and the target display device, and the interface is transferred through a preset interface transfer method. Otherwise, the near-field sampling node in the mobile display device re-determines in real time whether a near-field tag is identified. Interface transfer via preset interface transfer methods includes: When the mobile display device receives a first type of interface transfer instruction, the mobile display device sends the interface information of the currently displayed human-computer interaction interface to the target display device. The target display device reads the corresponding human-computer interaction entity interface from the edge display server based on the interface information, and displays the interface based on the corresponding human-computer interaction entity interface and the interface information. When the mobile display device receives the second type of interface transfer instruction, the mobile display device sends an interface data acquisition request to the target display device. Based on the interface data acquisition request, the target display device returns the interface information of the currently displayed human-computer interaction interface to the mobile display device. Based on the interface information, the mobile display device reads the corresponding human-computer interaction entity interface from the edge display server and displays the interface based on the corresponding human-computer interaction entity interface and the interface information. The interface information includes the interface number of the human-computer interaction interface, the interface state of the human-computer interaction interface, the component code of all data components in the human-computer interaction interface, and the data source connection or data value displayed by all data components.

2. The method according to claim 1, characterized in that, Reading the corresponding human-computer interaction entity interface from the edge display server based on the interface information, and displaying the interface based on the corresponding human-computer interaction entity interface and the interface information includes: Based on the human-computer interaction interface number in the interface information, the corresponding human-computer interaction entity interface is read from the edge display server; The interface is displayed based on the interface status of the human-computer interaction interface and the interface information, the component codes of all data components in the human-computer interaction interface, and the data source connection or data value displayed by all data components.

3. The method according to claim 1, characterized in that, The desktop display device, the rack display device, and the edge display server are all connected to each other via wired or wireless communication. The mobile display device is connected to the desktop display device, the rack display device, and the edge display server via wireless communication.

4. The method according to claim 3, characterized in that, The wired communication method is Ethernet, and the wireless communication method is WLAN, Bluetooth, Infrared Data Association, Ultra Wideband, or ZigBee.

5. The method according to claim 1, characterized in that, The mobile display device includes a touch screen. The first type of interface transfer instruction is for a finger to slide from the center of the touch screen of the mobile display device to the periphery, and the second type of interface transfer instruction is for a finger to slide from the periphery of the touch screen of the mobile display device to the center.

6. The method according to claim 1, characterized in that, During the interface transfer process between the target display device and the mobile display device, the mobile display device remains stationary to ensure uninterrupted communication between them.

7. The method according to claim 1, characterized in that, The desktop display device and the cabinet display device are equipped with near-field tags on the top, bottom, left and right sides, and the mobile display device is equipped with near-field acquisition nodes on the top, bottom, left and right sides.

8. The method according to claim 1, characterized in that, The target system is an automated control system.

9. An automated human-machine interface following system that implements the automated human-machine interface following method of any one of claims 1-8, characterized in that, It includes an edge display server and all desktop display devices, rack display devices, and mobile display devices in the target system that are respectively connected to the edge display server; The edge display server is used to store the interface entity database, which includes all human-computer interaction entity interfaces after conversion in the target system. The desktop display device is equipped with a near-field tag, which, after establishing a communication connection with the mobile display device, returns the interface information of the currently displayed human-computer interaction interface to the mobile display device when it receives an interface data acquisition request, or reads the corresponding human-computer interaction entity interface from the edge display server based on the received interface information, and displays the interface based on the human-computer interaction entity interface and the interface information. The cabinet display device is equipped with a near-field tag, which is used to return the interface information of the currently displayed human-computer interaction interface to the mobile display device when a request for interface data acquisition is received after establishing a communication connection with the mobile display device, or to read the corresponding human-computer interaction entity interface from the edge display server based on the received interface information, and to display the interface based on the human-computer interaction entity interface and the interface information. The mobile display device has a near-field acquisition node for real-time identification of near-field tags. When a near-field tag is identified, the display device to which the identified near-field tag belongs is taken as the target display device. Based on a first type of interface transfer instruction, the interface information of the currently displayed human-computer interaction interface is sent to the target display device, or an interface data acquisition request is sent to the target display device. Based on the interface information returned by the target display device, the corresponding human-computer interaction entity interface is read from the edge display server, and the interface is displayed based on the corresponding human-computer interaction entity interface and the interface information. In this system, all human-computer interaction interfaces on all display devices have a unique interface number, and all data components in all human-computer interaction interfaces also have a unique component code in their respective human-computer interaction interfaces. The human-computer interaction entity interfaces can be displayed on all display devices in the target system. The interface information includes the interface number of the human-computer interaction interface, the interface status of the human-computer interaction interface, the component code of all data components in the human-computer interaction interface, and the data source connection or data value displayed by all data components.

10. The system according to claim 9, characterized in that, The mobile display device includes a touch screen. The first type of interface transfer instruction is for a finger to slide from the center of the touch screen of the mobile display device to the periphery, and the second type of interface transfer instruction is for a finger to slide from the periphery of the touch screen of the mobile display device to the center.

Images