Human-machine interface for providing information to operator of industrial production installation

Through semantic networks and information layout engines, the operators can obtain relevant information through natural language or voice queries in industrial production facilities, solve the time-consuming and cost-effective problems of existing HMI design, and improve the efficiency and accuracy of information acquisition , enhance the real-time monitoring and management capabilities of production facilities.

CN119087920APending Publication Date: 2024-12-06HONEYWELL INTERNATIONAL INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410656517.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-06-06
Filing Date
2024-05-24
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

The HMI design of existing industrial production facilities is time-consuming and cost-effective, and it is difficult to effectively respond to operators' daily accidents, and it is impossible to provide the required information in a timely manner.

Method used

The semantic network and information layout engine are used to input queries by operators in natural language or voice form, collect and generate targeted information layouts, automatically display relevant information, and respond to changes in the operating environment.

Benefits of technology

It reduces the preliminary engineering work of HMI design, improves the efficiency and accuracy of operators to obtain information, allows operators to obtain relevant information about the production process in the form of search and query, and enhances real-time monitoring and intervention capabilities of industrial production facilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119087920A_ABST
    Figure CN119087920A_ABST
Patent Text Reader

Abstract

A system and method including a human-machine interface (HMI) connected to an industrial process control and automation system that controls an industrial process. The HMI is arranged to receive and process an information acquisition request from an operator. The HMI collects information specific to operator requests from a semantic network connected to the industrial process control and automation system and generates a layout for the information received from the semantic network. The received information is displayed to the operator by the HMI using the layout.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure generally relates to industrial production facilities controlled by industrial process control and automation systems. More specifically, the present disclosure relates to a human machine interface (HMI) for providing information to operators of industrial production facilities. Background Art

[0002] Industrial process control and automation systems are often used in industrial production facilities or processing plants to automate large and complex industrial processes. These types of control and automation systems generally include sensors, actuators and controllers. The controller generally receives measurements from the sensor and generates control signals for the actuator. Industrial process control and automation systems are configured with control schemes using programmable logic controllers (PLCs), or control schemes in the case of more complex systems using distributed control systems (DCSs) or supervisory control and data acquisition systems (SCADAs). Automated process control relies on one or more process controllers, which are communicatively coupled via input / output (I / O) modules coupled to one or more field devices, which are coupled to processing equipment, wherein the field devices include sensors for sensing parameters (such as temperature and pressure), and actuators configured to receive control signals generated by the process controller and adjust the settings of the processing equipment.

[0003] Operators of industrial production facilities are highly dependent on human-machine interfaces (HMIs) to provide them with the ability to understand the past, current, and potential future states of the production process and the industrial process control and automation systems that manage the production facility, and to intervene when necessary to execute operating procedures and handle abnormal situations (when they arise). Plant operators utilize a set of standard operating procedures (SOPs) that describe the methods by which operators operate the system and the actions they take in response to situations. A key element of HMI is to ensure that operators have access to the information they need when they need it. Doing so typically involves significant upfront engineering activities, in which the information needs of plant operators are analyzed to design a series of information displays and associated navigation mechanisms to handle those needs. This is a costly and time-consuming endeavor that results in a rigid structure that often fails to address day-to-day contingencies that affect the information required by operators. Summary of the invention

[0004] The present disclosure relates to a human machine interface (HMI) for providing information to operators of an industrial production facility.

[0005] In a first embodiment, a method is disclosed that includes processing, by a human machine interface (HMI), an information acquisition request from an operator, the human machine interface (HMI) being connected to an industrial process control and automation system that controls an industrial process. The method also includes collecting information specific to the operator's request from a semantic network, generating a layout for the information received from the semantic network, and displaying, by the HMI, the layout and the received information to the operator.

[0006] In a second embodiment, a system is disclosed, the system comprising: an industrial process control and automation system that controls an industrial process; an operator device that is connected to the industrial process control and automation system; an input device that is used to enter information from the operator into the operator device; a display that is used to display information from the operator device to the operator; a semantic network that is connected to the industrial process control and automation system, the semantic network that collects and stores information and relationships of elements that constitute the industrial process control and automation system; an information layout engine that is used to generate a display layout of information received from the semantic network; and a human-machine interface (HMI) that operates on the operator device and is adapted to receive an information acquisition request from the input device, wherein in response to the information acquisition request, the HMI collects information received from the semantic network within an operating environment of the industrial process, and displays the received information to the operator on the display using the display layout.

[0007] In a third embodiment, a non-transitory computer-readable medium containing instructions is disclosed, which when executed causes at least one operator console of an operator to cause an operator computer system to implement the following method, the at least one operator console including the operator computer system, the operator computer system including at least one processor device coupled to a human-machine interface (HMI), the method comprising: processing, by the HMI, an information acquisition request from the operator, the HMI being connected to an industrial process control and automation system that controls an industrial process. The method also includes: collecting, by the HMI, information specific to the plant operator's request from a semantic network connected to the industrial process control and automation system, generating a layout for the information received from the semantic network, and displaying, by the HMI, the received information on the operator console using the layout.

[0008] Other technical features will be apparent to those skilled in the art from the following drawings, descriptions and claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] For a more complete understanding of the present disclosure, reference is now made to the following description taken in conjunction with the accompanying drawings, in which:

[0010] Figure 1 An exemplary industrial process control and automation system for controlling an industrial production facility is illustrated;

[0011] Figure 2 An exemplary HMI for providing information to operators of an industrial production facility according to the present disclosure is illustrated;

[0012] Figure 3 The invention is illustrated by Figure 2 An exemplary screen layout generated by the HMI of

[0013] Figure 4 The invention is illustrated by Figure 2 Another exemplary screen layout generated by the HMI. DETAILED DESCRIPTION

[0014] These figures discussed below and the various embodiments for describing the principles of the present invention in this patent document are carried out by way of example only and should not be construed as limiting the scope of the present invention in any way. Those skilled in the art will appreciate that the principles of the present invention can be implemented in any type of suitably arranged device or system.

[0015] The systems and methods of the present disclosure relate to providing information to a plant operator using a human-machine interface (HMI) that can display the most relevant information specific to a production process performed in an industrial production facility based on the current interests of the plant operator. The disclosed systems and methods avoid the extensive work required to design an HMI specific to an industrial production process. Specifically, the systems and methods of the present disclosure allow a plant operator to declare interest in information to the HMI in the form of search commands and queries. For example, a search command "Furnace 001" will populate the HMI with information related to an asset of a production facility labeled "Furnace 001," including a diagram of the asset and current operating data from various devices and systems that manage and execute the production process. The information will be displayed to the plant operator on an operator console or other display device.

[0016] The query provided to the HMI is input by the plant operator in the form of natural language, which can be a text message or a voice in the form of speech. The query can also be made by describing the content that the plant operator is interested in. For example, the plant operator can issue a voice query to the HMI to "show information related to the trip of furnace 001." In this example, the HMI will collect information related to the unexpected shutdown of furnace 001, including alarm information, process trends that caused the trip, equipment operating status data, etc., for presentation to the plant operator.

[0017] The information collected by the HMI and displayed to the plant operator may be further affected by any current operating environment. The operating environment may include the current process mode of the plant, for example, whether the plant is in a startup state, a stable state, or experiencing an abnormal situation. The operating environment may include the current state of the process managed by the industrial process control and automation system, such as, for example, the current process parameters of the running process and any parameters for which an alarm has been sent. Other operating environments may include the operating status of the plant equipment and any current or planned operational maintenance planned for execution, the execution of standard operating procedures (SOPs), and the execution of specific tasks (such as shift handovers), such as providing a summary of the shift work status and unresolved problems to the plant operator who arrives on duty. Other operating environments may include operational risk factors, such as the operation of an industrial process using a new set of parameters, atypical raw materials, thermal maintenance activities, severe weather conditions, etc. Another operational risk factor may include the state of any advanced control system or plant-wide optimization system, which may affect a set of specific constraints that the plant operator needs to monitor for manual intervention.

[0018] The above factors establish the operating context in which the plant operator receives information from the HMI. For example, if furnace 001 is currently being started up, the operator's information query for furnace 001 will include the startup procedure and the process parameters required to monitor the startup. Conversely, if furnace 001 is operating in a steady state, the startup procedure will not be shown. Instead, the parameters required to monitor the steady state and any information from any advanced control strategy that manages the steady state will be shown.

[0019] It should be appreciated that while basic context-based guidance to plant operators may be known, the disclosed aspects of the present disclosure go a step further by having the HMI respond to context-based guidance, including responding to operator query inputs within context-related operational inputs that allow the HMI to display specific plant information to the plant operator and thereby automate the plant operator's interaction with the HMI. This disclosed aspect makes the HMI more effective and also allows the operator to better focus on those actions that have a direct impact on the industrial processes of the industrial production facility.

[0020] Figure 1 An exemplary industrial process control and automation system 100 that may benefit from the disclosed aspects of the present disclosure is illustrated. Figure 1As shown, system 100 includes various components that are conducive to producing or processing at least one tangible product or other tangible material. For example, system 100 can be used to facilitate the control of components in one or more industrial production plants. Each industrial production plant represents one or more processing facilities (or one or more parts thereof), such as one or more manufacturing facilities for producing at least one tangible product or other tangible material. In general, each plant can implement one or more industrial processes and can be individually or collectively referred to as a processing system. A processing system generally represents any system or part thereof that is configured to process one or more products or other tangible materials in some way. System 100 includes a field device, which includes one or more sensors 102a and one or more actuators 102b coupled between a controller 106 and a processing equipment, and the processing equipment is shown in simplified form as a process unit 101a coupled to another process unit 201b through a pipeline 109. Sensors 102a and actuators 202b represent components that can perform any of a variety of functions in a processing system. For example, sensor 102a can measure a variety of characteristics in a processing system, such as flow, pressure or temperature. In addition, actuator 102b can change a variety of characteristics in the processing system, such as valve opening. Each sensor in sensor 102a includes any suitable structure for measuring one or more characteristics in the processing system. Each actuator in actuator 102b includes any suitable structure for operating or affecting one or more conditions in system 100.

[0021] At least one network 104 is shown to provide a connection between the controller 106 and the sensor 102a and the actuator 102b. The network 104 facilitates interaction with the sensor 102a and the actuator 102b. For example, the network 104 can transmit measurement data from the sensor 102a to the controller 106, and provide control signals from the controller 106 to the actuator 102b. The network 104 can represent any suitable network or combination of networks. As a specific example, the network 104 can represent at least one Ethernet network (such as an Ethernet network supporting the Foundation Fieldbus protocol), an electrical signal network (such as a Highway Addressable Remote Transducer (HART protocol network)), a pneumatic control signal network, or any other or additional type of network.

[0022] The system 100 also includes various process controllers 106, which are typically configured in multiple Purdue model levels, which can exist at all levels except level 0, where level 0 typically includes only field devices (sensors and actuators) and process units. Each process controller includes a processor 106a coupled to a memory 106b. Process controllers 206 can be used in the system 200 to perform various functions to control one or more industrial processes.

[0023] For example, the first set of process controllers 206 corresponding to level 1 in the Purdue model may refer to smart transmitters or smart flow controllers, where the control logic is embedded in these controller devices. Level 2 typically refers to distributed control system (DCS) controllers, such as the C300 controller from Honeywell International. These level 2 controllers may also include more advanced strategies including machine-level control built into the C300 controller, or another similar controller. Level 3 is typically reserved for controllers implemented by the server 116. These controllers interact with the other level (level 1, level 2, and level 4) controllers.

[0024] A Level 1 controller in the case of a smart device or a Level 2 controller such as a C300 controller can use measurements from one or more sensors 102a to control the operation of one or more actuators 102b. The Level 2 process controller 106 can be used to optimize the control logic or other operations performed by the Level 1 process controller. For example, a machine level controller (such as a DCS controller) at Purdue Level 2 can record information collected or generated by a process controller 106 at Level 1, such as measurement data from sensors 102a or control signals for actuators 102b.

[0025] The third group of controllers implemented by the server 116 corresponding to the Purdue model level 3 are called unit-level controllers, which typically perform model predictive control (MPC), and these controllers can be used to perform additional functions. Therefore, the process controller 106 and the controllers implemented by the server 116 can generally support a combination of methods, such as regulatory control, advanced regulatory control, supervisory control, and advanced process control. In one arrangement, the third group of controllers implemented by the server 116 includes an upper controller corresponding to the Purdue model level 4, which upper controller also typically performs MPC control, also known as a plant-level controller, and is coupled to a lower controller corresponding to the Purdue model level 3. The processor 116a of the server 116 may include a digital signal processor (DSP), a microcontroller, an application-specific integrated circuit (ASIC), a general-purpose processor, or any other combination of one or more integrated processing devices.

[0026] The MPC simulation model typically resides in a memory associated with an upper level controller implemented by the server 116 (shown as being stored in a memory such as Figure 1 In the example of FIG. 1 , an upper level controller uses the MPC simulation model to predict the movement in the process, participate in controlling the plant, and interact with the MPC simulation model to optimize the overall economic conditions of the plant, including sending the output from the MPC simulation model as a set value target to the lower level controller. The lower level controller uses the set value target to transfer raw materials or intermediate materials in the pipeline network.

[0027] Figure 1 At least one of the process controllers 106 shown may represent a model-based process controller that operates using one or more process models. For example, each of the process controllers 106 may operate using one or more process models (including MPC simulation models) to determine how to adjust one or more actuators 102b based on measurements from one or more sensors 102a. In some disclosed aspects, each model associates one or more manipulated variables (MVs) or disturbance variables (DVs), which are generally referred to as independent variables, with one or more controlled variables (CVs), which are generally referred to as dependent variables. Each of the process controllers 106 may use an objective function to identify how to adjust its manipulated variables so as to push its CVs to the most attractive set of constraints.

[0028] At least one network 108 couples the process controller 106 and other devices in the system 100. The network 108 facilitates the transmission of information between components of the system 100. The network 108 may represent any suitable network or combination of networks. As a specific example, the network 108 may represent at least one Ethernet network.

[0029] Plant operator access and interaction with the process controller 106 and other components of the system 100 including the server 116 may be via various disclosed operator consoles 110 that include an HMI 110a coupled to an operator computer system 110b including a processor 110c. Each operator console 110 may be used to provide information to the plant operator and receive information from the operator. For example, each operator console 110 may provide information to the plant operator identifying the current state of the industrial process, such as warnings, alarms, or other states associated with the industrial process and values ​​of various process variables.

[0030] Each operator console 110 may also receive information that affects how the industrial process is controlled, such as by receiving setpoints or control modes for process variables controlled by the process controller 106 or by a process controller implemented by the server 116, or receiving other information that changes or affects how the process controller controls the industrial process. Each operator console 110 includes any suitable structure for displaying information to an operator and interacting with the operator. For example, the operator computing device may run a WINDOWS operating system or other operating system.

[0031] Multiple operator consoles 110 may be grouped together and used in one or more control rooms 112. Each control room 112 may include any number of operator consoles 110 arranged in any suitable arrangement. In some disclosed aspects, multiple control rooms 112 may be used to control an industrial plant, such as when each control room 112 contains an operator console 110 for managing a discrete portion of the industrial facility.

[0032] The system 200 typically includes at least one data historian 114, which typically includes an event log entered by an operator or technician. The data historian 114 may also store various information about the system 100. The data historian 114 may, for example, store information generated by each process controller 106 during control of one or more industrial processes, as well as event logs. The data historian 114 includes any suitable structure for storing information and facilitating retrieval of the information stored therein. Although shown here as a single component, the data historian 114 may be located in other locations in the system 100 (such as the cloud), or multiple data historians may be distributed in different locations in the system 100.

[0033] The processor 116a of the server 116 executes applications for users of the operator console 110 or other applications. These applications can be used to support various functions of the operator console 110, the process controller 106, or other components of the system 100. Each server 116 can represent a computing device running a WINDOWS operating system or other operating system. It should be noted that although the server 116 is shown as being local within the system 100, the functionality of the server can be remote from the system 100. For example, the functionality of the server 116 can be implemented in the computing cloud 218, or in a remote server that is communicatively coupled to the system 100 via the gateway 120.

[0034] Although Figure 1 One example of an industrial process control and automation system 100 is illustrated, but various changes may be made to the system 100. For example, the system 100 may include any number of sensors, actuators, controllers, networks, operator consoles, control rooms, data historians, servers, and other components.

[0035] In the present system and method, the operator console 110 includes an HMI 110a, which serves as an interface for query-driven and context-dependent process operations, which can display the most relevant information specific to the production process performed in the industrial production facility based on the current interests of the plant operator. The information displayed on the operator console 110 is responsive to a specific query issued by the plant operator to the HMI 110a. The information collected by the HMI 110a and displayed to the specific query of the plant operator includes information within the current operating environment of the industrial process controlled by the system 100. For example, when an alarm is detected by the operator computing system 110b associated with the HMI 110a, the operator can use natural language instructions to the HMI 110a to present information related to the alarm. The system and method will collect information stored in the data historian 114, controller 106, and process units 101a and 101b of the system 100, which focuses on the abnormal situation that caused the alarm. Additionally, the HMI 110a will present to the plant operator, on the operator console 110 or a portable display device (not shown), suggested actions necessary to implement corrective measures in the system 100 in response to the alarm.

[0036] Can capture in SOP or other program instructions about how to deal with various specific current situations knowledge, including abnormal situations (such as alarm) or routine maintenance that is expected to be carried out. However, SOP is usually expensive and difficult to establish and maintain over time. An alternative method is to use the operation history of the process control system, which is usually stored in the data history library as a source of understanding how to deal with multiple current situations. The operation history can be stored as situation / event data at the site of the system 100, or can be stored in a plurality of different sites that usually implement the same system in the same industrial process. For example, the event log generated by the operator usually stored in the data history library can be "mined" for previous examples of the same situation or extremely close situation in time, and the analysis of the action taken in response to the current situation, and the result of the action can be used for which actions may be suitable for taking to deal with the current situation for the plant operator to draw suggestions. Based on the operation history of the system 100 including the event log stored in the data history library 114, it can be realized by applying analytical techniques to the event log generated by the operator at the operator console 110 in a sufficiently long time period. For example, analysis techniques such as sequence mining and deep learning techniques (sequence-to-sequence networks and convolutional networks) can be used to provide suggestions for upcoming (current) operator actions. These suggestions are based on the current state of the system 100 and the sequence of events at the time points that led to the current situation.

[0037] Figure 2 A method 200 for a query-driven and context-dependent process for providing information to plant operators of an industrial production facility is illustrated. Figure 2 The method 200 illustrated in FIG. 1 is performed by the HMI 110a in conjunction with Figure 1 Alternatively, Figure 2 The process operations of may be non-transitory media executed as a software application contained in the memory 116d of the server 116 and executed by the processor 116a. It should be noted that Figure 2 Each process operation shown in may be a software program, application, or functional module that is executed individually or simultaneously to provide the HMI 110a with information requested by the plant operator.

[0038] At process operation 205 , a natural language query prompt is issued to HMI 110 a by a plant operator using an input device such as, for example, a keyboard (not shown) associated with operator console 110 for text input or a microphone (not shown) for audio or speech input.

[0039] In process operation 210, the query language model accepts a query prompt from a plant operator and passes the text query to the information content generator 215. In the case of a voice query from an operator, the query language model 210 will convert the voice utterance into text. In the case of a direct keyboard text query, the text query prompt is passed to the information content generator 215. The query prompt can also be translated into the local language of the system 100 to allow multi-lingual queries. The query language model 210 can be any currently known software application for generating natural language queries, which consists of terms or phrases that are normally spoken or entered when spoken, without any non-language characters and without any special formatting or grammatical changes. Optionally, a neural network generative (artificial intelligence) AI language model can be used as the query language model 210.

[0040] Next, the operator query prompt from the query language model 210 is input to the information content generator 215. The information content generator 215 receives the query prompt from the query language model 210 and uses the query prompt to receive information related to the query prompt from the semantic network 225.

[0041] The semantic network 225 is continuously updated with data and metadata from the system content source process 230 and the external content source process 235. The semantic network 225 parses the information received from the content source and identifies the content and content-based metadata to establish semantic relationships with the data from the content source. The semantic network 225 stores the relationship between the elements of the system 100 (such as, for example, asset equipment) and operations. Querying the semantic network 225 provides information about the elements of the system 100 and links to these elements and how the elements of the system 100 are related. For example, a query from the information content generator 215 for information about an asset labeled as furnace 001 will provide performance information for the asset, including a list of content related to furnace 001 and links to any associated content sources. For the operator query prompt "How to avoid the tripping of the compressor when the feed is lost?", the semantic network 225 identifies the standard operating procedure (SOP) for stabilizing the compressor when the feed is lost as one of the related items. Then, the information content generator 215 can use the provided link to access the SOP so that it can be presented to the operator. The semantic network 225 can be implemented using a semantic database, a knowledge graph, a deep learning neural network, or a vector embedding model, which can obtain information from the system 100 provided by a content crawler.

[0042] Process operations 230 collects information about the industrial process control and automation system 100 from logs, asset lists, process modules, and controllers of the system 100 that are input to the semantic network 225. System content source information may include asset model entities, process parameter data databases from current and historical historians, activity and event logs, control strategies that control plant machines or actuators, graphical displays, trends, calculation results, faults, recommendations, shift logs, incident reports, SOPs, and key performance indicators (KPIs).

[0043] The process operation 235 collects information from external sources. The external source can be information collected from systems external to the system 100. Such as, for example, weather data including temperature, wind speed, humidity at the location of the industrial production facility. The weather data can be supplied from the cloud 118 via the gateway 120. The information content generator 215 can also use process content from the content sources 230, 235 before displaying the information to the operator, which will be explained in detail later in the embodiments.

[0044] The HMI 200 uses the operating environment classifier process 220 to provide the operating environment when querying the semantic network 225. The information content generator 215 asks the operating environment classifier 220 what the current or previous operating context is. For example, the operating environment may include process status (process upsets, such as feed loss), current or planned maintenance activities, known equipment health issues, etc. The information content generator 215 then adds this information to the query sent to the semantic network 225, requesting information built within the requested operating environment. The added environment affects the list of relevant data returned from the semantic network 225 to the information content generator 215. For example, the fact that there is a severe weather alert may make additional SOPs relevant.

[0045] The operating environment classifier 220 collects information related to the current and past environment applicable to the plant. The information content generator 215 uses this information to protect data from the semantic network 225, which is related to the environment of the system 100. The classifier 220 receives information about the current process mode from the process mode classifier 235, the scheduled production planning and maintenance activities from the activity planning process operation 230, the equipment health assessment from the equipment health assessment process operation 225, and the current operational risks from the operational risk classifier 245.

[0046] The process mode classifier of the process operation 235 identifies the current process mode of the production process controlled by the system 100, including whether the process is in a steady state, a startup state, a shutdown state, a transition state, a process upset, etc.

[0047] The equipment health assessment of process operation 225 identifies the equipment operating status of the production asset, such as whether it is operating normally, faulty, or degraded. This information can also come from external third-party systems, such as asset performance monitoring solutions operating with system 100.

[0048] The activity plan of process operations 230 collects the status of current and planned activities and maintenance that can be performed on the assets of the industrial production facility or system 100 .

[0049] The operational risk classifier for process operations 245 identifies potential risks to the operation of the industrial plant due to severe weather and maintenance activities to be or being performed on the on-site production facility, such as cleaning heat exchangers, replacing valves, calibrating sensors, working on flare systems, etc. Other operational risks that may be identified by process operations 230 may include control degradation, such as when a control loop is saturated, or when the industrial production facility is operating in a new mode.

[0050] The model relationships between information items provided by the semantic network 225 and using context-related information from the operating environment classifier 220 are sent to the information content generator 215 where the information is converted into a form for use in a visual layout generated by the information layout engine 250.

[0051] The information layout engine of process operation 250 automatically generates a visual layout of the information items collected by the information content generator 215 to be displayed on the operator console 110 or on a portable display device (not shown). The information content generator 215 uses responsive design to create a layout suitable for a device on which the HMI 110a is displayed, such as, for example, a control room operator console 110 or a mobile device such as a smart phone or tablet device. The information layout engine 250 can support one or more graphic design methods, such as, for example, a network shape object library that complies with abnormal situation management (ASM) and is configurable. The information layout engine 250 can be implemented using a template-based approach, in which a pre-developed template is loaded into the engine 250 and used to display HMI information to a specific selected display device. Or preferably, the engine 250 can use HTML source code generated by generative AI, which generates and generates HMI display layouts based on a description of the information to be displayed and related design guidelines and constraints. The information layout engine 250 can also generate source code in other languages ​​that can be used to implement the HMI.

[0052] Example

[0053] The disclosed aspects are further illustrated by the following specific examples, which should not be construed as limiting the scope or content of the present disclosure in any way.

[0054] As described above, while the basic terms of a query-driven HMI may be known, the disclosed aspects of the present disclosure improve upon the query-driven HMI by using Figure 2 The illustrated HMI and its process operation are further refined into a query-driven and context-sensitive process that can display the most relevant information specific to the production processes performed in the industrial production facility based on the current interests of the plant operators.

[0055] Figure 3 and Figure 4 Each shows a depiction of an exemplary screen shot display resulting from a query of the HMI 200 of the present disclosure. Figure 3 In FIG. 1 , screen 300 illustrates information and screen layout in response to a query for providing information about a furnace asset operating in an industrial production facility. Figure 4 , screen 400 illustrates the information and screen layout prompted by a plant operator's inquiry regarding how to avoid a compressor trip following a feed loss.

[0056] refer to Figure 3 , the exemplary screen layout 300 is generated by the HMI 200 of the present disclosure in response to a simple operator search query for "furnace 001". The search text "furnace 001" is entered in the search field 310 at the top of the screen. The microphone icon 315 enables the plant operator to verbally query by selecting the icon and using his voice. Figure 2 The HMI 110 of the method 200 generates a screen layout for display at the operator console 110 or at a mobile device as a result of the operator query 310 .

[0057] Screen 300 includes a graphical representation of the selected furnace, including its operating status 320, and includes an alphanumeric display of key current operating parameters located around the furnace graphic. A representation of the furnace's current KPIs 325 is illustrated by a graphic shown above the furnace graphic 320 along the top of the screen.

[0058] A trend graph 330 of furnace performance is illustrated in the lower left corner of screen 300. Next to the trend graph, current recommendations 335 related to the queried furnace may be listed. Recommendations may include maintenance items that need to be addressed by maintenance personnel, such as, for example, vibration noises or alarms. Related assets 340 may be displayed, providing status information, such as the condition and performance of related equipment required for efficient operation of the furnace. In the example of 340, a pump is illustrated with a trend line and any alarms that may have been issued during its operation. Finally, screen 300 may also include other relevant information 345, including weather, on-site safety incidents, maintenance contacts, and maintenance reports.

[0059] Figure 4 The screen layout generated by the HMI 200 in response to a natural voice query issued by a plant operator regarding "How can I avoid a compressor trip after a feed loss?" is illustrated. The HMI 200 generates a screen layout 400 as a result of the operator's query. The screen layout 400 includes a list 410 of previous feed loss events, and a trending graph 415, and key process parameters 420 for drum liquid accumulation, and a compressor pressure profile including current and historical data for the compressor. On the right side of the screen 400, an event summary 425 lists information from the SOP, shift log, and event reports from previous feed loss events provided by content sources 230, 235, which are made by the information content generator 215 before being displayed to the operator. Recommended actions are provided to the plant operator in box 430 in response to the query issued to prevent the compressor from tripping after a feed loss.

[0060] It may be advantageous to set forth the definitions of certain words and phrases used throughout this patent document. The term "communication" and its derivatives cover both direct communication and indirect communication. The terms "include" and "comprising" and their derivatives mean including but not limited to this. The term "or" is inclusive, meaning and / or. The phrase "associated with..." and its derivatives may mean including, included within, interconnected with, included within, connected to, or connected with, coupled to, or coupled with, can communicate with, collaborate with, interlace, juxtapose, approach, be coupled to, or be combined with, have, have the property of, have a relationship with, or have a relationship with. When used with a list of items, the phrase "at least one of..." means that different combinations of one or more items in the listed items may be used, and only one item in the list may be needed. For example, "at least one of A, B, and C" includes any combination of A, B, C, A and B, A and C, B and C, and A and B and C.

[0061] The description in this application should not be construed as implying that any particular element, step, or function is an essential or critical element that must be included within the scope of the claims. The scope of subject matter protected by a patent is limited only by the claims as allowed. In addition, none of the claims is intended to invoke 35 U.S.C. §112(f) with respect to any of the appended claims or claim elements, unless the exact words "means for..." or "step for..." followed by a participle phrase identifying the function are expressly used in a particular claim. The use of terms such as (but not limited to) "mechanism", "module", "device", "unit", "component", "element", "member", "device", "machine", "system" or "controller" within the claims is understood and intended to refer to structures known to those skilled in the relevant art, as further modified or enhanced by the features of the claims themselves, and is not intended to invoke 35 U.S.C. §112(f).

[0062] Although the present disclosure has described certain embodiments and generally associated methods, changes and permutations of these embodiments and methods will be apparent to those skilled in the art. Therefore, the above description of the exemplary embodiments does not limit or restrict the present disclosure. Other changes, substitutions and variations are also possible without departing from the spirit and scope of the present disclosure as defined in the following claims.

Claims

1. A method, the method include: Processing information acquisition requests from operators by a human machine interface (HMI) connected to an industrial process control and automation system that controls the industrial process; collecting information specific to the operator's request from the semantic network; generating a layout for the information received from the semantic network; as well as The layout and the received information are displayed to the operator by the HMI.

2. A system, wherein the system include: Industrial process control and automation systems, which control industrial processes; an operator device connected to the industrial process control and automation system; an input device, the input device being used to enter information from the operator into the operator device; a display, the display being used to display information from the operator device to the operator; a semantic network connected to the industrial process control and automation system, the semantic network collecting and storing information and relationships of elements constituting the industrial process control and automation system; an information layout engine, the information layout engine being used to generate a display layout of the information received from the semantic network; and a human machine interface (HMI) operating on the operator device and adapted to receive an information acquisition request from the input device, Wherein, in response to the information acquisition request, the HMI collects the information received from the semantic network within the operating environment of the industrial process, and displays the received information to the operator on the display using the display layout.

3. A non-transitory computer readable medium containing instructions that, when executed, cause at least one operator console of an operator to cause an operator computer system to implement the following method, wherein the at least one operator console includes the operator computer system, the operator computer system includes at least one processor device coupled to a human machine interface (HMI), the method include: processing, by the HMI, an information acquisition request from the operator, the HMI being connected to an industrial process control and automation system for controlling an industrial process; collecting, by the HMI, information specific to a plant operator's request from a semantic network connected to the industrial process control and automation system; generating a layout for the information received from the semantic network; as well as The information received from the semantic network is displayed by the HMI on the operator console using the layout.