Semantic HMI Layouts for Context-Aware Operator Information

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Industrial process control and automation systems face challenges in providing operators with relevant information in a timely and efficient manner, as existing Human Machine Interfaces (HMIs) require significant upfront engineering and fail to account for day-to-day contingencies, leading to a rigid structure that is costly and time-consuming to maintain.

Innovation Solution

A semantic network-connected HMI that processes operator requests, generates context-specific information layouts, and displays relevant data to operators using natural language queries or voice inputs, incorporating operational context such as process modes, equipment health, and scheduled maintenance, allowing for dynamic and efficient information delivery.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If a rigid HMI structure with significant upfront engineering is implemented, then information display capability is established, but adaptability to day-to-day contingencies deteriorates

Engineering Contradiction:
Improveupfront engineering effortVSAvoidadaptability to contingencies
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The HMI system dynamically adapts its information display based on real-time operational context. The system automatically adjusts which information is presented to operators depending on the current process state, equipment conditions, and operational mode, transforming the static rigid structure into a dynamic adaptive interface that responds to changing plant conditions without requiring re-engineering

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the parameters of information presentation based on operational context. Different operational modes (startup, shutdown, normal operation, abnormal conditions) trigger different information configurations, allowing the HMI to provide context-relevant information without requiring separate engineering designs for each scenario

Inventive Principle:
Principle #35Parameter changes

2Loss of information

If context-specific information layouts are generated dynamically, then information relevance improves, but system complexity increases

Engineering Contradiction:
Improveinformation relevanceVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The HMI system serves itself by automatically generating context-specific information layouts without requiring operator intervention or complex configuration. The system monitors its own operational context and autonomously determines what information to display and how to present it, reducing the complexity burden on operators while maintaining high information relevance

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses feedback from operational sensors and process data to continuously adjust information presentation. The HMI receives feedback about current plant conditions and automatically modifies its display content accordingly, creating a closed-loop system that maintains information relevance without manual intervention

Inventive Principle:
Principle #23Feedback

3Productivity

If automated information processing is implemented, then operational efficiency improves, but initial development time increases

Engineering Contradiction:
Improveoperational efficiencyVSAvoiddevelopment time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The HMI system is designed as a universal platform that handles multiple operational contexts and information types through a single automated framework. Rather than developing separate systems for different scenarios, the universal system adapts to various operational modes, reducing long-term development time while maintaining high operational efficiency across all contexts

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP4478139A1Human machine interface for providing information to an operator of an industrial production facility
Publication Date: 2024.12.18 HONEYWELL INTERNATIONAL INC
  • EP4478139A1 patent drawingFigure 1
  • EP4478139A1 patent drawingFigure 2
  • EP4478139A1 patent drawingFigure 3

AI summary

A system and method comprises a human machine interface (HMI) connected to an industrial process control and automation system controlling an industrial process. The HMI is arranged to receive and process a request for information from an operator. The HMI collects the information specific to the operator request from a semantic network connected to the industrial process control and automation system and generates a layout for the information received from the semantic network. The received information is displayed by the HMI to the operator using the layout.