Context-Aware HMI Workflow Visualization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional Human Machine Interfaces (HMI) in industrial control systems are limited in their ability to provide users with situation-specific information, often requiring users to navigate through multiple screens to find relevant data, and are either overly intrusive or not informative enough, leading to inefficiencies and increased costs due to excessive navigation and pre-configuration requirements.

Innovation Solution

The development of systems and methods that dynamically superimpose situation-specific information onto the user's current view in industrial automation systems, using context-aware components to automatically provide relevant information based on user identity, role, location, and current tasks, reducing the need for pre-configuration and minimizing navigation efforts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If traditional HMI systems pre-configure information for specific situations, then information completeness is improved, but device complexity and ease of operation deteriorate due to extensive pre-configuration requirements and multiple navigation screens

Engineering Contradiction:
Improveinformation completenessVSAvoidpre-configuration complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system automatically detects user context (role, location, task) and retrieves relevant information without requiring pre-configuration for each situation. The HMI self-adapts to user needs by querying context data and assembling appropriate information dynamically, eliminating the need for extensive manual pre-configuration while maintaining information completeness

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The HMI transitions from static pre-configured displays to dynamic context-aware presentations. Information is assembled in real-time based on detected user context, allowing the interface to adapt automatically to different situations, roles, and tasks without requiring manual reconfiguration or navigation through multiple screens

Inventive Principle:
Principle #15Dynamics

2Loss of information

If traditional HMI systems provide detailed information through separate displays, then information completeness is improved, but productivity deteriorates due to excessive navigation requirements

Engineering Contradiction:
Improveinformation completenessVSAvoidinformation retrieval efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The system merges multiple information sources and context data into a single integrated display. Instead of requiring users to navigate through separate alarm screens, detail screens, and help screens, the HMI combines all relevant information (alarm status, diagnostic data, troubleshooting steps) into one cohesive presentation that appears automatically in the user's current view

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system performs preliminary actions by proactively detecting user context and assembling relevant information before the user requests it. Context data is continuously monitored and processed in advance, so when an alarm occurs or information is needed, the appropriate data is already prepared and displayed immediately without requiring user navigation or explicit requests

Inventive Principle:
Principle #10Preliminary action

3Reliability

If traditional HMI systems use pop-up alarms to alert users, then attention to critical information is improved, but ease of operation deteriorates due to intrusive interruptions

Engineering Contradiction:
Improvealarm effectivenessVSAvoidworkflow continuity
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system applies local quality by presenting alarm information in context with the user's current view rather than as a generic pop-up. Alarms are localized to the relevant process area or equipment being monitored, and information is presented at the appropriate level of detail based on user role and situation, maintaining workflow continuity while ensuring critical information is noticed

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS7676294B2Visualization of workflow in an industrial automation environment
Publication Date: 2010.03.09 ROCKWELL AUTOMATION TECH INC
  • US7676294B2 patent drawing
  • US7676294B2 patent drawing
  • US7676294B2 patent drawing

AI summary

A visualization system that generates a visualization of manufacturing operations and corresponding workflow is provided. An interface component receives input concerning displayed objects and information. A context component can detect, infer or determine context information regarding an entity or application. A workflow component binds workflow information to industrial automation manufacturing-related information. A visualization component dynamically generates a visualization from a set of display objects to present to a user that is a function of the received context information, workflow information, and industrial automation manufacturing-related information.