Generative AI HMI Development for Natural Language Screen Editing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing HMI development platforms are cumbersome and time-consuming due to their graphical and menu-driven workflows, which require manual selection and binding of graphical elements to data tags, making the development process inefficient.
Innovation Solution
An HMI development system utilizing generative artificial intelligence (AI) that processes natural language prompts to generate HMI project components, including display screens, layouts, and data links, leveraging custom models trained with industrial knowledge and standards to assist in the development process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If graphical and menu-driven workflows are used for HMI development, then developers can manually select and bind graphical elements to data tags, but the development process becomes cumbersome and time-consuming
Solution Approach 1:
The system enables self-service HMI development through natural language processing. Developers can describe desired HMI configurations in natural language, and the system automatically generates the corresponding HMI projects, graphical elements, and data bindings without requiring manual selection and configuration through complex graphical interfaces.
Solution Approach 2:
The patent replaces the mechanical graphical and menu-driven interaction system with an intelligent natural language processing system. Instead of manually dragging and dropping elements through graphical interfaces, the system uses AI to interpret natural language commands and automatically generate HMI configurations, substituting the mechanical workflow with an intelligent automation approach.
2Productivity
If manual selection and binding of graphical elements is required, then developers have control over HMI design, but the development workflow becomes complex and inefficient
Solution Approach 1:
The system introduces an intermediary natural language processing layer between the developer and the HMI generation system. Instead of directly interacting with complex graphical interfaces and binding mechanisms, developers communicate their requirements through natural language, and the intermediary system translates these into appropriate HMI configurations, simplifying the overall workflow.
Solution Approach 2:
The system performs self-service by automatically generating HMI projects, selecting appropriate graphical elements, and establishing data bindings based on natural language descriptions. This eliminates the need for developers to manually navigate complex development workflows and directly manipulate graphical elements, thereby improving productivity while reducing workflow complexity.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A human-machine interface (HMI) development system leverages a generative AI model to assist in development of HMI projects in accordance with specified functional requirements, which can be provided to the development system as intuitive natural language spoken or written text. The system can formulate and implement HMI project edits during design time based on analysis of this natural language design input. After the HMI project is deployed as a runtime application, the system can also receive and process natural language requests to modify the runtime HMI in accordance with described modification criteria.