Industrial Automation Interfaces With Generative AI Function Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing industrial device user interfaces are cumbersome and obstructive, requiring users to navigate complex menus with their hands, often lacking necessary functionality, and are inefficient in processing natural language inputs.
Innovation Solution
A system utilizing generative artificial intelligence (GAI) to process user inputs, including natural language and spoken requests, to generate executable code for user interface functionality, integrating with preprogrammed functionality and security analysis to ensure efficient and secure execution.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a traditional graphical user interface is used for industrial devices, then users can interact with the device, but the interface becomes cumbersome and obstructive requiring manual navigation through complex menus
Solution Approach 1:
The patent replaces the mechanical/manual interaction system (physical menu navigation) with an AI-based automated system. The GAI model processes natural language requests and automatically generates appropriate interface interactions, eliminating the need for manual menu browsing and reducing operational complexity.
Solution Approach 2:
The system enables self-service by allowing the AI model to autonomously interpret user intentions from natural language and execute the appropriate operations without requiring users to manually navigate complex interfaces. The system serves itself by automatically generating and executing the necessary interface interactions based on user requests.
2Productivity
If users manually navigate menus to find functionality, then they can access device functions, but the process is tedious and time-consuming
Solution Approach 1:
The system performs preliminary action by pre-processing and indexing all available device functions and interface options before user interaction. The AI model has pre-access to the complete function catalogue and can immediately retrieve and execute the appropriate functionality without requiring users to manually search or navigate through menus.
Solution Approach 2:
The patent replaces the manual mechanical process of navigating menus with an automated AI-based retrieval and execution system. The GAI model processes natural language requests and automatically retrieves and executes the appropriate functions, dramatically reducing the time required to access functionality.
3Adaptability or versatility
If the user interface includes comprehensive functionality, then it can meet diverse user needs, but the interface becomes more complex and harder to navigate
Solution Approach 1:
The AI model serves as an intermediary between the user and the complex interface system. It translates simple natural language requests into appropriate interface interactions and manages the complexity of accessing comprehensive functionality. The intermediary absorbs the complexity while presenting a simple, intuitive interface to the user.
Solution Approach 2:
The patent replaces the complex mechanical interface structure with an AI-based mediation system. The GAI model handles the complexity of mapping diverse user needs to appropriate functions, eliminating the need for users to navigate complex interface structures while maintaining comprehensive functionality coverage.
4Ease of operation
If preprogrammed functionality is used for the user interface, then the interface is simpler to operate, but it cannot accommodate functions that do not exist in the preprogrammed menu
Solution Approach 1:
The system achieves universality by combining preprogrammed functionality with AI-based dynamic function generation. The GAI model can both execute preprogrammed functions and generate new interface functionality on-demand, allowing the system to adapt to any user need while maintaining operational simplicity. This multi-functional approach eliminates the trade-off between simplicity and extensibility.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Disclosed herein are methods and systems for an industrial automation device interface system that leverages generative artificial intelligence (GAI). The system receives a user request associated with an industrial device. The system processes the request to identify an intent and user interface functionality based at least on an industrial device context. When no existing user interface functionality is identified in the programming, the system generates a prompt designed to elicit a response from a generative artificial intelligence (GAI) model. The prompt contains industrial device context and a request to generate user interface functionality in the form of executable code for performing an action corresponding to the intent. The system submits the prompt to the GAI model and receives user interface functionality in return. The system executes the user interface functionality or provides it to the user device for execution.