Model-Based HMI for 3D Multi-Device System Visualization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional human machine interface (HMI) systems rely on oversimplified, two-dimensional representations and are limited to stationary panels, failing to provide intuitive and accurate visualization of complex systems, especially when multiple parameters need to be represented simultaneously.
Innovation Solution
A model-based HMI system that includes a semantics library capable of analyzing and transmitting system-under-control (SUC) component models to output devices with varying capabilities, enabling the rendering of accurate, three-dimensional models and augmented data on devices such as smart glasses, smartphones, and desktops, allowing for synchronized and device-independent visualization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional HMI systems use basic 2D graphical elements and tags for visualization, then the system is simple to implement and maintain, but the information representation is oversimplified and lacks accuracy
Solution Approach 1:
The patent uses digital twins (virtual copies) of physical systems that replicate the complete 3D geometry, physics properties, and operational states of actual equipment. These digital copies provide accurate information representation without requiring complex physical instrumentation, resolving the contradiction between measurement precision and device complexity.
Solution Approach 2:
The patent transitions from 2D graphical representations to immersive 3D virtual environments. By adding the third dimension and enabling spatial navigation, the system provides comprehensive information representation while maintaining intuitive visualization, overcoming the limitations of flat 2D displays.
2Adaptability or versatility
If conventional HMI systems use stationary centralized panels, then the system architecture is simple and centralized, but the system lacks adaptability to different device types and modern output devices
Solution Approach 1:
The patent creates a universal digital twin platform that can be accessed across multiple device types (VR headsets, AR glasses, smartphones, tablets, desktops). The same core digital twin data serves multiple functions and device formats, providing adaptability without requiring separate systems for each device type.
Solution Approach 2:
The patent introduces digital twins as an intermediary layer between the physical system and various output devices. This mediator translates physical system data into device-independent virtual representations that can be rendered on any platform, enabling adaptability while simplifying the overall architecture.
3Loss of information
If conventional HMI systems use separate output elements for different parameters, then each parameter can be displayed individually, but multiple parameters cannot be represented simultaneously in a single visualization
Solution Approach 1:
The patent merges multiple parameter visualizations into a single integrated 3D digital twin environment. Temperature, pressure, flow rate, and other parameters are simultaneously displayed as overlays on the corresponding physical components in the virtual model, eliminating the need for separate gauges and providing complete information in one view.
4Measurement precision
If conventional HMI systems use primitive drawing elements and ad-hoc models, then the system is easy to create and modify, but the visualization is not intuitive or accurate for complex systems
Solution Approach 1:
The patent performs preliminary actions by automatically generating digital twins from existing CAD models, BIM data, or point cloud scans during the design phase. This preliminary creation of accurate 3D models eliminates the need for manual modeling later, maintaining ease of modification while achieving high representation accuracy.
Solution Approach 2:
The patent replaces manual creation of visualizations with automated processes that use algorithms to generate digital twins from various data sources. This substitution of manual mechanical modeling with automated computational processes maintains ease of creation while dramatically improving accuracy.
Data Source
AI summary
A model-based human machine interface (HMI) system is provided. The HMI system includes a plurality of output devices each having output capabilities that include at least one unique output capability level and a semantics library that is configured to receive SUC component models each having an output format and data. The semantics library is configured to analyze the data relative to the SUC component models and to transmit each of the SUC component models to one or more of the plurality of output devices. The one or more of the plurality of output devices are selected based on a correlation between the output capabilities of the plurality of output devices and the output format of the SUC component models.