3D HMI System Cell-Based Rendering for Automation Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current human-machine interfaces (HMIs) for automated production environments are computationally inefficient in presenting monitoring and control information in a graphical format, leading to resource constraints that hinder effective operation and maintenance of complex machinery.

Innovation Solution

A three-dimensional HMI system that models production environments using cells, where a field of view is calculated and rendered with context-based filtering and graphical modifications, such as color-coding and animation, to optimize resource usage and improve user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If graphical HMIs are used to present data to users in an easily understandable manner, then ease of operation is improved, but processing resources are consumed excessively

Engineering Contradiction:
Improveease of useVSAvoidprocessing resources
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The HMI system divides the automated production environment model into discrete cells that can be independently loaded and rendered. Only cells within the current field of view are processed and displayed, while other cells remain unloaded or in a simplified state, significantly reducing processing resource consumption while maintaining ease of operation through intuitive graphical presentation.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If complete environmental models are rendered graphically, then information completeness is improved, but device complexity increases

Engineering Contradiction:
Improveinformation completenessVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system applies different levels of graphical detail and processing to different regions of the environment model based on their relevance to the current view. Cells within the field of view receive full graphical rendering with complete information, while cells outside the view are either unloaded or rendered in a simplified manner, optimizing the balance between information completeness and system complexity.

Inventive Principle:
Principle #3Local quality

3Loss of information

If all cells in the environment model are loaded for processing, then data availability is improved, but memory usage and processing time increase

Engineering Contradiction:
Improvedata availabilityVSAvoidprocessing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system pre-loads only the cells that are currently within the field of view or are likely to be viewed next, based on the calculated reference point and view parameters. This allows the HMI to have immediate access to necessary data without the overhead of loading and processing the entire environment model, significantly reducing processing time while maintaining data availability for the current view.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS7817150B2Three-dimensional immersive system for representing an automation control environment
Publication Date: 2010.10.19 ROCKWELL AUTOMATION TECH INC
  • US7817150B2 patent drawing
  • US7817150B2 patent drawing
  • US7817150B2 patent drawing

AI summary

A computer-implemented system for representing a production environment comprises a modeling module that creates a three-dimensional model of at least a portion of a production environment. The system also includes a view module that renders a graphical depiction of at least a portion of the three-dimensional model from a reference point that is based at least in part upon a location. Methods of using the system are also provided.