Automated HMI Generation from Spreadsheet Cells for Vision Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The process of generating a human-machine interface (HMI) for machine vision systems using a spreadsheet format is tedious and time-consuming, requiring numerous manual steps for scaling and layout of elements, which is costly and labor-intensive.

Innovation Solution

A system and method that automatically generates a user interface (HMI) by selecting a range of spreadsheet cells, reducing the workflow to two steps and enabling interactive, fully functional HMIs that can run in a web browser, with data automatically propagated and communicated between the user interface and vision system processor.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If manual steps are used for scaling and layout of HMI elements in a spreadsheet format, then the interface can be customized and generated, but the process becomes tedious and time-consuming

Engineering Contradiction:
ImproveHMI generation processVSAvoidTime required for HMI setup
Core Design Contradiction:
Ease of manufactureVSLoss of time

Solution Approach 1:

The system performs preliminary actions by automatically generating HMI elements, scaling, and layout based on spreadsheet data before the user needs to use the interface. The HMI generator pre-processes the spreadsheet information and creates the complete interface structure, eliminating the need for users to perform manual scaling and layout operations when setting up the HMI.

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If automatic HMI generation is implemented, then user workflow is reduced to two steps and manual effort is minimized, but the system requires automated generation capabilities and processing

Engineering Contradiction:
ImproveUser workflow simplicityVSAvoidSystem complexity for automated generation
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The HMI generator performs self-service by automatically generating the human-machine interface elements, scaling, and layout without requiring user intervention. The system reads spreadsheet data and autonomously creates the HMI structure, positioning elements, and configuring parameters, thereby simplifying user workflow to just providing spreadsheet input and receiving the generated interface.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If spreadsheet-based interface creation is used, then parameters and settings can be defined systematically, but numerous manual steps are required for element linking and configuration

Engineering Contradiction:
ImproveInterface configuration flexibilityVSAvoidInterface creation efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The system replaces manual mechanical operations (clicking, dragging, linking, configuring) with an automated computational process. The HMI generator uses algorithms to read spreadsheet data, determine element relationships, calculate positioning and scaling, and generate the complete HMI structure automatically, substituting manual configuration steps with automated processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11422833B1System and method for automatic generation of human-machine interface in a vision system
Publication Date: 2022.08.23 COGNEX CORP
  • US11422833B1 patent drawing
  • US11422833B1 patent drawing
  • US11422833B1 patent drawing

AI summary

The invention provides a system and method that automatically generates a user interface (HMI) based on a selection of spreadsheet cells. The spreadsheet controls operations within the processor(s) of one or more vision system cameras. After selecting a range of cells in the spreadsheet, the user applies the system and method by pressing a button, or using a menu command that results in an automatically generated HMI with appropriate scaling of interface elements and a desired layout of such elements on the associated screen. Advantageously, the system and method essentially reduces the user's workflow to two steps, selecting spreadsheet cells and generating the HMI around them. The generated HMI runs in a web browser that can be instantiated on a user device, and communicates directly to a vision system processor(s). Data can pass directly between the user interface running in a web browser and the vision system processor(s).