Automated Monitoring Screen Data Generation via Image Recognition

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional monitoring-screen-data generation devices require significant time and effort for system designers to manually assign data defining state transitions to image objects, making the process inefficient.

Innovation Solution

A monitoring-screen-data generation device comprising an image-data obtaining unit, an object-data generation unit, a screen-data generation unit, and an assignment processing unit that automatically identifies and assigns state transition data to image objects based on image data and definition data, facilitating the generation of monitoring screen data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual assignment of state transition data to image objects is performed, then monitoring screen data can be generated, but the time and effort required increases significantly

Engineering Contradiction:

Improveaccuracy of state transition data assignmentVSAvoidtime required to create monitoring screen data

Core Design Contradiction:

Manufacturing precisionVSLoss of time

Solution Approach 1:

The system captures a screenshot of the monitoring screen and uses image recognition to automatically identify image objects and their corresponding state transition data. This copying approach replaces manual assignment by automatically extracting information from the existing screen layout, significantly reducing the time required while maintaining accuracy through automated image processing and pattern recognition algorithms

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The system enables self-service by allowing the monitoring screen data to generate its own metadata automatically. The image recognition unit processes the screen screenshot and automatically assigns state transition data to image objects without requiring manual intervention, making the system self-configuring and eliminating the need for time-consuming manual data entry

Inventive Principle:

Principle #25Self-service

2Reliability

If manual assignment of state transition data is performed, then complete monitoring screen data can be created, but the complexity of the process increases

Engineering Contradiction:

Improvecompleteness of monitoring screen dataVSAvoidcomplexity of data assignment process

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical manual assignment process with an automated image recognition and data processing system. The system uses computer vision algorithms to identify image objects in screenshots and automatically matches them with corresponding state transition data from definition data, eliminating the need for manual dragging, dropping, or configuration while ensuring complete and accurate data assignment

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system introduces an intermediary image recognition unit that acts as a mediator between the monitoring screen screenshot and the state transition data. This intermediary automatically processes the visual information, identifies image objects, and bridges them with the appropriate data definitions, simplifying the overall process while maintaining data completeness and reliability

Inventive Principle:

Principle #24Intermediary (Mediator)

3Productivity

If automated image recognition is used to generate monitoring screen data, then the speed of data creation improves, but the complexity of the system increases

Engineering Contradiction:

Improvespeed of monitoring screen data generationVSAvoidsystem complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The system segments the monitoring screen data generation process into distinct functional units: screenshot capture, image recognition, object identification, data matching, and data generation. This segmentation allows each component to be optimized independently for speed while managing system complexity through modular architecture, where the image recognition unit processes visual data and the data generation unit creates the structured output

Inventive Principle:

Principle #1Segmentation

4Ease of operation

If automated assignment processing is implemented, then manual effort is reduced, but the initial system setup complexity increases

Engineering Contradiction:

Improveease of monitoring screen data creationVSAvoidinitial system configuration complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by pre-processing the monitoring screen screenshot and pre-identifying image objects before actual data generation is needed. The image recognition unit continuously analyzes screen layouts and maintains a database of identified objects and their corresponding state transition data, so that when monitoring screen data needs to be created or updated, the system can quickly retrieve and assign the pre-processed information without requiring complex real-time configuration

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS11222226B2Monitoring-screen-data generation device, monitoring-screen-data generation method, and recording medium

Publication Date: 2022.01.11 MITSUBISHI ELECTRIC CORP

AI summary

A monitoring-screen-data generation device includes an object-data generation unit, a screen-data generation unit, and an assignment processing unit. The object-data generation unit identifies a plurality of objects included in an image based on image data, and generates object data. The screen-data generation unit generates monitoring screen data on the basis of the object data. On the basis of definition data that defines a state transition and the object data, the assignment processing unit assigns data that defines the state transition to an image object included in a monitoring screen of the monitoring screen data.