Image-Based Screen Data Capture for Legacy Device Interfaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional device data collection systems face challenges in integrating with modern industrial Ethernet interfaces and software due to outdated communication protocols and lack of open interfaces, leading to difficulties in automated data collection and manual transcription errors.
Innovation Solution
A device data collection system utilizing image recognition technology, comprising an interface module, task management module, collection strategy execution module, and content recognition module, with virtual action, screen capturing, and image processing modules, enabling automatic data collection and integration across various screens and scenarios.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional communication interfaces and protocols are used, then device compatibility is maintained, but data collection capability deteriorates due to outdated protocols lacking industrial Ethernet interface support
Solution Approach 1:
The patent introduces an image recognition intermediary layer that captures screenshots of device interfaces and uses OCR technology to extract data, serving as a mediator between modern systems and legacy devices without standard communication interfaces
Solution Approach 2:
The patent replaces traditional mechanical communication interfaces with an optical recognition system that uses cameras to capture interface displays and digitally extracts information through image processing
2Productivity
If manual transcription is used for data collection, then device complexity is reduced, but data collection efficiency and accuracy deteriorate
Solution Approach 1:
The system enables automatic self-service data extraction by having the image recognition system automatically capture, process, and extract data from device interfaces without requiring manual intervention
Solution Approach 2:
The patent replaces manual transcription with automated optical recognition and digital data extraction systems that electronically capture and process interface information
3Adaptability or versatility
If unique operation monitoring interfaces are used for each device, then device functionality is optimized, but data collection versatility deteriorates due to lack of standardized interfaces
Solution Approach 1:
The patent creates a universal data collection system that can interface with multiple different device types through a single image recognition platform, making the system multi-functional across various devices without requiring device-specific integration
Data Source
Figure 1
Figure 2
AI summary
The present invention discloses a device data collection system based on image recognition, wherein the system comprises an interface module, a task management module, a collection strategy execution module, and a content recognition module. A device data collection method based on image recognition is further disclosed. The steps of the method are as follows. An external application invokes an interface module; a task management module screens out a list of tasks based on a task parameter obtained by the interface module; a collection strategy execution module performs screen capturing according to the list of tasks, performs local segmentation and preprocessing to obtain local images, and passes the local images to a content recognition module; the content recognition module performs recognition and calculation to obtain result data, and returns the result data to the collection strategy execution module; and the collection strategy execution module feeds back the returned result data to the interface module by using a preset format. The present invention implements automatic collection of screen data, thereby avoiding errors in manual transcription. Based on user-defined customer requirements, the system streamlines client applications and satisfies requirements of various screens and in various application scenarios.