Shop Floor Screen Data Extraction for Cross-Network Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In the manufacturing industry, integrating data from facility operating systems with production planning and management systems is challenging due to differences in network security policies and automation levels, making it difficult to share real-time information across systems.
Innovation Solution
A device and method that encodes streaming video data from facility operating systems, extracts numeric and text data using video analysis, and transmits it to a data engine for integration, allowing for real-time monitoring and control across different networks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a separate interface program is used to integrate manufacturing site data and production order data, then data integration between facility operating systems and production management systems is achieved, but the device complexity and difficulty of design increase significantly due to the need to accommodate multiple facilities, operating systems, and development languages
Solution Approach 1:
The patent introduces an image processing server as an intermediary component that captures screen images from facility operating systems and extracts data through image recognition algorithms. This mediator translates between different system interfaces uniformly, eliminating the need for separate interface programs for each facility type and reducing overall system complexity while maintaining data integration capability
Solution Approach 2:
Instead of creating custom interface programs that directly interact with each facility operating system, the patent creates a visual copy (screen image) of the system interface and processes this copy through image recognition. This approach allows data extraction without direct system integration, reducing complexity while achieving the same data access goal
2Loss of information
If streaming video data is transmitted in real-time from facility operating systems to data engines, then real-time information sharing is improved, but network bandwidth consumption increases
Solution Approach 1:
The patent extracts only the necessary data elements from the full screen image using image recognition algorithms, rather than transmitting the entire video stream. By identifying and extracting only relevant data points (such as numerical values and status indicators), the system achieves real-time information availability while dramatically reducing the data transmission volume and network bandwidth consumption
Solution Approach 2:
The patent segments the screen image into meaningful data regions and extracts only the relevant information from each segment. Instead of processing and transmitting the complete video stream, the system divides the visual information into discrete data elements and transmits only these extracted values, reducing bandwidth usage while maintaining real-time data availability
Data Source
AI summary
One aspect of the present disclosure provides a device for extracting and transmitting data from a shop floor image, the device comprising: an encoder configured for receiving, from a facility operating system, streaming video data of a display screen of a monitor of the facility operating system on a shop floor, and for encoding the streaming video data in real time; a video data analyzer configured for receiving the real-time encoded streaming video data and for extracting data by figuring out and tagging a data presentation location in the real-time encoded streaming video data using a video data analysis algorithm; and a communication unit configured for transmitting to a data engine the real-time encoded streaming video data, and the data extracted by the video data analyzer.