Screen Image Analysis for Control Machine Command Conversion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in coordinating information devices with control machines, especially when the format of control commands is unknown, leading to increased development costs and difficulties in generating dedicated applications for factory automation devices.
Innovation Solution
An information processing device equipped with an application controller, image analyzer, and communication controller that analyzes images displayed on a device and converts data into formats recognizable by control machines, enabling seamless communication and automation between incompatible applications and control machines.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a dedicated application with coordination function is used to connect information device and control machine, then coordination capability is improved, but development cost increases significantly
Solution Approach 1:
The patent makes the information device's display application serve multiple functions: it not only displays information but also acts as a communication interface with the control machine. By analyzing the display content and extracting control commands, the system eliminates the need for separate dedicated coordination applications, reducing development costs while maintaining coordination capability.
Solution Approach 2:
The patent introduces an image analysis function as an intermediary between the display application and the control machine. This intermediary extracts meaningful data from the displayed images and converts it into control commands, enabling communication without requiring the application to have built-in coordination functions or the control machine to expose detailed protocols.
2Ease of manufacture
If control machine's communication protocol or interface specification is released for third-party application development, then dedicated application generation is enabled, but security and proprietary information protection is compromised
Solution Approach 1:
The patent introduces image analysis as an intermediary layer that interacts only with the control machine's visual display interface. This intermediary extracts necessary control information without requiring access to the control machine's internal protocols, interfaces, or proprietary specifications, thereby maintaining information security while enabling third-party application development.
Solution Approach 2:
Instead of requiring access to the control machine's communication protocols or interface specifications, the patent copies the necessary information from the control machine's display output. This approach allows third-party applications to function without needing to know or access the control machine's proprietary communication methods, protecting intellectual property while enabling compatibility.
Data Source
AI summary
An information processing device includes an application controller, an image analyzer, and a communication controller. The application controller executes an application that causes an image to be displayed on a display. The image analyzer analyzes the image displayed on the display by the application. The communication controller converts, based on a result of analysis of the image by the image analyzer, data obtained from the image displayed on the display by the application into data recognizable by a control machine, and transmits the converted data to the control machine.