Non-Invasive Cursor Image Detection via Screen Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for collecting machine data from old machines face challenges such as increased operational load on processors, limited system resources, and difficulty in installing mouse control feedback programs, leading to inconsistent cursor movement and errors in data collection.
Innovation Solution
A non-invasive data-extraction system using an image processing unit to detect and compare cursor images on the operation screen, applying a cursor mask for pattern recognition, and transmitting feedback status to a software control system, thereby reducing processor load and ensuring accurate cursor movement without intervening with the target machine.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If invasive data-extraction method is used to collect machine data, then data collection capability is improved, but system reliability deteriorates due to signal loss and cursor control failure
Solution Approach 1:
The patent introduces an intermediary feedback program that acts as a mediator between the mouse control signal and the cursor display. This feedback program captures cursor position information from the display screen and sends it back to the data extraction system, enabling reliable data collection without directly interfering with the target machine's cursor control mechanisms.
Solution Approach 2:
Instead of directly accessing or modifying the target machine's cursor control system, the patent creates a copy of the cursor position information by capturing the display screen content. This copying approach allows data extraction while maintaining the original system's integrity and avoiding signal loss or control failure.
2Measurement precision
If mouse control feedback program is installed on old machine, then cursor control accuracy is improved, but device complexity increases due to hardware expansion limitations
Solution Approach 1:
The patent replaces the mechanical approach of installing additional hardware devices on old machines with a software-based solution. By using screen capture and image processing techniques, the system obtains cursor position information without requiring any hardware expansion or modification of the target machine's physical configuration.
Solution Approach 2:
The feedback program serves as a software intermediary that bridges the gap between the existing mouse control system and the data extraction requirements. It captures cursor information from the display output rather than interfacing with the mouse hardware directly, thus avoiding hardware complexity while achieving accurate cursor position tracking.
3Productivity
If processor resources are allocated for data collection on old machine, then data extraction capability is improved, but operational load increases causing system performance degradation
Solution Approach 1:
The patent implements periodic action by capturing cursor position information at specific intervals rather than continuously monitoring every processor cycle. The feedback program operates in a periodic manner, extracting data at predetermined time points, which reduces the overall processor load while still achieving effective data collection for analysis purposes.
Solution Approach 2:
The patent extracts only the necessary cursor position information from the display screen rather than processing all screen content or system data. By selectively extracting only the relevant cursor coordinates and movement data, the system minimizes processor resource consumption while maintaining effective data extraction capability for user behavior analysis.
Data Source
AI summary
A cursor image detection comparison and feedback status determination method is disclosed. The method is based on a non-invasive data-extraction system architecture, and uses an image processing unit to perform detection comparison on a cursor image shown on an operation screen outputted from a machine controller. The method includes steps of obtaining cursor foreground and background images set by a user, and selecting an algorithm to process the cursor foreground and background images to generate a cursor mask, and reading a cursor image and applying the cursor mask on the cursor image for pattern comparison, transmitting information of a comparison result and a cursor feedback status to a software control system, so as to provide a correction system to perform a cursor process program and check whether the movement of the cursor meet a position controlled by a feedback and correction system, thereby completing closed-loop control for the cursor.