Remote OS Error Handling Using Screen Image Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic systems face inefficiencies in managing uncontrollable errors in operating systems, requiring manual intervention and in-person visits for analysis and recovery, especially when errors occur due to peripheral devices.
Innovation Solution
An electronic system and method that utilizes a management device connected through a communication network to monitor and analyze screen image data from monitored devices, determining error types and automatically initiating follow-up actions based on error determination factors, reducing the need for manual intervention.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If manual intervention and in-person visits are used for error analysis and recovery, then error management can be performed with simple system architecture, but productivity and time efficiency deteriorate due to required physical presence
Solution Approach 1:
A management device is introduced as an intermediary between monitored devices and human operators. The management device receives screen image data from monitored devices, analyzes error types using error determination factors, and automatically performs follow-up actions. This intermediary handles the complex analysis and decision-making processes, allowing simple monitored devices to achieve high error management efficiency without requiring physical presence for error analysis and recovery
Solution Approach 2:
The patent replaces the mechanical system of physical presence and manual intervention with an automated information processing system. Screen image data is transmitted electronically to the management device, which uses automated analysis based on error determination factors (such as color information, text information, and image processing) to identify error types and execute follow-up actions remotely, eliminating the need for physical travel and manual on-site operations
2Loss of time
If automated error management is implemented, then productivity and time efficiency improve, but device complexity increases due to additional monitoring and analysis components
Solution Approach 1:
The management device is configured with pre-defined error determination factors and corresponding error type classifications before errors occur. When screen image data is received, the system immediately compares the data against these pre-established criteria to rapidly determine error types and execute corresponding follow-up actions. This preliminary preparation of analysis frameworks and response protocols enables fast error recovery without requiring complex real-time decision algorithms
Solution Approach 2:
The system uses screen image data as a copy or representation of the actual error state on the monitored device. By analyzing this visual copy rather than requiring direct physical access to the device, the system achieves rapid remote error diagnosis. The screen image serves as a sufficient replica of the error condition, enabling automated analysis and follow-up actions without complex direct device interaction
3Measurement precision
If comprehensive error analysis is performed using multiple error determination factors, then measurement precision of error types improves, but device complexity and computational requirements increase
Solution Approach 1:
The error analysis process is segmented into distinct components: screen image data acquisition, error determination factor extraction (color information, text information, image processing features), error type classification, and follow-up action selection. Each segment handles a specific aspect of the analysis, making the overall complex process manageable and efficient. The management device processes these segmented elements sequentially or in parallel depending on the error situation
Solution Approach 2:
The management device is designed with universal error determination capabilities that can handle multiple types of errors using the same framework of error determination factors. The system uses a unified approach combining color analysis, text recognition, and image processing to identify various error types (such as BSOD, application crashes, system freezes). This multi-functional error analysis system achieves high measurement precision across different error scenarios without requiring separate specialized systems for each error type
4Speed
If real-time monitoring of screen image data is implemented, then error detection speed improves, but use of energy and computing resources increases
Solution Approach 1:
The system implements periodic monitoring of screen image data at predetermined time intervals rather than continuous real-time monitoring. The management device receives screen image data from monitored devices at these periodic intervals and performs error analysis based on the received data. This periodic approach maintains error detection speed by frequently sampling system state while significantly reducing energy and computing resource consumption compared to continuous monitoring
Solution Approach 2:
The system performs error determination analysis only on received screen image data that shows changes or potential error conditions, rather than analyzing every single screen image. The management device uses error determination factors to identify only the necessary information for error detection (such as color changes indicating BSOD, specific text patterns, or image differences from baseline). This partial analysis approach achieves fast error detection while minimizing unnecessary computing resource consumption on normal operating states
Data Source
AI summary
An electronic system includes a monitored device and a management device. The monitored device operates according to an operating system and generates a display image. The management device is connected to the monitored device through a communication network. The management device periodically receives, from the monitored device, screen image data corresponding to the display image, determines whether an error that causes the operating system of the monitored device to become inoperable occurs in the operating system of the monitored device based on a network connection state with the monitored device, determines a type of the error based on error determination factors and an analysis result of the screen image data, and transfers, to the monitored device, a request indicating follow-up actions to take to resolve the error, the follow-up actions corresponding to the type of the error.


