AI Key Information Interface Inference from Window Pixel Data

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing technologies struggle to adaptively display key information for different applications and games, especially with the introduction of new electronic devices and applications, due to challenges in setting the required key information categories and items.

Innovation Solution

A displaying method using artificial intelligence to infer key information categories and items based on pixel data of window frames, employing a key information inference model trained through supervised, unsupervised, or reinforcement learning algorithms, and optimizing the model based on user corrections.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional methods are used to display key information, then the display is simple and direct, but the system cannot adaptively display different key information for different applications and games

Engineering Contradiction:

Improveadaptability to different applicationsVSAvoidsystem complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system automatically infers the current application type and determines appropriate key information categories and items without requiring manual user configuration. The inference model self-adapts to different applications by analyzing pixel data and window frame characteristics, enabling the system to serve itself in configuring the display based on the running application.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system dynamically changes display parameters (key information categories and items) based on the inferred application type. By using the inference model to analyze pixel data and determine the current application context, the system adjusts which key information is displayed, transforming the display configuration from static to dynamic based on application parameters.

Inventive Principle:

Principle #35Parameter changes

2Productivity

If manual configuration of key information categories and items is used, then the display can be customized, but the process is time-consuming and cannot keep up with new applications

Engineering Contradiction:

Improvespeed of adapting to new applicationsVSAvoidtime for configuration

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The inference model is pre-trained with comprehensive application type knowledge and key information associations during the model establishment phase. This preliminary preparation enables the system to quickly infer and adapt to new applications without requiring time-consuming manual configuration when the applications are actually used, significantly reducing the adaptation time for new software.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system replaces the manual mechanical configuration process with an automated AI inference process. Instead of users manually selecting and configuring key information categories and items for each application, the inference model automatically performs this task by analyzing pixel data and window frame characteristics, dramatically improving the speed of adaptation to new applications.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If comprehensive key information is displayed for all applications, then all possible information is available, but the display becomes cluttered and irrelevant information is shown

Engineering Contradiction:

Improveaccuracy of information relevanceVSAvoidinformation quality

Core Design Contradiction:

Measurement precisionVSLoss of information

Solution Approach 1:

The system applies different display configurations (key information categories and items) to different local contexts (application types). By using the inference model to determine the current application context, the system displays only the relevant key information categories and items for that specific application type, ensuring that each display instance has the appropriate local quality of information relevance rather than a uniform comprehensive display.

Inventive Principle:

Principle #3Local quality

Data Source

PatentUS12461759B2Displaying method for key information interface, establishing method for key information inference model, and electronic device using the same

Publication Date: 2025.11.04 ACER INC

AI summary

A displaying method for a key information interface, an establishing method for a key information inference model and an electronic device using the same are provided. The electronic device includes an application layer operation unit, a data analysis unit, an artificial intelligence operation unit and a hardware layer monitoring unit. If a hot key is triggered, the application layer operation unit detects a focused window. The data analysis unit is used to obtain at least one window frame of the focused window and obtain a plurality of pixel data according to the window frame. The artificial intelligence operation unit uses a key information inference model to infer at least one key information category and at least one key information item of a key information interface according to the pixel data. The hardware layer monitoring unit is used to retrieve an information content corresponding to the key information item.