Layout Analysis Using Overlap and Prediction for Nested UI Regions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional layout analysis methods in electronic devices often result in inconsistencies between the services provided and the user's actual intent due to system component-based determinations, especially when nesting relationships exist between system components.
Innovation Solution
A layout analysis method that determines the user's intended service by analyzing the degree of overlapping between regions of interest (ROIs) and various types of regions on the display interface, using historical operation records and prediction models to improve accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If system component-based determination is used to identify user intent, then the implementation is simple and direct, but the accuracy deteriorates when nesting relationships exist between system components
Solution Approach 1:
The patent segments the determination process into multiple stages: first obtaining the pressing region, then determining multiple candidate system components that may correspond to the pressing region, and finally using a prediction model to select the most appropriate service. This segmentation allows the system to handle nesting relationships by considering multiple candidates rather than relying on a single direct mapping.
Solution Approach 2:
The patent introduces a prediction model as an intermediary between the system component identification and service selection. This intermediary processes the pressing region information and candidate components to determine the most likely user intent, thereby resolving the inconsistency caused by nesting relationships without requiring complex changes to the underlying system architecture.
2Measurement precision
If multiple candidate regions are considered to improve accuracy, then the user intent identification becomes more accurate, but the computational complexity increases
Solution Approach 1:
The patent obtains multiple candidate system components that may correspond to the pressing region, which is more than the single component that would be obtained through direct mapping. However, not all candidates are processed equally - the prediction model evaluates them and selects the most appropriate one, thus performing partial action on the set of candidates to balance accuracy and complexity.
Solution Approach 2:
The patent changes the parameter of component matching from exact matching to fuzzy matching with multiple candidates. This allows the system to consider nesting relationships and overlapping regions by accepting multiple potential matches, then uses the prediction model to resolve ambiguity, thereby improving accuracy without requiring exhaustive analysis of all possible components.
Data Source
AI summary
A device control method, apparatus, and system applicable to the field of smart home technologies. The method includes: recognizing a collected environmental image; determining at least one to-be-recognized region in the environmental image; monitoring a target body part movement in the to-be-recognized region; if it is monitored that the target body part movement is consistent with a preset activation movement, tracking and monitoring a target body part movement in a target to-be-recognized region; or if it is monitored that the target body part movement in the target to-be-recognized region is a preset control movement, controlling a terminal device to perform a function operation corresponding to the control movement. The terminal device is controlled by using a target body part movement including two-stage movements.