Electronic Device Routine Execution Based on Screen Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is a need for an electronic device and method that can recognize content provided by the device and user intentions, and execute routines that reflect these intentions, particularly for frequently used applications and screen states, to enhance user interface efficiency.
Innovation Solution
The electronic device identifies content and UI components on its screen, obtains state information based on this identification, and uses usage pattern information to determine and execute appropriate routines for tasks such as sharing reviews or skipping advertisements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the electronic device provides diverse user interface configurations for various content types, then the usability and user experience are improved, but the device complexity and difficulty of detecting user intention increase
Solution Approach 1:
The electronic device automatically detects content type and user intention without requiring manual configuration. The processor identifies content characteristics and autonomously selects appropriate UI configurations, allowing the system to serve itself rather than requiring complex user setup
Solution Approach 2:
The system dynamically changes UI parameters based on detected content type and user intention. The processor adjusts interface characteristics (such as layout, interaction modes, or display properties) according to the identified content characteristics, enabling adaptive behavior without hardcoding multiple static configurations
2Productivity
If the electronic device automatically executes routines based on content identification, then productivity and user experience are improved, but the extent of automation increases system complexity
Solution Approach 1:
The system pre-defines multiple routines associated with different content types and user intentions. When content is identified, the processor selects and executes the corresponding pre-prepared routine, eliminating the need for complex real-time decision-making logic while maintaining high automation
Solution Approach 2:
The system uses usage pattern information as feedback to refine routine selection. The processor analyzes user interaction patterns and adjusts routine execution based on this feedback, enabling intelligent automation that learns from user behavior without requiring complex explicit programming
Data Source
AI summary
An operating method of an electronic device is provided. The operating method includes executing a first application in the electronic device, identifying a first content and at least one user interface (UI) component that are displayed on a first execution screen of the first application, obtaining first state information of the first execution screen based on a result of the identifying of the first content and the at least one UI component, obtaining a routine for performing a first task corresponding to the first state information based on usage pattern information of applications for a user of the electronic device and the first state information, and executing the routine.