Screen-Content Analysis for Context-Aware Electronic Device Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices face challenges in accurately recognizing user voice commands due to unsatisfactory voice recognition performance and the lack of intuitive guide information for controlling both internal and external device functions.
Innovation Solution
An electronic device that provides guide information based on use history, identifying keywords from content displayed, categorizing applications, and offering text commands to execute functions, with the ability to control external devices through a communication interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If representative utterance examples are displayed to guide user input, then ease of operation is improved, but the guide information becomes unrelated to current situation or content being output, inducing wrong utterances
Solution Approach 1:
The system performs preliminary analysis of the current content being output and pre-generates guide information that is contextually relevant. By analyzing the content beforehand and preparing appropriate utterance examples that match the current situation, the system ensures that guide information is both helpful and accurate, preventing users from being induced to make wrong utterances.
2Device complexity
If the electronic device provides guide information only for its own functions, then device complexity is reduced, but adaptability to control external devices is limited
Solution Approach 1:
The electronic device implements a universal guide information provision mechanism that can control both its own functions and external electronic devices through voice commands. The system analyzes content output, identifies relevant applications and devices, and generates guide information that works across multiple devices and functions, making the device versatile without proportionally increasing complexity.
3Reliability
If voice recognition performance is improved to accurately recognize user commands, then reliability is improved, but the system requires more sophisticated processing that increases device complexity
Solution Approach 1:
The system introduces an intermediary content analysis mechanism that bridges the gap between simple voice input and accurate command recognition. By analyzing the content being output and using it as context, the system can more accurately interpret user voice commands without requiring overly sophisticated voice recognition algorithms, thus improving reliability while controlling complexity.
Data Source
Figure 1~3
Figure 4~5
Figure 6~7
AI summary
An electronic device includes a storage, and a processor to identify a category corresponding to a keyword related to a content of an output screen, to obtain use history of at least one application corresponding to the identified category, and to provide, based on the use history, guide information to guide a user to select one of the at least one application for execution by the electronic device.