User Terminal Device Drawing Input Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current user terminal devices lack an efficient method for convenient user interaction, as they require explicit selection and manipulation of icons to access applications, leading to cumbersome navigation and delayed service access.
Innovation Solution
A user terminal device equipped with a display, detector, and controller that processes user drawing inputs as inputs for corresponding programs, allowing for direct execution of applications and services by recognizing text, symbols, and connections between objects, enabling quick and intuitive control operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional icon selection method is used, then application execution is reliable, but user interaction efficiency deteriorates due to cumbersome navigation
Solution Approach 1:
The patent replaces traditional mechanical icon selection and menu navigation with voice command recognition. Users speak natural language commands which are processed by speech-to-text conversion and natural language understanding modules, directly triggering application execution or function invocation without manual navigation through icons or menus.
Solution Approach 2:
The patent introduces voice recognition and natural language processing as intermediary layers between the user and the operating system. The voice input is converted to text, interpreted through NLU to determine user intent, and then mapped to corresponding system commands or application launches, serving as a mediator that translates human speech into machine actions.
2Loss of time
If manual icon selection is required, then application control is precise, but user interaction time increases
Solution Approach 1:
The patent substitutes manual icon selection with voice-based direct command input. Instead of navigating through UI elements, users speak commands that are directly interpreted by the system's speech recognition and natural language understanding components, executing the desired action immediately without intermediate navigation steps.
Solution Approach 2:
The system performs preliminary processing of voice commands through speech-to-text conversion and natural language understanding before executing the intended action. This preliminary interpretation phase allows the system to anticipate user intent and prepare the appropriate response or application launch in advance, reducing overall interaction time.
Data Source
Figure 1~3
Figure 4~5
Figure 6
AI summary
A user terminal device is provided. The device includes a display configured to display a screen including an object, a detector configured to detect a user drawing input which is input on the object or in an area surrounding the object, a controller configured to, in response to the user drawing input being detected, execute a program corresponding to the object and display, on the display, a screen where the user drawing input is processed as an input of the program. Accordingly, the operations of the user terminal device may be controlled conveniently.