Object-Anchored Voice Memo UI for Image-Based Text Placement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices require multiple steps for generating and displaying text information from user voice, including executing an application, inputting a trigger, uttering voice, and designating display position and size, which is inconvenient.
Innovation Solution
An electronic device that intuitively and simply provides text information corresponding to user voice by identifying objects in an image and correlating them with user voice input, using object and voice recognition, and displaying the text information on the desired area based on user interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a touch screen displays detailed map information at a first magnification level, then the map information is clear and detailed, but the battery consumption increases
Solution Approach 1:
The system dynamically adjusts the magnification level of the map display based on the detected operation state of the electronic device. When the device is in a power-saving mode or low battery state, the system automatically reduces magnification to conserve energy while maintaining usability. This dynamic adaptation resolves the contradiction by making the display detail flexible rather than fixed.
Solution Approach 2:
The system changes the display parameter (magnification level) based on the operation state. By detecting battery level, power mode, or usage patterns, the system adjusts the magnification parameter to an appropriate level that balances detail visibility with energy consumption requirements.
2Measurement precision
If a touch screen displays detailed map information at a first magnification level, then the map information is clear and detailed, but the size of the touch screen required increases
Solution Approach 1:
The system dynamically adjusts magnification level based on detected finger size or user characteristics. By identifying whether the user has large or small fingers through touch patterns, the system adapts the display magnification to ensure that map details are visible and interactable within the existing screen boundaries, eliminating the need for a larger physical display.
3Ease of operation
If operation information is displayed in pop-up windows, then the information is easily accessible, but the aesthetic appearance deteriorates due to frequent popping
Solution Approach 1:
The system extracts the operation information from traditional pop-up windows and integrates it into the main display area through status bars, headers, or inline indicators. This extraction maintains information accessibility while eliminating the visual disruption and aesthetic degradation caused by frequent pop-up appearances.
Solution Approach 2:
The system merges the operation information display with the existing user interface elements rather than using separate pop-up windows. By combining the information presentation with the main interface, the system maintains ease of access while preserving aesthetic continuity and avoiding the jarring effect of frequent pop-ups.
4Ease of operation
If the magnification level is adjusted based on finger size, then the operability improves for different users, but the device complexity increases
Solution Approach 1:
The system performs self-calibration by automatically detecting finger size characteristics during normal touch operations and adjusting magnification levels without requiring manual user input or complex external sensors. The device uses its existing touch screen controller to analyze touch patterns and infer finger size, thereby improving operability while avoiding additional hardware complexity.
Data Source
Figure 1
Figure 2
Figure 3A
AI summary
Provided are an electronic device capable of providing text information corresponding to a user voice through a user interface and a method of controlling the electronic device. Specifically, an electronic device according to the present disclosure, when an image including at least one object is obtained, analyzes the image to identify the at least one object included in the image, and when a user voice is received, performs voice recognition on the user voice to obtain text information corresponding to the user voice, then identifies an object corresponding to the user voice among the at least one object included in the image, and displays a memo user interface (Ul) including text information on an area corresponding to the object identified as corresponding to the user voice among areas on a display.