Semantic Media Cursor for Streamlined Multimedia Insertion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing user interfaces for inserting multimedia content into text require cumbersome manual operations, such as opening a gallery and selecting an image, leading to a subpar user experience.
Innovation Solution
An interaction method that automatically searches for media information matching user-entered text, using a second-style cursor to indicate the found media, allowing users to select and apply the media without additional search commands.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual operations are used to insert multimedia content (opening gallery, selecting image), then the user can insert media information, but the user operation becomes cumbersome and user experience deteriorates
Solution Approach 1:
The system performs preliminary action by automatically searching for and pre-selecting media information that matches the user's text input before the user completes the insertion operation. The cursor transformation indicates that the system has already completed the search and selection work, so the user only needs to confirm the pre-selected result, thereby eliminating the time-consuming manual browsing and selection process.
Solution Approach 2:
The system provides self-service by autonomously performing the media search and selection task without requiring manual user intervention. When the user inputs text, the system automatically searches its media database, identifies matching content, and presents the results through cursor transformation, allowing the user to simply confirm rather than manually search and select, thus making the system serve the user's needs automatically.
2Ease of operation
If automatic media search is implemented based on text input, then user operation is simplified, but the system complexity increases
Solution Approach 1:
The system applies universality by making the cursor serve multiple functions: it not only indicates text input position but also transforms to display media search results and indicate media types. This multi-functionality allows the system to perform automatic media search and presentation without adding separate complex interfaces or controls, thereby simplifying user interaction while implementing advanced functionality.
Solution Approach 2:
The system uses parameter changes by transforming the cursor's visual parameters (shape, content displayed) to convey different states and information. The cursor changes from a standard text input indicator to a media result indicator showing thumbnails and media types, allowing the system to communicate complex information efficiently without requiring additional UI elements or increasing overall system complexity.
3Loss of information
If cursor is transformed to indicate media search results, then user can learn search status intuitively, but the interface complexity increases
Solution Approach 1:
The cursor is designed with multi-functionality to simultaneously serve as a text input indicator, a media search result display, and a media type indicator. By consolidating these multiple information presentation functions into a single cursor element, the system conveys comprehensive search status information without introducing separate complex interface components, thereby maintaining interface simplicity while reducing information loss.
Solution Approach 2:
The system employs parameter changes by dynamically modifying the cursor's visual parameters (displayed content, shape, icons) to encode different types of information about media search results. This allows the cursor to convey rich search status information including media thumbnails, media types, and selection state through parameter variations rather than through additional interface elements, thus reducing interface complexity while preventing information loss.
Data Source
Figure 1
Figure 2
Figure 3(a)~3(b)
AI summary
An interaction method and an apparatus are disclosed, and relate to the field of terminal technologies. The method includes: An electronic device receives a first user operation, and obtains a first text in response to the first user operation, where the first user operation is used to enter a text, and the first text includes the text entered by using the first user operation; searches, based on the first text, for media information that matches semantics of the first text; changes a first-style cursor to a second-style cursor, where the second-style cursor indicates that the media information is found; and receives a second user operation on the second-style cursor, and displays the media information in response to the second user operation. According to this application, complexity of a user operation can be reduced, and user experience can be improved.