Speech-Based AR Content Selection in Messaging Apps
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing messaging systems lack an efficient method for users to select and display augmented reality content, particularly in a manner that is intuitive and user-friendly.
Innovation Solution
A messaging application that utilizes speech recognition to allow users to select augmented reality content items based on voice commands, determining keywords from the speech input and querying a database to identify and display the corresponding augmented reality content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional manual selection methods are used for augmented reality content, then users have precise control over content selection, but the operation complexity and time consumption increase significantly
Solution Approach 1:
The patent replaces manual mechanical selection operations with speech-based acoustic input. Users speak natural language commands to select augmented reality content, eliminating the need for manual browsing and selection through graphical interfaces. This substitution dramatically reduces operation time and complexity while maintaining selection accuracy through speech recognition technology.
Solution Approach 2:
The patent introduces speech recognition technology as an intermediary between the user and the augmented reality content selection system. The speech recognition module converts spoken commands into structured input that the system can process, serving as a mediator that translates natural language intent into actionable content selection without requiring direct manual interaction with content interfaces.
2Ease of operation
If speech recognition is implemented for content selection, then user experience and intuitiveness improve, but system complexity increases
Solution Approach 1:
The patent integrates speech recognition functionality into the existing messaging application framework, allowing the same system to handle both traditional messaging operations and augmented reality content selection. By making the messaging application multi-functional, the patent avoids creating a separate complex system while still providing speech-based selection capabilities, thus limiting the increase in overall system complexity.
3Productivity
If manual browsing of augmented reality content is required, then content selection precision is maintained, but productivity and efficiency decrease
Solution Approach 1:
The patent replaces manual browsing operations with speech-based direct selection. Instead of requiring users to manually navigate through content options, the speech recognition system interprets spoken commands to directly identify and select the desired augmented reality content, significantly improving selection efficiency while maintaining accuracy through natural language processing capabilities.
Solution Approach 2:
The system performs preliminary processing of speech input to extract relevant keywords and intent before presenting content options or making selections. This preliminary action of analyzing and structuring speech input ensures that the subsequent content selection is both efficient and accurate, as the system already understands the user's intent before executing the selection process.
Data Source
AI summary
Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for displaying augmented reality content. The program and method provide for receiving, by a device, speech input to select augmented reality content for display; determining at least one keyword included in the speech input; identifying, from plural augmented reality content items, an augmented reality content item corresponding to the at least one keyword; and displaying the augmented reality content item with an image captured by a camera of the device.