Messaging App Gesture-Based AR Content Integration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing messaging systems lack an efficient method for users to easily select and integrate augmented reality content into messages, particularly in conjunction with image capture.
Innovation Solution
A messaging application that detects a predefined gesture, such as a pinch gesture, to switch from a first user interface displaying media content to a second user interface where a device camera captures an image. The second user interface combines the captured image with a resized version of the media content and displays a carousel of ranked augmented reality content items based on objects detected in both the media content and the captured image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a messaging system provides traditional media content viewing interface, then users can view media content, but users cannot easily select and integrate augmented reality content into messages
Solution Approach 1:
The patent merges the media content viewing interface with AR content selection and integration capabilities. The carousel interface combines media content display with AR content options, allowing users to integrate AR content directly while viewing media content without switching interfaces or performing complex manual selection processes.
Solution Approach 2:
The system automatically detects objects in the captured image and ranks relevant AR content items based on the detected objects. This automated ranking eliminates the need for users to manually search or select from numerous AR options, making the AR content selection process intuitive and efficient.
2Adaptability or versatility
If the system displays multiple augmented reality content items, then users have more content options, but the interface becomes more complex and harder to navigate
Solution Approach 1:
The patent segments the AR content presentation into a dedicated carousel interface that is separate from the main media content display. This segmented structure allows multiple AR content items to be displayed in an organized, scrollable format, making the interface easier to navigate while maintaining access to numerous AR options.
Solution Approach 2:
The system performs preliminary object detection and content ranking before the user needs to select AR content. By pre-processing the captured image to identify objects and pre-ranking AR content items based on detected objects, the system prepares the information in advance, reducing the cognitive load on users during the selection process.
3Extent of automation
If the system automatically detects objects and ranks AR content, then AR content selection becomes more intelligent, but processing time and computational resources increase
Solution Approach 1:
The system performs object detection and AR content ranking selectively based on the media content being viewed and the captured image. Rather than continuously processing all possible content, the system processes only the relevant objects and content items needed for the current viewing context, reducing unnecessary computational overhead while maintaining intelligent automation where needed.
Data Source
AI summary
Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for displaying augmented reality content. The program and method provide for displaying, within a messaging application running on a device, a first user interface for viewing a media content item; receiving user input via the first user interface, the user input corresponding to a predefined touch gesture; and in response to receiving the user input, switching, within the messaging application, from the first user interface to a second user interface in which a camera of the device is activated to capture an image, and displaying, via the second user interface, a resized version of the media content item with the image.