Travel Image AR Content Using Object And Context Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing messaging systems lack the ability to facilitate the creation and selection of augmented reality content during travel, limiting the enhancement of captured images with relevant travel-related information.
Innovation Solution
A messaging system that integrates object detection and supplemental content systems to identify objects in captured images, determine travel parameters, and provide augmented reality content items based on these parameters, including travel schedules, transportation schedules, general locations, specific venues, activities, and topics of interest.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If messaging systems integrate object detection and supplemental content systems to identify objects in captured images and determine travel parameters, then the ability to provide augmented reality content with travel-related information is improved, but the device complexity increases
Solution Approach 1:
The patent combines multiple previously separate systems (messaging system, object detection system, supplemental content system, and augmented reality content system) into an integrated platform. This merging allows the system to leverage existing capabilities of each component while achieving enhanced functionality that none of the individual systems could provide alone, specifically enabling travel-based augmented reality content delivery through message sharing.
Solution Approach 2:
The messaging system is enhanced to serve multiple functions: traditional messaging, object detection, travel parameter determination, supplemental content retrieval, and augmented reality content delivery. This multi-functionality allows a single platform to handle diverse operations across different domains (communication, computer vision, data retrieval, and immersive content delivery) without requiring separate dedicated systems for each function.
2Loss of information
If the system processes travel parameters and object attributes to obtain supplemental content, then the relevance of augmented reality content to user travel experiences is improved, but the processing time and loss of time increase
Solution Approach 1:
The system performs preliminary processing of travel parameters and object attributes to pre-identify relevant supplemental content categories and sources. By preparing and organizing potential content sources in advance based on detected objects and travel context, the system reduces the time required for content retrieval and assembly when augmented reality content is requested, as the framework for content selection is already established.
Solution Approach 2:
The system implements feedback mechanisms where processing results from object detection and travel parameter analysis continuously inform and refine supplemental content selection. This iterative feedback loop allows the system to optimize content relevance by adjusting content selection based on processed information, improving the accuracy of travel-related content delivery while managing processing efficiency through learned patterns from previous interactions.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality content with a captured image in association with traveling, in accordance with some example embodiments. The program and method provide for receiving, by a messaging application running on a device of a user, a request to scan an image captured by a device camera; determining, in response to the receiving, a travel parameter associated with the request and an attribute of an object depicted in the image; obtaining supplemental content based on the travel parameter and on the attribute; and displaying an augmented reality content item, which includes the supplemental content, with the captured image.