Mobile AR Video Analysis for Abstract Object Information Retrieval
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern handheld mobile devices struggle to provide information about abstract or intangible objects, such as software programs or individuals, as these cannot be adequately captured in video streams or still shots, limiting users' ability to access relevant data.
Innovation Solution
Implementing real-time video or still shot analysis using augmented reality (AR) to recognize and provide information about abstract representations, such as logos, artwork, or locations, by matching recognized objects in the video stream with associated data, including financial information like customer behavior history or purchase history.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If real-time video analysis is implemented to recognize and provide information about abstract representations, then users can receive relevant information about abstract objects, but the device complexity increases
Solution Approach 1:
The patent introduces an intermediary system consisting of servers, databases, and processing platforms that mediate between the mobile device and the abstract objects. The mobile device captures video streams, and the intermediary system performs the complex analysis to match visual representations with abstract objects (software, individuals, financial data), returning relevant information without requiring the mobile device itself to handle all processing complexity.
Solution Approach 2:
The system creates visual copies or representations of abstract objects in the video stream. For example, screenshots of software interfaces, photographs of individuals, or visual displays of financial data are captured and matched against the video feed. This allows abstract objects to be represented visually without requiring the device to directly interact with or store complex representations of all possible abstract objects.
2Loss of information
If video stream analysis is used to identify abstract objects, then information about these objects can be provided, but the measurement precision decreases because abstract objects cannot be adequately captured in video streams
Solution Approach 1:
The patent segments the identification process into multiple stages: first, visual elements in the video stream are captured and analyzed; second, these visual elements are matched against known representations of abstract objects; third, additional contextual information is retrieved and verified. This segmentation allows the system to handle the inherent imprecision of video-based abstract object recognition by breaking down the complex task into manageable steps, each with its own verification mechanisms.
Solution Approach 2:
The system implements feedback loops where the initial recognition results are verified against multiple data sources including financial institution databases, user profiles, and contextual information. If the initial match is uncertain or imprecise, the system requests additional input or verification before providing the final information, ensuring that measurement precision is maintained even when dealing with abstract objects that are difficult to capture accurately in video streams.
Data Source
AI summary
Methods, apparatus systems and computer program products are described herein that provide for using video or still shot analysis, such as AR or the like, to assist the user of mobile devices with receiving information corresponding to an abstraction or representation of a subject. Some subjects are difficult to capture in a video or still shot. The method and devices described herein capture representations of difficult to capture or unavailable subjects and presents information related to the subject with the representation. In an embodiment, the representation is a screenshot and the information is provided related to the application that is represented by the screenshot. Various other types of representations including depictions, advertisements, portions of, and identifying marks can be identified by the system and method and information presented relating to the corresponding subjects. In some cases, the information is customized with financial information of the user.