Augmented Reality Object Identification via Continuous Image Stream
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems require users to manually capture and send individual images for analysis, leading to inefficient information retrieval and repeated processing, which consumes computing resources and user time.
Innovation Solution
A system that uses continuous image data streams from user devices to identify objects and provide real-time information using augmented reality, refining searches and aggregating data based on device data such as location, orientation, and time, eliminating the need for manual input and repeated processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users manually capture and send individual images for analysis, then object information can be retrieved, but the process requires repeated user input and consumes excessive computing resources
Solution Approach 1:
The system continuously captures image data streams from the camera without requiring repeated manual capture actions. The continuous stream allows the system to maintain constant object tracking and information retrieval, eliminating the start-stop nature of manual capture and significantly improving both ease of operation and productivity
Solution Approach 2:
The system performs preliminary object identification and tracking using the continuous image stream before the user even completes their information query. By having objects pre-identified and tracked in advance, the system eliminates the need for repeated user capture actions and reduces computing resources needed for each individual search
2Reliability
If the system processes each captured image individually, then search results can be provided, but computing resources are consumed repeatedly for the same objects
Solution Approach 1:
The system uses feedback from continuous image stream analysis to maintain object identification state across multiple frames. By comparing successive frames and tracking object persistence, the system confirms object identity without re-processing the entire image, thereby maintaining search result accuracy while dramatically reducing computing resource consumption
Solution Approach 2:
The system creates and maintains object identification copies from the continuous image stream rather than re-analyzing each frame from scratch. Once an object is identified in one frame, the system uses that identification information for subsequent frames, reducing redundant computing while preserving accurate search results
3Measurement precision
If manual picture capture is used, then users can send images for analysis, but the process is time-consuming and requires multiple attempts if results are incorrect
Solution Approach 1:
The continuous image stream provides uninterrupted object tracking and identification, allowing the system to maintain accurate object recognition over time without requiring multiple discrete capture attempts. This continuity eliminates the time loss associated with recapturing images when initial results are incorrect
Solution Approach 2:
The system performs preliminary and continuous object identification using the image stream before the user needs the information. By having objects pre-identified and tracked continuously, the system ensures accurate identification is already in place when the user requests information, eliminating the need for repeated capture and analysis attempts
Data Source
AI summary
In various example embodiments, a system and method for providing information in an augmented reality display are provided. In example embodiments, an initial continuous stream of image data captured by a client device is received. An object within the continuous stream of image data is initially identified. The continuous stream of image data is further received and comprises additional image data regarding the object. The additional image data provides more visual details and features of the object than the initially received image data. Using the additional visual data, the identification of the object is refined to indicate a specific type of object. Based on the refined identification of the object, a search for information pertaining to the specific type of object is performed. A result is formatted to be displayed with a real-time image of the object on the client device.