AR Panorama Engine for Real-Time Object Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional object recognition systems for visually impaired individuals face challenges in providing real-time, reliable, and portable object recognition due to high computing resource requirements, limiting their effectiveness and usability.
Innovation Solution
A system utilizing an augmented reality engine that constructs a panoramic model of the environment based on ambient sensor data from a visually impaired person's device, allowing a sighted assistant to interact with the model and provide feedback through device commands, enabling real-time object recognition and navigation assistance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional object recognition algorithms are used to ensure reliable object identification, then recognition reliability is improved, but computing resource requirements increase substantially
Solution Approach 1:
The patent segments the computing tasks by separating image capture and preliminary processing from complex algorithm execution. The portable device captures and pre-processes images locally, then transmits them to a remote server for sophisticated algorithm analysis. This segmentation allows reliable object recognition through complex algorithms while keeping the portable device's computational burden manageable.
Solution Approach 2:
The patent introduces a remote server as an intermediary between the portable device and the complex object recognition algorithms. The server acts as a mediator that receives simplified image data from the portable device and performs the computationally intensive recognition tasks, enabling reliable identification without requiring substantial local computing resources.
2Measurement precision
If sophisticated algorithms are deployed to achieve accurate object recognition, then identification accuracy is improved, but device portability deteriorates
Solution Approach 1:
The patent extracts the computationally intensive algorithm execution from the portable device and places it on a remote server. The portable device only retains lightweight image capture and transmission functions, maintaining high identification accuracy through sophisticated algorithms while preserving device portability by removing the computational burden.
Solution Approach 2:
The remote server serves as an intermediary that houses the sophisticated object recognition algorithms. This intermediary architecture enables accurate identification without requiring the portable device to contain heavy computational components, thus maintaining device portability while achieving high measurement precision.
3Speed
If real-time object recognition is implemented to enhance user safety and independence, then responsiveness is improved, but computing power requirements increase
Solution Approach 1:
The patent segments the real-time processing pipeline into two stages: rapid local image capture and transmission from the portable device, followed by quick remote algorithm execution on the server. This segmentation enables real-time responsiveness by optimizing the data transmission and processing workflow, achieving fast recognition without requiring the portable device to sustain high computing power demands continuously.
Solution Approach 2:
The system employs periodic action by capturing images at appropriate intervals rather than continuously processing streams. The portable device captures images periodically and transmits them to the server for analysis, enabling real-time recognition responsiveness while reducing overall computing power requirements by avoiding continuous heavy processing.
Data Source
AI summary
There is presented a system and method for providing real-time object recognition to a remote user. The system comprises a portable communication device including a camera, at least one client-server host device remote from and accessible by the portable communication device over a network, and a recognition database accessible by the client-server host device or devices. A recognition application residing on the client-server host device or devices is capable of utilizing the recognition database to provide real-time object recognition of visual imagery captured using the portable communication device to the remote user of the portable communication device. In one embodiment, a sighted assistant shares an augmented reality panorama with a visually impaired user of the portable communication device where the panorama is constructed from sensor data from the device.