AR Text Recognition for Room-Scaled Virtual Object Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality (AR) systems fail to fully utilize information from ancillary devices to enhance the AR environment, lacking the ability to supplement or enhance messages, pictures, and alarms displayed on secondary devices.
Innovation Solution
An AR device communicates with ancillary devices like smartphones or tablets to detect key words or phrases in messages, using image and text recognition to determine if they correspond to virtual objects, and adjusts the format based on environmental and device characteristics to display these objects in the AR environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If AR systems display virtual objects based on information from ancillary devices, then the AR experience is enhanced and becomes more immersive, but the device complexity and information processing requirements increase
Solution Approach 1:
The patent introduces an intermediary processing system that bridges ancillary devices and the AR display system. This intermediary captures information from ancillary devices, processes it through image and text recognition, and translates it into virtual objects for AR display, thereby enhancing the AR experience while managing system complexity through modular architecture
Solution Approach 2:
The system is divided into distinct functional modules: information capture from ancillary devices, image recognition processing, text recognition processing, virtual object generation, and AR display. This segmentation allows each component to be optimized independently, enhancing overall system capability while maintaining manageable complexity
2Measurement precision
If the AR device performs image and text recognition on messages from ancillary devices, then virtual objects can be accurately generated, but the processing time and computational resources increase
Solution Approach 1:
The system performs preliminary processing by pre-configuring recognition models and virtual object templates before actual message processing occurs. Common message patterns and object mappings are pre-established, allowing the system to quickly match incoming messages to predefined templates, thereby maintaining high recognition accuracy while reducing real-time processing time
Solution Approach 2:
The system implements a tiered recognition approach where not all messages require full image and text analysis. Simple messages use quick keyword matching, while complex messages undergo comprehensive recognition. This partial action strategy maintains accuracy for critical messages while reducing overall processing time through selective analysis
3Adaptability or versatility
If the AR device adjusts virtual object format based on environmental characteristics, then the display becomes more realistic and immersive, but the computational overhead increases
Solution Approach 1:
The system adjusts virtual object parameters (size, position, format) based on detected environmental characteristics such as indoor/outdoor settings and device orientation. By dynamically changing these parameters rather than completely regenerating objects, the system achieves environmental adaptability while minimizing computational overhead and energy consumption
Solution Approach 2:
The system combines multiple environmental sensors (accelerometer, GPS, ambient light sensors) into a unified environmental context model. This merged information is then used to adjust virtual objects, reducing redundant processing and lowering overall energy consumption while maintaining comprehensive environmental adaptation
Data Source
AI summary
Systems and methods are provided herein for detecting key words provided by ancillary devices and acquiring virtual objects based on the detected key words. This may be accomplished by a system displaying an augmented reality view to a user and detecting a received message. The system can determine whether a portion of the message corresponds to an augmented reality object. In response to detecting that the portion of the message corresponds to the augmented reality object, the system can display the augmented reality object in the augmented reality view in a first format. The first format can be based on the environment around the user.