AR Virtual Object Display Using Text Recognition and Room Scaling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality (AR) systems fail to fully utilize information from ancillary devices to enhance the AR environment, lacking the ability to supplement or enhance messages, pictures, and alarms displayed on secondary devices.
Innovation Solution
AR devices communicate with ancillary devices via wired or wireless protocols to detect key words or phrases in messages, using image and text recognition to determine corresponding virtual objects, and adjust their display format based on environmental and device characteristics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If AR systems display virtual objects in fixed formats, then device complexity is reduced, but adaptability to different environments and devices deteriorates
Solution Approach 1:
The patent implements dynamic format adjustment by continuously monitoring environmental characteristics (indoor/outdoor, vehicle presence) and device characteristics (screen size, orientation, ancillary device presence) to automatically adapt virtual object display formats. This resolves the contradiction by making the system flexible and responsive rather than static, allowing it to adapt to varying conditions without requiring multiple dedicated systems for each scenario.
Solution Approach 2:
The system changes display parameters (size, position, format, animation) of virtual objects based on detected environmental and device characteristics. When ancillary devices are detected or environment changes, the AR system modifies rendering parameters dynamically, enabling adaptability across different contexts while using a single unified system rather than multiple specialized systems.
2Loss of information
If AR systems integrate information from multiple ancillary devices, then information utilization improves, but device complexity increases
Solution Approach 1:
The AR device is designed to perform multiple functions: displaying virtual objects, detecting environmental characteristics, communicating with various ancillary devices (smartphones, tablets, computers), and integrating information from these diverse sources. This multi-functional design allows the system to fully utilize information from multiple devices without requiring separate specialized systems for each function, thereby improving information utilization while managing complexity through a unified platform.
Solution Approach 2:
The system employs an intermediary processing layer that receives information from multiple ancillary devices, processes and integrates this information, and then uses it to enhance the AR experience. This intermediary layer manages the complexity of multi-device integration by providing a standardized interface and processing pipeline, allowing information from diverse sources to be synthesized without overwhelming system complexity.
3Ease of operation
If virtual object display format is adjusted based on environment, then user experience improves, but processing time increases
Solution Approach 1:
The system performs preliminary detection and classification of environmental characteristics (indoor/outdoor, vehicle presence) and device characteristics (screen size, orientation) before rendering virtual objects. By pre-processing and categorizing environmental data, the system can quickly select appropriate display formats without extensive real-time processing during object rendering, thus improving user experience while minimizing processing time delays.
Solution Approach 2:
The system maintains multiple pre-configured virtual object display formats corresponding to different environmental and device conditions. Instead of generating new formats in real-time, the system selects from pre-prepared format templates based on detected conditions, significantly reducing processing time while still providing customized displays that improve user experience for each context.
Data Source
AI summary
Systems and methods are provided herein for detecting key words provided by ancillary devices and acquiring virtual objects based on the detected key words. This may be accomplished by a system displaying an augmented reality view to a user and detecting a received message. The system can determine whether a portion of the message corresponds to an augmented reality object. In response to detecting that the portion of the message corresponds to the augmented reality object, the system can display the augmented reality object in the augmented reality view in a first format. The first format can be based on the environment around the user.