Augmented Reality Virtual Interior View Access via Gesture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented-reality systems lack effective methods for users to interactively manipulate and access virtual interior views of objects in their environment, limiting the immersive and interactive experience.
Innovation Solution
A method that uses a digital camera to obtain images of objects, identifies manipulatable portions, and integrates augmented-reality elements with hyperlinks to virtual interior views, allowing users to access these views through predefined gestures, which are recognized by a processor and displayed on a computer display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If augmented-reality elements with hyperlinks are integrated into virtual views, then interactivity and information access are improved, but device complexity increases
Solution Approach 1:
The patent implements nested augmented-reality elements where hyperlinked virtual interior views are embedded within the context of the exterior object view. Users can navigate from an exterior building view to interior room views, and further to detailed object views, creating a nested exploration experience that maintains context while providing deep interactivity without requiring separate standalone applications for each view level.
Solution Approach 2:
The system introduces an intermediary processing layer that automatically matches user queries with manipulatable portions of objects and manages the integration of augmented-reality elements. This intermediary layer handles the complex matching and integration tasks, shielding users from the underlying system complexity while providing intuitive interactive access to virtual interior views through natural gestures and queries.
2Adaptability or versatility
If multiple manipulatable portions are integrated with hyperlinked virtual views, then user experience is enhanced, but processing requirements and energy consumption increase
Solution Approach 1:
The system performs preliminary actions by pre-identifying and storing manipulatable portions of objects along with their associated virtual interior views in a database before user interaction. When users point at or query objects, the system quickly retrieves pre-processed information rather than performing complex real-time analysis, significantly reducing processing requirements and energy consumption during actual use while maintaining enhanced interactivity.
3Ease of operation
If gesture recognition is implemented for accessing virtual views, then ease of operation is improved, but measurement precision requirements increase
Solution Approach 1:
The system implements feedback mechanisms where the augmented-reality interface provides visual confirmation when gesture recognition succeeds in identifying manipulatable portions and loading virtual interior views. This feedback loop allows users to understand whether their gestures were correctly interpreted, enabling them to adjust their gestures if needed, thereby maintaining ease of operation while managing the precision requirements through iterative correction rather than demanding perfect initial gesture detection.
Data Source
AI summary
In one exemplary embodiment, a method includes the step of obtaining a digital image of an object with a digital camera. The object is identified. A user query is received. The method includes the step of matching, with at least one processor, the user query with at least one manipulatable portion of a virtual view of the digital image of the object. The method include the step of obtaining the at least one manipulatable portion from a database of manipulatable portions of the object. The method includes the step of integrating the at least one manipulatable portion with the virtual view of the digital image of the object, wherein a manipulatable portion comprises a region of an augmented-reality element integrated into the virtual view of the digital image of the object, and wherein the augmented-reality element comprises a hyper link to another augmented-reality element comprising a virtual interior view of the object and wherein the camera obtains the predefined user gesture.