AR Object Interaction Using Real-World Pose and 3D Audio
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) technologies lack focus on improving the authenticity of virtual objects, leading to poor user experience due to inadequate integration of real-world interactions.
Innovation Solution
An AR interaction method that determines the pose and location of real objects and sound sources, generating AR images and 3D audio data to create a virtual object that interacts authentically with the real world through visual and auditory perceptions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional AR technology is used to integrate virtual and real worlds, then virtual objects can be displayed, but the authenticity of virtual objects remains low resulting in poor user experience
Solution Approach 1:
The patent implements feedback mechanisms where virtual objects perceive real-world objects and sound sources through sensors, process this information, and generate appropriate action responses and sound responses. This closed-loop feedback system enhances the authenticity of virtual objects by making them react dynamically to their environment, resolving the contradiction between reliability and complexity.
Solution Approach 2:
The patent introduces an intermediary processing system that mediates between the real world (captured by sensors) and the virtual world (displayed through AR). This intermediary layer processes sensor data, determines pose information, generates appropriate responses, and coordinates the interaction, thereby enhancing authenticity while managing system complexity through modular design.
2Adaptability or versatility
If virtual objects are made more intelligent with perception and response capabilities, then user experience improves, but the system complexity increases
Solution Approach 1:
The patent segments the virtual object's intelligence into distinct functional modules: perception modules (sensing real objects and sound sources), processing modules (determining pose information and generating responses), and output modules (displaying AR images and playing 3D audio). This segmentation allows each module to be optimized independently, enhancing adaptability while controlling overall system complexity.
Solution Approach 2:
The patent implements universal processing mechanisms that can handle multiple types of interactions (visual perception of real objects, auditory perception of sound sources, generation of action responses, generation of sound responses) through a unified framework. This multi-functionality approach enhances the intelligent level of virtual objects while avoiding redundant complexity by reusing common processing logic across different interaction types.
Data Source
AI summary
An electronic device may determine pose information of a virtual object based on pose information of a real object or a location of a real sound source, to generate and display an AR image, and may further generate and play 3D sound data of the virtual object based on the pose information of the real object and the pose information of the virtual object.