AR Virtual Audio Objects Without Real Object Cooperation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing sound visualization methods are limited by relying on real object motion, leading to poor visualization effects and high costs due to the requirement of real object cooperation.
Innovation Solution
A method and system for determining the pose of a device playing audio in a target coordinate system, allowing the display of a virtual object corresponding to the audio on a display interface, using AR technology to enhance sound visualization without requiring real object cooperation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If real object motion is used for sound visualization, then the visualization can be achieved, but the visualization effect is poor and costs are high due to requiring real object cooperation
Solution Approach 1:
The patent uses virtual objects (digital copies) instead of real physical objects to represent sound sources. The system creates virtual sound sources that can be positioned and manipulated in a virtual environment, eliminating the need for actual physical objects and their cooperation, while providing better visualization control and reduced costs
Solution Approach 2:
The patent replaces the mechanical/physical system of real objects with a digital/computational system. Instead of using physical objects that require coordination and setup, the system uses software-based virtual objects that can be freely positioned and configured in a virtual coordinate system, substituting mechanical complexity with digital flexibility
2Reliability
If real object motion is used for sound visualization, then the visualization can be achieved, but the costs are high
Solution Approach 1:
The patent creates virtual copies of sound sources that can be displayed on screens or head-mounted displays. These virtual representations eliminate the need for expensive physical setups, special equipment, and coordination of real objects, providing cost-effective sound visualization through digital rendering
Solution Approach 2:
The patent uses lightweight virtual objects that can be freely created, modified, and discarded in the digital domain. These virtual sound sources have negligible material cost compared to physical objects, allowing flexible experimentation and customization without financial burden
3Reliability
If real object motion is used for sound visualization, then the visualization can be achieved, but the information transmission is limited due to human auditory organs' fixed frequency band
Solution Approach 1:
The patent adds visual dimension to sound representation by displaying virtual objects that correspond to audio frequencies. This transforms the purely auditory experience into a multi-sensory experience combining sound with visual feedback, allowing information transmission beyond the limitations of human hearing range through visual metaphors and representations
Data Source
AI summary
A virtual object display method, a non-transitory computer-readable storage medium and an electronic device. The virtual object display method includes operations as follows. Localization is performed on the first device to determine a pose of the first device in a target coordinate system; a pose of a second device in the target coordinate system is determined, where the second device is configured to play audio; a virtual object corresponding to the audio is determined, and a pose of the virtual object in the target coordinate system is determined based on the pose of the second device in the target coordinate system; and in response to the second device is playing the audio, the virtual object is displayed on a display interface of the first device according to the pose of the first device in the target coordinate system and the pose of the virtual object in the target coordinate system.