Head-Adaptive Audiovisual Pose Mapping with Category-Based Transforms
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audiovisual rendering technologies struggle to provide an optimal immersive experience in virtual and augmented reality applications, as they often fail to adapt rendering to head movements, leading to a reduced sense of immersion and unnatural user experiences.
Innovation Solution
An audiovisual rendering apparatus that maps input poses to rendering poses using a coordinate system transform specific to each audiovisual item, allowing flexible rendering categories that can be fixed to the real world, user head, or an in-between state, thereby adapting to user movements for a more immersive experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a single fixed coordinate system is used for rendering all audiovisual items, then the rendering process is simple and computationally efficient, but the system cannot adapt to different user preferences and head movements, reducing immersion
Solution Approach 1:
The patent segments the coordinate system into multiple independent types (first type fixed to real world, second type fixed to user head, and intermediate types). Each audiovisual item can be assigned to a specific coordinate system type, allowing independent management and transformation. This segmentation enables the system to handle different rendering requirements without managing a single complex unified coordinate system.
Solution Approach 2:
The patent introduces dynamic coordinate system transforms that can adapt based on user head movements and preferences. The mapping between input poses and rendering poses becomes dynamic rather than static, allowing the rendering coordinate system to adjust in real-time according to user behavior, thereby improving adaptability while maintaining manageable complexity through structured transformation rules.
2Reliability
If rendering poses are dynamically adjusted for every head movement, then immersion is enhanced, but computational resources and processing complexity increase significantly
Solution Approach 1:
The patent applies different coordinate system transform qualities to different audiovisual items based on their rendering category indications. Some items use fixed real-world coordinate transforms, others use head-fixed transforms, and some use intermediate transforms. This local differentiation allows the system to maintain spatial consistency where needed while reducing computational overhead by not applying complex dynamic transforms to all items uniformly.
Solution Approach 2:
The patent changes the parameters of the coordinate system transform based on the rendering category and user preferences. By adjusting transform parameters dynamically only for specific categories of audiovisual items rather than all items, the system maintains reliable spatial perception for critical elements while reducing overall computational resource requirements through selective parameter adjustment.
3Adaptability or versatility
If multiple coordinate system transforms are implemented for different rendering categories, then flexibility and personalization are improved, but the system complexity and difficulty of implementation increase
Solution Approach 1:
The patent divides the rendering system into distinct segments based on coordinate system types (first type, second type, and intermediate types). Each segment handles specific rendering categories independently, making the implementation of multiple transforms more manageable. The segmentation allows developers to implement and test each coordinate system type separately before integration, reducing overall implementation difficulty.
Solution Approach 2:
The patent creates a universal framework that can handle multiple coordinate system transforms through a common architecture. The rendering apparatus is designed to accept different types of coordinate system transforms and apply them based on rendering category indications, providing multi-functionality without requiring separate implementation systems for each transform type. This universal approach simplifies implementation by providing a single unified system that handles diverse rendering requirements.
Data Source
AI summary
An audiovisual rendering apparatus comprises a receiver (201) receiving audiovisual items and a receiver (209) receives metadata comprising input poses provided with reference to an input coordinate system and rendering category indications indicating a rendering category. A receiver (213) receives user head movement data and a mapper (211) maps the input poses to rendering poses in a rendering coordinate system in response to the user head movement data. A renderer (203) renders the audiovisual items using the rendering poses. Each rendering category is linked with a different coordinate system transform from a real world coordinate system to a category coordinate system, at least one of which is variable with respect to the real world coordinate system and the rendering coordinate system. The mapper selects a rendering category for an audiovisual item in response to a rendering category indication and maps an input pose to rendering poses that correspond to fixed poses in a category coordinate system for varying user head movement where the category coordinate system is determined from the coordinate system transform of the rendering category.