Haptic Atlas Coding for Volumetric Video Immersion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D scene and volumetric video technologies lack the ability to effectively incorporate and render haptic, gustatory, and olfactory sensory effects, particularly in associating precise spatial haptic properties with visual objects, and reusing existing video containers for haptic information.
Innovation Solution
A method involving obtaining a 3D scene with haptic features, projecting depth and haptic components onto patch pictures, packing these in atlases, and encoding haptic features as color values or separate atlases, allowing for precise rendering of haptic effects in volumetric video formats.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If haptic information is added to existing video formats, then sensory immersion is improved, but format complexity increases
Solution Approach 1:
The patent extends the existing MPEG video container format to serve multiple functions by incorporating haptic, gustatory, and olfactory information alongside traditional visual and auditory data. This allows a single standardized format to deliver multi-sensory content without requiring separate proprietary formats, thereby improving sensory immersion while controlling format complexity through reuse of established infrastructure.
Solution Approach 2:
The patent nests haptic and other sensory information within the existing MPEG video container structure, placing new sensory data types inside the established format framework. This nesting approach allows enrichment of the video format with additional sensory layers while maintaining compatibility with existing video processing pipelines and reducing the need for entirely new format specifications.
2Measurement precision
If precise spatial haptic properties are associated with visual objects, then rendering accuracy is improved, but data processing complexity increases
Solution Approach 1:
The patent segments haptic information into distinct spatial components that can be independently processed and associated with specific visual objects in the scene. By dividing the haptic data into manageable spatial segments rather than treating it as a monolithic dataset, the system achieves precise spatial mapping to visual objects while reducing the overall complexity of data processing through modular handling of haptic properties.
Solution Approach 2:
The patent applies different haptic properties to different local regions of visual objects, allowing precise spatial differentiation of haptic characteristics across the scene. This local quality approach enables accurate rendering of position-dependent haptic effects while managing data processing complexity by only computing and transmitting haptic data for locally relevant regions rather than processing the entire scene uniformly.
Data Source
AI summary
Methods and devices for encoding and decoding a data stream representative of a 3D volumetric scene comprising haptic features associated with objects of the 3D scene are disclosed. At the encoding, haptic features are associated with objects of the scene, for instance as haptic maps. Haptic components are stored in points of the 3D scene as color may be. These components are projected onto patch pictures which are packed in atlas images. At the decoding, haptic components are un-projected onto reconstructed points as color may be according to the depth component of pixels of the decoded atlases.