MPEG Haptic Material Extension for Low-Overhead glTF Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies do not efficiently integrate haptic data into immersive environments, leading to unnecessary metadata overhead and inefficiencies in scene description frameworks like glTF, which affects the rendering of haptic textures.
Innovation Solution
The integration of haptic data is optimized by using the MPEG_haptic_material extension within the glTF format, which associates haptic textures with 3D objects, allowing for efficient rendering and reducing redundant metadata through a unified object encapsulation of haptic properties.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If haptic data is integrated into scene description frameworks using traditional methods, then haptic textures can be rendered in immersive environments, but metadata overhead increases and efficiency decreases
Solution Approach 1:
The patent combines haptic data with existing scene description frameworks by integrating haptic properties into object definitions. Instead of storing haptic data separately, the system merges haptic texture information directly with visual object descriptions in the scene graph, eliminating redundant metadata and reducing overall data overhead while maintaining complete haptic rendering capability
Solution Approach 2:
The patent creates a unified scene description framework that simultaneously handles both visual and haptic properties through a single data structure. The scene graph nodes are designed to carry multiple types of sensory information (visual textures, haptic textures, material properties) in a universal format, allowing one system to serve multiple rendering purposes without requiring separate dedicated structures for each sensory modality
2Reliability
If haptic data is integrated into scene description frameworks using traditional methods, then haptic textures can be rendered in immersive environments, but processing efficiency decreases
Solution Approach 1:
The patent merges haptic data processing with the existing visual rendering pipeline by integrating haptic property extraction and processing into the same scene graph traversal and material processing stages. This consolidation eliminates separate processing passes and reduces computational overhead, improving overall processing efficiency while ensuring accurate haptic texture rendering
Solution Approach 2:
The patent performs preliminary organization of haptic data during the scene graph construction phase, pre-associating haptic properties with their corresponding visual objects and materials. By preparing and structuring haptic data in advance during scene loading rather than processing it on-demand during rendering, the system reduces real-time computational burden and improves processing efficiency
Data Source
Figure 1A
Figure 1B
Figure 1C
AI summary
Some embodiments of a method may include: obtaining a bitstream corresponding to an immersive environment; decoding the bitstream, wherein the decoded bitstream comprises information corresponding to a first object associated with the immersive environment, wherein the information comprises haptic texture information corresponding to a first haptic texture property associated with the first object, and wherein the haptic texture information comprises: at least one range bound of the first haptic texture property, and at least one value of the first haptic texture property; and rendering, in the immersive environment, the first haptic texture property associated with the first object.