MPEG Haptic Scene Parsing via Indexed Media Accessors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in rendering haptic media files in immersive media scenarios, particularly when the haptic material attribute is set to 'Reference,' as the haptic values are not directly stored and require additional processing to obtain.
Innovation Solution
A method is provided to generate a scene description document that includes determining the type of each haptic material attribute in a 3D-scene-to-be-rendered. For a 'Reference' type attribute, an accessor index syntax element is added to the target node description module in the scene description document, setting its value to the index of the haptic media accessor, enabling proper rendering of haptic media files.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If the haptic material attribute type is set to 'Reference' to save storage space, then the storage efficiency is improved, but the display engine cannot obtain the decoded haptic value directly and cannot perform rendering normally
Solution Approach 1:
The patent introduces an accessor description module as an intermediary between the texture map and the haptic media file. This module contains an accessor index syntax element that points to the haptic media file, enabling the display engine to indirectly access the decoded haptic values through a mediator structure rather than storing them directly in the texture map.
Solution Approach 2:
The haptic media file is prepared and encoded in advance with the decoded haptic values, and the accessor description module is pre-configured with the index pointing to this file. This preliminary preparation allows the display engine to retrieve and use the haptic data when needed, without requiring the data to be embedded in the scene description document.
2Ease of operation
If the haptic values are stored directly in the texture map for 'High_resolution' or 'Low_resolution' types, then the rendering process is simplified, but the storage space consumption increases
Solution Approach 1:
The patent changes the parameter representation by introducing an accessor index syntax element that stores a reference index rather than the actual haptic values. This parameter transformation allows the system to switch between storing direct values (for high/low resolution types) and storing reference indices (for reference type), optimizing both rendering simplicity and storage efficiency based on the specific use case.
3Manufacturing precision
If the scene description document includes detailed haptic material attributes for all nodes, then the haptic rendering accuracy is improved, but the document complexity increases
Solution Approach 1:
The patent segments the haptic data storage into two separate components: the scene description document (containing only accessor indices) and the haptic media file (containing the actual decoded haptic values). This segmentation allows the scene description document to remain simple while still providing access to detailed haptic attributes through the referenced media file, thereby maintaining rendering accuracy without increasing document complexity.
Data Source
AI summary
A method for parsing a scene description document, including: determining an index value of a target haptic object description module; obtaining the target haptic object description module from a moving picture experts group (MPEG) haptic description module in the scene description document according to the index value of the target haptic object description module; and obtaining description information of a haptic media accessor according to the target haptic object description module, where the haptic media accessor is an accessor configured to access haptic rendering data of a haptic media file declared in an MPEG media description module.