MIHS Haptic Packetization for ISOBMFF Sample Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is no concept of haptic access units that enable mapping haptic distribution format to a file format with a ISOBMFF sample structure, leading to difficulties in mapping and cumbersome, computationally inefficient revision of haptic sample offsets in multimedia presentations.
Innovation Solution
The implementation of timed-reference access units, specifically MPEG-I haptic stream (MIHS) units, which are non-overlapping in time and include start times, allowing efficient mapping to ISOBMFF sample structures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If traditional haptic distribution format is used without access unit concept, then haptic signals can be delivered to the device, but mapping to ISOBMFF sample structure becomes difficult and requires cumbersome computational revisions of haptic sample offsets
Solution Approach 1:
The haptic stream is segmented into discrete access units (AU) with defined boundaries and timing information. Each AU contains haptic samples organized in a structured format that maps directly to ISOBMFF sample structures, eliminating the need for complex offset revisions and enabling efficient integration with multimedia presentations.
2Productivity
If haptic samples are organized without timed-reference access units, then data can be stored, but retrieval and synchronization with multimedia presentation becomes inefficient
Solution Approach 1:
Access units are pre-organized with embedded timing references and synchronization information during the encoding phase. This preliminary structuring allows the decoder to directly retrieve and synchronize haptic samples with multimedia presentation without requiring complex real-time computations, significantly improving processing efficiency.
Data Source
AI summary
Method, apparatus, and system for haptic signal processing are provided. The process may include receiving a media stream comprising at least one haptic track and at least one media track. The process may include obtaining at least one MIHS unit from the media stream and obtain a respective start time associated with the at least one MIHS unit from the media stream. The process may include the media stream being rendered based on the respective start time. Each of the at least one MIHS unit is non-overlapping in time, a MIHS unit among the at least one MIHS unit comprises a start time for the MIHS unit, and the MIHS unit is associated with one or more haptic channel.