Haptic Signal Frames with Time-Referenced MIHS Units
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is no concept of haptic frames or haptic time-referenced network abstraction layer units in multimedia presentations, hindering effective encoding and decoding of haptic experiences.
Innovation Solution
Introduce the concept of haptic frames and timed-referenced network abstraction layer units, specifically the MPEG immersive haptics stream (MIHS) units, which include timing information for haptic effects, enabling efficient encoding and decoding of haptic data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If haptic experience is integrated into multimedia presentation, then user experience is enhanced, but there is no concept of haptic frames or time-referenced network abstraction layer units
Solution Approach 1:
The patent applies universality by making the MIHS unit structure multi-functional: it serves as both a network abstraction layer unit and a timing reference structure, and can be mapped to various container formats (ISOBMFF, MPEG-TS, etc.). This single structure handles multiple functions including haptic data organization, timing synchronization, and format adaptation, reducing the need for separate specialized structures.
Solution Approach 2:
The patent segments haptic data into discrete MIHS units with defined timing boundaries, creating frame-like structures from continuous haptic streams. This segmentation allows independent processing and random access to specific time intervals, solving the original problem of lacking haptic frame concepts while maintaining temporal precision.
2Reliability
If timing information is added to MIHS units, then random access and consistent playback are enabled, but data structure complexity increases
Solution Approach 1:
The patent applies preliminary action by embedding timing information (presentation timestamps, duration, sync boundaries) directly into the MIHS unit structure during encoding. This advance preparation of timing data enables reliable random access and synchronized playback without requiring complex runtime calculations or external timing mechanisms.
Solution Approach 2:
The MIHS unit acts as an intermediary structure that mediates between the haptic data stream and the timing/synchronization requirements. It contains embedded timing information that bridges the gap between raw haptic effects and the multimedia presentation timeline, enabling consistent playback without direct complex interactions between data and timing systems.
3Adaptability or versatility
If haptic streams are mapped to temporal sample-based formats, then interoperability is improved, but mapping complexity increases
Solution Approach 1:
The MIHS unit is designed as a universal container that can be mapped to multiple different temporal sample-based formats (ISOBMFF, MPEG-TS, etc.) through standardized timing fields. This universal structure handles format adaptation through consistent timing metadata, reducing the need for format-specific processing logic.
Solution Approach 2:
The patent uses parameter changes by adjusting the representation of timing information according to the target format requirements. The core MIHS unit structure remains unchanged, but timing parameters (timestamps, time scales, reference points) are transformed to match the specific temporal conventions of different container formats, simplifying the mapping process.
Data Source
AI summary
Method, apparatus, and system for haptic signal processing are provided. The process may include receiving a bitstream comprising one or more haptic channels one or more moving picture experts group (MPEG) immersive haptics stream (MIHS) units may be obtained for the one or more haptic channels, with a MIHS unit including timing information for one or more haptic effects. The process may also include timing information being obtained for the one or more haptic effects from the one or more MIHS units, the timing information for the one or more haptic effects including an offset associated with the one or more haptic effects. The one or more haptic effects may be rendered based on the obtained timing information.