Haptic Track Sample Anchoring for Precise Media Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The timing model for carrying haptic tracks in multimedia presentations is unclear, specifically in relation to the timing of ISOBMFF tracks, which hinders effective synchronization with other media elements.
Innovation Solution
A method and apparatus for encoding and decoding haptic data that includes receiving a media stream with haptic and video tracks, obtaining MPEG immersive haptics stream (MIHS) units with defined start times, and rendering the stream based on obtained timing information, using a processor and memory to manage haptic effects synchronization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If haptic tracks are integrated into ISOBMFF multimedia presentations, then haptic experience can be delivered to devices, but the timing model for synchronization between haptic tracks and other media tracks becomes unclear
Solution Approach 1:
The patent segments the haptic track into discrete samples, where each sample contains haptic effects with explicit timing information. This segmentation allows each haptic sample to be independently timed and synchronized with corresponding video or audio samples in the ISOBMFF structure, resolving the timing model ambiguity while maintaining haptic experience integration.
2Reliability
If timing information is added to haptic effects for synchronization, then synchronization with other media tracks is enabled, but the complexity of the data structure increases
Solution Approach 1:
The patent merges the timing information directly into the haptic effect data structure within each haptic sample. By combining timing metadata with haptic effect parameters in a unified sample structure, the patent enables synchronization without requiring separate timing files or complex external synchronization mechanisms, thus improving reliability while controlling data structure complexity.
Data Source
AI summary
Method, apparatus, and system for haptic signal processing are provided. The process may include receiving a media stream comprising at least one haptic track and at least one video track. The process may include obtaining, from the media stream, one or more moving picture experts group (MPEG) immersive haptics stream (MIHS) units and obtaining, from the media stream, timing information associated with one or more haptic effects, the timing information comprises at least one temporal position of the one or more haptic effects. Then the process may include rendering the media stream based on the obtained timing information.