Binary Wavelet Haptics Streams for Clear Track Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The timing model for carrying haptic tracks in multimedia presentations is unclear, and the current JSON format for haptics interchange format does not support binary wavelet-coded streams, necessitating a solution for clear synchronization and efficient encoding/decoding.
Innovation Solution
The proposed solution involves receiving and decoding media streams in haptics interchange format, utilizing wavelet effect values to decode binary wavelet streams through entropy decoding and inverse wavelet transformation, with additional support for binary wavelet keyframes via base64 decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If quantized wavelet coefficients are carried in haptics interchange format, then the format is simple and easy to implement, but the timing model is unclear and conversion to binary wavelet-coded streams is complex
Solution Approach 1:
The patent introduces a new parameter `band_type` with value `BinaryWavelet` to indicate when binary wavelet-coded streams are present in the haptics interchange format. This parameter change enables the format to carry both quantized wavelet coefficients and binary wavelet-coded streams, resolving the timing model ambiguity while maintaining backward compatibility with existing simple implementations.
2Productivity
If binary wavelet-coded streams are added to haptics interchange format, then conversion efficiency is improved, but decoding complexity increases
Solution Approach 1:
The patent introduces an intermediary decoding layer that uses the `band_type` parameter to determine the decoding path. When `BinaryWavelet` is detected, the system automatically selects the appropriate binary wavelet decoding algorithm, while falling back to standard quantized wavelet coefficient decoding when needed. This intermediary layer simplifies the decoder architecture by handling different formats uniformly rather than requiring separate complex decoders.
3Reliability
If timing model is made clear for ISOBMFF tracks, then synchronization with other media tracks is improved, but format complexity increases
Solution Approach 1:
The patent makes the timing model universal by defining how binary wavelet-coded streams in haptics interchange format align with ISOBMFF track timing. The `band_type` parameter serves multiple purposes: it identifies the encoding type, provides timing information for synchronization, and enables proper alignment with other media tracks. This multi-functional approach improves synchronization reliability without requiring separate timing mechanisms.
Data Source
AI summary
Methods, apparatuses, and systems for haptic signal processing are provided and include receiving a media stream comprising data in a haptics interchange format, obtaining, from the data in the haptics interchange format of the media stream, a wavelet effect value, and decoding the media stream based on the wavelet effect value.