Haptic JSON Interchange Format for Frame-Accurate Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The Haptic JSON Interchange File (HJIF) format does not support frame-accurate synchronization of haptic experiences with video or audio, limiting the effectiveness of multimedia presentations.
Innovation Solution
A method and apparatus for processing HJIF files into a binary format that includes a plurality of haptic channels with specified relative and haptic position parameters, synchronized with video or audio based on a scale, enabling frame-accurate synchronization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If HJIF format is used for haptic data interchange, then ease of operation and human readability are improved, but frame-accurate synchronization capability deteriorates
Solution Approach 1:
The haptic data is segmented into multiple independent haptic channels, each with its own timing parameters. This segmentation allows the system to process and synchronize different haptic streams independently with their corresponding video/audio frames, enabling frame-accurate synchronization while maintaining the flexible HJIF structure.
Solution Approach 2:
The patent introduces dynamic timing parameters including relative position parameters and haptic position parameters that can be adjusted on a per-channel basis. These dynamic parameters allow the system to adapt timing information to achieve frame-accurate synchronization with variable frame rates and timing requirements, while the HJIF format remains human-readable and editable.
2Manufacturing precision
If multiple haptic channels with detailed timing parameters are added, then frame-accurate synchronization is improved, but device complexity increases
Solution Approach 1:
The HJIF format is enhanced with universal timing parameters that can be applied across multiple haptic channels. The relative position parameter and haptic position parameter serve multiple functions: they define timing relationships within channels, enable synchronization with external media, and work with variable frame rates. This multi-functionality reduces the need for separate complex synchronization mechanisms.
Solution Approach 2:
The patent changes the parameter structure by introducing scale-based timing parameters that can be adjusted to match different frame rates and timing requirements. By making these parameters scalable and adaptable, the system achieves frame-accurate synchronization without requiring completely different data structures for each application scenario, thus managing complexity.
Data Source
AI summary
A method of signaling a haptic java script object notation (JSON) interchange file format (HJIF) file comprises processing the HJIF file into a binary file format for distribution in a bitstream, in which the HJIF file comprises a plurality of haptic channels, in which each haptic channel from the plurality of haptic channels is defined by a channel description that comprises a relative position parameter that specifies a relative position of a keyframe included in the data and a haptic position parameter of a haptic effect, in which the relative position parameter and the haptic position parameter are specified in accordance with a scale, and in which the haptic effect and keyframe of each channel are synchronized with video or audio included in the bitstream based on the scale.