Haptic Media Interchange Format for Multi-Modal Signal Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies struggle to efficiently and uniformly express multi-dimensional haptics sensations in immersive media content, which encompass vibrations, pressure, acceleration, temperature, humidity, and olfactory, beyond basic vibrotactile forms, limiting user experience.
Innovation Solution
A haptics media content processing method and apparatus that generates a haptics media interchange format, converts it into a binary bitstream, and encapsulates it into a file for uniform expression and streaming transmission, using JSON format for data representation and conversion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple types of haptics signals (vibration, pressure, acceleration, temperature, humidity, olfactory) are integrated into immersive media content, then the user experience and immersion quality are improved, but the complexity of expressing and processing these multi-dimensional haptics sensations increases
Solution Approach 1:
The patent creates a universal haptics media interchange format that can represent multiple types of haptics signals (vibration, pressure, acceleration, temperature, humidity, olfactory) within a single standardized structure. This multi-functional format allows different haptics modalities to be expressed uniformly, resolving the contradiction by providing a versatile framework that handles diverse haptics types without proportionally increasing processing complexity.
Solution Approach 2:
The patent transforms complex multi-dimensional haptics sensations into standardized parameters within the interchange format. By defining specific parameter structures for different haptics modalities (e.g., vibration frequency, pressure magnitude, temperature values), the system manages complexity through parameterization, allowing diverse haptics types to be expressed through a consistent parameter-based approach rather than requiring separate complex processing for each sensation type.
2Ease of operation
If a standardized haptics media interchange format is created to uniformly express multi-dimensional haptics sensations, then the ease of processing and transmission is improved, but the format complexity increases to accommodate all haptics modalities
Solution Approach 1:
The haptics media interchange format is segmented into distinct components, each handling specific aspects of haptics representation. The format divides haptics content into separate elements such as haptics experience objects, haptics pattern objects, haptics channel objects, and component element objects. This segmentation allows the complex format to be managed through modular structures, where each segment handles a specific function, making the overall complex format easier to process through systematic decomposition.
Solution Approach 2:
The patent introduces an intermediary haptics media interchange format that acts as a bridge between raw haptics signals and final haptics presentation. This intermediary format serves as a standardized translation layer that converts diverse haptics modalities into a uniform structure, simplifying subsequent processing and transmission operations while accommodating the complexity of multiple haptics modalities within its standardized framework.
3Productivity
If haptics media content is converted to binary bitstream and encapsulated for streaming transmission, then the transmission efficiency is improved, but the processing complexity during encoding and decoding increases
Solution Approach 1:
The patent performs preliminary organization of haptics media content into a standardized interchange format before conversion to binary bitstream for transmission. By pre-structuring the haptics content with defined objects and parameters during encoding, the system prepares the data in advance for efficient transmission and streamlined decoding. This preliminary action reduces the complexity burden during real-time decoding operations, as the structure is already established before the conversion process.
Data Source
AI summary
In a haptic media content processing method, at least one haptic media signal is obtained. A haptic media interchange format is generated based on the at least one haptic media signal. The haptic media interchange format includes a haptic experience object, a haptic pattern object, a haptic channel object, a haptic event object, and a component element object. The haptic media interchange format is converted to obtain a haptic media binary bitstream. The haptic media binary bitstream is encapsulated into a haptic media file. The haptic media file is transmitted to a client.

