DASH Haptic Track Selection Using Initialization Segments
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The MPEG DASH standard does not provide explicit support for haptic streaming, especially when multiple haptic tracks are available, leading to a need for technical solutions to enhance haptic experiences in multimedia presentations.
Innovation Solution
A method and apparatus that includes memory and processors to implement a DASH application for haptics processing, enabling the selection and streaming of haptic adaptation sets based on avatars, perceptions, channels, and band identifiers, with support for haptics interchange format (HJIF) configuration files.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If DASH standard is used for streaming multimedia content, then standard compliance and interoperability are improved, but explicit support for haptic streaming with multiple haptic tracks is lost
Solution Approach 1:
The patent segments haptic content into multiple independent haptic tracks, each representing different haptic experiences or quality levels. This segmentation allows the DASH system to handle haptic streams similarly to how it handles video tracks, enabling selective streaming and adaptation based on device capabilities and network conditions while maintaining standard compliance
Solution Approach 2:
The patent extends the DASH manifest structure to universally support both traditional multimedia content and haptic content through a unified adaptation set framework. The haptic adaptation sets follow the same structure as video adaptation sets, allowing the system to handle multiple content types through a single standardized interface, thereby achieving both standard compliance and haptic streaming capability
2Adaptability or versatility
If multiple haptic tracks are provided for selection, then haptic experience versatility is improved, but complexity of track selection and management increases
Solution Approach 1:
The patent implements dynamic selection of haptic adaptation sets based on real-time device characteristics, network conditions, and user preferences. The system dynamically determines which haptic tracks to stream and in what quality, similar to how DASH dynamically selects video representations. This dynamic approach simplifies client-side complexity by automating the selection process while maintaining versatile haptic experience options
Solution Approach 2:
The patent changes key parameters in the DASH manifest structure to support haptic content, including adding haptic-specific attributes to adaptation sets and representations. By modifying parameters such as mimeType, codecs, and adding haptic track identifiers, the system enables automatic parsing and selection by DASH clients without requiring complex custom selection logic, thereby reducing client complexity while maintaining versatility
Data Source
AI summary
There is included a method and apparatus comprising computer code configured to cause a processor or processors to, by a dynamic adaptive streaming over hypertext transfer protocol (HTTP) (DASH) application implemented by the processor or processors, implement receiving a media file having haptics indicated by an adaptation set of a DASH media presentation description (MPD) manifest, parsing any of avatars, perceptions, channels, and band identifiers, of the haptics, selecting a subset of haptic adaptation sets, including the adaptation set based on parsing any of the avatars, the perceptions, the channels and the band identifiers, and streaming and rendering, in DASH, haptic feedbacks of the media file based on the selected subset of the haptic adaptation sets.