Sensory Effect Media File Structure for 4D Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing media file formats are inadequate for storing and managing sensory effect data, which is essential for creating immersive 4D media experiences that engage multiple senses, as they separate audiovisual content from sensory effect metadata, making it difficult to effectively store, exchange, and play.
Innovation Solution
A method and apparatus for constructing and playing sensory effect media data files by integrating sensory effect data with media data, where sensory effect data is divided into samples and inserted into the same field as media data, using a composition information container and media data field structure, allowing for efficient storage, management, and playback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If sensory effect data is separated from audiovisual content data, then the media file format can maintain simplicity and compatibility with existing standards, but it becomes difficult to effectively store, exchange, and manage 4D media content
Solution Approach 1:
The patent combines sensory effect data and audiovisual content data into a single integrated media file format. The file structure includes both media data (video/audio) and sensory effect data (SEM) with their respective composition information containers, allowing them to be stored together while maintaining organized separation through distinct boxes and fields within the unified structure.
Solution Approach 2:
The patent creates a universal media file format that can handle both traditional audiovisual content and sensory effect data. The structure is designed to be multi-functional, supporting standard media playback while also enabling 4D media experiences through integrated sensory effect information containers that can describe various sensory effects (lighting, wind, temperature, vibrations, scents, etc.).
2Adaptability or versatility
If sensory effect data is integrated with media data in the same file, then effective storage and management of 4D media is achieved, but the file structure and processing complexity increases
Solution Approach 1:
The patent segments the integrated file structure into distinct functional components: media data boxes for audiovisual content, sensory effect information containers for SEM data, composition information containers for describing properties of each data type, and sample fields for timestamped data samples. This segmentation allows complex 4D media to be organized in a structured, manageable way with clear boundaries between different data types.
Solution Approach 2:
The patent implements a nested structure where sensory effect information containers are embedded within the media file format alongside media data boxes. The composition information containers further nest within these structures, containing detailed property descriptions. This nested organization allows multiple levels of data to be integrated while maintaining hierarchical order and reducing overall structural complexity.
3Productivity
If sensory effect data is divided into samples and inserted into the same field as media data, then efficient storage and real-time delivery are enabled, but the difficulty of parsing and processing increases
Solution Approach 1:
The patent applies preliminary action by organizing sensory effect data into timestamped samples during the encoding phase, inserting them into the same field as media data samples with associated composition information. This pre-organization of data into standardized samples with timestamps simplifies real-time playback and processing, as the data is already structured for efficient access and synchronization during playback.
Data Source
AI summary
Disclosed is a method and apparatus for constructing and playing a sensory effect media data file, which includes information on sensory effects. A method for constructing a sensory effect media data file according to an embodiment of the present invention includes: inserting first composition information, which represents a property of media data, into a composition information container field; inserting second composition information, which represents a property of sensory effect data, into the composition information container field; inserting a sample of the media data into a media data field, where the sample represents data associated with a timestamp; and inserting a sample of the sensory effect data into the media data field.