Video Stream Temperature Metadata for Immersive Tactile Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video broadcasting technologies lack the capability to provide direct interaction and immersive tactile information, limiting viewer engagement and realism.
Innovation Solution
A method and apparatus for generating video streams that include temperature meta information by dividing video frames into sections, calculating representative temperatures, and compressing them using MPEG-2 transport stream (TS) to efficiently transmit tactile information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If temperature data is transmitted along with video data, then tactile information is provided to enhance immersion, but data transmission volume increases
Solution Approach 1:
The patent divides video frames into multiple sections (e.g., 4x4 grid) and extracts temperature meta-information only for representative sections rather than processing entire frames. This segmentation approach reduces the volume of temperature data that needs to be transmitted while still providing tactile information for key regions of the video content.
Solution Approach 2:
The patent applies different processing quality levels to different parts of the video content. Temperature meta-information is extracted and transmitted selectively for sections that require tactile enhancement, rather than uniformly processing all video data. This allows the system to provide tactile information where most beneficial while minimizing overall data transmission volume.
2Measurement precision
If temperature meta information is extracted for every frame, then accurate temperature information is provided, but processing complexity increases
Solution Approach 1:
The patent extracts temperature meta-information from only selected representative sections of each frame rather than processing every pixel or region. This selective extraction maintains adequate temperature information accuracy for tactile reproduction while significantly reducing the computational complexity of temperature data extraction and processing.
Solution Approach 2:
The patent extracts temperature information for a subset of sections that are sufficient for providing effective tactile feedback, rather than exhaustively processing all possible regions. This partial action approach achieves the necessary measurement precision for immersion while avoiding the excessive processing complexity that would result from complete frame analysis.
3Productivity
If video compression is performed with additional temperature meta information, then tactile information is efficiently transmitted, but compression complexity increases
Solution Approach 1:
The patent merges temperature meta-information with video data streams by integrating them into the MPEG-2 transport stream format. The temperature data is packaged alongside video packets using standard transport stream structures, allowing efficient combined transmission without requiring separate communication channels or complex custom protocols.
Solution Approach 2:
The patent uses the existing MPEG-2 transport stream infrastructure to carry both video and temperature information. By leveraging the established universal video compression and transmission framework, the system achieves efficient transmission of multi-type data (video plus tactile information) without adding significant compression complexity, as the transport stream format is already designed to handle diverse data types.
Data Source
AI summary
Disclosed are a video stream generation method and a video stream generation apparatus, and a video stream generation method of generating video streams capable of reproducing temperature of scenes within a video according to an embodiment of the present disclosure may include receiving video data and temperature data for scenes included within the video data, generating temperature meta information by dividing each frame included in the video data into sections and configuring representative temperature of the sections, based on the temperature data distributed within the sections, and generating video streams by performing compression such that each frame within the video data further includes the temperature meta information.