Multiview Video Dynamic Metadata Fusion for HDMI Tone Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video streaming technologies face challenges in accommodating the demand for multiview streaming due to differences in static and dynamic metadata across multiple video feeds, and hardware and algorithms are not designed to handle multiple sets of dynamic metadata for simultaneous display, particularly in HDMI couplings.
Innovation Solution
A method and system for combining dynamic metadata from multiple video streams into a single set for multiview display, using a dynamic metadata combination service to generate a unified metadata format that can be processed by client devices and displays, allowing simultaneous display of multiple video streams with improved tone mapping.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple video streams with different dynamic metadata are displayed simultaneously, then multiview streaming capability is improved, but hardware and algorithms cannot handle multiple sets of dynamic metadata
Solution Approach 1:
The patent combines multiple sets of dynamic metadata from different video streams into a single unified metadata structure. The system merges metadata parameters such as brightness, color saturation, and ambient light adaptation across multiple views, creating one consolidated metadata set that the display hardware can process while maintaining multiview functionality.
Solution Approach 2:
The patent introduces an intermediary processing layer that sits between the multiple video streams and the display hardware. This intermediary component reconciles conflicting metadata from different views by applying weighting algorithms and selection logic, transforming multiple metadata sets into a single compatible format that the display can handle.
2Manufacturing precision
If static metadata and dynamic metadata from different views are rendered simultaneously, then multiview display quality is improved, but HDMI couplings do not support transfer of multiple sets of dynamic metadata
Solution Approach 1:
The patent extracts the dynamic metadata from multiple video streams and processes it separately from the video content itself. By separating the metadata extraction and combination process from the HDMI transmission protocol, the system can handle multiple metadata sets and then present a single unified set through the HDMI interface, bypassing the protocol's limitation.
Solution Approach 2:
The patent changes the parameter structure of metadata by transforming multiple separate metadata sets into a single unified parameter structure. This involves reformatting and reorganizing metadata parameters such as luminance, chrominance, and tone mapping information into a single compatible format that fits within HDMI's metadata transmission capabilities.
3Measurement precision
If dynamic metadata is combined from multiple video streams, then tone mapping and color accuracy are improved, but processing complexity increases
Solution Approach 1:
The patent applies local quality by treating different regions of the metadata parameter space differently. Certain critical parameters like brightness and color saturation receive more sophisticated combination algorithms with higher weighting, while less critical parameters use simpler merging logic. This selective approach improves color accuracy where it matters most while limiting overall processing complexity.
Data Source
AI summary
Techniques for combining dynamic metadata for multiple view (multiview) video displaying are described. According to some examples, a computer-implemented method includes receiving, by a client device, a first video comprising a first set of dynamic metadata including a corresponding first color value histogram for a plurality of frames of the first video, and a second video comprising a second set of dynamic metadata including a corresponding second color value histogram for a plurality of frames of the second video; combining the first video and the second video into a combined video; generating a first combined color value histogram for a first frame of the combined video based on a first color value histogram of the first set of dynamic metadata for a first frame of the first video and a second color value histogram of the second set of dynamic metadata for a first frame of the second video, and a second different combined color value histogram for a second frame of the combined video based on a third color value histogram of the first set of dynamic metadata for a second frame of the first video and a fourth color value histogram of the second set of dynamic metadata for a second frame of the second video; performing, by a tone mapper of the client device, a tone mapping of the combined video based on the first combined color value histogram and the second different combined color value histogram to generate an output video with multiple views; and sending the output video to a display or storage.