Miracast Overlay Segmentation for Direct Video Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current Miracast systems require transcoding of video content, leading to increased power consumption and potential video quality degradation due to the need for re-encoding using limited H.264 codecs, which is inefficient and degrades video quality.
Innovation Solution
The implementation of an extended Miracast system that allows direct streaming of video content without transcoding by supporting additional video encoders and decoders, enabling the use of various codecs and formats, and enabling overlay processing for improved video quality and power efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If video content is transcoded using H.264 codec in current Miracast systems, then compatibility is improved, but video quality degrades and power consumption increases
Solution Approach 1:
The video stream is segmented into multiple independent overlay layers, each encoded with the most appropriate codec for its content type. Background video can use H.264 for broad compatibility, while foreground overlays (graphics, text, UI elements) can use more efficient codecs like JPEG or PNG, avoiding unnecessary transcoding of high-quality content.
Solution Approach 2:
The system implements a universal overlay blending mechanism that can handle multiple codec formats simultaneously. The sink device is designed to accept and blend overlays encoded in different formats (H.264, JPEG, PNG, etc.), providing multi-functionality without requiring all content to be converted to a single format.
2Adaptability or versatility
If video content is transcoded using H.264 codec in current Miracast systems, then compatibility is improved, but power consumption increases
Solution Approach 1:
By segmenting the video stream into background and overlay components, the system avoids transcoding entire video frames when only portions need format conversion. The source device can encode overlays in their native format and transmit them separately, significantly reducing the computational power required for encoding.
Solution Approach 2:
The system applies transcoding only partially - only to the extent necessary for compatibility. Instead of fully transcoding all video content to H.264, the system selectively applies different encoding strategies to different portions of the display content, minimizing the excessive power consumption associated with full-frame transcoding.
3Device complexity
If single codec format is used for all display content, then processing complexity is reduced, but display flexibility and quality are limited
Solution Approach 1:
The display content is segmented into background video and foreground overlays that can be encoded with different codecs. This segmentation allows each portion to use the most appropriate format for its content type, improving display flexibility without significantly increasing processing complexity because the blending operation is performed in the spatial domain rather than requiring complex multi-format decoding.
Solution Approach 2:
The patent introduces an intermediary overlay blending mechanism that mediates between multiple codec formats. Instead of requiring the sink device to handle complex multi-format decoding and conversion, the intermediary blending process combines overlays in the spatial domain, simplifying the overall processing architecture while supporting diverse codec formats.
Data Source
AI summary
Wireless communication devices are provided with direct video and audio streaming capability. The streaming capability may support overlays, and seek functionality. Some implementations include incorporation of these features into devices with a mirroring display mode such as Miracast.