Wireless Video Streaming Overlay Synchronization via Direct Bitstream Transmission
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current wireless video streaming protocols, such as Miracast, require transcoding of video content, which consumes power and can degrade video quality due to the need for re-encoding using limited H.264 codec profiles, and do not support the efficient transmission of graphical overlays.
Innovation Solution
Implementing a direct streaming capability that allows wireless transmission of video and audio content without transcoding, using additional control communications and protocols to negotiate codec support and overlay handling, enabling the transmission of pre-encoded bit streams and graphical overlays with metadata for accurate display and blending on the sink device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If video content is transmitted through transcoding in current wireless video streaming protocols, then compatibility with standard codecs is improved, but power consumption increases and video quality degrades
Solution Approach 1:
The patent extracts the transcoding step from the video streaming process by enabling direct transmission of pre-encoded bitstreams from the source device to the sink device. This eliminates the need for re-encoding at the source device, thereby reducing power consumption while maintaining codec compatibility through standardized bitstream formats
Solution Approach 2:
The video content is pre-encoded into standard bitstream formats (such as H.264, H.265, or VP9) at the source device before transmission. This preliminary encoding action allows the content to be transmitted directly without requiring transcoding at the destination, thus reducing power consumption while ensuring compatibility with various playback devices
2Adaptability or versatility
If video content is re-encoded using limited H.264 codec profiles, then compatibility is improved, but video quality degrades
Solution Approach 1:
The patent enables dynamic selection of codec profiles and bitstream formats based on the capabilities of both the source and sink devices. The system can adaptively choose from multiple encoding standards (H.264, H.265, VP9, AV1) and profiles, allowing high-quality transmission when supported while maintaining compatibility when using more constrained profiles
Solution Approach 2:
The patent changes the encoding parameters by allowing transmission of pre-encoded bitstreams with various codec profiles and resolutions. The sink device can request specific profile parameters, and the source device transmits accordingly, thereby optimizing video quality while maintaining compatibility across different device capabilities
3Adaptability or versatility
If graphical overlays are transmitted in current protocols, then display functionality is improved, but transmission efficiency decreases due to lack of optimized protocols
Solution Approach 1:
The patent segments the display content into separate components: the main video bitstream and the graphical overlay elements. Each component is transmitted independently with its own metadata, allowing the video and overlays to be processed and rendered separately at the sink device, thereby improving transmission efficiency and display flexibility
Solution Approach 2:
The patent introduces metadata as an intermediary layer that carries information about the graphical overlays, including their format, timing, and blending parameters. This metadata acts as a mediator between the source and sink devices, enabling efficient transmission and accurate rendering of overlays without requiring complex real-time processing
4Use of energy by moving object
If direct streaming without transcoding is implemented, then power consumption is reduced and video quality is preserved, but compatibility and overlay support require additional control protocols
Solution Approach 1:
The patent implements a universal control protocol framework that can handle multiple functions: negotiating codec capabilities, managing overlay transmission, and coordinating timing between video and overlays. This multi-functional protocol reduces the need for separate specialized protocols, thereby managing complexity while enabling direct streaming with overlay support
Data Source
AI summary
Wireless communication devices are provided with direct video and audio streaming capability. The streaming capability may support overlays. Some implementations include incorporation of these features into devices with a mirroring display mode.