Video Casting Layer Synthesis with Parallel GPU and HWC Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional casting technologies suffer from low efficiency due to the complete synthesis and transmission of multimedia content, leading to increased data transmission and storage requirements.
Innovation Solution
The method involves parallel synthesis of multimedia layers using a graphics processing unit (GPU) and hardware composer (HWC) when a video security layer is absent, employing formats like YUV420sp to reduce data amount, and encoding with RTP/RTCP for efficient transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If complete content synthesis is performed for casting, then casting completeness is improved, but casting efficiency deteriorates
Solution Approach 1:
The patent segments the display content into multiple independent layers (video layer, UI layer, game layer, etc.) that can be processed and transmitted separately. This allows selective synthesis of only necessary layers for casting, improving efficiency while maintaining completeness of essential content.
Solution Approach 2:
The patent extracts and identifies the video security layer separately from other layers, and selectively excludes it from GPU synthesis when present. This extraction approach allows the system to maintain casting completeness for non-sensitive layers while improving efficiency by skipping unnecessary synthesis of sensitive content.
2Manufacturing precision
If all layers are synthesized sequentially, then synthesis accuracy is improved, but synthesis speed deteriorates
Solution Approach 1:
The system performs preliminary identification of the video security layer before synthesis begins. By detecting the presence of a video security layer in advance, the system can pre-determine which layers require GPU synthesis and which can be handled by HWC, avoiding unnecessary processing steps and improving synthesis speed without sacrificing accuracy.
Solution Approach 2:
The patent implements dynamic synthesis routing that adjusts the synthesis path based on real-time layer characteristics. When a video security layer is detected, the system dynamically switches to HWC-only synthesis for that layer; otherwise, it uses GPU synthesis for better performance. This dynamic approach maintains accuracy while optimizing speed based on content type.
Data Source
AI summary
A casting control method and apparatus are provided. The casting control method and apparatus are applied to the field of video processing technologies. The method is applied to a first electronic device. The first electronic device includes a GPU and an HWC. When the first electronic device is in a casting state, the to-be-synthesized layer can be separately sent to the GPU and the HWC if the video security layer is not included. The first electronic device synthesizes the to-be-synthesized layer in parallel by using the GPU and the HWC.