Adaptive Media Streaming via Trusted Execution Environment Workload Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Ultra High Definition (UHD) media and Digital Rights Management (DRM) content streaming faces challenges in maintaining consistent rendering speed with decryption rates, leading to glitches and audiovisual artifacts, especially during concurrent playback on multiple displays, due to the introduction of new cryptographic keys.
Innovation Solution
A computing device with a trusted execution environment communicates counter data from media IP blocks and power devices to a trusted server, determining residual workload and adjusting content playback characteristics like bitrate to maintain smooth streaming, using secure channels for communication and leveraging activity counters to fine-tune media delivery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If adaptive streaming is used for UHD DRM content, then data transmission flexibility is improved, but scalability is worsened
Solution Approach 1:
The system dynamically adjusts streaming parameters (bitrate, resolution, frame rate) based on real-time workload conditions. The trusted execution environment continuously monitors device performance and adapts content delivery parameters to maintain smooth playback while managing cryptographic operations, making the system both adaptable to varying conditions and scalable across different device configurations.
Solution Approach 2:
The patent changes operational parameters (content bitrate, resolution, frame rate) based on workload conditions to resolve the contradiction between adaptive streaming flexibility and scalability. By adjusting these parameters dynamically, the system achieves both adaptability to device capabilities and scalability across multiple concurrent playback sessions.
2Reliability
If cryptographic keys are rotated to introduce new keys, then security is improved, but content rendering consistency is worsened due to decryption speed limitations
Solution Approach 1:
The system performs preliminary actions by pre-loading and pre-processing cryptographic keys and content segments before they are needed for playback. The trusted execution environment prepares decryption resources in advance, ensuring that key rotation operations do not cause rendering glitches or audiovisual artifacts during actual content playback.
Solution Approach 2:
The system implements feedback mechanisms where the trusted execution environment continuously monitors decryption speed and rendering performance. Based on this feedback, it dynamically adjusts key rotation timing and content delivery parameters to maintain rendering consistency while implementing security updates through key rotation.
3Adaptability or versatility
If multiple concurrent UHD DRM playback sessions are supported, then user experience is improved, but device workload increases leading to performance degradation
Solution Approach 1:
The system segments content into smaller chunks or segments that can be processed and decrypted independently. This allows multiple concurrent playback sessions to share cryptographic resources more efficiently, reducing overall device workload while maintaining the ability to support multiple simultaneous UHD DRM playback sessions across different displays.
Data Source
AI summary
Technologies for adaptive real-time media streaming include a computing device to determine, by a trusted execution environment of the computing device, a current workload of the computing device based on at least one activity counter. The at least one activity counter is to record counter data associated with performance of the computing device. Further, the computing device determines a residual workload capable of being supported by the computing device based on the determined current workload and a new content playback characteristics for streaming media content based on the determined residual workload. The computing device streams media content received from a trusted server based on the determined new content playback characteristics.