Media Rendering Layer Segmentation for Bandwidth and Throughput Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional rendering techniques for media, such as documents and video streams, do not effectively utilize improved processing capabilities and network bandwidth, leading to inefficiencies and exclusion of devices with limited resources, like digital phones, due to inadequate handling of similar data types across multiple pages or frames.
Innovation Solution
The method involves dividing logical units of media into layers, preprocessing components to assign them to specific layers based on type, position, and dependencies, and then concurrently formatting and superimposing these layers for efficient rendering, allowing for parallel processing and reduced bandwidth usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional rendering techniques are used to process media data, then processing can be performed with existing technology, but processing speed is slow and bandwidth requirements are excessive
Solution Approach 1:
The patent segments media data into distinct layers based on component types (e.g., background layers, foreground layers, text layers). Each layer is processed independently through separate rendering pipelines, enabling parallel processing that increases throughput while reducing the bandwidth required for each individual processing stream.
Solution Approach 2:
The patent introduces a temporal dimension to rendering by pre-processing and caching layer data in advance. Layers are prepared ahead of time and stored in an optimized format, allowing the rendering system to retrieve and composite layers quickly during playback without requiring excessive real-time bandwidth.
2Adaptability or versatility
If conventional rendering techniques are used, then all devices can attempt to render media, but devices with limited processing capabilities are excluded from benefits
Solution Approach 1:
By dividing media into layered components, the patent enables devices to selectively render only the layers they can handle. Low-capability devices can render simplified versions with fewer layers, while high-capability devices can render all layers with full effects, allowing adaptive performance across different device classes.
Solution Approach 2:
Different layers can be rendered with different quality levels appropriate to the device capabilities. Critical layers (e.g., text, key visual elements) are rendered with high quality on all devices, while less critical layers can use lower quality settings on resource-constrained devices, optimizing the balance between compatibility and efficiency.
3Productivity
If media data is processed without accounting for similar data types, then processing is straightforward, but processing time increases and technology improvements are not utilized
Solution Approach 1:
The patent segments media processing into distinct layer processing pipelines, where each pipeline handles a specific component type (e.g., one pipeline for background layers, another for foreground objects). This segmentation allows the system to exploit similarities within each layer type through specialized processing optimizations without increasing overall system complexity.
Solution Approach 2:
The patent creates universal layer processing templates that can be applied repeatedly to similar layer types. Once a rendering pipeline is established for a particular layer type, the same template can be reused across multiple instances, reducing processing complexity through pattern recognition and template-based rendering.
Data Source
AI summary
Techniques are provided for rendering media as layers. Logical units of media form a media stream. The media stream as a whole is processed to divide components within the units into assigned layers. The layers are then formatted to a desired output format in parallel with one another when dependencies permit. Next, each unit of media is rendered to the output format by superimposing or merging multiple layers to reconstruct each unit of media in the output format.