Application User Interface Forwarding via Multi-Stream Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current wireless systems for transmitting application user interfaces suffer from latency and image quality issues due to compression, which degrades complex graphics and motion, and introduces noticeable delays.
Innovation Solution
The system encodes application user interface content into multiple streams containing source content and composition metadata, allowing independent composition on the receiving platform, thereby reducing latency and maintaining image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If compression is used to reduce transmission bitrate, then transmission throughput requirement is reduced, but latency increases and image quality degrades
Solution Approach 1:
The system segments the user interface content into multiple independent encoded streams (e.g., video stream, graphics stream, audio stream) that can be transmitted and decoded independently. This segmentation allows the receiving device to process and display different portions of the interface simultaneously, reducing overall latency while maintaining compression efficiency for each individual stream.
Solution Approach 2:
The system performs preliminary encoding and preparation of content streams on the source device before transmission. By pre-processing the content into optimized encoded formats with associated metadata, the system reduces the processing burden on the receiving device, thereby minimizing decoding latency and enabling faster display of the user interface.
2Quantity of substance
If compression is used to reduce transmission bitrate, then transmission throughput requirement is reduced, but image quality degrades
Solution Approach 1:
By dividing the user interface into multiple specialized encoded streams (video, graphics, audio), each stream can be compressed using optimized algorithms tailored to its specific characteristics. This allows higher quality preservation for each individual stream at lower overall bitrates compared to compressing the entire interface as a single stream.
Solution Approach 2:
The system applies different compression qualities and algorithms to different portions of the user interface based on their importance and visual characteristics. Critical elements maintain higher quality while less important elements use lower quality compression, optimizing overall image quality at reduced transmission bitrate.
3Adaptability or versatility
If independent composition is performed on the receiving platform, then adaptability across platforms is improved, but device complexity increases
Solution Approach 1:
The source device performs preliminary composition setup by encoding multiple independent streams with embedded metadata describing their spatial and temporal relationships. This pre-prepared structure allows the receiving device to reconstruct the user interface with minimal processing, achieving platform adaptability without significantly increasing device complexity.
Solution Approach 2:
The encoded streams with composition metadata act as an intermediary that carries all necessary information for reconstruction. This intermediary structure enables the receiving device to perform independent composition without requiring complex real-time processing, as the composition rules are already embedded in the transmitted data.
Data Source
AI summary
A system and method for forwarding an application user interface from a first computing platform to a second computing platform. The application user interface is generated using source content. The application user interface is encoded into two or more encoded content streams where the two or more encoded content streams contain source content representable as the application user interface and composition metadata associated with the application user interface. The two or more encoded content stream are sent to the second computing platform. The two or more encoded content streams are received where the two or more encoded content streams contain information reproducible as the application user interface. The two or more encoded content streams are decoded. The application user interface is generated using the two or more decoded content streams and composition metadata associated with the two or more decoded content streams.