Cloud App Streaming via Drawing Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud-based streaming systems face challenges with bandwidth requirements, leading to lost audiovisual data and reduced performance, especially when higher resolutions are demanded by client devices.
Innovation Solution
The system includes a cloud-based application server that encodes audiovisual data and provides drawing data as part of the application data stream to client devices, reducing bandwidth needs and allowing for flexible rendering at different resolutions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If cloud-based servers encode and stream audiovisual data at high resolutions to meet client device demands, then the quality of the streamed content is improved, but the bandwidth requirements increase leading to data loss and reduced performance
Solution Approach 1:
The patent extracts only the essential drawing data and scene graph information from the complete audiovisual stream, transmitting only the necessary elements required to reconstruct the visual content at the client device. This selective extraction reduces bandwidth consumption while maintaining the ability to render high-quality images locally.
Solution Approach 2:
Instead of the traditional approach where the server renders complete high-resolution frames and transmits them, this patent inverts the process by transmitting minimal drawing data and scene graphs, then performing the actual rendering at the client device. This reversal of the rendering location solves the bandwidth constraint problem.
2Loss of information
If cloud-based servers transmit complete audiovisual frames to ensure rendering quality, then the visual fidelity is improved, but the data transmission volume increases causing bandwidth constraints
Solution Approach 1:
The patent transmits lightweight scene graph data structures that serve as templates or blueprints, which the client device then uses to reconstruct the actual visual frames. This copying approach transmits minimal data while preserving the ability to generate complete visual content at the destination.
Solution Approach 2:
The patent segments the audiovisual data transmission into two parts: (1) essential scene graph and drawing data transmitted over the network, and (2) actual frame rendering performed locally at the client device. This segmentation separates data transmission from data generation, reducing network bandwidth requirements.
3Device complexity
If the cloud-based server determines stream resolution centrally, then the streaming process is simplified, but the adaptability to different client device resolutions is reduced
Solution Approach 1:
The patent makes the rendering resolution dynamic and adaptable by enabling client devices to perform local rendering at their native resolutions. The scene graph data structures are designed to be resolution-independent, allowing the same data to be rendered at multiple resolutions without requiring separate streams for each device type.
Data Source
AI summary
A cloud-based application streaming system [100] is implemented to stream an application to a client device [116]. The system includes a server [102] running the application on an application instance [104] configured to render video frames and determine drawing data [106] based on the application. The server then encodes the video frames and provides the video frames and drawing data to the client device as an application data stream [114]. In response to receiving the application data stream, the client device is configured to display at least a portion of the application data stream based on the drawing data. Additionally, the client device is configured to receive inputs and provide an input data stream [128] representing these inputs to the server. In response to the input data stream, the server modifies the application based on the input data stream and provides a modified application data stream to the client device.