Multi-Plane Display System for Independent Window Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing single-plane display systems are limited in capturing and streaming multiple windows, as they composite all windows into a single-layer image, restricting flexibility in frame rate, arrangement, and individual window modification, and are unable to provide subsets of desktop content at different frequencies.
Innovation Solution
A multi-plane display system that uses graphics driver-based capturing and rendering, allowing individual windows to be placed on separate overlay planes, enabling independent rendering, capture, and streaming of content windows at different frequencies and arrangements, with the ability to apply digital watermarks and modify display parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If all windows are composited into a single-layer image for capture and streaming, then the system complexity is reduced and easier to implement, but the flexibility in frame rate, arrangement, and individual window modification is lost
Solution Approach 1:
The patent divides the desktop into multiple overlay planes, where each plane can independently capture and stream windows. This segmentation allows different windows to be captured at different frame rates and arranged differently on client devices, resolving the contradiction between system simplicity and streaming flexibility.
Solution Approach 2:
The patent introduces an additional dimension by using multiple overlay planes instead of a single composited layer. This dimensional change enables independent control of capture parameters for different windows while maintaining overall system architecture simplicity.
2Ease of manufacture
If a single composited desktop layer is captured and streamed, then the capture and streaming process is simplified, but the ability to provide subsets of content at different frequencies is eliminated
Solution Approach 1:
The patent segments the desktop into multiple overlay planes that can be independently captured. This allows the system to provide subsets of content (individual windows) at different frequencies while maintaining a simplified capture process through direct graphics driver access.
Solution Approach 2:
The patent extracts individual windows from the composited desktop layer by placing them on separate overlay planes. This extraction enables selective capture and streaming of specific windows at different frequencies without complicating the overall capture mechanism.
3Ease of operation
If multiple windows are captured at the same frame rate as the desktop, then the capture process is straightforward, but the ability to stream individual windows at different frame rates is lost
Solution Approach 1:
The patent segments windows onto different overlay planes, enabling independent frame rate control for each window. This segmentation allows the capture process to remain straightforward while providing versatility in frame rate selection for individual windows.
Solution Approach 2:
The patent introduces dynamic frame rate control by allowing each overlay plane to operate at its own frame rate. This dynamic approach enables individual windows to be streamed at different frequencies while maintaining ease of operation through automated graphics driver integration.
Data Source
AI summary
A request is received from an application to present content generated by the application in an overlay plane of a multi-plane display system. Responsive to determining that current system resources support presentation of the generated content in the overlay plane, frames of the generated content are displayed in the overlay plane and captured directly from the overlay plane such that the captured frames may be provided to one or more remote client computing systems independently of frames captured from one or more additional overlay planes and from an underlying composited desktop layer. Identifiers of prioritized applications may be maintained based on user preferences to determine specific applications for which generated content is enabled for display via overlay plane.