Screen Projection of Invisible App Windows on Target Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing screen projection technologies, such as AirPlay and AirMirror, only project visible windows from a source device to a target device, failing to display content from invisible windows.
Innovation Solution
A method and system that project both visible and invisible windows from a source device to a target device by obtaining and displaying window data that includes active and visible window components with unique identifiers, allowing for navigation and shopping modes of display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If conventional screen projection software is used, then the projection of visible window content is achieved, but the projection of invisible window content is not possible
Solution Approach 1:
The system performs preliminary actions by obtaining window data of enabled applications before projection occurs. The source device retrieves and transmits window data including invisible windows in advance, so that when projection happens, all window content (visible and invisible) is already available at the target device for display
Solution Approach 2:
The system creates a copy of window data from the source device and transmits it to the target device. Instead of projecting only the visible screen output, the system copies the underlying window data structures including invisible windows, allowing the target device to reconstruct and display these windows independently
2Adaptability or versatility
If only currently visible window content is projected, then the projection simplicity is maintained, but the comprehensiveness of projected content is limited
Solution Approach 1:
The system adds another dimension to screen projection by transitioning from 2D visible screen content to 3D window data structures. By obtaining window data that includes z-order, visibility state, and window hierarchy information, the system enables operation on windows across multiple dimensional layers, not just the currently visible top layer
3Loss of information
If window data of enabled application is obtained and displayed, then the projection of invisible windows is achieved, but the distinction between visible and invisible windows must be managed
Solution Approach 1:
The system segments window data into distinct components including window identifiers, visibility states, z-order information, and content data. By dividing the complex window data structure into manageable segments, the target device can independently process and display each window based on its specific attributes without being overwhelmed by the overall complexity
Data Source
AI summary
The screen projection display method includes: After receiving screen projection request information sent by a source device, a target device obtains window data of an application enabled by the source device, where the window data includes display content corresponding to at least two windows opened in a same application enabled by the source device; and the target device displays the window data of the enabled application. The target device onto which a screen is to be projected obtains the window data of the application enabled by the source device. The window data not only includes content of a currently visible window on the source device, but also includes content of a window that is enabled by the source device but is invisible. The target device displays the window data on a display interface of the target device.