Concurrent Application Display with Sensitive Data Obfuscation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in allowing controlled access and support for mobile device applications, particularly due to the complexity of wireless data communication protocols and diverse operating systems, making it difficult for end-users to assist users without accessing sensitive information.
Innovation Solution
Establishing a concurrent display method between devices, enabling a co-browsing session where a second computing device can receive and emulate the user interface of a first computing device, with features like full-duplex communication, image polling, and sensitive information obfuscation, allowing controlled access and assistance while maintaining user privacy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a second computing device directly accesses and controls the first computing device to provide assistance, then effective remote assistance can be provided, but sensitive information on the first device may be exposed
Solution Approach 1:
The system creates a visual copy of the user interface by capturing screenshots or rendering the display buffer, then transmits these images to the second computing device. This allows the assisting user to see exactly what the first user sees without having direct access to or control over the underlying data and system resources, thereby preventing sensitive information exposure while maintaining effective remote assistance capability
Solution Approach 2:
The patent introduces an intermediary communication channel that transmits only visual interface elements (images, screenshots, rendered display data) between the two devices. This intermediary layer acts as a buffer that allows the second device to observe and provide guidance on the first device's interface without establishing direct control pathways that could expose sensitive information, thus resolving the contradiction between assistance effectiveness and information security
2Ease of operation
If direct control access is granted to assist users on mobile devices, then effective support can be provided, but the complexity of wireless data communication protocols and diverse operating systems creates barriers
Solution Approach 1:
The system implements a universal interface layer that captures the user interface through standardized methods (such as accessing the display buffer or capturing screenshots) that work across different operating systems and device types. By focusing on the universal visual output rather than device-specific control mechanisms, the system enables effective remote support while avoiding the complexity of adapting to diverse wireless communication protocols and operating system variations
Solution Approach 2:
Instead of attempting to control the first device directly through complex device-specific protocols, the system creates a visual copy of the interface and transmits it through standard image communication channels. This approach bypasses the need to navigate complex wireless data communication protocols and operating system differences, as image transmission is a universal function available across all platforms, thereby simplifying the overall system complexity while maintaining support effectiveness
3Loss of information
If the entire user interface is transmitted to the second device, then complete visibility is achieved, but sensitive information is exposed
Solution Approach 1:
The system extracts only the necessary visual portions of the user interface that are relevant to the current support task, rather than transmitting the entire interface. By selectively capturing and transmitting only the specific areas, elements, or portions of the interface that need attention, the system maintains complete visibility of relevant information while automatically excluding sensitive areas from transmission, thus resolving the contradiction between information visibility and sensitive data protection
Data Source
AI summary
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for concurrent display of applications between devices. One of the methods includes establishing full duplex communication session with a first application on a first computing device using a second application. The method includes receiving a user interface image from the first application on the first computing device. The method includes displaying the user interface image on a second user interface of the computer system. The method includes generating an overlay image including one or more annotations to the user interface image. The method also includes sending the overlay image to the first computing device.