Cross-Device UI Restoration Without Client Video Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current UI restoration technologies, such as video projection, require video decoding capabilities on the client device, limiting their use on devices without such capabilities.
Innovation Solution
A method where a source device adds label information to interface elements, allowing a client device to restore a user interface suitable for its capabilities without relying on video decoding, using short-range wireless connections.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If video projection restoration technology is used, then user interface can be restored on client device, but client device must have video decoding capability
Solution Approach 1:
The source device captures screenshots and extracts interface elements from the displayed UI, creating a digital representation of the interface. This copied interface data is then transmitted to the client device for reconstruction, eliminating the need for video decoding while preserving the visual appearance and functionality of the original interface.
Solution Approach 2:
The patent introduces an intermediary process that captures the visual output of the source device and converts it into extractable interface elements. This intermediary layer (screenshot capture + element extraction) acts as a bridge between the source device display and the client device reconstruction, enabling UI restoration without direct video stream dependency.
2Loss of information
If video projection technology is used, then interface elements can be transmitted, but video decoding capability is required on both devices
Solution Approach 1:
The patent extracts only the necessary interface elements (buttons, text, images, layout information) from the screenshot data, removing unnecessary video encoding/decoding components. This extraction process isolates the essential UI components for transmission, eliminating the complexity of video decoding requirements while preserving interface fidelity.
Solution Approach 2:
The patent replaces the mechanical video decoding system with an alternative approach: screenshot capture → element extraction → data transmission → interface reconstruction. This substitution eliminates the need for video decoding hardware/software while achieving the same goal of interface restoration on the client device.
3Adaptability or versatility
If label information is added to interface elements, then client device can restore suitable interface without video decoding, but source device processing increases
Solution Approach 1:
The source device performs preliminary actions by capturing screenshots and extracting interface elements with their label information before transmission. This preliminary processing organizes the UI data into a structured format with embedded labels, making the data ready for direct reconstruction on the client device without requiring video decoding capabilities.
Data Source
AI summary
The method includes: In response to receiving a first indication, a first electronic device displays a first interface and sends first information to a second electronic device, where the first information includes one or more interface elements on the first interface and label information of the one or more interface elements. The second electronic device displays a second interface based on the label information of the one or more interface elements in response to receiving the first information, where the second interface displays at least part of the one or more interface elements.