Display Interface Tagging for Video-Free UI Restoration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing user interface restoration technologies between devices require video decoding capabilities on the client device, limiting their use on devices without such capabilities.
Innovation Solution
A method where a source device adds tag information to interface elements, allowing a client device to restore a user interface suitable for its capabilities without relying on video decoding, enabling multiple display interfaces on the source device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If video projection restoration technology is used to restore user interfaces between devices, then the user interface can be restored on the client device, but the client device must have video decoding capability which limits its applicability
Solution Approach 1:
The patent segments the user interface into individual interface elements and transmits their structural information (tags, properties, coordinates) separately from visual content. This allows the client device to reconstruct the UI using only rendering capabilities, eliminating the need for video decoding while maintaining UI restoration functionality across diverse devices.
Solution Approach 2:
The patent introduces an intermediary data structure consisting of interface element tags and property information that acts as a mediator between the source and client devices. This intermediary representation enables UI restoration without direct video stream transmission, allowing devices without video decoding capabilities to restore interfaces through standard rendering processes.
2Productivity
If video encoding is used to transmit interface information from source to client device, then the interface can be transmitted, but both devices need video encoding and decoding capabilities which increases system complexity
Solution Approach 1:
The patent replaces the mechanical video encoding/decoding system with a data-based interface element description system. Instead of encoding visual pixels into video streams, the system uses structured data (tags, properties, coordinates) to describe interface elements, which can be transmitted and rendered without video processing capabilities, thereby reducing device complexity while maintaining transmission efficiency.
Solution Approach 2:
The patent changes the parameter representation from pixel-based video data to structured interface element parameters (tags, properties, coordinates). This parameter transformation allows the interface information to be transmitted in a format that can be processed by devices without video encoding/decoding capabilities, reducing system complexity while preserving transmission efficiency through compact data structures.
3Adaptability or versatility
If multiple display interfaces need to be shown on source device, then user can access multiple functions, but user needs to switch between interfaces which reduces operational efficiency
Solution Approach 1:
The patent merges multiple display interfaces by mapping interface elements from different source interfaces to corresponding positions on the client device screen. This allows multiple interfaces to be displayed simultaneously in a unified view, eliminating the need for users to switch between interfaces while maintaining access to all functions, thereby improving operational efficiency without sacrificing versatility.
Data Source
AI summary
A method includes: a first electronic device displaying a first interface, and sending first information to a second electronic device, where the first information includes one or more interface elements on the first interface and tag information of the interface elements; and the second electronic device displaying a second interface based on the tag information of the one or more interface elements on the first interface, where the second interface includes a first display window and a second display window, at least some interface elements of the one or more interface elements on the first interface are displayed in the first display window, the second display window displays a display interface associated with a first interface element, and the at least some interface elements include the first interface element.