APP Remote Control via Interface Drawing Instructions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote control technologies face challenges with high network resource consumption, low transmission efficiency, and poor fluency due to the reliance on video stream transmission, which is affected by unstable networks and results in large traffic consumption and poor text display effects.
Innovation Solution
An APP remote control method that uses a client/server system architecture to transmit interface drawing instructions instead of video streams, allowing the service device to simulate user interactions on the service device's Android operating system and send interface drawing instructions to the terminal device, reducing bandwidth consumption and improving fluency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If video stream transmission is used for remote control, then the interface can be transmitted to the client, but the network resource consumption increases and transmission efficiency decreases
Solution Approach 1:
The patent extracts only the essential interface drawing instructions from the complete video stream, transmitting only the necessary rendering commands rather than the entire video data. This allows the client to reconstruct the interface with minimal bandwidth consumption while maintaining complete interface transmission functionality.
Solution Approach 2:
Instead of transmitting the actual video stream, the patent creates and transmits a copy of the interface drawing instructions that can be rendered by the client. This instructional copy enables the client to reproduce the interface visually without requiring the original video data, significantly reducing bandwidth usage.
2Loss of information
If video stream transmission is used for remote control, then the interface can be transmitted to the client, but the transmission efficiency decreases and fluency deteriorates
Solution Approach 1:
The patent segments the interface transmission into discrete drawing instructions rather than continuous video streams. Each instruction represents a specific rendering command that can be processed independently, enabling more efficient transmission and rendering that improves overall system fluency and responsiveness.
Solution Approach 2:
The patent changes the transmission parameter from video stream format to interface drawing instruction format. This parameter transformation fundamentally alters how data is transmitted, converting continuous visual data into discrete, processable commands that enhance transmission efficiency and system fluency.
3Loss of information
If video stream transmission is used for remote control, then the interface can be transmitted to the client, but the text display effect deteriorates
Solution Approach 1:
The patent replaces the mechanical video stream transmission system with an instructional rendering system. Instead of transmitting pre-processed video data, the system transmits rendering instructions that the client executes to generate the interface, including text elements. This substitution enables precise control over text rendering quality while reducing bandwidth consumption.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
Embodiments of the present invention disclose an APP remote control method and related devices, the method may include: receiving, by a service device, a first operation instruction sent by a terminal device, where the first operation instruction is generated by the terminal device based on a first input, the first input includes an input acting on a start of an application icon of a first application program, and/or an input acting on a user interface of the first application program, the first application program runs on the service device, and the application icon of the first application program and the user interface of the first application program are displayed on the terminal device; responding, by the service device, to the first operation instruction through the first application program, and generating a first response result; and extracting, by the service device, a first interface drawing instruction from the first response result, and sending the first interface drawing instruction to the terminal device, where the first interface drawing instruction is used for the terminal device to draw a partial or complete interface corresponding to the first response result. By using the embodiments of the present invention, remote control efficiency in a remote control system may be improved.