Terminal control method, device, electronic device and storage medium

By synchronously displaying the interface between the video network terminal and the controlled terminal, and receiving remote control instructions for end-to-end control, the complex use of video network terminals is solved, and user experience and convenience are improved.

CN112346799BActive Publication Date: 2024-11-19VISIONVERA INFORMATION TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202011099576.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-10-14
Publication Date
2024-11-19
Estimated Expiration
2040-10-14

AI Technical Summary

Technical Problem

The use of existing video network terminals is complex, especially for older users or users in remote areas. When users encounter problems, the process of solving problems through telephone customer service or home-to-door service is cumbersome and costly, making it difficult to improve the user experience.

Method used

By synchronizing the display interface of the video network control terminal with the display interface of the controlled terminal, and receiving control instructions sent by the remote control, the commands are directly sent to the controlled terminal, so that the user can control the video network terminal end-to-end. Improve convenience.

Benefits of technology

End-to-end control is achieved without installing control software on the terminal, which simplifies user operation processes, reduces the cost and time of solving problems, and improves user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112346799B_ABST
    Figure CN112346799B_ABST
Patent Text Reader

Abstract

The present application provides a terminal control method, device, electronic device and storage medium. The method is applied to a visual network control terminal, including: displaying its own display interface as the display interface of the visual network controlled terminal; receiving a control instruction for the visual network controlled terminal sent by a remote control, wherein the control instruction is generated by a user operating the remote control on the display interface of the visual network control terminal; and sending the control instruction to the visual network controlled terminal via the visual network, so that the visual network controlled terminal responds to the control instruction. The method can realize end-to-end control without installing any control software on the visual network control terminal and / or the visual network controlled terminal, thereby improving the convenience of using the visual network terminal and enhancing the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of information processing technology, and in particular to a terminal control method, device, electronic device and storage medium. Background Art

[0002] With the rapid development of visual Internet, the functions provided by visual Internet terminals to users are becoming more and more abundant and complex. In addition, due to the diversity of buttons on the remote control, it is difficult for users to use them, especially for older users or users in remote areas.

[0003] At present, when users encounter problems while using visual networking terminals, the solutions available are: 1. Users call the service hotline, and customer service guides users to complete the corresponding operations over the phone; 2. Contact local technical support for door-to-door service. However, for the first method, telephone customer service can only guide users through verbal descriptions, which causes many inconveniences in communication. If there are communication barriers, it will affect the timely resolution of the problem; for the second method, it takes a long time to wait, and for some not very serious problems, the cost of door-to-door service is high. It can be seen that how to improve the convenience of users using visual networking terminals has become an urgent problem to be solved. Summary of the invention

[0004] In view of the above problems, the present application provides a terminal control method, device, electronic device and storage medium, which can effectively improve the convenience of users in using visual network terminals.

[0005] In a first aspect, the present application provides a terminal control method, which is applied to a visual network control terminal, and the method includes:

[0006] Displaying its own display interface as the display interface of the controlled terminal of the visual network;

[0007] Receiving a control instruction for the visual network controlled terminal sent by a remote controller, wherein the control instruction is generated by a user operating the remote controller on a display interface of the visual network control terminal;

[0008] The control instruction is sent to the visual network controlled terminal through the visual network, so that the visual network controlled terminal responds to the control instruction.

[0009] Optionally, before displaying its own display interface as the display interface of the visual network controlled terminal, the method further includes:

[0010] Sending a control invitation to the controlled terminal of the visual network;

[0011] When the visual network controlled terminal agrees to the control invitation, obtaining a display video stream of a display interface of the visual network controlled terminal;

[0012] Displaying its own display interface as the display interface of the visual network controlled terminal includes:

[0013] According to the display video stream, its own display interface is displayed as the display interface of the controlled terminal in the visual network.

[0014] Optionally, the visual network control terminal is provided with an Android layer program and a bottom layer program, the Android layer program is used to monitor the control instructions of the remote control, and the bottom layer program is used to send the control instructions of the remote control to the outside;

[0015] Receiving a control instruction sent by a remote controller for the controlled terminal of the visual network includes:

[0016] Receiving control instructions for the visual network controlled terminal sent by the remote controller through the Android layer program;

[0017] Sending the control instruction to the controlled terminal of the visual network through the visual network includes:

[0018] The control instruction is obtained from the Android layer program through the bottom layer program, and the control instruction is sent to the controlled terminal of the visual network according to the visual network transparent transmission protocol.

[0019] Optionally, there are multiple controlled terminals in the visual network; displaying the own display interface as the current display interface of the controlled terminal in the visual network includes:

[0020] Displaying its own display interface as the current display interface of the plurality of visual network controlled terminals;

[0021] Receiving a control instruction sent by a remote controller for the controlled terminal of the visual network includes:

[0022] Receiving control instructions sent by the remote controller for some or all of the visual network control terminals among the plurality of visual network controlled terminals;

[0023] The control instruction is sent to the visual network controlled terminal through the visual network so that the visual network controlled terminal responds to the control instruction, including:

[0024] The control instruction is sent to some or all of the visual network control terminals among the multiple visual network controlled terminals through the visual network, so that some or all of the visual network control terminals respond to the control instruction.

[0025] Optionally, before receiving the control instruction for the visual network controlled terminal sent by the remote controller, the method further includes:

[0026] Shield the visual network control terminal from responding to the control instructions sent by the remote control.

[0027] A second aspect of the present application provides a terminal control method, which is applied to a controlled terminal in a visual network, and the method includes:

[0028] Receive control invitation sent by visual network control terminal;

[0029] When agreeing to the control invitation, sending a display video stream of its own current display interface to the visual network control terminal, so that the visual network control terminal displays the current display interface of the visual network controlled terminal according to the display video stream;

[0030] Receiving a control instruction sent by the visual network control terminal through the visual network, wherein the control instruction is generated by a user operating a display interface of the visual network control terminal through a remote controller;

[0031] Respond to the control instruction.

[0032] Optionally, the visual network controlled terminal is provided with a bottom layer program, an Android layer program and an H5 program;

[0033] Receiving a control instruction sent by the visual network control terminal via the visual network, comprising:

[0034] Receiving, through the underlying program, a control instruction sent by the visual network control terminal through the visual network;

[0035] Responding to the control instruction includes:

[0036] When the operating interface is an Android interface, the control instruction is processed by the Android layer program;

[0037] When the operating interface itself is an H5 interface, the control instruction is processed by the H5 program.

[0038] Optionally, before receiving the control instruction sent by the visual network control terminal through the visual network, the method further includes:

[0039] Shield the visual network controlled terminal from responding to the control command sent by the remote control.

[0040] A third aspect of the present application provides a terminal control device, which is applied to a visual network control terminal, and the device includes:

[0041] A display module, used to display its own display interface as the display interface of the visual network controlled terminal;

[0042] A first receiving module, configured to receive a control instruction for the visual network controlled terminal sent by a remote controller, wherein the control instruction is generated by a user operating the remote controller on a display interface of the visual network control terminal;

[0043] The first sending module is used to send the control instruction to the visual network controlled terminal through the visual network, so that the visual network controlled terminal responds to the control instruction.

[0044] A fourth aspect of the present application provides a terminal control device, which is applied to a controlled terminal in a visual network, and the device includes:

[0045] The second receiving module is used to receive a control invitation sent by the visual network control terminal;

[0046] A third sending module is used to send a display video stream of its current display interface to the visual network control terminal when agreeing to the control invitation, so that the visual network control terminal displays the current display interface of the visual network controlled terminal according to the display video stream;

[0047] A third receiving module is used to receive a control instruction sent by the visual network control terminal through the visual network, wherein the control instruction is generated by a user operating on a display interface of the visual network control terminal through a remote control;

[0048] A response module is used to respond to the control instruction.

[0049] The fifth aspect of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executed, implements the steps of the terminal control method described in the first aspect or the second aspect of the present application.

[0050] The sixth aspect of the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps in the terminal control method as described in the first aspect or the second aspect of the present application.

[0051] Through the terminal control method of the present application, the visual network control terminal first displays its own display interface as the display interface of the visual network controlled terminal; then receives the control instruction for the visual network controlled terminal sent by the remote control, and the control instruction is generated by the user operating the display interface of the visual network control terminal through the remote control; finally, the control instruction is sent to the visual network controlled terminal through the visual network, so that the visual network controlled terminal responds to the control instruction. This method can achieve end-to-end control without installing any control software on the visual network control terminal and / or the visual network controlled terminal, which improves the convenience of using the visual network terminal and enhances the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the technical solution of the embodiments of the present application, the drawings required for use in the description of the embodiments of the present application are briefly introduced below.

[0053] Figure 1 This is a schematic diagram of an implementation scenario shown in an embodiment of the present application;

[0054] Figure 2 is a flow chart of a terminal control method shown in an embodiment of the present application;

[0055] Figure 3 is a flow chart of another terminal control method shown in an embodiment of the present application;

[0056] Figure 4 is a schematic diagram of an end-to-end control shown in an embodiment of the present application;

[0057] Figure 5 is a schematic diagram of another end-to-end control shown in an embodiment of the present application;

[0058] Figure 6 is a structural block diagram of a terminal control device shown in an embodiment of the present application;

[0059] Figure 7 is a structural block diagram of another terminal control device shown in an embodiment of the present application;

[0060] Figure 8 This is a schematic diagram of a visual network shown in an embodiment of the present application;

[0061] Fig. 9 It is a schematic diagram of the hardware structure of a node server shown in an embodiment of the present application;

[0062] Fig.10 It is a schematic diagram of the hardware structure of an access switch shown in an embodiment of the present application;

[0063] Fig.11 It is a schematic diagram of the hardware structure of an Ethernet protocol conversion gateway shown in an embodiment of the present application. DETAILED DESCRIPTION

[0064] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0065] Figure 1 This is a schematic diagram of an implementation scenario shown in an embodiment of the present application. Figure 1In the embodiment, the visual network control terminal and the visual network controlled terminal are both remote control type terminals, the first remote control can control the visual network control terminal, and the second remote control can control the visual network controlled terminal. The visual network control terminal can control the visual network controlled terminal through the visual network, that is, the visual network control terminal receives the control instruction sent by the first remote control, sends the control instruction to the visual network controlled terminal through the visual network, and the visual network controlled terminal responds to the control instruction.

[0066] The terminal control method of the present application can be applied to Figure 1 The visual network control terminal in. Figure 2 1 is a flow chart of a terminal control method shown in an embodiment of the present application. Figure 2 , the terminal control method of the present application may include the following steps:

[0067] Step S21: Displaying its own display interface as the display interface of the visual network controlled terminal.

[0068] In this embodiment, the visual network control terminal will display its own display interface as the display interface of the visual network controlled terminal, that is, the display image on the screen of the visual network control terminal is completely consistent with the display image on the screen of the visual network controlled terminal. In this way, the user on the visual network control terminal side can view the display image of the visual network controlled terminal in real time.

[0069] Step S22: receiving a control instruction for the visual network controlled terminal sent by a remote controller, wherein the control instruction is generated by a user operating the remote controller on a display interface of the visual network control terminal.

[0070] In this embodiment, the user on the side of the visual network control terminal can view the display interface of the visual network controlled terminal through the display interface of the visual network controlled terminal. When it is necessary to control the visual network controlled terminal by performing corresponding operations on the display interface of the visual network controlled terminal, control instructions can be sent to the visual network control terminal through the remote control.

[0071] In one implementation, before the above step S22, the following may also be included:

[0072] Shield the visual network control terminal from responding to the control instructions sent by the remote control.

[0073] In this embodiment, when the visual network controlled terminal is controlled by the visual network control terminal, the visual network control terminal shields its own response to the control instructions of the remote control except for the command to release the control, so that the visual network control terminal can send these control instructions to the visual network controlled terminal.

[0074] Similarly, when the visual network controlled terminal allows this control, in addition to the command to release the control, it will also shield its own response to the control instructions of the remote control, thereby ensuring the response to the control instructions sent by the visual network control terminal.

[0075] Step S23: Sending the control instruction to the visual network controlled terminal through the visual network, so that the visual network controlled terminal responds to the control instruction.

[0076] In this embodiment, after receiving the control instruction sent by the visual network control terminal, the visual network controlled terminal responds to the control instruction.

[0077] For example, when a user plays a TV program through visual networking terminal A, if he wants to adjust the playback settings but does not know how to operate, he can control visual networking terminal A through a remote control to send a control invitation to visual networking terminal B to request visual networking terminal B to control visual networking terminal A. If visual networking terminal B allows control of visual networking terminal A, then visual networking terminal B displays the current interface status of visual networking terminal A on itself, so that the user on the side of visual networking terminal B can obtain the playback setting strategy according to the interface status of visual networking terminal A, and then control visual networking terminal B through the remote control to send playback setting operation instructions to visual networking terminal A. After receiving the playback setting operation instructions, visual networking terminal A responds to the playback setting operation instructions to complete the adjustment of the playback settings. During this adjustment process, the user on the side of visual networking terminal A can view the specific adjustment steps, such as the picture after each adjustment step, but cannot control visual networking terminal A through the remote control. In other words, if visual networking terminal A is Figure 1 The video network controlled terminal shown in the figure can only accept the control of the first remote controller, but cannot accept the control of the second remote controller. When control is not needed, the user on the video network terminal A side or the user on the video network terminal B side can cancel the control at any time.

[0078] Through the terminal control method of the present application, the visual network control terminal first displays its own display interface as the display interface of the visual network controlled terminal; then receives the control instruction for the visual network controlled terminal sent by the remote control, and the control instruction is generated by the user operating the display interface of the visual network control terminal through the remote control; finally, the control instruction is sent to the visual network controlled terminal through the visual network, so that the visual network controlled terminal responds to the control instruction. This method can achieve end-to-end control without installing any control software on the visual network control terminal and / or the visual network controlled terminal, which improves the convenience of using the visual network terminal and enhances the user experience.

[0079] In combination with the above embodiments, in one implementation, before the above step S21, the terminal control method of the present application may further include the following steps:

[0080] A control invitation is sent to the controlled terminal of the visual network.

[0081] When the visual network controlled terminal agrees to the control invitation, a display video stream of the display interface of the visual network controlled terminal is obtained.

[0082] Accordingly, step S21 may include:

[0083] According to the display video stream, its own display interface is displayed as the display interface of the controlled terminal in the visual network.

[0084] In this embodiment, when it is necessary to control the visual network controlled terminal through the visual network control terminal, the visual network control terminal can send a control invitation to the visual network controlled terminal. If the visual network controlled terminal allows this control, it returns a control permission response and sends the display video stream of its own display interface to the visual network control terminal together with the control permission response, so that the visual network control terminal displays its own display interface as the display interface of the visual network controlled terminal according to the display video stream, so that the user can operate the visual network controlled terminal.

[0085] Of course, when it is necessary to control the visual network controlled terminal through the visual network control terminal, the visual network controlled terminal can also actively send a control invitation to the visual network control terminal. If the visual network control terminal allows this control, it will return a control permission response. After receiving the control permission response, the visual network controlled terminal will send the display video stream of its own display interface to the visual network control terminal.

[0086] In this embodiment, the visual network control terminal displays its own display interface as the display interface of the visual network controlled terminal, so that the user on the side of the visual network control terminal can easily view the display status of the visual network controlled terminal, thereby achieving precise control of the visual network control terminal.

[0087] In combination with the above embodiments, in one implementation, the visual network control terminal is provided with an Android layer program and a bottom layer program, the Android layer program is used to monitor the control instructions of the remote control, and the bottom layer program is used to send the control instructions of the remote control to the outside.

[0088] On this basis, the above step S22 may include:

[0089] The control instructions for the visual network controlled terminal sent by the remote control are received through the Android layer program.

[0090] The above step S23 may include:

[0091] The control instruction is obtained from the Android layer program through the bottom layer program, and the control instruction is sent to the controlled terminal of the visual network according to the visual network transparent transmission protocol.

[0092] In this embodiment, the visual network control terminal is provided with an Android layer program and a bottom layer program. The Android layer program is used to monitor the received remote control commands and pass the monitored received remote control commands to the bottom layer C program. The bottom layer C program sends the remote control commands to the visual network controlled terminal through the visual network.

[0093] This embodiment provides the underlying implementation logic when the visual networking control terminal sends a control instruction to the visual networking controlled terminal, so that the visual networking control terminal can smoothly control the visual networking controlled terminal.

[0094] In combination with the above embodiments, in one implementation, the number of the visual network controlled terminals is multiple. On this basis, the above step S21 may include:

[0095] Display its own display interface as the current display interface of multiple visual network controlled terminals.

[0096] The above step S22 may include:

[0097] Receive control instructions sent by the remote control for some or all of the visual network control terminals among the multiple visual network controlled terminals.

[0098] The above step S23 may include:

[0099] The control instruction is sent to some or all of the visual network control terminals among the multiple visual network controlled terminals through the visual network, so that some or all of the visual network control terminals respond to the control instruction.

[0100] In this embodiment, the visual network control terminal can also control multiple visual network controlled terminals at the same time. The visual network control terminal first sends a control invitation to multiple visual network controlled terminals. When multiple visual network controlled terminals allow control, the visual network control terminal displays the display interface of each visual network controlled terminal in a split screen. When a user on one side of the visual network control terminal needs to control a single visual network controlled terminal at a certain moment, the visual network controlled terminal can be selected through the remote control, and then the control button can be clicked to set it. When the display interface of some visual network controlled terminals is adjusted to be the same, the user can select this part of the visual network controlled terminals through the remote control, and then click the synchronization control button to synchronize the settings of this part of the visual network controlled terminals. When performing synchronous control, the control instructions issued by the user through the remote control can be sent to each visual network controlled terminal through the visual network control terminal, so that each visual network controlled terminal responds to the control instruction independently.

[0101] For example, when it is necessary to control the visual network controlled terminal 1-visual network controlled terminal 3, the visual network control terminal can display the display interface of the visual network controlled terminal 1-visual network controlled terminal 3 in a split screen, wherein the display interface of the visual network controlled terminal 1 is the same as that of the visual network controlled terminal 2, and the display interface of the visual network controlled terminal 3 is different from that of the visual network controlled terminal 1 and the visual network controlled terminal 2. At this time, the visual network control terminal can first select the visual network controlled terminal 3, adjust its display interface to the same display interface as the visual network controlled terminal 1 or the visual network controlled terminal 2, and then select the visual network controlled terminal 1-visual network controlled terminal 3 for synchronous control. At this time, the control command issued by the user through the remote control can be sent to the visual network controlled terminal 1-networked controlled terminal 3 through the visual network control terminal, so that the visual network controlled terminal 1-networked controlled terminal 3 can respond to the control command independently, for example, when the control command is to play music X, the visual network controlled terminal 1-networked controlled terminal 3 can play music X at the same time after responding to the control command.

[0102] In this embodiment, multiple visual network controlled terminals can be controlled by the visual network control terminal, which further improves the convenience of the visual network terminal.

[0103] The terminal control method of the present application can also be applied to Figure 1 The visual network controlled terminal. Figure 3 FIG. 1 is a flow chart of another terminal control method according to an embodiment of the present application. Figure 3 Another terminal control method of the present application may include the following steps:

[0104] Step S31: receiving a control invitation sent by the visual network control terminal.

[0105] Step S32: When agreeing to the control invitation, the display video stream of the current display interface of the visual network control terminal is sent to the visual network control terminal, so that the visual network control terminal displays the current display interface of the visual network controlled terminal according to the display video stream.

[0106] Step S33: receiving a control instruction sent by the visual network control terminal through the visual network, wherein the control instruction is generated by a user operating a remote control on a display interface of the visual network control terminal.

[0107] Step S34: respond to the control instruction.

[0108] In this embodiment, the visual network control terminal can send a control invitation to the visual network controlled terminal. If the visual network controlled terminal allows this control, it sends the display video stream of its current display interface to the visual network control terminal, so that the visual network control terminal displays the current display interface of the visual network controlled terminal according to the display video stream. In this way, the user on the side of the visual network control terminal can better control the visual network controlled terminal by viewing the current display interface of the visual network controlled terminal.

[0109] For detailed description of the above steps S31 to S34, please refer to the above description, which will not be repeated in this embodiment.

[0110] In one implementation, before the above step S33, the following steps may also be included:

[0111] Shield the visual network controlled terminal from responding to the control command sent by the remote control.

[0112] In this embodiment, when the visual network controlled terminal is controlled by the visual network control terminal, the visual network controlled terminal will shield its own response to the control instructions of the remote control except for the command to release the control, thereby ensuring the response to the control instructions sent by the visual network control terminal.

[0113] Through the terminal control method of the present application, the visual network controlled terminal first receives the control invitation sent by the visual network control terminal, and when agreeing to the control invitation, sends the display video stream of its own current display interface to the visual network control terminal, so that the visual network control terminal displays the current display interface of the visual network controlled terminal according to the display video stream; then receives the control instruction sent by the visual network control terminal through the visual network, which is generated by the user operating the display interface of the visual network control terminal through the remote control; and responds to the control instruction. This method can achieve end-to-end control without installing any control software on the visual network control terminal and / or the visual network controlled terminal, which improves the convenience of using the visual network terminal and enhances the user experience.

[0114] In combination with the above embodiments, in one implementation, the visual network controlled terminal is provided with a bottom layer program, an Android layer program and an H5 program. On this basis, step S33 may include:

[0115] The control instructions sent by the visual network control terminal through the visual network are received through the underlying program.

[0116] The above step S34 may include:

[0117] When the operating interface is an Android interface, the control instruction is processed by the Android layer program;

[0118] When the operating interface itself is an H5 interface, the control instruction is processed by the H5 program.

[0119] In this embodiment, the visual network controlled terminal is provided with a bottom-layer program, an Android-layer program, and an H5 program. When the bottom-layer program receives the remote control command sent by the visual network control terminal, it passes the remote control command to the Android-layer program. The Android-layer program determines whether the current operation interface of the visual network controlled terminal is an Android interface or an H5 interface. If it is an Android interface, the Android method is called to simulate the remote control parsing command. If it is an H5 interface, the remote control command is passed to the H5-layer program, and the H5-layer program calls the JS method to simulate the remote control parsing command.

[0120] This embodiment provides the underlying implementation logic when the visual network controlled terminal processes the control instruction sent by the visual network control terminal, so that the visual network control terminal can smoothly control the visual network controlled terminal.

[0121] Figure 4 It is a schematic diagram of an end-to-end control shown in an embodiment of the present application. Figure 5 This is a schematic diagram of another end-to-end control shown in an embodiment of the present application. Figure 4 and Figure 5 , the terminal control method of the present application is described in detail with a specific embodiment.

[0122] exist Figure 4 In the embodiment of the present invention, when it is necessary to control the controlled terminal of the visual network through the visual network control terminal, the user enters the terminal number of the controlled terminal of the visual network on the operation interface of the visual network control terminal through the remote control, clicks the button requesting control, and sends a transparent transmission instruction to the controlled terminal of the visual network. The controlled terminal of the visual network receives the control request, and a prompt box pops up on the interface. After the user clicks to allow control, the transparent transmission instruction allowing control is returned to the control terminal of the visual network. At the same time, the controlled terminal of the visual network sends the displayed video stream to the control terminal of the visual network through the visual network server, and then shields its own remote control button control, and only retains the response of the "cancel" button, which is used to interrupt the control relationship at any time. Similarly, the controlled terminal of the visual network also shields its own remote control button control, and only retains the response of the "cancel" button, which is used to interrupt the control relationship at any time. The control terminal of the visual network receives and plays the video stream in full screen, and monitors the buttons of the remote control at the same time. The received remote control buttons are not responded locally (except for the "cancel" button, which is used to interrupt the control relationship), and are completely transmitted to the controlled terminal of the visual network through the transparent transmission instruction. After the controlled terminal of the visual network receives the remote control instruction sent, it simulates the button operation through the program, thereby completing the effect of remote control. The visual network control terminal and the visual network controlled terminal can send a transparent transmission command to the other terminal through the "cancel" button on the remote control to cancel the control relationship and restore the normal operation of the terminal.

[0123] exist Figure 5 In the control terminal of the visual network, an Android layer program and a bottom C program are set up. The visual network control terminal monitors the remote control commands sent by the remote control through the Android layer program, and then passes the remote control commands to the bottom C program. The bottom C program sends the remote control commands to the controlled terminal of the visual network through transparent transmission commands. The controlled terminal of the visual network is provided with a bottom C program, an Android layer program and an H5 layer program. After receiving the remote control command, the bottom C program passes the remote control command to the Android layer program. The Android layer program determines whether the current interface is an Android interface. If so, it calls the Android method to simulate the remote control command. If it is an H5 interface, it passes the remote control command to the H5 layer program, and the H5 layer program calls the JS method to simulate the remote control command.

[0124] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0125] Based on the same inventive concept, the present application also provides a terminal control device 600, which is applied to a visual network control terminal, such as Figure 6 shown. Figure 6 1 is a block diagram of a terminal control device according to an embodiment of the present application. Figure 6 , the terminal control device 600 may include:

[0126] Display module 601, used to display its own display interface as the display interface of the visual network controlled terminal;

[0127] A first receiving module 602 is used to receive a control instruction for the visual network controlled terminal sent by a remote controller, wherein the control instruction is generated by a user operating the remote controller on a display interface of the visual network control terminal;

[0128] The first sending module 603 is used to send the control instruction to the visual network controlled terminal through the visual network, so that the visual network controlled terminal responds to the control instruction.

[0129] Optionally, the device 600 further includes:

[0130] A second sending module, used to send a control invitation to the controlled terminal of the visual network;

[0131] An acquisition module, used for acquiring a display video stream of a display interface of the visual network controlled terminal when the visual network controlled terminal agrees to the control invitation;

[0132] The display module 601 includes:

[0133] The first display submodule is used to display its own display interface as the display interface of the visual network controlled terminal according to the display video stream.

[0134] Optionally, the visual network control terminal is provided with an Android layer program and a bottom layer program, the Android layer program is used to monitor the control instructions of the remote control, and the bottom layer program is used to send the control instructions of the remote control to the outside; the first receiving module 601 includes:

[0135] A first receiving submodule, used for receiving a control instruction for the visual network controlled terminal sent by the remote controller through the Android layer program;

[0136] The first sending module 603 includes:

[0137] The first sending submodule is used to obtain the control instruction from the Android layer program through the bottom layer program, and send the control instruction to the controlled terminal of the visual network according to the visual network transparent transmission protocol.

[0138] Optionally, the number of the visual network controlled terminals is multiple; the display module 601 includes:

[0139] A second display submodule, used to display its own display interface as the current display interface of the plurality of visual network controlled terminals;

[0140] The first receiving module 602 includes:

[0141] A second receiving submodule is used to receive control instructions sent by the remote controller for some or all of the visual network control terminals among the plurality of visual network controlled terminals;

[0142] The first sending module 603 includes:

[0143] The second sending submodule is used to send the control instruction to some or all of the visual network control terminals among the multiple visual network controlled terminals through the visual network, so that some or all of the visual network control terminals respond to the control instruction.

[0144] Optionally, the device 600 further includes:

[0145] The first shielding module is used to shield the visual network control terminal from responding to the control command sent by the remote control.

[0146] Based on the same inventive concept, the present application also provides a terminal control device 700, which is applied to a controlled terminal in a visual network, such as Figure 7 shown. Figure 7 1 is a block diagram of another terminal control device according to an embodiment of the present application. Figure 7 , the terminal control device 700 may include:

[0147] The second receiving module 701 is used to receive a control invitation sent by the visual network control terminal;

[0148] The third sending module 702 is used to send a display video stream of its current display interface to the visual network control terminal when agreeing to the control invitation, so that the visual network control terminal displays the current display interface of the visual network controlled terminal according to the display video stream;

[0149] The third receiving module 703 is used to receive a control instruction sent by the visual network control terminal through the visual network, where the control instruction is generated by a user operating on a display interface of the visual network control terminal through a remote controller;

[0150] The response module 704 is used to respond to the control instruction.

[0151] Optionally, the visual network controlled terminal is provided with a bottom layer program, an Android layer program and an H5 program; the third receiving module 702 includes:

[0152] A third receiving submodule, used for receiving, through the underlying program, a control instruction sent by the visual network control terminal through the visual network;

[0153] The response module 704 includes:

[0154] A first processing submodule, for processing the control instruction through the Android layer program when its own operation interface is an Android interface;

[0155] The second processing submodule is used to process the control instruction through the H5 program when its own operation interface is the H5 interface.

[0156] Optionally, the device 700 further includes:

[0157] The second shielding module is used to shield the response of the visual network controlled terminal to the control instruction sent by the remote control.

[0158] Based on the same inventive concept, the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executed, implements the steps in the terminal control method described in any of the above embodiments of the present application.

[0159] Based on the same inventive concept, the present application provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps in the terminal control method described in any of the above embodiments of the present application are implemented.

[0160] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0161] The visual Internet is an important milestone in the development of the Internet. It is a real-time network that can realize real-time transmission of high-definition video and push many Internet applications towards high-definition video and high-definition face-to-face communication.

[0162] The visual network adopts real-time high-definition video exchange technology. It can integrate the required services such as high-definition video conferencing, video monitoring, intelligent monitoring analysis, emergency command, digital radio and television, delayed TV, online teaching, live broadcast, VOD on demand, TV mail, personalized recording (PVR), intranet (self-operated) channels, intelligent video broadcast control, information release and dozens of other video, voice, picture, text, communication, data and other services on a single system platform, and realize high-definition quality video playback through TV or computer.

[0163] In order to enable those skilled in the art to better understand the embodiments of the present invention, the visual network is introduced as follows:

[0164] Some of the technologies used in the visual Internet of Things are as follows:

[0165] Network Technology

[0166] The network technology innovation of visual networking improves the traditional Ethernet to cope with the huge potential video traffic on the network. Different from simple network packet switching or network circuit switching, visual networking technology uses packet switching to meet streaming needs. Visual networking technology has the flexibility, simplicity and low price of packet switching, and the quality and security guarantee of circuit switching, realizing the seamless connection of the whole network switching virtual circuit and data format.

[0167] Switching Technology

[0168] Visual networking uses the two advantages of Ethernet: asynchronism and packet switching. It eliminates Ethernet defects under the premise of full compatibility, and has seamless end-to-end connection across the entire network, directly connects to user terminals, and directly carries IP data packets. User data does not require any format conversion within the entire network. Visual networking is a more advanced form of Ethernet and a real-time switching platform that can achieve large-scale real-time transmission of high-definition video across the entire network, which is currently unattainable on the Internet, and pushes many network video applications towards high definition and unification.

[0169] Server Technology

[0170] The server technology on the visual network and unified video platform is different from the traditional server. Its streaming media transmission is based on connection-oriented. Its data processing capability is independent of traffic and communication time. A single network layer can include signaling and data transmission. For voice and video services, the complexity of streaming media processing on the visual network and unified video platform is much simpler than data processing, and its efficiency is more than 100 times higher than that of traditional servers.

[0171] Storage Technology

[0172] The ultra-high-speed storage technology of the unified video platform adopts the most advanced real-time operating system to adapt to the media content with ultra-large capacity and ultra-large flow, mapping the program information in the server command to the specific hard disk space. The media content no longer passes through the server, but is directly delivered to the user terminal in an instant. The user generally waits for less than 0.2 seconds. The optimized sector distribution greatly reduces the mechanical movement of the hard disk head seeking, and the resource consumption accounts for only 20% of the same level of IP Internet, but it generates 3 times more concurrent traffic than the traditional hard disk array, and the overall efficiency is improved by more than 10 times.

[0173] Network Security Technology

[0174] The structural design of the visual network completely eradicates the network security issues that plague the Internet through separate licensing for each service and complete isolation of equipment and user data. Antivirus programs and firewalls are generally not required, and attacks by hackers and viruses are eliminated, providing users with a structurally worry-free and secure network.

[0175] Service Innovation Technology

[0176] The unified video platform integrates services and transmission. Whether it is a single user, a private network user or a network, it is just an automatic connection. User terminals, set-top boxes or PCs are directly connected to the unified video platform to obtain rich and colorful multimedia video services in various forms. The unified video platform uses a "recipe-style" table configuration mode to replace traditional complex application programming. Complex applications can be implemented with very little code, realizing "unlimited" new business innovation.

[0177] The networking of the visual network is as follows:

[0178] Visual networking is a centrally controlled network structure. The network can be a tree network, star network, ring network, etc., but on this basis, there needs to be a centralized control node in the network to control the entire network.

[0179] Figure 8 FIG. 1 is a schematic diagram of a visual network shown in an embodiment of the present application. Figure 8 As shown in the figure, the visual network is divided into two parts: access network and metropolitan area network.

[0180] The equipment in the access network can be divided into three categories: node server, access switch, and terminal (including various set-top boxes, encoding boards, storage, etc.). The node server is connected to the access switch, and the access switch can be connected to multiple terminals and can be connected to Ethernet.

[0181] The node server is a node in the access network that performs centralized control functions and can control access switches and terminals. The node server can be directly connected to the access switch or directly connected to the terminal.

[0182] Similarly, the devices in the metropolitan area network can also be divided into three categories: metropolitan area servers, node switches, and node servers. The metropolitan area servers are connected to the node switches, and the node switches can be connected to multiple node servers.

[0183] The node server is a node server of the access network part, that is, the node server belongs to both the access network part and the metropolitan area network part.

[0184] The metropolitan area server is a node with centralized control function in the metropolitan area network, which can control the node switch and node server. The metropolitan area server can be directly connected to the node switch or the node server.

[0185] It can be seen from this that the entire visual network is a hierarchical and centrally controlled network structure, and the network controlled by the node server and the metropolitan area server can be various structures such as tree, star, and ring.

[0186] Figuratively speaking, the access network part can form a unified video platform (the part in the dotted circle), and multiple unified video platforms can form a visual network; each unified video platform can be interconnected through the metropolitan area and wide area visual networks.

[0187] Visual networking equipment classification

[0188] 1.1 The devices in the visual network of the embodiment of the present invention can be mainly divided into three categories: servers, switches (including Ethernet gateways), terminals (including various set-top boxes, encoding boards, storage devices, etc.). The visual network as a whole can be divided into a metropolitan area network (or a national network, a global network, etc.) and an access network.

[0189] 1.2 The equipment in the access network can be mainly divided into three categories: node server, access switch (including Ethernet gateway), terminal (including various set-top boxes, encoding boards, storage, etc.).

[0190] The specific hardware structure of each access network device is as follows:

[0191] Node server:

[0192] Fig. 9 FIG. 1 is a schematic diagram of the hardware structure of a node server shown in an embodiment of the present application. Fig. 9 As shown, it mainly includes a network interface module 901, a switching engine module 902, a CPU module 903, and a disk array module 904;

[0193] Among them, the packets coming from the network interface module 901, the CPU module 903, and the disk array module 904 all enter the switching engine module 902; the switching engine module 902 performs an operation of checking the address table 905 on the incoming packets, thereby obtaining the packet's guidance information; and according to the packet's guidance information, the packet is stored in the queue of the corresponding packet buffer 906; if the queue of the packet buffer 906 is close to full, it is discarded; the switching engine module 902 polls all packet buffer queues, and forwards if the following conditions are met: 1) the port sending buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 904 mainly implements the control of the hard disk, including the initialization, reading and writing of the hard disk; the CPU module 903 is mainly responsible for the protocol processing between the access switch and the terminal (not shown in the figure), the configuration of the address table 905 (including the downstream protocol packet address table, the upstream protocol packet address table, and the data packet address table), and the configuration of the disk array module 904.

[0194] Access switch:

[0195] Fig.10 FIG. 1 is a schematic diagram of the hardware structure of an access switch shown in an embodiment of the present application. Fig.10As shown, it mainly includes a network interface module (a downlink network interface module 1001, an uplink network interface module 1002), a switching engine module 1003 and a CPU module 1004;

[0196] Among them, the packet (uplink data) coming from the downlink network interface module 1001 enters the packet detection module 1005; the packet detection module 1005 detects whether the destination address (DA), source address (SA), data packet type and packet length of the packet meet the requirements. If they meet the requirements, the corresponding stream identifier (stream-id) is allocated and enters the switching engine module 1003, otherwise it is discarded; the packet (downlink data) coming from the uplink network interface module 1002 enters the switching engine module 1003; the data packet coming from the CPU module 1004 enters the switching engine module 1003; the switching engine module 1003 processes the incoming The packet performs an operation of looking up the address table 1006 to obtain the packet's guidance information; if the packet entering the switching engine module 1003 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 1007 in combination with the stream identifier (stream-id); if the queue of the packet buffer 1007 is nearly full, it is discarded; if the packet entering the switching engine module 1003 is not from the downstream network interface to the upstream network interface, then according to the packet's guidance information, the data packet is stored in the queue of the corresponding packet buffer 1007; if the queue of the packet buffer 1007 is nearly full, it is discarded.

[0197] The switching engine module 1003 polls all packet buffer queues. In the embodiment of the present invention, there are two situations:

[0198] If the queue is from the downlink network interface to the uplink network interface, it is forwarded if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero; 3) a token generated by the bit rate control module is obtained;

[0199] If the queue is not going from the downstream network interface to the upstream network interface, it is forwarded if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

[0200] The code rate control module 1008 is configured by the CPU module 1004 to generate tokens for all packet buffer queues from the downstream network interface to the upstream network interface within a programmable interval to control the code rate of the upstream forwarding.

[0201] The CPU module 1004 is mainly responsible for protocol processing with the node server, configuration of the address table 1006 , and configuration of the bit rate control module 1008 .

[0202] Ethernet protocol conversion gateway :

[0203] Fig.11 FIG. 1 is a schematic diagram of the hardware structure of an Ethernet protocol conversion gateway shown in an embodiment of the present application. Fig.11 As shown, it mainly includes a network interface module (a downlink network interface module 1101, an uplink network interface module 1102), a switching engine module 1103, a CPU module 1104, a packet detection module 1105, a bit rate control module 1108, an address table 1106, a packet buffer 1107 and a MAC adding module 1109, and a MAC deleting module 1110.

[0204] The data packet from the downlink network interface module 1101 enters the packet detection module 1105; the packet detection module 1105 detects whether the Ethernet MAC DA, Ethernet MAC SA, Ethernet length or frame type, visual network destination address DA, visual network source address SA, visual network data packet type and packet length of the data packet meet the requirements, and if they meet the requirements, the corresponding stream identifier (stream-id) is assigned; then, the MAC deletion module 1110 subtracts the MAC DA, MAC SA, length or frame type (2 bytes) and enters the corresponding receiving buffer, otherwise it is discarded;

[0205] The downstream network interface module 1101 detects the sending buffer of the port. If there is a packet, it obtains the Ethernet MAC DA of the corresponding terminal based on the visual network destination address DA of the packet, adds the Ethernet MAC DA of the terminal, the MACSA of the Ethernet protocol conversion gateway, and the Ethernet length or frame type, and sends it.

[0206] The functions of other modules in the Ethernet protocol conversion gateway are similar to those of the access switch.

[0207] terminal:

[0208] It mainly includes network interface module, business processing module and CPU module; for example, the set-top box mainly includes network interface module, audio and video encoding and decoding engine module, CPU module; the encoding board mainly includes network interface module, audio and video encoding engine module, CPU module; the memory mainly includes network interface module, CPU module and disk array module.

[0209] 1.3 The equipment in the metropolitan area network can be divided into two categories: node server, node switch, and metropolitan area server. Among them, the node switch mainly includes network interface module, switching engine module and CPU module; the metropolitan area server mainly includes network interface module, switching engine module and CPU module.

[0210] 2. Definition of Visual Network Data Packet

[0211] 2.1 Access Network Data Packet Definition

[0212] The data packet of the access network mainly includes the following parts: destination address (DA), source address (SA), reserved bytes, payload (PDU), and CRC.

[0213] As shown in the following table, the data packet of the access network mainly includes the following parts:

[0214] DA SA Reserved Payload CRC

[0215] in:

[0216] The destination address (DA) consists of 8 bytes. The first byte indicates the type of data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), with a maximum of 256 possibilities. The second to sixth bytes are the metropolitan area network address, and the seventh and eighth bytes are the access network address.

[0217] The source address (SA) is also composed of 8 bytes and has the same definition as the destination address (DA).

[0218] The reserved bytes consist of 2 bytes;

[0219] The payload part has different lengths depending on the type of datagram. If it is a protocol packet, it is 64 bytes. If it is a single multicast data packet, it is 32+1024=1056 bytes. Of course, it is not limited to the above two types.

[0220] CRC consists of 4 bytes and its calculation method follows the standard Ethernet CRC algorithm.

[0221] 2.2 Definition of Metropolitan Area Network Data Packet

[0222] The topology of the metropolitan area network is a graph. There may be two or more connections between two devices, that is, there may be more than two connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metropolitan area network address of a metropolitan area network device is unique. In order to accurately describe the connection relationship between metropolitan area network devices, a parameter: a label is introduced in the embodiment of the present invention to uniquely describe a metropolitan area network device.

[0223] The definition of labels in this manual is similar to the definition of labels in MPLS (Multi-Protocol Label Switch). Assuming that there are two connections between device A and device B, there are two labels for the data packet from device A to device B, and there are two labels for the data packet from device B to device A. Labels are divided into input labels and output labels. Assuming that the label of the data packet entering device A (input label) is 0x0000, the label of the data packet when leaving device A (output label) may become 0x0001. The access process of the metropolitan area network is a centralized access process, which means that the address allocation and label allocation of the metropolitan area network are dominated by the metropolitan area server, and the node switch and node server are only passively executed. This is different from the label allocation of MPLS, which is the result of mutual negotiation between the switch and the server.

[0224] As shown in the following table, the data packets of the metropolitan area network mainly include the following parts:

[0225] DA SA Reserved Label Payload CRC

[0226] That is, destination address (DA), source address (SA), reserved byte (Reserved), label, payload (PDU), CRC. The label format can refer to the following definition: the label is 32 bits, of which the upper 16 bits are reserved and only the lower 16 bits are used. It is located between the reserved bytes and payload of the data packet.

[0227] Based on the above characteristics of the visual network, one of the core concepts of the embodiment of the present invention is proposed. When the visual network control terminal needs to control the visual network controlled terminal, it displays its own display interface as the display interface of the visual network controlled terminal; then receives the control instruction for the visual network controlled terminal sent by the remote control; then sends the control instruction to the visual network controlled terminal through the visual network, so that the visual network controlled terminal responds to the control instruction. This method can achieve end-to-end control without installing any control software on the visual network control terminal and / or the visual network controlled terminal, which improves the convenience of using the visual network terminal and enhances the user experience.

[0228] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0229] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0230] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0231] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0232] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0233] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0234] The terminal control method, device, electronic device and storage medium provided in the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A terminal control method, It is characterized in that Applied to a visual networking control terminal, the method comprises: Displaying its own display interface as the display interface of the visual network controlled terminal; receiving a control instruction for the visual network controlled terminal sent by a remote controller, wherein the control instruction is generated by a user operating the remote controller on the display interface of the visual network control terminal; Sending the control instruction to the visual network controlled terminal through the visual network so that the visual network controlled terminal responds to the control instruction; The visual network control terminal is provided with an Android layer program and a bottom layer program, wherein the Android layer program is used to monitor the control instructions of the remote controller, and the bottom layer program is used to send the control instructions of the remote controller to the outside; Receiving a control instruction sent by a remote controller for the controlled terminal of the visual network includes: Receiving control instructions for the visual network controlled terminal sent by the remote controller through the Android layer program; Sending the control instruction to the controlled terminal of the visual network through the visual network includes: The control instruction is obtained from the Android layer program through the bottom layer program, and the control instruction is sent to the controlled terminal of the visual network according to the visual network transparent transmission protocol.

2. The method according to claim 1, It is characterized in that Before displaying its own display interface as the display interface of the visual network controlled terminal, the method further includes: Sending a control invitation to the controlled terminal of the visual network; When the visual network controlled terminal agrees to the control invitation, obtaining a display video stream of a display interface of the visual network controlled terminal; Displaying its own display interface as the display interface of the visual network controlled terminal includes: According to the display video stream, its own display interface is displayed as the display interface of the controlled terminal in the visual network.

3. The method according to claim 1, It is characterized in that The number of the visual network controlled terminals is multiple; displaying the own display interface as the current display interface of the visual network controlled terminal includes: Displaying its own display interface as the current display interface of the plurality of visual network controlled terminals; Receiving a control instruction sent by a remote controller for the controlled terminal of the visual network includes: Receiving control instructions sent by the remote controller for some or all of the visual network control terminals among the plurality of visual network controlled terminals; The control instruction is sent to the visual network controlled terminal through the visual network so that the visual network controlled terminal responds to the control instruction, including: The control instruction is sent to some or all of the visual network control terminals among the multiple visual network controlled terminals through the visual network, so that some or all of the visual network control terminals respond to the control instruction.

4. The method according to claim 1, It is characterized in that Before receiving the control instruction sent by the remote controller for the controlled terminal in the visual network, the method further includes: Shield the visual network control terminal from responding to the control instructions sent by the remote control.

5. A terminal control method, It is characterized in that Applied to a controlled terminal in a visual network, the method comprises: Receive control invitation sent by visual network control terminal; When agreeing to the control invitation, sending a display video stream of its own current display interface to the visual network control terminal, so that the visual network control terminal displays the current display interface of the visual network controlled terminal according to the display video stream; Receiving a control instruction sent by the visual network control terminal through the visual network, wherein the control instruction is generated by a user operating a display interface of the visual network control terminal through a remote controller; responding to the control instruction; The visual network controlled terminal is provided with a bottom layer program, an Android layer program and an H5 program; Receiving a control instruction sent by the visual network control terminal via the visual network, comprising: Receiving, through the underlying program, a control instruction sent by the visual network control terminal through the visual network; Responding to the control instruction includes: When the operating interface is an Android interface, the control instruction is processed by the Android layer program; When the operating interface itself is an H5 interface, the control instruction is processed by the H5 program.

6. The method according to claim 5, It is characterized in that Before receiving the control instruction sent by the visual network control terminal through the visual network, the method further includes: Shield the visual network controlled terminal from responding to the control command sent by the remote control.

7. A terminal control device, It is characterized in that Applied to a visual networking control terminal, the device comprises: A display module, used to display its own display interface as the display interface of the controlled terminal in the visual network; A first receiving module, configured to receive a control instruction for the visual network controlled terminal sent by a remote controller, wherein the control instruction is generated by a user operating the remote controller on a display interface of the visual network control terminal; A first sending module, used to send the control instruction to the visual network controlled terminal through the visual network, so that the visual network controlled terminal responds to the control instruction; The visual network control terminal is provided with an Android layer program and a bottom layer program, wherein the Android layer program is used to monitor the control instructions of the remote controller, and the bottom layer program is used to send the control instructions of the remote controller to the outside; the first receiving module includes: A first receiving submodule, used for receiving a control instruction for the visual network controlled terminal sent by the remote controller through the Android layer program; The first sending module includes: The first sending submodule is used to obtain the control instruction from the Android layer program through the bottom layer program, and send the control instruction to the controlled terminal of the visual network according to the visual network transparent transmission protocol.

8. A terminal control device, It is characterized in that Applied to a controlled terminal in a visual network, the device comprises: The second receiving module is used to receive a control invitation sent by the visual network control terminal; A third sending module is used to send a display video stream of its current display interface to the visual network control terminal when agreeing to the control invitation, so that the visual network control terminal displays the current display interface of the visual network controlled terminal according to the display video stream; A third receiving module is used to receive a control instruction sent by the visual network control terminal through the visual network, wherein the control instruction is generated by a user operating on a display interface of the visual network control terminal through a remote control; A response module, used for responding to the control instruction; The visual network controlled terminal is provided with a bottom layer program, an Android layer program and an H5 program; the third receiving module includes: A third receiving submodule, used for receiving, through the underlying program, a control instruction sent by the visual network control terminal through the visual network; The response module comprises: A first processing submodule, for processing the control instruction through the Android layer program when its own operation interface is an Android interface; The second processing submodule is used to process the control instruction through the H5 program when its own operation interface is the H5 interface.

9. A computer-readable storage medium having a computer program stored thereon, It is characterized in that When the program is executed by a processor, the steps in the terminal control method as described in any one of claims 1 to 4 or claims 5 to 6 are implemented.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, It is characterized in that When executed, the processor implements the steps in the terminal control method as described in any one of claims 1-4, or claims 5-6.