Equipment remote control method and device

Abstract

The invention provides an equipment remote control method and device, and the method can analyze a starting instruction and configuration information issued by a client, enables a controller of an equipment end to obtain an authentication credential from the client, configures a server based on the authentication credential to complete the initialization of the server, and enables the server to be initialized after the connection between the controller and the client is completed. And the controller can control the equipment side based on the instruction sent by the client side. According to the scheme provided by the invention, the dependence on the manual operation of the user is less, the user does not need to manually configure related service information, the remote operation function operation of the equipment is simplified, the invalid or wrong operation is effectively reduced, the setting of the server is more flexible, the adjustment can be carried out according to the actual demand or environment change, and the user experience is improved. Therefore, the adaptability, compatibility and expansibility of the system are improved, and the user experience is improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of remote device control, and in particular relates to a device remote control method and device. Background Art

[0002] Traditional device remote control systems are generally fixed settings. Such systems require users to input and maintain server addresses, authentication credentials and other configuration information. Users are often required to perform cumbersome steps when establishing a connection between the device and the client, and are highly dependent on user operations, resulting in less intuitive and efficient operations.

[0003] Moreover, since users of traditional remote control systems need to manually configure server information, they are required to perform manual configuration every time they use the system. The process is complicated and prone to errors, which increases the difficulty of operation and the maintenance cost.

[0004] In addition, the server settings of the existing system have poor compatibility and cannot adapt to actual needs or environmental changes, resulting in poor performance of the system when dealing with changing application scenarios. There are certain limitations in actual applications, which greatly affects the user experience. Summary of the invention

[0005] In order to overcome the defects of the prior art, the present invention proposes a device remote control method, the method comprising:

[0006] The controller of the device side obtains the authentication credentials from the client by parsing the startup instruction and configuration information sent by the client;

[0007] Configuring the server based on the authentication credentials to complete initialization of the server;

[0008] In response to the connection instruction of the client, the controller is connected to the client, so that after the connection between the controller and the client is completed, the controller can control the device end based on the instruction sent by the client.

[0009] Specifically, the controller predefines a remote control interface based on the native application component of the device, and the start instruction is generated by the remote control interface.

[0010] Furthermore, the “configuring the server based on the authentication credentials to complete initialization of the server” includes:

[0011] The controller is connected to the server through the authentication credentials, and the remote control interface initializes a communication channel with the Flutter layer, so as to complete the initialization of the server based on the Flutter layer and the native application component of the device.

[0012] Preferably, the “enabling the controller to control the device based on the instruction sent by the client” includes:

[0013] In response to the custom instruction, providing a user with a remote control interface with custom settings for controlling the device end on the client;

[0014] In response to the message from the client, the controller controls the device accordingly based on the events monitored by the remote control interface.

[0015] Specifically, the method further includes:

[0016] After the controller obtains the message, determining the format and name of the message;

[0017] If the format of the message is a preset format and the name is a chat server message, the text information in the preset format is parsed to determine the event corresponding to the text information through the controller.

[0018] Furthermore, the remote control interface includes a button, a slider and / or a text input unit, and the method further includes:

[0019] Determine, by the controller, a corresponding event monitored by the remote control interface;

[0020] If the corresponding event monitored by the remote control interface is the corresponding WEB interface key information, the event is converted into a key input event, and the key input event is sent to the underlying system of the device end through a predefined key sending interface, thereby realizing the key function on the client end;

[0021] If the corresponding event monitored by the remote control interface is keyboard key information, the event is converted into a text input event, and the text input event is filled into the underlying system of the device end through a predefined text sending interface, thereby realizing the simulated text input function on the client end.

[0022] Preferably, the method further comprises:

[0023] When the controller currently has a connection with a client, if the controller receives a connection instruction from another client, the controller intercepts the connection between the other client and the controller.

[0024] Specifically, when the controller responds to the start instruction, the remote control program is caused to run on the device end, and the method further includes:

[0025] The connection status between the controller and the client is detected, so that when it is detected that the controller is not connected to the client for more than a preset time, the device end exits the remote control program.

[0026] Optionally, the device end includes a set-top box.

[0027] The present invention also proposes a device for remotely controlling equipment, the device comprising:

[0028] A parsing module, used to enable the controller at the device end to obtain authentication credentials from the client by parsing the startup instruction and configuration information sent by the client;

[0029] A configuration module, configured to configure the server based on the authentication credentials to complete initialization of the server;

[0030] The connection module is used to connect the controller to the client in response to the connection instruction of the client, so that after the connection between the controller and the client is completed, the controller can control the device end based on the instruction sent by the client.

[0031] The present invention has at least the following beneficial effects:

[0032] The solution proposed by the present invention can complete the initialization of the server by configuring the server information on the client platform and parsing the issued startup instruction. After initialization, the client can initiate a connection instruction to control the device through the controller, omitting the step of the user manually configuring the server information, thereby solving the problem of too many operations caused by the remote controller for devices in different environments. Even in different environments, when remote control is enabled, it only needs to initiate a connection, and clients in different platform environments can quickly trigger the connection with the device to perform remote control through the remote controller.

[0033] Furthermore, the solution proposed in the present invention simplifies user operations and ensures the consistency of instructions. The Flutter layer and native application components are used for server initialization, making the system more compatible and flexibly handling the communication requirements of different platforms, allowing users to achieve personalized control through custom settings and remote control interfaces. Multiple input methods make the remote control function more comprehensive, improve the accuracy and diversity of control, and improve the accuracy and flexibility of instruction processing. At the same time, the identification of different types of instructions helps to better parse and execute specific events, increasing the flexibility of the system and user experience.

[0034] In addition, this solution adopts a loop detection mechanism in the client connection mechanism, which realizes effective connection by reading client information and intercepts excessive client connections. It also allows the client to send specific configuration information or control commands according to actual needs, thereby supporting customized connections.

[0035] Thus, the present invention provides a method and apparatus for remote control of a device. The solution proposed in the present invention is less dependent on manual operation of the user and does not require the user to manually configure relevant service information. The remote operation function of the device is simplified and invalid or erroneous operations are effectively reduced. At the same time, the server setting is more flexible and can be adjusted according to actual needs or environmental changes, thereby improving the adaptability, compatibility and scalability of the system and enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0037] Figure 1 A schematic diagram of a method flow of a device remote control method provided in Example 1;

[0038] Figure 2 This is a flowchart of an example of a device remote control method provided in Example 1;

[0039] Figure 3 A flow chart of a method for controlling a device end;

[0040] Figure 4 This is a schematic diagram of the module structure of the equipment remote control device provided in Example 2.

[0041] Reference numerals

[0042] 10-analysis module; 20-configuration module; 30-connection module; 31-setting unit; 32-control unit; 40-detection module. DETAILED DESCRIPTION

[0043] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0044] Hereinafter, various embodiments of the present invention will be described more fully. The present invention may have various embodiments, and adjustments and changes may be made therein. However, it should be understood that there is no intention to limit the various embodiments of the present invention to the specific embodiments disclosed herein, but the present invention should be understood to cover all adjustments, equivalents and / or alternatives falling within the spirit and scope of the various embodiments of the present invention.

[0045] Hereinafter, the term "include" or "may include" used in various embodiments of the present invention indicates the presence of disclosed functions, operations or elements, and does not limit the addition of one or more functions, operations or elements. In addition, as used in various embodiments of the present invention, the terms "include", "have" and their cognates are intended only to indicate specific features, numbers, steps, operations, elements, components or combinations of the foregoing items, and should not be understood as first excluding the presence of one or more other features, numbers, steps, operations, elements, components or combinations of the foregoing items or the possibility of adding one or more features, numbers, steps, operations, elements, components or combinations of the foregoing items.

[0046] In various embodiments of the present invention, the expression "or" or "at least one of A or / and B" includes any combination or all combinations of the words listed at the same time. For example, the expression "A or B" or "at least one of A or / and B" may include A, may include B, or may include both A and B.

[0047] The expressions (such as "first", "second", etc.) used in various embodiments of the present invention may modify the various constituent elements in various embodiments, but may not limit the corresponding constituent elements. For example, the above expressions do not limit the order and / or importance of the elements. The above expressions are only used for the purpose of distinguishing an element from other elements. For example, the first user device and the second user device indicate different user devices, although both are user devices. For example, without departing from the scope of various embodiments of the present invention, the first element may be referred to as the second element, and similarly, the second element may also be referred to as the first element.

[0048] It should be noted that in the present invention, unless otherwise clearly specified and defined, the terms such as "installation", "connection", "fixation" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium; it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0049] In the present invention, those skilled in the art need to understand that the terms indicating orientation or positional relationship herein are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present invention.

[0050] The terms used in various embodiments of the present invention are only used for the purpose of describing specific embodiments and are not intended to limit various embodiments of the present invention. As used herein, the singular form is intended to also include the plural form, unless the context clearly indicates otherwise. Unless otherwise limited, all terms used here (including technical terms and scientific terms) have the same meaning as the meaning generally understood by those of ordinary skill in the art to which the various embodiments of the present invention belong. The terms (such as the terms defined in the dictionary generally used) will be interpreted as having the same meaning as the contextual meaning in the relevant technical field and will not be interpreted as having an idealized meaning or an overly formal meaning, unless clearly defined in various embodiments of the present invention.

[0051] Example 1

[0052] This embodiment provides a device remote control method, the method comprising:

[0053] S100: The controller at the device end parses the startup instruction and configuration information sent by the client to obtain the authentication credentials from the client.

[0054] Specifically, the controller predefines a remote control interface RemoteActivity based on the native application component of the device. In this embodiment, the startup entry is set in the remote control interface, that is, the remote control interface is used to generate the startup instruction in step S100 based on the user's operation. Exemplarily, when the controller is an Android device, the remote control interface may include a RemoteActivity predefined based on the native Activity mode of the Android device, and RemoteActivity is inherited from Activity;

[0055] It should be noted that Activity is an application component used to provide a user interface (UI). The Activity class is one of the basic building blocks of Android applications and is responsible for managing the interaction between users and applications. In object-oriented programming, inheritance is a mechanism that allows a subclass to inherit properties and methods from a parent class. A subclass can inherit all non-private members of the parent class and can extend or modify these members.

[0056] It should also be noted that the device side may include but is not limited to smart home devices such as set-top boxes, industrial control equipment such as assembly lines, and network devices such as switches. The method proposed in this embodiment shows an integration method using an Android system plug-in method. In another embodiment, an interface integration method can also be used to integrate into the internal application of the device side to implement the method proposed in this embodiment.

[0057] In this embodiment, the authentication credentials include a server address serverUrl and a key serverKey. serverUrl points to the address of a remote server with which the remote control interface needs to communicate. When the remote control interface receives a startup instruction, it uses serverUrl to establish a connection with the remote server. Through serverUrl, the remote control interface can access services or resources on the server.

[0058] serverKey is a string used for authentication or authorization. It can verify the identity of the client and ensure that only authorized clients can access the services provided by the server, thereby ensuring the legality of the communication between the remote control interface and the server.

[0059] When RemoteActivity is started, the remote control interface receives a startup intent (startup Intent) containing serverUrl and serverKey from the client, and parses these parameters to obtain serverUrl and serverKey. As a result, the controller can use serverUrl to connect to the remote server and authenticate through serverKey, ensuring that the communication between the controller and the server is secure and authorized.

[0060] S200: Configuring the server based on the authentication credentials to complete initialization of the server.

[0061] Furthermore, when RemoteActivity is started, the remote control interface will also initialize the communication channel with the Flutter layer, thereby combining Flutter with the native application layer, preparing the running environment for the Flutter application, and providing an interface between the Flutter layer and the Android native layer, so that the Flutter layer can control the underlying system and perform actual remote control operations. The communication channel with the Flutter layer enables the function calls of the Flutter layer and the native application layer to be carried out seamlessly, thereby realizing remote control between the client and the device.

[0062] It should be noted that Flutter is an open source UI software development kit developed by Google for building cross-platform applications. It can help developers use the same code base to create applications that run on multiple platforms such as iOS, Android, Web, and desktop. For example, the Flutter communication channel can define the interface as follows:

[0063] get_config interface: used to provide the Flutter layer with the underlying service configuration information serverUrl and serverKey;

[0064] init_service interface: used to provide the Flutter layer with remote control preparatory services. Preparatory services may include but are not limited to audio services and video recording services.

[0065] start_capture interface: used to start recording video in the Flutter layer and upload it to the remote server;

[0066] stop_service interface: used to shut down the remote control service at the Flutter layer, including the preparatory service started by the init_service interface;

[0067] send_broadcast interface: used to receive information after the Flutter layer sends the initialization successfully, and report it to the client;

[0068] send_key interface: used to trigger key events through the native sendKeyDownUpSync method, that is, to send key events to the underlying system through the Flutter layer, and then implement key functions on the client;

[0069] send_input interface: fills data into the input box through the native sendStringSync method, that is, passes the input data to the underlying system through the Flutter layer, and then implements the simulated keyboard input function on the client;

[0070] moveTaskToBack interface: used to execute the native moveTaskToBack method, switch the program to the background, and keep the remote control program in the background standby state;

[0071] exit_app interface: used to call the native Runtime.getRuntime().exit(0) to end the program, ensuring that the remote control program exits when it is not needed.

[0072] Therefore, the method proposed in this embodiment can define the communication channel androidChannel and match it with the underlying channel after initializing the Flutter business layer, define the module remote as a remote service plug-in library for processing communication with the remote service, and call the underlying get_config interface through androidChannel to obtain the configuration information of the remote service. Then, the obtained configuration information is passed to the mainSetOption method of the remote plug-in library to configure the remote service. After the remote service configuration is completed, the init_service interface is called through androidChannel to complete the startup of the remote service.

[0073] It should be noted that the androidChannel channel is used for communication between Flutter and Android native code, which can ensure that the same channel identifier is used in Flutter and Android native code so that messages and data can be delivered correctly; the mainSetOption method is usually used to configure options for remote services or plug-ins. It is used to receive configuration parameters and set related options or properties. Parameters can include the service URL, timeout period, authentication information, etc. Its main function is to ensure that the remote service is correctly configured as needed for normal operation and interaction.

[0074] After the remote service is started, the remote control interface obtains the clientId and password required for remote service authentication, and reports the clientId and password to the client through the androidChannel call send_broadcast interface, and then enables the remote to receive the client's connection instructions through the listening interface setListener.

[0075] In this embodiment, if the initialization of the server fails, the system will automatically retry to ensure that the remote control service can be successfully started in the end.

[0076] S300: In response to a connection instruction from the client, the controller is connected to the client, so that after the connection between the controller and the client is completed, the controller can control the device end based on the instruction sent by the client.

[0077] In this embodiment, the controller defines a timer mechanism for detecting client connections, and sets the parameters of the timer so that when the timer is triggered, the checkClient function is called to detect whether there is a client connection instruction based on a specified time interval. The checkClient function obtains the current connection information and parses the connection information into a json format to generate a connection list. If the number of connections in the current connection list is equal to 0, the controller is allowed to connect to the client that initiated the connection instruction.

[0078] Preferably, the method further comprises:

[0079] When the controller currently has a connection with a client, if the controller receives a connection instruction from another client, the connection between the other client and the controller is intercepted.

[0080] In this embodiment, if the number of connections in the current connection list is equal to 0, the remote authentication process of the client that newly initiates the connection instruction is intercepted. That is, when the controller currently has a connection with a client, the number of connections in the current connection list is 1. If the controller receives a connection instruction from another client at this time, the remote authentication process of the client that initiated the connection instruction will be intercepted.

[0081] Furthermore, the “enabling the controller to control the device based on the instruction sent by the client” in step S300 includes:

[0082] S310: In response to the custom instruction, the client provides a remote control interface with custom settings for controlling the device end for the user.

[0083] Specifically, the remote control interface may include buttons, sliders and / or text input units.

[0084] S320: In response to the message from the client, the controller controls the device accordingly based on the events monitored by the remote control interface.

[0085] Specifically, when the controller currently has a connection with a client, the moveTaskToBack interface is called through androidChannel to switch the control program to the back end and wait for control commands. After the client sends a message, the control end can monitor the message through the monitoring interface setListener and determine the corresponding event monitored by the remote control interface.

[0086] Furthermore, two message type processing methods are defined in this embodiment. If the corresponding event monitored by the remote control interface is the corresponding WEB interface key information, the event is converted into a key input event keyEvent, and the key input event is sent to the underlying system of the device end through the send_key interface, thereby realizing the key function on the client side; if the corresponding event monitored by the remote control interface is keyboard key information, the event is converted into a text input event i nputEvent, and the text input event is filled into the underlying system of the device end through the send_i nput interface, thereby realizing the function of simulating keyboard input text on the client side.

[0087] Preferably, after the controller obtains the message, it will judge the format and name of the message. If the controller determines that the format of the message is json format and the name is a chat server message, it will parse the text information in the json format to determine the event corresponding to the text information through the controller, that is, to achieve the above-mentioned determination of the corresponding event monitored by the remote control interface through the controller.

[0088] It should be noted that in step S100, when the controller responds to the start instruction, the remote control program will be run on the device side. Further, the method also includes:

[0089] S400: Detecting the connection status between the controller and the client, so that when it is detected that the controller is not connected to the client for more than a preset time, the device end exits the remote control program.

[0090] Exemplarily, when the preset interval time is 60 seconds, if the timer mechanism detects that the heartbeat signal sending interval exceeds 60 seconds without any client connection, the androidChannel calls the exit_app interface to exit the remote control program and prepare for the triggering of the next connection instruction.

[0091] Example 2

[0092] This embodiment proposes a device remote control apparatus for implementing the method proposed in embodiment 1, see Figure 4 , the device comprises:

[0093] The parsing module 10 is used to enable the controller of the device end to obtain the authentication credentials from the client by parsing the startup instruction and configuration information sent by the client;

[0094] A configuration module 20, configured to configure the server based on the authentication credentials to complete the initialization of the server;

[0095] The connection module 30 is used to connect the controller to the client in response to the connection instruction of the client, so that after the connection between the controller and the client is completed, the controller can control the device end based on the instruction sent by the client;

[0096] The detection module 40 is used to detect the connection status between the controller and the client, so as to make the device end exit the remote control program when it is detected that the controller is not connected to the client for more than a preset time.

[0097] Specifically, the controller predefines a remote control interface based on the native application component on the device side, and the startup instruction to which the acquisition module 10 responds is generated by the remote control interface; the controller defines a timer mechanism for detecting client connections, and sets the parameters of the timer so that when the timer is triggered, it detects whether there is a client connection instruction based on a specified time interval, generates a connection list by acquiring the current connection information, and when the number of connections in the current connection list is equal to 0, allows the controller to connect to the client that initiated the connection instruction.

[0098] Preferably, when the controller currently has a connection established with a client, if the controller receives a connection instruction from another client, the connection module 30 will intercept the connection between the other client and the controller.

[0099] Further, the connection module 30 includes:

[0100] A setting unit 31, configured to respond to a custom instruction and provide a user with a remote control interface for controlling a device end on a client side with custom settings;

[0101] The control unit 32 is used to respond to the message from the client and control the device side accordingly based on the events monitored by the remote control interface through the controller.

[0102] Specifically, the remote control interface may include buttons, sliders and / or text input units.

[0103] The control unit 32 can judge the corresponding event monitored by the remote control interface through the controller. If the corresponding event monitored by the remote control interface is the corresponding WEB interface key information, the event is converted into a key input event, and the key input event is sent to the underlying system of the device end through a predefined key sending interface, thereby realizing the key function on the client side;

[0104] If the corresponding event monitored by the remote control interface is keyboard key information, the event is converted into a text input event, and the text input event is filled into the underlying system of the device through the predefined text sending interface, thereby realizing the simulated text input function on the client.

[0105] Furthermore, after the controller obtains the message, the control unit 32 can judge the format and name of the message through the controller. If the format of the message is a preset format and the name is a chat server message, the text information in the preset format is parsed to judge the event corresponding to the text information through the controller, that is, to judge the corresponding event monitored by the remote control interface through the controller.

[0106] In summary, the present invention provides a method and apparatus for remote control of a device. The solution proposed in the present invention is less dependent on user manual operations and does not require users to manually configure related service information. It simplifies the remote operation function of the device and effectively reduces invalid or erroneous operations. At the same time, the server settings are more flexible and can be adjusted according to actual needs or environmental changes, thereby improving the adaptability, compatibility and scalability of the system and enhancing the user experience.

[0107] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A device remote control method, characterized in that: The method comprises: The controller of the device side obtains the authentication credentials from the client by parsing the startup instruction and configuration information sent by the client; Configuring the server based on the authentication credentials to complete initialization of the server; In response to the connection instruction of the client, the controller is connected to the client, so that after the connection between the controller and the client is completed, the controller can control the device end based on the instruction sent by the client.

2. The method according to claim 1, characterized in that The controller predefines a remote control interface based on the native application component of the device, and the start instruction is generated by the remote control interface.

3. The method according to claim 2, characterized in that The “configuring the server based on the authentication credentials to complete initialization of the server” includes: The controller is connected to the server through the authentication credentials, and the remote control interface initializes a communication channel with the Flutter layer, so as to complete the initialization of the server based on the Flutter layer and the native application component of the device.

4. The method according to any one of claims 1 to 3, characterized in that: The “enabling the controller to control the device end based on the instruction sent by the client end” includes: In response to the custom instruction, providing a user with a remote control interface with custom settings for controlling the device end on the client; In response to the message from the client, the controller controls the device accordingly based on the events monitored by the remote control interface.

5. The method according to claim 4, characterized in that The method further comprises: After the controller obtains the message, determining the format and name of the message; If the format of the message is a preset format and the name is a chat server message, the text information in the preset format is parsed to determine the event corresponding to the text information through the controller.

6. The method according to claim 4 or 5, characterized in that: The remote control interface includes a button, a slider and / or a text input unit, and the method further includes: Determine, by the controller, a corresponding event monitored by the remote control interface; If the corresponding event monitored by the remote control interface is the corresponding WEB interface key information, the event is converted into a key input event, and the key input event is sent to the underlying system of the device end through a predefined key sending interface, thereby realizing the key function on the client end; If the corresponding event monitored by the remote control interface is keyboard key information, the event is converted into a text input event, and the text input event is filled into the underlying system of the device end through a predefined text sending interface, thereby realizing the simulated text input function on the client side.

7. The method according to claim 1, characterized in that The method further comprises: When the controller currently has a connection with a client, if the controller receives a connection instruction from another client, the controller intercepts the connection between the other client and the controller.

8. The method according to claim 1, characterized in that When the controller responds to the start instruction, the remote control program is caused to run on the device end, and the method further includes: The connection status between the controller and the client is detected, so that when it is detected that the controller is not connected to the client for more than a preset time, the device end exits the remote control program.

9. The method according to claim 1, characterized in that: The device end includes a set-top box.

10. A remote control device for equipment, characterized in that: The device comprises: A parsing module, used to enable the controller at the device end to obtain authentication credentials from the client by parsing the startup instruction and configuration information sent by the client; A configuration module, configured to configure the server based on the authentication credentials to complete initialization of the server; The connection module is used to connect the controller to the client in response to the connection instruction of the client, so that after the connection between the controller and the client is completed, the controller can control the device end based on the instruction sent by the client.

Images