Remote control method and related device, storage medium and computer program product

Abstract

A remote control method and related device, a storage medium and a computer program product, the remote control method comprising: a signal transceiver receives remote control input information from a remote control device, the remote control input information being a signal triggered by a key event on the remote control device, a preset mapping relation exists between the key event and an input event of the virtual input equipment; the signal receiving and transmitting device sends the remote control input information to a using terminal; and the using terminal receives the remote control input information from the signal receiving and transmitting device, responds to the remote control input information, and executes a corresponding input event based on the preset mapping relation. Communication between the remote control equipment and the use terminal is realized through the signal receiving and transmitting device, so that the use terminal can execute the corresponding input event, and a user can remotely control the virtual input equipment on the use terminal conveniently.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of communication, and in particular, to a remote control method and related device, storage medium and computer program product. BACKGROUND

[0002] With the continuous progress of science and technology, more and more use terminals are used by users, for example, personal computers (PCs).

[0003] In order to realize the interaction between the user and the use terminal, it is usually necessary to configure an input device (such as a mouse or a keyboard, etc.) matched with the use terminal, but in special cases, there may be a situation that the input device is damaged or has poor response performance, thereby causing the user to be unable to remotely control the use terminal in the case that there is no available external input device. SUMMARY

[0004] The problem solved by embodiments of the present application is to provide a remote control method and related device, storage medium and computer program product, which facilitate the user to remotely control the virtual input device on the use terminal, thereby being able to alleviate the operation difficulty caused by the user having no available external input device.

[0005] To solve the above problem, embodiments of the present application provide a remote control method of a virtual input device, applied to a signal transceiver device, the remote control method comprising: receiving remote control input information from a remote control device, the remote control input information being a signal triggered by a key event on the remote control device, and the key event and an input event of the virtual input device having a preset mapping relationship; sending the remote control input information to a use terminal, so that the use terminal responds to the remote control input information and performs a corresponding input event based on the preset mapping relationship.

[0006] Correspondingly, embodiments of the present application also provide a remote control method of a virtual input device, applied to a use terminal, the remote control method comprising: receiving remote control input information from a signal transceiver device, the remote control input information being a signal triggered by a key event on the remote control device, and the key event and an input event of the virtual input device having a preset mapping relationship; responding to the remote control input information, and performing a corresponding input event based on the preset mapping relationship.

[0007] Correspondingly, the embodiment of the present application further provides a signal transceiving device, comprising: a signal receiving module, configured to receive remote control input information from a remote control device, wherein the remote control input information is a signal triggered by a key event on the remote control device, and the key event and an input event of the virtual input device have a preset mapping relationship; and a signal sending module, configured to send the remote control input information to a use terminal, so that the use terminal responds to the remote control input information and performs a corresponding input event based on the preset mapping relationship.

[0008] Correspondingly, the embodiment of the present application further provides a use terminal, comprising: a virtual input device control module, configured to receive remote control input information from a signal transceiving device, wherein the remote control input information is a signal triggered by a key event on the remote control device, and the key event and an input event of the virtual input device have a preset mapping relationship; and further configured to respond to the remote control input information and perform a corresponding input event based on the preset mapping relationship.

[0009] Correspondingly, the embodiment of the present application further provides a remote control system of a virtual input device, comprising: a remote control device, configured to send remote control input information, wherein the remote control input information is a signal triggered by a key event on the remote control device, and the key event and an input event of the virtual input device have a preset mapping relationship; a signal transceiving device according to any one of the embodiments of the present application; and a use terminal according to any one of the embodiments of the present application.

[0010] Correspondingly, the embodiment of the present application further provides a storage medium, which stores one or more computer instructions, and the one or more computer instructions are used to implement the remote control method of the virtual input device according to any one of the embodiments of the present application.

[0011] Correspondingly, the embodiment of the present application further provides a computer program product, comprising computer instructions, and the computer instructions are used to implement the remote control method of the virtual input device according to any one of the embodiments of the present application when executed by a processor.

[0012] Compared with the prior art, the technical scheme of the embodiment of the present application has the following advantages:

[0013] The remote control method of the virtual input device provided by the embodiment of the present application, the signal transceiver device receives the remote control input information sent by the remote control device, the remote control input information is the signal triggered by the key event on the remote control device, and the key event and the input event of the virtual input device have a preset mapping relationship, and the signal transceiver device also sends the remote control input information to the use terminal, therefore, through the signal transceiver device, the communication between the remote control device and the use terminal can be realized, so that the use terminal responds to the remote control input information and executes the corresponding input event based on the preset mapping relationship, thereby facilitating the user to remotely control the virtual input device on the use terminal by using the remote control device, and further relieving the operation difficulty caused by the user having no available external input device.

[0014] The remote control method of the virtual input device provided by the embodiment of the present application, the signal transceiver device receives the remote control input information sent by the remote control device, the remote control input information is the signal triggered by the key event on the remote control device, and the key event and the input event of the virtual input device have a preset mapping relationship, and the signal transceiver device also sends the remote control input information to the use terminal, therefore, through the signal transceiver device, the communication between the remote control device and the use terminal can be realized, so that the use terminal responds to the remote control input information and executes the corresponding input event based on the preset mapping relationship, thereby facilitating the user to remotely control the virtual input device on the use terminal by using the remote control device, and further relieving the operation difficulty caused by the user having no available external input device. BRIEF DESCRIPTION OF DRAWINGS

[0015] Figure 1 is a flowchart of an embodiment of the remote control method of the virtual input device applied to the signal transceiver device of the present application;

[0016] Figure 2 is a flowchart of an embodiment of the remote control method of the virtual input device applied to the use terminal of the present application;

[0017] Figure 3 is a schematic diagram of the framework structure of an embodiment of the signal transceiver device of the present application;

[0018] Figure 4 is a schematic diagram of the framework structure of an embodiment of the use terminal of the present application;

[0019] Figure 5 is a schematic diagram of the connection relationship between the remote control device, the signal transceiver device and the use terminal provided by an embodiment of the present application. DETAILED DESCRIPTION

[0020] As known from the background, when there is a damaged input device or poor response performance, the user cannot provide an available input device, resulting in that the user cannot remotely control the use terminal.

[0021] To solve the technical problem, the embodiment of the present application provides a remote control method of a virtual input device, which is applied to a signal transceiving device, and the remote control method comprises the following steps: receiving remote control input information from a remote control device, the remote control input information being generated by the remote control device in response to a remote control operation of a user, and the remote control operation and an input event of the virtual input device having a preset mapping relationship; and sending the remote control input information to a use terminal, so that the use terminal performs a corresponding input event in response to the remote control input information and based on the preset mapping relationship.

[0022] The embodiment of the present application also provides a remote control method of a virtual input device, which is applied to a use terminal, and the remote control method comprises the following steps: receiving remote control input information from a signal transceiving device, the remote control input information being generated by a remote control device in response to a remote control operation of a user, and the remote control operation and an input event of the virtual input device having a preset mapping relationship; and performing a corresponding input event in response to the remote control input information and based on the preset mapping relationship.

[0023] Therefore, the remote control device and the use terminal communicate through the signal transceiving device, the user performs a remote control operation on the remote control device, the remote control device generates a key event to trigger remote control input information, the signal transceiving device receives the remote control input information sent by the remote control device, and sends the remote control input information to the use terminal, and the use terminal can perform a corresponding input event in response to the remote control input information and based on the preset mapping relationship, so that the user can remotely control the virtual input device on the use terminal, and the operation difficulty caused by the fact that the user does not have an available external input device can be relieved.

[0024] In order to make the above object, characteristics and advantages of the present application more obvious and easy to understand, the specific embodiments of the present application will be described in detail below with reference to the drawings.

[0025] Reference Figure 1 , Figure 1 is a flowchart of an embodiment of a remote control method of a virtual input device applied to a signal transceiving device.

[0026] Reference Figure 5 , Figure 5 is a schematic diagram of a connection relationship among a remote control device, a signal transceiving device and a use terminal according to an embodiment of the present application, and step S101 is performed, the signal transceiving device 200 receives remote control input information from the remote control device 100, the remote control input information being a signal triggered by a key event on the remote control device 100, and the key event and an input event of the virtual input device 320 having a preset mapping relationship.

[0027] The remote control method described in this embodiment is executed on the side of the signal transceiving device 200, which has the functions of receiving information and sending information, so the signal transceiving device 200 can enable the communication between the using terminal 300 and the external remote control device 100.

[0028] It should be noted that the remote control input information is transceived by the signal transceiving device 200, thereby reducing the requirement for the adaptation of the remote control device 100 and the using terminal 300, and further facilitating the reduction of the modification of the remote control device 100 and the using terminal 300.

[0029] In addition, the remote control input information is transceived by the signal transceiving device 200, so that the signal transceiving device 200 can meet the requirement for the specific information processing (for example, encryption processing, etc.) of the remote control input information, thereby also facilitating the reduction of the modification of the remote control device 100 and the using terminal 300.

[0030] In this embodiment, the virtual input device 320 includes a virtual mouse or a virtual keyboard, the virtual keyboard can realize the input of characters or the movement of a cursor, etc., and the virtual mouse can realize the movement or clicking of a cursor, etc., so that the human-computer interaction between the user and the using terminal 300 can be realized through the remote control device 100.

[0031] In this embodiment, the signal transceiving device 200 includes a set top box (STB).

[0032] The set top box is a common electronic device and is widely used, so the set top box is used as the signal transceiving device 200, and the user does not need to additionally purchase other signal transceiving devices to realize the remote control method, thereby facilitating the convenience of the remote control method.

[0033] The remote control device 100 can include a remote controller or a remote control handle.

[0034] The remote controller usually has physical function keys such as direction keys, number keys, confirmation keys, return keys, and volume keys, so that the remote control of the virtual input device 320 can be realized according to the remote control operation of the user on the remote controller.

[0035] The remote control handle usually has physical function keys such as direction keys and joysticks, so that the remote control of the virtual input device 320 can also be realized according to the remote control operation of the user on the remote control handle.

[0036] It should be noted that in the case where the virtual input device 320 is a virtual keyboard, the input event can include the input operation of the virtual key corresponding to the key event in the virtual keyboard; in the case where the virtual input device 320 is a virtual mouse, the input event includes the movement of a virtual cursor or the clicking of a virtual cursor.

[0037] It should be noted that the key event includes, but is not limited to, single triggering of a single key for less than a first preset time length, single triggering of a single key for more than a second preset time length, multiple continuous triggering of a single key within a first preset time interval, or combined triggering of multiple keys within a second preset time interval.

[0038] For example, the remote controller usually has number keys, and thus the user can trigger the number keys of the remote controller individually, so that the corresponding virtual number keys in the virtual keyboard are triggered and the corresponding number characters are input into the terminal 300.

[0039] For another example, since the number of keys of the virtual keyboard is usually large, the single triggering of a single key, the multiple continuous triggering of a single key, and the combined triggering of multiple keys can be associated with the virtual keys on the virtual keyboard, so that the key event and the input event of the virtual input device 320 have a preset mapping relationship.

[0040] It can be understood that the key event is configured according to the actual configuration requirement of the preset mapping relationship between the key event and the input event of the virtual input device 320.

[0041] In this embodiment, the remote control device 100 is a remote controller. The remote controller is a common household appliance accessory and is widely used in homes, and thus using the remote controller as the remote control device 100 is conducive to reducing the convenience of the remote control method.

[0042] In this embodiment, the terminal 300 includes a personal computer.

[0043] The personal computer is a common electronic device, and the popularity of the personal computer has reached a relatively high level. For example, at least one personal computer is configured in many families to meet the needs of work, study, entertainment, and the like.

[0044] It should be noted that the personal computer is usually equipped with an external input device such as a keyboard or a mouse, but when the input device such as the keyboard or the mouse is damaged or has poor response performance, the user cannot implement remote control on the personal computer. Therefore, by using the remote control method described in this embodiment, the remote control device 100 can be used to implement remote control on the virtual input device 320 in the personal computer, so as to alleviate the operation difficulty caused by the fact that the user does not have a usable external input device.

[0045] In this embodiment, when the signal transceiver 200 and the remote control device 100 establish a communication connection, the signal transceiver 200 receives the remote control input information from the remote control device 100.

[0046] When the signal transceiving device 200 and the remote control device 100 establish a communication connection, the remote control function of the remote control device 100 is activated, and the signal transceiving device 200 can receive remote control input information from the remote control device 100 in response to an activation instruction of the information transceiving function.

[0047] Specifically, the signal transceiving device 200 and the remote control device 100 can establish a communication connection through Bluetooth, infrared, or a wired connection interface (for example, a USB interface).

[0048] If the signal transceiving device 200 and the remote control device 100 establish a communication connection through Bluetooth or infrared, wireless communication can be achieved between the two, thereby reducing the requirement for the spatial position of the remote control device 100 and improving the user experience.

[0049] If the signal transceiving device 200 and the remote control device 100 establish a connection through a wired connection interface, the requirement for the configuration of the remote control device 100 can be reduced.

[0050] With reference to Figure 1 , and with reference to Figure 5 , a step S102 is performed, in which the signal transceiving device 200 sends the remote control input information to the use terminal 300, so that the use terminal 300 performs a corresponding input event in response to the remote control input information and based on the preset mapping relationship.

[0051] Since the key event and the input event of the virtual input device 320 have a preset mapping relationship, after the signal transceiving device 200 sends the remote control input information to the use terminal 300, the use terminal 300 can perform a corresponding input event based on the preset mapping relationship.

[0052] Therefore, the signal transceiving device 200 can realize communication between the remote control device 100 and the use terminal 300, so that the use terminal 300 can perform a corresponding input event based on a preset mapping relationship after receiving remote control input information, thereby facilitating the user to remotely control the virtual input device 320 on the use terminal 300, and thereby alleviating the operation difficulty caused by the user having no available external input device.

[0053] In the embodiment, when the signal transceiving device 200 and the use terminal 300 establish a network connection, the signal transceiving device 200 sends the remote control input information to the use terminal 300.

[0054] Specifically, the signal transceiving device and the use terminal establish a network connection through a network socket (SOCKET).

[0055] The network socket has good migration ability for different operating systems, so the network socket can run on different operating systems without or with only a small number of changes, so that the remote control method can be applied to signal transceiver devices 200 and use terminals 300 of various operating systems.

[0056] As shown in Figure 5 In this embodiment, the signal transceiver device 200 includes a rich execution environment (REE), and a first client application (CA) 210 is configured in the rich execution environment, and the first client application 210 is used to run in the rich execution environment.

[0057] Correspondingly, the signal transceiver device 200 receives the remote control input information from the remote control device 100, including: using the first client application 210 running in the rich execution environment to receive the remote control input information from the remote control device.

[0058] The signal transceiver device 200 sends the remote control input information to the use terminal 300, including: using the first client application 210 to send the remote control input information to the use terminal 300.

[0059] The rich execution environment is a general environment of the operating system (OS) runtime, generally refers to Linux, Android and other operating systems.

[0060] The rich execution environment can execute various application programs and services. By configuring the first client application 210 in the rich execution environment, the first client application 210 for executing the transceiving function of the remote control input information is integrated, thereby reducing the difficulty of the remote control method.

[0061] Continuing to refer to Figure 1 , and referring to Figure 5 In this embodiment, before sending the remote control input information to the use terminal 300, the remote control method further includes: performing step S103, the signal transceiver device 200 performs encryption operation on the remote control input information.

[0062] In the information transmission path, the remote control input information sent by the remote control device 100 is first encrypted before being received by the use terminal 300, so that the use terminal 300 can filter other illegal information.

[0063] In the embodiment, the remote control input information is encrypted, including encryption by a Key Ladder module or a crypto module.

[0064] The encryption method can implement multi-level encryption of the key, thereby reducing the probability of being cracked.

[0065] In one embodiment, the encryption is performed by a Key Ladder module. By using the Key Ladder-based encryption method, the overall encryption speed is faster, thereby improving the efficiency of the remote control method.

[0066] Specifically, in the remote control method of the signal transceiver 200, the Key Ladder module is a hardware module, thereby making the encryption more efficient.

[0067] It should be noted that in the Key Ladder-based encryption method, key derivation is performed based on a root key and an input key (for example, by a key derivation algorithm), thereby generating a target key for encryption.

[0068] It should be further noted that the purpose of the crypto module is to provide encryption functions, including a complete set of encapsulation of the hash, HMAC, encryption, decryption, signature, and verification functions of OpenSSL.

[0069] As an example, the crypto module is a software module.

[0070] As shown in Figure 5 In the embodiment, the signal transceiver 200 includes a Trusted Execute Environment (TEE) and a rich execute environment, in other words, the signal transceiver 200 can run the Trusted Execute Environment and the rich execute environment.

[0071] The Trusted Execute Environment is configured with a Trusted Application (TA) 220, the rich execute environment is configured with a first Client Application (CA) 210 and a signature file of the Trusted Application.

[0072] The Trusted Execute Environment can provide a higher level of security, thereby meeting the sensitivity and security requirements of data. The Trusted Execute Environment generally refers to a Secure OS.

[0073] The Trusted Application 220 is used to run in the Trusted Execute Environment.

[0074] Therefore, receiving remote control input information from the remote control device 100 comprises: receiving remote control input information from the remote control device 100 by using the first client application 210 running in the rich execution environment, and sending the remote control input information to the trusted application 220 in the trusted execution environment.

[0075] Encrypting the remote control input information comprises: loading a signature file of the trusted application 220 in the trusted execution environment to trigger running of the trusted application 220, and encrypting the remote control input information by using the trusted application 220 running in the trusted execution environment, and sending the encrypted remote control input information to the first client application 210.

[0076] Loading the signature file of the trusted application 220 in the trusted execution environment facilitates further improvement of information security.

[0077] Correspondingly, sending the remote control input information to the using terminal 300 comprises: after receiving the encrypted remote control input information sent by the trusted application 220, sending the encrypted remote control input information to the using terminal 300 by using the first client application 210.

[0078] Correspondingly, in the embodiment, in the step (i.e., step S102) of sending the remote control input information to the using terminal 300 by using the signal transceiver 200, the signal transceiver 200 sends the encrypted remote control input information to the using terminal 300.

[0079] Correspondingly, the embodiment of the application further provides a remote control method of a virtual input device 320 applied to a using terminal. Figure 2 , Figure 2 is a flowchart of an embodiment of the remote control method of the virtual input device 320 applied to the using terminal of the application.

[0080] Refer to Figure 5 , Figure 5 is a schematic diagram of a connection relationship among the remote control device 100, the signal transceiver 200 and the using terminal 300, and step S201 is performed, i.e., the using terminal 300 receives remote control input information from the signal transceiver 200, the remote control input information is a signal triggered by a key event on the remote control device 100, and the key event and an input event of the virtual input device 320 have a preset mapping relationship.

[0081] The remote control method is executed at the side of the using terminal 300, and the using terminal 300 receives the remote control input information from the signal transceiving device 200, so as to subsequently execute the input event corresponding to the remote control operation of the user to the remote control device 100.

[0082] In the embodiment, the using terminal 300 comprises a personal computer.

[0083] By adopting the remote control method, the remote control device 100 can be used to realize the remote control of the virtual input device 320 in the personal computer, so as to relieve the operation difficulty caused by the fact that the user has no available external input device.

[0084] In the embodiment, the virtual input device 320 comprises a virtual mouse or a virtual keyboard, so that the human-computer interaction between the user and the using terminal 300 can be realized through the remote control device 100.

[0085] In the case that the virtual input device 320 is a virtual keyboard, the input event comprises an input operation corresponding to a virtual key corresponding to the key event in the virtual keyboard; in the case that the virtual input device 320 is a virtual mouse, the input event comprises movement of a virtual cursor or clicking of the virtual cursor.

[0086] In the embodiment, the signal transceiving device 200 comprises a set top box.

[0087] In the embodiment, the remote control device 100 can comprise a remote controller or a remote control handle. As an example, the remote control device 100 is a remote controller.

[0088] The specific description of the remote control device 100, the signal transceiving device 200, the using terminal 300 and the virtual input device 320 can refer to the related content in the foregoing embodiments, which will not be described herein again.

[0089] In the embodiment, in the case that the using terminal 300 and the signal transceiving device 200 have established a network connection, the using terminal 300 receives the remote control input information from the signal transceiving device 200.

[0090] Specifically, the using terminal 300 and the signal transceiving device 200 establish the network connection through a network socket.

[0091] The network socket has good migration ability for different operating systems, so that the network socket can run on different operating systems without or with only a small number of changes, so that the remote control method can be applicable to the signal transceiving device 200 and the using terminal 300 of various operating systems.

[0092] In the step of receiving the remote control input information from the signal transceiving device 200 by the using terminal 300, the remote control input information is encrypted remote control input information, thus, before responding to the remote control input information, the remote control method further comprises: performing step S203, decrypting the encrypted remote control input information.

[0093] In the embodiment, the signal transceiving device 200 encrypts the remote control input information by a key ladder module, thus, the using terminal 300 decrypts the encrypted remote control input information by a key ladder module.

[0094] Specifically, the using terminal 300 decrypts the encrypted remote control input information by a key ladder module, which comprises: obtaining a root key, an input key and a key derivation mechanism (for example, by a key derivation algorithm) used in the encryption; obtaining a target key used in the encryption based on the root key, the input key and the key derivation mechanism; and decrypting based on the target key.

[0095] It should be noted that the using terminal 300 stores the root key, the input key and the key derivation mechanism, thus, the using terminal 300 can decrypt the encrypted remote control input information.

[0096] It should be further noted that, in the remote control method of the virtual input device of the using terminal 300, the key ladder module is a software form key ladder module.

[0097] In other embodiments, if the signal transceiving device encrypts the remote control input information by a crypto module, the using terminal decrypts the encrypted remote control input information by a crypto module.

[0098] In the embodiment, the remote control method further comprises: performing step S202, the using terminal 300 responds to the remote control input information and performs a corresponding input event based on the preset mapping relationship.

[0099] Specifically, the using terminal 300 responds to the remote control input information after decrypting the encrypted remote control input information.

[0100] The using terminal 300 responds to the remote control input information to simulate a virtual input device 320 and performs a corresponding input event based on the preset mapping relationship, so that the user can interact with the using terminal 300 through the remote control device 100.

[0101] Therefore, the use terminal 300 can realize the communication with the remote control device 100 through the signal transceiving device 200, so that the use terminal 300 can execute the corresponding input event based on the preset mapping relationship after receiving the remote control input information, and the user can remotely control the virtual input device 320 on the use terminal 300, thereby relieving the operation difficulty caused by the fact that the user has no available external input device.

[0102] As shown in Figure 5 In the embodiment, the use terminal 300 is configured with a second client application 310, and the use terminal 300 executes the remote control method through the second client application 310.

[0103] The second client application 310 is used to reduce or avoid the modification of the use terminal 300, and the compatibility of the use terminal 300 with the remote control method can be improved.

[0104] It should be noted that in the embodiment, the preset mapping relationship is stored in the use terminal 300, so that the corresponding input event can be executed based on the preset mapping relationship.

[0105] Specifically, the preset mapping relationship is written in the second client application 310.

[0106] It should be further noted that the remote control method is used to remotely control the virtual input device 320 on the use terminal 300, so the virtual input device 320 can not be displayed on the display interface of the use terminal 300.

[0107] Correspondingly, the embodiment of the application further provides a signal transceiving device. Figure 3 is a schematic structural diagram of an embodiment of the signal transceiving device of the application.

[0108] For reference Figure 5 , Figure 5 is a schematic connection relationship diagram among the remote control device 100, the signal transceiving device 200 and the use terminal 300 provided by the embodiment of the application, the signal transceiving device 200 comprises a signal receiving module 201, which is used to receive the remote control input information from the remote control device 100, the remote control input information is the signal triggered by the key event on the remote control device 100, and the key event and the input event of the virtual input device 320 have a preset mapping relationship; a signal sending module 202, which is used to send the remote control input information to the use terminal 300, so that the use terminal 300 executes the corresponding input event based on the preset mapping relationship in response to the remote control input information.

[0109] The signal transceiving apparatus 200 can receive the remote control input information sent by the remote control device 100, and can also send the remote control input information to the use terminal 300, so that the communication between the remote control device 100 and the use terminal 300 can be realized through the signal transceiving apparatus 200, so that the use terminal 300 can execute the corresponding input event based on the preset mapping relationship after receiving the remote control input information, thereby facilitating the user to remotely control the virtual input device 320 on the use terminal 300 by using the remote control device 100, and further relieving the operation difficulty caused by the fact that the user has no available external input device.

[0110] It should be noted that the remote control input information is received and sent through the signal transceiving apparatus 200, so that the requirement for the adaptation of the remote control device 100 and the use terminal 300 is reduced, thereby facilitating the reduction of the modification of the remote control device 100 and the use terminal 300.

[0111] In addition, the remote control input information is received and sent through the signal transceiving apparatus 200, so as to facilitate the use of the signal transceiving apparatus 200 to meet the requirement for specific information processing (for example, encryption processing, etc.) on the remote control input information, thereby also facilitating the reduction of the modification of the remote control device 100 and the use terminal 300.

[0112] In this embodiment, the virtual input device 320 includes a virtual mouse or a virtual keyboard, so that the human-computer interaction between the user and the use terminal 300 can be realized through the remote control device 100.

[0113] In the case where the virtual input device 320 is a virtual keyboard, the input event includes an input operation corresponding to a virtual key corresponding to the key event in the virtual keyboard; in the case where the virtual input device 320 is a virtual mouse, the input event includes movement of a virtual cursor or clicking of the virtual cursor.

[0114] In this embodiment, the signal transceiving apparatus 200 includes a set top box.

[0115] In this embodiment, the remote control device 100 can include a remote controller or a remote control handle. As an example, the remote control device 100 is a remote controller.

[0116] In this embodiment, the use terminal 300 includes a personal computer.

[0117] The specific description of the remote control device 100, the signal transceiving apparatus 200, the use terminal 300 and the virtual input device 320 can refer to the related content in the foregoing embodiments, which will not be described here again.

[0118] The signal receiving module 201 is used to receive remote control input information from the remote control device 100 when the signal transceiver 200 and the remote control device 100 have established a communication connection.

[0119] The signal transceiver 200 and the remote control device 100 establish a communication connection, thereby realizing the information transmission between the two.

[0120] The signal transceiver 200 and the remote control device 100 can establish a communication connection via Bluetooth, infrared, or a wired connection interface (e.g., USB interface).

[0121] If the signal transceiver 200 and the remote control device 100 establish a communication connection via Bluetooth or infrared, they can achieve wireless communication, thereby reducing the spatial requirements of the remote control device 100 and improving the user experience.

[0122] If the signal transceiver 200 and the remote control device 100 are connected via a wired connection interface, the configuration requirements for the remote control device 100 can be reduced.

[0123] In this embodiment, the signal transmitting module 202 is used to send the remote control input information to the user terminal 300 when the signal transceiver 200 and the user terminal 300 have established a network connection.

[0124] Specifically, the signal transceiver 200 and the user terminal 300 establish a network connection through a network socket.

[0125] Network sockets have good portability across different operating systems, so they can run on different operating systems without modification or with only minor modifications, making the remote control method applicable to signal transceiver devices 200 and user terminals 300 on various operating systems.

[0126] like Figure 5 As shown, in this embodiment, the signal transceiver 200 includes a rich execution environment (REE), and a first client application (CA) 210 is configured in the rich execution environment. The first client application 210 is used to run in the rich execution environment.

[0127] Correspondingly, the first client application 210 is configured to run in the rich execution environment to execute the functions of the signal receiving module 201 and the functions of the signal sending module 202. In other words, the first client application 210 is the signal receiving module 201 and the signal sending module 202.

[0128] The specific description of the rich execution environment and the first client application 210 can refer to the related content in the foregoing embodiments, which will not be repeated here.

[0129] Continuing to refer to Figure 3 In this embodiment, the signal transceiver 200 further comprises an encryption module 203 configured to perform an encryption operation on the remote control input information before transmitting the remote control input information to the use terminal 300.

[0130] In the information transmission path, the remote control input information sent by the remote control device 100 is first encrypted before being received by the use terminal 300, so that the use terminal 300 can filter other illegal information.

[0131] The encryption module 203 can be configured to perform the encryption operation through a Key Ladder module or a crypto module.

[0132] In this embodiment, the encryption module 203 is configured to perform the encryption operation through a Key Ladder module.

[0133] As Figure 5 shown, the signal transceiver 200 comprises a trusted execution environment (TEE) and a rich execution environment, in other words, the signal transceiver 200 can run the trusted execution environment and the rich execution environment.

[0134] The trusted execution environment is configured with a trusted application (TA) 220, the rich execution environment is configured with a first client application (CA) 210 and a signature file of the trusted application.

[0135] The trusted execution environment can provide a higher level of security to meet the sensitivity and security requirements of data, and the trusted execution environment generally refers to a secure operating system (Secure OS). The trusted application 220 is configured to run in the trusted execution environment.

[0136] Therefore, in this embodiment, the first client application 210 is configured to run in the rich execution environment to perform the function of the signal receiving module 201 and send the remote control input information to the trusted application 220 in the trusted execution environment.

[0137] In this embodiment, the trusted execution environment is configured to load and verify a signature file of the trusted application 220 to trigger the running of the trusted application 220; and the trusted application 220 is configured to run in the trusted execution environment to perform the function of the encryption module 203 and send the encrypted remote control input information to the first client application 210. In other words, the trusted application 220 is the encryption module 203.

[0138] In this embodiment, the first client application 210 is further configured to receive the encrypted remote control input information sent by the trusted application 220, perform the function of the signal sending module 202, and send the encrypted remote control input information to the use terminal 300.

[0139] It should be noted that the signal transceiver 200 further includes a first one-time programmable memory (OTP) configured to store a root key, a second one-time programmable memory configured to store configuration information of a key ladder used for encryption, and a third one-time programmable memory configured to write-lock the stored information in the first memory and the second memory.

[0140] The first one-time programmable memory, the second one-time programmable memory, and the third one-time programmable memory are burned in the signal transceiver 200, thereby improving the security of the encrypted remote control input information.

[0141] It should be noted that a plurality of one-time programmable memories can be arranged at different positions of the signal transceiver 200.

[0142] In this embodiment, the one-time programmable memory 204 includes an electronic fuse (efuse) device.

[0143] Correspondingly, the encryption module 203 is configured to perform an encryption operation based on the information in the first one-time programmable memory and the second one-time programmable memory.

[0144] Specifically, the encryption module 203 stores an input key, and thus performs a key derivation operation (for example, key derivation through a key derivation algorithm) based on the root key and the input key to generate a target key used for encryption.

[0145] Correspondingly, in the embodiment, the signal sending module 202 is configured to send the encrypted remote control input information to the use terminal 300.

[0146] It should be noted that the signal transceiver 200 is configured to perform the remote control method of the virtual input device 320 as described in the first embodiment, and thus the description of the signal transceiver can refer to the related content of the foregoing embodiments.

[0147] Correspondingly, the embodiment of the present application further provides a use terminal. Figure 4 is a schematic diagram of the framework structure of the use terminal according to an embodiment of the present application.

[0148] In combination with reference Figure 5 , Figure 5 is a schematic diagram of the connection relationship among the remote control device 100, the signal transceiver 200, and the use terminal 300 according to an embodiment of the present application, wherein the use terminal 300 comprises a virtual input device control module 301 configured to receive remote control input information from the signal transceiver 200, the remote control input information being a signal triggered by a key event on the remote control device 100, and the key event and a preset mapping relationship between the input event of the virtual input device 320; and further configured to perform a corresponding input event based on the preset mapping relationship in response to the remote control input information.

[0149] The virtual input device control module 301 receives remote control input information from the signal transceiver 200, and prepares for performing an input event corresponding to a remote control operation of the user on the remote control device 100.

[0150] In the embodiment, the use terminal 300 comprises a personal computer, and correspondingly, the remote control device 100 is used to realize remote control of the virtual input device 320 in the personal computer, which can alleviate the operation difficulty caused by the fact that the user has no available external input device.

[0151] In the embodiment, the virtual input device 320 comprises a virtual mouse or a virtual keyboard, so that the user can realize human-computer interaction with the use terminal 300 through the remote control device 100.

[0152] In the case where the virtual input device 320 is a virtual keyboard, the input event comprises an input operation corresponding to a virtual key corresponding to the key event in the virtual keyboard; in the case where the virtual input device 320 is a virtual mouse, the input event comprises movement of a virtual cursor or clicking of the virtual cursor.

[0153] In the embodiment, the signal transceiver 200 comprises a set-top box.

[0154] In this embodiment, the remote control device 100 can include a remote controller or a remote handle. As an example, the remote control device 100 is a remote controller.

[0155] The specific description of the remote control device 100, the signal transceiver 200, the use terminal 300 and the virtual input device 320 can refer to the related content in the foregoing embodiments, which will not be described here.

[0156] In this embodiment, the virtual input device control module 301 is configured to receive the remote control input information from the signal transceiver 200 when the use terminal 300 and the signal transceiver 200 have established a network connection. Specifically, the use terminal 300 and the signal transceiver 200 establish a network connection through a network socket.

[0157] In this embodiment, the remote control input information is encrypted remote control input information, and therefore, the virtual input device control module 301 is further configured to perform a decryption operation on the encrypted remote control input information before responding to the remote control input information.

[0158] In this embodiment, the signal transceiver 200 performs an encryption operation on the remote control input information through a key ladder module, and therefore, the virtual input device control module 301 is configured to perform a decryption operation through the key ladder module.

[0159] Specifically, the decryption operation through the key ladder module includes: obtaining a root key, an input key and a key derivation mechanism (for example, through a key derivation algorithm) used in the encryption operation; obtaining a target key used for encryption based on the root key, the input key and the key derivation mechanism; and performing decryption based on the target key.

[0160] It should be noted that the use terminal 300 stores the root key, the input key and the key derivation mechanism, and therefore, the encrypted remote control input information can be decrypted.

[0161] It should be further noted that the key ladder module in the use terminal 300 is a software form of the key ladder module.

[0162] In other embodiments, if the signal transceiver performs an encryption operation on the remote control input information through a crypto module, the virtual input device control module is configured to perform a decryption operation through the crypto module.

[0163] In this embodiment, the virtual input device control module 301 responds to the remote control input information to simulate the virtual input device 320, and performs a corresponding input event based on the preset mapping relationship, so that the user can realize interaction with the terminal 300 through the remote control device 100.

[0164] Therefore, the terminal 300 can realize communication with the remote control device 100 through the signal transceiver 200, so that the terminal 300 can perform a corresponding input event based on the preset mapping relationship after receiving the remote control input information, facilitating the user to remotely control the virtual input device 320 on the terminal 300, thereby alleviating the operation difficulty caused by the user having no available external input device.

[0165] As shown in Figure 5 In this embodiment, the terminal 300 is configured with a second client application 310 for performing the function of the virtual input device control module 301. In other words, the second client application 310 is the virtual input device control module 301.

[0166] Through the second client application 310, the modification to the terminal 300 is reduced or avoided, and the compatibility of the terminal 300 with the remote control method is improved.

[0167] It should be noted that in this embodiment, the terminal 300 stores the preset mapping relationship, so that a corresponding input event can be performed based on the preset mapping relationship.

[0168] Specifically, the preset mapping relationship is written in the second client application 310.

[0169] It should be further noted that when remotely controlling the virtual input device 320 on the terminal 300, the virtual input device 320 can not be displayed on the display interface of the terminal 300.

[0170] As an example, the terminal 300 is used to perform the remote control method of the virtual input device 320 provided in the second embodiment, and the specific description of the terminal 300 can refer to the related description of the foregoing embodiments.

[0171] Correspondingly, the embodiment of the application also provides a remote control system of a virtual input device 320.

[0172] For reference Figure 5 , Figure 5is a connection relationship schematic diagram between a remote control device 100, a signal transceiver 200 and a use terminal 300 provided by an embodiment of the present application, and a remote control system of the virtual input device 320 comprises: the remote control device 100, used for sending remote control input information, the remote control input information is a signal triggered by a key event on the remote control device 100, and the key event has a preset mapping relationship with an input event of the virtual input device 320; the signal transceiver 200 provided by any embodiment of the present application; the use terminal 300 provided by any embodiment of the present application.

[0173] The remote control device 100 triggers the remote control input information after a key event occurs, the signal transceiver 200 receives the remote control input information from the remote control device 100, and sends the remote control input information to the use terminal 300, the use terminal 300 receives the remote control input information from the signal transceiver 200 and responds to the remote control input information, and performs a corresponding input event based on the preset mapping relationship, therefore, the signal transceiver 200 enables communication between the remote control device 100 and the use terminal 300, so that the use terminal 300 can perform a corresponding input event, and the user can remotely control the virtual input device 320 on the use terminal.

[0174] As an example, after the user remotely controls the remote control device 100, the remote control device 100 generates a key event corresponding to the remote control operation.

[0175] In the embodiment, the remote control device 100 comprises a remote controller or a remote control handle.

[0176] The specific description of the remote control device 100, the signal transceiver 200 and the use terminal 300 can refer to the related content in the foregoing embodiments, and will not be described here.

[0177] Correspondingly, the embodiment of the present application further provides a storage medium, the storage medium stores one or more computer instructions, and the one or more computer instructions are used for implementing the remote control method of the virtual input device provided by the foregoing first embodiment, or are used for implementing the remote control method of the virtual input device provided by the foregoing second embodiment.

[0178] The embodiment of the present application further provides a computer program product comprising computer instructions, and the computer instructions are used for implementing the remote control method of the virtual input device provided by the foregoing first embodiment or the remote control method of the virtual input device provided by the foregoing second embodiment when executed by a processor.

[0179] The above-described embodiments of the application are combinations of elements and features of the applications. The elements or features can be applied to one another only in combinations, unless otherwise indicated. Each individual element or feature can be replaced by alternative elements or features serving the same, equivalent or similar purpose, unless otherwise stated. The numerous individual features or elements can be combined or integrated in other combinations or arrangements, unless otherwise indicated. Other combinations and modifications of the application will occur to those skilled in the art upon reading this description.

[0180] The embodiments of the present application can be implemented by various means, for example, hardware, firmware, software, or a combination thereof. In a hardware configuration, the method according to the exemplary embodiments of the present application can be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, etc.

[0181] In a firmware or software configuration, the embodiments of the present application can be implemented in the form of modules, procedures, functions, and so on. Software code can be stored in a memory unit and executed by a processor. The memory unit is located at the interior or exterior of the processor and can transmit data to and receive data from the processor via various known means.

[0182] The above description of disclosed embodiments is merely intended to illustrate the general principles of the application. Various modifications of the embodiments described herein can be readily apparent to those skilled in the art, and the general principles defined herein can be put to other applications in the art without the exercise of inventive faculty. Accordingly, the present application is not intended to be limited to the examples described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

[0183] While the application has been disclosed in connection with the embodiments presented, it should be understood that modifications and / or improvements can be made to the above-described embodiments without departing from the spirit and scope of the application. Thus, the scope of the application should not be limited to the specific examples described herein, but should be given the broadest interpretation consistent with the principles and novel features disclosed herein.

Claims

1. A remote control method for a virtual input device, characterized in that, The remote control method, applied to a signal transceiver device, includes: Receive remote control input information from a remote control device, wherein the remote control input information is a signal triggered by a button event on the remote control device, and there is a preset mapping relationship between the button event and the input event of the virtual input device; The remote control input information is sent to the user terminal so that the user terminal responds to the remote control input information and executes the corresponding input event based on the preset mapping relationship.

2. The remote control method for a virtual input device as described in claim 1, characterized in that, The signal transceiver includes a rich execution environment, and a first client application is configured in the rich execution environment; Receiving remote control input information from a remote control device includes: receiving remote control input information from the remote control device using a first client application running in the rich execution environment; Sending the remote control input information to the user terminal includes: sending the remote control input information to the user terminal using the first client application.

3. The remote control method for a virtual input device as described in claim 1, characterized in that, Before sending the remote control input information to the user terminal, the remote control method further includes: encrypting the remote control input information; In the step of sending the remote control input information to the user terminal, the encrypted remote control input information is sent to the user terminal.

4. The remote control method for a virtual input device as described in claim 3, characterized in that, Encrypting the remote control input information includes encrypting it using a key ladder module or a crypto module.

5. The remote control method for a virtual input device as described in claim 3, characterized in that, The signal transceiver includes a trusted execution environment and a rich execution environment. The trusted execution environment is configured with a trusted application, and the rich execution environment is configured with a first client application and a signature file of the trusted application. Receiving remote control input information from a remote control device includes: using a first client application running in the rich execution environment to receive the remote control input information from the remote control device, and sending the remote control input information to a trusted application in the trusted execution environment; Encrypting the remote control input information includes: using the trusted execution environment to load and verify the signature file of the trusted application to trigger the execution of the trusted application; using the trusted application running in the trusted execution environment to encrypt the remote control input information, and sending the encrypted remote control input information to the first client application; Sending the remote control input information to the user terminal includes: sending the encrypted remote control input information to the user terminal using the first client application.

6. The remote control method for a virtual input device as described in claim 1, characterized in that, The key events include individual triggering of a single key with a duration less than a first preset duration, individual triggering of a single key with a duration greater than a second preset duration, multiple consecutive triggering of a single key within a time interval less than a first preset time interval, or combined triggering of multiple keys within a time interval less than a second preset time interval.

7. The remote control method for a virtual input device as described in any one of claims 1 to 6, characterized in that, When the signal transceiver and the remote control device have established a communication connection, the remote control input information from the remote control device is received; wherein the signal transceiver and the remote control device establish a communication connection through Bluetooth, infrared or wired connection interface.

8. The remote control method for the virtual input device as described in any one of claims 1 to 6, characterized in that, When the signal transceiver and the user terminal have established a network connection, the remote control input information is sent to the user terminal; wherein the signal transceiver and the user terminal establish a network connection through a network socket.

9. The remote control method for the virtual input device as described in any one of claims 1 to 6, characterized in that, The virtual input device includes a virtual mouse or a virtual keyboard; Wherein, when the virtual input device is a virtual keyboard, the input event includes the input operation corresponding to the virtual key in the virtual keyboard that corresponds to the key event; When the virtual input device is a virtual mouse, the input event includes moving the virtual cursor or clicking the virtual cursor.

10. The remote control method for a virtual input device as described in any one of claims 1 to 6, characterized in that, The signal transceiver includes a set-top box, the remote control device includes a remote controller or a remote control handle, and the user terminal includes a personal computer.

11. A remote control method for a virtual input device, characterized in that, The remote control method, applied to a user terminal, includes: Receive remote control input information from a signal transceiver device, wherein the remote control input information is a signal triggered by a button event on the remote control device, and there is a preset mapping relationship between the button event and the input event of the virtual input device; In response to the remote control input information, the corresponding input event is executed based on the preset mapping relationship.

12. The remote control method for a virtual input device as described in claim 11, characterized in that, In the step of receiving remote control input information from a signal transceiver, the remote control input information is encrypted remote control input information; In response to the remote control input information, the remote control method further includes: decrypting the encrypted remote control input information.

13. The remote control method for a virtual input device as described in claim 12, characterized in that, The encrypted remote control input information is decrypted, including by using a key ladder module or a crypto module.

14. The remote control method for a virtual input device as described in claim 11, characterized in that, When the user terminal and the signal transceiver have established a network connection, the user terminal receives remote control input information from the signal transceiver; wherein the user terminal and the signal transceiver establish a network connection through a network socket.

15. The remote control method for a virtual input device as described in claim 11, characterized in that, The virtual input device includes a virtual mouse or a virtual keyboard; Wherein, when the virtual input device is a virtual keyboard, the input event includes the input operation corresponding to the virtual key in the virtual keyboard that corresponds to the key event; When the virtual input device is a virtual mouse, the input event includes moving the virtual cursor or clicking the virtual cursor.

16. The remote control method for a virtual input device as described in claim 11, characterized in that, The terminal includes a personal computer, the signal transceiver includes a set-top box, and the remote control device includes a remote control or a remote control handle.

17. The remote control method for a virtual input device as described in any one of claims 11 to 16, characterized in that, The terminal is configured with a second client application, through which the remote control method of the virtual input device is executed.

18. A signal transceiver, characterized in that, include: The signal receiving module is used to receive remote control input information from the remote control device. The remote control input information is a signal triggered by a button event on the remote control device, and there is a preset mapping relationship between the button event and the input event of the virtual input device. The signal transmitting module is used to send the remote control input information to the user terminal, so that the user terminal responds to the remote control input information and executes the corresponding input event based on the preset mapping relationship.

19. The signal transceiver as described in claim 18, characterized in that, The signal transceiver includes a rich execution environment, and a first client application is configured in the rich execution environment; The first client application is used to run in the rich execution environment to perform the functions of the signal receiving module and the signal sending module.

20. The signal transceiver as described in claim 18, characterized in that, The signal transceiver device further includes an encryption module, used to encrypt the remote control input information before sending it to the user terminal; The signal transmitting module is used to send encrypted remote control input information to the user terminal.

21. The signal transceiver as described in claim 20, characterized in that, The encryption module is used to perform encryption operations through the key ladder module or the crypto module.

22. The signal transceiver as described in claim 20, characterized in that, The signal transceiver includes a trusted execution environment and a rich execution environment. The trusted execution environment is configured with a trusted application, and the rich execution environment is configured with a first client application and a signature file of the trusted application. The first client application is used to run in the rich execution environment to perform the function of the signal receiving module and send the remote control input information to the trusted application in the trusted execution environment; The trusted execution environment is used to load and verify the signature file of the trusted application in order to trigger the execution of the trusted application; The trusted application is used to run in the trusted execution environment to perform the function of the encryption module and send the encrypted remote control input information to the first client application; The first client application is also used to perform the function of the signal sending module, sending the encrypted remote control input information to the user terminal.

23. The signal transceiver as described in claim 20, characterized in that, The encryption module is used to perform encryption operations through the key ladder module; The signal transceiver device further includes: a first one-time programmable memory for storing the root key; a second one-time programmable memory for storing configuration information of the key ladder used for encryption; and a third one-time programmable memory for write-locking the stored information in the first and second one-time programmable memories. The encryption module is used to perform encryption operations based on the information in the first and second one-time programmable memories.

24. The signal transceiver as described in claim 23, characterized in that, The first, second, and third one-time programmable memories all include an electric fuse device.

25. The signal transceiver apparatus as described in any one of claims 18 to 24, characterized in that, The signal transceiver includes a set-top box.

26. A user terminal, characterized in that, include: The virtual input device control module is used to receive remote control input information from the signal transceiver device. The remote control input information is a signal triggered by a button event on the remote control device, and there is a preset mapping relationship between the button event and the input event of the virtual input device. It is also used to respond to the remote control input information and execute the corresponding input event based on the preset mapping relationship.

27. The user terminal as described in claim 26, characterized in that, The remote control input information is encrypted. The virtual input device control module is also used to decrypt the encrypted remote control input information before responding to the remote control input information.

28. The user terminal as described in claim 27, characterized in that, The virtual input device control module is used to perform decryption operations via the key ladder module or the crypto module.

29. The user terminal as described in any one of claims 26 to 28, characterized in that, The terminal is configured with a second client application, which is used to execute the functions of the virtual input device control module.

30. The user terminal as described in any one of claims 26 to 28, characterized in that, The terminal used includes a personal computer.

31. A remote control system for a virtual input device, characterized in that, include: A remote control device is used to send remote control input information, wherein the remote control input information is a signal triggered by a button event on the remote control device, and there is a preset mapping relationship between the button event and the input event of the virtual input device; The signal transceiver apparatus as described in any one of claims 18 to 25; The user terminal as described in any one of claims 26 to 30.

32. The remote control system for a virtual input device as described in claim 31, characterized in that, The remote control device includes a remote controller or a remote control handle.

33. A storage medium, characterized in that, The storage medium stores one or more computer instructions, which are used to implement the remote control method of the virtual input device as described in any one of claims 1 to 10, or to implement the remote control method of the virtual input device as described in any one of claims 17 to 18.

34. A computer program product, characterized in that, The device includes computer instructions that, when executed by a processor, are used to implement the remote control method for the virtual input device as described in any one of claims 1 to 10, or to implement the remote control method for the virtual input device as described in any one of claims 17 to 18.

Images