Method, apparatus, electronic device and storage medium for controlling a remote control device

Abstract

The application relates to a method, a system, an electronic device and a storage medium for controlling a remote control device. The method comprises: receiving a current remote control instruction; determining a user perception time difference corresponding to the current remote control instruction, the user perception time difference being a difference between a time when a matched remote control instruction is received from the remote control device and a time when a remote control signal corresponding to the matched remote control instruction is responded by the controlled device to execute a user-perceivable action, the matched remote control instruction being a remote control instruction indicating the controlled device to execute a same instruction action; and not executing the current remote control instruction in response to the remote control device receiving the matched remote control instruction within the user perception time difference before receiving the current remote control instruction. The method can prevent a misoperation of the controlled device caused by a repeated triggering of a remote control instruction corresponding to a same instruction action due to the user not perceiving a response of the controlled device to a corresponding remote control signal.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of remote control, and in particular to a method and device for controlling a remote control device, an electronic device, and a storage medium. BACKGROUND

[0002] Generally, a user can control a remote controlled device to perform various actions through a remote control device, which can be a dedicated device, such as a remote controller, or can be acted by other devices, such as a smart phone, a smart speaker, etc. For example, the current smart speaker supports infrared function, and the infrared remote control function can be added to the smart speaker. The smart speaker can control the electrical appliance through learning the infrared control signal of the electrical appliance, so that the smart speaker can remotely control the electrical appliance. The user can send a voice command to the smart speaker, and the smart speaker converts the voice command into the infrared control signal of the electrical appliance, and the electrical appliance receives the infrared control signal sent by the smart speaker to perform an operation, thereby realizing the remote control of the electrical appliance through the infrared remote control signal.

[0003] However, in the process of implementing the present disclosure, the inventors have found that at least the following problems exist in the prior art: when the remote controlled device responds to the remote control signal, the user may not be able to perceive the response, and the same instruction action may be triggered again, thereby causing the misoperation of the remote controlled device. SUMMARY

[0004] Therefore, it is necessary to provide a method and device for controlling a remote control device, an electronic device, and a storage medium, which can prevent the misoperation of the remote controlled device caused by the user not perceiving the response of the controlled device to the corresponding remote control signal to repeatedly trigger the same instruction action of the remote control instruction.

[0005] According to a first aspect of certain exemplary embodiments of the present disclosure, a method for controlling a remote control device is provided, which includes: receiving a current remote control instruction; determining a user perception time difference corresponding to the current remote control instruction, the user perception time difference being a difference between a time at which a matching remote control instruction is received by the remote control device and a time at which the remote controlled device responds to a remote control signal corresponding to the matching remote control instruction to perform a user-perceptible action, the matching remote control instruction being a remote control instruction indicating the remote controlled device to perform the same instruction action; and in response to the remote control device receiving the matching remote control instruction within the user perception time difference before receiving the current remote control instruction, not executing the current remote control instruction.

[0006] In combination with the first aspect, in a possible implementation manner, the current remote control instruction shares the same remote control signal with at least another instruction action of the remote controlled device.

[0007] With reference to the first aspect, in a possible implementation manner, the method further includes: in response to the user perception time difference corresponding to the current remote control instruction not being determined, or in response to the current remote control instruction not being a remote control instruction for which the user perception time difference needs to be determined, executing the current remote control instruction.

[0008] With reference to the first aspect, in a possible implementation manner, the method further includes: in response to the remote control device not receiving a remote control instruction matching the current remote control instruction within the user perception time difference before receiving the current remote control instruction, executing the current remote control instruction.

[0009] With reference to the first aspect, in a possible implementation manner, the determining of the user perception time difference corresponding to the current remote control instruction includes: identifying the remote controlled device identification information and the instruction action information of the current remote control instruction; and determining the user perception time difference corresponding to the current remote control instruction according to the remote controlled device identification information and the instruction action information.

[0010] With reference to the first aspect, in a possible implementation manner, the method further includes: in response to the remote controlled device information of the current remote control instruction and the remote controlled device identification information of another remote control instruction both corresponding to a same remote controlled device, and the instruction action information of the current remote control instruction and the instruction action information of another remote control instruction both corresponding to a same instruction action, determining that the current remote control instruction matches another remote control instruction.

[0011] With reference to the first aspect, in a possible implementation manner, the executing of the current remote control instruction includes: generating a control instruction according to the remote controlled device identification information and the instruction action information of the current remote control instruction, and sending the control instruction to the remote controlled device after encoding the control instruction into a remote control signal.

[0012] With reference to the first aspect, in a possible implementation manner, the method further includes: deleting remote control instruction record information with a record duration exceeding a set duration, the set duration being greater than the user perception time difference, and the remote control instruction record information including remote controlled device identification information, instruction action information, and receiving time information corresponding to a remote control instruction.

[0013] With reference to the first aspect, in a possible implementation manner, when there are multiple user perception time differences corresponding to multiple remote control instructions, the set duration is greater than a maximum value of the user perception time differences corresponding to the multiple remote control instructions.

[0014] With reference to the first aspect, in a possible implementation manner, the method further includes: obtaining a plurality of recorded historical time difference values, the historical time difference value being a difference value recorded from a first historical time at which a historical remote control instruction is received from the remote control device to a second historical time at which the controlled device performs a user-perceptible action in response to the historical remote control instruction, the historical remote control instruction being a matched remote control instruction of the current remote control instruction; and determining the user-perceptible time difference by averaging or maximizing the plurality of historical time difference values.

[0015] With reference to the first aspect, in a possible implementation manner, the method further includes: determining the second historical time according to feedback information sent by the controlled device to the remote control device after the controlled device performs a user-perceptible action in response to a corresponding remote control signal of the historical remote control instruction; or determining the second historical time according to image recognition information or audio recognition information of the controlled device.

[0016] According to a second aspect of certain example embodiments of the present disclosure, there is provided an apparatus for controlling a remote control device, the apparatus comprising: a command receiving module configured to receive a current remote control instruction; a user-perceptible time difference determining module configured to determine a user-perceptible time difference corresponding to the current remote control instruction, the user-perceptible time difference being a difference value from a time at which a matched remote control instruction is received from the remote control device to a time at which the controlled device performs a user-perceptible action in response to a corresponding remote control signal of the matched remote control instruction, the matched remote control instruction being a remote control instruction indicating the controlled device to perform a same instruction action; and an executing module configured to, in response to the remote control device receiving the matched remote control instruction within the user-perceptible time difference before receiving the current remote control instruction, not execute the current remote control instruction.

[0017] With reference to the second aspect, in a possible implementation manner, the current remote control instruction shares a same remote control signal with another instruction action corresponding remote control instruction of the controlled device.

[0018] With reference to the second aspect, in a possible implementation manner, the executing module is further configured to, in response to the current remote control instruction not being a remote control instruction that needs to be determined for the user-perceptible time difference, execute the current remote control instruction.

[0019] With reference to the second aspect, in a possible implementation manner, the executing module is further configured to, in response to the remote control device not receiving the matched remote control instruction within the user-perceptible time difference before receiving the current remote control instruction, execute the current remote control instruction.

[0020] With reference to the second aspect, in a possible implementation manner, the user perception time difference determination module is configured to identify the controlled device identification information and the instruction action information of the current remote control instruction, and determine the user perception time difference corresponding to the current remote control instruction according to the controlled device identification information and the instruction action information.

[0021] With reference to the second aspect, in a possible implementation manner, the user perception time difference determination module and / or the execution module are further configured to, in response to the controlled device information of the current remote control instruction and the controlled device identification information of another remote control instruction both corresponding to a same controlled device, and the instruction action information of the current remote control instruction and the instruction action information of another remote control instruction both corresponding to a same instruction action, determine that the current remote control instruction and another remote control instruction are matched.

[0022] With reference to the second aspect, in a possible implementation manner, the execution module is further configured to generate a control instruction according to the controlled device identification information and the instruction action information of the current remote control instruction, and send the control instruction to the controlled device after encoding the control instruction into a remote control signal.

[0023] With reference to the second aspect, in a possible implementation manner, the apparatus further includes a deletion module configured to delete remote control instruction record information with a record duration exceeding a set duration, the set duration being greater than the user perception time difference, and the remote control instruction record information including the controlled device identification information, the instruction action information and the receiving time information corresponding to the remote control instruction.

[0024] With reference to the second aspect, in a possible implementation manner, when there are multiple user perception time differences corresponding to multiple remote control instructions, the set duration is greater than a maximum value of the multiple user perception time differences corresponding to the multiple remote control instructions.

[0025] With reference to the second aspect, in a possible implementation manner, the apparatus further includes a perception time difference identification module configured to obtain multiple recorded historical time difference values, the historical time difference value being a difference value between a first historical time when a historical remote control instruction is received from a remote control device and a second historical time when a controlled device responds to the historical remote control instruction to perform a user-perceivable action, the historical remote control instruction being a matched remote control instruction with the current remote control instruction, and the user perception time difference being determined by taking an average value or a maximum value of the multiple historical time difference values.

[0026] With reference to the second aspect, in a possible implementation manner, the perception time difference identification module determines the second historical time according to feedback information sent by the controlled device to the remote control device after the controlled device responds to a remote control signal corresponding to the historical remote control instruction to perform a user-perceivable action; or the perception time difference identification module determines the second historical time according to image recognition information or audio recognition information of the controlled device.

[0027] According to a third aspect of certain example embodiments of the present disclosure, there is provided an electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the method for controlling a remote control device of any of the example embodiments of the present disclosure when executing the computer program.

[0028] According to a fourth aspect of certain example embodiments of the present disclosure, there is provided a computer readable storage medium having stored thereon a computer program, the computer program implementing the steps of the method for controlling a remote control device of any of the example embodiments of the present disclosure when executed by a processor.

[0029] The above method, apparatus, electronic device and storage medium for controlling a remote control device, since upon receiving the current remote control instruction, first determines the user perception time difference corresponding to the current remote control instruction, i.e. the difference between the time when the remote control device receives a remote control instruction matching the current remote control instruction and the time when the controlled device responds to the remote control signal corresponding to the matching remote control instruction to perform an action that the user can perceive, the matching remote control instruction is a remote control instruction indicating the controlled device to perform the same instruction action, if the remote control device receives a remote control instruction matching the current remote control instruction within the user perception time difference before receiving the current remote control instruction, the current remote control instruction is not executed. In this way, it can prevent the misoperation of the controlled device caused by the user not perceiving the response of the controlled device to the corresponding remote control signal repeatedly triggering the remote control instruction corresponding to the same instruction action. BRIEF DESCRIPTION OF DRAWINGS

[0030] Figure 1 Application environment diagram for the method for controlling a remote control device in certain example embodiments;

[0031] Figure 2 Flowchart for the method for controlling a remote control device in certain example embodiments;

[0032] Figure 3 Flowchart for the user perception time difference determination step in certain example embodiments;

[0033] Figure 4 Flowchart for the method for controlling a remote control device in certain example embodiments;

[0034] Figure 5 Flowchart for the user perception time difference determination step in certain example embodiments;

[0035] Figure 6 Structural block diagram of the remote control device in certain example embodiments;

[0036] Figure 7 FIG. 1 is a diagram illustrating an internal structure of an electronic device according to an example embodiment. DETAILED DESCRIPTION

[0037] The following detailed description is provided to help the reader understand the method, apparatus, electronic device, and / or storage medium described herein. However, various changes, modifications, and equivalents of the method, apparatus, electronic device, and / or storage medium described herein can be apparent to those skilled in the art after understanding the disclosure provided herein. For example, the order of the operations described herein is merely an example and is not limited to those set forth herein, but can be changed as would be apparent to one of ordinary skill in the art after understanding the disclosure provided herein, except for operations that must occur in a particular, chronological order. Also, descriptions of features known to those of ordinary skill in the art can be omitted for the sake of clarity and conciseness.

[0038] The features described herein can be implemented in different forms and should not be construed as limited to the examples described herein. Rather, these examples are provided as illustrative of only some of the many possible implementations of the method, electronic device, and / or storage medium described herein, which implementations could be practiced with the understanding of the disclosure provided herein.

[0039] The terminology used herein is for the purpose of describing various examples only and is not intended to be limiting of the disclosure. As used herein, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. The terms "comprises," "comprising," "includes," "including," and "has," "having," and the like are inclusive of the stated features, numbers, operations, members, elements, and / or combinations thereof, but not excluding the presence or addition of one or more other features, numbers, operations, members, elements, and / or combinations thereof. Unless otherwise defined, "or" means any one member of the alternative, e.g., either A or B. The phrase "and / or," as used herein, merely describes associated objects in that at least one of each listed object can be present and one or more of such objects can be present. In other words, the phrase "and / or" as used herein simply means either "and" or "or," not both.

[0040] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs when the disclosure is understood in light of the present disclosure. Unless otherwise explicitly defined, terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and the disclosure, and are not to be interpreted in an idealized or overly formal sense.

[0041] It is to be understood that the terms "first", "second", and the like in the description and in the claims of the present disclosure, as well as above-described figures relate to distinguishing between similar elements and do not necessarily imply a required or a certain chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the present disclosure described herein are capable of operation in other sequences than described or otherwise illustrated herein. Implementations of the various embodiments of the present disclosure have not been presented in order to facilitate explanation of only some embodiments of the present disclosure. Thus, it is to be appreciated that various implementations of the present disclosure can include and incorporate only other

[0042] Furthermore, in the description of the examples, detailed discussion of related structures or functions of the various embodiments will not be repeated here for the sake of brevity.

[0043] Hereinafter, the implementations will be described in detail with reference to the accompanying drawings. However, the implementations can be implemented in various forms and are not limited to the examples described herein.

[0044] The method for controlling a remote control device provided in the present application can be applied to an application environment as shown in Figure 1 . In the application environment, the remote control device 102 can send a remote control signal to the controlled device 104 to control the controlled device 104 to perform various actions. The remote control signal can be an optical signal (such as an infrared signal) or an acoustic signal, or other forms of signals; the remote control signal can be a short-range remote control signal, such as an infrared signal, or a long-range remote control signal, such as a signal transmitted through a network. The remote control device 102 and the controlled device 104 in Figure 1 are taken as examples of a smart speaker and a television, but the remote control device 102 and the controlled device 104 are not limited thereto. The remote control device 102 can be a dedicated device, such as a remote controller, or can be acted by other electronic devices (such as a smart phone, a smart speaker, etc.). The controlled device 104 can be a household appliance such as a television, a radio, an air conditioner, a water heater, a washing machine, etc., but is not limited to household appliances, such as industrial equipment. The controlled device 104 can also be another electronic device of the same type as the remote control device 102, for example, the remote control device 102 is a smart speaker, and the controlled device 104 can be another smart speaker.

[0045] In some example embodiments, as shown in Figure 2 , a method for controlling a remote control device is provided, which is taken as an example of the remote control device to illustrate, comprising the following steps:

[0046] Step 202, receiving the current remote control instruction.

[0047] Here, the current remote control instruction can be an instruction triggered by the user this time for instructing the remote control device to send a remote control signal to the controlled device. For example, the current remote control instruction can be an instruction for remote control recognized based on a voice command or an instruction for remote control recognized based on a video image, or an instruction triggered by the user operating a key or a touch screen on the remote control device.

[0048] Specifically, in some scenarios, for example, the remote control device 102 is acted by other electronic devices, the remote control device can analyze the current received instruction to determine whether the received instruction is a remote control instruction, and if so, determine that the current remote control instruction is received. The way to determine whether the received instruction is a remote control instruction can use the existing way, which is not described here. In some other scenarios, for example, the remote control device 102 is a device dedicated to remote control, it can also not need to determine whether the current received instruction is a remote control instruction, that is, the current received instruction is taken as the current remote control instruction.

[0049] Step 204, determine the user perception time difference corresponding to the current remote control instruction, which is the difference between the time when the remote control device receives a remote control instruction matching the current remote control instruction and the time when the controlled device responds to the remote control signal corresponding to the matching remote control instruction to perform a user-perceptible action. The matching remote control instruction is a remote control instruction instructing the controlled device to perform the same instruction action.

[0050] Here, the matching remote control instruction can include the same remote control instruction, or a remote control instruction that although the remote control instruction is not the same, instructs the controlled device to perform the same instruction action. For example, "turn on the TV", "turn on the TV" and "turn on the TV" are all remote control instructions instructing the TV to perform the power-on action, and these remote control instructions are matching remote control instructions.

[0051] Here, the user-perceptible action can be different for different remote control instructions or different controlled devices, for example, it can be displaying a picture, playing a sound, or opening an air outlet, etc. For example, the current remote control instruction is a command to turn on the TV, and the user perception time difference corresponding to the command is the difference between the time when the remote control device receives the command to turn on the TV and the time when the TV responds to the remote control signal corresponding to the command to display a picture.

[0052] Here, the user perception time difference can be pre-set according to an empirical value, but is not limited to this way, for example, can also be determined according to historical feedback information of the remote-controlled device. As a non-limiting example, the remote control device can store a pre-established association between the remote control instruction and the user perception time difference, determine the user perception time difference corresponding to the current remote control instruction according to the association, but the storage location of the association is not limited to the remote control device, for example, it can also be stored in other terminals or servers that the remote control device can communicate with.

[0053] Step 206, in response to the remote control device receiving the remote control instruction matching the current remote control instruction within the user perception time difference corresponding to the current remote control instruction before receiving the current remote control instruction, the current remote control instruction is not executed.

[0054] In the conventional way, generally, after receiving the remote control instruction, the remote control signal corresponding to the remote control instruction (or information in the remote control instruction) is sent to the remote-controlled device according to the remote control instruction. This process can be called execution of the remote control instruction. Here, not executing the current remote control instruction makes the remote control device no longer send the remote control signal corresponding to the current remote control instruction to the remote-controlled device.

[0055] For example, the time of receiving the current remote control instruction is 2022.6.1210:35:11, the user perception time difference corresponding to the current remote control instruction is 3 seconds, and 2022.6.1210:35:09 the remote control device also receives a remote control instruction matching the current remote control instruction, for example, both are "turn on the TV" command, or the current remote control instruction is "turn on the TV" command, 2022.6.1210:35:09 the remote control device also receives a command to turn on the TV. Since 2022.6.1210:35:09 is 3 seconds before 2022.6.1210:35:11, the execution of the command received at 2022.6.1210:35:11 is terminated, that is, the command received at 2022.6.1210:35:11 is not converted into a remote control signal and sent to the TV.

[0056] 10:35:11 this time received "turn on the TV" command, that is, the "turn on the TV" command received at 2022.6.1210:35:11 will not be converted into a remote control signal and sent to the TV.

[0057] In the method for controlling the remote control device, when the current remote control instruction is received, instead of directly executing the current remote control instruction, a user perception time difference corresponding to the current remote control instruction is determined, i.e. a difference between a time when the remote control device receives a remote control instruction matching the current remote control instruction and a time when the remote control signal corresponding to the matching remote control instruction is responded to by the controlled device to execute a user-perceivable action, the matching remote control instruction being a remote control instruction instructing the controlled device to execute the same instruction action, and if the remote control device receives the remote control instruction matching the current remote control instruction within the user perception time difference before receiving the current remote control instruction, the current remote control instruction is not executed. In this way, the misoperation of the controlled device caused by the user repeatedly triggering the remote control instruction corresponding to the same instruction action without perceiving the response of the controlled device to the corresponding remote control signal can be prevented.

[0058] Take the user controlling the TV through the smart speaker as an example. Before the method of the example embodiment of the present disclosure is adopted, the user says "turn on the TV" to the smart speaker for the first time, the smart speaker sends an infrared remote control signal to the TV, but the TV is slow to respond and the picture has not appeared, the user will think that the TV has not been turned on, resulting in the user saying "turn on the TV" to the smart speaker for the second time in a short period of time, the smart speaker sends an infrared remote control signal to the TV again, which causes the TV to be turned off. After the method of the example embodiment of the present disclosure is adopted, if the user says "turn on the TV" to the smart speaker for the second time, if it is determined that there is a first "turn on the TV" within a set time period (the set time period is the difference between the time when the smart speaker receives "turn on the TV" and the time when the TV responds to the remote control signal corresponding to "turn on the TV" to display the picture) before receiving the second "turn on the TV", the second "turn on the TV" is not executed, avoiding the TV being turned off due to the second "turn on the TV". It should be noted that, here, the same remote control instruction "turn on the TV" is taken as an example for the user to say to the smart speaker for the first time and for the user to say to the smart speaker for the second time, but as described above, it is not limited thereto, for example, the user says "turn on the TV" to the smart speaker for the first time, and says "turn on the TV" to the smart speaker for the second time, because "turn on the TV" and "turn on the TV" are both remote control instructions instructing the TV to execute the power-on action, and when the corresponding conditions are met, the second "turn on the TV" is not executed, avoiding the TV being turned off due to the second "turn on the TV".

[0059] In some example embodiments of the present disclosure, the above-mentioned current remote control instruction and the remote control instruction corresponding to at least another instruction action of the remote controlled device share the same remote control signal. That is, the method for controlling the remote control device in these example embodiments is applied to a scenario in which the remote control commands for triggering multiple instruction actions of the remote controlled device share the same remote control signal, for example, the power-on operation or the power-off operation of the electronic device generally share the same remote control signal. In this case, the corresponding user perception time difference can be set for the remote control instructions corresponding to the multiple instruction actions sharing the same remote control signal. Generally, the time for the remote controlled device to respond to the remote control signals corresponding to different instruction actions to perform actions that can be perceived by the user can be different, and accordingly, the user perception time difference corresponding to each of the multiple instruction actions can be set respectively. For example, for the case where the remote control signal S is shared by instruction action A and instruction action B, the user perception time difference T1 corresponding to instruction action A and the user perception time difference T2 corresponding to instruction action B can be set. Among them, the user perception time difference T1 corresponding to instruction action A, that is, the user perception time difference T1 corresponding to the remote control instruction indicating the remote controlled device to perform instruction action A, and the user perception time difference corresponding to instruction action B, that is, the user perception time difference corresponding to the remote control instruction indicating the remote controlled device to perform instruction action B.

[0060] In the scenario in which the remote control commands for triggering multiple instruction actions of the remote controlled device share the same remote control signal, since the remote control command corresponding to a certain instruction action in the remote control commands sharing the same remote control signal can be repeatedly triggered, it can lead to an action result different from or completely opposite to the user's expected action, for example, the user expects to turn on the TV, but it results in the TV being turned off, therefore, the example embodiments of the present disclosure for this scenario can especially avoid the remote controlled device generating an action inconsistent with the user's expectation.

[0061] The method for controlling a remote control device in some example embodiments of the present disclosure can further include the step of: executing the current remote control instruction in response to the current remote control instruction not being a remote control instruction for which a user perception time difference needs to be determined. With the method in these example embodiments, a corresponding user perception time difference can be set for only part of the remote control instructions, for example, a remote control instruction for which a user perception time difference is shorter can not be set with a corresponding user perception time difference. For a remote control instruction for which a user perception time difference does not need to be determined, the above-mentioned one or more determination steps or judgment steps can be skipped and the step of executing the current remote control instruction can be directly performed. The remote control instructions for which a user perception time difference needs to be determined can be distinguished by setting a label. With the method in these example embodiments, the response speed of more remote control instructions can be taken into account while avoiding the repeated triggering of some specific remote control instructions causing misoperation of the remote control device, which can be multiple remote control instructions sharing the same remote control signal, or remote control instructions for which a corresponding user perception time difference is longer, etc.

[0062] The method for controlling a remote control device in some example embodiments of the present disclosure can further include the step of: executing the current remote control instruction in response to the remote control device not receiving a remote control instruction matching the current remote control instruction within a user perception time difference before receiving the current remote control instruction.

[0063] Still taking the time of receiving the current remote control instruction as 2022.6.1210:35:11 and the user perception time difference corresponding to the current remote control instruction as 3 seconds as an example, if it is found that no remote control instruction matching the current remote control instruction has been received within 3 seconds before 2022.6.1210:35:11, the current remote control instruction is executed.

[0064] In some example embodiments of the present disclosure, as shown in Figure 3 the above-mentioned determination of the user perception time difference corresponding to the current remote control instruction can include the following steps:

[0065] Step 302, identifying the remote control device identification information and instruction action information of the current remote control instruction.

[0066] As a non-limiting example, the information carried in the current remote control instruction can be analyzed to identify the remote-controlled device identification information and the instruction action information of the current remote control instruction. For example, the current remote control instruction is a voice command, and the voice command can be text-recognized to obtain text information, and then the text information can be input into a pre-established artificial intelligence model for semantic recognition to obtain the remote-controlled device identification information and the instruction action information of the current remote control instruction. The remote-controlled device identification information and the instruction action information of the current remote control instruction can also be determined according to the associated information of the current remote control instruction. For example, according to the preset configuration information, different remote control instructions can be pre-associated with different instruction actions and corresponding remote-controlled devices, and the remote-controlled device identification information and the instruction action information of the current remote control instruction can be determined by analyzing these relationship information.

[0067] In step 304, the user perception time difference corresponding to the current remote control instruction is determined according to the remote-controlled device identification information and the instruction action information.

[0068] Specifically, an association relationship among the remote-controlled device identification information, the instruction action information, and the user perception time difference can be pre-established, and the user perception time difference corresponding to the current remote control instruction can be determined in combination with the association relationship and the remote-controlled device identification information and the instruction action information identified from the current remote control instruction.

[0069] The embodiment scheme can be applied to a scenario of remotely controlling different electronic devices using the same remote control device, for example, a scenario of remotely controlling different household appliances using a smart sound box, thereby further improving the applicability of the scheme.

[0070] The artificial intelligence model described above can be an NLP (Natural Language Processing) semantic analysis model. The artificial intelligence model can be obtained by training. Here, "obtained by training" means that a basic artificial intelligence model with multiple training data is trained by a training algorithm, thereby obtaining a predefined operation rule or artificial intelligence model configured to perform a required feature (or purpose). As an example, the artificial intelligence model can include multiple neural network layers. Each of the multiple neural network layers includes multiple weight values, and performs neural network calculation by calculation between the calculation result of the previous layer and the multiple weight values. Language analysis is a technology of recognizing and applying / processing human language / text, including, for example, natural language processing, machine translation, dialogue system, question and answer, or speech recognition / synthesis.

[0071] Exemplarily, first, the subject information in the current remote control instruction can be identified using NER (Named Entity Recognition) technology or regular expressions. For example, the subject information (corresponding to the remote-controlled device identification information) of "turn on the TV" is "TV". Then, POS tagging (Part Of Speech tagging) can be used. For example, the action (corresponding to the instruction action information) of "turn on the TV" is "turn on".

[0072] In combination with some of the exemplary embodiments described above, as shown in Figure 4 A method for controlling a remote control device is provided, which is applied to a remote control device as an example and includes the following steps:

[0073] Step 402, receiving the current remote control instruction.

[0074] In the method, after receiving the current remote control instruction, the receiving time information of the current remote control instruction can be recorded.

[0075] Step 404, identifying the remote-controlled device identification information and the instruction action information of the current remote control instruction.

[0076] In the method, after identifying the remote-controlled device identification information and the instruction action information of the current remote control instruction, the identified remote-controlled device identification information and the instruction action information can be recorded.

[0077] To avoid the redundancy of recorded information, the method for controlling a remote control device in some exemplary embodiments of the present disclosure can further include the step of deleting the remote control instruction record information with a record duration exceeding a set duration, the set duration being greater than the user perception time difference, and the remote control instruction record information including the remote-controlled device identification information, the instruction action information and the receiving time information corresponding to the remote control instruction. Here, the set duration being greater than the user perception time difference can ensure the reliability of the algorithm. In the case where there are multiple user perception time differences corresponding to multiple remote control instructions, the set duration can be greater than the maximum value of the user perception time differences corresponding to the multiple remote control instructions. In this way, the redundancy of recorded information can be avoided, the reliability of the algorithm can be ensured, and the complexity of the algorithm can not be increased.

[0078] Step 406, determining whether there is a user perception time difference corresponding to the current remote control instruction according to the remote-controlled device identification information and the instruction action information. If yes, go to step 408; if no, go to step 412.

[0079] Specifically, it is determined whether there is a user perception time difference corresponding to the remote control device identification information and the instruction action information identified in step 404, i.e., a user perception time difference corresponding to the current remote control instruction.

[0080] Step 408, it is determined whether the remote control device receives a remote control instruction matching the current remote control instruction within the user perception time difference corresponding to the current remote control instruction before receiving the current remote control instruction. If yes, go to step 410, if no, go to step 412.

[0081] In some example embodiments of the present disclosure, it can be determined whether two remote control instructions match based on the remote control device identification information and the instruction action information of the two remote control instructions. Specifically, the method of some example embodiments of the present disclosure can further include the step of: in response to the remote control device information of the current remote control instruction and the remote control device identification information of another remote control instruction both corresponding to the same remote control device, and the instruction action information of the current remote control instruction and the instruction action information of another remote control instruction both corresponding to the same instruction action, determining that the current remote control instruction and another remote control instruction match.

[0082] For example, "TV", "television" and "television set" can all correspond to the same remote control device, i.e., a television set, and "turn on", "turn on" and "play" can all correspond to the same instruction action, i.e., turning on.

[0083] The way of determining whether two remote control instructions match based on the remote control device identification information and the instruction action information of the two remote control instructions can be applied not only in step 408, but also in the step of "determining the user perception time difference corresponding to the current remote control instruction". For example, the user perception time difference corresponding to "turning on the television" is stored, and the current remote control instruction is "turn on TV". It can be determined that "turn on the television" and "turn on TV" match according to the way of determining whether two remote control instructions match, and then the user perception time difference corresponding to "turn on the television" can be used as the user perception time difference corresponding to "turn on TV".

[0084] Step 410, do not execute the current remote control instruction.

[0085] Step 412, execute the current remote control instruction.

[0086] For example, the remote control device identification information and the instruction action information of the current remote control instruction can be used to generate a control instruction, and the control instruction can be encoded into a remote control signal and sent to the remote control device.

[0087] The method in some example embodiments of the present disclosure further comprises a user perception time difference determining step, which can be initiated when it is first required to determine the user perception time difference, or can be initiated again in some specific scenarios, for example, can be initiated when the user perception time difference corresponding to a certain remote control instruction fluctuates greatly. As shown in Figure 5 The user perception time difference determining step can comprise the following steps:

[0088] Step 502, obtaining a plurality of recorded historical time difference values, the historical time difference value being a recorded difference between a first historical time when a historical remote control instruction is received by the remote control device and a second historical time when the controlled device performs a user-perceptible action in response to the historical remote control instruction, the historical remote control instruction being a matching remote control instruction of the current remote control instruction.

[0089] The second historical time can be obtained in multiple ways, two example ways are provided as follows:

[0090] Way one, determining the second historical time according to feedback information sent by the controlled device to the remote control device after the controlled device performs a user-perceptible action in response to the remote control signal corresponding to the historical remote control instruction.

[0091] Way two, determining the second historical time according to image recognition information or audio recognition information of the controlled device.

[0092] For example, some remote control devices have certain image recognition capabilities or audio recognition capabilities, which can detect whether the corresponding controlled device performs a user-perceptible action through the image recognition function or the audio recognition function of the remote control device. For example, identifying whether the controlled device displays a picture, plays a specified audio, or whether the air outlet of the air conditioner is opened through image recognition, etc. In addition, the image recognition information or the audio recognition information of the controlled device here can be recognized by the remote control device, or can be recognized by other devices.

[0093] Step 504, determining the user perception time difference by taking the average value or the maximum value of the plurality of historical time difference values.

[0094] Here, the number of historical time difference values can be selected according to actual needs, for example, 5.

[0095] The following describes the method for controlling a remote control device according to an example embodiment of the present disclosure, taking the example of a smart speaker remotely controlling a television set. In the following example, the user perception time difference corresponding to different remote control instructions of the same controlled device (for example, the television set described below) is not distinguished, but this does not constitute a limitation on the present disclosure.

[0096] First, a pre-operation can be performed: set the user perception time difference corresponding to each subject device according to the experience value, for example, the time difference between receiving a remote control instruction from a smart speaker and the subject device (corresponding to the above-mentioned remote-controlled device) executing an action that the user can perceive (such as presenting a TV picture). The user perception time difference record table corresponding to the subject device is shown in Table 1:

[0097] Table 1

[0098] Device ID Device Name Action IR Remote Control Operation User Perceived Time Difference D001 TV Turn ON or OFF Yes 3s

[0099] In this example, the method for controlling the remote control device can include the following steps:

[0100] Step 1: The smart speaker identifies whether the current voice command is an infrared remote control operation instruction

[0101] After the smart speaker receives the user's voice command "turn on the TV", it uses ASR (Automatic Speech Recognition) technology to convert the voice information into text. After converting into text, the next step of semantic analysis of the voice command (text) can be performed using an AI (Artificial Intelligence) model. Among them, the semantic analysis of the voice command (text) can be performed in the NLP semantic analysis mode. As mentioned above, first, the subject information of the instruction can be identified using NER technology or regular expressions. For example, "turn on the TV": "TV". Second, the instruction action information is identified using POStagging. For example, "turn on the TV": "turn on".

[0102] After the AI model performs semantic analysis on the voice command (text), it can identify the user's intent.

[0103] The semantic analysis result and the time are recorded, and this time the 002 record is recorded. In order to avoid instruction redundancy, the instruction record with a saved time exceeding T can be deleted. Among them, T is greater than the maximum value of "user perception time difference" in the user perception time difference record table.

[0104] Table 2

[0105]

[0106] According to the semantic analysis result, the user perception time difference record table corresponding to the subject device can be queried to determine that the current voice command ("turn on the TV") is an infrared remote control operation instruction.

[0107] Step 2: Determine the user perception time difference of the infrared remote control operation.

[0108] According to the semantic analysis result in step one, it can be known that the subject of the voice command "turn on the TV" is "TV" and the action is "turn on". According to the "user perceived time difference record table", it can be known that the user perceived time difference of the current 002 command is 3 seconds.

[0109] Step three: the smart speaker analyzes whether there is another same voice instruction within the user perceived time difference.

[0110] The current instruction is 002 command, and within the time period of 3 seconds before the user perceived time difference, it is known through the query that there is another 001 command. If the subject information ("TV") and the instruction action information ("turn on") of the two instructions are matched, it is judged that the 002 command and the 001 command are matched instructions, otherwise it is judged as different instructions.

[0111] Step four: if the two instructions within the user perceived time difference are matched, the current instruction is not executed, otherwise the current instruction is executed.

[0112] According to the judgment result of step three: if the current instruction matches the previous instruction within the user perceived time difference, the current instruction is not further processed; otherwise, the smart speaker generates a corresponding control instruction according to the semantic analysis result in step one, and converts the remote control code corresponding to the control instruction into an infrared signal and sends it to the TV to control the TV.

[0113] It should be understood that, although Figure 2-5 the steps in the flowchart are displayed in sequence according to the arrow, these steps are not necessarily executed in sequence according to the arrow. Unless otherwise specified in this article, the execution of these steps has no strict order restriction, and these steps can be executed in other orders. Moreover, Figure 2-5 at least part of the steps in the flowchart can include multiple sub-steps or multiple stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution order of these sub-steps or stages is not necessarily sequential, but can be executed with at least part of other steps or other steps Sub-steps or stages of the stage are executed in rotation or alternation.

[0114] In one embodiment, as Figure 6As shown, a remote control device is provided, comprising: a command receiving module 602, a user perceived time difference determining module 604 and an executing module 606, wherein: the command receiving module 602 is configured to receive a current remote control instruction; the user perceived time difference determining module 604 is configured to determine a user perceived time difference corresponding to the current remote control instruction, the user perceived time difference being a difference between a time at which a matching remote control instruction is received from the remote control device and a time at which a remote control signal corresponding to the matching remote control instruction is responded by the controlled device to execute a user-perceived action, the matching remote control instruction being a remote control instruction indicating the controlled device to execute a same instruction action; and the executing module 606 is configured to, in response to the remote control device receiving the matching remote control instruction within the user perceived time difference before receiving the current remote control instruction, not execute the current remote control instruction.

[0115] In some example embodiments of the present disclosure, the current remote control instruction shares a same remote control signal with at least one remote control instruction corresponding to another instruction action of the controlled device.

[0116] In some example embodiments of the present disclosure, the executing module 606 is further configured to, in response to the current remote control instruction not being a remote control instruction for which the user perceived time difference is required to be determined, execute the current remote control instruction.

[0117] In some example embodiments of the present disclosure, the executing module 606 is further configured to, in response to the remote control device not receiving the matching remote control instruction within the user perceived time difference before receiving the current remote control instruction, execute the current remote control instruction.

[0118] In some example embodiments of the present disclosure, the user perceived time difference determining module 604 identifies controlled device identification information and instruction action information of the current remote control instruction, and determines the user perceived time difference corresponding to the current remote control instruction according to the controlled device identification information and the instruction action information.

[0119] In some example embodiments of the present disclosure, the executing module 606 and / or the user perceived time difference determining module 604 are further configured to, in response to the controlled device information of the current remote control instruction and the controlled device identification information of another remote control instruction both corresponding to a same controlled device, and the instruction action information of the current remote control instruction and the instruction action information of the another remote control instruction both corresponding to a same instruction action, determine that the current remote control instruction matches the another remote control instruction.

[0120] In some example embodiments of the present disclosure, the executing module 606 generates a control instruction according to the controlled device identification information and the instruction action information of the current remote control instruction, and sends the control instruction to the controlled device after encoding the control instruction into a remote control signal.

[0121] In some example embodiments of the present disclosure, the device described above further comprises a deletion module (not shown in the figure) configured to delete the remote control instruction record information whose record duration exceeds a set duration, the set duration being greater than the user perception time difference, and the remote control instruction record information comprising the remote-controlled device identification information, the instruction action information and the receiving time information corresponding to the remote control instruction.

[0122] In some example embodiments of the present disclosure, when there are multiple user perception time differences corresponding to multiple remote control instructions, the set duration is greater than the maximum value of the user perception time differences corresponding to the multiple remote control instructions.

[0123] In some example embodiments of the present disclosure, the device described above further comprises a perception time difference identification module (not shown in the figure) configured to obtain multiple historical time difference values recorded, the historical time difference value being the difference between the first historical time when a historical remote control instruction is received from a remote control device and the second historical time when a user-perceivable action is performed by a remote-controlled device in response to the historical remote control instruction, the historical remote control instruction being a matching remote control instruction of the current remote control instruction, and the user perception time difference being determined by taking the average or maximum value of the multiple historical time difference values.

[0124] In some example embodiments of the present disclosure, the perception time difference identification module determines the second historical time according to feedback information sent by the remote-controlled device to the remote control device after the remote-controlled device performs a user-perceivable action in response to the remote control signal corresponding to the historical remote control instruction; or, the perception time difference identification module determines the second historical time according to image recognition information or audio recognition information of the remote-controlled device.

[0125] The specific limitations of the device for controlling the remote control device can be referred to the limitations of the method for controlling the remote control device described above, which will not be repeated here. Each module in the device for controlling the remote control device described above can be realized by software, hardware and their combinations in whole or in part. Each module described above can be embedded in or independent of the processor in the electronic device in hardware form, or stored in the memory in the electronic device in software form, so as to be called and executed by the processor to perform the operations corresponding to each module.

[0126] In some example embodiments of the present disclosure, an electronic device is provided, which can be a device dedicated to remote control, or can be a terminal device such as a smart phone or a smart speaker, and its internal structure diagram can be as shown in Figure 7The electronic device includes a processor, a memory, a communication unit, and a user interface connected through a system bus. The processor of the electronic device is configured to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operating system and the computer program in the non-volatile storage medium to run. The computer program is executed by the processor to implement a method for controlling a remote control device.

[0127] The user interface of the electronic device is configured to receive various user interactions for controlling the remote control device or the remote control device. The user interface can include a key, a microphone, a camera, or a control panel. The microphone can be configured to receive user voice or other sound input and convert the received voice or sound into audio data. The processor can convert the user voice input through the microphone into audio data, or use the audio data as a control command according to the user voice. The camera is configured to capture still images or moving images according to user control or program settings. Specifically, the camera can capture images of user actions to control the remote control device or the remote control device. The control panel can be a touch layer overlaid on a display screen, or a key, trackball, or touchpad provided on the housing of the electronic device, or an external keyboard, touchpad, mouse, etc. The communication unit of the electronic device is configured to communicate with external electronic devices, such as the remote control device, for example, to send remote control signals to the remote control device, or to receive feedback information from the remote control device, etc.

[0128] Those skilled in the art can understand that Figure 7 The structure shown in the figure is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the electronic device to which the scheme of the present application is applied. The specific electronic device can include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0129] In some example embodiments of the present disclosure, an electronic device is provided, including a memory, a processor, and a computer program stored on the memory and executable on the processor, and the processor implements the steps of the method for controlling a remote control device in any one of the example embodiments described above when executing the computer program.

[0130] In some example embodiments of the present disclosure, a computer readable storage medium is provided, which stores a computer program, and the processor implements the steps of the method for controlling a remote control device in any one of the example embodiments described above when executing the computer program.

[0131] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when the computer program is executed, the processes of the above-mentioned embodiments of the methods can be included. Any reference to memory, storage, databases, or other media in the embodiments provided by the present application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration but not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0132] The technical features of the above embodiments can be combined in any way. In order to make the description simple, not all possible combinations of the technical features in the above embodiments are described, but as long as the combinations of the technical features do not exist, they should be considered as the scope of the present application.

[0133] The above embodiments only express several implementation manners of the present application, and the description is more specific and detailed, but it should not be understood as a limitation on the scope of the patent. It should be pointed out that for ordinary skilled in the art, without departing from the concept of the present application, some modifications and improvements can be made, which are all within the scope of the present application. Therefore, the scope of the patent of the present application should be subject to the appended claims.

Claims

1. A method for controlling a remote control device, the method comprising: receiving a current remote control instruction; determining a user perceived time difference corresponding to the current remote control instruction, the user perceived time difference being a difference between a time at which a matching remote control instruction is received from the remote control device and a time at which a remote control signal corresponding to the matching remote control instruction is responded by a controlled device to perform a user-perceivable action, the matching remote control instruction being a remote control instruction instructing the controlled device to perform a same instruction action; in response to the remote control device receiving the matching remote control instruction within the user perceived time difference before receiving the current remote control instruction, not executing the current remote control instruction.

2. The method of claim 1, wherein, The current remote control instruction shares a same remote control signal with at least a remote control instruction corresponding to another instruction action of the controlled device.

3. The method according to claim 1 or 2, characterized in that, The method further comprising: in response to the current remote control instruction not being a remote control instruction for which a user perceived time difference is required to be determined, executing the current remote control instruction; and / or in response to the remote control device not receiving the matching remote control instruction within the user perceived time difference before receiving the current remote control instruction, executing the current remote control instruction.

4. The method according to claim 1 or 2, characterized in that, The determining the user perceived time difference corresponding to the current remote control instruction comprises: identifying controlled device identification information and instruction action information of the current remote control instruction; determining the user perceived time difference corresponding to the current remote control instruction according to the controlled device identification information and the instruction action information.

5. The method of claim 4, wherein, The method further comprising: in response to the controlled device information of the current remote control instruction and the controlled device identification information of another remote control instruction both corresponding to a same controlled device, and the instruction action information of the current remote control instruction and the instruction action information of the another remote control instruction both corresponding to a same instruction action, determining that the current remote control instruction matches the another remote control instruction.

6. The method of claim 4, wherein, The executing the current remote control instruction comprises: generating a control instruction with the controlled device identification information and the instruction action information of the current remote control instruction, and sending the control instruction to the controlled device after encoding the control instruction into a remote control signal.

7. The method of claim 4, wherein, The method further comprising: deleting remote control instruction record information with a record duration exceeding a set duration, the set duration being greater than the user perceived time difference, the remote control instruction record information including controlled device identification information, instruction action information and receiving time information of a corresponding remote control instruction.

8. The method of claim 7, wherein, In a case where there are multiple user perceived time differences corresponding to multiple remote control instructions, the set duration is greater than a maximum value of the multiple user perceived time differences corresponding to the multiple remote control instructions.

9. The method of claim 1 or 2, wherein, The method further comprising: obtaining multiple recorded historical time difference values, the historical time difference value being a difference between a first historical time at which a historical remote control instruction is received from the remote control device and a second historical time at which the controlled device responds to the historical remote control instruction to perform a user-perceivable action, the historical remote control instruction being a matching remote control instruction of the current remote control instruction; determining the user perceived time difference by averaging or maximizing the multiple historical time difference values.

10. The method of claim 9, wherein, The method further comprises: determining the second historical time according to feedback information sent by the remote-controlled device after the remote-controlled device performs a user-perceptible action in response to the historical remote control instruction corresponding remote control signal; or determining the second historical time according to image recognition information or audio recognition information of the remote-controlled device.

11. An apparatus for controlling a remote control device, characterized by The device comprises: a command receiving module configured to receive a current remote control instruction; a user-perceptible time difference determining module configured to determine a user-perceptible time difference corresponding to the current remote control instruction, the user-perceptible time difference being a difference between a time when a remote control device receives a remote control instruction matching the current remote control instruction and a time when the remote-controlled device performs a user-perceptible action in response to a remote control signal corresponding to the matching remote control instruction, the matching remote control instruction being a remote control instruction indicating the remote-controlled device to perform the same instruction action; an executing module configured to, in response to the remote control device receiving a remote control instruction matching the current remote control instruction within the user-perceptible time difference before receiving the current remote control instruction, not execute the current remote control instruction.

12. The apparatus of claim 11, wherein, The current remote control instruction shares a same remote control signal with at least one remote control instruction corresponding to another instruction action of the remote-controlled device.

13. The device of claim 11 or 12, wherein: the executing module is further configured to, in response to the current remote control instruction not being a remote control instruction requiring determination of a user-perceptible time difference, execute the current remote control instruction; and / or the executing module is further configured to, in response to the remote control device not receiving a remote control instruction matching the current remote control instruction within the user-perceptible time difference before receiving the current remote control instruction, execute the current remote control instruction.

14. The apparatus of claim 11 or 12, wherein, The user-perceptible time difference determining module is configured to identify remote-controlled device identification information and instruction action information of the current remote control instruction, and determine the user-perceptible time difference corresponding to the current remote control instruction according to the remote-controlled device identification information and the instruction action information.

15. The apparatus of claim 14, wherein, The user-perceptible time difference determining module and / or the executing module are further configured to, in response to remote-controlled device information of the current remote control instruction and remote-controlled device identification information of another remote control instruction both corresponding to a same remote-controlled device, and instruction action information of the current remote control instruction and instruction action information of the another remote control instruction both corresponding to a same instruction action, determine that the current remote control instruction matches the another remote control instruction.

16. The apparatus of claim 14, wherein, The executing module is further configured to generate a control instruction with the remote-controlled device identification information and the instruction action information of the current remote control instruction, and send the control instruction to the remote-controlled device after encoding the control instruction into a remote control signal.

17. The apparatus of claim 14, wherein, The device further comprises: a deleting module configured to delete remote control instruction record information with a record duration exceeding a set duration, the set duration being greater than the user-perceptible time difference, the remote control instruction record information including remote-controlled device identification information, instruction action information, and receiving time information corresponding to a remote control instruction.

18. The apparatus of claim 17, wherein, The set time period is greater than a maximum of the user perception time differences corresponding to the plurality of remote control instructions.

19. The apparatus of claim 11 or 12, wherein, The device further comprises: The perception time difference identification module is configured to obtain a plurality of recorded historical time difference values, the historical time difference value being a difference value between a first historical time when a historical remote control instruction is received from the remote control device and a second historical time when the remotely controlled device performs a user-perceivable action in response to the historical remote control instruction, the historical remote control instruction being a matching remote control instruction of the current remote control instruction, and the user perception time difference being determined by taking an average or a maximum of the plurality of historical time difference values.

20. The device of claim 19, wherein: The perception time difference identification module determines the second historical time according to feedback information sent by the remotely controlled device to the remote control device after the remotely controlled device performs a user-perceivable action in response to a remote control signal corresponding to the historical remote control instruction; Or The perception time difference identification module determines the second historical time according to image recognition information or audio recognition information of the remotely controlled device.

21. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein, The processor, when executing the computer program, implements the steps of the method of any one of claims 1 to 10.

22. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program, when executed by the processor, implements the steps of the method of any one of claims 1 to 10.

Images