Computer-implemented method for a system comprising a remote control for controlling an external device, and the external device

Abstract

The invention relates to a computer-implemented method (100) for a system comprising a remote control (200) for controlling an external device (300) and the external device (300), said method comprising the steps of: receiving (110), by means of the remote control (200), a first control input from a user (600) which characterises a first remote control command for remote control of the external device (300), wherein the first remote control command is designed to actuate at least a first unit (341) of a plurality of units (341-343) of the device (300) by means of the device (300); determining (120) a first latency in conjunction with the actuation of the first unit (341) and the first remote control command; modifying (130) the first remote control command on the basis of the first latency and an exceeding of a predetermined latency threshold value for the first unit (341), of a plurality of latency threshold values for the plurality of units (341-343); and actuating (140), by means of the device, the first unit (341) on the basis of the modified first remote control command.

Description

[0001] Computer-implemented method for a system comprising a remote control for controlling an external device and the external device

[0002] The invention relates to a computer-implemented method for a system comprising a remote control for controlling an external device and the external device, a system comprising the remote control and the external device with respective means for carrying out the method, the remote control, the external device, associated computer-implemented methods for the remote control or the external device, and respective computer program products.

[0003] With remote control systems, a user, such as a machine operator, can perform driving and / or work tasks not only from the driver's cab, but also from outside a remotely controlled external device such as a machine, or sometimes even from other locations. Such systems often establish radio communication with a control unit on the vehicle, which implements the user's commands so that the vehicle follows these instructions. A key advantage here is that the vehicle can be viewed from a location other than the driver's cab, allowing the work task to be performed more effectively.

[0004] The time that elapses between the input of the command and the corresponding response of the system is also called “latency”.

[0005] The higher this latency, the more difficult it becomes for a user to control the system so that it meets expectations for the driving / work task. This also applies when this latency changes continuously and the system response can therefore be very unexpected. The reason for this is that with a high latency, the system does not respond directly to the user's instructions, but rather exhibits a time delay in implementing the instructions. This makes intuitive and precise control by a human extremely difficult. Furthermore, the quality of the work result can suffer. Prior art is known from EP 3 706 426 A1, disclosing a remote control system for a forklift truck, comprising a forklift truck which includes a vehicle communication unit, and a remote control device which includes a remote communication unit.The remote communication unit is configured to perform wireless communication with the vehicle communication unit. The remote communication unit is used for remote control of the forklift. A wireless vehicle CPU of the forklift calculates an accumulated delay time corresponding to a difference between a reception period required to receive a plurality of remote control signals and a generation period required to generate the plurality of remote control signals. The vehicle CPU performs communication delay determination to determine whether a communication delay has been caused or not based on the accumulated delay time.

[0006] It is an object of the present invention to provide a computer-implemented method for a system comprising a remote control and an external device, such a system, a computer-implemented method for a remote control, such a remote control, a computer-implemented method for an external device, and such an external device that solve one or more of the aforementioned disadvantages. In particular, it is an object of the present invention to enable process- and / or situation-appropriate control of the external device by means of the remote control with increased latency.

[0007] According to a first aspect, the object is achieved by a computer-implemented method for a system comprising a remote control for controlling an external device and the external device. The method comprises receiving, by means of the remote control, a first control input from a user, which characterizes a first remote control command for remotely controlling the external device. The first remote control command is designed to control at least a first unit of a plurality of units of the device by means of the device. The method further comprises determining a first latency in connection with the control of the first unit and the first remote control command. The method further comprises modifying the first remote control command based on the first latency and an exceeding of a latency threshold value predetermined for the first unit of a plurality of latency threshold values ​​for the plurality of units.The method further comprises controlling, by means of the device, the first unit based on the modified first remote control command.

[0008] The inventors have recognized that improved remote control of the external device is possible if a respective latency threshold can be predetermined for each individual unit or a respective subsystem consisting of two or more such units of the device. For example, one unit of the plurality of units may require very fine control, so that even with a relatively slightly increased latency, such fine control is no longer possible. By comparison, there is also a unit of the plurality of units for which such fine control is not necessary and instead a coarser control still leads to a desired quality. Consequently, this coarsely controllable unit can still be easily controlled even with a high latency.To support the user and achieve the best possible quality, at least partially identical and / or different latency thresholds can be set for the individual units of the plurality of units, and the remote control command can be modified based on whether the respective latency threshold is exceeded. Thus, the external device can continue to be controlled at least partially via the remote control even with high latencies.

[0009] The external device can be a device controllable by means of the remote control. The remote control and the device can be designed to communicate by means of wireless and / or wired communication and thus to remotely control the device by means of the remote control. Remote control here can comprise controlling the device by means of the remote control, wherein the user is not located in the device. For example, the user can be positioned next to the device or at a distance from it. The external device can be a vehicle. The first remote control command can be determined based on the first control input. The remote control and / or the device can be designed to determine, based on the first control input, that the at least one first unit is to be controlled in order to implement the first control input.

[0010] Latency can be a delay between an input and an execution associated with the input by the external device, up to the user's perception of the execution. The execution can be a change in an actual state of the first unit, for example, a change in position, speed, etc.

[0011] The latency can be determined continuously and / or at predetermined time intervals. The latency can be determined at least once, in particular multiple times, between a time of receiving the first control input and a time of executing the first unit, in particular a time of perceiving the execution by the user based on the first remote control command. Consequently, a latency can change between the time of the input and the time of actuation, and the first remote control command can be changed based on a current latency. The current latency can differ from a latency at the time of receiving the first control input.

[0012] The multitude of latency thresholds may be at least partially different and / or identical.

[0013] The plurality of latency thresholds can be further based on a respective criticality of each unit of the plurality of units. The criticalities of the plurality of units can be at least partially different and / or identical. The higher the criticality of a respective unit, the lower the respective latency threshold can be. The criticality can evaluate safety, driver comfort, and / or fuel consumption. Consequently, a high criticality can mean that the associated unit and its associated control have a very high impact on safety.

[0014] The criticality can characterize a criticality of the respective unit in a process associated with the control of the respective unit. For example, a lamp in a manufacturing process can generally have a low criticality compared to a tool for manufacturing a product, since the lamp has little to no influence on the manufacturing process compared to the tool. Alternatively or additionally, the criticality can characterize a sensitivity of the control of the respective unit in the process. For example, in the manufacturing process, adjusting the brightness of a lamp using the external device can have a low criticality, since here the supplied current can be doubled without this having a particular influence on the manufacturing process.On the other hand, changing the speed of a tool in the manufacturing process by 10% can already be very critical, so a high criticality is predetermined. Since not all units can be controlled with the same degree of sensitivity or coarseness, this can be taken into account using criticality.

[0015] Modifying the first remote control command may include at least one of the following:

[0016] - modifying a parameter of the first unit associated with the control;

[0017] - changing the parameter to a predetermined first parameter value;

[0018] - modifying the parameter by a predetermined second parameter value; and / or

[0019] - preventing the control.

[0020] The associated parameter can be a drive speed, a drive force, a torque, a power, a position, a direction, or any other parameter of the unit. In the previous example of the manufacturing process, the parameter can be a current supplied to the lamp or the rotational speed of the tool.

[0021] The first latency associated with controlling the first unit may comprise at least a partial time period of a control period, wherein the control period characterizes a period from a time of receiving the first control input to a time of a response of the first unit based on the first remote control command. Corresponding partial time periods may be determined for various processing and / or handling steps of the remote control and the external device. The latency may characterize the control period.

[0022] A partial time period can be defined as a time from the remote control sending the first control input to the external device, where the remote control can read a response from the external device and determine the time difference between sending and receiving the response. Thus, this latency or this partial time period can be assigned to this processing step. Further latencies of further processing steps can be determined. Consequently, one or more individual latencies of individual processing steps and / or a total latency resulting from the individual determined latencies can be considered.

[0023] To determine a partial time period from a time of sending the first remote control command within the external device, for example, a corresponding control of the external device to the first unit, and a time of execution by the first unit based on the first remote control command, a camera can be used that, for example, captures a change in movement based on the first remote control command and a time associated with it. The partial time period can be determined based on the known time of sending the first remote control command and the time of the change in movement.The first latency associated with controlling the first unit may additionally or alternatively comprise at least a perception duration of the user, wherein the perception duration characterizes a time duration from a time of the first unit's response to a time of physical perception by the user. The perception duration may be further characterized by the perception occurring optically and / or acoustically by the user themselves or by an optical and / or acoustic reproduction of the device and a perception of the reproduction by the user. If the user is near the external device and can see it, the speed of light can be used to determine the perception duration. If, for example, the user can only hear the external device but not see it, the speed of sound can be used.If the user is located in a location where they cannot see or hear the external device, a video transmission can be provided through which the user can see the external device. Accordingly, the delay can extend from the time the video is captured until the video is output and finally perceived by the user. The perception time can be predetermined and / or user-defined.

[0024] The first latency can be determined based on a second latency. The second latency can be a latency associated with controlling the first unit and a second remote control command for remotely controlling the external device, and the second remote control command can be characterized by a second control input from the user. The second control input can be made before the first control input. The first latency can correspond to the second latency. The first control input can be identical to or different from the second control input.

[0025] The method may further comprise issuing, via the remote control, a warning message to the user based on the exceedance of the latency threshold predetermined for the first unit before and / or during the activation period. The warning message may be issued visually, acoustically, and / or haptically. This has the advantage that the user is informed before or during activation that a high or significantly changed latency is present. This can alert the user to increased alertness early on, thus preventing potential damage / accidents.

[0026] The first latency can be determined using the remote control or the device, and the first remote control command can be modified using the remote control or the device. If the first latency is determined using the remote control and the first remote control command is modified using the device, the method can further comprise sending latency information characterizing the first latency from the remote control to the device. If the first latency is determined using the device and the first remote control command is modified using the remote control, the method can further comprise sending latency information characterizing the first latency from the device to the remote control. If the first latency is determined using the remote control and the first remote control command is modified using the remote control, the method can further comprise sending the modified remote control command from the remote control to the device.Alternatively, the latency can be determined by means of the device and the first remote control command can be modified by means of the device.

[0027] The remote control can be a mobile device, a laptop, a smart device or another portable device.

[0028] The object is achieved according to a second aspect by a system comprising a remote control for controlling an external device and the external device, wherein the remote control and the external device each comprise means for carrying out the steps of the method according to the first aspect.

[0029] According to a third aspect, the object is achieved by a computer program product comprising commands that cause the system according to the second aspect to carry out the method steps according to the first aspect. According to a fourth aspect, the object is achieved by a computer-implemented method for a remote control for remotely controlling an external device. The method comprises receiving a first control input from a user that characterizes a first remote control command for remotely controlling the external device. The first remote control command is designed to control at least a first unit of a plurality of units of the device by means of the device.The method further comprises modifying the first remote control command based on a first latency associated with controlling the first unit and the first remote control command, and exceeding a latency threshold predetermined for the first unit among a plurality of latency thresholds for the plurality of units. The method further comprises sending the modified first remote control command to the device.

[0030] The method may further comprise determining the first latency or receiving latency information characterizing the first latency from the device.

[0031] The object is achieved according to a fifth aspect by a remote control for remotely controlling an external device, comprising means designed to carry out the method according to the fourth aspect.

[0032] The object is achieved according to a sixth aspect by a computer program product comprising instructions which cause the remote control according to the fifth aspect to carry out the method steps of the method according to the fourth.

[0033] According to a seventh aspect, the object is achieved by a computer-implemented method for an external device that can be remotely controlled by means of a remote control. The method comprises determining a first latency in connection with controlling a first unit of a plurality of units of the external device and a first remote control command for remotely controlling the external device, wherein the first remote control command is based on a control input from a user during the remote control. Alternatively or additionally, the method comprises modifying the first remote control command based on the first latency and exceeding a latency threshold value predetermined for the first unit of a plurality of latency threshold values ​​for the plurality of units. Alternatively or additionally, the method comprises receiving a modified first remote control command from the remote control.The method further comprises controlling the first unit based on the modified first remote control command.

[0034] Consequently, according to the seventh aspect, the object can be achieved by a computer-implemented method for an external device that is remotely controllable by means of a remote control. The method comprises receiving a modified first remote control command from the remote control and controlling a first unit of a plurality of units of the device based on the modified first remote control command. The modified first remote control command is based on a first remote control command for remotely controlling the device, which is characterized by a first control input from a user during the remote control. The first remote control command was modified based on a first latency associated with controlling the first unit and the first remote control command and exceeding a latency threshold predetermined for the first unit of a plurality of latency thresholds for the plurality of units.

[0035] The object is achieved according to an eighth aspect by an external device which is designed to be remotely controllable by means of a remote control, wherein the device comprises means for carrying out the method according to the seventh aspect.

[0036] The object is achieved according to a ninth aspect by a computer program product comprising instructions which cause the external device according to the eighth aspect to carry out the method steps according to the seventh aspect.

[0037] Features described with reference to one of the embodiments of the first to ninth aspects can be suitably implemented as features of one of the other embodiments. Preferred embodiments are explained by way of example with reference to the accompanying figures.

[0038] Fig. 1 shows a schematic embodiment of a computer-implemented method for a system comprising a remote control and an external device that can be remotely controlled by means of the remote control;

[0039] Fig. 2 shows a schematic embodiment of the remote control and the external device;

[0040] Fig. 3 shows a schematic embodiment of a computer-implemented method for a remote control for remotely controlling an external device;

[0041] Fig. 4 shows a schematic embodiment of a computer-implemented method for an external device that can be remotely controlled by means of a remote control; and

[0042] Fig. 5 is a schematic representation of a latency of the system with a user.

[0043] In the figures, identical or essentially functionally identical or similar elements are designated by the same reference numerals.

[0044] Fig. 1 shows a computer-implemented method 100 for a system comprising a remote control 200 for controlling an external device 300 and the external device 300. The remote control 200 and the external device 300 are shown in Fig. 2. The remote control 200 has a memory 210, a communication unit 220, a controller 230, and an input unit 240. The external device 300 has a memory 310, a communication unit 320, a controller 330, and a plurality of units 341, 342, 343, which can be controlled by means of a control input from a user 600. The communication units 220, 320 are designed to send and / or receive information. The controllers 230, 330 are designed to control the remote control 200 and the device 300 and the units thereof. The input unit 240 is configured to receive a control input from the user 600.The memories 210, 310 are configured to store information and one or more computer program products. The computer program products include instructions that, when executed by the respective processor 230, 330, cause the remote control 200 or the device 300 to perform the methods of Figs. 1, 3, and 4.

[0045] The method 100 of Fig. 1 includes receiving 110, by means of the remote control 200, a first control input from a user 600 that characterizes a first remote control command for remotely controlling the external device 300. The remote control 200 can receive the control input by means of the input unit 240.

[0046] The first remote control command is designed to control at least a first unit 341 of the plurality of units 341, 342, 343 of the device 300 by means of the device 300. The control can be performed by means of the controller 330.

[0047] The method 100 further comprises determining 120 a first latency in connection with the actuation of the first unit 341 and the first remote control command.

[0048] The method 100 further comprises modifying 130 the first remote control command based on the first latency and an exceeding of a latency threshold predetermined for the first unit 341 of a plurality of latency thresholds for the plurality of units 341-343.

[0049] In the present exemplary embodiment, the units 341-343 each have different latency thresholds. The different latency thresholds can be due to the fact that controlling one unit of the plurality of units 341-343 requires very sensitive control, so that with a slightly increased latency and thus delay, the control no longer leads to the desired result. Consequently, the latency threshold for this unit is low. A further unit of the plurality of units 341-343, on the other hand, can also be controlled with coarse control, so that higher latencies and thus greater delays still lead to the desired result. Consequently, a higher latency threshold can be predetermined for this unit. In particular, the latency thresholds can also be further predetermined based on the criticality of the respective units in a process associated with controlling the unit.The process may, for example, be a manufacturing process. If the device 300 is a vehicle, the process may be driving the vehicle 300.

[0050] The method 100 further comprises controlling 140, by means of the device 300, the first unit 341 based on the modified first remote control command. The controlling can be performed by means of the controller 330.

[0051] Amending 130 may include:

[0052] - modifying a parameter of the first unit 341 associated with the control;

[0053] - changing the parameter to a predetermined first parameter value;

[0054] - modifying the parameter by a predetermined second parameter value; and / or

[0055] - preventing the control of the first unit 341 .

[0056] Modifying 130 the parameter may include increasing and / or decreasing the parameter. For example, if the latency is high and the latency threshold is exceeded, a speed input for the first unit 341 may be changed to a lower speed.

[0057] Modifying 130 the parameter may be set to the predetermined first parameter value, for example, a predetermined maximum speed upon exceeding the latency threshold, wherein the maximum speed is less than the speed entered by the user 600.

[0058] Modifying 130 the parameter may include modifying it by a predetermined second parameter value. For example, in the case of high latency and exceeding the latency threshold, a speed increase of 10 m / s entered by user 600 may be modified to a speed increase of 2 m / s in order to improve safety while at least partially implementing the first control command.

[0059] Using the proposed method 100, it is possible, for example, not to stop a machining process using the device 300 entirely because of increased latency. Those units that lead to the desired result even with increased latency can continue to be controlled, while other control actions of units with a lower latency threshold are modified, supported, or even prevented. Consequently, the user is supported during remote control.

[0060] Steps 120 and 130 can be performed by the remote control 200 or the device 300. For better understanding, reference is made to the description of the following Figs. 3 and 4.

[0061] Fig. 3 shows a computer-implemented method 400 for a remote control 200 for remotely controlling an external device 300.

[0062] The method 400 includes receiving 410 a first control input from a user, which characterizes a first remote control command for remotely controlling the external device 300. The control input can be received by means of the input unit 240. The first remote control command is designed to control at least a first unit 341 of a plurality of units 341-343 of the device 300 by means of the device 300.

[0063] According to Fig. 3, two possible implementations of the method 400 are shown. According to the left side, the method 400 comprises determining 410 a first latency in connection with the actuation of the first unit 341 and the first remote control command. The processor 230 can be configured to determine the first latency. Consequently, according to the left side, the remote control 200 determines the first latency. The method 400 of the left side further comprises modifying 420 the first remote control command, for example by means of the controller 230, based on the first latency and an exceeding of a latency threshold predetermined for the first unit 341 from a plurality of latency thresholds for the plurality of units 341-343.

[0064] Furthermore, the method 400 on the left side comprises sending 440, for example by means of the communication unit 220, the modified first remote control command to the device 300. The device 300 can receive the modified first remote control command by means of the communication unit 320.

[0065] Alternatively, after step 410, device 300 can determine the first latency and send latency information characterizing the first latency to remote control 200. For this purpose, method 400 on the right includes receiving 421 the latency information. Based on the latency information, the remote control command can then be modified in the next step 430 and sent to device 300 in step 440.

[0066] Fig. 4 shows a computer-implemented method 500 for an external device 300 that can be remotely controlled by means of a remote control 200.

[0067] According to the left side, method 500 includes receiving 521 the modified first remote control command from remote control 200 and controlling 530 the first unit 341 based on the modified first remote control command. In this case, the first latency and the modification of the first remote control command were carried out by means of device 200.

[0068] According to the middle path shown, the method 500 comprises receiving 511 the latency information characterizing the first latency from the remote control 200, modifying 520 the first remote control command based on the first latency and exceeding the associated latency threshold, and controlling 530 the first unit 341 based on the modified first remote control command. According to the middle path, the latency is determined by the remote control 200, and the modification of the remote control command is performed by the device 300.

[0069] According to the right-hand side, the method 500 comprises determining 510 the first latency, sending 512 the latency information characterizing the first latency to the remote control 200, receiving 521 the changed second remote control command from the remote control 200, and controlling 530 the first unit 341 based on the changed first remote control command.

[0070] Fig. 5 shows partial time periods or latencies from the user 600 to the execution of the control by the first unit 341 and the perception of the execution by the user 600. The first latency can comprise at least a delay due to one of the partial time periods. Latency thresholds can be predetermined for at least one, several, or each partial time period. Alternatively or additionally, two or more of the partial time periods can be combined into an overall latency, which can be the first latency. A latency threshold can also be predetermined for the overall latency.

[0071] Reference symbol

[0072] Computer-implemented method for a system

[0073] Receiving, via the remote control, a first control input

[0074] Determining an initial latency

[0075] Modifying the first remote control command

[0076] Controlling, by means of the device, the first unit based on the modified first remote control command

[0077] Remote control

[0078] memory

[0079] Communication unit

[0080] steering

[0081] Input unit

[0082] External device

[0083] memory

[0084] Communication unit

[0085] Control first unit second unit third unit

[0086] Computer-implemented method for remote control

[0087] Receiving a first control input

[0088] Determining an initial latency

[0089] Receiving latency information characterizing the first latency

[0090] Modifying the first remote control command

[0091] Sending the modified first remote control command

[0092] Computer-implemented method for an external device

[0093] Determining an initial latency

[0094] Receiving latency information characterizing the first latency

[0095] Sending a latency information characterizing the first latency

[0096] Modifying the first remote control command

[0097] Receiving the modified first remote control command 530 Controlling the first unit based on the modified first remote control command

[0098] 600 users

Claims

Patent claims 1 . A computer-implemented method (100) for a system comprising a remote control (200) for controlling an external device (300) and the external device (300), comprising the steps: Receiving (110), by means of the remote control (200), a first control input from a user (600) which characterizes a first remote control command for remotely controlling the external device (300), wherein the first remote control command is designed to control at least a first unit (341) of a plurality of units (341-343) of the device (300) by means of the device (300); Determining (120) a first latency associated with controlling the first unit (341) and the first remote control command; modifying (130) the first remote control command based on the first latency and an exceeding of a latency threshold predetermined for the first unit (341) of a plurality of latency thresholds for the plurality of units (341-343); Controlling (140), by means of the device, the first unit (341) based on the modified first remote control command.

2. The method (100) of claim 1, wherein the plurality of latency thresholds is further based on a respective criticality of the respective unit of the plurality of units (341-343).

3. The method (100) according to claim 2, wherein the criticality characterizes a criticality of the respective unit (341-343) in a process associated with the control of the respective unit (341-343), and / or wherein the criticality characterizes a sensitivity of the control of the respective unit (341-343) in the process.

4. The method (100) according to any one of the preceding claims, wherein modifying (130) the first remote control command: - modifying a parameter of the first unit (341) associated with the control; - changing the parameter to a predetermined first parameter value; - modifying the parameter by a predetermined second parameter value; and / or - includes preventing the control.

5. The method (100) according to any one of the preceding claims, wherein the first latency in connection with the actuation of the first unit (341) comprises at least a partial time portion of an actuation period, wherein the actuation period characterizes a time period from a time of receiving the first control input to a time of a response of the first unit (341) based on the first remote control command.

6. The method (100) according to any one of the preceding claims, wherein the first latency in connection with the actuation of the first unit (341) comprises at least a perception duration of the user, wherein the perception duration characterizes a time duration from a time of the reaction of the first unit (341) to a time of the physical perception by the user.

7. The method (100) according to any one of the preceding claims, wherein the determining (120) of the first latency is based on a second latency, wherein the second latency is a latency associated with the actuation of the first unit (341) and a second remote control command for remotely controlling the external device (300), and the second remote control command is characterized by a second control input from the user, wherein the second control input occurred before the first control input.

8. Method (100) according to one of the preceding claims, further comprising: Outputting, by means of the remote control (200), a warning message to the user based on the exceeding of the latency threshold value predetermined for the first unit (341) before and / or during the activation period.

9. The method (100) according to any one of the preceding claims, wherein the determining (120) of the first latency is carried out by means of the remote control (200) or the device (300), wherein the modifying (130) of the first remote control command is carried out by means of the remote control (200) or the device (300).

10. A system comprising a remote control (200) for controlling an external device (300) and the external device (300), wherein the remote control (200) and the external device (300) each comprise means (210-240; 310-343) for carrying out the steps of the method (100) according to any one of claims 1 to 9.

11. A computer program product comprising instructions that cause the system according to claim 10 to carry out the method steps according to any one of claims 1 to 9.

12. A computer-implemented method (400) for a remote control (200) for remotely controlling an external device (300), comprising the steps: Receiving (410) a first control input from a user (600) which characterizes a first remote control command for remotely controlling the external device (300), wherein the first remote control command is designed to control at least a first unit (341) of a plurality of units (341-343) of the device (300) by means of the device (300); modifying (430) the first remote control command based on a first latency associated with controlling the first unit (341) and the first remote control command and exceeding a latency threshold predetermined for the first unit of a plurality of latency thresholds for the plurality of units; Sending (440) the modified first remote control command to the device (300).

13. Remote control (200) for remotely controlling an external device (300), comprising means (210-240) designed to carry out the method (400) according to claim 12.

14. A computer program product comprising instructions that cause the remote control (200) according to claim 13 to carry out the method steps of the method (400) according to claim 12.

15. A computer-implemented method (500) for an external device (300) that is remotely controllable by means of a remote control (200), the method (500) comprising at least one of the following steps: Determining (510) a first latency associated with controlling a first unit (341) of a plurality of units (341-343) of the external device (300) and a first remote control command for remotely controlling the external device (300), wherein the first remote control command is based on a control input of a user (600) at the remote control (200); Modifying (520) the first remote control command based on the first latency and exceeding a latency threshold predetermined for the first unit (341) of a plurality of latency thresholds for the plurality of units (341-343); and Receiving (521) a modified first remote control command from the remote control (200); wherein the method (500) further comprises controlling (530) the first unit (431) based on the modified first remote control command.

16. External device (300) which is designed to be remotely controllable by means of a remote control (200), wherein the device (300) comprises means for carrying out the method (500) according to claim 15.

17. A computer program product comprising instructions that cause the external device (300) of claim 16 to perform the method steps of claim 15.

Images