Method for controlling device, remote control, display device, and system

Abstract

The present application relates to the field of devices, and provides a method for controlling a device, a remote control, a display device, and a system. The method comprises: upon detecting a first swiping operation of a user in a touch area, determining a first distance from a first position at which the user contacts the touch area to a second position in the touch area and a first direction pointing from the second position to the first position, the first position being an end position of the first swiping operation, and the second position being a preset position in the touch area or a start position of the first swiping operation; and sending a first message to a display device, the first message being used to instruct the display device to execute a second swiping operation on a displayed interaction interface, a swiping speed of the second swiping operation being a first speed and a swiping direction of the second swiping operation being a second direction, the first speed being positively correlated with the first distance, and the second direction being determined on the basis of the first direction. The technical solution provided by the present application is capable of improving the efficiency of controlling a display device and improving the user experience.

Description

Methods for controlling equipment, remote controls, display devices and systems

[0001] This application claims priority to Chinese Patent Application No. 202510393181.7, filed with the State Intellectual Property Office of China on March 28, 2025, entitled “Method for Controlling Device, Remote Controller, Display Device and System”, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of equipment, and more particularly to a method for controlling equipment, a remote controller, a display device, and a system. Background Technology

[0003] Since the rise of display devices such as televisions and large-screen devices, the remote controls used to control these devices have also developed significantly. Remote controls provide users with a more convenient way to interact, making it easier for them to control display devices.

[0004] Traditional remote controls have physical buttons, which users press to operate the interactive interface displayed on the device. For example, a traditional remote control includes four directional buttons: up, down, left, and right. Pressing any of these buttons allows the user to switch between selected page elements on the interactive interface. However, this control method is very inefficient. Summary of the Invention

[0005] In view of this, this application provides a method for controlling a device, a remote controller, a display device, and a system that can improve the efficiency of controlling the display device and the user experience.

[0006] To achieve the above objectives, a first aspect provides a method for controlling a device, applied to a remote control, the remote control including a touch area, the method comprising: when detecting a first sliding operation by a user in the touch area, determining a first distance between a first position where the user contacts the touch area and a second position in the touch area, and a first direction from the second position to the first position, wherein the first position is an end position of the first sliding operation, the second position is a preset position in the touch area, or the second position is a start position of the first sliding operation; and sending a first message to a display device, the first message instructing the display device to perform a second sliding operation on a displayed interactive interface, wherein the sliding speed of the second sliding operation is a first speed and the sliding direction of the second sliding operation is a second direction, the first speed being positively correlated with the first distance, and the second direction being determined based on the first direction.

[0007] In the above scheme, when the remote control detects that the user performs a first swipe operation on the remote control's touch area, it generates a first message based on the first swipe operation. This first message then instructs the display device to perform a second swipe operation on the display device's interface, thus creating the effect of the user swiping on the display device's interface. Furthermore, since the first speed of the second swipe operation is positively correlated with the first distance between the first position where the user touches the touch area during the first swipe operation and the second position within that touch area, and the second direction is also determined based on the first direction pointing from the second position to the first position, and the first position is the end position of the first swipe operation, while the second position is a preset position within the touch area or the starting position of the first swipe operation, the user can adjust the position of contact with the touch area through the first swipe operation, freely adjusting the swiping amplitude and direction of the second swipe operation. This improves both the efficiency and precision of swiping on the display device, significantly enhancing the user experience of controlling the display device via remote control.

[0008] Wherein, the first distance is the straight-line distance between the first position and the second position.

[0009] In some implementations, the first speed can be expressed as N pixels / frame, meaning that the device slides a distance of N pixels whenever the interactive interface of the display device refreshes a frame, where N is an integer greater than or equal to 0. When the first position and the second position are the same, the first speed can be 0, meaning there is no sliding.

[0010] In one embodiment of the first aspect, the preset position is the center position of the touch area.

[0011] In one embodiment of the first aspect, the second direction is the same as the first direction, or the second direction is the direction with the smallest angle between it and the first direction among a plurality of preset directions.

[0012] In the above solution, when the second direction is the same as the first direction, when the user slides on the touch area of ​​the remote control in the first direction, the user can slide on the interactive interface of the display device in the same direction as the first direction. This provides a WYSIWYG (What You See Is What You Get) experience, allowing users to freely adjust the direction of their slide on the display device and further improving the user experience. When the second direction is the direction with the smallest angle to the first direction among multiple preset directions, it allows for more precise sliding on the display device, even when sliding on the touch area of ​​the remote control in a relatively coarse manner, or when the area of ​​the touch area is limited. This reduces the complexity of sliding operations on the display device and makes it easier for users to operate.

[0013] In one embodiment of the first aspect, there is a correspondence between the first velocity and the distance range in which the first distance is located.

[0014] In some implementations, multiple distance ranges and corresponding sliding speeds for each distance range can be preset. When the first distance is determined, the sliding speed corresponding to the distance range in which the first distance is located can be determined as the first speed.

[0015] In one embodiment of the first aspect, the first message includes at least one coordinate corresponding to the interactive interface, such that the display device performs a second swiping operation on the interactive interface based on the at least one coordinate.

[0016] In one embodiment of the first aspect, the method further includes: when a third sliding operation is detected moving from the first position to a third position in the touch area, and the angle between a third direction pointing from the fourth position to the third position and the first direction is greater than a preset angle, determining a second distance between the third position and the fourth position, wherein the fourth position is the preset position in the touch area, or the fourth position is the starting position of the third sliding operation; sending a second message to the display device, the second message being used to instruct the display device to perform a fourth sliding operation on the interactive interface, wherein the sliding speed of the fourth sliding operation is a second speed and the sliding direction of the fourth sliding operation is a fourth direction, the second speed is positively correlated with the second distance, and the fourth direction is opposite to the second direction.

[0017] In the above solution, after performing the first swipe operation on the touch area of ​​the remote control, the user can continue to perform more swipe operations, such as the third swipe operation, according to their own needs, changing the position of contact with the touch area, dynamically and autonomously adjusting the speed and direction of swiping on the display device, and more accurately adjusting the speed and direction of swiping on the display device, significantly improving the accuracy and efficiency of swiping on the display device, and enhancing the user experience.

[0018] In one embodiment of the first aspect, the starting position of the third swipe operation is the first position. In one embodiment of the first aspect, after the user performs the first swipe operation on the touch area, they can maintain contact with the touch area and start performing the third swipe operation from the ending position of the first swipe operation (e.g., the first position). That is, the first swipe operation and the third swipe operation can be part of a single gesture.

[0019] In one embodiment of the first aspect, the third position is the end position of the third sliding operation.

[0020] In one embodiment of the first aspect, the fourth position is the preset position in the touch area, or the fourth position is the starting position of the third sliding operation. In one embodiment of the first aspect, when the second position is the preset position in the touch area, the fourth position is also the preset position in the touch area, that is, the fourth position is the same as the second position. In one embodiment of the first aspect, when the second position is the starting position of the first sliding operation, the fourth position is also the starting position of the third sliding operation (e.g., the first position).

[0021] In some implementations, if the angle between the third direction and the first direction is greater than a preset angle, then the fourth direction is opposite to the second direction; if the angle between the third direction and the first direction is less than or equal to the preset angle, then the fourth direction is the same as the second direction.

[0022] In some implementations, when the trajectory of the third swipe operation passes through a preset position in the touch area, and the angle between the third direction and the first direction is greater than a preset angle, the fourth direction is opposite to the second direction; otherwise, the fourth direction is the same as the second direction. That is, after a user swipes along a certain direction on the display device, if they need to change the direction of swiping on the display device, they can first return to the preset position in the touch area, and then continue swiping in the opposite direction from that preset position.

[0023] In one embodiment of the first aspect, when a user's first swipe operation on the touch area is detected, determining a first distance between a first position where the user contacts the touch area and a second position in the touch area, as well as a first direction from the second position to the first position, includes: when a preset trigger operation is detected from the touch area and then a first swipe operation is detected, determining the first distance and the first direction.

[0024] In one embodiment of the first aspect, the triggering operation and the first sliding operation are consecutive operations.

[0025] A second aspect provides a method for controlling a device, applied to a display device, the method comprising: receiving a first message sent by a remote controller, the first message being sent by the remote controller after detecting a first swipe operation by a user on a touch area of ​​the remote controller, determining a first distance between a first position where the user contacts the touch area and a second position in the touch area, and a first direction from the second position to the first position; the first message instructing the display device to perform a second swipe operation on a displayed interactive interface, the second swipe operation having a swipe speed of a first speed and a swipe direction of a second direction, the first speed being positively correlated with the first distance, the second direction being determined based on the first direction, the first position being the end position of the first swipe operation, and the second position being a preset position in the touch area, or the second position being the start position of the first swipe operation; and performing the second swipe operation on the interactive interface.

[0026] In one embodiment of the second aspect, performing a second swiping operation on the interactive interface includes: swiping page content in the interactive interface along a second direction and at a first speed.

[0027] In one embodiment of the second aspect, the method further includes: displaying a first prompt message before the user performs a first swipe operation on the touch area, the first prompt message being used to prompt the user to determine a first direction.

[0028] In one embodiment of the second aspect, the method further includes: displaying a second prompt message, the second prompt message being used to indicate a first speed and / or a second direction.

[0029] In one embodiment of the second aspect, the method further includes: receiving a second message sent by the remote controller, the second message being sent by the remote controller after determining a second distance between the third position and the fourth position when it detects a third swipe operation moving from the first position to a third position in the touch area, and the angle between the third direction pointing from the fourth position to the third position and the first direction is greater than a preset angle; the second message being used to instruct the execution of a fourth swipe operation on the interactive interface, the swipe speed of the fourth swipe operation being a second speed and the swipe direction of the fourth swipe operation being a fourth direction, the second speed being positively correlated with the second distance, the fourth direction being opposite to the second direction, the fourth position being a preset position in the touch area, or the fourth position being the starting position of the third swipe operation; and executing the fourth swipe operation on the interactive interface.

[0030] A third aspect provides a remote controller, comprising: a memory and one or more processors, the memory being used to store a program; the one or more processors being used to implement the method described in any one of the first aspects when the program is invoked.

[0031] A fourth aspect provides a display device, comprising: a memory and one or more processors, the memory being used to store a program; the one or more processors being used to implement the method described in any one of the second aspects above when the program is invoked.

[0032] The fifth aspect provides a system comprising the remote controller described in the third aspect and the display device described in the fourth aspect.

[0033] A sixth aspect provides a chip system including a processor coupled to a memory, the processor calling a program stored in the memory to implement the method described in any one of the first aspects or the method described in any one of the second aspects.

[0034] The chip system can be a single chip or a chip module composed of multiple chips.

[0035] The seventh aspect provides a readable storage medium (also referred to as a computer-readable storage medium) having a program stored thereon, which, when invoked by a processor, implements the method described in any one of the first aspects or the method described in any one of the second aspects.

[0036] The eighth aspect provides a program product (also referred to as a computer program product) that, when run on a device, causes the device to perform the method described in any one of the first aspects or the method described in any one of the second aspects.

[0037] It is understood that the beneficial effects of aspects two through eight above can be found in the relevant descriptions in aspect one above, and will not be repeated here. Attached Figure Description

[0038] Figure 1 is a schematic diagram of the structure of a device provided in an embodiment of this application;

[0039] Figure 2 is a schematic diagram of a control device provided in an embodiment of this application;

[0040] Figure 3 is a schematic diagram of another control device provided in an embodiment of this application;

[0041] Figure 4 is a schematic diagram of another control device provided in an embodiment of this application;

[0042] Figure 5 is a flowchart illustrating a method for controlling a device according to an embodiment of this application;

[0043] Figure 6 is a schematic diagram of a prompt message provided in an embodiment of this application;

[0044] Figure 7 is a schematic diagram of a first direction provided in an embodiment of this application;

[0045] Figure 8 is a schematic diagram of a sliding gear provided in an embodiment of this application;

[0046] Figure 9 is a schematic diagram of another sliding gear provided in an embodiment of this application;

[0047] Figure 10 is a schematic diagram of another prompting message provided in an embodiment of this application;

[0048] Figure 11 is a flowchart illustrating another method for controlling a device provided in an embodiment of this application. Detailed Implementation

[0049] The method for controlling a device provided in this application can be applied to devices such as remote controls and display devices. In some embodiments, the remote control may include a pointing remote control. In some embodiments, the display device includes a smart screen, television, large-screen device, tablet computer, mobile phone, in-vehicle device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), etc. This application does not limit the specific types of devices such as remote controls and display devices.

[0050] Figure 1 is a schematic diagram of the structure of an example device 100 provided in an embodiment of this application. Device 100 may include a processor 110, a memory 120, and a communication module 130, etc.

[0051] The processor 110 may include one or more processing units, and the memory 120 is used to store programs and data. In this embodiment, the processor 110 may run the program stored in the memory 120 to control the device 100 to perform corresponding operations.

[0052] The communication module 130 can be used for communication between various internal modules of the device 100, communication between the device 100 and other external devices, or communication between the device 100 and a network or other external devices. For example, the communication module 130 can provide solutions for wireless communication applied to the device 100, including ultra-wideband (UWB), satellite communication, wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), near field communication (NFC), and infrared (IR) technologies. Furthermore, the communication module 130 can also provide solutions for wireless communication applied to the device 100, including 2G / 3G / 4G / 5G technologies.

[0053] It should be understood that when device 100 is a display device, device 100 also includes a display screen 140. The display screen 140 can display an interactive interface, such as video feeds, web pages, and various prompts. For example, the display device could be a Huawei Smart Screen.

[0054] It should be understood that when device 100 is a remote control, device 100 also includes a touchpad 150. The touchpad 150 includes a touch area that can receive user touch operations. When the remote control detects a user touch operation from the touch area, it can control the display device based on the touch operation. Optionally, when device 100 is a remote control (e.g., pointing at a remote control), the remote control can emit electrical signals (e.g., UWB signals) or sound signals. These electrical or sound signals can be used to determine the distance and angle between the remote control and the display device, thereby determining the position indicated by the remote control on the display screen 140 of the display device. Optionally, when device 100 is a remote control, device 100 also includes an inertial measurement unit (IMU) 160. The inertial measurement unit 160 can be used to detect the three-dimensional spatial motion data (e.g., rotation angle and displacement velocity) of the remote control. The remote control determines the position indicated on the display screen 140 of the display device based on this three-dimensional spatial motion data. It is understandable that when device 100 is a remote control, the position indicated on the display screen of the display device can also be determined by other means. For example, the remote control is a Huawei Lingxi pointing remote control.

[0055] In some embodiments, the inertial measurement unit 160 includes a gyroscope and an accelerometer. The gyroscope can be used to determine the motion attitude of the remote controller. In some embodiments, the gyroscope can determine the angular velocity of the remote controller about three axes (i.e., the x, y, and z axes). The accelerometer can detect the magnitude of the acceleration of the remote controller in each direction (typically three axes). When the remote controller is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the attitude of the remote controller.

[0056] Optionally, device 100 includes a display screen 140 and a touchpad 150. In some embodiments, the display screen 140 and the touchpad 150 can be integrated together, i.e., a touchscreen. For example, when a user uses a touchscreen phone as a remote control to control a television or large-screen device, they can submit touch operations on the touchscreen phone's touchscreen.

[0057] It should be understood that, apart from the various components or modules listed in Figure 1, the embodiments of this application do not specifically limit the structure of device 100. In other embodiments of this application, device 100 may also include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. For example, device 100 may also include one or more buttons. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0058] To facilitate understanding of the technical solutions in the embodiments of this application, the application scenarios of the embodiments of this application will be introduced first below.

[0059] When using a display device, users often need to perform swiping operations, which a button-only remote control cannot meet. For example, as shown in Figure 2a, when watching a video, a user needs to fast-forward by pressing the corresponding right arrow key on the remote. Each press of the right arrow key fast-forwards the video for a fixed amount of time, such as adjusting to one of the five specific progress points (1-5) shown in Figure 2a. Similarly, to rewind the video, a user needs to press the corresponding left arrow key on the remote, which also rewinds the video for a fixed amount of time. As another example, as shown in Figure 2b, when browsing a webpage or other social media application, a user needs to swipe up on the page by pressing the corresponding up arrow key on the remote. Each press of the up arrow key scrolls the page up one page. Conversely, to swipe down on the page, a user needs to press the corresponding down arrow key on the remote, which scrolls the page down one page. Because it requires users to press buttons frequently and slide only a fixed amount each time, the operation efficiency is very low and the user experience is poor.

[0060] In some implementations, the remote control includes a touchpad with a touch area. Each time a user swipes once in a certain direction on the touch area, the display device also swipes a fixed amount in that direction on its screen. For example, as shown in Figure 3a, when watching a video, if a user needs to fast forward or rewind, they need to swipe right or left multiple times on the remote control's touch area. Each time the user swipes, the display device fast-forwards or rewinds the video for a fixed duration. As another example, as shown in Figure 3b, when browsing web pages or other social media applications, if a user needs to scroll up or down on a page, they need to swipe up or down multiple times on the remote control's touch area. Each time the user swipes, the display device flips one page up or down. Although swiping on the touch area improves the user experience to some extent compared to using buttons, it still requires frequent swiping, and each swipe is only a fixed amount, resulting in low operational efficiency. Furthermore, the limited area of ​​the touch area on the remote control makes it difficult for users to perform precise swiping operations on the display device.

[0061] To address at least some of the aforementioned technical problems, this application provides a method for controlling a device, which can be applied to a system including a remote controller and a display device, wherein the remote controller includes a touch area.

[0062] Please refer to Figure 4, which is a schematic diagram illustrating the principle of a sliding operation on a display device via a remote control, according to an embodiment of this application. As shown in Figure 4, when a user slides a certain distance in a certain direction (upward as shown in Figure 4a, downward as shown in Figure 4b, leftward as shown in Figure 4c, or rightward as shown in Figure 4d) on the touch area of ​​the remote control, the remote control converts the coordinates of the user's slide on the touch area into coordinates on the display screen of the display device according to a preset mapping method. The display device then slides on the display screen according to the converted coordinates, thereby achieving an effect similar to sliding on the display screen.

[0063] Please refer to Figure 5, which is a flowchart of a method for controlling a device according to an embodiment of this application. This method can be used for interaction between a remote control and a display device. It should be noted that this method is not limited to the specific order described in Figure 5 and below. It should be understood that in some embodiments, the order of some steps in this method can be interchanged according to actual needs, or some steps can be omitted or deleted. The method includes the following steps:

[0064] S501, the remote control enters the custom adjustment sliding speed mode.

[0065] In some embodiments, in order to make the method of controlling the device provided in this application compatible with other methods of controlling the display device by remote control (such as the methods shown in any of Figures 2-4 above), meet the user's various control needs for the display device, and improve the reliability of controlling the display device, the remote control can first enter the custom adjustment sliding speed mode through S501, and after entering this mode, the sliding operation on the display device can be realized through subsequent steps.

[0066] In some implementations, a user can trigger the remote control to enter a customizable sliding speed adjustment mode via a preset trigger operation. In some implementations, this trigger operation is a touch operation; the user can perform the trigger operation on the touch area of ​​the remote control, and when the remote control detects the trigger operation from the touch area, it determines that it has entered the customizable sliding speed adjustment mode. In some implementations, the trigger operation involves touching any location or a preset location within the touch area, and the touch duration is greater than or equal to the preset duration. For example, the preset location could be the center of the touch area, and the preset duration could be 1 second. Alternatively, in other implementations, the preset location could be another location within the touch area, and the preset duration could be other values.

[0067] Understandably, in practical applications, the preset trigger operation can also be other types of operation. Correspondingly, the remote control can also determine to enter the custom adjustment sliding speed mode through other methods corresponding to the other types of trigger operations.

[0068] In some implementations, when the remote control determines that it has entered a custom sliding speed adjustment mode, or when the remote control detects a user's trigger operation, the display device may display a first prompt message to prompt the user to determine a first direction of sliding. In some implementations, the first prompt message may include multiple preset directions for sliding. In some implementations, the first prompt message may include at least one of graphics, images, characters, and symbols.

[0069] For example, as shown in Figure 6, when the remote control detects that the user has pressed and held the center of the touch area, i.e. the user has performed a trigger operation to enter the custom adjustment of the sliding speed mode, the display device displays the first prompt information, which includes arrows pointing up, down, left and right, thereby prompting the user to determine the first direction among the directions indicated by these four arrows.

[0070] In some implementations, S501 may be omitted.

[0071] S502, when the remote control detects the user's first swipe operation in the touch area, the remote control determines the first distance between the first position where the user contacts the touch area and the second position in the touch area, and the first direction from the second position to the first position. The first position is the end position of the first swipe operation, and the second position is a preset position in the touch area or the second position is the start position of the first swipe operation.

[0072] Optionally, the first distance is the straight-line distance between the first position and the second position.

[0073] As an example, as shown in Figure 7, the center position of the touch area is position 3. The first swipe operation moves from position 1 to position 2 along trajectory 1. If position 3 is the second position and position 2 is the first position, the first direction is direction 1, as shown in Figure 7a, from position 3 to position 2. If position 1 is the second position and position 2 is the first position, the first direction is direction 2, as shown in Figure 7b, from position 1 to position 2.

[0074] In some implementations, the first swipe operation and the trigger operation for initiating the remote control to enter a custom swipe speed adjustment mode can be consecutive operations. For example, the user first triggers the remote control to enter a custom swipe speed adjustment mode by long-pressing the center of the touch area, and then continues to maintain contact with the touch area and performs the first swipe operation from that center position.

[0075] S503, the remote control sends a first message to the display device. The first message is used to instruct the display device to perform a second sliding operation on the displayed interactive interface. The sliding speed of the second sliding operation is a first speed and the sliding direction of the second sliding operation is a second direction. The first speed is positively correlated with the first distance, and the second direction is determined based on the first direction.

[0076] When the remote control detects that the user performs a first swipe operation on its touch area, it generates a first message based on the first swipe operation. This message then instructs the display device to perform a second swipe operation on its interface, creating the effect of the user swiping on the display device's interface. Furthermore, since the first speed of the second swipe operation is positively correlated with the first distance between the first position where the user contacts the touch area during the first swipe and the second position within that touch area, and the second direction is also determined based on the first direction from the second position to the first position, the user can freely adjust the amplitude and direction of the second swipe operation by controlling the position of contact with the touch area. This improves both the efficiency and precision of swiping on the display device, significantly enhancing the user experience of controlling the display device via remote control.

[0077] In some implementations, the second direction is the same as the first direction. That is, when a user slides in the first direction on the touch area of ​​the remote control, they can slide in the same direction on the interactive interface of the display device, achieving a WYSIWYG (What You See Is What You Get) experience. This allows users to freely adjust the direction of their slide on the display device, further improving the user experience.

[0078] In some implementations, the second direction is the direction with the smallest angle between it and the first direction among a plurality of preset directions. That is, the interactive interface displayed by the display device supports sliding in multiple preset directions. The user actually slides in the first direction on the touch area of ​​the remote control. The first direction may not be exactly the same as the preset direction. The remote control can calibrate (or update) the first direction based on the plurality of preset directions to determine the second direction among the plurality of preset directions, so that the display device slides in the second direction on the interactive interface. For example, the plurality of preset directions include up, down, left, and right. The first direction is between the up and right directions, and the angle between the first direction and the right direction is the smallest; therefore, the second direction is the right direction. For the user, this allows for more precise sliding on the display device while sliding in a relatively coarse manner on the touch area of ​​the remote control, or when the area of ​​the touch area is limited. This reduces the complexity of sliding operations on the display device and facilitates user operation.

[0079] In some implementations, the first speed can be expressed as N pixels / frame, meaning that the device slides a distance of N pixels whenever the interactive interface of the display device refreshes a frame, where N is an integer greater than or equal to 0. When the first position and the second position are the same, the first speed can be 0, meaning there is no sliding.

[0080] In some implementations, there is a correspondence between the first speed and the distance range in which the first distance is located. In some implementations, multiple distance ranges and corresponding sliding speeds for each distance range can be preset. When the first distance is determined, the sliding speed corresponding to the distance range in which the first distance is located can be determined as the first speed.

[0081] For example, as shown in Figure 8, taking up and down swiping as an example, the center position of the touch area of ​​the remote control is the second position. Using this center position as a reference point, six distance ranges are set vertically for this touch area. Each distance range corresponds to a swiping speed. The distance range between distance 1 and distance 2 corresponds to speed 1, the distance range between distance 2 and distance 3 corresponds to speed 2, the distance range between distance 3 and distance 4 corresponds to speed 3, the distance range between distance 4 and distance 5 corresponds to speed 4, the distance range between distance 5 and distance 6 corresponds to speed 5, and the distance range between distance 6 and distance 7 corresponds to speed 6. The distance range between distance 1 and distance 2 is farthest from the reference point and is above it; therefore, speed 1 has the highest value and its direction is the same as the positive direction, indicating an upward swiping motion, for example, speed 1 is 40 pixels / frame. The distance range between distance 3 and distance 4 is closest to the reference point and is above it; therefore, speed 3 has the lowest value and its direction is the same as the positive direction, indicating an upward swiping motion, for example, speed 3 is 20 pixels / frame. The distances between distances 2 and 3 are moderate and above the reference point. Therefore, the value of speed 2 falls between the values ​​of speed 1 and speed 3, and its direction is the same as the positive direction, indicating an upward slide, for example, speed 2 is 30 pixels / frame. The distances between distances 6 and 7 are the farthest from the reference point and below it. Therefore, the value of speed 6 is the largest, and its direction is the same as the negative direction, indicating a downward slide, for example, speed 6 is -40 pixels / frame. The distances between distances 4 and 5 are the closest to the reference point and below it. Therefore, the value of speed 4 is the smallest, and its direction is the same as the negative direction, indicating a downward slide, for example, speed 4 is -20 pixels / frame. The distances between distances 5 and 6 are moderate and below the reference point. Therefore, the value of speed 5 falls between speeds 4 and speed 6, and its direction is the same as the negative direction, indicating a downward slide, for example, speed 5 is -30 pixels / frame. In the example shown in Figure 8, it is possible to slide upwards on the display device at a speed of 20 pixels / frame, 30 pixels / frame, or 40 pixels / frame, or slide downwards at a speed of 20 pixels / frame, 30 pixels / frame, or 40 pixels / frame.

[0082] For example, as shown in Figure 9, taking left and right swiping as an example, the center position of the touch area of ​​the remote control is the second position. Using this center position as a reference point, six distance ranges are set horizontally around the touch area. Each distance range corresponds to a swiping speed. The distance range between distance 1 and distance 2 corresponds to speed 1, the distance range between distance 2 and distance 3 corresponds to speed 2, the distance range between distance 3 and distance 4 corresponds to speed 3, the distance range between distance 4 and distance 5 corresponds to speed 4, the distance range between distance 5 and distance 6 corresponds to speed 5, and the distance range between distance 6 and distance 7 corresponds to speed 6. The distance range between distance 1 and distance 2 is farthest from the reference point and is to the right of it; therefore, speed 1 has the largest value and its direction is the same as the positive direction, indicating a rightward swiping motion, for example, speed 1 is 40 pixels / frame. The distance range between distance 3 and distance 4 is closest to the reference point and is to the right of it; therefore, speed 3 has the smallest value and its direction is the same as the positive direction, indicating a rightward swiping motion, for example, speed 3 is 20 pixels / frame. The distances between distances 2 and 3 are moderate and to the right of the reference point. Therefore, the value of speed 2 falls between the values ​​of speed 1 and speed 3, and the direction of speed 3 is the same as the positive direction, indicating a rightward slide. For example, speed 2 is 30 pixels / frame. The distances between distances 6 and 7 are the farthest from the reference point and to the left. Therefore, the value of speed 6 is the largest, and the direction of speed 6 is the same as the negative direction, indicating a leftward slide. For example, speed 6 is -40 pixels / frame. The distances between distances 4 and 5 are the closest to the reference point and to the left. Therefore, the value of speed 4 is the smallest, and the direction of speed 4 is the same as the negative direction, indicating a leftward slide. For example, speed 4 is -20 pixels / frame. The distances between distances 5 and 6 are moderate and to the left of the reference point. Therefore, the value of speed 5 falls between the values ​​of speed 4 and speed 6, and the direction of speed 5 is the same as the negative direction, indicating a leftward slide. For example, speed 5 is -30 pixels / frame. In the example shown in Figure 9, it is possible to slide to the right on the display device at a speed of 20 pixels / frame, 30 pixels / frame, or 40 pixels / frame, or to slide to the left at a speed of 20 pixels / frame, 30 pixels / frame, or 40 pixels / frame.

[0083] In some implementations, the first message includes at least one coordinate corresponding to the interactive interface, causing the display device to perform a second swipe operation on the interactive interface based on at least one coordinate.

[0084] S504, the display device performs a second swipe operation on the interactive interface.

[0085] When the display device receives a first message from the remote control, it can execute the second swipe operation indicated by the first message on the display device's interactive interface. In some implementations, the effect of the display device executing the second swipe operation on the interactive interface will vary depending on the content included in the interactive interface.

[0086] In some implementations, the display device can slide the page content of the interactive interface displayed on the display device along a second direction and at a first speed. For example, if the page content is a video, the display device can fast forward or rewind the video at the first speed; or, if the page content is a webpage or a list, the display device can slide the webpage or list up or down at the first speed.

[0087] In some implementations, the interactive interface of the display device includes a marker that indicates the position indicated by the remote control in the interactive interface. The display device can move the marker along the sliding trajectory of a second sliding operation, such as moving the marker in a second direction and at a first speed, thereby producing a visual effect similar to a user sliding in the interactive interface of the display device.

[0088] In some embodiments, the display device may display a second prompt message on the interactive interface, which indicates the first speed and / or the second direction. By indicating the first speed and the second direction of sliding on the display device, the sliding process can be intuitively shown to the user, facilitating precise control of the sliding process and the display device, further improving the user experience. In some embodiments, the second prompt message includes at least one of graphics, images, characters, and symbols. In some embodiments, as shown in FIG10, the display device may simultaneously display the first and second prompt messages, the second prompt message including information indicating the second direction, and the distance between the second and first prompt messages can be used to indicate the first speed, for example, the distance can be positively correlated with the first speed. It is understood that the second prompt message can indicate the first speed and / or the second direction in other ways, such as the second prompt message indicating the first speed and / or the second direction in text form. Alternatively, in other embodiments, the second prompt message can indicate more or less information related to the second sliding operation.

[0089] In this embodiment, when the remote control detects that a user performs a first swipe operation on the touch area of ​​the remote control, it generates a first message based on the first swipe operation. The first message then instructs the display device to perform a second swipe operation on the interactive interface of the display device, thereby creating the effect of the user swiping on the interactive interface of the display device. Furthermore, since the first speed of the second swipe operation is positively correlated with the first distance between the first position where the user contacts the touch area during the first swipe operation and the second position within the touch area, and the second direction is also determined based on the first direction from the second position to the first position, the user can freely adjust the swiping amplitude and direction of the second swipe operation by controlling the position in contact with the touch area. This improves both the efficiency and precision of swiping on the display device, significantly enhancing the user experience of controlling the display device via remote control.

[0090] The method shown in Figure 5 above enables the display device to perform a corresponding second sliding operation on its interface when the user performs a first sliding operation on the touch area of ​​the remote control. In some embodiments, after performing the first sliding operation and contacting the first position in the touch area, the user can leave the touch area, thereby terminating the sliding operation on the display device and exiting the custom sliding speed adjustment mode. In other embodiments, after performing the first sliding operation and contacting the first position in the touch area, the user continues to maintain contact with the touch area and continues to slide, thus continuing the sliding operation on the display device as shown in Figure 11 below.

[0091] Please refer to Figure 11, which is a flowchart of another method for controlling a device provided in an embodiment of this application. This method can be executed after the method shown in Figure 5. It should be noted that this method is not limited to the specific order described in Figure 11 and below. It should be understood that in some embodiments, the order of some steps in this method can be interchanged according to actual needs, or some steps can be omitted or deleted. The method includes the following steps:

[0092] S505, when the remote control detects a third sliding operation that moves from the first position to the third position in the touch area, it determines a second distance between the third position and the fourth position, and a third direction from the fourth position to the third position.

[0093] In some implementations, the starting position of the third swipe operation is the first position. In one implementation, after the user performs the first swipe operation on the touch area, they can maintain contact with the touch area and start the third swipe operation from the ending position of the first swipe operation (such as the first position). That is, the first swipe operation and the third swipe operation can be part of a single gesture.

[0094] In some implementations, the third position is the end position of the third sliding operation.

[0095] In some implementations, the fourth position is a preset position within the touch area, or the fourth position is the starting position of the third swipe operation. In some implementations, when the aforementioned second position is a preset position within the touch area, the fourth position is also the preset position within the touch area, i.e., the fourth position is the same as the second position. In some implementations, when the second position is the starting position of the first swipe operation, the fourth position is also the starting position of the third swipe operation (e.g., the first position).

[0096] Optionally, the second distance is the straight-line distance between the third and fourth positions.

[0097] In some implementations, the remote control may execute S505 in the same or similar manner as it executes S502.

[0098] S506, the remote control sends a second message to the display device. The second message is used to instruct the display device to perform a fourth sliding operation on the interactive interface. The sliding speed of the fourth sliding operation is the second speed and the sliding direction of the fourth sliding operation is the fourth direction. The second speed is positively correlated with the second distance, and the fourth direction is determined based on the third direction.

[0099] In some implementations, the remote control may execute S506 in the same or similar manner as it executes S503.

[0100] In some implementations, if the angle between the third direction and the first direction is greater than a preset angle, the fourth direction is opposite to the second direction; if the angle between the third direction and the first direction is less than or equal to the preset angle, the fourth direction is the same as the second direction. The preset angle can be any size; for example, in some implementations, it can be 90 degrees. When the angle between the third direction and the first direction is less than or equal to the preset angle, it may be due to user accidental touch or an error caused by the limited area of ​​the remote control's touch area. Therefore, the sliding direction on the display device can remain unchanged in the second direction. Only when the angle between the third direction and the first direction is greater than the preset angle will the sliding direction on the display device be changed.

[0101] In some implementations, when the trajectory of the third swipe operation passes through a preset position in the touch area, and the angle between the third direction and the first direction is greater than a preset angle, the fourth direction is opposite to the second direction; otherwise, the fourth direction is the same as the second direction. That is, after a user swipes along a certain direction on the display device, if they need to change the direction of swiping on the display device, they can first return to the preset position in the touch area, and then continue swiping in the opposite direction from that preset position.

[0102] S507, the display device performs a fourth swipe operation on the interactive interface.

[0103] When the display device receives the second message sent by the remote control, it can continue to perform the fourth swipe operation on the interactive interface displayed on the display device.

[0104] In some implementations, the display device may perform S507 in the same or similar manner as it performs S504.

[0105] In some implementations, the display device may display a prompt message corresponding to the fourth sliding operation, which may be used to indicate the second speed and / or the fourth direction.

[0106] In this embodiment, after performing a first swipe operation on the touch area of ​​the remote control, the user can continue to perform a third swipe operation and other swipe operations according to their own needs, change the position in contact with the touch area, and dynamically and autonomously adjust the speed and direction of the swipe on the display device. This allows for more precise adjustment of the speed and direction of the swipe on the display device, significantly improving the accuracy and efficiency of the swipe and enhancing the user experience.

[0107] For example, while watching a video on a display device, a user can trigger a customizable swipe speed mode by long-pressing the center of the touch area on the remote control. Then, swiping from the center to the far right of the touch area causes the display device to fast-forward the video at its fastest speed. When the video is close to the user's desired progress, the user can swipe from the far right of the touch area to the right of the center position, closer to the center, causing the display device to fast-forward the video at a slower or even slower speed, thus more accurately reaching the desired point. If the user accidentally fast-forwards past the desired point, they can return to the center position and swipe to the left of that center position to rewind the video. Therefore, with a single gesture, the user can precisely adjust the speed and direction of their swipe on the display device, thus accurately positioning the video at their desired point.

[0108] Based on the same inventive concept, this application also provides a remote control. The remote control includes: a memory and one or more processors, wherein the memory stores a program (also referred to as a computer program); and the one or more processors implement the method performed by the remote control described in the above method embodiments when the program is invoked (or run or executed).

[0109] Based on the same inventive concept, this application also provides a display device. The display device includes: a memory and one or more processors, wherein the memory is used to store a program (also referred to as a computer program); and the one or more processors are used to implement the method executed by the display device described in the above method embodiments when the program is invoked (or run or executed).

[0110] The device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effect are similar, so it will not be described again here.

[0111] Based on the same inventive concept, this application also provides a system that includes the remote controller and display device described in the foregoing method embodiments.

[0112] Based on the same inventive concept, this application also provides a chip system. The chip system includes one or more processors coupled to a memory, which call (or run or execute) a program stored in the memory to implement the method performed by the remote control or display device described in the above method embodiments.

[0113] The chip system can be a single chip or a chip module composed of multiple chips.

[0114] This application also provides a readable storage medium (also known as a computer-readable storage medium) storing a program thereon, which, when called (or run or executed) by a processor, implements the method executed by the remote control or display device described in the above method embodiments.

[0115] This application also provides a program product (also known as a computer program product) that, when run on a device, enables the device to execute the method described in the above method embodiments, which is performed by the remote control or display device.

[0116] If the integrated units described above are implemented as software functional units and sold or used as independent products, they can be stored in a readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The program includes program code, which can be in the form of source code, object code, executable files, or some intermediate form. The readable storage medium can include at least: any entity or device capable of carrying program code to a device, a recording medium, a memory, a read-only memory, a random access memory, and a software distribution medium. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks.

[0117] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of some embodiments.

[0118] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0119] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0120] As used in this application specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as meaning "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."

[0121] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0122] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0123] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A method for controlling a device, characterized in that, Applied to a remote control, the remote control including a touch area, the method includes: When a user's first swipe operation is detected in the touch area, a first distance is determined between a first position where the user contacts the touch area and a second position in the touch area, and a first direction is determined from the second position to the first position. The first position is the end position of the first swipe operation, and the second position is a preset position in the touch area, or the second position is the start position of the first swipe operation. A first message is sent to the display device, the first message being used to instruct the display device to perform a second sliding operation on the displayed interactive interface, the sliding speed of the second sliding operation being a first speed and the sliding direction of the second sliding operation being a second direction, the first speed being positively correlated with the first distance, and the second direction being determined based on the first direction.

2. The method according to claim 1, characterized in that, The preset position is the center position of the touch area.

3. The method according to claim 1 or 2, characterized in that, The second direction is the same as the first direction, or the second direction is the direction with the smallest angle between it and the first direction among a plurality of preset directions.

4. The method according to any one of claims 1-3, characterized in that, There is a corresponding relationship between the first speed and the distance range in which the first distance is located.

5. The method according to any one of claims 1-4, characterized in that, The first message contains at least one coordinate corresponding to the interactive interface, such that the display device performs the second sliding operation on the interactive interface based on at least one of the coordinates.

6. The method according to any one of claims 1-5, characterized in that, The method further includes: When a third swipe operation is detected, moving from the first position to the third position in the touch area, and the angle between the third direction from the fourth position to the third position and the first direction is greater than a preset angle, a second distance between the third position and the fourth position is determined, wherein the fourth position is the preset position in the touch area, or the fourth position is the starting position of the third swipe operation; A second message is sent to the display device, the second message being used to instruct the display device to perform a fourth swipe operation on the interactive interface, the swipe speed of the fourth swipe operation being a second speed and the swipe direction of the fourth swipe operation being a fourth direction, the second speed being positively correlated with the second distance, and the fourth direction being opposite to the second direction.

7. The method according to any one of claims 1-6, characterized in that, When a user's first swipe operation on the touch area is detected, determining a first distance between a first position where the user contacts the touch area and a second position within the touch area, as well as a first direction from the second position to the first position, includes: When a preset trigger operation is detected from the touch area, and the first swipe operation is also detected, the first distance and the first direction are determined.

8. The method according to claim 7, characterized in that, The triggering operation and the first sliding operation are consecutive operations.

9. A method for controlling a device, characterized in that, Applied to a display device, the method includes: The device receives a first message from a remote control. This first message is sent by the remote control after detecting a first swipe operation by a user on the remote control's touch area, determining a first distance between a first position where the user contacts the touch area and a second position within the touch area, as well as a first direction from the second position to the first position. The first message instructs the display device to perform a second swipe operation on the displayed interactive interface. The swipe speed of the second swipe operation is the first speed, and the swipe direction of the second swipe operation is the second direction. The first speed is positively correlated with the first distance, and the second direction is determined based on the first direction. The first position is the end position of the first swipe operation, and the second position is a preset position within the touch area, or the second position is the start position of the first swipe operation. Perform the second swipe operation on the interactive interface.

10. The method according to claim 9, characterized in that, The second swiping operation performed on the interactive interface includes: The page content in the interactive interface is slid along the second direction and at the first speed.

11. The method according to claim 9 or 10, characterized in that, The method further includes: Before the user performs the first swipe operation on the touch area, a first prompt message is displayed, which prompts the user to determine the first direction.

12. The method according to any one of claims 9-11, characterized in that, The method further includes: Display a second prompt message, which is used to indicate the first speed and / or the second direction.

13. The method according to any one of claims 9-12, characterized in that, The method further includes: The remote controller receives a second message. This second message is sent by the remote controller after detecting a third swipe operation that moves from the first position to a third position in the touch area, and the angle between the third direction pointing from the fourth position to the third position and the first direction is greater than a preset angle, and after determining a second distance between the third position and the fourth position. The second message is used to instruct the execution of a fourth swipe operation on the interactive interface. The swipe speed of the fourth swipe operation is a second speed, and the swipe direction of the fourth swipe operation is a fourth direction. The second speed is positively correlated with the second distance, and the fourth direction is opposite to the second direction. The fourth position is a preset position in the touch area, or the fourth position is the starting position of the third swipe operation. Perform the fourth swipe operation on the interactive interface.

14. A remote control, characterized in that, include: A memory and one or more processors, the memory being used to store a program; the one or more processors being used to execute the method as described in any one of claims 1-8 when the program is invoked.

15. A display device, characterized in that, include: A memory and one or more processors, the memory being used to store a program; the one or more processors being used to execute the method as described in any one of claims 9-13 when the program is invoked.

16. A system, characterized in that, The system includes the remote controller as described in claim 14 and the display device as described in claim 15.

17. A readable storage medium having a program stored thereon, characterized in that, When the program is invoked by the processor, it implements the method as described in any one of claims 1-8 or the method as described in any one of claims 9-13.

18. A program product, characterized in that, When the program product is run on the device, the device performs the method as described in any one of claims 1-8, or the method as described in any one of claims 9-13.

Images