Cursor position determination method and remote control equipment

By determining the deflection angle of the remote control device and the offset distance in the virtual arc surface, the problem of inaccurate cursor movement caused by changes in the distance and pointing direction between the remote control device and the screen device is solved, achieving accuracy of cursor movement and improving user experience. .

CN119342258AActive Publication Date: 2025-01-21HUAWEI TECH CO LTD

Patent Information

Application Number
CN202310909379.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-07-21
Publication Date
2025-01-21
Estimated Expiration
2043-07-21

Smart Images

  • Figure CN119342258A_ABST
    Figure CN119342258A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a cursor position determination method and remote control equipment, and the method comprises the steps: under the condition that the pointing direction of the remote control equipment deflects, the remote control equipment determines a first deflection angle of the pointing direction of the remote control equipment relative to a first reference line, and the remote control equipment determines the pointing direction of the remote control equipment according to the first deflection angle and a first virtual cambered surface; a first offset distance is determined, the center position of the first virtual cambered surface is located on the first reference line, the tangent line of the center position of the first virtual cambered surface is perpendicular to the first reference line, and the remote control device determines the cursor position of a cursor corresponding to the remote control device in the screen device based on the center position of the screen device and the first offset distance. According to the method, when the distance between the remote control equipment and the screen equipment is different or the pointing direction of the remote control equipment is different, the remote control equipment is deflected by the same angle, the moving distance of the cursor on the screen equipment is still the same, and a user can accurately control the moving precision of the cursor.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of remote control devices, and in particular to a cursor position determination method and a remote control device. Background Art

[0002] When a user uses a remote control device to control a smart TV, if the remote control device is set to an air mouse mode, a cursor corresponding to the remote control device can be displayed on the smart TV screen. When the user adjusts the position of the remote control device, the cursor on the smart TV screen will also move accordingly.

[0003] At present, the positional relationship between the remote control device and the smart TV screen will affect the moving distance of the cursor on the smart TV screen. How to make the movement of the cursor on the smart TV screen not be affected by the positional relationship between the remote control device and the smart TV screen is an urgent problem to be solved. Summary of the invention

[0004] The present application provides a cursor position determination method and a remote control device to solve the problem that when the distance between the remote control device and the screen device is different or the pointing direction of the remote control device is different, the cursor moves different distances on the screen device when the remote control device is deflected at the same angle.

[0005] In the first aspect, an embodiment of the present application provides a method for determining a cursor position, the method comprising: when the pointing direction of the remote control device is deflected, the remote control device determines a first deflection angle of the pointing direction of the remote control device relative to a first reference line, wherein the first reference line is a line between the position of the remote control device and the center position of the screen device, the remote control device determines a first offset distance according to the first deflection angle and a first virtual arc surface, wherein the remote control device is located within the arc of the first virtual arc surface, the screen device is located outside the arc of the first virtual arc surface, the center position of the first virtual arc surface is located on the first reference line, the tangent at the center position of the first virtual arc surface is perpendicular to the first reference line, and the remote control device determines the cursor position of the cursor corresponding to the remote control device in the screen device based on the center position of the screen device and the first offset distance. In the method, when the distance between the remote control device and the screen device is different or the pointing direction of the remote control device is different, the distance moved by the cursor on the screen device is still the same for the remote control device deflected by the same angle, and the user can accurately control the movement accuracy of the cursor, thereby improving the user's experience.

[0006] In a possible design, the first deflection angle includes a first horizontal deflection angle and a first vertical deflection angle; the remote control device determines the first deflection angle of the pointing direction of the remote control device relative to the first reference line, which may include: the remote control device uses the angle between the pointing direction of the remote control device and the first reference plane as the first horizontal deflection angle, wherein the first reference plane is a plane perpendicular to the horizontal plane and includes the first reference line; the remote control device then uses the angle between the pointing direction of the remote control device and the second reference plane as the first vertical deflection angle, wherein the second reference plane is a plane parallel to the horizontal plane and includes the first reference line. Through this design, a method for determining the first deflection angle is provided.

[0007] In a possible design, the first offset distance includes a first horizontal offset distance and a first vertical offset distance; the remote control device determines the first offset distance according to the first deflection angle and the first virtual arc surface, which may include: the remote control device uses the product of the radius length of the first virtual arc surface and the first horizontal deflection angle as the first horizontal offset distance, and the remote control device uses the product of the radius length of the first virtual arc surface and the first vertical deflection angle as the first vertical offset distance. Through this design, a method for determining the first offset distance is provided.

[0008] In a possible design, the first offset distance includes a first horizontal offset distance and a first vertical offset distance; the remote control device determines the first offset distance according to the first deflection angle and the first virtual arc surface, which may include: the remote control device uses the product of the radius length of the first virtual arc surface and the first horizontal deflection angle as the second horizontal offset distance, and then uses the product of the first horizontal adjustment ratio and the second horizontal offset distance as the first horizontal offset distance; the remote control device uses the product of the radius length of the first virtual arc surface and the first vertical deflection angle as the second vertical offset distance, and then uses the product of the first vertical adjustment ratio and the second vertical offset distance as the first vertical offset distance. Through this design, a method for determining the first offset distance is provided.

[0009] In a possible design, the remote control device determines the cursor position of the cursor corresponding to the remote control device in the screen device based on the center position of the screen device and the first offset distance, which may include: the remote control device determines a first coordinate value based on the center position of the screen device and the first horizontal offset distance, and determines a second coordinate value based on the center position of the screen device and the first vertical offset distance, the remote control device combines the first coordinate value and the second coordinate value into the coordinates of the cursor position, and determines the cursor position of the cursor corresponding to the remote control device in the screen device according to the coordinates of the cursor position. Through this design, a method for determining the cursor position corresponding to the remote control device is provided.

[0010] In a possible design, it also includes: when the pointing direction of the remote control device is deflected, before determining the first deflection angle of the pointing direction of the remote control device relative to the first reference line, the method also includes: the remote control device receives a first operation, wherein the first operation includes an operation to deflect the pointing direction of the remote control device, and the radius length of the first virtual arc surface is the first length; or, the remote control device receives a second operation, wherein the second operation includes the first operation and a third operation on the touch pad of the remote control device, and the radius length of the first virtual arc surface is the second length; the second length is less than the first length. In the above method, when the radius length of the first virtual arc surface is reduced, the remote control device is deflected by the same angle, which can reduce the movement speed of the cursor and improve the accuracy of the determined cursor position.

[0011] In a possible design, the method further includes: when the remote control device receives the fourth operation, the remote control device determines the first deflection angle of the pointing direction of the remote control device relative to the first reference line, wherein the fourth operation includes an operation of deflecting the pointing direction of the remote control device and a fifth operation on the touch pad of the remote control device, the first reference line is a line between the position of the remote control device and the center position of the screen device, the remote control device determines the third horizontal offset distance based on the first horizontal deflection angle and the second horizontal adjustment ratio, and determines the third vertical offset distance based on the first vertical deflection angle and the second vertical adjustment ratio, and the remote control device determines the cursor position of the cursor corresponding to the remote control device in the screen device based on the center position of the screen device, the third horizontal offset distance and the third vertical offset distance. Through this design, the cursor position changes with the change of the first horizontal deflection angle and the first vertical deflection angle, and is not affected by the radius length of the first virtual arc surface, providing a convenient method for determining the cursor position.

[0012] In a possible design, the method further includes: when the remote control device receives the sixth operation on the touch pad, the remote control device determines the horizontal movement distance and the vertical movement distance of the remote control device, wherein the sixth operation includes the operation of moving the remote control device and the seventh operation on the touch pad of the remote control device, the remote control device determines the fourth horizontal offset distance based on the horizontal movement distance and the third horizontal adjustment ratio; and determines the fourth vertical offset distance based on the vertical movement distance and the third vertical adjustment ratio, and the remote control device determines the cursor position of the cursor corresponding to the remote control device in the screen device based on the center position of the screen device, the fourth horizontal offset distance and the fourth vertical offset distance. Through this design, the cursor position changes with the change of the horizontal movement distance and the vertical movement distance, and is not affected by the radius length of the first virtual arc surface, providing a convenient method for determining the cursor position.

[0013] In a second aspect, the present application further provides a remote control device, which can implement the method in the first aspect and any possible implementation of the first aspect. The remote control device can be implemented by hardware, or by hardware executing corresponding software implementation. The hardware or software includes one or more units or modules corresponding to the above functions.

[0014] In a third aspect, an embodiment of the present application further provides a remote control device, which includes a module / unit for executing the method in the first aspect and any possible implementation of the first aspect. These modules / units can be implemented by hardware, or by executing corresponding software implementations through hardware.

[0015] In a fourth aspect, an embodiment of the present application provides a remote control device, comprising a memory and a processor; wherein the processor is used to execute a computer program or instruction stored in the memory, so that the head display device implements the method in the above-mentioned first aspect and any possible implementation manner of the first aspect.

[0016] In the fifth aspect, an embodiment of the present application also provides a computer-readable storage medium, which includes a computer program. When the computer program runs on a remote control device, the computer-readable storage medium implements the method in the above-mentioned first aspect and any possible implementation method of the first aspect.

[0017] In a sixth aspect, an embodiment of the present application further provides a computer program product, which, when executed on a remote control device, enables the remote control device to implement the method in the above-mentioned first aspect and any possible implementation manner of the first aspect.

[0018] These and other aspects of the present application will become more clearly understood in the description of the following embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1A A schematic diagram of the structure of a remote control device provided in an embodiment of the present application;

[0020] Figure 1B A schematic diagram of a scenario of using a remote control device provided in an embodiment of the present application;

[0021] Figure 1C A schematic diagram of the hardware structure of a remote control device provided in an embodiment of the present application;

[0022] Figure 1D A schematic diagram of the software structure of a remote control device provided in an embodiment of the present application;

[0023] Figure 2 A schematic diagram of a scenario of using a remote control device provided in an embodiment of the present application;

[0024] Figure 3A A schematic diagram of a scenario of using a remote control device provided in an embodiment of the present application;

[0025] Figure 3B A schematic diagram of a scenario of using a remote control device provided in an embodiment of the present application;

[0026] Figure 4A A schematic diagram of a scenario of using a remote control device provided in an embodiment of the present application;

[0027] Figure 4B A schematic diagram of a scenario of using a remote control device provided in an embodiment of the present application;

[0028] Figure 5 A flowchart of a method for determining a cursor position provided in an embodiment of the present application;

[0029] Fig. 6A A schematic diagram of the structure of a geodetic reference coordinate system provided in an embodiment of the present application;

[0030] Figure 6B A schematic diagram of the structure of a geodetic reference coordinate system provided in an embodiment of the present application;

[0031] Fig. 7A A top view of a remote control device provided in an embodiment of the present application;

[0032] Figure 7B A left view of a remote control device provided in an embodiment of the present application;

[0033] Figure 7C A top view of a remote control device provided in an embodiment of the present application;

[0034] Fig.7D A left view of a remote control device provided in an embodiment of the present application;

[0035] Fig. 7E A top view of a remote control device provided in an embodiment of the present application;

[0036] Figure 7F A left view of a remote control device provided in an embodiment of the present application;

[0037] Figure 7G A top view of a remote control device provided in an embodiment of the present application;

[0038] Figure 7H A left view of a remote control device provided in an embodiment of the present application;

[0039] Fig. 8A A top view of a remote control device provided in an embodiment of the present application;

[0040] Figure 8B A left view of a remote control device provided in an embodiment of the present application;

[0041] Figure 8C A top view of a remote control device provided in an embodiment of the present application;

[0042] Fig.8D A left view of a remote control device provided in an embodiment of the present application;

[0043] Fig. 8E A top view of a remote control device provided in an embodiment of the present application;

[0044] Fig.8F A left view of a remote control device provided in an embodiment of the present application;

[0045] Figure 8G A top view of a remote control device provided in an embodiment of the present application;

[0046] Figure 8H A left view of a remote control device provided in an embodiment of the present application;

[0047] Fig. 9 A schematic diagram of the structure of the position of a remote control device provided in an embodiment of the present application;

[0048] Fig.10 A schematic diagram of the structure of the position of a remote control device provided in an embodiment of the present application;

[0049] Fig.11 A schematic diagram of the structure of a first reference line provided in an embodiment of the present application;

[0050] Fig.12 A schematic diagram of the structure of a first reference line provided in an embodiment of the present application;

[0051] Fig.13A A schematic diagram of the structure of the indication direction of a remote control device provided in an embodiment of the present application;

[0052] Fig. 13B A schematic diagram of the structure of the indication direction of a remote control device provided in an embodiment of the present application;

[0053] Fig.14A A schematic diagram of the structure of a first reference line provided in an embodiment of the present application;

[0054] Fig. 14B A schematic diagram of the structure of a first reference line provided in an embodiment of the present application;

[0055] Fig. 14C A schematic diagram of the structure of a first reference line provided in an embodiment of the present application;

[0056] Fig.15A A schematic diagram of the structure of the pointing direction of a remote control device provided in an embodiment of the present application;

[0057] Fig. 15B A top view of the pointing direction of a remote control device provided in an embodiment of the present application;

[0058] Fig. 15C A left view of the pointing direction of a remote control device provided by an embodiment of the present application;

[0059] Fig.16A A schematic diagram of the structure of the pointing direction of a remote control device provided in an embodiment of the present application;

[0060] Fig. 16B A top view of the pointing direction of a remote control device provided in an embodiment of the present application;

[0061] Fig. 16C A left view of the pointing direction of a remote control device provided by an embodiment of the present application;

[0062] Fig.17A A schematic diagram of the structure of the pointing direction of a remote control device provided in an embodiment of the present application;

[0063] Fig. 17B A top view of the pointing direction of a remote control device provided in an embodiment of the present application;

[0064] Fig. 17C A left view of the pointing direction of a remote control device provided by an embodiment of the present application;

[0065] Fig.18A A schematic diagram of a structure of a first deflection angle provided in an embodiment of the present application;

[0066] Fig.18B A top view at a first deflection angle provided in an embodiment of the present application;

[0067] Fig.18C A left view at a first deflection angle provided by an embodiment of the present application;

[0068] Fig.19A A schematic diagram of a structure of a first deflection angle provided in an embodiment of the present application;

[0069] Fig.19B A top view at a first deflection angle provided in an embodiment of the present application;

[0070] Fig.19C A left view at a first deflection angle provided by an embodiment of the present application;

[0071] Fig. 20 A schematic flow chart of a method for determining a first deflection angle provided in an embodiment of the present application;

[0072] Fig.21A A schematic diagram of the structure of a second reference line provided in an embodiment of the present application;

[0073] Fig.21B A schematic diagram of the structure of a second reference line provided in an embodiment of the present application;

[0074] Fig.22A A schematic diagram of the structure of a second reference line provided in an embodiment of the present application;

[0075] Fig. 22B A schematic diagram of the structure of a second reference line provided in an embodiment of the present application;

[0076] Fig. 22C A schematic diagram of the structure of a second reference line provided in an embodiment of the present application;

[0077] Fig.23A A schematic diagram of a structure of a second deflection angle provided in an embodiment of the present application;

[0078] Fig. 23B A schematic diagram of a structure of a second deflection angle provided in an embodiment of the present application;

[0079] Fig.23C A schematic diagram of a structure of a second deflection angle provided in an embodiment of the present application;

[0080] Fig.24A A schematic diagram of a structure of a second deflection angle provided in an embodiment of the present application;

[0081] Fig. 24B A schematic diagram of a structure of a second deflection angle provided in an embodiment of the present application;

[0082] Fig.24C A schematic diagram of a structure of a second deflection angle provided in an embodiment of the present application;

[0083] Fig.25A A schematic diagram of a structure of a second deflection angle provided in an embodiment of the present application;

[0084] Fig.25B A schematic diagram of a structure of a second deflection angle provided in an embodiment of the present application;

[0085] Fig.25C A schematic diagram of a structure of a second deflection angle provided in an embodiment of the present application;

[0086] Fig.26A A schematic diagram of a structure of a first deflection angle provided in an embodiment of the present application;

[0087] Fig.26B A schematic diagram of a structure of a first deflection angle provided in an embodiment of the present application;

[0088] Fig.26C A schematic diagram of a structure of a first deflection angle provided in an embodiment of the present application;

[0089] Fig.27A A schematic diagram of a structure of a first deflection angle provided in an embodiment of the present application;

[0090] Fig.27B A schematic diagram of a structure of a first deflection angle provided in an embodiment of the present application;

[0091] Fig.27C A schematic diagram of a structure of a first deflection angle provided in an embodiment of the present application;

[0092] Fig.28A A schematic diagram of a structure of a first deflection angle provided in an embodiment of the present application;

[0093] Fig.28B A schematic diagram of a structure of a first deflection angle provided in an embodiment of the present application;

[0094] Fig.28C A schematic diagram of a structure of a first deflection angle provided in an embodiment of the present application;

[0095] Fig.29A A schematic diagram of a structure of a first deflection angle provided in an embodiment of the present application;

[0096] Fig.29B A schematic diagram of a structure of a first deflection angle provided in an embodiment of the present application;

[0097] Fig.29C A schematic diagram of a structure of a first deflection angle provided in an embodiment of the present application;

[0098] Fig.30 A schematic diagram of the structure of a first virtual curved surface provided in an embodiment of the present application;

[0099] Fig.31 A schematic flow chart of a method for determining a first virtual curved surface provided in an embodiment of the present application;

[0100] Fig.32 A schematic diagram of the structure of a first virtual curved surface provided in an embodiment of the present application;

[0101] Fig.33A A schematic diagram of the structure of a first virtual curved surface provided in an embodiment of the present application;

[0102] Fig.33BA schematic diagram of the structure of a second reference position provided in an embodiment of the present application;

[0103] Fig.33C A schematic diagram of the structure of a first virtual curved surface provided in an embodiment of the present application;

[0104] Fig.34A A schematic diagram of a cursor position structure provided in an embodiment of the present application;

[0105] Fig.34B A schematic diagram of a cursor position structure provided in an embodiment of the present application;

[0106] Fig.34C A schematic diagram of a cursor position structure provided in an embodiment of the present application;

[0107] Fig.34D A schematic diagram of a cursor position structure provided in an embodiment of the present application;

[0108] Fig.35A A schematic diagram of a cursor position structure provided in an embodiment of the present application;

[0109] Fig.35B A schematic diagram of a cursor position structure provided in an embodiment of the present application;

[0110] Fig.36 A flowchart of a method for determining a cursor position provided in an embodiment of the present application;

[0111] Fig.37 A is a structural schematic diagram of a cursor position provided in an embodiment of the present application;

[0112] Fig.37 B is a structural schematic diagram of a cursor position provided in an embodiment of the present application;

[0113] Fig.38 A flowchart of a method for determining a cursor position provided in an embodiment of the present application;

[0114] Fig.39 A is a structural schematic diagram of a cursor position provided in an embodiment of the present application;

[0115] Fig.39 B is a structural schematic diagram of a cursor position provided in an embodiment of the present application;

[0116] Fig.40 A schematic diagram of the hardware structure of a head-mounted display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0117] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0118] Below, some terms in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.

[0119] A remote control device with an air mouse mode can be called an air mouse, air mouse, air mouse, or flying mouse. The remote control device has a built-in gyroscope, which can sense changes in direction and speed. When you wave the remote control device in the air, you can accurately control the cursor corresponding to the remote control device to move on the screen of the electronic device.

[0120] It should be understood that the electronic devices in the embodiments of the present application may be smart home devices (for example, smart TVs, smart projectors, smart speakers, smart cameras, etc.), augmented reality (AR) / virtual reality (VR) devices, vehicle-mounted devices, wearable devices (for example, watches, bracelets, helmets, headphones, etc.), personal digital assistants (PDA), ultra-mobile personal computers (UMPC), laptops, tablet computers, netbooks, mobile phones, etc., without limitation herein.

[0121] Figure 1A A three-dimensional diagram of a remote control device 100 provided in an embodiment of the present application is shown. Figure 1A As shown, the remote control device 100 includes a plurality of buttons and a touch pad. Figure 1B FIG. 1 shows a scene diagram of a user using a remote control device 100 to control a screen device 200 provided in an embodiment of the present application, such as Figure 1B As shown, the remote control device 100 may also include a signal indicating device. In this application, the end of the remote control device 100 including the signal indicating device is referred to as the head of the remote control device 100, and the opposite end of the end including the signal indicating device is referred to as the tail. When the user uses the remote control device to control the screen device, the user holds the remote control device close to the tail, and the head of the remote control device generally points to the screen device. In the following, the direction pointed by the head of the remote control device is referred to as the pointing direction of the remote control device. Figure 1A as well as Figure 1B Based on the remote control device shown, the remote control device may also have other modified structures, which are not limited here.

[0122] The hardware structure diagram corresponding to the remote control device 100 is as follows: Figure 1CAs shown, the remote control device 100 may include a processor 110, a universal serial bus (USB) interface 120, a charging management module 130, a power management module 131, a battery 132, an antenna 1, an antenna 2, a mobile communication module 140, a wireless communication module 150, a sensor module 160, a button 170, an indicator 171, etc. The sensor module 160 may include a pressure sensor 160A, a gyroscope sensor 160B, an air pressure sensor 160C, a magnetic sensor 160D, an acceleration sensor 160E, a distance sensor 160F, a touch sensor 160K, etc.

[0123] It is to be understood that the structure shown in the embodiment of the present application does not constitute a specific limitation on the remote control device 100. In other embodiments of the present application, the remote control device 100 may include Figure 1C More or fewer components than those shown in the drawings may be used, some components may be combined, some components may be separated, or different component arrangements may be used. Figure 1C The components shown may be implemented in hardware, software, or a combination of software and hardware.

[0124] Below Figure 1C The components of the remote control device 100 shown will be described in detail.

[0125] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, etc. Among them, different processing units may be independent devices or integrated into one or more processors. Among them, the controller may be the nerve center and command center of the remote control device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0126] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory, thereby avoiding repeated access, reducing the waiting time of the processor 110, and thus improving the efficiency of the system.

[0127] In some embodiments, the processor 110 may include one or more interfaces. For example, the interface may include an inter-integrated circuit (I2C) interface, a universal asynchronous receiver / transmitter (UART) interface, and / or a universal serial bus (USB) interface.

[0128] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 160K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 160K through the I2C interface, so that the processor 110 communicates with the touch sensor 160K through the I2C bus interface, thereby realizing the touch function of the remote control device 100.

[0129] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 150. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 150 through the UART interface to implement the Bluetooth function.

[0130] The USB interface 120 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 120 can be used to connect a charger to charge the remote control device 100, and can also be used to transmit data between the remote control device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as mobile phones, etc.

[0131] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the remote control device 100. In other embodiments of the present application, the remote control device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0132] The charging management module 130 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 130 may receive charging input from a wired charger through the USB interface 120. In some wireless charging embodiments, the charging management module 130 may receive wireless charging input through a wireless charging coil of the remote control device 100. While the charging management module 130 is charging the battery 132, it may also power the electronic device through the power management module 131.

[0133] The power management module 131 is used to connect the battery 132, the charging management module 130 and the processor 110. The power management module 131 receives input from the battery 132 and / or the charging management module 130, and supplies power to the processor 110 and the wireless communication module 150. The power management module 131 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 131 can also be set in the processor 110. In other embodiments, the power management module 131 and the charging management module 130 can also be set in the same device.

[0134] The wireless communication function of the remote control device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 140, the wireless communication module 150, the modem processor and the baseband processor.

[0135] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the remote control device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0136] The mobile communication module 140 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the remote control device 100. The mobile communication module 140 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 140 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 140 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 140 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 140 can be set in the same device as at least some of the modules of the processor 110.

[0137] The wireless communication module 150 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the remote control device 100. The wireless communication module 150 can be one or more devices integrating at least one communication processing module. The wireless communication module 150 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signal and filters it, and sends the processed signal to the processor 110. The wireless communication module 150 can also receive the signal to be sent from the processor 110, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0138] In some embodiments, the antenna 1 of the remote control device 100 is coupled to the mobile communication module 140, and the antenna 2 is coupled to the wireless communication module 150, so that the remote control device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0139] The pressure sensor 160A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. There are many types of pressure sensors 160A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a device including at least two parallel plates with conductive materials. When a force acts on the pressure sensor 160A, the capacitance between the electrodes changes. The remote control device 100 determines the intensity of the pressure based on the change in capacitance. The remote control device 100 can also calculate the touch position based on the detection signal of the pressure sensor 160A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions.

[0140] The gyro sensor 160B can be used to determine the motion posture of the remote control device 100. In some embodiments, the angular velocity of the remote control device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 160B. The gyro sensor 160B can be used for shooting anti-shake. The gyro sensor 160B can also be used for navigation and somatosensory game scenes.

[0141] The air pressure sensor 160C is used to measure air pressure. In some embodiments, the remote control device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 160C to assist in positioning and navigation.

[0142] The magnetic sensor 160D includes a Hall sensor. The remote control device 100 can use the magnetic sensor 160D to detect the opening and closing of the flip leather case. In some embodiments, when the remote control device 100 is a flip-type head display, the remote control device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 160D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover automatic unlocking and other features are set.

[0143] The acceleration sensor 160E can detect the magnitude of acceleration of the remote control device 100 in all directions (generally three axes). When the remote control device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0144] The distance sensor 160F is used to measure the distance. The remote control device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the remote control device 100 can use the distance sensor 160F to measure the distance to achieve fast focusing.

[0145] The touch sensor 160K is also called a "touch panel". The touch sensor 160K is used to detect a touch operation applied thereto or near the touch sensor. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. In other embodiments, the touch sensor 160K can also be disposed on the surface of the remote control device 100.

[0146] The button 170 includes a power button, a volume button, etc. The button 170 can be a mechanical button or a touch button. The remote control device 100 can receive the button input and generate a key signal input related to the user setting and function control of the remote control device 100.

[0147] The indicator 171 may be an indicator light, which may be used to indicate the charging status, power changes, messages, missed calls, notifications, etc.

[0148] The software system of the remote control device 100 may adopt a layered architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the remote control device 100 .

[0149] Figure 1D 4 is a software structure block diagram of the remote control device 100 according to an embodiment of the present invention.

[0150] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer.

[0151] The application layer can include a series of application packages.

[0152] like Figure 1D As shown, the application package may include applications such as WLAN, Bluetooth, etc.

[0153] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0154] like Figure 1D As shown, the application framework layer may include a window manager, a content provider, etc.

[0155] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0156] Content providers are used to store and retrieve data and make it accessible to applications.

[0157] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0158] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0159] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0160] The system library can include multiple functional modules, such as surface manager, etc.

[0161] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0162] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver and sensor driver.

[0163] In conjunction with the accompanying drawings, taking the screen device as a smart TV screen as an example, the positional relationship between the remote control device and the smart TV screen is further explained.

[0164] When a user uses a remote control device to control a smart TV, the user can operate the buttons on the remote control device to switch the remote control device to the air mouse mode. Figure 2 As shown in the scenario diagram, after the remote control device is switched to the air mouse mode, the remote control device can transmit the cursor position information to the smart TV, and the smart TV can display the cursor at a position corresponding to the cursor position information on the smart TV screen based on the cursor position information.

[0165] like Figure 3A In the scene diagram shown, the distance between the remote control device and the smart TV screen is L1. The user holds the remote control device so that the direction of the remote control device starts from perpendicular to the smart TV screen and deflects at an angle a on the horizontal plane. The distance the cursor moves on the smart TV screen is L2. Figure 3B In the scene diagram shown, the distance between the remote control device and the smart TV screen is L3, where L3 is greater than L1. The user holds the remote control device so that the pointing direction of the remote control device starts from perpendicular to the smart TV screen and is also deflected by angle a in the horizontal plane, but the distance L4 that the cursor moves on the smart TV screen is greater than L2. In other words, when the distance between the remote control device and the smart TV screen is different, when the remote control device is deflected by the same angle, the distance that the cursor moves on the smart TV screen is not the same. That is, when the remote control device is deflected by the same angle, the greater the distance between the remote control device and the smart TV screen, the greater the distance that the cursor moves on the smart TV screen; the smaller the distance between the remote control device and the smart TV screen, the smaller the distance that the cursor moves on the smart TV screen. This will cause the cursor movement accuracy to be affected by the distance between the remote control device and the smart TV screen when the user uses the remote control device, and the user cannot accurately control the cursor movement accuracy, which reduces the user's experience.

[0166] like Figure 4AIn the scene diagram shown, the distance between the remote control device and the smart TV screen is L1. The user holds the remote control device so that the pointing direction of the remote control device starts from perpendicular to the smart TV screen (that is, the angle between the pointing direction of the remote control device and the horizontal plane is 0), deflects at an angle a on the horizontal plane, and the distance the cursor moves on the smart TV screen is L2. Figure 4B In the scene diagram shown, the distance between the remote control device and the smart TV screen is L1. The user holds the remote control device so that the pointing direction of the remote control device starts from an angle b with the horizontal plane and deflects at an angle a on the horizontal plane, but the distance L5 that the cursor moves on the smart TV screen is greater than L2. In other words, when the pointing directions of the remote control device are different, when the remote control device is deflected at the same angle, the distance that the cursor moves on the smart TV screen is not the same. That is, when the remote control device is deflected at the same angle, the greater the angle between the pointing direction of the remote control device and the horizontal plane, the greater the distance that the cursor moves on the smart TV screen; the smaller the angle between the pointing direction of the remote control device and the horizontal plane, the smaller the distance that the cursor moves on the smart TV screen. This will cause the cursor movement accuracy to be affected by the pointing direction of the remote control device when the user uses the remote control device, and the user cannot accurately control the cursor movement accuracy, reducing the user's experience.

[0167] The following embodiments can all be implemented in an electronic device having the above hardware structure (eg, remote control device 100). The following embodiments will take remote control device 100 as an example and describe in detail the cursor position determination method provided in the embodiments of the present application in conjunction with the accompanying drawings.

[0168] Figure 5 The following is a flow chart of a method for determining a cursor position provided by an embodiment of the present application. The method for determining a cursor position may include:

[0169] S501: When a pointing direction of the remote control device is deflected, the remote control device determines a first deflection angle of the pointing direction of the remote control device relative to a first reference line.

[0170] Before the remote control device executes the above S501, the remote control device receives a first operation, wherein the first operation includes an operation of the user deflecting the pointing direction of the remote control device, wherein the deflection of the pointing direction of the remote control device includes horizontal deflection and / or vertical deflection.

[0171] In order to facilitate the definition of the position of the remote control device, a geodetic reference coordinate system can be established, such as Fig. 6A As shown, one way to define the geodetic reference coordinate system is as follows: the positive direction of the x-axis is tangent to the ground where the remote control device is currently located, pointing directly to the east; the positive direction of the y-axis is also tangent to the ground and points to the magnetic north pole. The xOy plane formed by the x-axis and the y-axis is the horizontal plane; the positive direction of the z-axis is perpendicular to the horizontal plane and points to the sky. Fig. 6AThe geodetic reference coordinate system shown is applied to the scenario of remote control device and smart TV, such as Figure 6B As shown. Figure 6B In the illustrated scenario, several possible implementations of the positional relationship between the remote control device and the smart TV screen are provided.

[0172] Implementation method 1: In the geodetic coordinate system, Figure 6B The first plane of the remote control device is parallel to the horizontal plane, wherein the first plane is the plane where the buttons on the remote control device are located, Figure 6B The smart TV screen in is parallel to the xOz plane formed by the x-axis and the z-axis.

[0173] Among them, the first plane of the remote control device is parallel to the horizontal plane, which can be understood as: the angle between the first plane of the remote control device and the horizontal plane is 0, or the angle between the first plane of the remote control device and the horizontal plane is θ, θ is greater than 0 and less than the first angle threshold, and the first angle threshold can be set according to actual needs, and this document does not impose any restrictions on this.

[0174] The smart TV screen being parallel to the xOz plane can be understood as: the angle between the smart TV screen and the xOz plane is 0, or the angle between the smart TV screen and the xOz plane is θ, θ is greater than 0 and less than a first angle threshold, and the first angle threshold can be set according to actual needs, and this article does not impose any restrictions on this.

[0175] In this first embodiment, Figure 6B The corresponding top view (i.e., the view seen along the negative direction of the z-axis) of the scene shown in the geodetic coordinate system is as follows Fig. 7A As shown, Figure 6B The left view (i.e., the view seen along the negative direction of the x-axis) corresponding to the scene shown is as follows Figure 7B shown.

[0176] After the remote control device is turned on, when the head of the remote control device points to the smart TV screen, a cursor can be displayed on the smart TV screen. The position of the cursor is the position where the remote control device can control the smart TV screen. Fig. 7A The top view and Figure 7B In the left view shown, the first plane of the remote control device is parallel to the horizontal plane (i.e., the xOy plane in the geodetic coordinate system) and the head of the remote control device points to position 1 on the smart TV screen, and the cursor corresponding to the remote control device is displayed at position 1 on the smart TV screen. The user can hold the remote control device and adjust the pointing direction of the remote control device to change the position of the smart TV screen that needs to be controlled. Adjusting the pointing direction of the remote control device includes horizontal deflection and / or vertical deflection. Three possible implementations are provided below.

[0177] In a first possible implementation, the remote control device is deflected in the horizontal direction, that is, the tail of the remote control device is fixed, and the head of the remote control device is deflected by an angle a (where a is greater than 0) along the positive direction of the x-axis on the horizontal plane, such as Figure 7C As shown in the top view and the left view of 7D, the cursor corresponding to the remote control device after deflection is displayed at position 2 on the smart TV screen. Fig. 7A , Figure 7B , Figure 7C , Fig.7D It can be seen that when the head of the remote control device is deflected by angle a along the positive direction of the x-axis on the horizontal plane, the cursor on the smart TV screen will also move a certain distance along the positive direction of the x-axis. In some embodiments, the tail of the remote control device can also be fixed, and the head of the remote control device can be deflected by angle a along the negative direction of the x-axis on the horizontal plane, which will not be described in detail here.

[0178] In a second possible implementation, the remote control device is deflected in a vertical direction, that is, the tail of the remote control device is fixed, and the head of the remote control device is deflected by an angle b (where b is greater than 0) along the positive direction of the z-axis on the yOz plane formed by the y-axis and the z-axis, such as Fig. 7E As shown in the top view and the left view of 7F, the cursor corresponding to the remote control device after deflection is displayed at position 3 on the smart TV screen. Fig. 7A , Figure 7B , Fig. 7E , Figure 7F It can be seen that when the head of the remote control device is deflected by angle b along the positive direction of the z-axis on the yOz plane, the cursor on the smart TV screen will also move a certain distance along the positive direction of the z-axis. In some embodiments, the tail of the remote control device can also be fixed, and the head of the remote control device can be rotated by angle b along the negative direction of the z-axis on the yOz plane, which will not be described in detail here.

[0179] In a third possible implementation, the remote control device is deflected in the horizontal direction and the vertical direction at the same time, that is, the tail of the remote control device is fixed, the head of the remote control device is deflected by an angle a along the positive direction of the x-axis on the horizontal plane, and the head of the remote control device is deflected by an angle b along the positive direction of the z-axis on the yOz plane formed by the y-axis and the z-axis (where a is greater than 0 and b is greater than 0), as shown in FIG. Figure 7G As shown in the top view and the left view of 7H, the cursor corresponding to the remote control device after deflection is displayed at position 4 on the smart TV screen. Fig. 7A , Figure 7B , Figure 7G , Figure 7HIt can be seen that when the head of the remote control device is deflected by angle a along the positive direction of the x-axis on the horizontal plane, the cursor on the smart TV screen will also move a certain distance along the positive direction of the x-axis, and when the head of the remote control device is deflected by angle b along the positive direction of the z-axis on the yOz plane, the cursor on the smart TV screen will also move a certain distance along the positive direction of the z-axis. In some embodiments, the tail of the remote control device can also be fixed, and the head of the remote control device can be deflected by angle a along the negative direction of the x-axis on the horizontal plane; at the same time, the tail of the remote control device can also be fixed, and the head of the remote control device can be rotated by angle b along the negative direction of the z-axis on the yOz plane, which will not be described in detail here.

[0180] Implementation method 2: In the geodetic coordinate system, Figure 6B The first plane of the remote control device is parallel to the second plane, wherein the angle between the second plane and the horizontal plane is angle c, the first plane is the plane where the buttons on the remote control device are located, and angle c is greater than 0 and less than 180 degrees, Figure 6B The smart TV screen in is parallel to the xOz plane formed by the x-axis and the z-axis.

[0181] In the second embodiment, Figure 6B The corresponding top view (i.e., the view seen along the negative direction of the z-axis) of the scene shown in the geodetic coordinate system is as follows Fig. 8A As shown, Figure 6B The left view (i.e., the view seen along the negative direction of the x-axis) corresponding to the scene shown is as follows Figure 8B shown.

[0182] After the remote control device is turned on, when the head of the remote control device points to the smart TV screen, a cursor can be displayed on the smart TV screen. The position of the cursor is the position where the remote control device can control the smart TV screen. Fig. 8A The top view and Figure 8B In the left view shown, the angle between the first plane of the remote control device and the horizontal plane is angle c, and the head of the remote control device points to position 5 on the smart TV screen, and the cursor corresponding to the remote control device is displayed at position 5 on the smart TV screen. The user can hold the remote control device and adjust the pointing direction of the remote control device to change the position of the smart TV screen that needs to be controlled. Adjusting the pointing direction of the remote control device includes horizontal deflection and / or vertical deflection. Three possible implementations are provided below.

[0183] In a first possible implementation, the remote control device is deflected in the horizontal direction, that is, the tail of the remote control device is fixed, and the head of the remote control device is deflected by an angle a (where a is greater than 0) along the positive direction of the x-axis on the second plane, such as Figure 8C As shown in the top view and the 8D left view, the cursor corresponding to the remote control device is displayed at position 6 on the smart TV screen after deflection. Fig. 8A , Figure 8B , Figure 8C , Fig.8D It can be seen that when the head of the remote control device is deflected by angle a along the positive direction of the x-axis on the second plane, the cursor on the smart TV screen will also move a certain distance along the positive direction of the x-axis. In some embodiments, the tail of the remote control device can also be fixed, and the head of the remote control device can be deflected by angle a along the negative direction of the x-axis on the second plane, which will not be described in detail here.

[0184] In a second possible implementation, the remote control device is deflected in a vertical direction, that is, the tail of the remote control device is fixed, and the head of the remote control device is deflected by an angle b (where b is greater than 0) along the positive direction of the z-axis on the yOz plane formed by the y-axis and the z-axis, such as Fig. 8E As shown in the top view and the left view 8F, the cursor corresponding to the remote control device is displayed at position 7 on the smart TV screen after deflection. Fig. 8A , Figure 8B , Fig. 8E , Fig.8F It can be seen that when the head of the remote control device is deflected by angle b along the positive direction of the z-axis on the yOz plane, the cursor on the smart TV screen will also move a certain distance along the positive direction of the z-axis. In some embodiments, the tail of the remote control device can also be fixed, and the head of the remote control device can be rotated by angle b along the negative direction of the z-axis on the yOz plane, which will not be described in detail here.

[0185] In a third possible implementation, the remote control device is deflected in the horizontal direction and the vertical direction at the same time, that is, the tail of the remote control device is fixed, the head of the remote control device is deflected by an angle a along the positive direction of the x-axis on the second plane, and the head of the remote control device is deflected by an angle b along the positive direction of the z-axis on the yOz plane formed by the y-axis and the z-axis (where a is greater than 0 and b is greater than 0), as shown in FIG. Figure 8G As shown in the top view and the left view 8H, the cursor corresponding to the remote control device after deflection is displayed at position 8 on the smart TV screen. Fig. 8A , Figure 8B , Figure 8G , Figure 8HIt can be seen that when the head of the remote control device is deflected by angle a along the positive direction of the x-axis on the second plane, the cursor on the smart TV screen will also move a certain distance along the positive direction of the x-axis, and when the head of the remote control device is deflected by angle b along the positive direction of the z-axis on the yOz plane, the cursor on the smart TV screen will also move a certain distance along the positive direction of the z-axis. In some embodiments, the tail of the remote control device can also be fixed, and the head of the remote control device can be deflected by angle a along the negative direction of the x-axis on the second plane; at the same time, the tail of the remote control device can be fixed, and the head of the remote control device can be rotated by angle b along the negative direction of the z-axis on the yOz plane, which will not be described in detail here.

[0186] In the embodiment of the present application, the first reference line is determined based on the position of the remote control device and the center position of the screen device. The position of the remote control device may be the center position of the head of the remote control device (see Fig. 9 ), or the center position of the remote control device (see Fig.10 ), and can also be determined in other ways, which are not limited here.

[0187] In a possible implementation, a line connecting the position of the remote control device and the center position of the screen device is used as the first reference line. The position of the remote control device is not fixed, and the user can adjust the position of the remote control device at any time. When the screen device is fixed, the first reference line changes with the position of the remote control device. For example, the screen device is a smart TV screen. Fig.11 As shown, the remote control device is located in front of the center of the screen, and the first reference line is perpendicular to the plane where the smart TV screen is located, that is, the first reference line is the midline of the smart TV screen. Fig.12 As shown, the remote control device is not located directly in front of the center of the screen, so there is a certain angle between the first reference line and the perpendicular bisector of the smart TV screen.

[0188] like Fig.13A and Fig. 13B As shown in FIG. 1 , the pointing direction of the remote control device can be regarded as a straight line starting from the position of the remote control device and parallel to the long edge line of the remote control device. The pointing direction of the remote control device is affected by the position of the remote control device.

[0189] The first reference line is not affected by the pointing direction of the remote control device. The following examples are all taken as an example of a smart TV screen.

[0190] like Fig.14A As shown, when the position of the remote control device remains unchanged and the pointing direction of the remote control device changes, the first reference line remains unchanged and is not affected by the pointing direction of the remote control device. Fig. 14BAs shown in FIG. 1 , when the position of the remote control device changes and the pointing direction of the remote control device remains unchanged, the first reference line changes along with the position of the remote control device. Fig. 14C As shown, when the position of the remote control device changes and the pointing direction of the remote control device changes, the first reference line changes with the position of the remote control device and is not affected by the pointing direction of the remote control device.

[0191] The first reference line and the pointing direction of the remote control device may include the following multiple possible relationships, which are all illustrated below using the screen device as a smart TV screen.

[0192] by Fig.15A In the scene shown, the remote control device is located in front of the center of the smart TV screen, and the direction of the remote control device is perpendicular to the smart TV screen. Fig. 15B for Fig.15A The corresponding top view, Fig. 15C for Fig.15A The corresponding left view, combined with Fig. 15B and Fig. 15C It can be seen that the pointing direction of the remote control device coincides with the first reference line.

[0193] by Fig.16A In the scene shown, the remote control device is located in front of the center of the smart TV screen, and the pointing direction of the remote control device is not perpendicular to the smart TV screen. Fig. 16B for Fig.16A The corresponding top view, Fig. 16C for Fig.16A The corresponding left view, combined with Fig. 16B and Fig. 16C It can be seen that the pointing direction of the remote control device does not coincide with the first reference line.

[0194] by Fig.17A In the scene shown, the remote control device is not located directly in front of the center of the smart TV screen, and the pointing direction of the remote control device is not perpendicular to the smart TV screen. Fig. 17B for Fig.17A The corresponding top view, Fig. 17C for Fig.17A The corresponding left view, combined with Fig. 17B and Fig. 17C It can be seen that the pointing direction of the remote control device does not coincide with the first reference line.

[0195] In the embodiment of the present application, the remote control device may determine the first deflection angle of the pointing direction of the remote control device relative to the first reference line in the following two possible implementations:

[0196] In a first possible implementation manner, the remote control device determining a first deflection angle of a pointing direction of the remote control device relative to a first reference line may include the following steps:

[0197] In a possible implementation, the angle between the pointing direction of the remote control device and the first reference plane is used as the first horizontal deflection angle, wherein the first reference plane is a plane perpendicular to the horizontal plane and includes the first reference line. The angle between the pointing direction of the remote control device and the second reference plane is used as the first vertical deflection angle, wherein the second reference plane is a plane parallel to the horizontal plane and includes the first reference line. Finally, the obtained first horizontal deflection angle and first vertical deflection angle are used as the first deflection angle.

[0198] It should be understood that the method for calculating the angle between the pointing direction of the remote control device and the first reference plane, or the angle between the pointing direction of the remote control device and the second reference plane can refer to the method for calculating the angle between a straight line and a plane in geometry, which will not be elaborated here.

[0199] by Fig.15A In the scene shown, the remote control device is located in front of the center of the smart TV screen, and the direction of the remote control device is perpendicular to the smart TV screen. Fig. 15B for Fig.15A The corresponding top view, Fig. 15C for Fig.15A The corresponding left view, combined with Fig. 15B and Fig. 15C It can be seen that the pointing direction of the remote control device coincides with the first reference line. When the pointing direction of the remote control device coincides with the first reference line, it can be seen that the first horizontal deflection angle and the first vertical deflection angle are both 0.

[0200] by Fig.18A In the scene shown, the remote control device is located in front of the center of the smart TV screen, and the pointing direction of the remote control device is not perpendicular to the smart TV screen. Fig.18B for Fig.18A The corresponding top view, Fig.18C for Fig.18A The corresponding left view, combined with Fig.18B and Fig.18C It can be seen that the first reference plane is a plane perpendicular to the horizontal plane and including the first reference line, the second reference plane is a plane parallel to the horizontal plane and including the first reference line, the angle between the pointing direction of the remote control device and the first reference plane is angle a1, so the first horizontal deflection angle is a1, the angle between the pointing direction of the remote control device and the second reference plane is angle b1, so the first vertical deflection angle is b1.

[0201] by Fig.19AIn the scene shown, the remote control device is not located directly in front of the center of the smart TV screen, and the pointing direction of the remote control device is not perpendicular to the smart TV screen. Fig.19B for Fig.19A The corresponding top view, Fig.19C for Fig.19A The corresponding left view, combined with Fig.19B and Fig.19C It can be seen that the first reference plane is a plane perpendicular to the horizontal plane and including the first reference line, the second reference plane is a plane parallel to the horizontal plane and including the first reference line, the angle between the pointing direction of the remote control device and the first reference plane is angle a2, so the first horizontal deflection angle is a2, the angle between the pointing direction of the remote control device and the second reference plane is angle b2, so the first vertical deflection angle is b2.

[0202] In a second possible implementation manner, the remote control device determines that the first deflection angle of the pointing direction of the remote control device relative to the first reference line may include: Fig. 20 The following steps are shown:

[0203] S2001: The remote control device determines a second reference line based on the position of the remote control device and the position of the screen device.

[0204] In the embodiment of the present application, the position of the remote control device is used as the starting point, a straight line perpendicular to the screen device is determined, the intersection of the straight line and the screen device is used as the end point, and the line between the starting point and the end point is used as the second reference line. Therefore, when the screen device is fixed, the second reference line changes with the position of the remote control device.

[0205] The following examples are all described using a smart TV screen as an example.

[0206] For example Fig.21A As shown, the remote control device is located in front of the center of the smart TV screen, and the determined second reference line coincides with the first reference line.

[0207] For example Fig.21B As shown, the remote control device is not located directly in front of the center of the smart TV screen, and the determined second reference line does not overlap with the first reference line.

[0208] In addition, the second reference line is not affected by the pointing direction of the remote control device. The following examples are all taken as an example of a smart TV screen. Fig.22A As shown, when the position of the remote control device remains unchanged and the pointing direction of the remote control device changes, the second reference line remains unchanged and is not affected by the pointing direction of the remote control device. Fig. 22BAs shown in FIG. 1 , when the position of the remote control device changes and the pointing direction of the remote control device remains unchanged, the second reference line changes along with the position of the remote control device. Fig. 22C As shown, when the position of the remote control device changes and the pointing direction of the remote control device changes, the second reference line changes with the position of the remote control device and is not affected by the pointing direction of the remote control device.

[0209] S2002: The remote control device determines a second deflection angle based on the first reference line and the second reference line.

[0210] In the embodiment of the present application, the second deflection angle includes a second horizontal deflection angle and / or a second vertical deflection angle.

[0211] In the embodiment of the present application, determining the second horizontal deflection angle and the second vertical deflection angle may include the following two possible implementations:

[0212] In a possible implementation, the angle between the second reference line and the third reference plane is used as the second horizontal deflection angle, wherein the third reference plane is a plane perpendicular to the horizontal plane and including the first reference line. The angle between the second reference line and the fourth reference plane is used as the second vertical deflection angle, wherein the fourth reference plane is a plane parallel to the horizontal plane and including the first reference line. Finally, the obtained second horizontal deflection angle and the second vertical deflection angle are used as the second deflection angle.

[0213] It should be understood that the method for calculating the angle between the second reference line and the third reference plane, or the angle between the second reference line and the fourth reference plane can refer to the method for calculating the angle between a straight line and a plane in geometry, which will not be elaborated here.

[0214] In another possible implementation, the length of the second reference line is used as the first distance, wherein the first distance is the distance between the position of the remote control device and the center position of the screen device in the y-axis direction; the distance between the end point of the second reference line and the center position of the screen device in the x-axis direction is used as the second distance, wherein the second distance is the distance between the position of the remote control device and the center position of the screen device in the x-axis direction; the distance between the end point of the second reference line and the center position of the screen device in the z-axis direction is used as the third distance, wherein the third distance is the distance between the position of the remote control device and the center position of the screen device in the z-axis direction.

[0215] After determining the first distance, the second distance and the third distance, the second horizontal deflection angle and the second vertical deflection angle can be determined according to the inverse tangent function, where the second horizontal deflection angle = arctan (second distance / first distance), the second vertical deflection angle = arctan (third distance / first distance), where / is a semicolon.

[0216] The second horizontal deflection angle is shown in formula (1):

[0217]

[0218] Wherein, Δα_horizontal represents the second horizontal deflection angle, distance_x represents the second distance, and distance_y represents the first distance.

[0219] The second vertical deflection angle is shown in formula (2):

[0220]

[0221] Wherein, Δα_vertical represents the second vertical deflection angle, distance_z represents the third distance, and distance_y represents the first distance.

[0222] The following examples are all described using a smart TV screen as an example.

[0223] by Fig.23A In the scene shown, the remote control device is located in front of the center of the smart TV screen, and the direction of the remote control device is perpendicular to the smart TV screen. Fig. 23B for Fig.23A The corresponding top view, Fig.23C for Fig.23A The corresponding left view, combined with Fig. 23B and Fig.23C It can be seen that the first reference line and the second reference line coincide, so the determined first distance is d1, and the second distance and the third distance are both 0. According to the inverse tangent function, the second horizontal deflection angle=arctan(0 / d1)=0, and the second vertical deflection angle=arctan(0 / d1)=0.

[0224] by Fig.24A In the scene shown, the remote control device is located in front of the center of the smart TV screen, and the pointing direction of the remote control device is not perpendicular to the smart TV screen. Fig. 24B for Fig.24A The corresponding top view, Fig.24C for Fig.24A The corresponding left view, combined with Fig. 24B and Fig.24C It can be seen that the first reference line and the second reference line coincide, so the determined first distance is d1, and the second distance and the third distance are both 0. According to the inverse tangent function, the second horizontal deflection angle=arctan(0 / d1)=0, and the second vertical deflection angle=arctan(0 / d1)=0.

[0225] by Fig.25AIn the scenario shown, the remote control device is not located directly in front of the center of the smart TV screen, and the pointing direction of the remote control device is not perpendicular to the smart TV screen. Fig.25B for Fig.25A The corresponding top view, Fig.25C for Fig.25A The corresponding left view, combined with Fig.25B and Fig.25C It can be seen that the first reference line and the second reference line do not overlap, so the determined first distance is d1, the second distance is d2, and the third distance is d3. According to the inverse tangent function, the second horizontal deflection angle = arctan (d2 / d1), the second vertical deflection angle = arctan (d3 / d1).

[0226] S2003: The remote control device determines a third deflection angle based on the second reference line and the pointing direction of the remote control device.

[0227] In the embodiment of the present application, the third deflection angle includes a third horizontal deflection angle and / or a third vertical deflection angle.

[0228] In a possible implementation, the angle between the pointing direction of the remote control device and the fifth reference plane is used as the third horizontal deflection angle, wherein the fifth reference plane is a plane perpendicular to the horizontal plane and includes the first reference line. The angle between the pointing direction of the remote control device and the sixth reference plane is used as the third vertical deflection angle, wherein the sixth reference plane is parallel to the horizontal plane and includes the first reference line. Finally, the obtained third horizontal deflection angle and third vertical deflection angle are used as the third deflection angle.

[0229] It should be understood that the method for calculating the angle between the pointing direction of the remote control device and the fifth reference plane, or the angle between the pointing direction of the remote control device and the sixth reference plane can refer to the method for calculating the angle between a straight line and a plane in geometry, which will not be elaborated here.

[0230] S2004: The remote control device determines a first deflection angle based on the second deflection angle and the third deflection angle.

[0231] In an embodiment of the present application, if the pointing direction of the remote control device is not between the first reference line and the second reference line, the sum of the second horizontal deflection angle and the third horizontal deflection angle is the first horizontal deflection angle, and the sum of the second vertical deflection angle and the third vertical deflection angle is the first vertical deflection angle.

[0232] If the pointing direction of the remote control device is between the first reference line and the second reference line, the difference between the second horizontal deflection angle and the third horizontal deflection angle is the first horizontal deflection angle, and the difference between the second vertical deflection angle and the third vertical deflection angle is the first vertical deflection angle.

[0233] Finally, the obtained first horizontal deflection angle and the first vertical deflection angle are used as the first deflection angle.

[0234] The following examples are all described using a smart TV screen as an example.

[0235] by Fig.26A In the scene shown, the remote control device is located in front of the center of the smart TV screen, and the direction of the remote control device is perpendicular to the smart TV screen. Fig.26B for Fig.26A The corresponding top view, Fig.26C for Fig.26A The corresponding left view, combined with Fig.26B and Fig.26C It can be seen that the first reference line and the second reference line coincide with each other, so the determined first distance is d1, and the second distance and the third distance are both 0. According to the inverse tangent function, the second horizontal deflection angle = arctan(0 / d1) = 0, and the second vertical deflection angle = arctan(0 / d1) = 0. The third horizontal deflection angle can be determined based on the pointing direction of the remote control device and the fifth reference plane, and the third horizontal deflection angle is 0. The third vertical deflection angle can be determined based on the pointing direction of the remote control device and the sixth reference plane, and the third vertical deflection angle is 0. Therefore, the first horizontal deflection angle is 0, and the first vertical deflection angle is 0.

[0236] by Fig.27A In the scene shown, the remote control device is located in front of the center of the smart TV screen, and the pointing direction of the remote control device is not perpendicular to the smart TV screen. Fig.27B for Fig.27A The corresponding top view, Fig.27C for Fig.27A The corresponding left view, combined with Fig.27B and Fig.27C It can be seen that the first reference line and the second reference line coincide with each other, so the determined first distance is d1, and the second distance and the third distance are both 0. According to the inverse tangent function, the second horizontal deflection angle = arctan(0 / d1) = 0, and the second vertical deflection angle = arctan(0 / d1) = 0. Based on the pointing direction of the remote control device and the fifth reference plane, the third horizontal deflection angle can be determined, and the third horizontal deflection angle is angle a2. Based on the pointing direction of the remote control device and the sixth reference plane, the third vertical deflection angle can be determined, and the third vertical deflection angle is angle b2. Therefore, the first horizontal deflection angle is a2, and the first vertical deflection angle is b2.

[0237] by Fig.28A In the scenario shown, the remote control device is located in front of the non-center position of the smart TV screen, and the placement direction of the remote control device is not perpendicular to the smart TV screen. Fig.28Bfor Fig.28A The corresponding top view, Fig.28C for Fig.28A The corresponding left view, combined with Fig.28B and Fig.28C It can be seen that the first reference line and the second reference line do not overlap, so the determined first distance is d1, the second distance is d2, and the third distance is d3. According to the inverse tangent function, the second horizontal deflection angle = arctan (d2 / d1), and the second vertical deflection angle = arctan (d3 / d1). The third horizontal deflection angle can be determined based on the pointing direction of the remote control device and the fifth reference plane, and the third horizontal deflection angle is angle a2. The third vertical deflection angle can be determined based on the pointing direction of the remote control device and the sixth reference plane, and the third vertical deflection angle is angle b2. Since the pointing direction of the remote control device is not between the first reference line and the second reference line, the first horizontal deflection angle is (arctan (d2 / d1) + a2), and the first vertical deflection angle is (arctan (d3 / d1) + b2).

[0238] by Fig.29A In the scenario shown, the remote control device is located in front of the non-center position of the smart TV screen, and the placement direction of the remote control device is not perpendicular to the smart TV screen. Fig.29B for Fig.29A The corresponding top view, Fig.29C for Fig.29A The corresponding left view, combined with Fig.29B and Fig.29C It can be seen that the first reference line and the second reference line do not overlap, so the determined first distance is d1, the second distance is d2, and the third distance is d3. According to the inverse tangent function, the second horizontal deflection angle = arctan (d2 / d1), and the second vertical deflection angle = arctan (d3 / d1). The third horizontal deflection angle can be determined based on the pointing direction of the remote control device and the fifth reference plane, and the third horizontal deflection angle is angle a2. The third vertical deflection angle can be determined based on the pointing direction of the remote control device and the sixth reference plane, and the third vertical deflection angle is angle b2. Since the pointing direction of the remote control device is between the first reference line and the second reference line, the first horizontal deflection angle is (arctan (d2 / d1) - a2), and the first vertical deflection angle is (arctan (d3 / d1) - b2).

[0239] In the embodiment of the present application, the first horizontal deflection angle and the first vertical deflection angle determined by the above implementation are both in degrees. To facilitate subsequent calculations, the corresponding relationship between angles and radians can be used to modify the first horizontal deflection angle and the first vertical deflection angle to radians. The corresponding relationship between angles and radians is: 1 angle = π / 180 radians, and / is a semicolon.

[0240] S502: The remote control device determines a first offset distance based on the first deflection angle and the first virtual arc surface, and determines a cursor position of a cursor corresponding to the remote control device in the screen device based on the center position of the screen device and the first offset distance.

[0241] In the embodiments of the present application, Fig.30 In the top view shown, the first virtual arc surface is located between the remote control device and the screen device, the remote control device is located inside the arc of the first virtual arc surface, and the screen device is located outside the arc of the first virtual arc surface. The radius of the first virtual arc surface is a fixed value, and the radius length of the first virtual arc surface is a first length. When the position of the remote control device or the pointing direction of the remote control device changes, the radius of the first virtual arc surface remains unchanged. The arc length of the first virtual arc surface is a fixed value. When the position of the remote control device or the pointing direction of the remote control device changes, the arc length of the first virtual arc surface remains unchanged.

[0242] The center position of the first virtual arc surface is located on the first reference line, and the tangent line at the center position of the first virtual arc surface is perpendicular to the first reference line.

[0243] When the position of the remote control device changes, the first reference line changes with the position of the remote control device, and the first virtual arc surface also changes accordingly with the change of the first reference line. The first virtual arc surface can be regarded as composed of multiple points, and before and after the first virtual arc surface changes, the relative distance between any point in the first virtual arc surface and the position of the remote control device remains unchanged.

[0244] In a possible implementation manner, the remote control device determines the first virtual curved surface, which may include: Fig.31 The following possible steps are shown:

[0245] S3101: The remote control device determines, on a second reference line, a first reference position that is a first preset distance away from the position of the remote control device.

[0246] In the embodiment of the present application, the y-axis coordinate of the first reference position is located between the y-axis coordinate of the remote control device and the y-axis coordinate of the screen.

[0247] S3102: The remote control device determines a second virtual arc surface based on the first reference position.

[0248] In the embodiment of the present application, the center position of the second virtual arc surface coincides with the first reference position, and the tangent line at the center position of the second virtual arc surface is perpendicular to the second reference line.

[0249] S3103: The remote control device determines, on the first reference line, a second reference position that is a first preset distance away from the position of the remote control device.

[0250] S3104, adjusting the second virtual arc surface according to the first reference position and the second reference position to obtain the first virtual arc surface.

[0251] In some embodiments, the second horizontal deflection angle and the second vertical deflection angle have been determined above, that is, the second horizontal deflection angle Second vertical deflection angle I won’t go into details here.

[0252] The second virtual arc surface is rotated in the horizontal direction by the second horizontal deflection angle and in the vertical direction by the second vertical deflection angle to obtain the first virtual arc surface. The center position of the first virtual arc surface coincides with the second reference position, and the tangent line at the center position of the first virtual arc surface is perpendicular to the first reference line. The radius length of the first virtual arc surface is equal to the radius length of the second virtual arc surface. The arc length of the first virtual arc surface is equal to the arc length of the second virtual arc surface.

[0253] The following examples are all described using a smart TV screen as an example.

[0254] by Fig.32 In the scenario shown, the remote control device is located directly in front of the center position of the smart TV screen, and the pointing direction of the remote control device is perpendicular to the smart TV screen. For example, in this scenario, the first reference line coincides with the second reference line, and the remote control device determines a first reference position on the second reference line that is a first preset distance from the position of the remote control device. The remote control device determines a second virtual arc surface based on the first reference position, wherein the center position of the second virtual arc surface coincides with the first reference position, and the tangent at the center position of the second virtual arc surface is perpendicular to the second reference line.

[0255] The remote control device determines a second reference position on the first reference line that is a first preset distance from the position of the remote control device. Since the first reference line coincides with the second reference line, the determined second reference position coincides with the first reference position. The second virtual arc surface is adjusted according to the first reference position and the second reference position, and the obtained first virtual arc surface coincides with the second virtual arc surface.

[0256] When the remote control device is located in front of the center of the smart TV screen and the pointing direction of the remote control device is not perpendicular to the smart TV screen, the first virtual arc surface is determined as follows: Fig.32 As shown, no further details are given here.

[0257] by FIG. 33A to FIG. 33C In the scene shown, the remote control device is located in front of the non-center position of the smart TV screen, and the pointing direction of the remote control device is perpendicular to the smart TV screen. In this scene, the first reference line and the second reference line do not overlap. Fig.33AAs shown, the remote control device determines a first reference position on the second reference line that is a first preset distance away from the position of the remote control device, and the remote control device determines a second virtual arc surface based on the first reference position, wherein the center position of the second virtual arc surface coincides with the first reference position, and the tangent at the center position of the second virtual arc surface is perpendicular to the second reference line.

[0258] like Fig.33B As shown, the remote control device determines a second reference position on the first reference line that is a first preset distance from the position of the remote control device. Fig.33C As shown, the second virtual curved surface is adjusted according to the first reference position and the second reference position to obtain the first virtual curved surface.

[0259] In the embodiment of the present application, the first offset distance includes a first horizontal offset distance and a first vertical offset distance.

[0260] Based on the first horizontal deflection angle and the first vertical deflection angle, determining the first horizontal offset distance and the first vertical offset distance may include the following three possible implementations:

[0261] In a first possible implementation, the product of the radius length of the first virtual arc surface and the first horizontal deflection angle is used as the second horizontal offset distance, and the product of the first horizontal adjustment ratio and the second horizontal offset distance is used as the first horizontal offset distance; the product of the radius length of the first virtual arc surface and the first vertical deflection angle is used as the second vertical offset distance, and the product of the first vertical adjustment ratio and the second vertical offset distance is used as the first vertical offset distance. It should be understood that the first horizontal adjustment ratio and the first vertical adjustment ratio are preset values, and the first horizontal adjustment ratio and the first vertical adjustment ratio can be the same or different. The first horizontal adjustment ratio and the first vertical adjustment ratio can be set to a decimal between 0 and 1, or can be set to a number greater than 1.

[0262] The first horizontal offset distance is shown in formula (3):

[0263] Δd_horizontal=k1_horizontal*R*Δα_horizontal(3)

[0264] Wherein, Δd_horizontal represents the first horizontal offset distance, k1_horizontal represents the first horizontal adjustment ratio, R represents the radius length of the first virtual arc surface, and Δα_horizontal represents the first horizontal deflection angle.

[0265] The first vertical offset distance is shown in formula (4):

[0266] Δd_vertical=k1_vertical*R*Δα_vertical(4)

[0267] Wherein, Δd_vertical represents the first vertical offset distance, k1_vertical represents the first vertical adjustment ratio, R represents the radius length of the first virtual arc surface, and Δα_vertical represents the first vertical deflection angle.

[0268] In the above possible implementation manner, the product of the radius length of the first virtual arc surface and the first horizontal deflection angle is the horizontal arc length corresponding to the first horizontal deflection angle, and the product of the horizontal arc length corresponding to the first horizontal deflection angle and the first horizontal adjustment ratio can be used as the first horizontal offset distance. The product of the radius length of the first virtual arc surface and the first vertical deflection angle is the vertical arc length corresponding to the first vertical deflection angle, and the product of the vertical arc length corresponding to the first vertical deflection angle and the first vertical adjustment ratio can be used as the first vertical offset distance.

[0269] In a second possible implementation, the product of the radius length of the first virtual arc surface and the first horizontal deflection angle is used as the first horizontal offset distance; and the product of the radius length of the first virtual arc surface and the first vertical deflection angle is used as the first vertical offset distance.

[0270] The first horizontal offset distance is shown in formula (5):

[0271] Δd_horizontal=R*Δα_horizontal(5)

[0272] Wherein, Δd_horizontal represents the first horizontal offset distance, R represents the radius length of the first virtual arc surface, and Δα_horizontal represents the first horizontal deflection angle.

[0273] The first vertical offset distance is shown in formula (6):

[0274] Δd_vertical=R*Δα_vertical(6)

[0275] Wherein, Δd_vertical represents the first vertical offset distance, R represents the radius length of the first virtual arc surface, and Δα_vertical represents the first vertical deflection angle.

[0276] In the above possible implementation manner, the product of the radius length of the first virtual arc surface and the first horizontal deflection angle is the horizontal arc length corresponding to the first horizontal deflection angle, and the horizontal arc length corresponding to the first horizontal deflection angle can be directly used as the first horizontal offset distance. The product of the radius length of the first virtual arc surface and the first vertical deflection angle is the vertical arc length corresponding to the first vertical deflection angle, and the vertical arc length corresponding to the first vertical deflection angle can be directly used as the first vertical offset distance.

[0277] In a third possible implementation, the product of the first preset value and the first horizontal deflection angle is used as the first horizontal offset distance, and the product of the second preset value and the first vertical deflection angle is used as the first vertical offset distance. The first preset value and the second preset value may be the same or different.

[0278] The first horizontal offset distance is shown in formula (7):

[0279] Δd_horizontal=K1*Δα_horizontal(7)

[0280] Wherein, Δd_horizontal represents a first horizontal offset distance, K1 represents a first preset value, and Δα_horizontal represents a first horizontal deflection angle.

[0281] The first vertical offset distance is shown in formula (8):

[0282] Δd_vertical=K2*Δα_vertical(8)

[0283] Wherein, Δd_vertical represents the first vertical offset distance, K2 represents the second preset value, and Δα_vertical represents the first vertical deflection angle.

[0284] It should be understood that the first preset value and the second preset value may be the same or different. The first preset value and the second preset value may be set to a decimal between 0 and 1, or may be set to a number greater than 1.

[0285] In the embodiment of the present application, after determining the first horizontal offset distance and the first vertical offset distance, the cursor position can be determined by the following method: first, based on the center position of the screen device and the first horizontal offset distance, determine the first coordinate value of the cursor position in the x-axis direction, and then based on the center position of the screen device and the first vertical offset distance, determine the second coordinate value of the cursor position in the z-axis direction. The first coordinate value and the second coordinate value constitute the coordinates of the cursor position. According to the coordinates of the cursor position, the cursor position of the cursor corresponding to the remote control device in the screen device can be determined, and the cursor is displayed at the coordinates of the cursor position.

[0286] Generally speaking, the sum of the center position of the screen device and the first horizontal offset distance is used as the first coordinate value of the cursor position in the x-axis direction; the sum of the center position of the screen device and the first vertical offset distance is used as the second coordinate value of the cursor position in the z-axis direction.

[0287] The following examples are all described using a smart TV screen as an example.

[0288] For example, if Fig.34A As shown in the top view of and the left view of 34B, the remote control device is located directly in front of the center of the smart TV screen, the pointing direction of the remote control device is perpendicular to the smart TV screen, and the cursor corresponding to the remote control device is displayed at point A on the smart TV screen, where point A is the center of the smart TV screen.

[0289] The user deflects the remote control device, wherein a first horizontal deflection angle of the remote control device is a1, a first vertical deflection angle of the remote control device is b1, and a radius length of the virtual arc surface is R.

[0290] like Fig.34C In the top view, the product of the radius length R of the virtual arc surface and the first horizontal deflection angle a1 is the horizontal arc length between points BC. The product of the horizontal arc length between points BC and the first horizontal adjustment ratio is used as the first horizontal offset distance. The first coordinate value of the cursor position in the x-axis direction (i.e., the coordinate value of point D in the x-axis direction) can be determined based on the center position of the smart TV screen (i.e., the coordinate value of point A in the x-axis direction) and the first horizontal offset distance.

[0291] like Fig.34D In the left view, the product of the radius length R of the virtual arc surface and the first vertical deflection angle b1 is the vertical arc length between points BC. The product of the vertical arc length between points BC and the first vertical adjustment ratio is used as the first vertical offset distance. The second coordinate value of the cursor position in the z-axis direction (i.e., the coordinate value of point D in the z-axis direction) can be determined based on the center position of the smart TV screen (the coordinate value of point A in the z-axis direction) and the first vertical offset distance.

[0292] Finally, the first coordinate value and the second coordinate value constitute the coordinates of the cursor position. According to the coordinates of the cursor position, the cursor position (ie, point D) of the cursor corresponding to the remote control device on the smart TV screen is determined, and the cursor is displayed at the coordinates of the cursor position.

[0293] In the above embodiment, when the distance between the remote control device and the screen device is different or the pointing direction of the remote control device is different, the distance the cursor moves in the screen device remains the same when the remote control device is deflected by the same angle. The user can accurately control the movement accuracy of the cursor, thereby improving the user experience.

[0294] In the case where the pointing direction of the remote control device deflects multiple times, the cursor position can be determined by two possible implementations. The following takes the Nth deflection of the pointing direction of the remote control device as an example, where N is greater than 1, for explanation. In the case where the pointing direction of the remote control device deflects the Nth time, determining the cursor position of the cursor corresponding to the remote control device on the screen device can include the following two possible implementations:

[0295] A first possible implementation method may be as follows: Figure 5 The steps shown determine the cursor position and are not described in detail here.

[0296] In a second possible implementation, when the pointing direction of the remote control device deflects for the N-1th time, the remote control device determines the cursor position corresponding to the N-1th deflection of the remote control device, and the remote control device determines the relative offset distance of the pointing direction of the remote control device at the Nth deflection relative to the pointing direction of the remote control device at the N-1th deflection. The remote control device determines the cursor position corresponding to the Nth deflection of the remote control device based on the cursor position corresponding to the N-1th deflection and the relative offset distance of the remote control device at the Nth deflection.

[0297] In a possible implementation, the relative offset distance includes a relative horizontal offset distance and a relative vertical offset distance. The remote control device first determines the seventh coordinate value of the cursor position in the x-axis direction based on the cursor position corresponding to the N-1th deflection and the relative horizontal offset distance, and then determines the eighth coordinate value of the cursor position in the z-axis direction based on the cursor position corresponding to the N-1th deflection and the relative vertical offset distance. The seventh coordinate value and the eighth coordinate value constitute the coordinates of the cursor position corresponding to the Nth deflection. According to the coordinates of the cursor position corresponding to the Nth deflection, the cursor position corresponding to the Nth deflection of the cursor corresponding to the remote control device in the screen device can be determined, and the cursor is displayed at the coordinates of the cursor position.

[0298] In order to improve the accuracy of the determined cursor position, an embodiment of the present application also provides a cursor position determination method, wherein the remote control device detects a third operation on the touch pad of the remote control device, and the remote control device adjusts the radius length of the first virtual arc surface from a first length to a second length in response to the third operation, wherein the second length is smaller than the first length.

[0299] When the user performs the third operation on the touchpad of the remote control device, the radius length of the first virtual arc surface is the second length, and when the user does not perform the third operation on the touchpad of the remote control device, the radius length of the first virtual arc surface returns to the first length. In the embodiment of the present application, the third operation can be understood as the touchpad of the remote control device being pressed, etc., which is not limited here. In the case where the third operation is that the touchpad of the remote control device is pressed, when the user presses the touchpad of the remote control device, the radius length of the first virtual arc surface is the second length. When the user does not press the touchpad of the remote control device, the radius length of the first virtual arc surface returns to the first length.

[0300] In one possible implementation, a remote control device receives a second operation, wherein the second operation includes a first operation and a third operation on a touchpad of the remote control device, wherein the first operation includes an operation of deflecting a pointing direction of the remote control device, and when the pointing direction of the remote control device is deflected, the remote control device determines a first deflection angle of the pointing direction of the remote control device relative to a first reference line, wherein the first reference line is a line between a position of the remote control device and a center position of a screen device, and the remote control device determines a first offset distance based on the first deflection angle and a first virtual arc surface, wherein the remote control device is located within an arc of the first virtual arc surface, and the screen device is located outside the arc of the first virtual arc surface, and the center position of the first virtual arc surface is located on the first reference line, and the tangent at the center position of the first virtual arc surface is perpendicular to the first reference line, and the radius length of the first virtual arc surface is a second length, and the remote control device determines the cursor position of a cursor corresponding to the remote control device in the screen device based on the center position of the screen device and the first offset distance.

[0301] For ease of understanding, the following description assumes that the third operation is that the touch panel of the remote control device is pressed.

[0302] When the user presses the touch pad of the remote control device, the radius length of the first virtual arc surface is the second length, and the user can deflect the remote control device to deflect the pointing direction of the remote control device. The deflection of the pointing direction of the remote control device includes horizontal deflection and / or vertical deflection. The first deflection angle of the pointing direction of the remote control device relative to the first reference line includes a first horizontal deflection angle and / or a first vertical deflection angle.

[0303] When the radius length of the first virtual arc surface is the first length, the user deflects the remote control device to determine a first horizontal offset distance corresponding to the first horizontal deflection angle and a first vertical offset distance corresponding to the first vertical deflection angle. The first horizontal offset distance is determined based on the product of the radius length (first length) of the first virtual arc surface and the first horizontal deflection angle, and the first vertical offset distance is determined based on the product of the radius length (first length) of the first virtual arc surface and the first vertical deflection angle.

[0304] In the case where the radius length of the first virtual arc surface is the second length, the user deflects the remote control device by the same angle, and a fifth horizontal offset distance corresponding to the first horizontal deflection angle and a fifth vertical offset distance corresponding to the first vertical deflection angle can be determined. The fifth horizontal offset distance is determined based on the product of the radius length (second length) of the first virtual arc surface and the first horizontal deflection angle, and the fifth vertical offset distance is determined based on the product of the radius length (second length) of the first virtual arc surface and the first vertical deflection angle.

[0305] Based on the above process, it can be seen that since the second length is smaller than the first length, the fifth horizontal offset distance is smaller than or equal to the first horizontal offset distance, and the fifth vertical offset distance is smaller than or equal to the first vertical offset distance.

[0306] The following examples are all described using a smart TV screen as an example.

[0307] For example, if Fig.34A As shown in the top view of and the left view of 34B, the remote control device is located directly in front of the center of the smart TV screen, the pointing direction of the remote control device is perpendicular to the smart TV screen, and the cursor corresponding to the remote control device is displayed at point A on the smart TV screen, where point A is the center of the smart TV screen.

[0308] When the user does not press the touch pad on the remote control device and the radius of the virtual arc is R1, the user deflects the remote control device, wherein the first horizontal deflection angle of the remote control device is a1, and the first vertical deflection angle of the remote control device is b1. Fig.35A The product of the radius length R1 of the first virtual arc surface and the first horizontal deflection angle a1 is the horizontal arc length between the two points BC. The product of the horizontal arc length between the two points BC and the first horizontal adjustment ratio is used as the first horizontal offset distance. The first coordinate value of the cursor position in the x-axis direction (i.e., the coordinate value of point D in the x-axis direction) can be determined based on the center position of the smart TV screen (i.e., the coordinate value of point A in the x-axis direction) and the first horizontal offset distance. Fig.35B The left view of the first virtual arc surface, the product of the radius length R1 of the first virtual arc surface and the first vertical deflection angle b1 is the vertical arc length between the two points BC. The product of the vertical arc length between the two points BC and the first vertical adjustment ratio is used as the first vertical offset distance. The second coordinate value of the cursor position in the z-axis direction (i.e., the coordinate value of point D in the z-axis direction) can be determined based on the center position of the smart TV screen (i.e., the coordinate value of point A in the z-axis direction) and the first vertical offset distance. Finally, the first coordinate value and the second coordinate value constitute the coordinates of the cursor position. According to the coordinates of the cursor position, the cursor position (i.e., point D) corresponding to the cursor of the remote control device on the smart TV screen is determined, and the cursor is displayed at the coordinates of the cursor position.

[0309] When the user presses the touch pad on the remote control device and the radius of the virtual arc is R2, where R2 is smaller than R1, the user deflects the remote control device, where the first horizontal deflection angle of the remote control device is a1, and the first vertical deflection angle of the remote control device is b1. Fig.35A The product of the radius length R2 of the first virtual arc surface and the first horizontal deflection angle a1 is the horizontal arc length between the two points EF. The product of the horizontal arc length between the two points EF and the first horizontal adjustment ratio is used as the fifth horizontal offset distance. The first coordinate value of the cursor position in the x-axis direction (i.e., the coordinate value of point G in the x-axis direction) can be determined based on the center position of the smart TV screen (i.e., the coordinate value of point A in the x-axis direction) and the fifth horizontal offset distance. Fig.35B The left view of the first virtual arc surface, the product of the radius length R2 of the first virtual arc surface and the first vertical deflection angle b1 is the vertical arc length between the two points EF. The product of the vertical arc length between the two points EF and the first vertical adjustment ratio is used as the first vertical offset distance. The second coordinate value of the cursor position in the z-axis direction (i.e., the coordinate value of point G in the z-axis direction) can be determined based on the center position of the smart TV screen (i.e., the coordinate value of point A in the z-axis direction) and the first vertical offset distance. Finally, the first coordinate value and the second coordinate value constitute the coordinates of the cursor position. According to the coordinates of the cursor position, the cursor position (i.e., point G) corresponding to the remote control device on the smart TV screen is determined, and the cursor is displayed at the coordinates of the cursor position.

[0310] In the above embodiment, when the radius of the first virtual arc surface is reduced, the remote control device is deflected by the same angle, so that the moving speed of the cursor can be reduced and the accuracy of the determined cursor position can be improved.

[0311] In order to improve the accuracy of the determined cursor position, the embodiment of the present application further provides a method for determining the cursor position, which may include: Fig.36 The following steps are shown:

[0312] S3601, when the remote control device receives the fourth operation, the remote control device determines a first deflection angle of the pointing direction of the remote control device relative to the first reference line, wherein the fourth operation includes an operation of deflecting the pointing direction of the remote control device and a fifth operation of the touch pad of the remote control device, and the first reference line is a line between the position of the remote control device and the center position of the screen device.

[0313] In the embodiment of the present application, the fifth operation can be understood as the touch panel of the remote control device being pressed, etc., which is not limited here. For ease of understanding, the fifth operation is described below as the touch panel of the remote control device being pressed.

[0314] The method for determining the first deflection angle in the above step is similar to the method for determining the first deflection angle in S501, and will not be described in detail here.

[0315] When the touch pad of the remote control device is pressed, the radius length of the virtual arc surface remains unchanged, that is, the radius length of the first virtual arc surface is the first length. When the touch pad of the remote control device is pressed, if the pointing direction of the remote control device is deflected, the deflection of the pointing direction of the remote control device includes a horizontal deflection and / or a vertical deflection. The first deflection angle of the pointing direction of the remote control device relative to the first reference line includes a first horizontal deflection angle and / or a first vertical deflection angle.

[0316] S3602, the remote control device determines a third horizontal offset distance based on the first horizontal deflection angle and the second horizontal adjustment ratio; and determines a third vertical offset distance based on the first vertical deflection angle and the second vertical adjustment ratio.

[0317] In the embodiment of the present application, the product of the first horizontal deflection angle and the second horizontal adjustment ratio is used as the third horizontal offset distance, and the product of the first vertical deflection angle and the second vertical adjustment ratio is used as the third vertical offset distance.

[0318] For ease of understanding, it can be understood that the product of the first horizontal deflection angle, the second horizontal adjustment ratio and the radius length 1 is taken as the third horizontal offset distance. Similarly, it can be understood that the product of the first vertical deflection angle, the second vertical adjustment ratio and the radius length 1 is taken as the third vertical offset distance.

[0319] In the embodiment of the present application, the first horizontal deflection angle and the first vertical deflection angle determined by the above implementation are both in degrees. To facilitate subsequent calculations, the corresponding relationship between angles and radians can be used to modify the first horizontal deflection angle and the first vertical deflection angle to radians. The corresponding relationship between angles and radians is: 1 angle = π / 180 radians, and / is a semicolon.

[0320] It should be understood that the second horizontal adjustment ratio and the second vertical adjustment ratio are preset values, and the second horizontal adjustment ratio and the second vertical adjustment ratio can be the same or different. The second horizontal adjustment ratio and the second vertical adjustment ratio can be set to a decimal between 0 and 1, or a number greater than 1.

[0321] Based on the above process, it can be seen that the third horizontal offset distance and the third vertical offset distance are both independent of the radius length of the first virtual arc surface.

[0322] S3603: The remote control device determines a cursor position of a cursor corresponding to the remote control device in the screen device based on the center position of the screen device, the third horizontal offset distance, and the third vertical offset distance.

[0323] In the embodiment of the present application, after determining the third horizontal offset distance and the third vertical offset distance, the cursor position can be determined by the following method: first, based on the center position of the screen device and the third horizontal offset distance, determine the third coordinate value of the cursor position in the x-axis direction, and then based on the center position of the screen device and the third vertical offset distance, determine the fourth coordinate value of the cursor position in the z-axis direction. The third coordinate value and the fourth coordinate value constitute the coordinates of the cursor position. According to the coordinates of the cursor position, the cursor position of the cursor corresponding to the remote control device in the screen device can be determined, and the cursor is displayed at the coordinates of the cursor position.

[0324] The following examples are all described using a smart TV screen as an example.

[0325] For example, if Fig.34A As shown in the top view of and the left view of 34B, the remote control device is located directly in front of the center of the smart TV screen, the pointing direction of the remote control device is perpendicular to the smart TV screen, and the cursor corresponding to the remote control device is displayed at point A on the smart TV screen, where point A is the center of the smart TV screen.

[0326] When the user presses the touch pad on the remote control device, the user deflects the remote control device, wherein the first horizontal deflection angle of the remote control device is a1, and the first vertical deflection angle of the remote control device is b1. Fig.37 A, the product of the first horizontal deflection angle a1 and the second horizontal adjustment ratio is used as the third horizontal offset distance, and the third coordinate value of the cursor position in the x-axis direction (i.e. the coordinate value of point H in the x-axis direction) can be determined based on the center position of the smart TV screen (i.e. the coordinate value of point A in the x-axis direction) and the third horizontal offset distance. Fig.37 B, the product of the first vertical deflection angle b1 and the second vertical adjustment ratio is used as the third vertical offset distance, and the fourth coordinate value of the cursor position in the z-axis direction (i.e., the coordinate value of point H in the z-axis direction) can be determined based on the center position of the smart TV screen (i.e., the coordinate value of point A in the z-axis direction) and the third vertical offset distance. Finally, the third coordinate value and the fourth coordinate value form the coordinates of the cursor position. According to the coordinates of the cursor position, the cursor position (i.e., point H) of the cursor corresponding to the remote control device on the smart TV screen is determined, and the cursor is displayed at the coordinates of the cursor position.

[0327] In the above embodiment, the cursor position changes with the first horizontal deflection angle and the first vertical deflection angle and is not affected by the radius length of the first virtual arc surface, thereby providing a convenient method for determining the cursor position.

[0328] In order to improve the accuracy of the cursor position, the present application embodiment also provides a method for determining the cursor position, which may include: Fig.38 The following steps are shown:

[0329] S3801, when the remote control device receives a sixth operation on the touch pad, the remote control device determines a horizontal movement distance and a vertical movement distance of the remote control device, wherein the sixth operation includes an operation of moving the remote control device and a seventh operation on the touch pad of the remote control device.

[0330] In the embodiment of the present application, the seventh operation can be understood as the touch panel of the remote control device being pressed, etc., which is not limited here. For ease of understanding, the seventh operation is described below as the touch panel of the remote control device being pressed.

[0331] When the touch pad of the remote control device is pressed, the radius length of the virtual arc surface remains unchanged, that is, the radius length of the first virtual arc surface is the first length.

[0332] S3802, the remote control device determines a fourth horizontal offset distance based on the horizontal movement distance and the third horizontal adjustment ratio; and determines a fourth vertical offset distance based on the vertical movement distance and the third vertical adjustment ratio.

[0333] In the embodiment of the present application, the product of the horizontal movement distance and the third horizontal adjustment ratio is used as the fourth horizontal offset distance, and the product of the vertical movement distance and the third vertical adjustment ratio is used as the fourth vertical offset distance.

[0334] It should be understood that the third horizontal adjustment ratio and the third vertical adjustment ratio are preset values, and the third horizontal adjustment ratio and the third vertical adjustment ratio can be the same or different. The third horizontal adjustment ratio and the third vertical adjustment ratio can be set to a decimal between 0 and 1, or a number greater than 1.

[0335] Based on the above process, it can be seen that the fourth horizontal offset distance and the fourth vertical offset distance are both independent of the radius length of the first virtual arc surface.

[0336] S3803: The remote control device determines a cursor position of a cursor corresponding to the remote control device in the screen device based on the center position of the screen device, the fourth horizontal offset distance, and the fourth vertical offset distance.

[0337] In the embodiment of the present application, after determining the fourth horizontal offset distance and the fourth vertical offset distance, the cursor position can be determined by the following method: first, based on the center position of the screen device and the fourth horizontal offset distance, determine the fifth coordinate value of the cursor position in the x-axis direction, and then based on the center position of the screen device and the fourth vertical offset distance, determine the sixth coordinate value of the cursor position in the z-axis direction. The fifth coordinate value and the sixth coordinate value constitute the coordinates of the cursor position. According to the coordinates of the cursor position, the cursor position of the cursor corresponding to the remote control device in the screen device can be determined, and the cursor is displayed at the coordinates of the cursor position.

[0338] The following examples are all described using a smart TV screen as an example.

[0339] For example, if Fig.34A As shown in the top view of and the left view of 34B, the remote control device is located in front of the center of the screen, the pointing direction of the remote control device is perpendicular to the smart TV screen, and the cursor corresponding to the remote control device is displayed at point A on the smart TV screen, where point A is the center of the smart TV screen.

[0340] When the user presses the touch pad on the remote control device, the user moves the remote control device, wherein the horizontal movement distance of the remote control device is x1, and the vertical movement distance of the remote control device is z1. Fig.39 A's top view, the product of the horizontal moving distance x1 and the second horizontal adjustment ratio is used as the fourth horizontal offset distance, and the fifth coordinate value of the cursor position in the x-axis direction (i.e. the coordinate value of point K in the x-axis direction) can be determined based on the center position of the smart TV screen (i.e. the coordinate value of point A in the x-axis direction) and the fourth horizontal offset distance. Fig.39 B, the product of the vertical movement distance z1 and the second vertical adjustment ratio is used as the fourth vertical offset distance, and the sixth coordinate value of the cursor position in the z-axis direction (i.e., the coordinate value of point K in the z-axis direction) can be determined based on the center position of the smart TV screen (i.e., the coordinate value of point A in the z-axis direction) and the fourth vertical offset distance. Finally, the fifth coordinate value and the sixth coordinate value constitute the coordinates of the cursor position. According to the coordinates of the cursor position, the cursor position (i.e., point K) corresponding to the cursor of the remote control device on the smart TV screen is determined, and the cursor is displayed at the coordinates of the cursor position.

[0341] In the above embodiment, the cursor position changes with the change of the horizontal moving distance and the vertical moving distance, and is not affected by the radius length of the first virtual arc surface, thereby providing a convenient method for determining the cursor position.

[0342] In the above embodiments provided by the present application, the method provided by the embodiment of the present application is introduced from the perspective of the remote control device as the execution subject. In order to realize the various functions in the method provided by the above embodiments of the present application, the remote control device may include a hardware structure and / or a software module, and the above functions are realized in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether a certain function of the above functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

[0343] For example, when hardware is used for implementation, the hardware implementation of the remote control device can refer to Fig.40 and its related description.

[0344] See also Fig.40 , the remote control device may include: one or more processors 4002; a memory 4003; one or more application programs (not shown); and one or more computer programs 4004, and the above components may be connected via one or more communication buses 4001. The one or more computer programs 4004 are stored in the memory 4003 and configured to be executed by the one or more processors 4002, and the one or more computer programs 4004 include instructions, which may be used to execute the method in any of the above embodiments.

[0345] An embodiment of the present application also provides a computer storage medium, which stores computer instructions. When the computer instructions are executed on a remote control device, the remote control device executes the above-mentioned related method steps to implement the cursor position determination method of the remote control device in the above-mentioned embodiment.

[0346] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement the method for determining the cursor position of the remote control device in the above-mentioned embodiment.

[0347] Among them, the remote control device, computer storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0348] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0349] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0350] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0351] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0352] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0353] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for determining a cursor position, applied to a remote control device, characterized in that: The method comprises: In the case where the pointing direction of the remote control device is deflected, determining a first deflection angle of the pointing direction of the remote control device relative to the first reference line, where the first reference line is a line between the position of the remote control device and the center position of the screen device; Determine a first offset distance according to the first deflection angle and the first virtual arc surface, wherein the remote control device is located within the arc of the first virtual arc surface, the screen device is located outside the arc of the first virtual arc surface, the center position of the first virtual arc surface is located on the first reference line, and the tangent line at the center position of the first virtual arc surface is perpendicular to the first reference line; Based on the center position of the screen device and the first offset distance, a cursor position of a cursor corresponding to the remote control device in the screen device is determined.

2. The method according to claim 1, characterized in that The first deflection angle includes a first horizontal deflection angle and a first vertical deflection angle; The determining a first deflection angle of the pointing direction of the remote control device relative to the first reference line comprises: The angle between the pointing direction of the remote control device and the first reference plane is used as the first horizontal deflection angle, where the first reference plane is a plane perpendicular to the horizontal plane and includes the first reference line; The angle between the pointing direction of the remote control device and the second reference plane is used as the first vertical deflection angle, and the second reference plane is a plane parallel to the horizontal plane and including the first reference line.

3. The method according to claim 2, characterized in that The first offset distance includes a first horizontal offset distance and a first vertical offset distance; The determining a first offset distance according to the first deflection angle and the first virtual arc surface includes: The product of the radius of the first virtual arc surface and the first horizontal deflection angle is used as the first horizontal offset distance; The product of the radius of the first virtual arc surface and the first vertical deflection angle is used as the first vertical offset distance.

4. The method according to claim 2, characterized in that The first offset distance includes a first horizontal offset distance and a first vertical offset distance; The determining a first offset distance according to the first deflection angle and the first virtual arc surface includes: The product of the radius of the first virtual arc surface and the first horizontal deflection angle is used as the second horizontal offset distance; The product of the first horizontal adjustment ratio and the second horizontal offset distance is used as the first horizontal offset distance; The product of the radius of the first virtual arc surface and the first vertical deflection angle is used as the second vertical offset distance; The product of the first vertical adjustment ratio and the second vertical offset distance is used as the first vertical offset distance.

5. The method according to claim 3 or 4, characterized in that The step of determining a cursor position of a cursor corresponding to the remote control device in the screen device based on the center position of the screen device and the first offset distance includes: Determine a first coordinate value based on the center position of the screen device and the first horizontal offset distance; Determining a second coordinate value based on the center position of the screen device and the first vertical offset distance; The first coordinate value and the second coordinate value are combined to form the coordinates of the cursor position, and the cursor position of the cursor corresponding to the remote control device in the screen device is determined according to the coordinates of the cursor position.

6. The method according to any one of claims 1 to 5, characterized in that: In a case where the pointing direction of the remote control device is deflected, before determining a first deflection angle of the pointing direction of the remote control device relative to the first reference line, the method further includes: receiving a first operation, wherein the first operation includes an operation of deflecting the pointing direction of the remote control device, and the radius length of the first virtual arc surface is a first length; Alternatively, a second operation is received, the second operation including the first operation and a third operation on the touch panel of the remote control device, the radius length of the first virtual arc surface is a second length; and the second length is smaller than the first length.

7. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: determining a first deflection angle of the pointing direction of the remote control device relative to the first reference line when the remote control device receives a fourth operation, wherein the fourth operation includes an operation of deflecting the pointing direction of the remote control device and a fifth operation on the touch pad of the remote control device, and the first reference line is a line connecting the position of the remote control device and the center position of the screen device; Determine a third horizontal offset distance based on the first horizontal deflection angle and the second horizontal adjustment ratio; and determine a third vertical offset distance based on the first vertical deflection angle and the second vertical adjustment ratio; The cursor position of the cursor corresponding to the remote control device in the screen device is determined based on the center position of the screen device, the third horizontal offset distance, and the third vertical offset distance.

8. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: determining a horizontal movement distance and a vertical movement distance of the remote control device when the remote control device receives a sixth operation on the touch panel, the sixth operation including an operation of moving the remote control device and a seventh operation on the touch panel of the remote control device; Determine a fourth horizontal offset distance based on the horizontal movement distance and the third horizontal adjustment ratio; and determine a fourth vertical offset distance based on the vertical movement distance and the third vertical adjustment ratio; The cursor position of the cursor corresponding to the remote control device in the screen device is determined based on the center position of the screen device, the fourth horizontal offset distance, and the fourth vertical offset distance.

9. A remote control device, characterized in that: including a processor and a memory; The processor is used to execute the computer program or instructions stored in the memory, so that the remote control device implements the method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: A computer program or instruction is stored, and when the computer program or instruction is executed on a computer, the computer-readable storage medium enables the computer-readable storage medium to implement the method according to any one of claims 1 to 8.

Citation Information

Patent Citations

  • Projection cursor control method and device and remote controller

    CN106406570A

  • Method for remotely controlling cursor in display screen

    CN114257850A

  • Spatial interaction in augmented reality

    US20160140763A1

  • Display device and remote operation control device

    WO2018142524A1

Cited By

  • Remote controller pointing alignment method, device and equipment and storage medium

    CN119672940A

  • Cursor position determination method and remote control device

    EP4692997A1