Methods, electronic devices, and systems for cursor control

Abstract

The application provides a cursor control method, comprising: when the distance between a first pointing device and a first display screen is a first distance, in response to the first pointing device controlling a pointing position to move by a first amplitude, a cursor synchronously moves on the first display screen by a second amplitude, wherein the first amplitude is greater than the second amplitude, and the pointing position is a position in the first display screen pointed by the first pointing device; when the distance between the first pointing device and the first display screen switches to a second distance, in response to the first pointing device controlling the pointing position to move by a third amplitude, the cursor synchronously moves on the first display screen by the second amplitude, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance. The method can adaptively adjust the dithering effect of the cursor according to the distance between the pointing device and the display screen, and improve the user experience.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of cursor control, and more particularly, to a method, an electronic device and a system for cursor control. BACKGROUND

[0002] A pointing remote controller can improve the interaction experience between a user and a large screen by controlling the movement of a cursor on the large screen. For example, the user can play a shooting game or a fruit cutting game on the large screen by using the pointing remote controller. In the process of using the pointing remote controller, the sensitivity of the cursor movement gradually increases with the increase of the distance between the pointing remote controller and the large screen. That is, when the posture of the pointing remote controller changes by the same amount, the farther the distance between the pointing remote controller and the large screen, the larger the range of the cursor movement.

[0003] Therefore, when the user uses the large screen at a long distance, a small range of hand shaking can cause a large range of cursor movement. When the target control area of the cursor movement is small, it is difficult to control the cursor to move to the target control accurately. This also makes the user unable to use the pointing remote controller to control the cursor to perform fine operations in a small range, such as drawing and document marking, which seriously affects the user experience. SUMMARY

[0004] The present application provides a method, an electronic device and a system for cursor control, which can adaptively adjust the cursor shake filtering effect according to the distance between the pointing device and the display screen, thereby improving the user experience.

[0005] In a first aspect, a method for cursor control is provided. The method includes: when the distance between a first pointing device and a first display screen is a first distance, controlling a pointing position to move by a first amplitude by using the first pointing device, so that a cursor moves by a second amplitude on the first display screen synchronously, wherein the first amplitude is greater than the second amplitude, and the pointing position is a position on the first display screen pointed by the first pointing device; when the distance between the first pointing device and the first display screen is switched to a second distance, controlling the pointing position to move by a third amplitude by using the first pointing device, so that the cursor moves by the second amplitude on the first display screen synchronously, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance. The pointing position of the first pointing device includes a position on the first display screen intended to be pointed by the first pointing device. The first amplitude can be the amplitude of the movement of the first pointing device along the display screen by the user.

[0006] In some embodiments, the first pointing device is a remote controller, and can also be a mobile phone with pointing function, or other devices with pointing function. The present application does not limit this.

[0007] In some embodiments, the first distance can be a first distance range, and the second distance can be a second distance range, wherein a minimum distance value in the second distance range is greater than a maximum distance value in the first distance range.

[0008] In some embodiments, the first amplitude, the second amplitude, and the third amplitude can be distance amplitudes at the same time, or can be angle amplitudes at the same time.

[0009] The pointing position can also be described as the intersection position of the direction pointed by the first pointing device and the first display screen.

[0010] In the embodiments of the present application, the pointing device can perceive the spatial relationship between the pointing device and the interactive large screen in real time, and adaptively adjust the sensitivity of the cursor according to the distance between the pointing device and the large screen, so as to adaptively adjust the dithering effect of the cursor according to the distance between the pointing device and the large screen.

[0011] In combination with the first aspect, in a possible implementation manner, the method further includes: when the pointing position moves on the first display screen, determining a damping coefficient according to the distance between the first pointing device and the first display screen, the damping coefficient being negatively related to the distance between the first pointing device and the first display screen; and adjusting the display position of the cursor according to the damping coefficient.

[0012] In some embodiments, the damping coefficient is greater than 0, and the damping coefficient is less than or equal to 1.

[0013] In the embodiments of the present application, the pointing device can perceive the spatial relationship between the pointing device and the interactive large screen in real time, and adaptively adjust the damping coefficient of the cursor according to the distance between the pointing device and the large screen, so as to adjust the sensitivity of the cursor, and adaptively adjust the dithering effect of the cursor according to the distance between the pointing device and the large screen, so that the user can obtain the experience of non-dithering cursor movement at any position using the remote controller.

[0014] In a possible implementation manner of the first aspect, the damping coefficient is determined according to the distance between the first pointing device and the first display screen, including: determining the damping coefficient corresponding to the i th frame according to the distance corresponding to the i th frame, where the distance corresponding to the i th frame refers to the distance between the first pointing device and the first display screen corresponding to the i th frame, i is a natural number, i = 1, 2, 3…; and the display position of the cursor is adjusted according to the damping coefficient, including: determining the x variable corresponding to the i th frame and the y variable corresponding to the i th frame, where the x variable corresponding to the i th frame is the change amount of the horizontal coordinate of the pointing position corresponding to the i th frame relative to the horizontal coordinate of the pointing position corresponding to the (i-1) th frame, and the y variable corresponding to the i th frame is the change amount of the vertical coordinate of the pointing position corresponding to the i th frame relative to the vertical coordinate of the pointing position corresponding to the (i-1) th frame; and the cursor coordinate corresponding to the i th frame is determined according to the damping coefficient corresponding to the i th frame, the cursor coordinate corresponding to the (i-1) th frame, the x variable corresponding to the i th frame and the y variable corresponding to the i th frame, and the cursor coordinate corresponding to the i th frame is used to display the cursor corresponding to the i th frame on the first display screen.

[0015] In some embodiments, the cursor coordinate corresponding to the i th frame is determined according to the damping coefficient corresponding to the i th frame, the cursor coordinate corresponding to the (i-1) th frame, the x variable corresponding to the i th frame and the y variable corresponding to the i th frame, including: determining the sum of the horizontal coordinate of the cursor coordinate corresponding to the i th frame and the first product as the horizontal coordinate of the cursor coordinate corresponding to the i th frame, where the first product is the product of the damping coefficient corresponding to the i th frame and the x variable corresponding to the i th frame; and determining the sum of the vertical coordinate of the cursor coordinate corresponding to the i th frame and the second product as the vertical coordinate of the cursor coordinate corresponding to the i th frame, where the second product is the product of the damping coefficient corresponding to the i th frame and the y variable corresponding to the i th frame.

[0016] In the embodiments of the present application, the pointing device can perceive the spatial relationship between the pointing device and the interactive large screen in real time by using the perception ability of the pointing device to the space, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen. The position of the cursor display is adjusted according to the adjusted damping coefficient, and thus the adaptive adjustment of the damped effect of the cursor according to the distance between the pointing device and the large screen can be realized, so that the user can obtain the experience of non-shaking cursor movement at any position using the remote controller.

[0017] In a possible implementation manner of the first aspect, the damping coefficient is determined according to the distance between the first pointing device and the first display screen, including: determining the damping coefficient according to the distance between the first pointing device and the first display screen and the attitude change value of the first pointing device, and the damping coefficient is positively correlated with the attitude change value of the first pointing device.

[0018] In the embodiments of the present application, the pointing device can be used to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen and the attitude change of the pointing device, so as to adjust the sensitivity of the cursor, and then the filtering effect of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen and the attitude change of the pointing device, so that the user can obtain the experience of no jitter for small movement of the cursor and no delay for large movement of the cursor at any position using the remote controller. Since the user generally moves at high speed to the vicinity of the control when performing fine pointing selection, and then slowly adjusts to accurately select the control, the method can be well applied to the scene of fine operation of the user on the large screen.

[0019] In combination with the first aspect, in a possible implementation manner, the damping coefficient is determined according to the distance between the first pointing device and the first display screen, and the attitude change value of the first pointing device, including: determining the first damping coefficient corresponding to the i th frame according to the distance corresponding to the i th frame and the first attitude change value corresponding to the i th frame; determining the second damping coefficient corresponding to the i th frame according to the distance corresponding to the i th frame and the second attitude change value corresponding to the i th frame, wherein the distance corresponding to the i th frame refers to the distance between the first pointing device and the first display screen corresponding to the i th frame, i is a natural number, i = 1, 2, 3…; the display position of the cursor is adjusted according to the damping coefficient, including: determining the x variable corresponding to the i th frame and the y variable corresponding to the i th frame, wherein the x variable corresponding to the i th frame is the change amount of the horizontal coordinate of the pointing position corresponding to the i th frame relative to the horizontal coordinate of the pointing position corresponding to the i-1 th frame, and the y variable corresponding to the i th frame is the change amount of the vertical coordinate of the pointing position corresponding to the i th frame relative to the vertical coordinate of the pointing position corresponding to the i-1 th frame; the cursor coordinate corresponding to the i th frame is determined according to the first damping coefficient corresponding to the i th frame, the second damping coefficient corresponding to the i th frame, the cursor coordinate corresponding to the i-1 th frame, the x variable corresponding to the i th frame and the y variable corresponding to the i th frame, and the cursor coordinate corresponding to the i th frame is used to display the cursor corresponding to the i th frame on the first display screen.

[0020] In some embodiments, the first attitude change value corresponding to the i th frame includes the change value of the azimuth angle of the first pointing device relative to the attitude corresponding to the i-1 th frame, and the second attitude change value corresponding to the i th frame includes the change value of the pitch angle of the first pointing device relative to the attitude corresponding to the i-1 th frame.

[0021] In some embodiments, determining the cursor coordinate corresponding to the i-th frame according to the first damping coefficient corresponding to the i-th frame, the second damping coefficient corresponding to the i-th frame, the cursor coordinate corresponding to the i-1-th frame, the x variable corresponding to the i-th frame and the y variable corresponding to the i-th frame comprises: determining the horizontal coordinate of the cursor coordinate corresponding to the i-th frame as the sum of the horizontal coordinate of the cursor coordinate corresponding to the i-1-th frame and a third product, the third product being the product of the first damping coefficient corresponding to the i-th frame and the x variable corresponding to the i-th frame; and determining the vertical coordinate of the cursor coordinate corresponding to the i-th frame as the sum of the vertical coordinate of the cursor coordinate corresponding to the i-1-th frame and a fourth product, the fourth product being the product of the second damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

[0022] In the embodiments of the present application, the pointing device can perceive the spatial relationship between the pointing device and the interactive large screen in real time by using the spatial perception capability of the pointing device, and adaptively adjust the damping coefficient of the cursor according to the distance between the pointing device and the large screen and the attitude change of the pointing device, and adjust the position of the cursor display according to the adjusted damping coefficient, thereby realizing adaptive adjustment of the dithering effect of the cursor according to the distance between the pointing device and the large screen and the attitude change of the pointing device, so that the user can obtain the experience of no dithering for small movement and no delay for large movement of the cursor when using the remote controller at any position. Since the user generally moves at high speed to the vicinity of the control when performing fine pointing selection, and then adjusts slowly to accurately select the control, the method can be well applied to the scene of fine operation of the user on the large screen.

[0023] In combination with the first aspect, in a possible implementation manner, the method further includes: when the pointing position moves on the first display screen, determining the position and the attitude of the first pointing device in real time, the position of the first pointing device being used to obtain the distance between the first pointing device and the first display screen, and the attitude of the first pointing device being used to obtain the attitude change value of the first pointing device.

[0024] The second aspect provides a method for controlling a cursor, the method comprising: when the distance between the first pointing device and the first display screen is a first distance, in response to moving a pointing position by a first amplitude by using the first pointing device, moving a cursor on the first display screen by a second amplitude synchronously, wherein the first amplitude is greater than the second amplitude, and the pointing position is a position in the first display screen pointed by the first pointing device; when the distance between the first pointing device and the first display screen is switched to a second distance, in response to moving the pointing position by a third amplitude by using the first pointing device, moving the cursor on the first display screen by the second amplitude synchronously, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance.

[0025] In some embodiments, the first display screen is a display screen of a large-screen device.

[0026] In some embodiments, the first amplitude, the second amplitude and the third amplitude can be distance amplitudes or angle amplitudes.

[0027] The pointing position can also be described as the intersection position of the direction pointed by the first pointing device and the first display screen.

[0028] In the embodiments of the present application, the pointing device can perceive the spatial relationship between the pointing device and the large screen in real time by using the perception ability of the pointing device to the space, and adaptively adjust the sensitivity of the cursor according to the distance between the pointing device and the large screen, so as to realize the adaptive adjustment of the dithering effect of the cursor according to the distance between the pointing device and the large screen.

[0029] In a third aspect, a system for cursor control is provided, which includes a first pointing device and a first display screen. The first pointing device is configured to control a pointing position to move by a first amplitude when the distance between the first pointing device and the first display screen is a first distance, the pointing position being a position on the first display screen pointed by the first pointing device. The first display screen is configured to control a cursor to move by a second amplitude on the first display screen in response to the pointing position moving by the first amplitude, wherein the first amplitude is greater than the second amplitude. The first pointing device is further configured to control the pointing position to move by a third amplitude on the first display screen when the distance between the first pointing device and the first display screen is a second distance. The first display screen is further configured to control the cursor to move by the second amplitude on the first display screen in response to the pointing position moving within a third display range of the first display screen, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance.

[0030] In some embodiments, the first pointing device is a remote controller, or a mobile phone with pointing function, or other devices with pointing function, which are not limited in the present application.

[0031] In some embodiments, the first display screen is a display screen of a large screen device.

[0032] In some embodiments, the first amplitude, the second amplitude and the third amplitude can be distance amplitudes or angle amplitudes.

[0033] The pointing position can also be described as the intersection position of the direction pointed by the first pointing device and the first display screen.

[0034] In the embodiments of the present application, the pointing device can perceive the spatial relationship between the pointing device and the interactive large screen in real time by using the spatial perception capability of the pointing device, and adaptively adjust the sensitivity of the cursor according to the distance between the pointing device and the large screen, thereby achieving adaptive adjustment of the dithering effect of the cursor according to the distance between the pointing device and the large screen.

[0035] In combination with the third aspect, in a possible implementation manner, the first pointing device is specifically configured to: when the pointing position moves on the first display screen, determine a damping coefficient according to the distance between the first pointing device and the first display screen, the damping coefficient being negatively correlated with the distance between the first pointing device and the first display screen; and adjust the display position of the cursor according to the damping coefficient.

[0036] In some embodiments, the damping coefficient is greater than 0 and less than or equal to 1.

[0037] In the embodiments of the present application, the pointing device can perceive the spatial relationship between the pointing device and the interactive large screen in real time by using the spatial perception capability of the pointing device, and adaptively adjust the damping coefficient of the cursor according to the distance between the pointing device and the large screen, thereby achieving adjustment of the sensitivity of the cursor, and further achieving adaptive adjustment of the dithering effect of the cursor according to the distance between the pointing device and the large screen, so that the user can obtain the experience of non-dithering cursor movement at any position using the remote controller.

[0038] In combination with the third aspect, in a possible implementation manner, the first pointing device is specifically configured to: determine a damping coefficient corresponding to the i th frame according to the distance corresponding to the i th frame, wherein the distance corresponding to the i th frame refers to the distance between the first pointing device and the first display screen corresponding to the i th frame, i is a natural number, i = 1, 2, 3…; determine an x variable corresponding to the i th frame and a y variable corresponding to the i th frame, wherein the x variable corresponding to the i th frame is the change amount of the horizontal coordinate of the pointing position corresponding to the i th frame relative to the horizontal coordinate of the pointing position corresponding to the i-1 th frame, and the y variable corresponding to the i th frame is the change amount of the vertical coordinate of the pointing position corresponding to the i th frame relative to the vertical coordinate of the pointing position corresponding to the i-1 th frame; determine the cursor coordinate corresponding to the i th frame according to the damping coefficient corresponding to the i th frame, the cursor coordinate corresponding to the i-1 th frame, the x variable corresponding to the i th frame, and the y variable corresponding to the i th frame; and the first display screen is specifically configured to: display the cursor corresponding to the i th frame on the first display screen according to the cursor coordinate corresponding to the i th frame.

[0039] In some embodiments, the first pointing device is specifically configured to: determine the sum of the first product and the horizontal coordinate of the cursor coordinate corresponding to the i-1th frame as the horizontal coordinate of the cursor coordinate corresponding to the ith frame, the first product being the product of the damping coefficient corresponding to the ith frame and the x variable corresponding to the ith frame; and determine the sum of the second product and the vertical coordinate of the cursor coordinate corresponding to the i-1th frame as the vertical coordinate of the cursor coordinate corresponding to the ith frame, the second product being the product of the damping coefficient corresponding to the ith frame and the y variable corresponding to the ith frame.

[0040] In the embodiments of the present application, the pointing device can perceive the spatial relationship between the pointing device and the interactive large screen in real time by using the spatial perception capability of the pointing device, and adaptively adjust the damping coefficient of the cursor according to the distance between the pointing device and the large screen, and adjust the position of the cursor display according to the adjusted damping coefficient, thereby achieving adaptive adjustment of the dithering effect of the cursor according to the distance between the pointing device and the large screen, so that the user can obtain the experience of non-dithering cursor movement at any position using the remote controller.

[0041] In combination with the third aspect, in a possible implementation manner, the first pointing device is specifically configured to: determine the damping coefficient according to the distance between the first pointing device and the first display screen and the attitude change value of the first pointing device, the damping coefficient being positively correlated with the attitude change value of the first pointing device.

[0042] In the embodiments of the present application, the pointing device can perceive the spatial relationship between the pointing device and the interactive large screen in real time by using the spatial perception capability of the pointing device, and adaptively adjust the damping coefficient of the cursor according to the distance between the pointing device and the large screen and the attitude change of the pointing device, thereby achieving adjustment of the sensitivity of the cursor, and further achieving adaptive adjustment of the dithering effect of the cursor according to the distance between the pointing device and the large screen and the attitude change of the pointing device, so that the user can obtain the experience of non-dithering cursor movement at a small amplitude and no delay at a large amplitude when using the remote controller at any position. Since the user generally moves at a high speed to the vicinity of the control when performing fine pointing selection, and then adjusts slowly to accurately select the control, the method can be well applied to the scene of fine operation of the user on the large screen.

[0043] In a possible implementation manner of the third aspect, the first pointing device is specifically configured to: determine a first damping coefficient corresponding to the i th frame according to a distance corresponding to the i th frame and a first attitude change value corresponding to the i th frame; determine a second damping coefficient corresponding to the i th frame according to the distance corresponding to the i th frame and a second attitude change value corresponding to the i th frame, wherein the distance corresponding to the i th frame refers to a distance between the first pointing device and the first display screen corresponding to the i th frame, i is a natural number, i = 1, 2, 3…; determine an x variable corresponding to the i th frame and a y variable corresponding to the i th frame, wherein the x variable corresponding to the i th frame is a change amount of a horizontal coordinate of a pointing position corresponding to the i th frame relative to a horizontal coordinate of a pointing position corresponding to the i-1 th frame, and the y variable corresponding to the i th frame is a change amount of a vertical coordinate of the pointing position corresponding to the i th frame relative to a vertical coordinate of the pointing position corresponding to the i-1 th frame; determine a cursor coordinate corresponding to the i th frame according to the first damping coefficient corresponding to the i th frame, the second damping coefficient corresponding to the i th frame, a cursor coordinate corresponding to the i-1 th frame, the x variable corresponding to the i th frame and the y variable corresponding to the i th frame; and the first display screen is specifically configured to: display a cursor corresponding to the i th frame on the first display screen according to the cursor coordinate corresponding to the i th frame.

[0044] In some embodiments, the first attitude change value corresponding to the i th frame includes a change value of an azimuth angle of the first pointing device relative to an attitude corresponding to the i-1 th frame, and the second attitude change value corresponding to the i th frame includes a change value of a pitch angle of the first pointing device relative to the attitude corresponding to the i-1 th frame.

[0045] In some embodiments, the first pointing device is specifically configured to: determine a sum of a third product and a horizontal coordinate of a cursor coordinate corresponding to the i-1 th frame as a horizontal coordinate of a cursor coordinate corresponding to the i th frame, the third product being a product of the first damping coefficient corresponding to the i th frame and the x variable corresponding to the i th frame; and determine a sum of a fourth product and a vertical coordinate of the cursor coordinate corresponding to the i-1 th frame as a vertical coordinate of the cursor coordinate corresponding to the i th frame, the fourth product being a product of the second damping coefficient corresponding to the i th frame and the y variable corresponding to the i th frame.

[0046] In the embodiments of the present application, the pointing device can be used to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen and the attitude change of the pointing device, and the position of the cursor display can be adjusted according to the adjusted damping coefficient, so that the damped effect of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen and the attitude change of the pointing device, and the user can obtain the experience of no dithering for small movement of the cursor and no delay for large movement of the cursor when using the remote controller at any position. Since the user generally moves at a high speed to the vicinity of the control when performing fine pointing selection, and then adjusts slowly to accurately select the control, the method can be well applied to the scene of fine operation of the user on the large screen.

[0047] In combination with the third aspect, in a possible implementation manner, the first pointing device is specifically configured to: when the pointing position moves on the first display screen, determine the position and the attitude of the first pointing device in real time, the position of the first pointing device being used to obtain the distance between the first pointing device and the first display screen, and the attitude of the first pointing device being used to obtain the attitude change value of the first pointing device.

[0048] The fourth aspect provides an electronic device, which includes a memory and a processor, wherein the memory is configured to store computer program code, and the processor is configured to execute the computer program code stored in the memory to implement the method in the first aspect or any possible implementation manner in the first aspect, or implement the method in the second aspect or any possible implementation manner in the second aspect.

[0049] The fifth aspect provides a computer readable storage medium, which stores computer program or instructions, and when the computer program or instructions are executed, the method in the first aspect or any possible implementation manner in the first aspect is implemented, or the method in the second aspect or any possible implementation manner in the second aspect is implemented.

[0050] The sixth aspect provides a chip, which stores instructions, and when the instructions are executed on the device, the chip executes the method in the first aspect or any possible implementation manner in the first aspect, or executes the method in the second aspect or any possible implementation manner in the second aspect.

[0051] The seventh aspect provides a computer program product, which stores computer program or instructions, and when the computer program or instructions are executed, the method in the first aspect or any possible implementation manner in the first aspect is implemented, or the method in the second aspect or any possible implementation manner in the second aspect is implemented. BRIEF DESCRIPTION OF DRAWINGS

[0052] Figure 1 FIG. 1 is a structural schematic diagram of an electronic device provided by an embodiment of the present application;

[0053] Figure 2 FIG. 2 is a structural schematic diagram of another electronic device provided by an embodiment of the present application;

[0054] Figure 3 FIG. 3 is a structural schematic diagram of yet another electronic device provided by an embodiment of the present application;

[0055] Figure 4 FIG. 4 is a use scenario of a pointing-type remote controller provided by an embodiment of the present application;

[0056] Figure 5 FIG. 5 is a schematic diagram of the sensitivity of cursor movement changing with the use distance provided by an embodiment of the present application;

[0057] Figure 6 FIG. 6 is a scenario schematic diagram of a pointing-type remote controller controlling a cursor at different use distances provided by an embodiment of the present application;

[0058] Figure 7 FIG. 7 is a scenario schematic diagram of an application scenario corresponding to the present application provided by an embodiment of the present application;

[0059] Figure 8 FIG. 8 is another scenario schematic diagram of an application scenario corresponding to the present application provided by an embodiment of the present application;

[0060] Figure 9 FIG. 9 is a comparison schematic diagram of cursor control effects of the present application and existing solutions provided by an embodiment of the present application;

[0061] Figure 10 FIG. 10 is a schematic flowchart of a cursor control method provided by an embodiment of the present application;

[0062] Figure 11 FIG. 11 is another schematic flowchart of a cursor control method provided by an embodiment of the present application;

[0063] Figure 12 FIG. 12 is yet another schematic flowchart of a cursor control method provided by an embodiment of the present application;

[0064] Figure 13 FIG. 13 is still another schematic flowchart of a cursor control method provided by an embodiment of the present application;

[0065] Figure 14 FIG. 14 is an interaction schematic diagram of a cursor control method provided by an embodiment of the present application;

[0066] Figure 15is a curve relationship diagram between a damping coefficient and a posture change value of each frame when a distance between a remote controller and a large screen is constant, provided by an embodiment of the present application.

[0067] Figure 16 is a curve relationship diagram between a damping coefficient and a distance between a remote controller and a large screen when a posture change value of each frame of the remote controller is constant, provided by an embodiment of the present application.

[0068] Figure 17 is a position relationship diagram between several large screen devices and a UWB base station, provided by an embodiment of the present application.

[0069] Figure 18 is a layout diagram of several first antenna arrays, provided by an embodiment of the present application.

[0070] Figure 19 is a layout state diagram of a second antenna array on a remote controller, provided by an embodiment of the present application.

[0071] Figure 20 is a space coordinate system established with a UWB base station as a coordinate origin, provided by an embodiment of the present application.

[0072] Figure 21 is a space coordinate system established with a center of a remote controller as a coordinate origin, provided by an embodiment of the present application.

[0073] Figure 22 is a diagram for measuring an azimuth angle ψ, a pitch angle and a roll angle θ of a posture of a remote controller, provided by an embodiment of the present application.

[0074] Figure 23 is a functional module diagram of a cursor control system, provided by an embodiment of the present application. DETAILED DESCRIPTION

[0075] The technical solutions in the present application will be described below with reference to the drawings. Obviously, the described embodiments are only some of the embodiments of the present application, not all the embodiments.

[0076] The technical solutions in the embodiments of the present application will be described below with reference to the drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " represents the meaning of or, for example, A / B can represent A or B; "and / or" in the present application only represents a description of the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which means that there are three cases of A alone, A and B together, and B alone. In addition, in the description of the embodiments of the present application, "plurality" or "multiple" means two or more than two.

[0077] The terms "first", "second", "third", etc. are used herein only to describe different instances, and are not intended to, nor should they be construed to, connote relative importance or imply specific characteristics thereof. Thus, features defined with "first", "second" or "third" can include one or more of the features. In the description of the embodiments, the meaning of "a plurality" is two or more, unless otherwise specified.

[0078] The terminology used in the following embodiments is for the purpose of describing particular embodiments only and is not intended to be limiting of the present application. As used in the description of the embodiments and the appended claims, the singular forms "a", "an" and "the" are intended to include both singular and plural forms, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises", "comprising", "includes" and / or "including", as used herein, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. The term "and / or" used in the context of the description of the embodiments refers to three relationships: A and / or B, A and B, and A or B. For example, A and / or B can mean A alone, A and B together, or B alone.

[0079] Reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrases "in one embodiment" or "in some embodiments" in various places throughout this specification are not necessarily all referring to the same embodiment, unless otherwise specified. The terms "including", "containing", "having" and variations thereof are meant to encompass the terms "including but not limited to".

[0080] The method provided by the embodiments of the present application can be applied to electronic devices such as mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, notebook computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), and the like. The embodiments of the present application do not limit the specific type of electronic device.

[0081] Exemplary, Figure 1A structural schematic diagram of the electronic device 100 is shown. The electronic device 100 can include a wireless communication module 110, an antenna 1, a processor 120, a loudspeaker 130, a power management module 140, an internal memory 150, a display screen 160, and the like.

[0082] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than shown (for example, it can also include an external memory interface, a battery, a frequency module, a sensor module, and the like), or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0083] The wireless communication module 110 can provide a wireless communication solution including wireless local area networks (WLAN) (such as a wireless fidelity (Wi-Fi) network), Bluetooth (BT), a global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), and the like, which are applied to the electronic device 100. The wireless communication module 110 can be one or more devices that integrate at least one communication processing module. The wireless communication module 110 receives electromagnetic waves via the antenna 1, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 120. The wireless communication module 110 can also receive signals to be sent from the processor 120, perform frequency modulation, amplification, and convert them into electromagnetic wave radiation via the antenna 1.

[0084] The processor 120 can include one or more processing units, for example: the processor 120 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), and the like. Among them, different processing units can be independent devices, or can be integrated in one or more processors.

[0085] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.

[0086] The processor 120 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 120 is a cache memory. The memory can save instructions or data that the processor 120 has just used or recycled. If the processor 120 needs to use the instructions or data again, it can be directly called from the memory. This avoids repeated access and reduces the waiting time of the processor 120, thereby improving the efficiency of the system.

[0087] In some embodiments, the processor 120 can include one or more interfaces. The interface can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0088] The antenna 1 is used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example: the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0089] The loudspeaker 130, also known as the "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to a hands-free call through the loudspeaker 130.

[0090] The power management module 140 is configured to be connected to the processor 120, and receives input from a battery and / or a charging management module to provide power to the processor 120, the internal memory 150, the speaker 130, the display screen 160, the wireless communication module 110, and the like. The power management module 140 can also be configured to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), and the like. In some other embodiments, the power management module 140 can also be disposed in the processor 120. In some other embodiments, the power management module 140 and the charging management module can also be disposed in the same device.

[0091] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the wireless communication module 110, and the like.

[0092] The internal memory 150 can be configured to store computer executable program codes including instructions. The processor 120 executes various function applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 150. The internal memory 150 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one App (such as a sound playing function, an image playing function, and the like) required by a function, and the like. The data storage area can store data (such as audio data, a phonebook, and the like) created during use of the electronic device 100, and the like. In addition, the internal memory 150 can include a high-speed random access memory, and can also include a non-volatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.

[0093] The electronic device 100 implements a display function through a GPU, the display screen 160, and an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 160 and the application processor. The GPU is configured to perform mathematical and geometric calculations for graphics rendering. The processor 120 can include one or more GPUs that execute program instructions to generate or change display information.

[0094] The display screen 160 is configured to display images, videos, and the like. The display screen 160 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the electronic device 100 can include one or N display screens 160, where N is a positive integer greater than 1.

[0095] The software system of the electronic device 100 can employ a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture.

[0096] In some embodiments, the electronic device 100 can be a large-screen device.

[0097] Exemplarily, Figure 2 A structural diagram of the electronic device 200 is shown. The electronic device 200 can include a wireless communication module 210, an antenna 2, an antenna 3, an antenna 4, an antenna 5, an antenna 6, an ultra wide band (UWB) module 220, a processor 230, an internal memory 240, a power management module 250, a power supply 260, a sensor module 270, and the like.

[0098] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 can include more or fewer components than shown, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0099] The wireless communication module 210 can provide a solution for wireless communication including WLAN (e.g., Wi-Fi network), BT, GNSS, FM, NFC, IR, etc. applied to the electronic device 200. The wireless communication module 210 can be one or more devices that integrate at least one communication processing module. The wireless communication module 210 receives electromagnetic waves via the antenna 3, frequency-mixes and filters the electromagnetic wave signals, and transmits the processed signals to the processor 230. The wireless communication module 210 can also receive signals to be transmitted from the processor 230, frequency-mix them, amplify them, and radiate them as electromagnetic waves via the antenna 3.

[0100] In some embodiments, the antenna 2, the antenna 3, and the wireless communication module 210 of the electronic device 200 are coupled so that the electronic device 200 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and / or a satellite based augmentation systems (SBAS).

[0101] The UWB module 220 can provide a UWB communication, ranging, etc. solution applied to a UWB tag device. When the electronic device 200 integrates one UWB transmitting antenna (e.g., the antenna 4) and multiple UWB receiving antennas (e.g., the antenna 5 and the antenna 6), the posture measurement of the electronic device 200 can be implemented based on a UWB signal.

[0102] The processor 230 can include one or more processing units. For example, the processor 230 can include an application processor, a modem processor, a graphics processor, an ISP, a controller, a memory, a video codec, a DSP, a baseband processor, and / or an NPU, etc. Different processing units can be independent devices or integrated in one or more processors.

[0103] In some embodiments, the processor 230 is configured to process the communication or ranging information output by the UWB module 220, and the processor 230 is further configured to calculate the positioning result of the UWB tag.

[0104] The controller can be the nerve center and command center of the electronic device 200. The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.

[0105] The memory can be disposed in the processor 230 and used to store instructions and data. In some embodiments, the memory in the processor 230 is a cache memory. The memory can store instructions or data that have just been used or are repeatedly used by the processor 230. If the processor 230 needs to use the instructions or data again, the instructions or data can be directly called from the memory. This avoids repeated access and reduces the waiting time of the processor 230, thereby improving the efficiency of the system.

[0106] In some embodiments, the processor 230 can include one or more interfaces. The interfaces can include an I2C interface, an I2S interface, a PCM interface, a UART interface, a MIPI, a GPIO interface, a SIM interface, and / or a USB interface, etc.

[0107] The antenna 2 and the antenna 3 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example, the antenna 2 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antennas can be used in combination with a tuning switch.

[0108] The internal memory 240 can be used to store computer executable program codes including instructions. The processor 230 performs various functional applications and data processing of the electronic device 200 by running the instructions stored in the internal memory 240. The internal memory 240 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one App (such as a sound playing function, an image playing function, etc.) required by a function, etc. The data storage area can store data (such as audio data, a phone book, etc.) created during the use of the electronic device 200, etc. In addition, the internal memory 240 can include a high-speed random access memory, and can further include a non-volatile memory such as at least one magnetic disk storage device, a flash memory device, a UFS, etc.

[0109] The power management module 250 is used to connect the processor 230, and receives the input of the battery 260 and / or the charging management module to supply power to the processor 230, the internal memory 240, the wireless communication module 210, the UWB module 220, and the sensor module 270, etc. The power management module 250 can also be used to monitor parameters such as the battery capacity, the battery cycle number, the battery health status (leakage, impedance), etc. In some other embodiments, the power management module 250 can also be arranged in the processor 230. In some other embodiments, the power management module 250 and the charging management module can also be arranged in the same device.

[0110] The wireless communication function of the electronic device 200 can be realized through the antenna 2, the antenna 3, the antenna 4, the antenna 5, the antenna 6, the wireless communication module 210, the UWB module 220, a modem processor, and a baseband processor, etc.

[0111] The sensor module 270 can include a gyroscope sensor 271, an acceleration sensor 272, a geomagnetic sensor 273, etc.

[0112] In some embodiments, the sensor module 270 is used to output the azimuth angle, the pitch angle, and the roll angle information of the UWB tag.

[0113] The software system of the electronic device 200 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture.

[0114] In some embodiments, the electronic device 200 is a pointing device, for example, can be a pointing type remote controller.

[0115] Exemplarily, Figure 3A structural diagram of the electronic device 300 is shown. The electronic device 300 can include a wireless communication module 310, an antenna 7, an antenna 8, an antenna 9, an antenna 10, an antenna 11, a UWB module 320, a processor 330, an internal memory 340, a driving motor 350, a power management module 360, a power supply 370, and the like.

[0116] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 300. In other embodiments of the present application, the electronic device 300 can include more or fewer components than shown, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0117] The wireless communication module 310 can provide a solution for wireless communication including WLAN (such as Wi-Fi network), BT, GNSS, FM, NFC, IR, and the like applied to the electronic device 300. The wireless communication module 310 can be one or more devices that integrate at least one communication processing module. The wireless communication module 310 receives electromagnetic waves via the antenna 8, frequency-modulates and filters the electromagnetic wave signals, and transmits the processed signals to the processor 330. The wireless communication module 310 can also receive signals to be transmitted from the processor 330, frequency-modulate them, amplify them, and convert them into electromagnetic wave radiation via the antenna 8.

[0118] In some embodiments, the antenna 7, the antenna 8, and the wireless communication module 310 of the electronic device 300 are coupled, so that the electronic device 300 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include GSM, GPRS, CDMA, WCDMA, TD-SCDMA, LTE, BT, GNSS, WLAN, NFC, FM, and / or IR technology, and the like. The GNSS can include GPS, GLONASS, BDS, QZSS, and / or SBAS.

[0119] The UWB module 320 can provide a UWB communication, ranging, and the like solution applied to the electronic device 300. It should be noted that the electronic device 300 can only carry one UWB signal receiving antenna, and in this case, at least three electronic devices 300 are needed to achieve three-dimensional positioning of the UWB tag. In another implementation scheme, the electronic device 300 can carry multiple UWB signal receiving antennas, and the arrangement between the antennas needs to meet certain rules. In this implementation scheme, at least two UWB receiving antennas are needed to achieve two-dimensional positioning of the UWB tag, and at least three UWB receiving antennas (such as the antenna 9, the antenna 10, and the antenna 11) are needed to achieve three-dimensional positioning of the tag. In addition, the electronic device 300 only needs to carry one UWB transmitting antenna.

[0120] The processor 330 can include one or more processing units, for example: the processor 330 can include an application processor, a modem processor, a graphics processor, an ISP, a controller, a memory, a video codec, a DSP, a baseband processor, and / or an NPU, etc. Among them, different processing units can be independent devices, or can be integrated in one or more processors.

[0121] In some embodiments, the processor 330 is used to process the communication or ranging information output by the UWB module 220, and the processor 230 is also responsible for calculating the positioning result of the UWB tag.

[0122] Among them, the controller can be the nerve center and command center of the electronic device 300. The controller can generate operation control signals according to instruction operation codes and timing signals to complete the control of fetching instructions and executing instructions.

[0123] The memory can also be provided in the processor 330, used to store instructions and data. In some embodiments, the memory in the processor 330 is a cache memory. The memory can save instructions or data that the processor 330 has just used or repeatedly uses. If the processor 330 needs to use the instructions or data again, it can be directly called from the memory. Avoid repeated access and reduce the waiting time of the processor 330, thereby improving the efficiency of the system.

[0124] In some embodiments, the processor 330 can include one or more interfaces. The interface can include an I2C interface, an I2S interface, a PCM interface, a UART interface, an MIPI, a GPIO interface, a SIM interface, and / or a USB interface, etc.

[0125] The antenna 7 and the antenna 8 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 300 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antenna. For example: the antenna 7 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0126] The internal memory 340 can be used to store computer executable program codes including instructions. The processor 330 performs various function applications and data processing of the electronic device 300 by running the instructions stored in the internal memory 340. The internal memory 340 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one App required by a function (such as a sound playing function, an image playing function, etc.), and the like. The data storage area can store data (such as audio data, a phone book, etc.) created during use of the electronic device 300, and the like. In addition, the internal memory 340 can include a high-speed random access memory, and can further include a non-volatile memory such as at least one magnetic disk storage device, a flash memory device, a UFS, and the like.

[0127] The power management module 360 is used to connect the processor 330, and the power management module 360 receives input of the battery 370 and / or a charging management module, and supplies power for the processor 330, the internal memory 340, the wireless communication module 310, the UWB module 320, and the driving motor 350, and the like. The power management module 360 can also be used to monitor parameters such as a battery capacity, a battery cycle number, a battery health state (leakage, impedance), and the like. In some other embodiments, the power management module 360 can also be arranged in the processor 330. In some other embodiments, the power management module 360 and the charging management module can also be arranged in the same device.

[0128] The wireless communication function of the electronic device 300 can be realized through the antenna 7, the antenna 8, the antenna 9, the antenna 10, the antenna 11, the wireless communication module 310, the UWB module 320, a modem processor, and a baseband processor, and the like.

[0129] The software system of the electronic device 300 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture.

[0130] In some embodiments, the electronic device 300 is a UWB base station.

[0131] It should be understood that the technical solutions in the embodiments of the present application can be used in Android, IOS, HarmonyOS, and the like.

[0132] The technical solutions of the embodiments of the present application can be applied to devices with a cursor control function, and electronic devices with a screen. For example, the technical solutions can be applied to a pointing remote controller or other devices with a pointing remote control function, a large-screen device, and the like, and can also be applied to other devices with a cursor control function, electronic devices in a 5G network or electronic devices in a future evolved public land mobile network (PLMN), and the like. The main application scenario can be a scenario of controlling a cursor by using a pointing remote controller, for example, controlling movement of a cursor on a large screen by using a pointing remote controller, so as to implement a shooting game, a fruit cutting game, drawing, and the like on the large screen.

[0133] To make the pointing remote controller clearer, for example, the pointing remote controller is described in combination with Figure 4 The use scenario of the pointing remote controller provided by the embodiments of the present application is described in detail.

[0134] As shown in Figure 4 , the cursor 420 displayed on the display screen of the large-screen device 400 can be controlled by using the pointing remote controller 410. The display position of the cursor 420 is the same as the position on the display screen pointed by the pointing remote controller 410, that is, the cursor 420 is displayed at which position on the display screen when the pointing remote controller 410 points at which position on the display screen.

[0135] As shown in Figure 4 (a), when the pointing remote controller 410 is switched from pointing at position A on the display screen to pointing at position B on the display screen, the display position of the cursor 420 is correspondingly switched from position A to position B; as shown in Figure 4 (b), when the pointing remote controller 410 points outside the display screen of the large-screen device 400, the cursor is not displayed on the display screen of the large-screen device 400.

[0136] The use experience of the pointing remote controller is similar to that of an infrared laser pointer. The pointing remote controller can control movement of the cursor on the display screen to implement interaction between the cursor and content displayed on the display screen, and can improve the interaction experience between a user and the large screen. For example, the user can implement a shooting game, a fruit cutting game, and the like on the large screen by using the pointing remote controller, which is more in line with the use habit of the user.

[0137] Further, Figure 5 a change diagram of sensitivity of cursor movement in a use process of a pointing remote controller provided by the embodiments of the present application is shown.

[0138] As shown in Figure 5As shown, after the pointing remote controller is horizontally rotated by an angle a at position 1, the pointing position of the pointing remote controller in the display screen of the large-screen device 500 is moved from position 3 to position 4, and simultaneously, the display position of the cursor is also moved from position 3 to position 4, the distance between position 3 and position 4 is L1, and the distance between position 1 and the display screen of the large-screen device 500 is d1; after the pointing remote controller is moved from position 1 to position 2 which is farther away from the display screen, when the pointing remote controller has the same attitude change (horizontally rotated by an angle a) as at position 1, the pointing position of the pointing remote controller in the display screen of the large-screen device 500 is moved from position 5 to position 6, and simultaneously, the display position of the cursor is also moved from position 5 to position 6, the distance between position 5 and position 6 is L2, L2 is obviously greater than L1, and the distance between position 2 and the display screen of the large-screen device 500 is d2.

[0139] It can be seen that, in the case that the pointing remote controller has the same attitude change, the farther the pointing remote controller is from the display screen, the greater the range of movement of the cursor on the display screen.

[0140] Here, the sensitivity s of the cursor can be introduced to measure the above phenomenon, in the case that the resolution K and the screen size L of the display screen of the large-screen device are unchanged, the sensitivity s of the cursor and the distance d between the pointing remote controller and the display screen have the following relationship:

[0141]

[0142] It can be seen that s and d have a monotonic increasing relationship, in the use of the pointing remote controller, the sensitivity of the cursor movement gradually increases with the increase of the use distance, that is, in the case that the pointing remote controller has the same attitude change, the farther the pointing remote controller is from the large-screen device, the greater the range of movement of the cursor.

[0143] Exemplarily, taking the interaction scene between the pointing remote controller and the display screen as an example, Figure 6 a scene diagram in which a pointing remote controller controls a cursor at different use distances is shown.

[0144] If a user wants to mark the content of the first subheading by using the pointing remote controller to control the cursor, the user can control the movement trajectory of the pointing position of the pointing remote controller on the display screen by controlling the attitude change of the pointing remote controller, so as to control the movement trajectory of the display cursor, and the movement trajectory of the display cursor is the final displayed mark, as shown in (a) of Figure 6 When the distance between the pointing remote controller and the display screen is a short distance, the user can accurately mark the content of the first subheading; however, as shown in (b) of Figure 6(b) in the (b) shown in the figure, when the distance between the pointing type remote controller and the display screen is a long distance, due to the high sensitivity of the cursor movement, a small attitude change of the pointing type remote controller can cause a long distance movement of the cursor on the display screen, and when marking a document, the marking range is easily expanded to the content that is not needed to be marked, and the user is difficult to accurately mark the content of the first subheading.

[0145] Therefore, when the user uses the large screen by the pointing type remote controller at a long distance, a small hand jitter can cause a large range movement of the cursor, and when the target control area of the cursor movement is small, it is difficult to control the cursor to accurately move to the target control, which also makes the user unable to smoothly use the pointing remote controller to control the cursor to perform fine operations in a small range, such as drawing and document marking, and seriously affects the user experience.

[0146] In view of the above problems, in some embodiments, the cursor control by the remote controller can be realized by using the method of the single mouse, in which the remote controller has no pointing effect, and the pointing position of the remote controller has no correlation with the display position of the cursor, and no matter where the remote controller points, the cursor is displayed on the display screen; in this method, the sensitivity of the cursor movement on the display screen is a constant value, and is irrelevant to the distance between the remote controller and the display screen. Although this method can alleviate the jitter problem caused by the high sensitivity of the cursor to a certain extent, in this method, the display position of the cursor is a relative coordinate, not an absolute coordinate, and in the use process, the user needs to frequently frame to manually control the cursor. This method cannot be applied to the pointing type remote controller, and cannot solve the cursor jitter problem of the pointing type remote controller in the use process.

[0147] Therefore, in the current cursor control method, the user cannot adaptively adjust the jitter filtering effect of the cursor in the process of using the remote controller to control the cursor movement at different distances, which seriously affects the user experience.

[0148] Therefore, in the current cursor control method, the user cannot adaptively adjust the jitter filtering effect of the cursor in the process of using the remote controller to control the cursor movement at different distances, which seriously affects the user experience.

[0149] It should be understood that the pointing device in the embodiments of the present application is taken as the pointing type remote controller for description, but this does not constitute any limitation on the application scope of the present application scheme, and the pointing device can also be any device with pointing function.

[0150] Exemplarily, Figure 7The illustration shows an application scenario corresponding to one of the solutions provided in this application.

[0151] If a user wants to use a directional remote control to mark the content of the first subheading, the user can control the movement of the directional remote control on the display screen by changing its orientation. This will control the movement of the cursor, which will then become the final displayed mark.

[0152] like Figure 7 As shown in (a), when the distance between the directional remote control and the display screen is D1 (D1 is close enough, for example, D1 is less than 0.5m), when the user wants to mark the content of the first subheading, that is, when the user wants to control the movement trajectory of the cursor to circle around the content of the first subheading within the range 701, since the sensitivity of the cursor movement is not high at this time, the damping coefficient of the cursor corresponding to this distance D1 is relatively large, for example, the damping coefficient is 1. The user needs to control the pointing position of the directional remote control on the display screen to circle around the content of the first subheading within the range 701 to achieve this. At this time, the trajectory of the pointing position movement and the trajectory of the cursor movement are almost overlapping.

[0153] like Figure 7 As shown in (b), when the distance between the directional remote control and the display screen is switched from D1 to D2 (D2 is greater than D1), when the user wants to mark the content of the first subheading, that is, when they want the cursor movement trajectory to appear as drawing a circle around the content of the first subheading within the range 701, since compared to Figure 7 As shown in (a) below, distance D1 allows for higher sensitivity of cursor movement. Correspondingly, reducing the cursor's damping coefficient allows the cursor to move within a range of 702 by controlling the pointing remote control to circle the content of the first subheading on the display screen. The distribution range of the pointing position movement trajectory is then within range 702. Figure 7 (The range shown by the dashed line in (b)) is 702, which includes 701 and is greater than 701.

[0154] Furthermore, such as Figure 7 As shown in (b), when the distance between the directional remote control and the display screen changes from D2 to D3 (D3 is greater than D2), when the user wants to mark the content of the first subheading, that is, when they want the cursor movement trajectory to appear as a circle around the content of the first subheading within range 701, since compared to Figure 7corresponding to the distance D2 shown in (b) in FIG. 7, at this time, the sensitivity of the cursor movement is higher, and the damping coefficient of the cursor is further reduced, and the user only needs to control the pointing position of the pointing remote controller on the display screen to be within the range 703 to encircle the content of the first sub-title, at this time, the trajectory of the movement of the pointing position corresponds to the distribution range of the range 703 Figure 7 corresponding to the dashed line shown in (c) in FIG. 7, the range 703 contains the range 701, the range 703 is greater than the range 702, and the range 703 includes the range 701.

[0155] It should be understood that the smaller the damping coefficient of the cursor, the smaller the ratio of the displacement amount of the cursor corresponding to each frame to the displacement amount of the pointing position corresponding to each frame.

[0156] In some embodiments, when adjusting the damping coefficient of the cursor according to the distance between the remote controller and the large screen, the damping coefficient of the cursor can be further adjusted in combination with the control state of the user on the remote controller, for example, the damping coefficient of the cursor is further adjusted in combination with the movement speed of the pointing position of the remote controller on the large screen or the posture change of the remote controller, the faster the movement speed of the pointing position, the smaller the adjustment intensity of the damping coefficient of the cursor, the slower the movement speed of the pointing position, the greater the adjustment intensity of the damping coefficient of the cursor; the faster the posture change of the remote controller, the smaller the adjustment intensity of the damping coefficient of the cursor, the slower the posture change of the remote controller, the greater the adjustment intensity of the damping coefficient of the cursor.

[0157] It can be understood that the pointing position moves at the same time as the cursor starts to move, and the pointing position stops moving at the same time as the cursor stops moving.

[0158] In the embodiments of the present application, the pointing remote controller can be used to perceive the spatial relationship between the large screen in real time, and the damping coefficient of the cursor is adaptively adjusted according to the position information of the remote controller relative to the large screen, so that the filtering effect of the cursor can be adaptively adjusted according to the distance between the remote controller and the large screen and / or the control state of the remote controller.

[0159] Exemplarily, taking the control of the control scene as an example, Figure 8 FIG. 8 shows another application scene corresponding to the present application scheme provided by the embodiments of the present application.

[0160] If the user wants to control the cursor 801 to move from the control "A" to the control "B" by using the pointing remote controller, the user can control the movement of the pointing position of the pointing remote controller on the display screen by controlling the posture change of the pointing remote controller, so as to control the movement of the display cursor 801.

[0161] As shown in FIG. 8, Figure 8As shown in (a), when the distance between the directional remote control and the display screen is the first distance, when the user wants to control the cursor 801 to move from control "A" to control "B", the user can do so by moving the pointing position of the remote control on the large screen 800 to position 802, instead of moving the pointing position of the remote control on the large screen 800 to the position of control "B".

[0162] It can be understood that in this embodiment of the application, when the remote control starts to move the pointing position on the large screen, the cursor starts to move synchronously. The ratio of the speed of the cursor movement to the speed of the pointing position movement (less than or equal to 1) decreases as the distance between the remote control and the large screen increases. That is, the damping coefficient of the cursor decreases as the distance between the remote control and the large screen increases. When the pointing position stops moving, the cursor stops moving synchronously.

[0163] like Figure 8 As shown in (b), when the distance between the directional remote control and the display screen increases to a second distance, when the user wants to control cursor 801 to move from control "A" to control "B", compared to Figure 8 In (a), since the distance between the remote control and the large screen has increased, the damping coefficient of the corresponding cursor has also decreased further, so that the user can move the pointing position of the remote control on the large screen 800 to position 803 instead of moving the pointing position of the remote control on the large screen 800 to the position of control "B". The distance between position 803 and control "B" is greater than the distance between position 802 and space "B".

[0164] In some embodiments, when adjusting the damping coefficient of the cursor based on the distance between the remote control and the large screen, the damping coefficient of the cursor can be further adjusted in conjunction with the user's control state of the remote control. For example, the damping coefficient of the cursor can be further adjusted in conjunction with the movement speed of the pointing position on the large screen or the change in the attitude of the remote control. The faster the pointing position moves, the smaller the adjustment force of the cursor's damping coefficient; the slower the pointing position moves, the greater the adjustment force of the cursor's damping coefficient. Similarly, the faster the attitude of the remote control changes, the smaller the adjustment force of the cursor's damping coefficient; the slower the attitude of the remote control changes, the greater the adjustment force of the cursor's damping coefficient.

[0165] In current cursor control methods, when a user uses a remote control from a distance, such as 5 meters away from a large screen, if the user needs to move the cursor from control "A" to control "B" on the screen, the physical distance between the two controls is 0.1 meters. The user needs to precisely control the remote control to rotate 1° to complete the operation, which is difficult and prone to misalignment. However, in the embodiments of this application, due to the addition of cursor damping, the user can control the remote control to rotate a larger angle to move the cursor from control "A" to control "B". For example, if the remote control is rotated 5°, the cursor displayed on the screen only moves 1°, which significantly reduces the difficulty of the user's cursor control operation.

[0166] In this embodiment, the spatial perception capability of the directional remote control can be utilized to perceive the spatial relationship between the remote control and the interactive screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the measured position information of the remote control relative to the screen. This enables the cursor to be adjusted adaptively based on the distance between the remote control and the screen and / or the control state of the remote control.

[0167] For example, Figure 9 This diagram illustrates a comparison of the cursor control effects of a solution provided in this application and existing solutions.

[0168] If a user wants to move the cursor to control "A" using a directional remote control, the user can control the movement of the directional remote control on the display screen by changing the posture of the directional remote control, thereby controlling the movement of the display cursor 901.

[0169] Figure 9 (a) shows a schematic diagram of cursor movement when the distance between the remote control and the large screen is a first distance in the existing solution.

[0170] like Figure 9 As shown in (a), when a user wants to move the cursor 901 from the display area outside the control "A" to the control "A", the user first quickly moves the pointing position towards the control "A" by rapidly switching the remote control's control posture. After approaching the control "A", the user controls the remote control's posture to slowly change and move the pointing position so that the cursor can eventually stop on the control "A". However, since the cursor's movement trajectory is the same as the pointing position's movement trajectory, the cursor movement sensitivity is high when the remote control is far from the large screen. Furthermore, when moving slowly within a small range, the cursor movement sensitivity is much higher than the user's expectation, resulting in severe cursor jitter. It is difficult for the user to control the cursor to be accurately displayed on the control "A".

[0171] Figure 9 (b) shows a schematic diagram of cursor movement when the distance between the remote control and the large screen is a first distance, according to an embodiment of this application.

[0172] As Figure 9 (b) shown, when the user wants to control the cursor 901 to move from the display area outside the control "A" to the control "A", the user first moves the pointing position to the control "A" quickly by quickly switching the remote control operation posture, and after approaching the control "A", slowly changes the remote control posture to move the pointing position at a slow speed, so that the cursor can finally stay on the control "A", wherein, since the cursor moves, the damping coefficient of the cursor can be adaptively adjusted according to the distance between the remote control and the large screen and the operation state of the remote control, so that the sensitivity of the cursor movement matches the expected value of the user, specifically: when the pointing position moves to the control "A" quickly, the sensitivity of the cursor movement is not adjusted (the damping coefficient of the cursor is 1) or is only adjusted based on the distance between the remote control and the large screen, which makes the cursor quickly move around the control "A" following the pointing position, and when the moving speed of the pointing position slows down, the damping coefficient of the cursor is adaptively reduced based on the distance between the remote control and the large screen and the speed of the change of the posture of the remote control, so that the moving range of the cursor is smaller than the moving range of the pointing position, which can reduce the shaking degree of the cursor, and then realize the adaptive adjustment of the de-shaking effect of the cursor.

[0173] It can be seen that when the user quickly points to the control "A", since the user operation of the remote control changes from fast change to low-speed change, a small range of shaking will be generated. In the existing scheme scenario, the shaking of the cursor is serious, which may shake out of the response area of the control "A", causing the control click to fail. In the embodiment of the present application, since the damping effect is increased in the small range of movement, the shaking range of the cursor is obviously suppressed, and the controllability of the cursor is significantly improved.

[0174] In the embodiment of the present application, the pointing type remote control can be used to perceive the spatial relationship between the large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the measured position information of the remote control relative to the large screen, and then the sensitivity of the cursor is adjusted, and then the de-shaking effect of the cursor can be adaptively adjusted according to the distance between the remote control and the large screen and / or the operation state of the remote control, so that the user can obtain the experience of small amplitude movement without shaking and large amplitude movement without delay when using the remote control at any position. Since the user generally moves at high speed near the control when performing fine pointing selection, and then slowly adjusts to accurately select the control, this method can be well applied to the scene of fine operation of the user on the large screen.

[0175] It should be understood that the above is an exemplary introduction to the scheme of the embodiments of the present application in the document marking scene and the control interaction scene. The scheme of the present application can be applied to any scene of interaction between a pointing device and the content of a display screen, for example, can also be applied to a scene of drawing, playing games, etc. on a large screen by a pointing device, and the present application does not limit this.

[0176] Exemplarily, Figure 10 An exemplary flow chart of a method 1000 for cursor control provided by the embodiments of the present application is shown. As Figure 10 shown, the method 1000 comprises:

[0177] S1001: When the distance between the remote controller and the large screen is a first distance, in response to the user moving the pointing position of the remote controller on the display screen within a first display range by controlling the remote controller by the remote controller, the cursor is synchronously moved within a second display range on the display screen, wherein the first display range contains the second display range.

[0178] In the embodiments of the present application, the remote controller can be understood as a pointing type remote controller.

[0179] In the embodiments of the present application, the pointing position can also be described as the intersection position of the direction pointed by the remote controller and the display screen of the large screen.

[0180] In the embodiments of the present application, the first display range refers to the distribution range of the moving track of the pointing position, and the second display range refers to the distribution range of the moving track of the cursor.

[0181] It can also be understood that the moving track of the pointing position in the first display range is a first track, the moving track of the cursor in the second display range is a second track, and the length of the first track is greater than the length of the second track.

[0182] S1002: When the distance between the remote controller and the large screen is switched to a second distance, in response to the user moving the pointing position of the remote controller on the display screen within a third display range by controlling the remote controller by the remote controller, the cursor is synchronously moved within the second display range on the display screen, wherein the third display range contains the first display range, and the second distance is greater than the first distance.

[0183] In the embodiments of the present application, the third display range refers to the distribution range of the moving track of the pointing position.

[0184] In the embodiments of the present application, the third display range contains the first display range, and the first display range contains the second display range, which indicates that the third display range is greater than the first display range, and the first display range is greater than the second display range.

[0185] It can also be understood that the moving track of the pointing position in the third display range is a third track, the length of the third track is greater than the length of the first track, and the length of the first track is greater than the length of the second track.

[0186] That is, when the distance between the remote controller and the large screen is the first distance, if the user wants the cursor to perform an interactive operation in the second display range, the user can achieve this by controlling the pointing position to move in the larger first display range; when the distance between the remote controller and the large screen increases to the second distance, if the user wants the cursor to still perform an interactive operation in the second display range, the user can achieve this by controlling the pointing position to move in the third display range which is larger than the first display range, thereby being able to alleviate the cursor jitter phenomenon caused by the increase in the distance of use (the increase in the sensitivity of cursor movement).

[0187] In some embodiments, the above S1001 to S1002 occur when the posture change speed of the remote controller is relatively fast.

[0188] Alternatively, the above S1101 and S1102 can also be described as: when the distance between the remote controller and the large screen is the first distance, in response to the user controlling the pointing position of the remote controller on the display screen on the display screen by the remote controller to move by a first amplitude, the cursor is synchronously moved on the display screen by a second amplitude, wherein the first amplitude is greater than the second amplitude; when the distance between the remote controller and the large screen is switched to the second distance, in response to the pointing position of the remote controller on the display screen being controlled by the remote controller to move by a third amplitude on the display screen, the cursor is synchronously moved on the display screen by the second amplitude, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance.

[0189] In some embodiments, the first amplitude, the second amplitude, and the third amplitude can be distance amplitudes at the same time, or can be angle amplitudes at the same time.

[0190] In the embodiments of the present application, the pointing type remote controller can be used to perceive the spatial relationship between the remote controller and the large screen in real time, and the sensitivity of the cursor can be adaptively adjusted according to the position information of the remote controller relative to the large screen obtained by measurement, thereby being able to adaptively adjust the jitter filtering effect of the cursor according to the distance between the remote controller and the large screen.

[0191] Exemplarily, Figure 11 A schematic flowchart of another method 1100 for controlling a cursor provided by an embodiment of the present application is shown. As shown in the figure, Figure 11 The method 1100 includes:

[0192] S1101: when the distance between the remote controller and the large screen is the first distance, in response to the user controlling the pointing position of the remote controller on the display screen by the remote controller to move from a first position to a second position, the cursor is synchronously moved on the display screen from the first position to a target position, wherein the distance between the first position and the second position is greater than the distance between the first position and the target position.

[0193] Wherein, the cursor starts to move at the same time as the pointing position starts to move, the cursor stops to move at the same time as the pointing position stops to move, and the direction of the cursor movement is always synchronized with the direction of the pointing position movement.

[0194] S1102: When the distance between the remote controller and the large screen is the second distance, in response to the user controlling the pointing position of the remote controller on the display screen by the remote controller to move from the first position to the third position, the cursor is controlled to move on the display screen from the first position to the target position, wherein the distance between the first position and the third position is greater than the distance between the first position and the target position, and the distance between the first position and the third position is greater than the distance between the first position and the second position.

[0195] Wherein, the second distance is greater than the first distance.

[0196] Exemplarily, Figure 12 A schematic flow chart of another method 1200 for controlling a cursor is shown. As shown in the method 1200 includes: Figure 12

[0197] S1201: Determine the x variable and the y variable corresponding to the i-th frame, wherein the x variable is the change amount of the pointing coordinate corresponding to the i-th frame relative to the pointing coordinate corresponding to the i-1-th frame in the X-axis direction, the y variable is the change amount of the pointing coordinate corresponding to the i-th frame relative to the pointing coordinate corresponding to the i-1-th frame in the Y-axis direction, the pointing coordinate is the intersection coordinate of the direction pointed by the remote controller and the large screen, and the initial value of i is 1.

[0198] In one example, the remote controller points to the coordinate (x1, y1) in the large screen in the i-1-th frame, and the remote controller points to the coordinate (x2, y2) in the large screen in the i-th frame, then the x variable corresponding to the i-th frame is x2-x1, and the y variable corresponding to the i-th frame is y2-y1.

[0199] S1202: Determine the damping coefficient corresponding to the i-th frame according to the distance between the remote controller and the large screen corresponding to the i-th frame, wherein the damping coefficient corresponding to the i-th frame is negatively related to the distance between the remote controller and the large screen corresponding to the i-th frame.

[0200] S1203: Determine the cursor coordinate corresponding to the i-th frame according to the damping coefficient corresponding to the i-th frame, the cursor coordinate corresponding to the i-1-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame.

[0201] ​In some embodiments, the x variable and the y variable corresponding to the i-th frame are adjusted according to the damping coefficient first, then the horizontal coordinate of the cursor coordinate corresponding to the i-1-th frame is added with the adjusted x variable corresponding to the i-th frame to obtain the horizontal coordinate of the cursor coordinate corresponding to the i-th frame, and the vertical coordinate of the cursor coordinate corresponding to the i-1-th frame is added with the adjusted y variable corresponding to the i-th frame to obtain the vertical coordinate of the cursor coordinate corresponding to the i-th frame.

[0202] In one example, the x variable corresponding to the i-th frame is x2-x1, the y variable corresponding to the i-th frame is y2-y1, the damping coefficient corresponding to the i-th frame is B1, and the cursor coordinate corresponding to the i-1-th frame is (x3, y3), then the cursor coordinate corresponding to the i-th frame is (x3+B1(x2-x1), y3+B1(y2-y1)).

[0203] S1204: displaying the cursor corresponding to the i-th frame on the large screen according to the cursor coordinate corresponding to the i-th frame.

[0204] Specifically, the large screen draws and displays the cursor corresponding to the i-th frame on the large screen according to the cursor coordinate corresponding to the i-th frame.

[0205] Thereafter, when the display of the cursor enters the i+1-th frame, i is set to i+1, and the operations of S1201 to S1204 are executed in a loop, thereby displaying the cursor corresponding to the i+1-th frame on the large screen, and so on, which is reflected on the user perception level as the movement of the cursor.

[0206] In the embodiments of the present application, the jitter reduction effect of the cursor can be adaptively adjusted according to the distance between the remote controller and the large screen, so that the user can obtain the experience of non-jittering cursor movement at any position using the remote controller.

[0207] Exemplarily, Figure 13 A schematic flowchart of another method 1300 for controlling a cursor is shown. As Figure 13 shown, the method 1300 includes:

[0208] S1301 is the same as S1201 in the embodiment shown, and is not described herein again for brevity. Figure 12

[0209] S1302: determining the damping coefficient corresponding to the i-th frame according to the distance between the remote controller and the large screen corresponding to the i-th frame and the attitude change value of the remote controller corresponding to the i-th frame, the damping coefficient corresponding to the i-th frame being negatively correlated with the distance between the remote controller and the large screen corresponding to the i-th frame, and the damping coefficient corresponding to the i-th frame being positively correlated with the attitude change value of the remote controller corresponding to the i-th frame.

[0210] ​S1303: determining the cursor coordinate corresponding to the i-th frame according to the damping coefficient corresponding to the i-th frame, the cursor coordinate corresponding to the (i-1)-th frame, the x variable corresponding to the i-th frame and the y variable corresponding to the i-th frame.

[0211] In some embodiments, the damping coefficient corresponding to the i-th frame includes a first damping coefficient and a second damping coefficient, the x variable corresponding to the i-th frame is adjusted according to the first damping coefficient, and the y variable corresponding to the i-th frame is adjusted according to the second damping coefficient, then the horizontal coordinate of the cursor coordinate corresponding to the i-th frame is obtained by adding the adjusted x variable corresponding to the i-th frame to the horizontal coordinate of the cursor coordinate corresponding to the (i-1)-th frame, and the vertical coordinate of the cursor coordinate corresponding to the i-th frame is obtained by adding the adjusted y variable corresponding to the i-th frame to the vertical coordinate of the cursor coordinate corresponding to the (i-1)-th frame.

[0212] In one example, the x variable corresponding to the i-th frame is x2-x1, the y variable corresponding to the i-th frame is y2-y1, the first damping coefficient and the second damping coefficient corresponding to the i-th frame are B2 and B3 respectively, and the cursor coordinate corresponding to the (i-1)-th frame is (x3, y3), then the cursor coordinate corresponding to the i-th frame is (x3+B2(x2-x1), y3+B3(y2-y1)).

[0213] In some embodiments, the first damping coefficient is related to the distance between the remote controller and the large screen, and the first damping coefficient is also related to the change of the azimuth angle of the posture of the remote controller in the current frame.

[0214] In some embodiments, the second damping coefficient is related to the distance between the remote controller and the large screen, and the second damping coefficient is also related to the change of the pitch angle of the posture of the remote controller in the current frame.

[0215] S1304: displaying the cursor corresponding to the i-th frame on the large screen according to the cursor coordinate corresponding to the i-th frame.

[0216] In the embodiments of the present application, the dithering effect of the light cursor can be adaptively adjusted according to the distance between the remote controller and the large screen and the change of the posture of the remote controller, so that the user can obtain the experience of no dithering for small cursor movement and no delay for large cursor movement when using the remote controller at any position.

[0217] Exemplarily, Figure 14 An interaction schematic diagram of a method 1400 for controlling a cursor provided by an embodiment of the present application is shown. As Figure 14 shown, the method is an interaction method between a UWB base station, a remote controller (i.e. a pointing type remote controller) and a large screen, and the method 1400 includes:

[0218] S1401: the UWB base station establishes a first coordinate system, which is a spatial coordinate system established with the UWB base station as the coordinate origin.

[0219] In some embodiments, the UWB base station can be deployed on a wall in the room, on a large screen or other locations in the room.

[0220] S1402: The UWB base station determines a first coordinate, which is the coordinate of the remote controller in the first coordinate system.

[0221] S1403: The UWB base station sends the first coordinate to the remote controller.

[0222] In some embodiments, the UWB base station includes a UWB module, and the remote controller also includes a UWB module. The UWB base station and the remote controller communicate through the respective UWB modules, i.e., the UWB module of the remote controller receives the first coordinate sent by the UWB module of the UWB base station.

[0223] S1404: The remote controller establishes a second coordinate system, which is a spatial coordinate system with the center of the remote controller as the coordinate origin.

[0224] It should be understood that the above S1401 to S1404 have been executed after the installation of the UWB base station, and this process can be understood as a preparation operation for executing the following S1405 to S1410.

[0225] S1405: Based on the first coordinate, the remote controller determines its position and attitude in real time, and further determines the attitude azimuth angle change value (Δψ) and attitude pitch angle change value (Δθ) of the remote controller corresponding to the current frame. and determines the distance between the remote controller and the large screen corresponding to the current frame.

[0226] Wherein, the attitude azimuth angle and the attitude pitch angle of the remote controller will be described in detail in subsequent embodiments.

[0227] In some embodiments, the remote controller is based on the first coordinate system and the second coordinate system, and determines the spatial relationship of the remote controller relative to the large screen in real time according to the first coordinate and the position of the large screen in the first coordinate system, wherein the spatial relationship of the remote controller relative to the large screen includes the distance between the remote controller and the large screen, the pointing position of the remote controller on the large screen, the attitude of the remote controller, etc.

[0228] In some embodiments, the remote controller is provided with a sensor module, which includes a gyroscope sensor and an acceleration sensor. The remote controller can calculate the attitude change value of the remote controller in real time through the gyroscope sensor. The attitude change value can specifically include the azimuth angle change value (Δψ), the pitch angle change value (Δθ) The pose change value and the UWB base station measured remote controller pose are fused and filtered with the roll angle change value (Δθ), so that a more accurate remote controller pose can be obtained; the remote controller position change value can be obtained by twice integration of the acceleration sensor on the remote controller, and the remote controller position change value and the positioning measurement value of the remote controller by the UWB base station are fused and filtered, so that a more accurate remote controller position can be obtained. Therefore, the measurement results of the UWB base station and the sensor module can be fused by using Kalman filtering and the like to obtain the accurate pose and position of the remote controller in the UWB coordinate system (i.e., the first coordinate system mentioned above).

[0229] S1406: The remote controller determines the x variable and the y variable corresponding to the current frame.

[0230] The x variable is the change amount of the pointing coordinate corresponding to the current frame relative to the pointing coordinate corresponding to the last frame in the X-axis direction, and the y variable is the change amount of the pointing coordinate corresponding to the current frame relative to the pointing coordinate corresponding to the last frame in the Y-axis direction. The pointing coordinate refers to the intersection coordinate of the direction pointed by the remote controller and the large screen.

[0231] In one example, in the last frame, the remote controller points to the coordinate (x1, y1) in the large screen, and in the current frame, the remote controller points to the coordinate (x2, y2) in the large screen. Then, the x variable corresponding to the current frame is x2-x1, and the y variable corresponding to the current frame is y2-y1.

[0232] Specifically, the pointing position of the remote controller on the large screen corresponding to the last frame and the pointing position of the remote controller on the large screen corresponding to the current frame are determined according to the spatial relationship of the remote controller relative to the large screen determined in real time in S1405, and then the x variable and the y variable corresponding to the current frame are determined.

[0233] S1407: The remote controller adjusts the change amount of the cursor in the X-axis direction according to the change value of the azimuth angle of the pose of the remote controller and the distance between the remote controller and the large screen; and adjusts the change amount of the cursor in the Y-axis direction according to the change value of the pitch angle of the pose of the remote controller and the distance between the remote controller and the large screen.

[0234] In some embodiments, a first damping coefficient is determined according to the change value of the azimuth angle of the pose of the remote controller and the distance between the remote controller and the large screen; a second damping coefficient is determined according to the change value of the pitch angle of the pose of the remote controller and the distance between the remote controller and the large screen; the change amount of the cursor in the X-axis direction (i.e., the change amount of the horizontal coordinate) is adjusted according to the first damping coefficient, and the change amount of the cursor in the Y-axis direction (i.e., the change amount of the vertical coordinate) is adjusted according to the second damping coefficient.

[0235] In some embodiments, the formula for adjusting the change amount of the cursor in the X-axis direction and the change amount of the cursor in the Y-axis direction is as follows:

[0236] Δx d =B(Δψ,d)*Δx r (2)

[0237]

[0238] Where, Δx d This represents the change in the cursor along the X-axis in the current frame, B(Δψ,d) represents the function for calculating the first damping coefficient, d represents the distance between the remote control and the large screen in the current frame, and Δx r Δy represents the x variable corresponding to the current frame; d This indicates the amount of change in the Y-axis direction of the adjusted cursor in the current frame. This represents the function for calculating the second damping coefficient, where d represents the distance between the remote control and the large screen in the current frame, and Δy... r This represents the y variable corresponding to the current frame.

[0239] The rules governing the selection of the damping coefficient will be detailed in subsequent embodiments.

[0240] S1408: The remote control calculates the cursor coordinates of the current frame based on the adjusted cursor's change in the X-axis direction, the change in the Y-axis direction, and the cursor coordinates of the previous frame.

[0241] Specifically, the remote control calculates the x-coordinate of the cursor in the current frame based on the change in the cursor's x-axis direction after adjustment and the x-coordinate of the cursor coordinate in the previous frame, and calculates the y-coordinate of the cursor in the current frame based on the change in the cursor's y-axis direction after adjustment and the y-coordinate of the cursor coordinate in the previous frame.

[0242] S1409: The remote control sends the calculated cursor coordinates of the current frame to the large screen.

[0243] S1410: The large screen draws the cursor based on the cursor coordinates of the current frame and displays the cursor on the screen.

[0244] In this embodiment, the spatial perception capability of the directional remote control can be utilized to perceive the spatial relationship between the remote control and the interactive screen in real time. Based on the measured position information of the remote control relative to the screen, the sensitivity of the cursor can be adaptively adjusted. This enables the cursor to be adjusted adaptively based on the distance between the remote control and the screen and / or the control state of the remote control, so that users can experience no jitter when moving the cursor slightly and no delay when moving it significantly, no matter where they are using the remote control.

[0245] The following, by way of example, combines Figure 15 and 16 The adaptive determination rules for the damping coefficient provided in the embodiments of this application will be introduced.

[0246] Figure 15 The graph shows the relationship between the damping coefficient and the attitude change value per frame when the distance between the remote control and the large screen is constant.

[0247] like Figure 15 As shown, when the distance is constant, within a range where the attitude change value of the current frame of the remote control is less than a certain threshold (this threshold could be, for example, 7°), the damping coefficient increases with the increase of the attitude change value of the current frame. In other words, when the attitude change of the current frame of the remote control is slow, a smaller damping coefficient is calculated according to the filtering function (B() above), further reducing the number of coordinates moved by the cursor. When the attitude change value of the current frame is greater than or equal to a certain threshold, the damping coefficient no longer increases with the increase of the attitude change value of the current frame, but remains almost constant at 1. In other words, when the attitude change of the current frame of the remote control is fast, a larger damping coefficient is calculated according to the filtering function, which does not affect the rapid movement of the cursor. This results in a user experience where "small-range cursor movement has a damping effect, while fast, large-range movement has no damping effect."

[0248] Figure 16 The graph shows the relationship between the damping coefficient and the distance between the remote control and the large screen, assuming a constant attitude change value for the remote control in each frame.

[0249] like Figure 16 As shown, the curves showing the relationship between the damping coefficient and the attitude change value per frame are presented when d=1; when d=3; and when d=5.

[0250] Depend on Figure 16 It can be seen that when the attitude change value of the current frame is the same, the greater the distance between the remote control and the large screen, the greater the damping coefficient. For example, when the distance between the remote control and the large screen is 1, the remote control undergoes an attitude change, and the corresponding attitude change value of the current frame is 2°, at which point the damping coefficient of the current frame is 0.9. When the distance between the remote control and the large screen changes from 1 to 3, the remote control undergoes the same attitude change, and the corresponding attitude change value of the current frame is 2°, at which point the damping coefficient of the current frame drops to 0.5. When the distance between the remote control and the large screen further changes from 3 to 5, the remote control undergoes the same attitude change, and the corresponding attitude change value of the current frame is 2°, at which point the damping coefficient of the current frame further drops to 0.3.

[0251] In other words, as the distance between the remote control and the large screen changes, the damping effect also adjusts. When the change in posture per unit time is constant, the farther the distance, the more obvious the cursor's jitter filtering effect.

[0252] For example,Figure 17 The position relationship between several large-screen devices and the UWB base station is shown, i.e., the arrangement state diagram of the first antenna array 1700 of the UWB base station on the large-screen device 1710.

[0253] As shown in Figure 17 , the first antenna array 1700 can be arranged at any position on the large-screen device 1710. For example, the first antenna array 1700 can be arranged outside the large-screen device 1710, such as on the upper frame of the large-screen device 1710 (as shown in (a) of Figure 17 , can be arranged at the diagonal position of the large-screen device 1710 (as shown in (b) of Figure 17 and (c) of Figure 17 ), can be arranged at any position of the left frame, right frame, lower frame, etc. of the large-screen device 1710, or can be integrated inside the large-screen device 1710; or can be arranged on an object that maintains a certain distance from the large-screen device 1710. The object can be a separate device, such as a desk, a stand, etc. The large-screen device 1710 and the first antenna array 1700 can be placed on different stands that maintain a certain distance. Of course, the first antenna array 1700 can also be arranged inside the electronic device, and the first antenna array 1700 can also be arranged at any position in the room where the large-screen device 1710 is located. This embodiment is not limited in this regard.

[0254] The first antenna array 1700 includes at least three first antenna units, which can be the first antenna 121, the second antenna 122, and the third antenna 123, respectively. The second antenna 122 is located on one side of the first antenna 121 in the first direction X, and the third antenna 123 is located on one side of the first antenna 121 in the second direction Y.

[0255] The first antenna 121 can implement signal transmission or reception, and the origin of the three-dimensional coordinate system can be defined through the first antenna 121.

[0256] In an embodiment, the first antenna 121 serves as the origin of the three-dimensional coordinate system, the first direction is the x-axis direction of the three-dimensional coordinate system, and the second direction is the y-axis direction of the three-dimensional coordinate system. The second antenna 122 is located on the x-axis, and the third antenna 123 is located on the y-axis, so that the first antenna 121, the second antenna 122, and the third antenna 123 are arranged in an "L" shape. The distance L between the second antenna 122 and the first antenna 121 and the distance L between the third antenna 123 and the first antenna 121 are each less than or equal to the wavelength λ of the first signal. The first signal is a first signal transmitted by a second antenna array arranged on a remote controller and received by the first antenna array 1700.

[0257] For example,Figure 18 The figure shows a schematic layout diagram of several first antenna arrays 1700 provided by the embodiments of the present application.

[0258] Figure 18 (a) of shows a schematic layout diagram of a first antenna array 1700. As Figure 18 shown in (a) of, the number of the first antenna units 120a is three, and the three first antenna units 120a are arranged in an "L" shape.

[0259] Figure 18 (b) of shows another schematic layout diagram of a first antenna array 1700. As Figure 18 shown in (b) of, the number of the first antenna units 120a is four, and the four first antenna units 120a are arranged in a "square" shape.

[0260] Figure 18 (c) of shows another schematic layout diagram of a first antenna array 1700. As Figure 18 shown in (c) of, the number of the first antenna units 120a is three, and the three first antenna units 120a are arranged in a "pin" shape.

[0261] Among various layout forms of at least three first antenna units 120a, there are at least two antennas distributed in the first direction X and the second direction Y respectively, and the first direction X is perpendicular to the second direction Y. Here, the first direction X can be used as the horizontal axis of the three-dimensional coordinate system, the second direction Y can be used as the vertical axis of the three-dimensional coordinate system, and there can be a set geometric relationship between the plane formed by the first direction X and the second direction Y and the display interface of the large screen device 1710, so as to facilitate the calculation of the coordinates of the second antenna array.

[0262] Exemplarily, Figure 19 The figure shows a layout state diagram of a second antenna array provided by the embodiments of the present application on the remote controller 1900.

[0263] :Refer to Figure 19The second antenna array includes at least three second antenna units, which can be the fourth antenna 221, the fifth antenna 222 and the sixth antenna 223. The fifth antenna 222 is located on one side of the fourth antenna 221 in the third direction, and the sixth antenna 223 is located on one side of the fourth antenna 221 in the fourth direction, so that the fourth antenna 221, the fifth antenna 222 and the sixth antenna 223 form an "L" shape. The fourth antenna 221 is a transceiving antenna, and the fifth antenna 222 and the sixth antenna 223 are receiving antennas. The second antenna units in the second antenna array can be used to receive the second signal sent by the first antenna array 1700. By making the distance L' between any two second antenna units less than or equal to the wavelength λ of the second signal, each second antenna unit used to receive the signal can receive the second signal at approximately the same time, and each second antenna unit can obtain a phase parameter from the second signal. The deflection angle can be obtained according to the phase parameter.

[0264] That is, by making the distance between any two first antenna units 120a and the distance between any two second antenna units less than the wavelength of the corresponding received signal, the first coordinate and the deflection angle can be obtained according to the phase parameter of the received signal, so that the positioning of the second antenna array in the three-dimensional space can be realized, and the absolute coordinate of the second antenna array in the size range of the large-screen device 1710 can be obtained, thereby improving the positioning accuracy and the control experience of the remote controller 1900. The first coordinate is the relative coordinate of the second antenna array relative to the first antenna array 1700.

[0265] The first antenna array 1700 and the second antenna array can have the same arrangement, for example, the first antenna array 1700 includes three first antenna units 120a, and the second antenna array includes three second antenna units, and the arrangement of the three first antenna units 120a is the same as that of the three second antenna units. Of course, in some other embodiments, the first antenna array 1700 and the second antenna array can have different arrangements, for example, the first antenna array 1700 includes three first antenna units 120a, and the second antenna array includes two second antenna units, and the arrangement of the three first antenna units 120a is different from that of the two second antenna units.

[0266] When the remote controller 1900 is operated, the remote controller 1900 and the large-screen device 1710 are usually kept at a distance, that is, the first antenna array 1700 and the second antenna array are kept at a distance, so that the second antenna array, the first antenna 121 and the second antenna 122 form a triangle, and the second antenna array, the first antenna 121 and the third antenna 123 also form a triangle, so that the value of the first coordinate (x, y, z) can be calculated according to the related principles of the triangle and the electromagnetic wave.

[0267] The first antenna array 1700 is arranged on the large screen device 1710, and the second antenna array is arranged on the remote controller 1900, the first antenna array 1700 can establish a three-dimensional coordinate system according to the relative position of the first antenna array 1700 on the large screen device 1710, and the first antenna array 1700 and the second antenna array can be positioned with each other, so that the coordinate of the second antenna array is accurately presented on the display interface of the large screen device 1710.

[0268] The attitude angle is determined by the rotation relationship between the carrier coordinate system (the second coordinate system) and the UWB coordinate system (the first coordinate system), and is composed of three Euler angles, namely the azimuth angle ψ, the pitch angle and the roll angle θ, in order to more clearly understand the attitude change value of the remote controller, in the following, the azimuth angle ψ, the pitch angle Figures 20 to 22 and the roll angle θ used to measure the attitude change value of the remote controller are introduced.

[0269] Figure 20 A space coordinate system established with the UWB base station as the coordinate origin is shown, that is, the above-mentioned first coordinate system.

[0270] As shown in (a) of FIG. 1 and (b) of FIG. 1, the UWB base station adopts a three-antenna (antenna 0, antenna 1 and antenna 2) structure, as shown in (a) of FIG. 1, the three-antenna structure is an L-shaped antenna structure, as shown in (b) of FIG. 1, the three-antenna structure is a triangular antenna structure, the UWB base station needs to be installed with the arrow shown in the figure perpendicular to the horizontal plane and pointing upward, and the UWB base station can be installed on the wall or integrated on other smart devices, such as the top of the large screen. Figure 20 Figure 20 As shown in (a) of FIG. 1 and (b) of FIG. 1, the UWB base station adopts a three-antenna (antenna 0, antenna 1 and antenna 2) structure, as shown in (a) of FIG. 1, the three-antenna structure is an L-shaped antenna structure, as shown in (b) of FIG. 1, the three-antenna structure is a triangular antenna structure, the UWB base station needs to be installed with the arrow shown in the figure perpendicular to the horizontal plane and pointing upward, and the UWB base station can be installed on the wall or integrated on other smart devices, such as the top of the large screen. Figure 20 Figure 20 As shown in (a) of FIG. 1 and (b) of FIG. 1, the UWB base station adopts a three-antenna (antenna 0, antenna 1 and antenna 2) structure, as shown in (a) of FIG. 1, the three-antenna structure is an L-shaped antenna structure, as shown in (b) of FIG. 1, the three-antenna structure is a triangular antenna structure, the UWB base station needs to be installed with the arrow shown in the figure perpendicular to the horizontal plane and pointing upward, and the UWB base station can be installed on the wall or integrated on other smart devices, such as the top of the large screen.

[0271] After the UWB base station is installed, the UWB coordinate system (that is, the above-mentioned first coordinate system) can be established, as shown in (a) of FIG. 1, the UWB coordinate system can take the center of the 0th antenna of the base station as the coordinate origin O1, the X1 axis is parallel to the bottom edge of the base station and points to the left, the Y1 axis points to the front of the base station, the Z1 axis is perpendicular to the X1O1Y1 plane and points upward, and the X1 axis and the Y1 axis satisfy the right-hand rule. Figure 20

[0272] As shown in (c) of FIG. 1, it is a schematic diagram of the UWB coordinate system on the UWB base station level. Figure 20

[0273] A space coordinate system established with the center of the remote controller as the coordinate origin is shown, that is, the above-mentioned second coordinate system. Figure 21 ​​​​

[0274] As shown in Figure 21 , the coordinate origin O2 of the second coordinate system is located at the center of the remote controller, the X2 axis is along the right direction of the carrier transverse axis, the Y2 axis is along the forward direction of the carrier longitudinal axis, the Z2 axis is perpendicular to the X2O2Y2 plane and outward, and the coordinate axes comply with the right-hand rule.

[0275] Among them, the remote controller can be replaced by other arbitrary UWB tags, such as mobile phones and the like.

[0276] On the basis of the coordinate system shown in Figure 20 and Figure 21 , Figure 22 a schematic diagram for measuring the azimuth angle ψ, the pitch angle and the roll angle θ of the remote controller is shown.

[0277] Figure 22 (a) in shows a schematic diagram of the azimuth angle ψ and the pitch angle

[0278] As shown in Figure 22 (a), the pitch angle is the angle between the Y2 axis and the X1O1Y1 plane in the first coordinate system, and the carrier head-up is positive; the azimuth angle ψ is the angle between the projection of the Y2 axis on the X1O1Y1 plane and the Y1 axis, and the carrier head-right yaw is positive.

[0279] Figure 22 (b) in shows a schematic diagram of the roll angle θ.

[0280] Figure 22 As shown in (b), the roll angle θ is the angle between the Z2 axis and the vertical plane containing the Y2 axis, and the carrier right tilt is positive.

[0281] In some embodiments, the attitude angle between the first coordinate system and the second coordinate system can also be presented by means of the attitude transfer matrix C, taking the attitude transfer between the second coordinate system and the first coordinate system as an example, denotes the attitude transfer matrix of the second coordinate system to the first coordinate system, can be calculated by the three attitude angles ψ, and θ of the second coordinate system relative to the first coordinate system described above, and the formula is as follows:

[0282]

[0283] It should be noted that the superscript "2" in the above formula (4) refers to the second coordinate system, not the square operation.

[0284] Exemplarily, Figure 23 a functional module schematic diagram of a cursor control system 2000 provided by the embodiments of the present application is shown.

[0285] like Figure 23 As shown, the system 2000 includes a UWB base station 2100, a pointing device 2200, and a large screen 2300. The UWB base station 2100 includes a first UWB module 2110; the pointing device 2200 includes a position and attitude estimation module 2210 and a cursor coordinate determination module 2220. The position and attitude estimation module 2210 includes a second UWB module 2211 and a sensor module 2212. The cursor coordinate determination module 2220 includes a projection calculation module 2221 and an adaptive jitter filtering module 2222; the large screen 2300 includes a drawing module 2310 and a display module 2320. Specifically:

[0286] The first UWB module 2110 is used to determine the first coordinate in real time after the UWB base station 2100 establishes the first coordinate system. The first coordinate system is a spatial coordinate system established with the UWB base station 2100 as the origin. The first coordinate is the coordinate of the pointing device 2200 in the first coordinate system.

[0287] In some embodiments, the UWB base station 2100 may be deployed on a wall, on a large screen, or in other locations in a room.

[0288] The first UWB module 2110 is also used to send the first coordinates determined in real time to the pointing device 2200.

[0289] The position and attitude estimation module 2210 is used to estimate the position and attitude of the pointing device 2200 in real time after the second coordinate system is established on the pointing device 2200. The second coordinate system is a spatial coordinate system with the center of the pointing device 2200 as the origin.

[0290] Specifically, the second UWB module 2211 is used to receive the first coordinates sent in real time by the first UWB module 2110; the sensor module 2212 is used to determine the attitude change of the pointing device 2200 in real time; and the position and attitude estimation module 2210 is specifically used to estimate the position and attitude of the pointing device 2200 in real time based on the first coordinates and the attitude change of the pointing device 2200.

[0291] The estimated position and attitude information of the pointing device 2200 includes the position of the pointing device 2200 from the large screen, the pointing position of the pointing device 2200 on the large screen, and the attitude angle of the pointing device 2200 relative to the first coordinate system (i.e., the attitude angle is determined by the rotation relationship between the second coordinate system and the first coordinate system). The attitude angle is composed of the azimuth angle ψ and the pitch angle ψ. The three Euler angles, including the roll angle θ, are used to determine the azimuth angle ψ and the pitch angle θ. The roll angle θ has already been mentioned above. Figures 20 to 22The embodiments shown are described in detail, and for the sake of brevity, they will not be repeated here.

[0292] Specifically, based on the attitude angle of the pointing device 2200 relative to the first coordinate system in the previous frame and the attitude angle of the pointing device 2200 relative to the first coordinate system in the current frame, the change value of the attitude angle in the current frame can be determined. That is, the change value Δψ of the azimuth angle ψ and the pitch angle in the current frame can be obtained. Change value And the change in roll angle θ, Δθ.

[0293] In some embodiments, the sensor module 2212 includes a gyroscope sensor and an accelerometer sensor. The gyroscope sensor can calculate the attitude change value of the remote controller in real time, and fuse the attitude change value with the attitude of the pointing device 2200 measured by the UWB base station 2100 to obtain a more accurate attitude of the pointing device 2200. The accelerometer sensor can obtain the position change value of the pointing device 2200 through double integration. Fusing the position change value of the pointing device 2200 with the positioning measurement value of the pointing device 2200 by the UWB base station 2100 can obtain a more accurate position of the pointing device 2200. Therefore, Kalman filtering and other methods can be used to fuse the measurement results of the UWB base station 2100 and the sensor module 2212 to obtain the accurate attitude and position of the remote controller in the first coordinate system.

[0294] The projection calculation module 2221 is used to determine the x and y variables corresponding to the current frame.

[0295] Wherein, the x variable is the change in the pointing coordinates of the current frame relative to the pointing coordinates of the previous frame in the X-axis direction, the y variable is the change in the pointing coordinates of the current frame relative to the pointing coordinates of the previous frame in the Y-axis direction, and the pointing coordinates refer to the coordinates of the intersection point between the direction pointed to by the pointing device 2200 and the large screen 2300.

[0296] In one example, in the previous frame, the coordinates of the pointer 2200 pointing to the large screen 2300 are (x1, y1), and in the current frame, the coordinates of the pointer 2200 pointing to the large screen 2300 are (x2, y2). Therefore, the x variable corresponding to the current frame is x2-x1, and the y variable corresponding to the current frame is y2-y1.

[0297] Specifically, based on the pointing position of the pointing device 2200 on the large screen 2300 corresponding to the previous frame and the pointing position of the pointing device 2200 on the large screen 2300 corresponding to the current frame, the x and y variables corresponding to the current frame are determined.

[0298] The adaptive filter module 2222 is configured to adjust the change amount of the cursor in the X-axis direction according to the change value of the azimuth angle of the posture of the pointing device 2200, Δψ, and the distance d between the pointing device 2200 and the large screen 2300; and adjust the change amount of the cursor in the Y-axis direction according to the change value of the pitch angle of the posture of the pointing device 2200, Δθ, and the distance d between the pointing device 2200 and the large screen 2300.

[0299] In some embodiments, the adaptive filter module 2222 determines a first damping coefficient according to the change value of the azimuth angle of the posture of the pointing device 2200, Δψ, and the distance d between the pointing device 2200 and the large screen 2300; determines a second damping coefficient according to the change value of the pitch angle of the posture of the pointing device 2200, Δθ, and the distance d between the pointing device 2200 and the large screen 2300; adjusts the change amount Δx of the cursor in the X-axis direction (i.e., the change amount of the horizontal coordinate) according to the first damping coefficient; and adjusts the change amount Δy of the cursor in the Y-axis direction (i.e., the change amount of the vertical coordinate) according to the second damping coefficient. r r

[0300] In some embodiments, the adaptive filter module 2222 adjusts the change amount of the cursor in the X-axis direction and the change amount of the cursor in the Y-axis direction according to the following formulas:

[0301] Δx d = B(Δψ, d) * Δx r

[0302]

[0303] wherein Δx d represents the change amount of the adjusted cursor in the X-axis direction corresponding to the current frame, B(Δψ, d) represents a calculation function of the first damping coefficient, d represents the distance between the remote controller and the large screen corresponding to the current frame, Δx r represents the x variable corresponding to the current frame; Δy d represents the change amount of the adjusted cursor in the Y-axis direction corresponding to the current frame, represents a calculation function of the second damping coefficient, d represents the distance between the remote controller and the large screen corresponding to the current frame, Δy r represents the y variable corresponding to the current frame.

[0304] The adaptive filter module 2222 is further configured to calculate the cursor coordinate of the current frame according to the change amount of the adjusted cursor in the X-axis direction, the change amount of the adjusted cursor in the Y-axis direction, and the cursor coordinate of the previous frame.

[0305] ​​​​​Specifically, the adaptive dithering module 2222 calculates the horizontal coordinate of the cursor coordinate of the current frame according to the adjusted change amount of the cursor in the X-axis direction and the horizontal coordinate of the cursor coordinate of the previous frame, and calculates the vertical coordinate of the cursor coordinate of the current frame according to the adjusted change amount of the cursor in the Y-axis direction and the vertical coordinate of the cursor coordinate of the previous frame.

[0306] The second UWB module 2211 is further configured to send the calculated cursor coordinate of the current frame to the large screen 2300.

[0307] The drawing module 2310 is configured to draw the cursor of the current frame according to the cursor coordinate of the current frame.

[0308] The display module 2320 is configured to display the cursor of the current frame on the screen of the large screen 2300.

[0309] In the embodiments of the present application, the pointing remote controller can be used to perceive the spatial relationship between the remote controller and the large screen in real time, and the sensitivity of the cursor can be adaptively adjusted according to the measured position information of the remote controller relative to the large screen, so that the dithering effect of the cursor can be adaptively adjusted according to the distance between the remote controller and the large screen and / or the control state of the remote controller, and the user can obtain the experience of no dithering for small cursor movement and no delay for large cursor movement at any position using the remote controller.

[0310] One or more of the modules or units described herein can be implemented in software, hardware, or a combination of both. When any of the above modules or units is implemented in software, the software exists in the form of computer program instructions, and is stored in a memory, and a processor can be used to execute the program instructions and implement the above method flow. The processor can include, but is not limited to, at least one of the following: a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a microcontroller unit (MCU), or an artificial intelligence processor, and the like. Each of the computing devices running software can include one or more cores for executing software instructions to perform operations or processing. The processor can be built-in in a SoC (system on chip) or an application specific integrated circuit (ASIC), or can be a separate semiconductor chip. In addition to the core for executing software instructions to perform operations or processing, the processor can further include necessary hardware accelerators, such as a field programmable gate array (FPGA), a PLD (programmable logic device), or a logic circuit for implementing special logic operations.

[0311] When the modules or units described herein are implemented in hardware, the hardware can be any one or a combination of CPUs, microprocessors, DSPs, MCUs, artificial intelligence processors, ASICs, SoCs, FPGAs, PLDs, special-purpose digital circuits, hardware accelerators, or non-integrated discrete devices, which can run necessary software or be independent of software to perform the above method flows.

[0312] When the modules or units described herein are implemented in software, they can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the flow or function described in the embodiments of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. integrated with one or more available media. The available media can be magnetic media (for example, floppy disk, hard disk, magnetic tape), optical media (for example, DVD), or semiconductor media (for example, solid state disk (SSD)) and the like.

[0313] Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0314] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, which will not be described here.

[0315] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other manners. For example, the described device embodiments are merely schematic. The division of the units is merely logical function division. There can be other division manners in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections can be indirect couplings or communication connections through some interfaces, devices or units, and can be in electrical, mechanical or other forms.

[0316] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e., can be located in one place, or can be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0317] In addition, each functional unit in the various embodiments of the present application can be integrated into a processing unit, or each unit can be a physically independent unit, or two or more units can be integrated into one unit.

[0318] If the functions are realized in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application can be embodied in the form of a software product, and the computer software product is stored in a storage medium, and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various program code storage media.

[0319] The above is merely specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A method for cursor control, characterized in that, The method includes: When the distance between the first pointing device and the first display screen is a first distance, the pointing position is moved by a first magnitude through the first pointing device, so that the cursor moves by a second magnitude synchronously on the first display screen. The first magnitude is greater than the second magnitude, and the pointing position is the position on the first display screen that the first pointing device is pointing to. When the distance between the first pointing device and the first display screen is switched to the second distance, the pointing position is moved by a third amplitude through the first pointing device so that the cursor moves synchronously on the first display screen by the second amplitude, wherein the third amplitude is greater than the first amplitude and the second distance is greater than the first distance.

2. The method according to claim 1, characterized in that, The method further includes: When the pointing position moves on the first display screen, a damping coefficient is determined based on the distance between the first pointing device and the first display screen. The damping coefficient is negatively correlated with the distance between the first pointing device and the first display screen. The cursor's display position is adjusted according to the damping coefficient.

3. The method according to claim 2, characterized in that, Determining the damping coefficient based on the distance between the first pointing device and the first display screen includes: The damping coefficient corresponding to the i-th frame is determined based on the distance corresponding to the i-th frame, where the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, and i is a natural number, i = 1, 2, 3...; The step of adjusting the display position of the cursor according to the damping coefficient includes: Determine the x variable and y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is the change of the x-coordinate of the pointing position corresponding to the i-th frame relative to the x-coordinate of the pointing position corresponding to the (i-1)-th frame, and the y variable corresponding to the i-th frame is the change of the y-coordinate of the pointing position corresponding to the i-th frame relative to the y-coordinate of the pointing position corresponding to the (i-1)-th frame. The cursor coordinates corresponding to the i-th frame are determined based on the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the (i-1)-th frame, the x-variable corresponding to the i-th frame, and the y-variable corresponding to the i-th frame. The cursor coordinates corresponding to the i-th frame are used to display the cursor corresponding to the i-th frame on the first display screen.

4. The method according to claim 3, characterized in that, The step of determining the cursor coordinates corresponding to the i-th frame based on the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the (i-1)-th frame, the x-variable corresponding to the i-th frame, and the y-variable corresponding to the i-th frame includes: The sum of the first product and the x-coordinate of the cursor coordinate corresponding to the (i-1)th frame is determined as the x-coordinate of the cursor coordinate corresponding to the i-th frame. The first product is the product of the damping coefficient corresponding to the i-th frame and the x-variable corresponding to the i-th frame. The sum of the second product and the ordinate of the cursor coordinate corresponding to the (i-1)th frame is determined as the ordinate of the cursor coordinate corresponding to the i-th frame. The second product is the product of the damping coefficient corresponding to the i-th frame and the y-variable corresponding to the i-th frame.

5. The method according to any one of claims 2 to 4, characterized in that, Determining the damping coefficient based on the distance between the first pointing device and the first display screen includes: The damping coefficient is determined based on the distance between the first pointing device and the first display screen, and the attitude change value of the first pointing device. The damping coefficient is positively correlated with the attitude change value of the first pointing device.

6. The method according to claim 5, characterized in that, The step of determining the damping coefficient based on the distance between the first pointing device and the first display screen, and the attitude change value of the first pointing device, includes: The first damping coefficient corresponding to the i-th frame is determined based on the distance corresponding to the i-th frame and the first attitude change value corresponding to the i-th frame. The second damping coefficient corresponding to the i-th frame is determined based on the distance corresponding to the i-th frame and the second attitude change value corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, i is a natural number, i = 1, 2, 3...; The step of adjusting the display position of the cursor according to the damping coefficient includes: Determine the x variable and y variable corresponding to the i-th frame, where the x variable corresponding to the i-th frame is the change of the x-coordinate of the pointing position corresponding to the i-th frame relative to the x-coordinate of the pointing position corresponding to the (i-1)-th frame, and the y variable corresponding to the i-th frame is the change of the y-coordinate of the pointing position corresponding to the i-th frame relative to the y-coordinate of the pointing position corresponding to the (i-1)-th frame. The cursor coordinates corresponding to the i-th frame are determined based on the first damping coefficient corresponding to the i-th frame, the second damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the (i-1)-th frame, the x-variable corresponding to the i-th frame, and the y-variable corresponding to the i-th frame. The cursor coordinates corresponding to the i-th frame are used to display the cursor corresponding to the i-th frame on the first display screen.

7. The method according to claim 6, characterized in that, The step of determining the cursor coordinates corresponding to the i-th frame based on the first damping coefficient corresponding to the i-th frame, the second damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the (i-1)-th frame, the x-variable corresponding to the i-th frame, and the y-variable corresponding to the i-th frame includes: The sum of the third product and the x-coordinate of the cursor coordinate corresponding to the (i-1)th frame is determined as the x-coordinate of the cursor coordinate corresponding to the i-th frame. The third product is the product of the first damping coefficient corresponding to the i-th frame and the x-variable corresponding to the i-th frame. The sum of the fourth product and the ordinate of the cursor coordinate corresponding to the (i-1)th frame is determined as the ordinate of the cursor coordinate corresponding to the i-th frame. The fourth product is the product of the second damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

8. The method according to claim 6 or 7, characterized in that, The first attitude change value corresponding to the i-th frame includes the change value of the azimuth angle of the first pointing device relative to the attitude corresponding to the (i-1)-th frame, and the second attitude change value corresponding to the i-th frame includes the change value of the pitch angle of the first pointing device relative to the attitude corresponding to the (i-1)-th frame.

9. The method according to any one of claims 2 to 8, characterized in that, The method further includes: When the pointing position moves on the first display screen, the position and attitude of the first pointing device are determined in real time. The position of the first pointing device is used to obtain the distance between the first pointing device and the first display screen, and the attitude of the first pointing device is used to obtain the attitude change value of the first pointing device.

10. The method according to any one of claims 2 to 9, characterized in that, The damping coefficient is greater than 0, and the damping coefficient is less than or equal to 1.

11. The method according to any one of claims 1 to 10, characterized in that, The first pointed device is a remote control.

12. A method for cursor control, characterized in that, The method includes: When the distance between the first pointing device and the first display screen is a first distance, in response to the first pointing device controlling the pointing position to move by a first magnitude, the cursor synchronously moves by a second magnitude on the first display screen, wherein the first magnitude is greater than the second magnitude, and the pointing position is the position on the first display screen that the first pointing device is pointing to; When the distance between the first pointing device and the first display screen is switched to a second distance, in response to the first pointing device controlling the pointing position to move by a third magnitude, the cursor synchronously moves by the second magnitude on the first display screen, wherein the third magnitude is greater than the first magnitude and the second distance is greater than the first distance.

13. A cursor control system, characterized in that, The system includes a first pointing device and a first display screen. The first pointing device is used for: When the distance between the first pointing device and the first display screen is a first distance, the pointing position is controlled to move by a first magnitude, wherein the pointing position is the position in the first display screen that the first pointing device is pointing to; The first display screen is used for: In response to the first movement of the pointed position, the cursor is controlled to move synchronously on the first display screen by a second movement, wherein the first movement is greater than the second movement; The first pointing device is further configured to: control the pointing position to move by a third magnitude when the distance between the first pointing device and the first display screen is a second distance; The first display screen is also used for: In response to the pointing position moving by a third amplitude, the cursor is controlled to move synchronously on the first display screen by a second amplitude, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance.

14. The system according to claim 13, characterized in that, The first pointing device is specifically used for: When the pointing position moves on the first display screen, a damping coefficient is determined based on the distance between the first pointing device and the first display screen. The damping coefficient is negatively correlated with the distance between the first pointing device and the first display screen. The cursor's display position is adjusted according to the damping coefficient.

15. The system according to claim 14, characterized in that, The first pointing device is specifically used for: The damping coefficient corresponding to the i-th frame is determined based on the distance corresponding to the i-th frame, where the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, and i is a natural number, i = 1, 2, 3...; Determine the x variable and y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is the change of the x-coordinate of the pointing position corresponding to the i-th frame relative to the x-coordinate of the pointing position corresponding to the (i-1)-th frame, and the y variable corresponding to the i-th frame is the change of the y-coordinate of the pointing position corresponding to the i-th frame relative to the y-coordinate of the pointing position corresponding to the (i-1)-th frame. The cursor coordinates corresponding to the i-th frame are determined based on the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the (i-1)-th frame, the x-variable corresponding to the i-th frame, and the y-variable corresponding to the i-th frame. The first display screen is specifically used for: The cursor corresponding to the i-th frame is displayed on the first display screen according to the cursor coordinates of the i-th frame.

16. The system according to claim 15, characterized in that, The first pointing device is specifically used for: The sum of the first product and the x-coordinate of the cursor coordinate corresponding to the (i-1)th frame is determined as the x-coordinate of the cursor coordinate corresponding to the i-th frame. The first product is the product of the damping coefficient corresponding to the i-th frame and the x-variable corresponding to the i-th frame. The sum of the second product and the ordinate of the cursor coordinate corresponding to the (i-1)th frame is determined as the ordinate of the cursor coordinate corresponding to the i-th frame. The second product is the product of the damping coefficient corresponding to the i-th frame and the y-variable corresponding to the i-th frame.

17. The system according to any one of claims 14 to 16, characterized in that, The first pointing device is specifically used for: The damping coefficient is determined based on the distance between the first pointing device and the first display screen, and the attitude change value of the first pointing device. The damping coefficient is positively correlated with the attitude change value of the first pointing device.

18. The system according to claim 17, characterized in that, The first pointing device is specifically used for: The first damping coefficient corresponding to the i-th frame is determined based on the distance corresponding to the i-th frame and the first attitude change value corresponding to the i-th frame. The second damping coefficient corresponding to the i-th frame is determined based on the distance corresponding to the i-th frame and the second attitude change value corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, i is a natural number, i = 1, 2, 3...; Determine the x variable and y variable corresponding to the i-th frame, where the x variable corresponding to the i-th frame is the change of the x-coordinate of the pointing position corresponding to the i-th frame relative to the x-coordinate of the pointing position corresponding to the (i-1)-th frame, and the y variable corresponding to the i-th frame is the change of the y-coordinate of the pointing position corresponding to the i-th frame relative to the y-coordinate of the pointing position corresponding to the (i-1)-th frame. The cursor coordinates corresponding to the i-th frame are determined based on the first damping coefficient corresponding to the i-th frame, the second damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the (i-1)-th frame, the x-variable corresponding to the i-th frame, and the y-variable corresponding to the i-th frame. The first display screen is specifically used for: The cursor corresponding to the i-th frame is displayed on the first display screen according to the cursor coordinates of the i-th frame.

19. The system according to claim 18, characterized in that, The first pointing device is specifically used for: The sum of the third product and the x-coordinate of the cursor coordinate corresponding to the (i-1)th frame is determined as the x-coordinate of the cursor coordinate corresponding to the i-th frame. The third product is the product of the first damping coefficient corresponding to the i-th frame and the x-variable corresponding to the i-th frame. The sum of the fourth product and the ordinate of the cursor coordinate corresponding to the (i-1)th frame is determined as the ordinate of the cursor coordinate corresponding to the i-th frame. The fourth product is the product of the second damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

20. The system according to claim 18 or 19, characterized in that, The first attitude change value corresponding to the i-th frame includes the change value of the azimuth angle of the first pointing device relative to the attitude corresponding to the (i-1)-th frame, and the second attitude change value corresponding to the i-th frame includes the change value of the pitch angle of the first pointing device relative to the attitude corresponding to the (i-1)-th frame.

21. The system according to any one of claims 14 to 20, characterized in that, The first pointing device is specifically used for: When the pointing position moves on the first display screen, the position and attitude of the first pointing device are determined in real time. The position of the first pointing device is used to obtain the distance between the first pointing device and the first display screen, and the attitude of the first pointing device is used to obtain the attitude change value of the first pointing device.

22. The system according to any one of claims 14 to 21, characterized in that, The damping coefficient is greater than 0, and the damping coefficient is less than or equal to 1.

23. The system according to any one of claims 13 to 22, characterized in that, The first pointing device is a remote control, and the first display screen is a large screen.

24. An electronic device, characterized in that, include: One or more processors; One or more memory units; And one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, the one or more computer programs including instructions that, when executed by the one or more processors, cause the electronic device to perform the method as claimed in any one of claims 1 to 11, or to perform the method as claimed in claim 12.

25. A computer-readable storage medium, characterized in that, The storage medium stores a program or instructions that, when executed, implement the method as described in any one of claims 1 to 11, or implement the method as described in claim 12.

26. A chip, characterized in that, The chip stores instructions that, when executed, implement the method as described in any one of claims 1 to 11, or implement the method as described in claim 12.

27. A computer program product, characterized in that, The computer program product stores a program or instructions that, when executed, implement the method as described in any one of claims 1 to 11, or implement the method as described in claim 12.

Images