Cursor control method, electronic device, and system

Abstract

The present application provides a cursor control method, comprising: when the distance between a first pointing device and a first display screen is a first distance, in response to the first pointing device controlling a pointed position to move by a first amplitude, a cursor synchronously moves on the first display screen by a second amplitude, wherein the first amplitude is greater than the second amplitude, and the pointed position is a position in the first display screen pointed by the first pointing device; and when the distance between the first pointing device and the first display screen is changed to a second distance, in response to the first pointing device controlling the pointed position to move by a third amplitude, the cursor synchronously moves on the first display screen by the second amplitude, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance. The method can adaptively adjust the jitter filtering effect of the cursor on the basis of the distance between the pointing device and the display screen, thereby improving user experience.

Description

Cursor control method, electronic device and system

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on March 28, 2024, with application number 202410377404.6 and application name “Cursor Control Method, Electronic Device and System”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of cursor control, and more particularly, to a cursor control method, electronic device, and system. Background Art

[0003] A pointing remote control achieves a remote control effect by controlling the movement of a cursor on the large screen, enhancing the user's interactive experience with the large screen. For example, users can use a pointing remote control to play shooting games or fruit-cutting games on the large screen. When using a pointing remote control, the cursor's sensitivity increases with distance. That is, if the pointing remote control's posture remains the same, the farther away from the large screen, the greater the cursor's range of movement.

[0004] Therefore, when the user is using a large screen at a distance, a small range of hand shaking will cause the cursor to move over a large range. When the target control area of ​​the cursor is small, it is difficult to control the cursor to move accurately to the target control. This also makes it impossible for the user to use the pointing remote control to smoothly control the cursor to perform fine operations in a small range, such as drawing, document marking, etc., which seriously affects the user experience. Summary of the Invention

[0005] The present application provides a cursor control method, electronic device, and system. Through this method, electronic device, and system, the cursor jitter filtering effect can be adaptively adjusted according to the distance between the pointing device and the display screen, thereby improving the user experience.

[0006] In a first aspect, a method for controlling a cursor is provided, the method comprising: when the distance between a first pointing device and a first display screen is a first distance, controlling the pointing position to move by a first amplitude via the first pointing device so that the cursor synchronously moves on the first display screen by a second amplitude, wherein the first amplitude is greater than the second amplitude, and the pointing position is the position on the first display screen pointed to by the first pointing device; when the distance between the first pointing device and the first display screen switches to a second distance, controlling the pointing position to move by a third amplitude via the first pointing device so that the cursor synchronously moves on the first display screen by a second amplitude, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance. The pointing position of the first pointing device includes the position on the first display screen that the first pointing device intends to point to. The first amplitude can be the amplitude that a user moves along the display screen using the first pointing device.

[0007] In some embodiments, the first pointing device is a remote control, and may also be a mobile phone with a pointing function, or other devices with a pointing function, which is not limited in this application.

[0008] In some embodiments, the first distance may be a first distance range, and the second distance may be a second distance range, wherein a minimum distance value in the second distance range is greater than a maximum distance value in the first distance range.

[0009] In some embodiments, the first amplitude, the second amplitude, and the third amplitude may be distance amplitudes or angle amplitudes at the same time.

[0010] The pointing position may also be described as the intersection position of the direction pointed by the first pointing device and the first display screen.

[0011] In an embodiment of the present application, the pointing device's ability to perceive space can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the sensitivity of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen, thereby achieving the adaptive adjustment of the cursor's jitter filtering effect according to the distance between the pointing device and the large screen.

[0012] In combination with the first aspect, in a possible implementation, the method also includes: when the pointing position moves on the first display screen, determining a damping coefficient based on the distance between the first pointing device and the first display screen, and the damping coefficient is negatively correlated with the distance between the first pointing device and the first display screen; and adjusting the display position of the cursor based on the damping coefficient.

[0013] In some embodiments, the damping coefficient is greater than 0 and the damping coefficient is less than or equal to 1.

[0014] In the embodiment of the present application, the spatial perception ability of the pointing device can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen, thereby achieving adjustment of the cursor sensitivity, and thus achieving adaptive adjustment of the cursor jitter filtering effect with the distance between the pointing device and the large screen, so that the user can get the experience of smooth cursor movement using the remote control at any position.

[0015] In combination with the first aspect, in a possible implementation, determining a damping coefficient based on the distance between the first pointing device and the first display screen includes: determining the damping coefficient corresponding to the i-th frame based on the distance corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, and i is a natural number, i=1, 2, 3...; adjusting the display position of the cursor based on the damping coefficient includes: determining an x ​​variable corresponding to the i-th frame and a y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is a change in the horizontal coordinate of the pointing position corresponding to the i-th frame relative to the horizontal coordinate of the pointing position corresponding to the i-1-th frame, and the y variable corresponding to the i-th frame is a change in the vertical coordinate of the pointing position corresponding to the i-th frame relative to the vertical coordinate of the pointing position corresponding to the i-1-th frame; determining the cursor coordinates corresponding to the i-th frame based on the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame, wherein the cursor coordinates corresponding to the i-th frame are used to display the cursor corresponding to the i-th frame on the first display screen.

[0016] In some embodiments, the cursor coordinates corresponding to the i-th frame are determined based on the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame, including: determining the abscissa of the cursor coordinates corresponding to the i-th frame by the sum of a first product and the abscissa of the cursor coordinates corresponding to the i-1-th frame, the first product being the product of the damping coefficient corresponding to the i-th frame and the x variable corresponding to the i-th frame; and determining the ordinate of the cursor coordinates corresponding to the i-th frame by the sum of a second product and the ordinate of the cursor coordinates corresponding to the i-1-th frame, the second product being the product of the damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

[0017] In an embodiment of the present application, the pointing device's ability to perceive space can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen. The position of the cursor display can be adjusted according to the adjusted damping coefficient, thereby achieving the adaptive adjustment of the cursor jitter effect with the distance between the pointing device and the large screen, so that the user can get the experience of smooth cursor movement when using the remote control at any position.

[0018] In combination with the first aspect, in a possible implementation method, the damping coefficient is determined based on the distance between the first pointing device and the first display screen, including: determining the damping coefficient based on the distance between the first pointing device and the first display screen, and the posture change value of the first pointing device, and the damping coefficient is positively correlated with the posture change value of the first pointing device.

[0019] In the embodiment of the present application, the pointing device's ability to perceive space can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen and the change in the posture of the pointing device, thereby achieving adjustment of the cursor sensitivity, and thus the cursor's jitter filtering effect can be adaptively adjusted as the distance between the pointing device and the large screen and the change in the posture of the pointing device change, so that the user can use the remote control in any position to obtain the experience of small cursor movements without jitter and large movements without delay. Since the user generally moves to the vicinity of the control at high speed when making refined pointing selections, and then makes slow adjustments to accurately select the control, this method can be well applied to scenarios where users perform refined operations on the large screen.

[0020] In combination with the first aspect, in a possible implementation, a damping coefficient is determined based on the distance between the first pointing device and the first display screen, and a posture change value of the first pointing device, including: determining a first damping coefficient corresponding to the i-th frame based on the distance corresponding to the i-th frame and the first posture change value corresponding to the i-th frame; determining a second damping coefficient corresponding to the i-th frame based on the distance corresponding to the i-th frame and the second posture change value corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, i is a natural number, i=1,2,3...; adjusting the display position of the cursor based on the damping coefficient includes: determining the i-th frame; an x variable corresponding to the i-th frame and a y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is a change in the horizontal coordinate of the pointing position corresponding to the i-th frame relative to the horizontal coordinate of the pointing position corresponding to the i-1-th frame, and the y variable corresponding to the i-th frame is a change in the vertical coordinate of the pointing position corresponding to the i-th frame relative to the vertical coordinate of the pointing position corresponding to the i-1-th frame; the cursor coordinates corresponding to the i-th frame are determined according to the first damping coefficient corresponding to the i-th frame, the second damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame, and the cursor coordinates corresponding to the i-th frame are used to display the cursor corresponding to the i-th frame on the first display screen.

[0021] In some embodiments, the first posture change value corresponding to the i-th frame includes the change value of the azimuth angle of the first pointing device relative to the posture corresponding to the i-1-th frame, and the second posture change value corresponding to the i-th frame includes the change value of the pitch angle of the first pointing device relative to the posture corresponding to the i-1-th frame.

[0022] In some embodiments, the cursor coordinates corresponding to the i-th frame are determined based on the first damping coefficient corresponding to the i-th frame, the second damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame, including: determining the abscissa of the cursor coordinates corresponding to the i-th frame by the sum of a third product and the abscissa of the cursor coordinates corresponding to the i-1-th frame, the third product being the product of the first damping coefficient corresponding to the i-th frame and the x variable corresponding to the i-th frame; and determining the ordinate of the cursor coordinates corresponding to the i-th frame by the sum of a fourth product and the ordinate of the cursor coordinates corresponding to the i-1-th frame, the fourth product being the product of the second damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

[0023] In an embodiment of the present application, the pointing device's ability to perceive space can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen and the change in the posture of the pointing device. The position of the cursor display can be adjusted according to the adjusted damping coefficient, thereby achieving the adaptive adjustment of the cursor's jitter filtering effect as the distance between the pointing device and the large screen and the change in the posture of the pointing device, so that the user can use the remote control at any position to obtain the experience of small cursor movements without jitter and large cursor movements without delay. Since the user generally moves to the vicinity of the control at high speed when making refined pointing selections, and then makes slow adjustments to accurately select the control, this method can be well applied to scenarios where users perform refined operations on the large screen.

[0024] In combination with the first aspect, in a possible implementation, the method also includes: when the pointing position moves on the first display screen, determining the position and posture of the first pointing device in real time, the position of the first pointing device is used to obtain the distance between the first pointing device and the first display screen, and the posture of the first pointing device is used to obtain the posture change value of the first pointing device.

[0025] In a second aspect, a method for cursor control is provided, the method comprising: when the distance between a first pointing device and a first display screen is a first distance, in response to controlling the pointing position to move by a first amplitude through the first pointing device, the cursor synchronously moves by a second amplitude on the first display screen, wherein the first amplitude is greater than the second amplitude, and the pointing position is the position in the first display screen pointed to by the first pointing device; when the distance between the first pointing device and the first display screen switches to a second distance, in response to controlling the pointing position to move by a third amplitude through the first pointing device, the cursor synchronously moves by a second amplitude on the first display screen, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance.

[0026] In some embodiments, the first display screen is a display screen of a large-screen device.

[0027] In some embodiments, the first amplitude, the second amplitude, and the third amplitude may be distance amplitudes or angle amplitudes at the same time.

[0028] The pointing position may also be described as the intersection position of the direction pointed by the first pointing device and the first display screen.

[0029] In an embodiment of the present application, the pointing device's ability to perceive space can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the sensitivity of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen, thereby achieving the adaptive adjustment of the cursor's jitter filtering effect according to the distance between the pointing device and the large screen.

[0030] In a third aspect, a cursor control system is provided, which includes a first pointing device and a first display screen, wherein the first pointing device is used to: when the distance between the first pointing device and the first display screen is a first distance, control the pointing position to move a first amplitude, and the pointing position is the position in the first display screen pointed to by the first pointing device; the first display screen is used to: in response to the pointing position moving the first amplitude, control the cursor to move a second amplitude on the first display screen synchronously, wherein the first amplitude is greater than the second amplitude; the first pointing device is also used to: when the distance between the first pointing device and the first display screen is a second distance, control the pointing position to move a third amplitude on the first display screen; the first display screen is also used to: in response to the pointing position moving within a third display range of the first display screen, control the cursor to move a second amplitude on the first display screen synchronously, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance.

[0031] In some embodiments, the first pointing device is a remote control, and may also be a mobile phone with a pointing function, or other devices with a pointing function, which is not limited in this application.

[0032] In some embodiments, the first display screen is a display screen of a large-screen device.

[0033] In some embodiments, the first amplitude, the second amplitude, and the third amplitude may be distance amplitudes or angle amplitudes at the same time.

[0034] The pointing position may also be described as the intersection position of the direction pointed by the first pointing device and the first display screen.

[0035] In an embodiment of the present application, the pointing device's ability to perceive space can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the sensitivity of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen, thereby achieving the adaptive adjustment of the cursor's jitter filtering effect according to the distance between the pointing device and the large screen.

[0036] In combination with the third aspect, in one possible implementation, the first pointing device is specifically used to: when the pointing position moves on the first display screen, determine a damping coefficient based on the distance between the first pointing device and the first display screen, and the damping coefficient is negatively correlated with the distance between the first pointing device and the first display screen; and adjust the display position of the cursor based on the damping coefficient.

[0037] In some embodiments, the damping coefficient is greater than 0 and the damping coefficient is less than or equal to 1.

[0038] In the embodiment of the present application, the spatial perception ability of the pointing device can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen, thereby achieving adjustment of the cursor sensitivity, and thus achieving adaptive adjustment of the cursor jitter filtering effect with the distance between the pointing device and the large screen, so that the user can get the experience of smooth cursor movement using the remote control at any position.

[0039] In combination with the third aspect, in a possible implementation method, the first pointing device is specifically used to: determine the damping coefficient corresponding to the i-th frame based on the distance corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device corresponding to the i-th frame and the first display screen, and i is a natural number, i=1, 2, 3...; determine the x variable corresponding to the i-th frame and the y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is the change in the horizontal coordinate of the pointing position corresponding to the i-th frame relative to the horizontal coordinate of the pointing position corresponding to the i-1-th frame, and the y variable corresponding to the i-th frame is the change in the vertical coordinate of the pointing position corresponding to the i-th frame relative to the vertical coordinate of the pointing position corresponding to the i-1-th frame; determine the cursor coordinates corresponding to the i-th frame based on the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame; the first display screen is specifically used to: display the cursor corresponding to the i-th frame on the first display screen based on the cursor coordinates corresponding to the i-th frame.

[0040] In some embodiments, the first pointing device is specifically used to: determine the sum of a first product and the horizontal coordinate of the cursor coordinate corresponding to the i-1th frame as the horizontal coordinate of the cursor coordinate corresponding to the i-th frame, and the first product is the product of the damping coefficient corresponding to the i-th frame and the x variable corresponding to the i-th frame; determine the sum of a second product and the vertical coordinate of the cursor coordinate corresponding to the i-1th frame as the vertical coordinate of the cursor coordinate corresponding to the i-th frame, and the second product is the product of the damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

[0041] In an embodiment of the present application, the pointing device's ability to perceive space can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen. The position of the cursor display can be adjusted according to the adjusted damping coefficient, thereby achieving the adaptive adjustment of the cursor jitter effect with the distance between the pointing device and the large screen, so that the user can get the experience of smooth cursor movement when using the remote control at any position.

[0042] In combination with the third aspect, in a possible implementation, the first pointing device is specifically used to: determine a damping coefficient based on the distance between the first pointing device and the first display screen, and a posture change value of the first pointing device, and the damping coefficient is positively correlated with the posture change value of the first pointing device.

[0043] In the embodiment of the present application, the pointing device's ability to perceive space can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen and the change in the posture of the pointing device, thereby achieving adjustment of the cursor sensitivity, and thus the cursor's jitter filtering effect can be adaptively adjusted as the distance between the pointing device and the large screen and the change in the posture of the pointing device change, so that the user can use the remote control in any position to obtain the experience of small cursor movements without jitter and large movements without delay. Since the user generally moves to the vicinity of the control at high speed when making refined pointing selections, and then makes slow adjustments to accurately select the control, this method can be well applied to scenarios where users perform refined operations on the large screen.

[0044] In combination with the third aspect, in a possible implementation, the first pointing device is specifically used to: determine a first damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame and the first posture change value corresponding to the i-th frame; determine a second damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame and the second posture change value corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, i is a natural number, i=1,2,3…; determine the x variable corresponding to the i-th frame and the y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is the distance between the first pointing device and the first display screen corresponding to the i-th frame, and i is a natural number, i=1,2,3…; determine the x variable corresponding to the i-th frame and the y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is the distance between the first pointing device and the first display screen corresponding to the i-th frame. The horizontal coordinate of the corresponding pointing position is the change amount relative to the horizontal coordinate of the pointing position corresponding to the i-1th frame, and the y variable corresponding to the i-th frame is the change amount of the vertical coordinate of the pointing position corresponding to the i-th frame relative to the vertical coordinate of the pointing position corresponding to the i-1th frame; the cursor coordinates corresponding to the i-th frame are determined according to the first damping coefficient corresponding to the i-th frame, the second damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame; the first display screen is specifically used to: display the cursor corresponding to the i-th frame on the first display screen according to the cursor coordinates corresponding to the i-th frame.

[0045] In some embodiments, the first posture change value corresponding to the i-th frame includes the change value of the azimuth angle of the first pointing device relative to the posture corresponding to the i-1-th frame, and the second posture change value corresponding to the i-th frame includes the change value of the pitch angle of the first pointing device relative to the posture corresponding to the i-1-th frame.

[0046] In some embodiments, the first pointing device is specifically used to: determine the sum of the third product and the horizontal coordinate of the cursor coordinate corresponding to the i-1th frame as the horizontal coordinate of the cursor coordinate corresponding to the i-th frame, and the third product is the product of the first damping coefficient corresponding to the i-th frame and the x variable corresponding to the i-th frame; determine the sum of the fourth product and the vertical coordinate of the cursor coordinate corresponding to the i-1th frame as the vertical coordinate of the cursor coordinate corresponding to the i-th frame, and the fourth product is the product of the second damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

[0047] In an embodiment of the present application, the pointing device's ability to perceive space can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen and the change in the posture of the pointing device. The position of the cursor display can be adjusted according to the adjusted damping coefficient, thereby achieving the adaptive adjustment of the cursor's jitter filtering effect as the distance between the pointing device and the large screen and the change in the posture of the pointing device, so that the user can use the remote control at any position to obtain the experience of small cursor movements without jitter and large cursor movements without delay. Since the user generally moves to the vicinity of the control at high speed when making refined pointing selections, and then makes slow adjustments to accurately select the control, this method can be well applied to scenarios where users perform refined operations on the large screen.

[0048] In combination with the third aspect, in a possible implementation, the first pointing device is specifically used to: when the pointing position moves on the first display screen, determine the position and posture of the first pointing device in real time, the position of the first pointing device is used to obtain the distance between the first pointing device and the first display screen, and the posture of the first pointing device is used to obtain the posture change value of the first pointing device.

[0049] In a fourth aspect, an electronic device is provided, comprising a memory and a processor, wherein the memory is used to store computer program code, and the processor is used to execute the computer program code stored in the memory to implement the method in the above-mentioned first aspect or any possible implementation of the first aspect, or to implement the method in the above-mentioned second aspect or any possible implementation of the second aspect.

[0050] In a fifth aspect, a computer-readable storage medium is provided, which stores a computer program or instruction. When the computer program or instruction is executed, it implements the method in the above-mentioned first aspect or any possible implementation of the first aspect, or implements the method in the above-mentioned second aspect or any possible implementation of the second aspect.

[0051] In a sixth aspect, a chip is provided, in which instructions are stored. When the chip is run on a device, the chip executes the method in the above-mentioned first aspect or any possible implementation of the first aspect, or executes the method in the above-mentioned second aspect or any possible implementation of the second aspect.

[0052] In the seventh aspect, a computer program product is provided, which stores a computer program or instructions. When the computer program or instructions are executed, it implements the method in the above-mentioned first aspect or any possible implementation of the first aspect, or implements the method in the above-mentioned second aspect or any possible implementation of the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] FIG1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

[0054] FIG2 is a schematic structural diagram of another electronic device provided in an embodiment of the present application;

[0055] FIG3 is a schematic structural diagram of another electronic device provided in an embodiment of the present application;

[0056] FIG4 is a usage scenario of a directional remote control provided by an embodiment of the present application;

[0057] FIG5 is a schematic diagram showing how the sensitivity of a cursor movement varies with the distance of use, provided by an embodiment of the present application;

[0058] FIG6 is a schematic diagram of a scenario in which a pointing remote controller performs cursor control at different usage distances, provided by an embodiment of the present application;

[0059] FIG7 is a schematic diagram of an application scenario corresponding to the solution of the present application provided in an embodiment of the present application;

[0060] FIG8 is a schematic diagram of another application scenario corresponding to the solution of the present application provided in an embodiment of the present application;

[0061] FIG9 is a schematic diagram comparing the cursor control effects of a solution of the present application and an existing solution provided in an embodiment of the present application;

[0062] FIG10 is a schematic flow chart of a cursor control method provided in an embodiment of the present application;

[0063] FIG11 is a schematic flow chart of another cursor control method provided in an embodiment of the present application;

[0064] FIG12 is a schematic flow chart of another cursor control method provided in an embodiment of the present application;

[0065] FIG13 is a schematic flow chart of another cursor control method provided in an embodiment of the present application;

[0066] FIG14 is an interactive diagram of a cursor control method provided in an embodiment of the present application;

[0067] FIG15 is a graph showing the relationship between the damping coefficient and the posture change value per frame when the distance between the remote control and the large screen is constant, provided by an embodiment of the present application;

[0068] FIG16 is a graph showing the relationship between the damping coefficient and the distance between the remote control and the large screen when the posture change value of the remote control per frame is constant, provided by an embodiment of the present application;

[0069] FIG17 is a schematic diagram of the positional relationship between several large-screen devices and UWB base stations provided in an embodiment of the present application;

[0070] FIG18 is a schematic diagram of the arrangement of several first antenna arrays provided in an embodiment of the present application;

[0071] FIG19 is a diagram showing an arrangement of a second antenna array on a remote control according to an embodiment of the present application;

[0072] FIG20 is a spatial coordinate system established with a UWB base station as the coordinate origin, provided by an embodiment of the present application;

[0073] FIG21 is a spatial coordinate system provided by an embodiment of the present application, with the center of the remote control as the coordinate origin;

[0074] FIG22 is a diagram of an embodiment of the present application for measuring the azimuth angle ψ and pitch angle of the remote control. and a schematic diagram of the roll angle θ;

[0075] FIG23 is a schematic diagram of the functional modules of a cursor control system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0076] The technical solutions of this application will be described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only part of the embodiments of this application, rather than all the embodiments.

[0077] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "plurality" or "multiple" refers to two or more than two.

[0078] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0079] The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification of this application and the appended claims, the singular expressions "a", "an", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one, two or more. The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship.

[0080] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "one embodiment," "some embodiments," "another embodiment," and "other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically stated. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically stated.

[0081] The method provided in the embodiments of the present application can be applied to electronic devices such as mobile phones, tablet computers, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, and personal digital assistants (PDAs). The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

[0082] 1 shows a schematic structural diagram of an electronic device 100. The electronic device 100 may include a wireless communication module 110, an antenna 1, a processor 120, a speaker 130, a power management module 140, an internal memory 150, a display screen 160, and the like.

[0083] It is understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown (for example, it may also include an external memory interface, a battery, a frequency module, a sensor module, etc.), or combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0084] The wireless communication module 110 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 110 can be one or more devices integrating at least one communication processing module. The wireless communication module 110 receives electromagnetic waves via the antenna 1, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 120. The wireless communication module 110 can also receive the signal to be sent from the processor 120, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 1.

[0085] The processor 120 may include one or more processing units. For example, the processor 120 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0086] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0087] Processor 120 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 120 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 120. If processor 120 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 120 latency, and thus improves system efficiency.

[0088] In some embodiments, the processor 120 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0089] Antenna 1 is used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antenna can be used in conjunction with a tuning switch.

[0090] The speaker 130 , also called a “loudspeaker,” is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 130 .

[0091] The power management module 140 is connected to the processor 120. It receives input from the battery and / or charging management module and provides power to the processor 120, internal memory 150, speaker 130, display 160, and wireless communication module 110. The power management module 140 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In other embodiments, the power management module 140 can also be located within the processor 120. In other embodiments, the power management module 140 and the charging management module can also be located within the same device.

[0092] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the wireless communication module 110, etc.

[0093] The internal memory 150 can be used to store computer executable program codes, which include instructions. The processor 120 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 150. The internal memory 150 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an App required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 150 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0094] Electronic device 100 implements display functionality through a GPU, display screen 160, and an application processor. The GPU is a microprocessor for image processing that connects display screen 160 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 120 may include one or more GPUs that execute program instructions to generate or modify display information.

[0095] Display screen 160 is used to display images, videos, and the like. Display screen 160 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 160, where N is a positive integer greater than one.

[0096] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.

[0097] In some embodiments, the electronic device 100 may be a large-screen device.

[0098] 2 shows a schematic structural diagram of an electronic device 200. The electronic device 200 may include a wireless communication module 210, antenna 2, antenna 3, antenna 4, antenna 5, antenna 6, an ultra-wide band (UWB) module 220, a processor 230, an internal memory 240, a power management module 250, a power supply 260, a sensor module 270, and the like.

[0099] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0100] The wireless communication module 210 can provide wireless communication solutions for the electronic device 200, including WLAN (such as Wi-Fi networks), BT, GNSS, FM, NFC, IR, and other wireless communication solutions. The wireless communication module 210 can be one or more devices that integrate at least one communication processing module. The wireless communication module 210 receives electromagnetic waves via the antenna 3, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 230. The wireless communication module 210 can also receive signals to be transmitted from the processor 230, modulate the signals, amplify them, and convert them into electromagnetic waves for radiation via the antenna 3.

[0101] In some embodiments, the antenna 2 and antenna 3 of the electronic device 200 are coupled to the wireless communication module 210, so that the electronic device 200 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite based augmentation system (SBAS).

[0102] The UWB module 220 can provide UWB communication, ranging and other solutions applied to UWB tag devices. When the electronic device 200 integrates a UWB transmitting antenna (such as antenna 4) and multiple UWB receiving antennas (such as antenna 5 and antenna 6), the posture measurement of the electronic device 200 can be achieved based on the UWB signal.

[0103] The processor 230 may include one or more processing units. For example, the processor 230 may include an application processor, a modem processor, a graphics processor, an ISP, a controller, a memory, a video codec, a DSP, a baseband processor, and / or an NPU. The different processing units may be independent devices or integrated into one or more processors.

[0104] In some embodiments, the processor 230 is used to process the communication or ranging information output by the UWB module 220. The processor 230 is also responsible for calculating the positioning result of the UWB tag.

[0105] The controller may be the nerve center and command center of the electronic device 200. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0106] Processor 230 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 230 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 230. If processor 230 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 230 latency, and thus improves system efficiency.

[0107] In some embodiments, the processor 230 may include one or more interfaces, such as an I2C interface, an I2S interface, a PCM interface, a UART interface, a MIPI interface, a GPIO interface, a SIM interface, and / or a USB interface.

[0108] Antenna 2 and antenna 3 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 2 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0109] The internal memory 240 can be used to store computer executable program codes, which include instructions. The processor 230 executes various functional applications and data processing of the electronic device 200 by running the instructions stored in the internal memory 240. The internal memory 240 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an App required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 200 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 240 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a UFS, etc.

[0110] The power management module 250 is connected to the processor 230. The power management module 250 receives input from the battery 260 and / or the charging management module, and provides power to the processor 230, the internal memory 240, the wireless communication module 210, the UWB module 220, and the sensor module 270. The power management module 250 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 250 can also be provided in the processor 230. In other embodiments, the power management module 250 and the charging management module can also be provided in the same device.

[0111] The wireless communication function of the electronic device 200 can be implemented through antenna 2, antenna 3, antenna 4, antenna 5, antenna 6, wireless communication module 210, UWB module 220, modem processor and baseband processor.

[0112] The sensor module 270 may include a gyro sensor 271 , an acceleration sensor 272 , a geomagnetic sensor 273 , and the like.

[0113] In some embodiments, the sensor module 270 is configured to output azimuth, pitch, and roll angle information of the UWB tag.

[0114] The software system of the electronic device 200 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.

[0115] In some embodiments, the electronic device 200 is a pointing device, for example, a pointing remote control.

[0116] 3 shows a schematic structural diagram of an electronic device 300. The electronic device 300 may include a wireless communication module 310, antenna 7, antenna 8, antenna 9, antenna 10, antenna 11, a UWB module 320, a processor 330, an internal memory 340, a drive motor 350, a power management module 360, a power supply 370, and the like.

[0117] It should be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 300. In other embodiments of the present application, the electronic device 300 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0118] The wireless communication module 310 can provide wireless communication solutions for the electronic device 300, including WLAN (such as Wi-Fi networks), BT, GNSS, FM, NFC, IR, and other wireless communication solutions. The wireless communication module 310 can be one or more devices that integrate at least one communication processing module. The wireless communication module 310 receives electromagnetic waves via the antenna 8, frequency modulates and filters the electromagnetic wave signals, and transmits the processed signals to the processor 330. The wireless communication module 310 can also receive signals to be transmitted from the processor 330, frequency modulate them, amplify them, and convert them into electromagnetic waves for radiation via the antenna 8.

[0119] In some embodiments, antenna 7 and antenna 8 of electronic device 300 are coupled to wireless communication module 310, so that electronic device 300 can communicate with a network and other devices via wireless communication technologies. The wireless communication technologies may include GSM, GPRS, CDMA, WCDMA, TD-SCDMA, LTE, BT, GNSS, WLAN, NFC, FM, and / or IR technologies. The GNSS may include GPS, GLONASS, BDS, QZSS, and / or SBAS.

[0120] The UWB module 320 can provide UWB communication, ranging and other solutions applied to the electronic device 300. It should be noted that the electronic device 300 can be equipped with only one UWB signal receiving antenna, and in this case, at least three electronic devices 300 are required to achieve three-dimensional positioning of the UWB tag. In another implementation scheme, the electronic device 300 can be equipped with multiple UWB signal receiving antennas, and the arrangement between the antennas needs to meet certain rules. In this implementation scheme, at least two UWB receiving antennas are required to achieve two-dimensional positioning of the UWB tag, and to achieve three-dimensional positioning of the tag, at least three UWB receiving antennas (such as antenna 9, antenna 10 and antenna 11) are required. In addition, the electronic device 300 only needs to be equipped with one UWB transmitting antenna.

[0121] The processor 330 may include one or more processing units. For example, the processor 330 may include an application processor, a modem processor, a graphics processor, an ISP, a controller, a memory, a video codec, a DSP, a baseband processor, and / or an NPU. The different processing units may be independent devices or integrated into one or more processors.

[0122] In some embodiments, the processor 330 is used to process the communication or ranging information output by the UWB module 220. The processor 230 is also responsible for calculating the positioning result of the UWB tag.

[0123] The controller may be the nerve center and command center of the electronic device 300. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0124] Processor 330 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 330 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 330. If processor 330 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 330's latency, and thus improves system efficiency.

[0125] In some embodiments, the processor 330 may include one or more interfaces, such as an I2C interface, an I2S interface, a PCM interface, a UART interface, a MIPI interface, a GPIO interface, a SIM interface, and / or a USB interface.

[0126] Antenna 7 and antenna 8 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 300 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 7 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0127] The internal memory 340 can be used to store computer executable program codes, which include instructions. The processor 330 executes various functional applications and data processing of the electronic device 300 by running the instructions stored in the internal memory 340. The internal memory 340 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an App required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 300 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 340 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a UFS, etc.

[0128] The power management module 360 ​​is connected to the processor 330. The power management module 360 ​​receives input from the battery 370 and / or the charging management module, and provides power to the processor 330, the internal memory 340, the wireless communication module 310, the UWB module 320, and the drive motor 350. The power management module 360 ​​can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 360 ​​can also be provided in the processor 330. In other embodiments, the power management module 360 ​​and the charging management module can also be provided in the same device.

[0129] The wireless communication function of the electronic device 300 can be implemented through antenna 7, antenna 8, antenna 9, antenna 10, antenna 11, wireless communication module 310, UWB module 320, modem processor and baseband processor.

[0130] The software system of the electronic device 300 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.

[0131] In some embodiments, the electronic device 300 is a UWB base station.

[0132] It should be understood that the technical solutions in the embodiments of the present application can be used in Android, IOS, Hongmeng and other systems.

[0133] The technical solutions of the embodiments of the present application can be applied to devices with cursor control functions and electronic devices with screens. For example, they can be applied to pointing remote controls or other devices with pointing remote control functions, large-screen devices, and other devices with cursor control functions, electronic devices in 5G networks, or electronic devices in future public land mobile networks (PLMNs). The main application scenario can be controlling the cursor through a pointing remote control, for example, controlling the movement of the cursor on a large screen through a pointing remote control, thereby enabling shooting games, fruit-cutting games, painting, etc. on the large screen.

[0134] In order to more clearly understand the directional remote control, for example, with reference to FIG4 , the usage scenario of the directional remote control provided in the embodiment of the present application is described in detail.

[0135] As shown in Figure 4, the cursor 420 displayed on the display screen of the large-screen device 400 can be controlled by the pointing remote control 410. The display position of the cursor 420 is the same as the position on the display screen pointed by the pointing remote control 410, that is, the cursor 420 is displayed at the position on the display screen where the pointing remote control 410 points.

[0136] As shown in (a) in Figure 4, when the pointing remote control 410 switches from pointing to position A in the display screen to pointing to position B in the display screen, the display position of the cursor 420 also switches from position A to position B accordingly; as shown in (b) in Figure 4, when the pointing remote control 410 points outside the display screen of the large-screen device 400, the cursor is not displayed on the display screen of the large-screen device 400.

[0137] The user experience of a pointing remote control is similar to that of an infrared laser pen, and the pointing remote control can interact with the content displayed on the display screen by controlling the movement of the cursor on the display screen, which can enhance the interactive experience between the user and the large screen. For example, the user can use the pointing remote control to play shooting games, fruit-cutting games, etc. on the large screen, which is more in line with the user's usage habits.

[0138] Furthermore, FIG5 shows a schematic diagram of changes in the sensitivity of cursor movement during use of a pointing remote control provided by an embodiment of the present application.

[0139] As shown in Figure 5, after the pointing remote control is horizontally rotated by an angle of α at position 1, the pointing position of the pointing remote control in the display screen of the large-screen device 500 moves from position 3 to position 4, and synchronously, the display position of the cursor also moves from position 3 to position 4. The distance between position 3 and position 4 is L1, and the distance from position 1 to the display screen of the large-screen device 500 is d1; after the position of the pointing remote control is moved from position 1 to position 2, which is farther away from the display screen, when the pointing remote control undergoes the same posture change as at position 1 (horizontally rotated by an angle of α), the pointing position of the pointing remote control in the display screen of the large-screen device 500 moves from position 5 to position 6, and synchronously, the display position of the cursor also moves from position 6 to position 6, and the distance between position 5 and position 6 is L2, which is obviously larger than L1, and the distance from position 2 to the display screen of the large-screen device 500 is d2.

[0140] It can be seen that, when the posture change of the pointing remote control is the same, the farther the pointing remote control is from the display screen, the larger the range of movement of the cursor on the display screen.

[0141] The cursor sensitivity s can be introduced here to measure the above phenomenon. When the resolution K and screen size L of the large-screen device remain unchanged, the cursor sensitivity s and the distance d between the remote pointing controller and the display are related as follows:

[0142] It can be seen that s and d are in a monotonically increasing relationship. When using a pointing remote control, the sensitivity of the cursor movement gradually increases with the increase of the usage distance. That is, when the posture change of the pointing remote control remains the same, the farther the remote control is from the large screen, the larger the range of cursor movement.

[0143] For example, taking the interaction scenario between the pointing remote control and the display screen as a document marking scenario, FIG6 shows a schematic diagram of a scenario in which a pointing remote control according to an embodiment of the present application performs cursor control at different usage distances.

[0144] If the user wants to control the cursor to mark the content of the first subheading by using a pointing remote control, the user can control the movement trajectory of the pointing position of the pointing remote control on the display screen by controlling the posture change of the pointing remote control, thereby realizing control of the movement trajectory of the display cursor. The movement trajectory of the display cursor is the final displayed mark. As shown in (a) in FIG6 , when the distance between the pointing remote control and the display screen is short, the user can accurately mark the content of the first subheading; however, as shown in (b) in FIG6 , when the distance between the pointing remote control and the display screen is long, due to the high sensitivity of the cursor movement, a very small posture change of the pointing remote control can cause the cursor to move a long distance on the display screen. When marking a document, the marking range can easily expand to the content that does not need to be marked, and it is difficult for the user to accurately mark the content of the first subheading.

[0145] Therefore, when a user uses a large screen with a pointing remote control at a distance, a small range of hand shaking will cause the cursor to move over a large range. When the target control area of ​​the cursor is small, it is difficult to control the cursor to move accurately to the target control. This also makes it impossible for the user to use the pointing remote control to control the cursor to perform fine operations in a small range, such as drawing, document marking, etc., which seriously affects the user experience.

[0146] To address the above problems, in some embodiments, a single empty mouse method can be used to realize the control of the cursor by the remote control. In this method, the remote control has no pointing effect, and there is no correlation between the pointing position of the remote control and the cursor display position. No matter where the remote control points, a cursor is displayed on the display screen. In this method, the sensitivity of the cursor moving on the display screen is a constant value and has nothing to do with the distance of the remote control from the display screen. Although this method can alleviate the jitter problem caused by the high sensitivity of the cursor to a certain extent, in this method, the position of the cursor display is a relative coordinate, not an absolute coordinate. During use, the user needs to frequently click the frame to manually control the cursor. This method cannot be applied to pointing remote controls and cannot solve the cursor jitter problem that occurs during the use of pointing remote controls.

[0147] Therefore, in the current cursor control method, when the user uses the remote control to control the cursor movement at different distances, the cursor jitter filtering effect cannot be adaptively adjusted, which seriously affects the user experience.

[0148] In view of this, the embodiments of the present application provide a cursor control method, electronic device and system. Through this method, electronic device and system, when the distance between the pointing remote control and the display screen changes, the sensitivity of the corresponding cursor can adaptively change, so that the movement speed and movement range of the cursor are adapted to the current usage distance and posture changes of the pointing remote control, thereby enabling the user to adaptively adjust the cursor jitter effect when using the remote control at different distances.

[0149] It should be understood that the pointing device in the embodiment of the present application is described as a pointing remote control, but this does not constitute any limitation on the scope of application of the solution of the present application. The pointing device can also be any device with a pointing function.

[0150] For example, FIG7 shows a schematic diagram of an application scenario corresponding to the solution of the present application provided in an embodiment of the present application.

[0151] If the user wants to control the cursor to mark the content of the first subtitle through a pointing remote control, the user can control the posture changes of the pointing remote control to control the moving trajectory of the pointing position of the pointing remote control on the display screen, and then control the moving trajectory of the displayed cursor. The moving trajectory of the displayed cursor is the final displayed mark.

[0152] As shown in (a) in Figure 7, when the distance between the pointing remote control and the display screen is D1 (D1 is close enough, for example, D1 is less than 0.5m), when the user wants to mark the content of the first subtitle, that is, when the user wants to control the movement trajectory of the cursor to draw a circle around the content of the first subtitle within the range 701, since the sensitivity of the cursor movement is not high at this time, the damping coefficient of the cursor corresponding to the distance D1 is relatively large, for example, the damping coefficient is 1. The user needs to control the pointing position of the pointing remote control on the display screen to draw a circle around the content of the first subtitle within the range 701 to achieve this. At this time, the trajectory of the pointing position movement and the trajectory of the cursor movement are almost the same.

[0153] As shown in (b) in Figure 7, when the distance between the pointing remote control and the display screen is switched from D1 to D2 (D2 is greater than D1), when the user wants to mark the content of the first subtitle, that is, when the user wants to control the movement trajectory of the cursor to draw a circle around the content of the first subtitle within range 701, compared with the distance D1 shown in (a) in Figure 7, the sensitivity of the cursor movement is higher at this time. Correspondingly, the damping coefficient of the cursor is reduced, and it is only necessary to control the pointing position of the pointing remote control on the display screen to draw a circle around the content of the first subtitle within range 702 to achieve this. At this time, the distribution range corresponding to the trajectory of the pointing position movement is range 702 (the range shown by the dotted line in (b) in Figure 7), and range 702 includes range 701, and range 702 is larger than range 701.

[0154] Furthermore, as shown in (b) in FIG7 , when the distance between the pointing remote control and the display screen is switched from D2 to D3 (D3 is greater than D2), when the user wants to mark the content of the first subtitle, that is, wants to control the movement trajectory of the cursor to draw a circle around the content of the first subtitle within range 701, since the sensitivity of the cursor movement is higher at this time compared to the distance D2 shown in (b) in FIG7 , the damping coefficient of the cursor is further reduced accordingly. The user only needs to control the pointing position of the pointing remote control on the display screen to draw a circle around the content of the first subtitle within range 703 to achieve this. At this time, the distribution range corresponding to the trajectory of the pointing position movement is range 703 (the range shown by the dotted line in (c) in FIG7 ), range 703 includes range 701, range 703 is greater than range 702, and range 703 includes range 701.

[0155] It should be understood that the smaller the damping coefficient of the cursor is, the smaller the ratio of the displacement of the cursor per frame to the displacement of the pointing position per frame is.

[0156] In some embodiments, when adjusting the damping coefficient of the cursor according to the distance between the remote control and the large screen, the damping coefficient of the cursor can be further adjusted in combination with the user's control status of the remote control. For example, the damping coefficient of the cursor can be further adjusted in combination with the moving speed of the pointing position of the remote control on the large screen or the posture change of the remote control. The faster the moving speed of the pointing position, the smaller the adjustment force of the damping coefficient of the cursor, and the slower the moving speed of the pointing position, the greater the adjustment force of the damping coefficient of the cursor; the faster the posture change of the remote control, the smaller the adjustment force of the damping coefficient of the cursor, and the slower the posture change of the remote control, the greater the adjustment force of the damping coefficient of the cursor.

[0157] It can be understood that: when the pointing position moves, the cursor starts to move, and when the pointing position stops moving, the cursor stops moving.

[0158] In an embodiment of the present application, the spatial perception ability of the pointing remote control can be utilized to perceive the spatial relationship between the cursor and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the measured position information of the remote control relative to the large screen, thereby achieving the adaptive adjustment of the cursor jitter effect according to the distance between the remote control and the large screen and / or the control state of the remote control.

[0159] Exemplarily, taking the control manipulation scenario as an example, FIG8 shows a schematic diagram of another application scenario corresponding to the solution of the present application provided in an embodiment of the present application.

[0160] If the user wants to control the cursor 801 to move from control "A" to control "B" through a pointing remote control, the user can control the movement of the pointing position of the pointing remote control on the display screen by controlling the posture changes of the pointing remote control, thereby achieving control of the movement of the displayed cursor 801.

[0161] As shown in (a) in Figure 8, when the distance between the pointing remote control and the display screen is a first distance, when the user wants to control the cursor 801 to move from control "A" to control "B", the user can achieve this by moving the pointing position of the remote control on the large screen 800 to position 802, without having to move the pointing position of the remote control on the large screen 800 to the position of control "B".

[0162] It can be understood that in the embodiment of the present application, when the pointing position of the remote control on the large screen starts to move, the cursor starts to move synchronously, and the ratio of the speed of the cursor movement to the speed of the pointing position movement (less than or equal to 1) decreases as the distance between the remote control and the large screen increases, that is, the damping coefficient of the cursor decreases as the distance between the remote control and the large screen increases. When the pointing position stops moving, the cursor stops moving synchronously.

[0163] As shown in (b) in Figure 8, when the distance between the pointing remote control and the display screen increases to the second distance, when the user wants to control the cursor 801 to move from control "A" to control "B", compared with (a) in Figure 8, since the distance between the remote control and the large screen has increased, the damping coefficient of the corresponding cursor is further reduced, so that the user can achieve this by moving the pointing position of the remote control on the large screen 800 to position 803, without having to move the pointing position of the remote control on the large screen 800 to the position of control "B", wherein the distance between position 803 and control "B" is greater than the distance between position 802 and space "B".

[0164] In some embodiments, when adjusting the damping coefficient of the cursor according to the distance between the remote control and the large screen, the damping coefficient of the cursor can be further adjusted in combination with the user's control status of the remote control. For example, the damping coefficient of the cursor can be further adjusted in combination with the moving speed of the pointing position of the remote control on the large screen or the posture change of the remote control. The faster the moving speed of the pointing position, the smaller the adjustment force of the damping coefficient of the cursor, and the slower the moving speed of the pointing position, the greater the adjustment force of the damping coefficient of the cursor; the faster the posture change of the remote control, the smaller the adjustment force of the damping coefficient of the cursor, and the slower the posture change of the remote control, the greater the adjustment force of the damping coefficient of the cursor.

[0165] In the current cursor control method, when a user uses a remote control at a distant location, such as 5 meters away from a large screen, if the cursor needs to be moved from control "A" to control "B" on the screen, the physical distance between the two controls is 0.1 meters, and the user needs to accurately control the remote control to rotate 1° to complete the operation. This operation is difficult and easy to deviate. However, in the embodiment of the present application, due to the increase in cursor damping, the user can move the cursor from control "A" to control "B" by controlling the remote control to rotate a larger angle, such as controlling the remote control to rotate 5°, while the cursor displayed on the screen only moves 1°, which significantly reduces the difficulty of the user's cursor control operation.

[0166] In an embodiment of the present application, the spatial perception ability of the pointing remote control can be utilized to perceive the spatial relationship between the cursor and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the measured position information of the remote control relative to the large screen, thereby achieving the adaptive adjustment of the cursor jitter effect according to the distance between the remote control and the large screen and / or the control state of the remote control.

[0167] For example, FIG9 shows a schematic diagram comparing the cursor control effects of a solution of the present application and an existing solution provided in an embodiment of the present application.

[0168] If the user wants to control the cursor to move to control "A" through the pointing remote control, the user can control the movement of the pointing position of the pointing remote control on the display screen by controlling the posture change of the pointing remote control, thereby achieving control of the movement of the display cursor 901.

[0169] FIG9( a ) shows a schematic diagram of cursor movement when the distance between the remote control and the large screen is a first distance in the existing solution.

[0170] As shown in (a) in Figure 9, when the user wants to control the cursor 901 to move from the display area outside the control "A" to the control "A", the user first quickly switches the remote control control posture to quickly move the pointing position toward the control "A". After approaching the control "A", the user controls the remote control posture to slowly change and slowly moves the pointing position so that the cursor can finally stay on the control "A". However, since the movement trajectory of the cursor is the same as the movement trajectory of the pointing position, when the remote control is far away from the large screen, the sensitivity of the cursor movement is higher, and when moving slowly within a small range, the sensitivity of the cursor movement is much higher than the user's expectation, and severe cursor jitter will occur, making it difficult for the user to control the cursor to be accurately displayed on the control "A".

[0171] (b) in FIG9 shows a schematic diagram of cursor movement when the distance between the remote control and the large screen is a first distance provided in an embodiment of the present application.

[0172] As shown in (b) of FIG9 , when a user wishes to control cursor 901 to move from a display area outside of control “A” to control “A”, the user first quickly switches the remote control control posture to quickly move the pointing position toward control “A”. After approaching control “A”, the remote control control posture slowly changes, slowly moving the pointing position so that the cursor can finally stay on control “A”. During the cursor movement process, the cursor damping coefficient can be adaptively adjusted according to the distance between the remote control and the large screen and the control state of the remote control, so that the cursor movement sensitivity matches the user's expected value. Specifically, when the pointing position moves rapidly toward control “A”, the cursor movement sensitivity is not adjusted (the cursor damping coefficient is 1) or the cursor movement sensitivity is adjusted only based on the distance between the remote control and the large screen. This allows the cursor to quickly move near control “A” following the pointing position. When the pointing position moves slower, the cursor damping coefficient is adaptively reduced based on the distance between the remote control and the large screen and the remote control posture change speed, so that the cursor movement range is smaller than the pointing position movement range, which can reduce the degree of cursor jitter, thereby achieving an adaptive adjustment of the cursor jitter filtering effect.

[0173] As can be seen, when the user quickly points to control "A," the user's remote control gesture changes from rapid to slow, resulting in small-scale jitter. In existing solutions, the cursor jitter is severe and may even shake out of the response area of ​​control "A," causing the control to fail to click. However, in the present embodiment, due to the added damping effect during small-scale movement, the cursor jitter range is significantly suppressed, significantly improving cursor controllability.

[0174] In an embodiment of the present application, the spatial perception ability of the pointing remote control can be utilized to perceive the spatial relationship between the cursor and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the measured position information of the remote control relative to the large screen, thereby achieving adjustment of the cursor sensitivity, and then the cursor filtering effect can be adaptively adjusted according to the distance between the remote control and the large screen and / or the control state of the remote control, so that the user can use the remote control in any position to obtain the experience of small cursor movement without jitter and large cursor movement without delay. Since the user generally moves to the vicinity of the control at high speed when making refined pointing selections, and then makes slow adjustments to accurately select the control, this method can be well applied to scenarios where users perform refined operations on the large screen.

[0175] It should be understood that the above is an exemplary introduction to the solution of the embodiment of the present application using document marking scenarios and control interaction scenarios. The solution of the present application can be applied to any scenario of interaction between a pointing device and display screen content. For example, it can also be applied to scenarios such as painting and playing games on a large screen using a pointing device. This application does not limit this.

[0176] For example, FIG10 shows a schematic flow chart of a cursor control method 1000 provided in an embodiment of the present application. As shown in FIG10 , the method 1000 includes:

[0177] S1001: When the distance between the remote control and the large screen is a first distance, in response to the user controlling the pointing position of the remote control on the display screen to move within a first display range through the remote control, the cursor synchronously moves within a second display range on the display screen, wherein the first display range includes the second display range.

[0178] Among them, the remote control described in the embodiments of the present application can be understood as a directional remote control.

[0179] The pointing position may also be described as the intersection of the direction pointed by the remote control and the display screen of the large screen.

[0180] The first display range refers to the distribution range of the movement track corresponding to the pointing position, and the second display range refers to the distribution range of the movement track corresponding to the cursor.

[0181] It can also be understood that: the movement trajectory of the pointing position in the first display range is the first trajectory, the movement trajectory of the cursor in the second display range is the second trajectory, and the length of the first trajectory is greater than the length of the second trajectory.

[0182] S1002: When the distance between the remote control and the large screen is switched to a second distance, in response to the pointing position of the remote control on the display screen being controlled to move within a third display range by the remote control, the cursor synchronously moves within a second display range on the display screen, wherein the third display range includes the first display range, and the second distance is greater than the first distance.

[0183] The third display range refers to the distribution range of the movement track corresponding to the pointing position.

[0184] The third display range includes the first display range, and the first display range includes the second display range, which means that the third display range is larger than the first display range, and the first display range is larger than the second display range.

[0185] It can also be understood that: the movement trajectory of the pointing position in the third display range is the third trajectory, the length of the third trajectory is greater than the length of the first trajectory, and the length of the first trajectory is greater than the length of the second trajectory.

[0186] That is to say, when the distance between the remote control and the large screen is a first distance, if the user wants the cursor to perform interactive operations within the second display range, the user can achieve this by controlling the pointing position to move within the larger first display range; when the distance between the remote control and the large screen increases to a second distance, if the user still wants the cursor to perform interactive operations within the second display range, the user can achieve this by controlling the pointing position to move within a third display range that is larger than the first display range, thereby reducing the cursor jitter phenomenon caused by the increase in usage distance (increased sensitivity of cursor movement).

[0187] In some embodiments, the above steps S1001 to S1002 occur when the remote controller posture changes rapidly.

[0188] Optionally, the above S1101 and S1102 can also be described as: when the distance between the remote control and the large screen is a first distance, in response to the user controlling the pointing position of the remote control on the display screen by the remote control to move a first amplitude on the display screen, the cursor synchronously moves a second amplitude on the display screen, wherein the first amplitude is greater than the second amplitude; when the distance between the remote control and the large screen is switched to a second distance, in response to the user controlling the pointing position of the remote control on the display screen by the remote control to move a third amplitude on the display screen, the cursor synchronously moves a second amplitude on the display screen, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance.

[0189] In some embodiments, the first amplitude, the second amplitude, and the third amplitude may be distance amplitudes or angle amplitudes at the same time.

[0190] In an embodiment of the present application, the spatial perception ability of the pointing remote control can be utilized to perceive the spatial relationship between the remote control and the interactive large screen in real time, and the sensitivity of the cursor can be adaptively adjusted according to the measured position information of the remote control relative to the large screen, thereby achieving the adaptive adjustment of the cursor jitter effect according to the distance between the remote control and the large screen.

[0191] For example, FIG11 shows a schematic flow chart of another cursor control method 1100 provided in an embodiment of the present application. As shown in FIG11 , the method 1100 includes:

[0192] S1101: When the distance between the remote control and the large screen is a first distance, in response to the user controlling the pointing position of the remote control on the display screen from a first position to a second position through the remote control, the cursor synchronously moves from the first position to the target position on the display screen, wherein the distance between the first position and the second position is greater than the distance between the first position and the target position.

[0193] The cursor starts to move when the pointing position starts to move, and stops moving when the pointing position stops moving. The direction of cursor movement is always synchronized with the direction of movement of the pointing position.

[0194] S1102: When the distance between the remote control and the large screen is the second distance, in response to the user controlling the pointing position of the remote control on the display screen from the first position to the third position through the remote control, the cursor synchronously moves from the first position to the target position on the display screen, wherein the distance between the first position and the third position is greater than the distance between the first position and the target position, and the distance between the first position and the third position is greater than the distance between the first position and the second position.

[0195] The second distance is greater than the first distance.

[0196] For example, FIG12 shows a schematic flow chart of another cursor control method 1200 provided in an embodiment of the present application. As shown in FIG12 , the method 1200 includes:

[0197] S1201: Determine the x variable and y variable corresponding to the i-th frame, where the x variable is the change in the pointing coordinate corresponding to the i-th frame relative to the pointing coordinate corresponding to the i-1-th frame in the x-axis direction, and the y variable is the change in the pointing coordinate corresponding to the i-th frame relative to the pointing coordinate corresponding to the i-1-th frame in the y-axis direction. The pointing coordinate refers to the coordinate of the intersection of the direction pointed by the remote control and the large screen. The initial value of i is 1.

[0198] In an example, in the i-1th frame, the coordinates of the large screen pointed by the remote control are (x1, y1), and in the i-th frame, the coordinates of the large screen pointed by the remote control are (x2, y2). Then, the x variable corresponding to the i-th frame is x2-x1, and the y variable corresponding to the i-th frame is y2-y1.

[0199] S1202: Determine a damping coefficient corresponding to the i-th frame according to the distance between the remote control and the large screen corresponding to the i-th frame, wherein the damping coefficient corresponding to the i-th frame is negatively correlated with the distance between the remote control and the large screen corresponding to the i-th frame.

[0200] S1203: Determine the cursor coordinates corresponding to the i-th frame according to the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the (i-1)-th frame, and the x variable and y variable corresponding to the i-th frame.

[0201] In some embodiments, the x variable and y variable corresponding to the i-th frame are first adjusted according to the damping coefficient, and then the horizontal coordinate of the cursor coordinate corresponding to the i-1-th frame is added to the adjusted x variable corresponding to the i-th frame to obtain the horizontal coordinate of the cursor coordinate corresponding to the i-th frame, and the vertical coordinate of the cursor coordinate corresponding to the i-1-th frame is added to the adjusted y variable corresponding to the i-th frame to obtain the vertical coordinate of the cursor coordinate corresponding to the i-th frame.

[0202] In an example, the x variable corresponding to the i-th frame is x2-x1, the y variable corresponding to the i-th frame is y2-y1, the damping coefficient corresponding to the i-th frame is B1, and the cursor coordinates corresponding to the i-1-th frame are (x3, y3). Then, the cursor coordinates corresponding to the i-th frame are (x3+B1(x2-x1), y3+B1(y2-y1)).

[0203] S1204: Displaying the cursor corresponding to the i-th frame on the large screen according to the cursor coordinates corresponding to the i-th frame.

[0204] Specifically, the large screen draws and displays the cursor corresponding to the i-th frame on the large screen according to the cursor coordinates corresponding to the i-th frame.

[0205] Afterwards, when the cursor display enters the i+1th frame, let i=i+1, and execute the operations from S1201 to S1204 in a loop, and then display the cursor corresponding to the i+1th frame on the large screen, and repeat this process. This process is reflected as the movement of the cursor at the user perception level.

[0206] In an embodiment of the present application, the cursor jitter filtering effect can be adaptively adjusted according to the distance between the remote control and the large screen, so that the user can get the experience of smooth cursor movement when using the remote control at any position.

[0207] For example, FIG13 shows a schematic flow chart of another cursor control method 1300 provided in an embodiment of the present application. As shown in FIG13 , the method 1300 includes:

[0208] S1301 is the same as S1201 in the embodiment shown in FIG12 , and will not be described again for the sake of brevity.

[0209] S1302: Determine the damping coefficient corresponding to the i-th frame based on the distance between the remote control corresponding to the i-th frame and the large screen and the posture change value of the remote control corresponding to the i-th frame. The damping coefficient corresponding to the i-th frame is negatively correlated with the distance between the remote control corresponding to the i-th frame and the large screen, and the damping coefficient corresponding to the i-th frame is positively correlated with the posture change value of the remote control corresponding to the i-th frame.

[0210] S1303: Determine the cursor coordinates corresponding to the i-th frame according to the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the (i-1)-th frame, and the x variable and y variable corresponding to the i-th frame.

[0211] In some embodiments, the damping coefficient corresponding to the i-th frame includes a first damping coefficient and a second damping coefficient. The x variable corresponding to the i-th frame is first adjusted according to the first damping coefficient, and the y variable corresponding to the i-th frame is adjusted according to the second damping coefficient. Then, the horizontal coordinate of the cursor coordinate corresponding to the i-1-th frame is added to the adjusted x variable corresponding to the i-th frame to obtain the horizontal coordinate of the cursor coordinate corresponding to the i-th frame, and the vertical coordinate of the cursor coordinate corresponding to the i-1-th frame is added to the adjusted y variable corresponding to the i-th frame to obtain the vertical coordinate of the cursor coordinate corresponding to the i-th frame.

[0212] In an example, the x variable corresponding to the i-th frame is x2-x1, the y variable corresponding to the i-th frame is y2-y1, the first damping coefficient and the second damping coefficient corresponding to the i-th frame are B2 and B3 respectively, and the cursor coordinates corresponding to the i-1-th frame are (x3, y3). Then, the cursor coordinates corresponding to the i-th frame are (x3+B2(x2-x1), y3+B3(y2-y1)).

[0213] In some embodiments, the first damping coefficient is related to the distance between the remote control and the large screen, and the first damping coefficient is also related to the change of the attitude azimuth of the remote control in the current frame.

[0214] In some embodiments, the second damping coefficient is related to the distance between the remote control and the large screen, and the second damping coefficient is also related to the change of the attitude pitch angle of the remote control in the current frame.

[0215] S1304: Displaying the cursor corresponding to the i-th frame on the large screen according to the cursor coordinates corresponding to the i-th frame.

[0216] In an embodiment of the present application, the cursor jitter filtering effect can be adaptively adjusted according to the distance between the remote control and the large screen and the posture changes of the remote control, so that the user can use the remote control in any position to obtain the experience of small cursor movements without jitter and large movements without delay.

[0217] For example, FIG14 shows an interactive diagram of a cursor control method 1400 provided in an embodiment of the present application. As shown in FIG14 , the method is an interactive method between a UWB base station, a remote control (i.e., a pointing remote control), and a large screen. The method 1400 includes:

[0218] S1401: The UWB base station establishes a first coordinate system, where the first coordinate system is a spatial coordinate system established with the UWB base station as the coordinate origin.

[0219] In some embodiments, the UWB base station may be deployed on a wall in a room, on a large screen, or at other locations in the room.

[0220] S1402: The UWB base station determines a first coordinate, which is a coordinate of the remote control in a first coordinate system.

[0221] S1403: The UWB base station sends the first coordinates to the remote controller.

[0222] In some embodiments, the UWB base station includes a UWB module, and the remote control also includes a UWB module. The UWB base station and the remote control communicate through their respective UWB modules, that is, the UWB module of the remote control receives the first coordinate sent by the UWB module of the UWB base station.

[0223] S1404: The remote controller establishes a second coordinate system, which is a spatial coordinate system with the center of the remote controller as the coordinate origin.

[0224] It should be understood that the above steps S1401 to S1404 have been completed after the UWB base station is installed, and this process can be understood as executing the following preparatory operations S1405 to S1410.

[0225] S1405: Based on the first coordinate, the remote controller determines its own position and attitude in real time, and then determines the attitude azimuth change value (Δψ) and attitude pitch angle change value of the remote controller corresponding to the current frame. And determine the distance between the remote control and the large screen corresponding to the current frame.

[0226] The attitude azimuth and attitude pitch angle of the remote controller will be described in detail in subsequent embodiments.

[0227] In some embodiments, the remote control is based on the first coordinate system and the second coordinate system, and determines the spatial relationship of the remote control relative to the large screen in real time according to the first coordinate and the position of the large screen in the first coordinate system. The spatial relationship of the remote control relative to the large screen includes the distance between the remote control and the large screen, the pointing position of the remote control on the large screen, the posture of the remote control, etc.

[0228] In some embodiments, a sensor module is provided in the remote control, and the sensor module includes a gyroscope sensor and an acceleration sensor. The remote control can calculate the attitude change value of the remote control in real time through the gyroscope sensor. The attitude change value can specifically include the azimuth angle change value (Δψ), the pitch angle change value (Δψ), and the pitch angle change value (Δψ). And the roll angle change value (Δθ), the attitude change value and the remote control attitude measured by the UWB base station are fused and filtered to obtain a more accurate remote control attitude; the acceleration sensor on the remote control can obtain the position change value of the remote control through quadratic integration, and the position change value of the remote control and the positioning measurement value of the remote control performed by the UWB base station are fused and filtered to obtain a more accurate remote control position. Therefore, the measurement results of the UWB base station and the sensor module can be fused by Kalman filtering and other methods to obtain the accurate attitude and position of the remote control in the UWB coordinate system (that is, the first coordinate system mentioned above).

[0229] S1406: The remote controller determines the x variable and the y variable corresponding to the current frame.

[0230] The x variable is the change in the pointing coordinates of the current frame relative to the pointing coordinates of the previous frame in the X-axis direction, and the y variable is the change in the pointing coordinates of the current frame relative to the pointing coordinates of the previous frame in the Y-axis direction. The pointing coordinates refer to the coordinates of the intersection of the direction pointed by the remote control and the large screen.

[0231] In an example, in the previous frame, the coordinates of the remote control pointing to the large screen are (x1, y1), and in the current frame, the coordinates of the remote control pointing to the large screen are (x2, y2). Then, the x variable corresponding to the current frame is x2-x1, and the y variable corresponding to the current frame is y2-y1.

[0232] Specifically, according to the spatial relationship of the remote control relative to the large screen determined in real time in S1405, the pointing position of the remote control corresponding to the previous frame on the large screen and the pointing position of the remote control corresponding to the current frame on the large screen are determined, and then the x variable and y variable corresponding to the current frame are determined.

[0233] S1407: The remote control adjusts the change amount of the cursor in the X-axis direction according to the change value of the remote control's attitude azimuth angle and the distance between the remote control and the large screen; and adjusts the change amount of the cursor in the Y-axis direction according to the change value of the remote control's attitude pitch angle and the distance between the remote control and the large screen.

[0234] In some embodiments, a first damping coefficient is determined based on a change in the attitude azimuth of the remote control and the distance between the remote control and the large screen; a second damping coefficient is determined based on a change in the attitude pitch of the remote control and the distance between the remote control and the large screen; a change in the cursor in the X-axis direction (i.e., a change in the horizontal coordinate) is adjusted based on the first damping coefficient, and a change in the cursor in the Y-axis direction (i.e., a change in the vertical coordinate) is adjusted based on the second damping coefficient.

[0235] In some embodiments, the formula for adjusting the change amount of the cursor in the X-axis direction and the change amount in the Y-axis direction is as follows: Δx d =B(Δψ,d)*Δx r (2)

[0236] Where Δx d represents the change in the X-axis direction of the adjusted cursor corresponding to the current frame, B(Δψ,d) represents the calculation function of the first damping coefficient, d represents the distance between the remote control and the large screen corresponding to the current frame, Δx r Indicates the x variable corresponding to the current frame; Δy d Indicates the change in the Y-axis direction of the adjusted cursor corresponding to the current frame. represents the calculation function of the second damping coefficient, d represents the distance between the remote control and the large screen corresponding to the current frame, Δy r Indicates the y variable corresponding to the current frame.

[0237] The value selection rule of the damping coefficient will be introduced in detail in the subsequent embodiments.

[0238] S1408: The remote controller calculates the cursor coordinates of the current frame based on the adjusted change amount of the cursor in the X-axis direction, the change amount in the Y-axis direction, and the cursor coordinates of the previous frame.

[0239] Specifically, the remote control calculates the horizontal coordinate of the cursor coordinate of the current frame based on the change in the X-axis direction of the adjusted cursor and the horizontal coordinate of the cursor coordinate of the previous frame, and calculates the vertical coordinate of the cursor coordinate of the current frame based on the change in the Y-axis direction of the adjusted cursor and the vertical coordinate of the cursor coordinate of the previous frame.

[0240] S1409: The remote controller sends the calculated cursor coordinates of the current frame to the large screen.

[0241] S1410: The large screen draws a cursor according to the cursor coordinates of the current frame and displays the cursor on the screen.

[0242] In an embodiment of the present application, the spatial perception ability of the pointing remote control can be utilized to perceive the spatial relationship between the remote control and the interactive large screen in real time, and the sensitivity of the cursor can be adaptively adjusted according to the measured position information of the remote control relative to the large screen. This can then achieve adaptive adjustment of the cursor jitter effect according to the distance between the remote control and the large screen and / or the control state of the remote control, so that the user can use the remote control in any position to obtain the experience of small cursor movements without jitter and large movements without delay.

[0243] The following, by way of example, describes the adaptive determination rule of the damping coefficient provided in the embodiment of the present application in conjunction with Figures 15 and 16.

[0244] FIG15 shows a curve relationship diagram between the damping coefficient and the attitude change value per frame when the distance between the remote control and the large screen is constant.

[0245] As shown in Figure 15, when the distance is constant, within the range where the posture change value of the current frame of the remote control is less than a certain threshold (the threshold can be 7°, for example), the damping coefficient increases with the increase of the posture change value of the current frame. That is, when the posture change of the current frame of the remote control is slow, a smaller damping coefficient is calculated according to the filter function (B() above), further reducing the number of coordinates of the cursor movement; when the posture change value of the current frame is greater than or equal to a certain threshold, the damping coefficient no longer increases with the increase of the posture change value of the current frame, but almost maintains a constant value of 1. That is, when the posture change of the current frame of the remote control is fast, a larger damping coefficient is calculated according to the filter function, which does not affect the rapid impact of the cursor, thereby forming a user experience of "the cursor has a damping effect when moving in a small range, and has no damping effect when moving in a fast and large range."

[0246] FIG16 shows a curve relationship diagram between the damping coefficient and the distance between the remote control and the large screen when the attitude change value of the remote control per frame is constant.

[0247] As shown in Figure 16, the curve relationship between the damping coefficient and the posture change value of each frame when d=1 is shown; the curve relationship between the damping coefficient and the posture change value of each frame when d=3 is shown; and the curve relationship between the damping coefficient and the posture change value of each frame when d=5 is shown.

[0248] It can be seen from Figure 16 that when the posture change value of the current frame is the same, the greater the distance between the remote control and the large screen, the greater the damping coefficient. For example, when the distance between the remote control and the large screen is 1, the remote control undergoes a posture change, and the corresponding posture change value of the current frame is 2°. At this time, the damping coefficient of the current frame is 0.9; when the distance between the remote control and the large screen switches from 1 to 3, the remote control undergoes the same posture change, and the corresponding posture change value of the current frame is 2°. At this time, the damping coefficient of the current frame is reduced to 0.5; when the distance between the remote control and the large screen further switches from 3 to 5, the remote control undergoes the same posture change, and the corresponding posture change value of the current frame is 2°. At this time, the damping coefficient of the current frame is further reduced to 0.3.

[0249] That is to say, as the distance between the remote control and the large screen changes, the damping effect is also adjusted accordingly. When the change posture per unit time is constant, the farther the distance, the more obvious the cursor shaking filtering effect.

[0250] Exemplarily, FIG17 shows a schematic diagram of the positional relationship between several large-screen devices and a UWB base station, that is, a diagram showing the arrangement of a first antenna array 1700 of a UWB base station on a large-screen device 1710 .

[0251] As shown in Figure 17, the first antenna array 1700 can be set at any position on the large-screen device 1710. For example, the first antenna array 1700 can be set on the outside of the large-screen device 1710, for example, on the upper frame of the large-screen device 1710 (as shown in (a) in Figure 17), or at the diagonal position of the large-screen device 1710 (as shown in (b) in Figure 17 and (c) in Figure 17), or at any position such as the left frame, right frame, and bottom frame of the large-screen device 1710, or can be integrated into the interior of the large-screen device 1710; or can be set on an object that maintains a certain distance from the large-screen device 1710. The "object" can be an independent device, such as a desk, a stand, etc. The large-screen device 1710 and the first antenna array 1700 can be placed on different stands that maintain a certain distance; of course, the first antenna array 1700 can also be set inside the electronic device, and the first antenna array 1700 can also be set at any position in the room where the large-screen device 1710 is located. This embodiment does not limit this.

[0252] The first antenna array 1700 includes at least three first antenna units, which may be a first antenna 121, a second antenna 122 and a third antenna 123, respectively. The second antenna 122 is located on one side of the first antenna 121 in the first direction X, and the third antenna 123 is located on one side of the first antenna 121 in the second direction Y.

[0253] The first antenna 121 can transmit or receive signals, and the origin of the three-dimensional coordinate system can be defined through the first antenna 121.

[0254] In one embodiment, the first antenna 121 serves as the origin of the three-dimensional coordinate system, the first direction is the x-axis direction of the three-dimensional coordinate system, the second direction is the y-axis direction of the three-dimensional coordinate system, the second antenna 122 is located on the x-axis, and the third antenna 123 is located on the y-axis, such that the first antenna 121, the second antenna 122, and the third antenna 123 are arranged in an "L" shape. The distances L between the second antenna 122 and the first antenna 121, and between the third antenna 123 and the first antenna 121 are both less than or equal to the wavelength λ of the first signal. Here, the first signal is the first signal transmitted by the second antenna array and received by the first antenna array 1700, and the second antenna array is the antenna array provided on the remote control.

[0255] Exemplarily, FIG. 18 shows schematic diagrams of the arrangements of several first antenna arrays 1700 provided in the embodiments of the present application.

[0256] (a) of FIG. 18 shows a schematic diagram of the arrangement of a first antenna array 1700. As shown in (a) of FIG. 18, the number of first antenna units 120a is three, and the three first antenna units 120a are arranged in an "L" shape.

[0257] (b) of FIG. 18 shows another schematic diagram of the arrangement of a first antenna array 1700. As shown in (b) of FIG. 18, the number of first antenna units 120a is four, and the four first antenna units 120a are arranged in a "square" shape.

[0258] (c) of FIG. 18 shows another schematic diagram of the arrangement of a first antenna array 1700. As shown in (c) of FIG. 18, the number of first antenna units 120a is three, and the three first antenna units 120a are arranged in a "pin" shape.

[0259] Among various arrangement forms of at least three first antenna units 120a, there are at least two antennas distributed in the first direction X and the second direction Y respectively, and the first direction X is perpendicular to the second direction Y. Here, the first direction X can be used as the horizontal axis of the three-dimensional coordinate system, the second direction Y can be used as the vertical axis of the three-dimensional coordinate system, and there can be a set geometric relationship between the plane formed by the first direction X and the second direction Y and the display interface of the large-screen device 1710, so as to facilitate the calculation of the coordinates of the second antenna array.

[0260] Exemplarily, FIG. 19 shows a diagram of the arrangement state of a second antenna array on the remote control 1900 provided in the embodiments of the present application.

[0261] Referring to Figure 19 , the second antenna array includes at least three second antenna units, which may be a fourth antenna 221, a fifth antenna 222, and a sixth antenna 223. The fifth antenna 222 is located on one side of the fourth antenna 221 in the third direction, and the sixth antenna 223 is located on one side of the fourth antenna 221 in the fourth direction, thereby forming an "L"-shaped structure. The fourth antenna 221 is a transceiver antenna, and the fifth antenna 222 and the sixth antenna 223 are both receiving antennas. The second antenna units in the second antenna array can be used to receive the second signal transmitted by the first antenna array 1700. By ensuring that the distance L' between any two second antenna units is less than or equal to the wavelength λ of the second signal, each second antenna unit used for receiving the signal can receive the second signal nearly simultaneously, and each second antenna unit can obtain a phase parameter based on the second signal, and the deflection angle can be obtained based on the phase parameter.

[0262] That is to say, this embodiment makes the distance between any two first antenna units 120a and the distance between any two second antenna units less than the wavelength of the corresponding received signal, so that the first coordinate and deflection angle can be obtained according to the phase parameters of the received signal, thereby realizing the positioning of the second antenna array in three-dimensional space, and obtaining the absolute coordinates of the second antenna array within the size range of the large-screen device 1710, thereby improving the positioning accuracy and the control experience of the remote control 1900, wherein the first coordinate is the relative coordinate of the second antenna array relative to the first antenna array 1700.

[0263] The first antenna array 1700 and the second antenna array may have the same arrangement. For example, the first antenna array 1700 includes three first antenna units 120a, and the second antenna array includes three second antenna units. The arrangement of the three first antenna units 120a is the same as the arrangement of the three second antenna units. Of course, in other embodiments, the first antenna array 1700 and the second antenna array may have different arrangements. For example, the first antenna array 1700 includes three first antenna units 120a, and the second antenna array includes two second antenna units. The arrangement of the three first antenna units 120a is different from the arrangement of the two second antenna units.

[0264] When operating the remote control 1900, a distance is usually maintained between the remote control 1900 and the large-screen device 1710, that is, a distance is maintained between the first antenna array 1700 and the second antenna array, so that a triangle is formed between the second antenna array, the first antenna 121, and the second antenna 122, and a triangle is also formed between the second antenna array, the first antenna 121, and the third antenna 123. Therefore, the value of the first coordinate (x, y, z) can be calculated based on the relevant principles of triangles and electromagnetic waves.

[0265] The large-screen device 1710 is provided with a first antenna array 1700, and the remote control 1900 is provided with a second antenna array. The first antenna array 1700 can establish a three-dimensional coordinate system based on the relative position of the first antenna array 1700 on the large-screen device 1710. The first antenna array 1700 and the second antenna array can position each other so that the coordinates of the second antenna array are accurately presented on the display interface of the large-screen device 1710.

[0266] The attitude angle is determined by the rotation relationship between the carrier coordinate system (second coordinate system) and the UWB coordinate system (first coordinate system), which is composed of the azimuth angle ψ, the pitch angle And the roll angle θ are composed of three Euler angles. In order to more clearly understand the attitude change value of the remote control, the following, for example, with reference to Figures 20 to 22, the azimuth angle ψ, the pitch angle θ and the roll angle θ used to measure the attitude change value of the remote control are shown. and roll angle θ are introduced.

[0267] FIG20 shows a spatial coordinate system established with the UWB base station as the coordinate origin, namely the first coordinate system mentioned above.

[0268] As shown in (a) and (b) in Figure 20, the UWB base station adopts a three-antenna (antenna 0, antenna 1 and antenna 2) structure. The three-antenna structure shown in (a) in Figure 20 is an L-shaped antenna structure, and the three-antenna structure shown in (b) in Figure 20 is a triangular antenna structure. When installing the UWB base station, the arrow shown in the figure needs to be perpendicular to the horizontal plane and pointed upward for installation. The UWB base station can be installed on a wall or can be integrated on other smart devices, such as the top of a large screen.

[0269] After the UWB base station is installed, the UWB coordinate system (i.e., the first coordinate system mentioned above) can be established. As shown in (a) in Figure 20, the UWB coordinate system can use the center of antenna No. 0 of the base station as the coordinate origin O1, the X1 axis is parallel to the bottom edge of the base station and points to the left, the Y1 axis points to the front direction of the base station, and the Z1 axis is perpendicular to the X1O1Y1 plane and upward, satisfying the right-hand rule with the X1 axis and Y1 axis.

[0270] (c) in FIG20 shows a schematic diagram of the UWB coordinate system at the UWB base station level.

[0271] FIG21 shows a spatial coordinate system established with the center of the remote control as the coordinate origin, namely the second coordinate system mentioned above.

[0272] As shown in Figure 21, the coordinate origin O2 of the second coordinate system is located at the center of the remote control, the X2 axis points to the right along the horizontal axis of the carrier, the Y2 axis points forward along the vertical axis of the carrier, and the Z2 axis is perpendicular to the X2O2Y2 plane and points outward. The coordinate axes conform to the right-hand rule.

[0273] The remote control can be replaced by any other UWB tag, such as a mobile phone.

[0274] Based on the coordinate systems shown in Figures 20 and 21, Figure 22 shows the azimuth angle ψ and pitch angle used to measure the attitude of the remote controller. and a schematic diagram of the roll angle θ.

[0275] Figure 22(a) shows an azimuth angle ψ and a pitch angle Schematic diagram of .

[0276] As shown in (a) of Figure 22, the pitch angle It is the angle between the Y2 axis and the X1O1Y1 plane in the first coordinate system, and is positive when the carrier head is tilted upward. The azimuth angle ψ is the angle between the projection of the Y2 axis on the X1O1Y1 plane and the Y1 axis, and is positive when the carrier head is tilted to the right.

[0277] FIG22( b ) shows a schematic diagram of a roll angle θ.

[0278] As shown in (b) of FIG22 , the roll angle θ is the angle between the Z2 axis and the vertical plane including the Y2 axis, and is considered positive when the carrier tilts to the right.

[0279] In some embodiments, the attitude angle between the first coordinate system and the second coordinate system can also be presented in the form of an attitude transfer matrix C. Taking the attitude transfer between the second coordinate system and the first coordinate system as an example, represents the attitude transfer matrix from the second coordinate system to the first coordinate system, The three attitude angles ψ, and θ are calculated as follows:

[0280] It should be noted that the superscript "2" in the above formula (4) refers to the second coordinate system, not the square operation.

[0281] For example, FIG23 shows a functional module diagram of a cursor control system 2000 provided in an embodiment of the present application.

[0282] As shown in FIG23 , the system 2000 includes a UWB base station 2100, a pointing device 2200, and a large screen 2300. The UWB base station 2100 includes a first UWB module 2110; the pointing device 2200 includes a position and attitude estimation module 2210 and a cursor coordinate determination module 2220; the position and attitude estimation module 2210 includes a second UWB module 2211 and a sensor module 2212; the cursor coordinate determination module 2220 includes a projection calculation module 2221 and an adaptive filtering module 2222; and the large screen 2300 includes a drawing module 2310 and a display module 2320. Specifically:

[0283] The first UWB module 2110 is used to determine the first coordinate in real time after the UWB base station 2100 establishes the first coordinate system, wherein the first coordinate system is a spatial coordinate system established with the UWB base station 2100 as the coordinate origin, and the first coordinate is the coordinate of the pointing device 2200 in the first coordinate system.

[0284] In some embodiments, the UWB base station 2100 may be deployed on a wall in a room, on a large screen, or at other locations in the room.

[0285] The first UWB module 2110 is further configured to send the first coordinates determined in real time to the pointing device 2200 .

[0286] The position and attitude estimation module 2210 is used to estimate the position and attitude of the pointing device 2200 in real time after the pointing device 2200 establishes a second coordinate system, wherein the second coordinate system is a spatial coordinate system with the center of the pointing device 2200 as the coordinate origin.

[0287] Specifically, the second UWB module 2211 is used to receive the first coordinate sent in real time by the first UWB module 2110; the sensor module 2212 is used to determine the posture changes of the pointing device 2200 in real time, and the position and posture estimation module 2210 is specifically used to estimate the position and posture of the pointing device 2200 based on the first coordinate and the posture changes of the pointing device 2200 in real time.

[0288] The estimated position and attitude information of the pointing device 2200 includes the position of the pointing device 2200 from the large screen, the pointing position of the pointing device 2200 on the large screen, and the attitude angle of the pointing device 2200 relative to the first coordinate system (i.e., the attitude angle is determined by the rotation relationship between the second coordinate system and the first coordinate system). The attitude angle is composed of the azimuth angle ψ, the pitch angle φ, and the pitch angle φ. and roll angle θ are composed of three Euler angles, about the azimuth angle ψ, pitch angle and the roll angle θ have been described in detail in the embodiments shown in Figures 20 to 22 above, and will not be repeated here for the sake of brevity.

[0289] According to the attitude angle of the pointing device 2200 corresponding to the previous frame relative to the first coordinate system and the attitude angle of the pointing device 2200 corresponding to the current frame relative to the first coordinate system, the change value of the attitude angle corresponding to the current frame can be determined, that is, the change value Δψ of the azimuth angle ψ and the pitch angle Δψ corresponding to the current frame can be obtained. Change in value And the change value Δθ of the roll angle θ.

[0290] In some embodiments, the sensor module 2212 includes a gyroscope sensor and an acceleration sensor. The gyroscope sensor can be used to calculate the attitude change value of the remote control in real time, and the attitude change value and the attitude of the pointing device 2200 measured by the UWB base station 2100 are fused and filtered to obtain a more accurate attitude of the pointing device 2200; the acceleration sensor can obtain the position change value of the pointing device 2200 through quadratic integration, and the position change value of the pointing device 2200 and the positioning measurement value of the pointing device 2200 performed by the UWB base station 2100 are fused and filtered to obtain a more accurate position of the pointing device 2200. Therefore, the measurement results of the UWB base station 2100 and the sensor module 2212 can be fused by using methods such as Kalman filtering to obtain the accurate attitude and position of the remote control in the first coordinate system.

[0291] The projection calculation module 2221 is used to determine the x variable and the y variable corresponding to the current frame.

[0292] Among them, the x variable is the change in the pointing coordinates corresponding to the current frame relative to the pointing coordinates corresponding to the previous frame in the X-axis direction, and the y variable is the change in the pointing coordinates corresponding to the current frame relative to the pointing coordinates corresponding to the previous frame in the Y-axis direction. The pointing coordinates refer to the coordinates of the intersection of the direction indicated by the pointing device 2200 and the large screen 2300.

[0293] In an example, in the previous frame, the coordinates of the large screen 2300 pointed to by the pointing device 2200 are (x1, y1), and in the current frame, the coordinates of the large screen 2300 pointed to by the pointing device 2200 are (x2, y2). Then, the x variable corresponding to the current frame is x2-x1, and the y variable corresponding to the current frame is y2-y1.

[0294] Specifically, the x variable and the y variable corresponding to the current frame are determined according to the pointing position of the pointing device 2200 on the large screen 2300 corresponding to the previous frame and the pointing position of the pointing device 2200 on the large screen 2300 corresponding to the current frame.

[0295] Adaptive filtering module 2222, for adjusting the change amount of the cursor in the X-axis direction according to the attitude azimuth change value Δψ of the pointing device 2200 and the distance d between the pointing device 2200 and the large screen 2300; according to the attitude pitch angle change value Δψ of the pointing device 2200 The change amount of the cursor in the Y-axis direction is adjusted based on the distance d between the pointing device 2200 and the large screen 2300.

[0296] In some embodiments, the adaptive filtering module 2222 determines a first damping coefficient according to the attitude azimuth change value Δψ of the pointing device 2200 and the distance d between the pointing device 2200 and the large screen 2300; and determines a first damping coefficient according to the attitude pitch angle change value Δψ of the pointing device 2200. The second damping coefficient is determined based on the distance d between the pointing device 2200 and the large screen 2300; the change Δx of the cursor in the X-axis direction is adjusted based on the first damping coefficient. r (i.e. the change in the horizontal axis) is adjusted, and the change in the cursor in the Y-axis direction Δy is adjusted according to the second damping coefficient r (i.e. the change in the vertical axis) to make adjustments.

[0297] In some embodiments, the adaptive filtering module 2222 adjusts the change amount of the cursor in the X-axis direction and the change amount in the Y-axis direction according to the following formula: Δx d =B(Δψ,d)*Δx r (2)

[0298] Where Δx d represents the change in the X-axis direction of the adjusted cursor corresponding to the current frame, B(Δψ,d) represents the calculation function of the first damping coefficient, d represents the distance between the remote control and the large screen corresponding to the current frame, Δx r Indicates the x variable corresponding to the current frame; Δy d Indicates the change in the Y-axis direction of the adjusted cursor corresponding to the current frame. represents the calculation function of the second damping coefficient, d represents the distance between the remote control and the large screen corresponding to the current frame, Δy r Indicates the y variable corresponding to the current frame.

[0299] The adaptive filtering module 2222 is further configured to calculate the cursor coordinates of the current frame based on the adjusted amount of change of the cursor in the X-axis direction, the amount of change in the Y-axis direction, and the cursor coordinates of the previous frame.

[0300] Specifically, the adaptive filtering module 2222 calculates the horizontal coordinate of the cursor coordinates of the current frame based on the adjusted change in the X-axis direction of the cursor and the horizontal coordinate of the cursor coordinates of the previous frame, and calculates the vertical coordinate of the cursor coordinates of the current frame based on the adjusted change in the Y-axis direction of the cursor and the vertical coordinate of the cursor coordinates of the previous frame.

[0301] The second UWB module 2211 is further configured to send the calculated cursor coordinates of the current frame to the large screen 2300 .

[0302] The drawing module 2310 is configured to draw the cursor of the current frame according to the cursor coordinates of the current frame.

[0303] The display module 2320 is used to display the cursor of the current frame on the screen of the large screen 2300.

[0304] In an embodiment of the present application, the spatial perception ability of the pointing remote control can be utilized to perceive the spatial relationship between the remote control and the interactive large screen in real time, and the sensitivity of the cursor can be adaptively adjusted according to the measured position information of the remote control relative to the large screen. This can then achieve adaptive adjustment of the cursor jitter effect according to the distance between the remote control and the large screen and / or the control state of the remote control, so that the user can use the remote control in any position to obtain the experience of small cursor movements without jitter and large movements without delay.

[0305] One or more of the modules or units described herein can be implemented in software, hardware, or a combination of the two. When any of the above modules or units is implemented in software, the software exists in the form of computer program instructions and is stored in a memory, and a processor can be used to execute the program instructions and implement the above method flow. The processor may include, but is not limited to, at least one of the following: a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a microcontroller (MCU), or an artificial intelligence processor, etc., a computing device that runs software, each computing device may include one or more cores for executing software instructions to perform operations or processing. The processor may be built into an SoC (system on chip) or an application specific integrated circuit (ASIC), or it may be an independent semiconductor chip. In addition to the core for executing software instructions to perform operations or processing within the processor, it may further include necessary hardware accelerators, such as a field programmable gate array (FPGA), a PLD (programmable logic device), or a logic circuit that implements dedicated logic operations.

[0306] When the modules or units described in this document are implemented in hardware, the hardware can be any one or any combination of a CPU, a microprocessor, a DSP, an MCU, an artificial intelligence processor, an ASIC, a SoC, an FPGA, a PLD, a dedicated digital circuit, a hardware accelerator, or a non-integrated discrete device, which can run the necessary software or not rely on the software to execute the above method flow.

[0307] When the modules or units described herein are implemented using software, they can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0308] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0309] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0310] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0311] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0312] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0313] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0314] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A cursor control method, characterized in that: The method comprises: When the distance between the first pointing device and the first display screen is a first distance, controlling the pointing position to move by a first amplitude by the first pointing device so that the cursor synchronously moves by a second amplitude on the first display screen, wherein the first amplitude is greater than the second amplitude, and the pointing position is the position on the first display screen pointed to by the first pointing device; When the distance between the first pointing device and the first display screen is switched to a second distance, the pointing position is controlled by the first pointing device to move a third amplitude, so that the cursor moves synchronously on the first display screen by the second amplitude, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance.

2. The method according to claim 1, characterized in that The method further comprises: When the pointing position moves on the first display screen, determining a damping coefficient according to the distance between the first pointing device and the first display screen, wherein the damping coefficient is negatively correlated with the distance between the first pointing device and the first display screen; The display position of the cursor is adjusted according to the damping coefficient.

3. The method according to claim 2, characterized in that The determining the damping coefficient according to the distance between the first pointing device and the first display screen includes: determining a damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, and i is a natural number, i=1, 2, 3, ...; The adjusting the display position of the cursor according to the damping coefficient includes: Determine an x ​​variable corresponding to the i-th frame and a y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is a change in the abscissa of the pointing position corresponding to the i-th frame relative to the abscissa of the pointing position corresponding to the i-1-th frame, and the y variable corresponding to the i-th frame is a change in the ordinate of the pointing position corresponding to the i-th frame relative to the ordinate of the pointing position corresponding to the i-1-th frame; The cursor coordinates corresponding to the i-th frame are determined according to the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame. The cursor coordinates corresponding to the i-th frame are used to display the cursor corresponding to the i-th frame on the first display screen.

4. The method according to claim 3, characterized in that The determining the cursor coordinates corresponding to the i-th frame according to the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame includes: Determine the sum of the first product and the abscissa of the cursor coordinate corresponding to the (i-1)th frame as the abscissa of the cursor coordinate corresponding to the (i)th frame, wherein the first product is the product of the damping coefficient corresponding to the (i)th frame and the x variable corresponding to the (i)th frame; The sum of the second product and the ordinate of the cursor coordinate corresponding to the i-1th frame is determined as the ordinate of the cursor coordinate corresponding to the i-th frame, and the second product is the product of the damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

5. The method according to any one of claims 2 to 4, characterized in that The determining the damping coefficient according to the distance between the first pointing device and the first display screen includes: A damping coefficient is determined according to the distance between the first pointing device and the first display screen and a posture change value of the first pointing device. The damping coefficient is positively correlated with the posture change value of the first pointing device.

6. The method according to claim 5, characterized in that The determining of the damping coefficient according to the distance between the first pointing device and the first display screen and the posture change value of the first pointing device includes: Determine a first damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame and the first posture change value corresponding to the i-th frame; determining a second damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame and the second posture change value corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, and i is a natural number, i=1, 2, 3, ...; The adjusting the display position of the cursor according to the damping coefficient includes: Determine the x variable corresponding to the i-th frame and the y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is the change in the abscissa of the pointing position corresponding to the i-th frame relative to the abscissa of the pointing position corresponding to the i-1-th frame, and the y variable corresponding to the i-th frame is the change in the ordinate of the pointing position corresponding to the i-th frame relative to the ordinate of the pointing position corresponding to the i-1-th frame; The cursor coordinates corresponding to the i-th frame are determined based on the first damping coefficient corresponding to the i-th frame, the second damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame. The cursor coordinates corresponding to the i-th frame are used to display the cursor corresponding to the i-th frame on the first display screen.

7. The method according to claim 6, characterized in that The determining the cursor coordinates corresponding to the i-th frame according to the first damping coefficient corresponding to the i-th frame, the second damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the (i-1)-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame includes: Determine the sum of the third product and the abscissa of the cursor coordinate corresponding to the (i-1)th frame as the abscissa of the cursor coordinate corresponding to the (i)th frame, wherein the third product is the product of the first damping coefficient corresponding to the (i)th frame and the x variable corresponding to the (i)th frame; The sum of the fourth product and the ordinate of the cursor coordinate corresponding to the i-1th frame is determined as the ordinate of the cursor coordinate corresponding to the i-th frame, and the fourth product is the product of the second damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

8. The method according to claim 6 or 7, characterized in that The first posture change value corresponding to the i-th frame includes the change value of the azimuth angle of the first pointing device relative to the posture corresponding to the i-1-th frame, and the second posture change value corresponding to the i-th frame includes the change value of the pitch angle of the first pointing device relative to the posture corresponding to the i-1-th frame.

9. The method according to any one of claims 2 to 8, characterized in that The method further comprises: When the pointing position moves on the first display screen, the position and posture of the first pointing device are determined in real time. The position of the first pointing device is used to obtain the distance between the first pointing device and the first display screen, and the posture of the first pointing device is used to obtain the posture change value of the first pointing device.

10. The method according to any one of claims 2 to 9, characterized in that The damping coefficient is greater than 0, and the damping coefficient is less than or equal to 1.

11. The method according to any one of claims 1 to 10, characterized in that The first pointing device is a remote controller.

12. A cursor control method, characterized in that: The method comprises: When the distance between the first pointing device and the first display screen is a first distance, in response to the first pointing device controlling the pointing position to move by a first amplitude, the cursor synchronously moves by a second amplitude on the first display screen, wherein the first amplitude is greater than the second amplitude, and the pointing position is the position on the first display screen pointed to by the first pointing device; When the distance between the first pointing device and the first display screen is switched to a second distance, in response to controlling the pointing position to move by a third amplitude through the first pointing device, the cursor synchronously moves by the second amplitude on the first display screen, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance.

13. A cursor control system, characterized in that: The system includes a first pointing device and a first display screen, The first pointing device is used for: When the distance between the first pointing device and the first display screen is a first distance, controlling the pointing position to move by a first amplitude, the pointing position being the position on the first display screen pointed to by the first pointing device; The first display screen is used for: In response to the pointing position moving by a first amplitude, controlling the cursor to move synchronously by a second amplitude on the first display screen, wherein the first amplitude is greater than the second amplitude; The first pointing device is further configured to: when the distance between the first pointing device and the first display screen is a second distance, control the pointing position to move by a third amplitude; The first display screen is further used for: In response to the pointing position moving by a third amplitude, the cursor is controlled to synchronously move by the second amplitude on the first display screen, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance.

14. The system according to claim 13, wherein: The first pointing device is specifically used for: When the pointing position moves on the first display screen, determining a damping coefficient according to the distance between the first pointing device and the first display screen, wherein the damping coefficient is negatively correlated with the distance between the first pointing device and the first display screen; The display position of the cursor is adjusted according to the damping coefficient.

15. The system according to claim 14, wherein: The first pointing device is specifically used for: determining a damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, and i is a natural number, i=1, 2, 3, ...; Determine an x ​​variable corresponding to the i-th frame and a y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is a change in the abscissa of the pointing position corresponding to the i-th frame relative to the abscissa of the pointing position corresponding to the i-1-th frame, and the y variable corresponding to the i-th frame is a change in the ordinate of the pointing position corresponding to the i-th frame relative to the ordinate of the pointing position corresponding to the i-1-th frame; Determine the cursor coordinates corresponding to the i-th frame according to the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the (i-1)-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame; The first display screen is specifically used for: The cursor corresponding to the i-th frame is displayed on the first display screen according to the cursor coordinates corresponding to the i-th frame.

16. The system according to claim 15, wherein: The first pointing device is specifically used for: Determine the sum of the first product and the abscissa of the cursor coordinate corresponding to the (i-1)th frame as the abscissa of the cursor coordinate corresponding to the (i)th frame, wherein the first product is the product of the damping coefficient corresponding to the (i)th frame and the x variable corresponding to the (i)th frame; The sum of the second product and the ordinate of the cursor coordinate corresponding to the i-1th frame is determined as the ordinate of the cursor coordinate corresponding to the i-th frame, and the second product is the product of the damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

17. The system according to any one of claims 14 to 16, characterized in that The first pointing device is specifically used for: A damping coefficient is determined according to the distance between the first pointing device and the first display screen and a posture change value of the first pointing device. The damping coefficient is positively correlated with the posture change value of the first pointing device.

18. The system according to claim 17, wherein: The first pointing device is specifically used for: Determine a first damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame and the first posture change value corresponding to the i-th frame; determining a second damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame and the second posture change value corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, and i is a natural number, i=1, 2, 3, ...; Determine the x variable corresponding to the i-th frame and the y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is the change in the abscissa of the pointing position corresponding to the i-th frame relative to the abscissa of the pointing position corresponding to the i-1-th frame, and the y variable corresponding to the i-th frame is the change in the ordinate of the pointing position corresponding to the i-th frame relative to the ordinate of the pointing position corresponding to the i-1-th frame; Determining the cursor coordinates corresponding to the i-th frame according to the first damping coefficient corresponding to the i-th frame, the second damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the (i-1)-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame; The first display screen is specifically used for: The cursor corresponding to the i-th frame is displayed on the first display screen according to the cursor coordinates corresponding to the i-th frame.

19. The system according to claim 18, wherein: The first pointing device is specifically used for: Determine the sum of the third product and the abscissa of the cursor coordinate corresponding to the (i-1)th frame as the abscissa of the cursor coordinate corresponding to the (i)th frame, wherein the third product is the product of the first damping coefficient corresponding to the (i)th frame and the x variable corresponding to the (i)th frame; The sum of the fourth product and the ordinate of the cursor coordinate corresponding to the i-1th frame is determined as the ordinate of the cursor coordinate corresponding to the i-th frame, and the fourth product is the product of the second damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

20. The system according to claim 18 or 19, characterized in that The first posture change value corresponding to the i-th frame includes the change value of the azimuth angle of the first pointing device relative to the posture corresponding to the i-1-th frame, and the second posture change value corresponding to the i-th frame includes the change value of the pitch angle of the first pointing device relative to the posture corresponding to the i-1-th frame.

21. The system according to any one of claims 14 to 20, characterized in that The first pointing device is specifically used for: When the pointing position moves on the first display screen, the position and posture of the first pointing device are determined in real time. The position of the first pointing device is used to obtain the distance between the first pointing device and the first display screen, and the posture of the first pointing device is used to obtain the posture change value of the first pointing device.

22. The system according to any one of claims 14 to 21, characterized in that The damping coefficient is greater than 0, and the damping coefficient is less than or equal to 1.

23. The system according to any one of claims 13 to 22, characterized in that The first pointing device is a remote controller, and the first display screen is a large screen.

24. An electronic device, characterized in that: include: one or more processors; one or more memories; and one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, and the one or more computer programs include instructions that, when executed by the one or more processors, cause the electronic device to perform the method as claimed in any one of claims 1 to 11, or perform the method as claimed in claim 12.

25. A computer-readable storage medium, characterized in that The storage medium stores a program or instruction. When the program or instruction is executed, the method according to any one of claims 1 to 11 or the method according to claim 12 is implemented.

26. A chip, characterized in that: The chip stores instructions, and when the instructions are executed, the method according to any one of claims 1 to 11 or the method according to claim 12 is implemented.

27. A computer program product, characterized in that The computer program product stores a program or an instruction, and when the program or the instruction is executed, the method according to any one of claims 1 to 11 or the method according to claim 12 is implemented.

Images