Cursor control method, electronic equipment and system

Abstract

The invention provides a cursor control method which comprises the steps that when the distance between a first pointing device and a first display screen is a first distance, a cursor synchronously moves by a second amplitude on the first display screen in response to the fact that the first pointing device controls a pointing position to move by a first amplitude, and the first amplitude is larger than the second amplitude; the pointing position is a position, pointed by the first pointing device, in the first display screen; when the distance between the first pointing device and the first display screen is switched to a second distance, the cursor synchronously moves by a second amplitude on the first display screen in response to the fact that the pointing position is controlled by the first pointing device to move by a third amplitude, the third amplitude is larger than the first amplitude, and the second distance is larger than the first distance. According to the method, the shake filtering effect of the cursor can be adaptively adjusted according to the distance between the pointing device and the display screen, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of cursor control, and more particularly, to a cursor control method, electronic device and system. Background Art

[0002] The pointing remote control achieves the remote control effect by controlling the movement of the cursor on the large screen, which can enhance the interactive experience between the user and the large screen. For example, the user can use the pointing remote control to play shooting games and fruit-cutting games on the large screen. During the use of the pointing remote control, the sensitivity of the cursor movement gradually increases with the increase of the use distance, that is, when the posture change of the pointing remote control is the same, the farther the remote control is from the large screen, the greater the range of cursor movement.

[0003] Therefore, when the user is using a large screen at a long distance, a small-scale hand shake will cause the cursor to move over a large range. When the target control area of ​​the cursor is small, it is difficult to control the cursor to move accurately to the target control. This also makes it impossible for the user to smoothly use the pointing remote control to control the cursor to perform fine operations in a small range, such as drawing, document marking, etc., which seriously affects the user experience. Summary of the invention

[0004] The present application provides a cursor control method, electronic device and system. Through this method, electronic device and system, the cursor jitter effect can be adaptively adjusted according to the distance between the pointing device and the display screen, thereby improving the user experience.

[0005] In a first aspect, a method for cursor control is provided, the method comprising: when the distance between a first pointing device and a first display screen is a first distance, controlling the pointing position to move by a first amplitude through the first pointing device, so that the cursor synchronously moves by a second amplitude on the first display screen, wherein the first amplitude is greater than the second amplitude, and the pointing position is the position in the first display screen pointed by the first pointing device; when the distance between the first pointing device and the first display screen is switched to a second distance, controlling the pointing position to move by a third amplitude through the first pointing device, so that the cursor synchronously moves by a second amplitude on the first display screen, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance. The pointing position of the first pointing device includes the position in the first display screen that the first pointing device intends to point to. The first amplitude can be the amplitude that the user moves along the display screen using the first pointing device.

[0006] In some embodiments, the first pointing device is a remote control, and may also be a mobile phone with a pointing function, or may be other devices with a pointing function, which is not limited in the present application.

[0007] In some embodiments, the first distance may be a first distance range, and the second distance may be a second distance range, wherein a minimum distance value in the second distance range is greater than a maximum distance value in the first distance range.

[0008] In some embodiments, the first amplitude, the second amplitude, and the third amplitude may be distance amplitudes or angle amplitudes at the same time.

[0009] The pointing position may also be described as the intersection position of the direction pointed by the first pointing device and the first display screen.

[0010] In an embodiment of the present application, the spatial perception ability of the pointing device can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the sensitivity of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen, thereby achieving the filtering effect of the cursor adaptively adjusted according to the distance between the pointing device and the large screen.

[0011] In combination with the first aspect, in a possible implementation, the method also includes: when the pointing position moves on the first display screen, determining a damping coefficient according to the distance between the first pointing device and the first display screen, and the damping coefficient is negatively correlated with the distance between the first pointing device and the first display screen; and adjusting the display position of the cursor according to the damping coefficient.

[0012] In some embodiments, the damping coefficient is greater than 0 and the damping coefficient is less than or equal to 1.

[0013] In the embodiment of the present application, the spatial perception ability of the pointing device can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen, thereby achieving adjustment of the sensitivity of the cursor, and then the cursor jitter filtering effect can be adaptively adjusted with the distance between the pointing device and the large screen, so that the user can get the experience of non-jittery cursor movement using the remote control in any position.

[0014] In combination with the first aspect, in a possible implementation manner, determining a damping coefficient according to the distance between the first pointing device and the first display screen includes: determining the damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device corresponding to the i-th frame and the first display screen, and i is a natural number, i=1, 2, 3...; adjusting the display position of the cursor according to the damping coefficient includes: determining an x ​​variable corresponding to the i-th frame and a y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is a change in the horizontal coordinate of the pointing position corresponding to the i-th frame relative to the horizontal coordinate of the pointing position corresponding to the i-1-th frame, and the y variable corresponding to the i-th frame is a change in the vertical coordinate of the pointing position corresponding to the i-th frame relative to the vertical coordinate of the pointing position corresponding to the i-1-th frame; determining the cursor coordinates corresponding to the i-th frame according to the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame, and the cursor coordinates corresponding to the i-th frame are used to display the cursor corresponding to the i-th frame on the first display screen.

[0015] In some embodiments, the cursor coordinates corresponding to the i-th frame are determined based on the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame, including: determining the abscissa of the cursor coordinates corresponding to the i-th frame by the sum of a first product and the abscissa of the cursor coordinates corresponding to the i-1-th frame, the first product being the product of the damping coefficient corresponding to the i-th frame and the x variable corresponding to the i-th frame; and determining the ordinate of the cursor coordinates corresponding to the i-th frame by the sum of a second product and the ordinate of the cursor coordinates corresponding to the i-1-th frame, the second product being the product of the damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

[0016] In the embodiment of the present application, the spatial perception ability of the pointing device can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen. The position of the cursor display can be adjusted according to the adjusted damping coefficient, thereby achieving the adaptive adjustment of the cursor jitter filtering effect with the distance between the pointing device and the large screen, so that the user can get the experience of non-jittering cursor movement using the remote control in any position.

[0017] In combination with the first aspect, in a possible implementation method, the damping coefficient is determined according to the distance between the first pointing device and the first display screen, including: determining the damping coefficient according to the distance between the first pointing device and the first display screen, and the posture change value of the first pointing device, and the damping coefficient is positively correlated with the posture change value of the first pointing device.

[0018] In the embodiment of the present application, the spatial perception ability of the pointing device can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen and the change in the posture of the pointing device, thereby achieving the adjustment of the cursor sensitivity, and then the cursor jitter filtering effect can be adaptively adjusted as the distance between the pointing device and the large screen and the change in the posture of the pointing device change, so that the user can use the remote control in any position to obtain the experience of small cursor movements without jitter and large cursor movements without delay. Because the user generally moves to the vicinity of the control at high speed when making a refined pointing selection, and then makes a slow adjustment to accurately select the control, this method can be well applied to scenarios where the user performs refined operations on the large screen.

[0019] In combination with the first aspect, in a possible implementation, a damping coefficient is determined according to the distance between the first pointing device and the first display screen, and a posture change value of the first pointing device, including: determining a first damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame and the first posture change value corresponding to the i-th frame; determining a second damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame and the second posture change value corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, i is a natural number, i=1,2,3…; adjusting the display position of the cursor according to the damping coefficient, including: determining the i-th frame; an x variable corresponding to the i-th frame and a y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is a change in the horizontal coordinate of the pointing position corresponding to the i-th frame relative to the horizontal coordinate of the pointing position corresponding to the i-1-th frame, and the y variable corresponding to the i-th frame is a change in the vertical coordinate of the pointing position corresponding to the i-th frame relative to the vertical coordinate of the pointing position corresponding to the i-1-th frame; the cursor coordinates corresponding to the i-th frame are determined according to the first damping coefficient corresponding to the i-th frame, the second damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame and the y variable corresponding to the i-th frame, and the cursor coordinates corresponding to the i-th frame are used to display the cursor corresponding to the i-th frame on the first display screen.

[0020] In some embodiments, the first posture change value corresponding to the i-th frame includes the change value of the azimuth angle of the first pointing device relative to the posture corresponding to the i-1-th frame, and the second posture change value corresponding to the i-th frame includes the change value of the pitch angle of the first pointing device relative to the posture corresponding to the i-1-th frame.

[0021] In some embodiments, the cursor coordinates corresponding to the i-th frame are determined based on the first damping coefficient corresponding to the i-th frame, the second damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1th frame, the x variable corresponding to the i-th frame and the y variable corresponding to the i-th frame, including: determining the abscissa of the cursor coordinates corresponding to the i-th frame by the sum of a third product and the abscissa of the cursor coordinates corresponding to the i-1th frame, the third product being the product of the first damping coefficient corresponding to the i-th frame and the x variable corresponding to the i-th frame; determining the ordinate of the cursor coordinates corresponding to the i-th frame by the sum of a fourth product and the ordinate of the cursor coordinates corresponding to the i-1th frame, the fourth product being the product of the second damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

[0022] In the embodiment of the present application, the pointing device's ability to perceive space can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen and the change in the posture of the pointing device. The position of the cursor display can be adjusted according to the adjusted damping coefficient, thereby enabling the cursor jitter filtering effect to be adaptively adjusted as the distance between the pointing device and the large screen and the change in the posture of the pointing device change. This allows the user to use the remote control in any position to obtain the experience of small cursor movements without jitter and large cursor movements without delay. Because the user generally moves to the vicinity of the control at high speed when making a refined pointing selection, and then makes a slow adjustment to accurately select the control, this method can be well suited for scenarios where the user performs refined operations on the large screen.

[0023] In combination with the first aspect, in a possible implementation, the method also includes: when the pointing position moves on the first display screen, determining the position and posture of the first pointing device in real time, the position of the first pointing device is used to obtain the distance between the first pointing device and the first display screen, and the posture of the first pointing device is used to obtain the posture change value of the first pointing device.

[0024] In a second aspect, a method for cursor control is provided, the method comprising: when the distance between a first pointing device and a first display screen is a first distance, in response to controlling a pointing position to move by a first amplitude through the first pointing device, the cursor synchronously moves by a second amplitude on the first display screen, wherein the first amplitude is greater than the second amplitude, and the pointing position is the position in the first display screen pointed to by the first pointing device; when the distance between the first pointing device and the first display screen is switched to a second distance, in response to controlling the pointing position to move by a third amplitude through the first pointing device, the cursor synchronously moves by a second amplitude on the first display screen, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance.

[0025] In some embodiments, the first display screen is a display screen of a large-screen device.

[0026] In some embodiments, the first amplitude, the second amplitude, and the third amplitude may be distance amplitudes or angle amplitudes at the same time.

[0027] The pointing position may also be described as the intersection position of the direction pointed by the first pointing device and the first display screen.

[0028] In an embodiment of the present application, the spatial perception ability of the pointing device can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the sensitivity of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen, thereby achieving the filtering effect of the cursor adaptively adjusted according to the distance between the pointing device and the large screen.

[0029] In a third aspect, a cursor control system is provided, the system comprising a first pointing device and a first display screen, the first pointing device being used to: when the distance between the first pointing device and the first display screen is a first distance, control a pointing position to move by a first amplitude, the pointing position being a position in the first display screen pointed to by the first pointing device; the first display screen being used to: in response to the pointing position moving by the first amplitude, control a cursor to synchronously move by a second amplitude on the first display screen, wherein the first amplitude is greater than the second amplitude; the first pointing device being used to: when the distance between the first pointing device and the first display screen is a second distance, control a pointing position to move by a third amplitude on the first display screen; the first display screen being used to: in response to the pointing position moving within a third display range of the first display screen, control a cursor to synchronously move by a second amplitude on the first display screen, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance.

[0030] In some embodiments, the first pointing device is a remote control, and may also be a mobile phone with a pointing function, or may be other devices with a pointing function, which is not limited in the present application.

[0031] In some embodiments, the first display screen is a display screen of a large-screen device.

[0032] In some embodiments, the first amplitude, the second amplitude, and the third amplitude may be distance amplitudes or angle amplitudes at the same time.

[0033] The pointing position may also be described as the intersection position of the direction pointed by the first pointing device and the first display screen.

[0034] In an embodiment of the present application, the spatial perception ability of the pointing device can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the sensitivity of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen, thereby achieving the filtering effect of the cursor adaptively adjusted according to the distance between the pointing device and the large screen.

[0035] In combination with the third aspect, in a possible implementation, the first pointing device is specifically used to: when the pointing position moves on the first display screen, determine a damping coefficient based on the distance between the first pointing device and the first display screen, and the damping coefficient is negatively correlated with the distance between the first pointing device and the first display screen; and adjust the display position of the cursor based on the damping coefficient.

[0036] In some embodiments, the damping coefficient is greater than 0 and the damping coefficient is less than or equal to 1.

[0037] In the embodiment of the present application, the spatial perception ability of the pointing device can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen, thereby achieving adjustment of the sensitivity of the cursor, and then the cursor jitter filtering effect can be adaptively adjusted with the distance between the pointing device and the large screen, so that the user can get the experience of non-jittery cursor movement using the remote control in any position.

[0038] In combination with the third aspect, in a possible implementation method, the first pointing device is specifically used to: determine the damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device corresponding to the i-th frame and the first display screen, and i is a natural number, i=1,2,3...; determine the x variable corresponding to the i-th frame and the y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is the change of the horizontal coordinate of the pointing position corresponding to the i-th frame relative to the horizontal coordinate of the pointing position corresponding to the i-1-th frame, and the y variable corresponding to the i-th frame is the change of the vertical coordinate of the pointing position corresponding to the i-th frame relative to the vertical coordinate of the pointing position corresponding to the i-1-th frame; determine the cursor coordinates corresponding to the i-th frame according to the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame; the first display screen is specifically used to: display the cursor corresponding to the i-th frame on the first display screen according to the cursor coordinates corresponding to the i-th frame.

[0039] In some embodiments, the first pointing device is specifically used to: determine the sum of a first product and the horizontal coordinate of the cursor coordinate corresponding to the i-1th frame as the horizontal coordinate of the cursor coordinate corresponding to the i-th frame, and the first product is the product of the damping coefficient corresponding to the i-th frame and the x variable corresponding to the i-th frame; determine the sum of a second product and the vertical coordinate of the cursor coordinate corresponding to the i-1th frame as the vertical coordinate of the cursor coordinate corresponding to the i-th frame, and the second product is the product of the damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

[0040] In the embodiment of the present application, the spatial perception ability of the pointing device can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen. The position of the cursor display can be adjusted according to the adjusted damping coefficient, thereby achieving the adaptive adjustment of the cursor jitter filtering effect with the distance between the pointing device and the large screen, so that the user can get the experience of non-jittering cursor movement using the remote control in any position.

[0041] In combination with the third aspect, in a possible implementation, the first pointing device is specifically used to: determine a damping coefficient based on the distance between the first pointing device and the first display screen, and a posture change value of the first pointing device, and the damping coefficient is positively correlated with the posture change value of the first pointing device.

[0042] In the embodiment of the present application, the spatial perception ability of the pointing device can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen and the change in the posture of the pointing device, thereby achieving the adjustment of the cursor sensitivity, and then the cursor jitter filtering effect can be adaptively adjusted as the distance between the pointing device and the large screen and the change in the posture of the pointing device change, so that the user can use the remote control in any position to obtain the experience of small cursor movements without jitter and large cursor movements without delay. Because the user generally moves to the vicinity of the control at high speed when making a refined pointing selection, and then makes a slow adjustment to accurately select the control, this method can be well applied to scenarios where the user performs refined operations on the large screen.

[0043] In combination with the third aspect, in a possible implementation method, the first pointing device is specifically used to: determine a first damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame and the first posture change value corresponding to the i-th frame; determine a second damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame and the second posture change value corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, i is a natural number, i=1,2,3…; determine an x ​​variable corresponding to the i-th frame and a y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is the distance between the first pointing device and the first display screen corresponding to the i-th frame, and i is a natural number, i=1,2,3…; determine an x ​​variable corresponding to the i-th frame and a y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is the distance between the first pointing device and the first display screen corresponding to the i-th frame. The change of the horizontal coordinate of the corresponding pointing position relative to the horizontal coordinate of the pointing position corresponding to the i-1th frame, and the y variable corresponding to the i-th frame is the change of the vertical coordinate of the pointing position corresponding to the i-th frame relative to the vertical coordinate of the pointing position corresponding to the i-1th frame; the cursor coordinates corresponding to the i-th frame are determined according to the first damping coefficient corresponding to the i-th frame, the second damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1th frame, the x variable corresponding to the i-th frame and the y variable corresponding to the i-th frame; the first display screen is specifically used to: display the cursor corresponding to the i-th frame on the first display screen according to the cursor coordinates corresponding to the i-th frame.

[0044] In some embodiments, the first posture change value corresponding to the i-th frame includes the change value of the azimuth angle of the first pointing device relative to the posture corresponding to the i-1-th frame, and the second posture change value corresponding to the i-th frame includes the change value of the pitch angle of the first pointing device relative to the posture corresponding to the i-1-th frame.

[0045] In some embodiments, the first pointing device is specifically used to: determine the sum of the third product and the horizontal coordinate of the cursor coordinate corresponding to the i-1th frame as the horizontal coordinate of the cursor coordinate corresponding to the i-th frame, and the third product is the product of the first damping coefficient corresponding to the i-th frame and the x variable corresponding to the i-th frame; determine the sum of the fourth product and the vertical coordinate of the cursor coordinate corresponding to the i-1th frame as the vertical coordinate of the cursor coordinate corresponding to the i-th frame, and the fourth product is the product of the second damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

[0046] In the embodiment of the present application, the pointing device's ability to perceive space can be utilized to perceive the spatial relationship between the pointing device and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the distance between the pointing device and the large screen and the change in the posture of the pointing device. The position of the cursor display can be adjusted according to the adjusted damping coefficient, thereby enabling the cursor jitter filtering effect to be adaptively adjusted as the distance between the pointing device and the large screen and the change in the posture of the pointing device change. This allows the user to use the remote control in any position to obtain the experience of small cursor movements without jitter and large cursor movements without delay. Because the user generally moves to the vicinity of the control at high speed when making a refined pointing selection, and then makes a slow adjustment to accurately select the control, this method can be well suited for scenarios where the user performs refined operations on the large screen.

[0047] In combination with the third aspect, in a possible implementation, the first pointing device is specifically used to: when the pointing position moves on the first display screen, determine the position and posture of the first pointing device in real time, the position of the first pointing device is used to obtain the distance between the first pointing device and the first display screen, and the posture of the first pointing device is used to obtain the posture change value of the first pointing device.

[0048] In a fourth aspect, an electronic device is provided, comprising a memory and a processor, wherein the memory is used to store computer program code, and the processor is used to execute the computer program code stored in the memory to implement the method in the above-mentioned first aspect or any possible implementation of the first aspect, or to implement the above-mentioned second aspect or any possible implementation of the second aspect.

[0049] In a fifth aspect, a computer-readable storage medium is provided, which stores a computer program or instruction. When the computer program or instruction is executed, it implements the method in the first aspect or any possible implementation of the first aspect, or implements the method in the second aspect or any possible implementation of the second aspect.

[0050] In a sixth aspect, a chip is provided, in which instructions are stored. When the chip is executed on a device, the chip executes the method in the first aspect or any possible implementation of the first aspect, or executes the method in the second aspect or any possible implementation of the second aspect.

[0051] In the seventh aspect, a computer program product is provided, in which a computer program or instruction is stored. When the computer program or instruction is executed, the method in the first aspect or any possible implementation of the first aspect is implemented, or the method in the second aspect or any possible implementation of the second aspect is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application;

[0053] Figure 2 is a structural schematic diagram of another electronic device provided in an embodiment of the present application;

[0054] Figure 3 is a structural schematic diagram of another electronic device provided in an embodiment of the present application;

[0055] Figure 4 This is a usage scenario of a directional remote control provided in an embodiment of the present application;

[0056] Figure 5 It is a schematic diagram of a cursor movement sensitivity changing with the use distance provided by an embodiment of the present application;

[0057] Figure 6 It is a schematic diagram of a scenario in which a pointing remote controller performs cursor control at different use distances provided in an embodiment of the present application;

[0058] Figure 7 This is a schematic diagram of an application scenario corresponding to the solution of the present application provided in an embodiment of the present application;

[0059] Figure 8 This is a schematic diagram of another application scenario corresponding to the solution of the present application provided in an embodiment of the present application;

[0060] Fig. 9 This is a schematic diagram comparing the cursor control effects of the present application solution and the existing solution provided in an embodiment of the present application;

[0061] Fig.10 is a schematic flow chart of a cursor control method provided in an embodiment of the present application;

[0062] Fig.11 is a schematic flow chart of another cursor control method provided in an embodiment of the present application;

[0063] Fig.12 is a schematic flow chart of another cursor control method provided in an embodiment of the present application;

[0064] Fig.13 is a schematic flow chart of another cursor control method provided in an embodiment of the present application;

[0065] Fig.14 is an interactive schematic diagram of a cursor control method provided in an embodiment of the present application;

[0066] Fig.15It is a curve relationship diagram between the damping coefficient and the posture change value of each frame when the distance between the remote control and the large screen is constant, provided by an embodiment of the present application;

[0067] Fig.16 A curve relationship diagram between a damping coefficient and a distance between a remote control and a large screen provided in an embodiment of the present application when a posture change value of a remote control per frame is constant;

[0068] Fig.17 It is a schematic diagram of the positional relationship between several large-screen devices and UWB base stations provided in the embodiments of the present application;

[0069] Fig.18 is a schematic diagram of the arrangement of several first antenna arrays provided in an embodiment of the present application;

[0070] Fig.19 is a diagram of the arrangement state of a second antenna array on a remote control provided in an embodiment of the present application;

[0071] Fig. 20 It is a spatial coordinate system established with a UWB base station as the coordinate origin provided in an embodiment of the present application;

[0072] Fig.21 It is a spatial coordinate system provided by an embodiment of the present application, which is established with the center of the remote control as the coordinate origin;

[0073] Fig. 22 The embodiment of the present application provides a method for measuring the azimuth angle ψ and the pitch angle of the remote control. and a schematic diagram of the roll angle θ;

[0074] Fig.23 It is a functional module diagram of a cursor control system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0075] The technical solution in the present application will be described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments.

[0076] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "plurality" or "multiple" refers to two or more than two.

[0077] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0078] The terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one, two or more. The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0079] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application. Thus, the phrases "one embodiment", "some embodiments", "another embodiment", "some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized.

[0080] The method provided in the embodiments of the present application can be applied to electronic devices such as mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), etc. The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

[0081] For example, Figure 1The schematic diagram of the structure of the electronic device 100 is shown. The electronic device 100 may include a wireless communication module 110, an antenna 1, a processor 120, a speaker 130, a power management module 140, an internal memory 150, a display screen 160, and the like.

[0082] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure (for example, it may also include an external memory interface, a battery, a frequency module, a sensor module, etc.), or combine certain components, or split certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0083] The wireless communication module 110 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 110 can be one or more devices integrating at least one communication processing module. The wireless communication module 110 receives electromagnetic waves via the antenna 1, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 120. The wireless communication module 110 can also receive the signal to be sent from the processor 120, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 1.

[0084] The processor 120 may include one or more processing units, for example, the processor 120 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0085] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0086] The processor 120 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 120 is a cache memory. The memory may store instructions or data that the processor 120 has just used or cyclically used. If the processor 120 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 120, and thus improves the efficiency of the system.

[0087] In some embodiments, the processor 120 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0088] Antenna 1 is used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0089] The speaker 130 , also called a “loudspeaker”, is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 130 .

[0090] The power management module 140 is used to connect to the processor 120. The power management module 140 receives input from the battery and / or the charging management module to power the processor 120, the internal memory 150, the speaker 130, the display screen 160, and the wireless communication module 110. The power management module 140 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 140 can also be set in the processor 120. In other embodiments, the power management module 140 and the charging management module can also be set in the same device.

[0091] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the wireless communication module 110, etc.

[0092] The internal memory 150 can be used to store computer executable program codes, which include instructions. The processor 120 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 150. The internal memory 150 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, at least one App required for a function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 150 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0093] The electronic device 100 implements the display function through a GPU, a display screen 160, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 160 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 120 may include one or more GPUs, which execute program instructions to generate or change display information.

[0094] The display screen 160 is used to display images, videos, etc. The display screen 160 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 160, where N is a positive integer greater than 1.

[0095] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.

[0096] In some embodiments, the electronic device 100 may be a large-screen device.

[0097] For example, Figure 2 : shows a schematic diagram of the structure of the electronic device 200. The electronic device 200 may include a wireless communication module 210, an antenna 2, an antenna 3, an antenna 4, an antenna 5, an antenna 6, an ultra wide band (UWB) module 220, a processor 230, an internal memory 240, a power management module 250, a power supply 260, a sensor module 270, and the like.

[0098] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0099] The wireless communication module 210 can provide solutions for wireless communication including WLAN (such as Wi-Fi network), BT, GNSS, FM, NFC, IR, etc. applied to the electronic device 200. The wireless communication module 210 can be one or more devices integrating at least one communication processing module. The wireless communication module 210 receives electromagnetic waves via the antenna 3, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 230. The wireless communication module 210 can also receive the signal to be sent from the processor 230, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through the antenna 3.

[0100] In some embodiments, the antenna 2, the antenna 3 and the wireless communication module 210 of the electronic device 200 are coupled, so that the electronic device 200 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long-term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite based augmentation system (SBAS).

[0101] The UWB module 220 can provide UWB communication, ranging and other solutions applied to UWB tag devices. When the electronic device 200 integrates a UWB transmitting antenna (such as antenna 4) and multiple UWB receiving antennas (such as antenna 5 and antenna 6), the posture measurement of the electronic device 200 can be achieved based on the UWB signal.

[0102] The processor 230 may include one or more processing units, for example, the processor 230 may include an application processor, a modem processor, a graphics processor, an ISP, a controller, a memory, a video codec, a DSP, a baseband processor, and / or an NPU, etc. Different processing units may be independent devices or integrated into one or more processors.

[0103] In some embodiments, the processor 230 is used to process the communication or ranging information output by the UWB module 220, and the processor 230 is also responsible for calculating the positioning result of the UWB tag.

[0104] The controller may be the nerve center and command center of the electronic device 200. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0105] The processor 230 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 230 is a cache memory. The memory may store instructions or data that the processor 230 has just used or cyclically used. If the processor 230 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 230, and thus improves the efficiency of the system.

[0106] In some embodiments, the processor 230 may include one or more interfaces. The interface may include an I2C interface, an I2S interface, a PCM interface, a UART interface, a MIPI, a GPIO interface, a SIM interface, and / or a USB interface, etc.

[0107] Antenna 2 and antenna 3 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 2 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0108] The internal memory 240 can be used to store computer executable program codes, which include instructions. The processor 230 executes various functional applications and data processing of the electronic device 200 by running the instructions stored in the internal memory 240. The internal memory 240 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, at least one App required for a function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 200 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 240 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a UFS, etc.

[0109] The power management module 250 is used to connect to the processor 230. The power management module 250 receives input from the battery 260 and / or the charging management module to power the processor 230, the internal memory 240, the wireless communication module 210, the UWB module 220, and the sensor module 270. The power management module 250 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 250 can also be set in the processor 230. In some other embodiments, the power management module 250 and the charging management module can also be set in the same device.

[0110] The wireless communication function of the electronic device 200 can be implemented through antenna 2, antenna 3, antenna 4, antenna 5, antenna 6, wireless communication module 210, UWB module 220, modem processor and baseband processor.

[0111] The sensor module 270 may include a gyro sensor 271 , an acceleration sensor 272 , a geomagnetic sensor 273 , and the like.

[0112] In some embodiments, the sensor module 270 is used to output the azimuth, pitch and roll angle information of the UWB tag.

[0113] The software system of the electronic device 200 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.

[0114] In some embodiments, the electronic device 200 is a pointing device, for example, a pointing remote control.

[0115] For example, Figure 3Schematic diagram of the structure of the electronic device 300 is shown. The electronic device 300 may include a wireless communication module 310, antenna 7, antenna 8, antenna 9, antenna 10, antenna 11, a UWB module 320, a processor 330, an internal memory 340, a drive motor 350, a power management module 360, a power supply 370, and the like.

[0116] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 300. In other embodiments of the present application, the electronic device 300 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0117] The wireless communication module 310 can provide solutions for wireless communication including WLAN (such as Wi-Fi network), BT, GNSS, FM, NFC, IR, etc. applied to the electronic device 300. The wireless communication module 310 can be one or more devices integrating at least one communication processing module. The wireless communication module 310 receives electromagnetic waves via the antenna 8, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 330. The wireless communication module 310 can also receive the signal to be sent from the processor 330, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through the antenna 8.

[0118] In some embodiments, the antenna 7, antenna 8 and wireless communication module 310 of the electronic device 300 are coupled, so that the electronic device 300 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include GSM, GPRS, CDMA, WCDMA, TD-SCDMA, LTE, BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include GPS, GLONASS, BDS, QZSS and / or SBAS.

[0119] The UWB module 320 can provide UWB communication, ranging and other solutions applied to the electronic device 300. It should be noted that the electronic device 300 can only be equipped with one UWB signal receiving antenna, and in this case, at least three electronic devices 300 are required to achieve three-dimensional positioning of the UWB tag. In another implementation scheme, the electronic device 300 can be equipped with multiple UWB signal receiving antennas, and the arrangement between the antennas needs to meet certain rules. In this implementation scheme, at least two UWB receiving antennas are required to achieve two-dimensional positioning of the UWB tag, and at least three UWB receiving antennas (such as antenna 9, antenna 10 and antenna 11) are required to achieve three-dimensional positioning of the tag. In addition, the electronic device 300 only needs to be equipped with one UWB transmitting antenna.

[0120] The processor 330 may include one or more processing units, for example, the processor 330 may include an application processor, a modem processor, a graphics processor, an ISP, a controller, a memory, a video codec, a DSP, a baseband processor, and / or an NPU, etc. Different processing units may be independent devices or integrated into one or more processors.

[0121] In some embodiments, the processor 330 is used to process the communication or ranging information output by the UWB module 220. The processor 230 is also responsible for calculating the positioning result of the UWB tag.

[0122] The controller may be the nerve center and command center of the electronic device 300. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0123] The processor 330 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 330 is a cache memory. The memory may store instructions or data that the processor 330 has just used or cyclically used. If the processor 330 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 330, and thus improves the efficiency of the system.

[0124] In some embodiments, the processor 330 may include one or more interfaces. The interface may include an I2C interface, an I2S interface, a PCM interface, a UART interface, a MIPI, a GPIO interface, a SIM interface, and / or a USB interface, etc.

[0125] Antenna 7 and antenna 8 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 300 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 7 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0126] The internal memory 340 can be used to store computer executable program codes, which include instructions. The processor 330 executes various functional applications and data processing of the electronic device 300 by running the instructions stored in the internal memory 340. The internal memory 340 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an App required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 300 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 340 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a UFS, etc.

[0127] The power management module 360 ​​is used to connect to the processor 330. The power management module 360 ​​receives input from the battery 370 and / or the charging management module to power the processor 330, the internal memory 340, the wireless communication module 310, the UWB module 320, and the drive motor 350. The power management module 360 ​​can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 360 ​​can also be set in the processor 330. In other embodiments, the power management module 360 ​​and the charging management module can also be set in the same device.

[0128] The wireless communication function of the electronic device 300 can be realized through antenna 7, antenna 8, antenna 9, antenna 10, antenna 11, wireless communication module 310, UWB module 320, modem processor and baseband processor.

[0129] The software system of the electronic device 300 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.

[0130] In some embodiments, the electronic device 300 is a UWB base station.

[0131] It should be understood that the technical solutions in the embodiments of the present application can be used in Android, IOS, Hongmeng and other systems.

[0132] The technical solution of the embodiment of the present application can be applied to devices with cursor control functions and electronic devices with screens. For example, it can be applied to pointing remote controls or other devices with pointing remote control functions, large-screen devices, etc. It can also be applied to other devices with cursor control functions, electronic devices in 5G networks, or electronic devices in future public land mobile networks (PLMN), etc. The main application scenario can be the control scenario of the cursor through a pointing remote control, for example, the movement of the cursor on the large screen can be controlled by a pointing remote control, thereby realizing shooting games, fruit cutting games, painting, etc. on the large screen.

[0133] In order to more clearly understand the directional remote control, for example, in combination with Figure 4 , the usage scenarios of the directional remote control provided in the embodiments of the present application are introduced in detail.

[0134] like Figure 4 As shown, the cursor 420 displayed on the display screen of the large-screen device 400 can be controlled by the pointing remote control 410. The display position of the cursor 420 is the same as the position on the display screen pointed by the pointing remote control 410, that is, the cursor 420 is displayed at the position on the display screen where the pointing remote control 410 points.

[0135] like Figure 4 As shown in (a) in FIG. 1 , when the pointing remote controller 410 switches from pointing at position A in the display screen to pointing at position B in the display screen, the display position of the cursor 420 also switches from position A to position B; Figure 4 As shown in (b) in FIG. 8 , when the pointing remote controller 410 points to outside the display screen of the large-screen device 400 , no cursor is displayed on the display screen of the large-screen device 400 .

[0136] The user experience of the pointing remote control is similar to that of an infrared laser pen, and the pointing remote control can interact with the content displayed on the display screen by controlling the movement of the cursor on the display screen, thereby enhancing the interactive experience between the user and the large screen. For example, the user can use the pointing remote control to play shooting games, fruit cutting games, etc. on the large screen, which is more in line with the user's usage habits.

[0137] Further, Figure 5 A schematic diagram showing changes in sensitivity of cursor movement during use of a pointing remote controller provided by an embodiment of the present application is shown.

[0138] like Figure 5As shown, after the pointing remote control is horizontally rotated by an angle of α at position 1, the pointing position of the pointing remote control in the display screen of the large-screen device 500 moves from position 3 to position 4, and synchronously, the display position of the cursor also moves from position 3 to position 4, the distance between position 3 and position 4 is L1, and the distance from position 1 to the display screen of the large-screen device 500 is d1; after the position of the pointing remote control is moved from position 1 to position 2 farther away from the display screen, when the pointing remote control undergoes the same posture change as at position 1 (horizontally rotated by an angle of α), the pointing position of the pointing remote control in the display screen of the large-screen device 500 moves from position 5 to position 6, and synchronously, the display position of the cursor also moves from position 6 to position 6, the distance between position 5 and position 6 is L2, L2 is obviously larger than L1, and the distance from position 2 to the display screen of the large-screen device 500 is d2.

[0139] It can be seen that, when the posture change of the pointing remote control is the same, the farther the pointing remote control is from the display screen, the larger the range of movement of the cursor on the display screen.

[0140] Here we can introduce the sensitivity s of the cursor to measure the above phenomenon. When the resolution K and screen size L of the large-screen device remain unchanged, the sensitivity s of the cursor and the distance d between the remote pointing controller and the display screen are in the following relationship:

[0141]

[0142] It can be seen that s and d are in a monotonically increasing relationship. When using a pointing remote control, the sensitivity of the cursor movement gradually increases with the increase of the use distance. That is, when the posture change of the pointing remote control is the same, the farther the distance between the remote control and the large screen is, the larger the movement range of the cursor.

[0143] For example, taking the interaction scene between the pointing remote control and the display screen as a document marking scene, Figure 6 A schematic diagram of a scenario in which a pointing remote controller provided by an embodiment of the present application performs cursor control at different usage distances is shown.

[0144] If the user wishes to control the cursor to mark the content of the first subtitle by using the pointing remote control, the user can control the movement trajectory of the pointing position of the pointing remote control on the display screen by controlling the gesture change of the pointing remote control, thereby realizing the control of the movement trajectory of the display cursor. The movement trajectory of the display cursor is the final displayed mark, such as Figure 6 As shown in (a) in FIG. 5 , when the distance between the pointing remote control and the display screen is short, the user can accurately mark the content of the first subtitle; however, Figure 6As shown in (b) in the figure, when the distance between the pointing remote control and the display screen is long, due to the high sensitivity of the cursor movement, a small change in the posture of the pointing remote control can cause the cursor to move a long distance on the display screen. When marking the document, the marking range can easily expand to the content that does not need to be marked, and it is difficult for the user to accurately mark the content of the first subheading.

[0145] Therefore, when the user uses a large screen through a pointing remote control at a long distance, a small-scale hand shake will cause the cursor to move over a large range. When the target control area of ​​the cursor is small, it is difficult to control the cursor to move accurately to the target control. This also makes it impossible for the user to smoothly use the pointing remote control to control the cursor to perform fine operations in a small range, such as drawing, document marking, etc., which seriously affects the user experience.

[0146] In response to the above problems, in some embodiments, a single empty mouse method can be used to realize the control of the cursor by the remote control. In this method, the remote control has no pointing effect, and there is no correlation between the pointing position of the remote control and the cursor display position. No matter where the remote control points, the cursor is displayed on the display screen; in this method, the sensitivity of the cursor moving on the display screen is a constant value and has nothing to do with the distance of the remote control from the display screen. Although this method can alleviate the jitter problem caused by the high sensitivity of the cursor to a certain extent, in this method, the position of the cursor display is a relative coordinate, not an absolute coordinate. During use, the user needs to frequently click the frame to manually control the cursor. This method cannot be applied to pointing remote controls and cannot solve the cursor jitter problem that occurs during the use of pointing remote controls.

[0147] Therefore, in the current cursor control method, when the user uses the remote control to control the movement of the cursor at different distances, the cursor jitter filtering effect cannot be adaptively adjusted, which seriously affects the user experience.

[0148] In view of this, the embodiments of the present application provide a cursor control method, electronic device and system. Through this method, electronic device and system, when the distance between a pointing remote control and a display screen changes, the sensitivity of the corresponding cursor can be adaptively changed so that the movement speed and movement range of the cursor are adapted to the current usage distance and posture changes of the pointing remote control, thereby enabling the user to adaptively adjust the cursor jitter effect when using the remote control at different distances.

[0149] It should be understood that in the embodiments of the present application, the pointing device is described as a pointing type remote control, but this does not constitute any limitation on the scope of application of the present application scheme, and the pointing device can also be any device with a pointing function.

[0150] For example, Figure 7A schematic diagram of an application scenario corresponding to the solution of the present application provided in an embodiment of the present application is shown.

[0151] If the user wants to control the cursor to mark the content of the first subtitle through a pointing remote control, the user can control the posture changes of the pointing remote control to control the moving trajectory of the pointing position of the pointing remote control on the display screen, and then control the moving trajectory of the displayed cursor. The moving trajectory of the displayed cursor is the final displayed mark.

[0152] like Figure 7 As shown in (a), when the distance between the pointing remote control and the display screen is D1 (D1 is close enough, for example, D1 is less than 0.5m), when the user wants to mark the content of the first subtitle, that is, wants to control the movement trajectory of the cursor to draw a circle around the content of the first subtitle within the range 701, since the sensitivity of the cursor movement is not high at this time, the damping coefficient of the cursor corresponding to the distance D1 is relatively large, for example, the damping coefficient is 1, and the user needs to control the pointing position of the pointing remote control on the display screen to draw a circle around the content of the first subtitle within the range 701 to achieve this. At this time, the movement trajectory of the pointing position and the movement trajectory of the cursor are almost overlapped.

[0153] like Figure 7 As shown in (b) of FIG. 1 , when the distance between the pointing remote control and the display screen changes from D1 to D2 (D2 is greater than D1), when the user wants to mark the content of the first subtitle, that is, when the user wants to control the movement trajectory of the cursor to draw a circle around the content of the first subtitle within the range 701, compared with Figure 7 The distance D1 shown in (a) in FIG. 1 is higher than that in FIG. 1 . At this time, the sensitivity of the cursor movement is higher. Correspondingly, the damping coefficient of the cursor is reduced. It is only necessary to control the pointing position of the pointing remote control on the display screen to draw a circle around the content of the first subtitle within the range 702. At this time, the distribution range corresponding to the trajectory of the pointing position movement is the range 702 ( Figure 7 (the range shown by the dotted line in (b)), range 702 includes range 701, and range 702 is larger than range 701.

[0154] Further, such as Figure 7 As shown in (b) of FIG. 1 , when the distance between the pointing remote control and the display screen changes from D2 to D3 (D3 is greater than D2), when the user wants to mark the content of the first subtitle, that is, when the user wants to control the movement trajectory of the cursor to draw a circle around the content of the first subtitle within the range 701, compared with Figure 7The distance D2 shown in (b) in the figure, at this time, the cursor movement sensitivity is higher. Correspondingly, the damping coefficient of the cursor is further reduced. The user only needs to control the pointing position of the pointing remote control on the display screen to draw a circle around the content of the first subtitle within the range 703 to achieve this. At this time, the distribution range corresponding to the trajectory of the pointing position movement is range 703 ( Figure 7 (the range shown by the dotted line in (c)), range 703 includes range 701, range 703 is greater than range 702, and range 703 includes range 701.

[0155] It should be understood that the smaller the damping coefficient of the cursor is, the smaller the ratio of the displacement of the cursor per frame to the displacement of the pointing position per frame is.

[0156] In some embodiments, when adjusting the damping coefficient of the cursor according to the distance between the remote control and the large screen, the damping coefficient of the cursor can be further adjusted in combination with the user's control state of the remote control. For example, the damping coefficient of the cursor is further adjusted in combination with the moving speed of the pointing position of the remote control on the large screen or the posture change of the remote control. The faster the moving speed of the pointing position, the smaller the adjustment force of the damping coefficient of the cursor, and the slower the moving speed of the pointing position, the greater the adjustment force of the damping coefficient of the cursor; the faster the posture change of the remote control, the smaller the adjustment force of the damping coefficient of the cursor, and the slower the posture change of the remote control, the greater the adjustment force of the damping coefficient of the cursor.

[0157] It can be understood that: when the pointing position moves, the cursor starts to move, and when the pointing position stops moving, the cursor stops moving.

[0158] In an embodiment of the present application, the spatial perception ability of the pointing remote control can be utilized to perceive the spatial relationship between the cursor and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the measured position information of the remote control relative to the large screen, thereby achieving the cursor jitter filtering effect adaptively adjusted according to the distance between the remote control and the large screen and / or the control state of the remote control.

[0159] For example, taking the control control scene as an example, Figure 8 A schematic diagram of an application scenario corresponding to another solution of the present application provided in an embodiment of the present application is shown.

[0160] If the user wishes to control the cursor 801 to move from control "A" to control "B" through a pointing remote control, the user can control the movement of the pointing position of the pointing remote control on the display screen by controlling the posture changes of the pointing remote control, thereby achieving control over the movement of the displayed cursor 801.

[0161] like Figure 8As shown in (a), when the distance between the pointing remote control and the display screen is a first distance, when the user wants to control the cursor 801 to move from control "A" to control "B", the user can achieve this by moving the pointing position of the remote control on the large screen 800 to position 802, without having to move the pointing position of the remote control on the large screen 800 to the position of control "B".

[0162] It can be understood that: in the embodiment of the present application, when the pointing position of the remote control on the large screen starts to move, the cursor starts to move synchronously, and the ratio of the speed of the cursor movement to the speed of the pointing position movement (less than or equal to 1) decreases as the distance between the remote control and the large screen increases, that is, the damping coefficient of the cursor decreases as the distance between the remote control and the large screen increases, and when the pointing position stops moving, the cursor stops moving synchronously.

[0163] like Figure 8 As shown in (b) of FIG. 1 , when the distance between the pointing remote control and the display screen increases to a second distance, when the user wishes to control the cursor 801 to move from control “A” to control “B”, compared to Figure 8 In (a), since the distance between the remote control and the large screen increases, the damping coefficient of the corresponding cursor is further reduced, so that the user can achieve it by moving the pointing position of the remote control on the large screen 800 to position 803, instead of moving the pointing position of the remote control on the large screen 800 to the position of control "B", wherein the distance between position 803 and control "B" is greater than the distance between position 802 and space "B".

[0164] In some embodiments, when adjusting the damping coefficient of the cursor according to the distance between the remote control and the large screen, the damping coefficient of the cursor can be further adjusted in combination with the user's control state of the remote control. For example, the damping coefficient of the cursor is further adjusted in combination with the moving speed of the pointing position of the remote control on the large screen or the posture change of the remote control. The faster the moving speed of the pointing position, the smaller the adjustment force of the damping coefficient of the cursor, and the slower the moving speed of the pointing position, the greater the adjustment force of the damping coefficient of the cursor; the faster the posture change of the remote control, the smaller the adjustment force of the damping coefficient of the cursor, and the slower the posture change of the remote control, the greater the adjustment force of the damping coefficient of the cursor.

[0165] In the current cursor control method, when the user uses the remote control at a distant location, such as 5m away from the large screen, if the cursor needs to be moved from control "A" to control "B" on the screen, the physical distance between the two controls is 0.1m, and the user needs to accurately control the remote control to rotate 1° to complete the operation. This operation is difficult and easy to deviate. However, in the embodiment of the present application, due to the increase in cursor damping, the user can move the cursor from control "A" to control "B" by controlling the remote control to rotate a larger angle, such as controlling the remote control to rotate 5°, while the cursor displayed on the screen only moves 1°, which significantly reduces the difficulty of the user's cursor control operation.

[0166] In an embodiment of the present application, the spatial perception ability of the pointing remote control can be utilized to perceive the spatial relationship between the cursor and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the measured position information of the remote control relative to the large screen, thereby achieving the cursor jitter filtering effect adaptively adjusted according to the distance between the remote control and the large screen and / or the control state of the remote control.

[0167] For example, Fig. 9 A schematic diagram comparing the cursor control effects of a solution of the present application and an existing solution provided in an embodiment of the present application is shown.

[0168] If the user wishes to control the cursor to move to control "A" via a pointing remote control, the user may control the movement of the pointing position of the pointing remote control on the display screen by controlling the posture change of the pointing remote control, thereby achieving control over the movement of the display cursor 901.

[0169] Fig. 9 (a) in the figure shows a schematic diagram of cursor movement when the distance between the remote control and the large screen is a first distance in the existing solution.

[0170] like Fig. 9 As shown in (a), when the user wants to control the cursor 901 to move from the display area outside the control "A" to the control "A", the user first quickly switches the remote control control posture to quickly move the pointing position toward the control "A", and then controls the remote control posture to slowly change after approaching the control "A" to slowly move the pointing position so that the cursor can finally stay on the control "A". However, since the movement trajectory of the cursor is the same as the movement trajectory of the pointing position, when the remote control is far away from the large screen, the sensitivity of the cursor movement is high, and when moving slowly in a small range, the sensitivity of the cursor movement is much higher than the user's expectation, and severe cursor jitter will occur, making it difficult for the user to control the cursor to be accurately displayed on the control "A".

[0171] Fig. 9 (b) shows a schematic diagram of cursor movement when the distance between the remote control and the large screen is a first distance provided by an embodiment of the present application.

[0172] like Fig. 9 As shown in (b), when the user wants to control the cursor 901 to move from the display area outside the control "A" to the control "A", the user first quickly switches the remote control control posture to quickly move the pointing position to the control "A", and controls the remote control posture to change slowly after approaching the control "A" to slowly move the pointing position so that the cursor can finally stay on the control "A", wherein, since the damping coefficient of the cursor can be adaptively adjusted according to the distance between the remote control and the large screen and the control state of the remote control during the cursor movement, the sensitivity of the cursor movement matches the user's expected value, specifically: when the pointing position moves quickly to the control "A", the sensitivity of the cursor movement is not adjusted (the damping coefficient of the cursor is 1) or the sensitivity of the cursor movement is adjusted only based on the distance between the remote control and the large screen, which enables the cursor to follow the pointing position and quickly move near the control "A", when the moving speed of the pointing position slows down, the damping coefficient of the cursor is adaptively reduced based on the distance between the remote control and the large screen and the speed of the remote control posture change, so that the range of the cursor movement is smaller than the range of the pointing position movement, which can reduce the degree of cursor jitter, and thus achieve the adaptive adjustment of the cursor jitter filtering effect.

[0173] It can be seen that when the user quickly points to the control "A", a small range of jitter will occur because the user's remote control changes from rapid posture changes to slow changes. In the existing solution scenario, the cursor jitters severely and may shake out of the response area of ​​the control "A", causing the control to fail to click. In the embodiment of the present application, since the damping effect is added in the small range movement, the jitter range of the cursor is significantly suppressed, and the controllability of the cursor is significantly improved.

[0174] In the embodiments of the present application, the spatial perception ability of the pointing remote control can be utilized to perceive the spatial relationship between the cursor and the interactive large screen in real time, and the damping coefficient of the cursor can be adaptively adjusted according to the measured position information of the remote control relative to the large screen, thereby achieving adjustment of the sensitivity of the cursor, and then being able to adaptively adjust the cursor jitter effect according to the distance between the remote control and the large screen and / or the control state of the remote control, so that the user can use the remote control in any position to obtain the experience of small cursor movements without jitter and large cursor movements without delay. Because the user generally moves to the vicinity of the control at high speed when making a refined pointing selection, and then makes a slow adjustment to accurately select the control, this method can be well suited for scenarios where the user performs refined operations on the large screen.

[0175] It should be understood that the above is an exemplary introduction to the scheme of the embodiment of the present application using document marking scenarios and control interaction scenarios. The scheme of the present application can be applied to any scenario of interaction between a pointing device and display screen content. For example, it can also be applied to scenarios such as painting and playing games on a large screen through a pointing device. The present application does not limit this.

[0176] For example, Fig.10 FIG. 1 is a schematic flow chart of a cursor control method 1000 provided in an embodiment of the present application. Fig.10 As shown, the method 1000 includes:

[0177] S1001: When the distance between the remote control and the large screen is a first distance, in response to the user controlling the pointing position of the remote control on the display screen to move within a first display range through the remote control, the cursor synchronously moves within a second display range on the display screen, wherein the first display range includes the second display range.

[0178] Among them, the remote control described in the embodiments of the present application can be understood as a directional remote control.

[0179] The pointing position may also be described as the intersection of the direction pointed by the remote control and the display screen of the large screen.

[0180] The first display range refers to the distribution range of the movement track corresponding to the pointing position, and the second display range refers to the distribution range of the movement track corresponding to the cursor.

[0181] It can also be understood that: the moving track of the pointing position in the first display range is the first track, the moving track of the cursor in the second display range is the second track, and the length of the first track is greater than the length of the second track.

[0182] S1002: When the distance between the remote control and the large screen is switched to a second distance, in response to the pointing position of the remote control on the display screen being controlled to move within a third display range through the remote control, the cursor synchronously moves within a second display range on the display screen, wherein the third display range includes the first display range, and the second distance is greater than the first distance.

[0183] The third display range refers to the distribution range of the moving track corresponding to the pointing position.

[0184] The third display range includes the first display range, and the first display range includes the second display range, which means that the third display range is larger than the first display range, and the first display range is larger than the second display range.

[0185] It can also be understood that: the movement trajectory of the pointing position in the third display range is the third trajectory, the length of the third trajectory is greater than the length of the first trajectory, and the length of the first trajectory is greater than the length of the second trajectory.

[0186] That is to say, when the distance between the remote control and the large screen is a first distance, if the user wants the cursor to perform an interactive operation within the second display range, the user can achieve this by controlling the pointing position to move within the larger first display range; when the distance between the remote control and the large screen increases to a second distance, if the user still wants the cursor to perform an interactive operation within the second display range, the user can achieve this by controlling the pointing position to move within a third display range that is larger than the first display range, thereby reducing the cursor jitter phenomenon caused by the increase in usage distance (increased sensitivity of cursor movement).

[0187] In some embodiments, the above steps S1001 to S1002 occur when the remote controller posture changes rapidly.

[0188] Optionally, the above S1101 and S1102 can also be described as: when the distance between the remote control and the large screen is a first distance, in response to the user controlling the pointing position of the remote control on the display screen to move a first amplitude on the display screen, the cursor synchronously moves a second amplitude on the display screen, wherein the first amplitude is greater than the second amplitude; when the distance between the remote control and the large screen is switched to a second distance, in response to the user controlling the pointing position of the remote control on the display screen to move a third amplitude on the display screen through the remote control, the cursor synchronously moves a second amplitude on the display screen, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance.

[0189] In some embodiments, the first amplitude, the second amplitude, and the third amplitude may be distance amplitudes or angle amplitudes at the same time.

[0190] In an embodiment of the present application, the spatial perception ability of the pointing remote control can be utilized to perceive the spatial relationship between the remote control and the interactive large screen in real time, and the sensitivity of the cursor can be adaptively adjusted according to the measured position information of the remote control relative to the large screen, thereby achieving the cursor filtering effect that can be adaptively adjusted according to the distance between the remote control and the large screen.

[0191] For example, Fig.11 FIG. 1 is a schematic flow chart of another cursor control method 1100 provided in an embodiment of the present application. Fig.11 As shown, the method 1100 includes:

[0192] S1101: When the distance between the remote control and the large screen is a first distance, in response to the user controlling the pointing position of the remote control on the display screen to move from a first position to a second position through the remote control, the cursor synchronously moves from the first position to the target position on the display screen, wherein the distance between the first position and the second position is greater than the distance between the first position and the target position.

[0193] The cursor starts to move when the pointing position starts to move, and stops moving when the pointing position stops moving. The direction of cursor movement is always synchronized with the direction of movement of the pointing position.

[0194] S1102: When the distance between the remote control and the large screen is the second distance, in response to the user controlling the pointing position of the remote control on the display screen to move from the first position to the third position through the remote control, the cursor synchronously moves from the first position to the target position on the display screen, wherein the distance between the first position and the third position is greater than the distance between the first position and the target position, and the distance between the first position and the third position is greater than the distance between the first position and the second position.

[0195] The second distance is greater than the first distance.

[0196] For example, Fig.12 FIG. 1 is a schematic flow chart of another cursor control method 1200 provided in an embodiment of the present application. Fig.12 As shown, the method 1200 includes:

[0197] S1201: Determine the x variable and y variable corresponding to the i-th frame, wherein the x variable is the change in the pointing coordinates corresponding to the i-th frame relative to the pointing coordinates corresponding to the i-1-th frame in the x-axis direction, and the y variable is the change in the pointing coordinates corresponding to the i-th frame relative to the pointing coordinates corresponding to the i-1-th frame in the y-axis direction. The pointing coordinates refer to the coordinates of the intersection of the direction pointed by the remote control and the large screen, and the initial value of i is 1.

[0198] In an example, in the i-1th frame, the coordinates of the large screen pointed by the remote control are (x1, y1), and in the i-th frame, the coordinates of the large screen pointed by the remote control are (x2, y2). Then, the x variable corresponding to the i-th frame is x2-x1, and the y variable corresponding to the i-th frame is y2-y1.

[0199] S1202: Determine a damping coefficient corresponding to the i-th frame according to the distance between the remote control and the large screen corresponding to the i-th frame, wherein the damping coefficient corresponding to the i-th frame is negatively correlated with the distance between the remote control and the large screen corresponding to the i-th frame.

[0200] S1203: Determine the cursor coordinates corresponding to the i-th frame according to the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the (i-1)-th frame, and the x variable and y variable corresponding to the i-th frame.

[0201] In some embodiments, the x variable and y variable corresponding to the i-th frame are first adjusted according to the damping coefficient, and then the horizontal coordinate of the cursor coordinate corresponding to the i-1-th frame is added to the adjusted x variable corresponding to the i-th frame to obtain the horizontal coordinate of the cursor coordinate corresponding to the i-th frame, and the vertical coordinate of the cursor coordinate corresponding to the i-1-th frame is added to the adjusted y variable corresponding to the i-th frame to obtain the vertical coordinate of the cursor coordinate corresponding to the i-th frame.

[0202] In an example, the x variable corresponding to the i-th frame is x2-x1, the y variable corresponding to the i-th frame is y2-y1, the damping coefficient corresponding to the i-th frame is B1, and the cursor coordinates corresponding to the i-1-th frame are (x3, y3). Then, the cursor coordinates corresponding to the i-th frame are (x3+B1(x2-x1), y3+B1(y2-y1)).

[0203] S1204: Displaying the cursor corresponding to the i-th frame on the large screen according to the cursor coordinates corresponding to the i-th frame.

[0204] Specifically, the large screen draws and displays the cursor corresponding to the i-th frame on the large screen according to the cursor coordinates corresponding to the i-th frame.

[0205] Thereafter, when the cursor display enters the i+1th frame, let i=i+1, and execute the operations from S1201 to S1204 in a loop, and then display the cursor corresponding to the i+1th frame on the large screen, and repeat this process. This process is reflected as the movement of the cursor at the user perception level.

[0206] In the embodiment of the present application, the filtering effect of the cursor can be adaptively adjusted according to the distance between the remote control and the large screen, so that the user can get the experience of smooth cursor movement when using the remote control in any position.

[0207] For example, Fig.13 FIG. 1 is a schematic flow chart of another cursor control method 1300 provided in an embodiment of the present application. Fig.13 As shown, the method 1300 includes:

[0208] S1301 and Fig.12 S1201 in the illustrated embodiments is the same and will not be described again for the sake of brevity.

[0209] S1302: Determine the damping coefficient corresponding to the i-th frame according to the distance between the remote control corresponding to the i-th frame and the large screen and the posture change value of the remote control corresponding to the i-th frame. The damping coefficient corresponding to the i-th frame is negatively correlated with the distance between the remote control corresponding to the i-th frame and the large screen, and the damping coefficient corresponding to the i-th frame is positively correlated with the posture change value of the remote control corresponding to the i-th frame.

[0210] S1303: Determine the cursor coordinates corresponding to the i-th frame according to the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the (i-1)-th frame, and the x variable and y variable corresponding to the i-th frame.

[0211] In some embodiments, the damping coefficient corresponding to the i-th frame includes a first damping coefficient and a second damping coefficient. The x variable corresponding to the i-th frame is first adjusted according to the first damping coefficient, and the y variable corresponding to the i-th frame is adjusted according to the second damping coefficient. Then, the horizontal coordinate of the cursor coordinate corresponding to the i-1-th frame is added to the adjusted x variable corresponding to the i-th frame to obtain the horizontal coordinate of the cursor coordinate corresponding to the i-th frame, and the vertical coordinate of the cursor coordinate corresponding to the i-1-th frame is added to the adjusted y variable corresponding to the i-th frame to obtain the vertical coordinate of the cursor coordinate corresponding to the i-th frame.

[0212] In an example, the x variable corresponding to the i-th frame is x2-x1, the y variable corresponding to the i-th frame is y2-y1, the first damping coefficient and the second damping coefficient corresponding to the i-th frame are B2 and B3 respectively, and the cursor coordinates corresponding to the i-1-th frame are (x3, y3). Then, the cursor coordinates corresponding to the i-th frame are (x3+B2(x2-x1), y3+B3(y2-y1)).

[0213] In some embodiments, the first damping coefficient is related to the distance between the remote controller and the large screen, and the first damping coefficient is also related to the change of the attitude azimuth of the remote controller in the current frame.

[0214] In some embodiments, the second damping coefficient is related to the distance between the remote control and the large screen, and the second damping coefficient is also related to the change of the attitude pitch angle of the remote control in the current frame.

[0215] S1304: Displaying the cursor corresponding to the i-th frame on the large screen according to the cursor coordinates corresponding to the i-th frame.

[0216] In an embodiment of the present application, the filtering effect of the light cursor can be adaptively adjusted according to the distance between the remote control and the large screen and the posture changes of the remote control, so that the user can get the experience of small cursor movements without jitter and large cursor movements without delay when using the remote control in any position.

[0217] For example, Fig.14 FIG. 1 shows an interactive schematic diagram of a cursor control method 1400 provided in an embodiment of the present application. Fig.14 As shown, the method is an interaction method between a UWB base station, a remote controller (i.e., a pointing remote controller) and a large screen, and the method 1400 includes:

[0218] S1401: The UWB base station establishes a first coordinate system, where the first coordinate system is a spatial coordinate system established with the UWB base station as the coordinate origin.

[0219] In some embodiments, the UWB base station may be deployed on a wall in a room, on a large screen, or at other locations in the room.

[0220] S1402: The UWB base station determines a first coordinate, which is a coordinate of the remote control in a first coordinate system.

[0221] S1403: The UWB base station sends the first coordinates to the remote controller.

[0222] In some embodiments, the UWB base station includes a UWB module, the remote control also includes a UWB module, and the UWB base station and the remote control communicate through their respective UWB modules, that is, the UWB module of the remote control receives the first coordinate sent by the UWB module of the UWB base station.

[0223] S1404: The remote controller establishes a second coordinate system, which is a spatial coordinate system with the center of the remote controller as the coordinate origin.

[0224] It should be understood that the above S1401 to S1404 have been executed after the UWB base station is installed, and this process can be understood as executing the following preparation operations of S1405 to S1410.

[0225] S1405: Based on the first coordinate, the remote controller determines its own position and attitude in real time, and then determines the attitude azimuth change value (Δψ) and attitude pitch angle change value of the remote controller corresponding to the current frame And determine the distance between the remote control and the large screen corresponding to the current frame.

[0226] Among them, the attitude azimuth angle and attitude pitch angle of the remote controller will be introduced in detail in subsequent embodiments.

[0227] In some embodiments, the remote control is based on the first coordinate system and the second coordinate system, and determines in real time the spatial relationship of the remote control relative to the large screen according to the first coordinate and the position of the large screen in the first coordinate system, wherein the spatial relationship of the remote control relative to the large screen includes the distance between the remote control and the large screen, the pointing position of the remote control on the large screen, the posture of the remote control, etc.

[0228] In some embodiments, a sensor module is provided in the remote controller, and the sensor module includes a gyroscope sensor and an acceleration sensor. The remote controller can calculate the attitude change value of the remote controller in real time through the gyroscope sensor. The attitude change value can specifically include the azimuth angle change value (Δψ), the pitch angle change value (Δψ), and the pitch angle change value (Δψ). and roll angle change value (Δθ), and the attitude change value and the remote control attitude measured by the UWB base station are fused and filtered to obtain a more accurate remote control attitude; the acceleration sensor on the remote control can obtain the position change value of the remote control through secondary integration, and the position change value of the remote control and the positioning measurement value of the remote control performed by the UWB base station are fused and filtered to obtain a more accurate remote control position. Therefore, the Kalman filter and other methods can be used to fuse the measurement results of the UWB base station and the sensor module to obtain the accurate attitude and position of the remote control in the UWB coordinate system (that is, the first coordinate system mentioned above).

[0229] S1406: The remote controller determines the x variable and the y variable corresponding to the current frame.

[0230] Among them, the x variable is the change in the pointing coordinates corresponding to the current frame relative to the pointing coordinates corresponding to the previous frame in the X-axis direction, and the y variable is the change in the pointing coordinates corresponding to the current frame relative to the pointing coordinates corresponding to the previous frame in the Y-axis direction. The pointing coordinates refer to the coordinates of the intersection of the direction pointed by the remote control and the large screen.

[0231] In an example, in the previous frame, the coordinates of the large screen pointed by the remote control are (x1, y1), and in the current frame, the coordinates of the large screen pointed by the remote control are (x2, y2). Then, the x variable corresponding to the current frame is x2-x1, and the y variable corresponding to the current frame is y2-y1.

[0232] Specifically, the pointing position of the remote control on the large screen corresponding to the previous frame and the pointing position of the remote control on the large screen corresponding to the current frame are determined according to the spatial relationship of the remote control relative to the large screen determined in real time in S1405, and then the x variable and y variable corresponding to the current frame are determined.

[0233] S1407: The remote control adjusts the change amount of the cursor in the X-axis direction according to the change value of the remote control's attitude azimuth angle and the distance between the remote control and the large screen; and adjusts the change amount of the cursor in the Y-axis direction according to the change value of the remote control's attitude pitch angle and the distance between the remote control and the large screen.

[0234] In some embodiments, a first damping coefficient is determined according to a change in the azimuth angle of the remote control and the distance between the remote control and the large screen; a second damping coefficient is determined according to a change in the pitch angle of the remote control and the distance between the remote control and the large screen; a change in the cursor in the X-axis direction (i.e., a change in the horizontal axis) is adjusted according to the first damping coefficient, and a change in the cursor in the Y-axis direction (i.e., a change in the vertical axis) is adjusted according to the second damping coefficient.

[0235] In some embodiments, the formula for adjusting the change amount of the cursor in the X-axis direction and the change amount in the Y-axis direction is as follows:

[0236] Δx d =B(Δψ,d)*Δx r (2)

[0237]

[0238] Where Δx d represents the change of the adjusted cursor in the X-axis direction corresponding to the current frame, B(Δψ,d) represents the calculation function of the first damping coefficient, d represents the distance between the remote control and the large screen corresponding to the current frame, Δx r Indicates the x variable corresponding to the current frame; Δy d Indicates the change in the Y-axis direction of the adjusted cursor corresponding to the current frame. represents the calculation function of the second damping coefficient, d represents the distance between the remote control and the large screen corresponding to the current frame, Δy r Indicates the y variable corresponding to the current frame.

[0239] The value of the damping coefficient will be described in detail in the subsequent embodiments.

[0240] S1408: The remote controller calculates the cursor coordinates of the current frame according to the adjusted change amount of the cursor in the X-axis direction, the change amount in the Y-axis direction, and the cursor coordinates of the previous frame.

[0241] Specifically, the remote control calculates the horizontal coordinate of the cursor coordinates of the current frame based on the adjusted change in the X-axis direction of the cursor and the horizontal coordinate of the cursor coordinates of the previous frame, and calculates the vertical coordinate of the cursor coordinates of the current frame based on the adjusted change in the Y-axis direction of the cursor and the vertical coordinate of the cursor coordinates of the previous frame.

[0242] S1409: The remote controller sends the calculated cursor coordinates of the current frame to the large screen.

[0243] S1410: The large screen draws a cursor according to the cursor coordinates of the current frame and displays the cursor on the screen.

[0244] In the embodiments of the present application, the spatial perception ability of the pointing remote control can be utilized to perceive the spatial relationship between the cursor and the interactive large screen in real time, and the sensitivity of the cursor can be adaptively adjusted according to the measured position information of the remote control relative to the large screen. Furthermore, the cursor jitter filtering effect can be adaptively adjusted according to the distance between the remote control and the large screen and / or the control state of the remote control, so that the user can use the remote control in any position to obtain the experience of small cursor movements without jitter and large cursor movements without delay.

[0245] Below, illustratively, in combination Fig.15 and 16 , the adaptive determination rule of the damping coefficient provided in the embodiment of the present application is introduced.

[0246] Fig.15 The graph shows the relationship between the damping coefficient and the attitude change value of each frame when the distance between the remote control and the large screen is constant.

[0247] like Fig.15 As shown, when the distance is constant, within the range where the posture change value of the current frame of the remote control is less than a certain threshold (the threshold may be 7°, for example), the damping coefficient increases with the increase of the posture change value of the current frame. That is to say, when the posture change of the current frame of the remote control is slow, a smaller damping coefficient is calculated according to the filter function (B() above), thereby further reducing the number of coordinates of the cursor movement; when the posture change value of the current frame is greater than or equal to a certain threshold, the damping coefficient no longer increases with the increase of the posture change value of the current frame, but almost maintains a constant value of 1. That is to say, when the posture change of the current frame of the remote control is fast, a larger damping coefficient is calculated according to the filter function, which does not affect the rapid movement of the cursor, thereby forming a user experience of "the cursor has a damping effect when moving in a small range, and has no damping effect when moving in a fast and large range".

[0248] Fig.16 The graph shows the relationship between the damping coefficient and the distance between the remote control and the large screen when the attitude change value of the remote control per frame is constant.

[0249] like Fig.16 As shown, the curve relationship diagram between the damping coefficient and the posture change value of each frame when d=1; the curve relationship diagram between the damping coefficient and the posture change value of each frame when d=3; and the curve relationship diagram between the damping coefficient and the posture change value of each frame when d=5 are respectively shown.

[0250] Depend on Fig.16 It can be seen that when the posture change value of the current frame is the same, the greater the distance between the remote control and the large screen, the greater the damping coefficient. For example, when the distance between the remote control and the large screen is 1, the remote control undergoes a posture change, and the corresponding posture change value of the current frame is 2°. At this time, the damping coefficient of the current frame is 0.9; when the distance between the remote control and the large screen switches from 1 to 3, the remote control undergoes the same posture change, and the corresponding posture change value of the current frame is 2°. At this time, the damping coefficient of the current frame is reduced to 0.5; when the distance between the remote control and the large screen further switches from 3 to 5, the remote control undergoes the same posture change, and the corresponding posture change value of the current frame is 2°. At this time, the damping coefficient of the current frame is further reduced to 0.3.

[0251] That is to say, as the distance between the remote control and the large screen changes, the damping effect is adjusted accordingly. When the change in posture per unit time is constant, the farther the distance, the more obvious the cursor shaking effect.

[0252] For example, Fig.17 A schematic diagram showing the positional relationship between several large-screen devices and UWB base stations is shown, that is, a diagram showing the arrangement status of the first antenna array 1700 of the UWB base station on the large-screen device 1710 .

[0253] like Fig.17 As shown, the first antenna array 1700 can be set at any position on the large screen device 1710. For example, the first antenna array 1700 can be set outside the large screen device 1710, for example, on the upper frame of the large screen device 1710 (such as Fig.17 ), and can also be set at a diagonal position of the large screen device 1710 (such as Fig.17 As shown in (b) and Fig.17 As shown in (c) in the figure), it can also be set at any position of the left frame, right frame, bottom frame, etc. of the large-screen device 1710, and can also be integrated inside the large-screen device 1710; or it can also be set on an object that is kept at a certain distance from the large-screen device 1710. The "object" can be an independent device, such as a desk, a stand, etc. The large-screen device 1710 and the first antenna array 1700 can be placed on different stands that are kept at a certain distance; of course, the first antenna array 1700 can also be set inside the electronic device, and the first antenna array 1700 can also be set at any position in the room where the large-screen device 1710 is located. This embodiment does not limit this.

[0254] The first antenna array 1700 includes at least three first antenna units, which may be a first antenna 121, a second antenna 122 and a third antenna 123 respectively. The second antenna 122 is located on one side of the first antenna 121 in the first direction X, and the third antenna 123 is located on one side of the first antenna 121 in the second direction Y.

[0255] The first antenna 121 can realize signal transmission or reception, and the origin of a three-dimensional coordinate system can be defined through the first antenna 121.

[0256] In one embodiment, the first antenna 121 serves as the origin of the three-dimensional coordinate system, the first direction is the x-axis direction of the three-dimensional coordinate system, the second direction is the y-axis direction of the three-dimensional coordinate system, the second antenna 122 is located on the x-axis, and the third antenna 123 is located on the y-axis, so that the first antenna 121, the second antenna 122 and the third antenna 123 are arranged in an "L" shape. The distance L between the second antenna 122 and the first antenna 121, and the distance L between the third antenna 123 and the first antenna 121 are all less than or equal to the wavelength λ of the first signal. Among them, the first signal is the first signal sent by the second antenna array received by the first antenna array 1700, and the second antenna array is the antenna array set on the remote control.

[0257] For example, Fig.18 The figure shows a schematic layout diagram of several first antenna arrays 1700 provided by an embodiment of the present application.

[0258] Fig.18 (a) of shows a schematic layout diagram of a first antenna array 1700. As shown in (a) of, Fig.18 the number of first antenna units 120a is three, and the three first antenna units 120a are arranged in an "L" shape.

[0259] Fig.18 (b) of shows another schematic layout diagram of a first antenna array 1700. As shown in (b) of, Fig.18 the number of first antenna units 120a is four, and the four first antenna units 120a are arranged in a "square" shape.

[0260] Fig.18 (c) of shows another schematic layout diagram of a first antenna array 1700. As shown in (c) of, Fig.18 the number of first antenna units 120a is three, and the three first antenna units 120a are arranged in a "pin" shape.

[0261] Among various arrangement forms of at least three first antenna units 120a, there are at least two antennas distributed in a first direction X and a second direction Y respectively, and the first direction X is perpendicular to the second direction Y. Among them, the first direction X can be used as the horizontal axis of a three-dimensional coordinate system, the second direction Y can be used as the vertical axis of the three-dimensional coordinate system, and a plane formed by the first direction X and the second direction Y can have a set geometric relationship with the display interface of the large-screen device 1710, so as to facilitate the calculation of the coordinates of the second antenna array.

[0262] Exemplarily, Fig.19 The figure shows a layout state diagram of a second antenna array provided by an embodiment of the present application on a remote controller 1900.

[0263] Referring to Fig.19, the second antenna array includes at least three second antenna units, and the at least three second antenna units can be the fourth antenna 221, the fifth antenna 222 and the sixth antenna 223 respectively. The fifth antenna 222 is located on one side of the fourth antenna 221 in the third direction, and the sixth antenna 223 is located on one side of the fourth antenna 221 in the fourth direction, so that the fourth antenna 221, the fifth antenna 222 and the sixth antenna 223 form an "L"-shaped structure. Among them, the fourth antenna 221 is a transceiver antenna, and the fifth antenna 222 and the sixth antenna 223 are both receiving antennas. The second antenna unit in the second antenna array can be used to receive the second signal sent by the first antenna array 1700. By making the distance L' between any two second antenna units less than or equal to the wavelength λ of the second signal, each second antenna unit used for receiving the signal can receive the second signal almost simultaneously, and each second antenna unit can obtain a phase parameter according to the second signal, and the deflection angle can be obtained according to the phase parameter.

[0264] That is to say, this embodiment makes the distance between any two first antenna units 120a and the distance between any two second antenna units smaller than the wavelength of the corresponding received signal, so that the first coordinate and the deflection angle can be obtained according to the phase parameter of the received signal, thereby realizing the positioning of the second antenna array in three-dimensional space, and the absolute coordinates of the second antenna array within the size range of the large-screen device 1710 can be obtained, thereby improving the positioning accuracy and the control experience of the remote control 1900, wherein the first coordinate is the relative coordinate of the second antenna array relative to the first antenna array 1700.

[0265] The first antenna array 1700 and the second antenna array may have the same arrangement form, for example, the first antenna array 1700 includes three first antenna units 120a, the second antenna array includes three second antenna units, and the arrangement form of the three first antenna units 120a is the same as the arrangement form of the three second antenna units. Of course, in some other embodiments, the first antenna array 1700 and the second antenna array may also have different arrangements, for example, the first antenna array 1700 includes three first antenna units 120a, the second antenna array includes two second antenna units, and the arrangement form of the three first antenna units 120a is different from that of the two second antenna units.

[0266] When operating the remote control 1900, a distance is usually maintained between the remote control 1900 and the large-screen device 1710, that is, a distance is maintained between the first antenna array 1700 and the second antenna array, so that a triangle is formed between the second antenna array, the first antenna 121 and the second antenna 122, and a triangle is also formed between the second antenna array, the first antenna 121 and the third antenna 123, so that the value of the first coordinate (x, y, z) can be calculated based on the relevant principles of triangles and electromagnetic waves.

[0267] The large-screen device 1710 is provided with a first antenna array 1700, and the remote control 1900 is provided with a second antenna array. The first antenna array 1700 can establish a three-dimensional coordinate system according to the relative position of the first antenna array 1700 on the large-screen device 1710. The first antenna array 1700 and the second antenna array can position each other so that the coordinates of the second antenna array are accurately presented on the display interface of the large-screen device 1710.

[0268] The attitude angle is determined by the rotation relationship between the carrier coordinate system (second coordinate system) and the UWB coordinate system (first coordinate system), which is composed of the azimuth angle ψ, the pitch angle And the rolling angle θ are composed of three Euler angles. In order to more clearly understand the attitude change value of the remote control, the following is an example, combined with Figure 20 to Figure 22 , the azimuth angle ψ and pitch angle used to measure the attitude change value of the remote control and roll angle θ are introduced.

[0269] Fig. 20 A spatial coordinate system established with the UWB base station as the coordinate origin is shown, namely the first coordinate system mentioned above.

[0270] like Fig. 20 (a) and Fig. 20 As shown in (b) of FIG. 1 , the UWB base station adopts a three-antenna structure (antenna 0, antenna 1, and antenna 2). Fig. 20 The three-antenna structure shown in (a) is an L-shaped antenna structure, such as Fig. 20 The three-antenna structure shown in (b) is a triangular antenna structure. When installing the UWB base station, the arrow shown in the figure needs to be perpendicular to the horizontal plane and pointed upward. The UWB base station can be installed on the wall or integrated into other smart devices, such as the top of a large screen.

[0271] After the UWB base station is installed, the UWB coordinate system (i.e. the first coordinate system mentioned above) can be established. Fig. 20 As shown in (a) in the figure, the UWB coordinate system can take the center of antenna No. 0 of the base station as the coordinate origin O1, the X1 axis is parallel to the bottom edge of the base station and points to the left, the Y1 axis points to the front direction of the base station, and the Z1 axis is perpendicular to the X1O1Y1 plane and points upward, satisfying the right-hand rule with the X1 axis and the Y1 axis.

[0272] Fig. 20 (c) in FIG. 1 is a schematic diagram of the UWB coordinate system at the UWB base station level.

[0273] Fig.21 A spatial coordinate system established with the center of the remote controller as the coordinate origin is shown, namely the second coordinate system mentioned above.

[0274] like Fig.21 As shown, the coordinate origin O2 of the second coordinate system is located at the center of the remote control, the X2 axis points to the right along the horizontal axis of the carrier, the Y2 axis points forward along the longitudinal axis of the carrier, and the Z2 axis is perpendicular to the X2O2Y2 plane and points outward, and the coordinate axes conform to the right-hand rule.

[0275] The remote control can be replaced by any other UWB tag, such as a mobile phone.

[0276] exist Fig. 20 and Fig.21 Based on the coordinate system shown, Fig. 22 The azimuth angle ψ and pitch angle used to measure the attitude of the remote controller are shown. Schematic diagram of the roll angle θ.

[0277] Fig. 22 (a) shows an azimuth angle ψ and a pitch angle Schematic diagram of .

[0278] like Fig. 22 As shown in (a), the pitch angle It is the angle between the Y2 axis and the X1O1Y1 plane in the first coordinate system, and is positive when the carrier head is tilted upward; the azimuth angle ψ is the angle between the projection of the Y2 axis on the X1O1Y1 plane and the Y1 axis, and is positive when the carrier head is tilted right.

[0279] Fig. 22 (b) in FIG. 1 shows a schematic diagram of a rolling angle θ.

[0280] like Fig. 22 As shown in (b) in FIG. 8 , the roll angle θ is the angle between the Z2 axis and the vertical plane including the Y2 axis, and is considered positive when the carrier tilts to the right.

[0281] In some embodiments, the attitude angle between the first coordinate system and the second coordinate system can also be presented in the form of an attitude transfer matrix C. Taking the attitude transfer between the second coordinate system and the first coordinate system as an example, represents the attitude transfer matrix from the second coordinate system to the first coordinate system, The three attitude angles ψ, And θ are calculated, the formula is as follows:

[0282]

[0283] It should be noted that the superscript "2" in the above formula (4) refers to the second coordinate system, not the square operation.

[0284] For example, Fig.23 A functional module diagram of a cursor control system 2000 provided in an embodiment of the present application is shown.

[0285] like Fig.23 As shown, the system 2000 includes a UWB base station 2100, a pointing device 2200 and a large screen 2300, wherein the UWB base station 2100 includes a first UWB module 2110; the pointing device 2200 includes a position attitude estimation module 2210 and a cursor coordinate determination module 2220, the position attitude estimation module 2210 includes a second UWB module 2211 and a sensor module 2212, the cursor coordinate determination module 2220 includes a projection calculation module 2221 and an adaptive filtering module 2222; the large screen 2300 includes a drawing module 2310 and a display module 2320. Specifically:

[0286] The first UWB module 2110 is used to determine the first coordinate in real time after the UWB base station 2100 establishes the first coordinate system, wherein the first coordinate system is a spatial coordinate system established with the UWB base station 2100 as the coordinate origin, and the first coordinate is the coordinate of the pointing device 2200 in the first coordinate system.

[0287] In some embodiments, the UWB base station 2100 may be deployed on a wall in a room, on a large screen, or at other locations in the room.

[0288] The first UWB module 2110 is further configured to send the first coordinates determined in real time to the pointing device 2200 .

[0289] The position and attitude estimation module 2210 is used to estimate the position and attitude of the pointing device 2200 in real time after the pointing device 2200 establishes a second coordinate system, wherein the second coordinate system is a spatial coordinate system with the center of the pointing device 2200 as the coordinate origin.

[0290] Specifically, the second UWB module 2211 is used to receive the first coordinate sent by the first UWB module 2110 in real time; the sensor module 2212 is used to determine the posture change of the pointing device 2200 in real time, and the position and posture estimation module 2210 is specifically used to estimate the position and posture of the pointing device 2200 based on the first coordinate and the posture change of the pointing device 2200 in real time.

[0291] The estimated position and attitude information of the pointing device 2200 includes the position of the pointing device 2200 from the large screen, the pointing position of the pointing device 2200 on the large screen, and the attitude angle of the pointing device 2200 relative to the first coordinate system (that is, the attitude angle is determined by the rotation relationship between the second coordinate system and the first coordinate system), and the attitude angle is composed of the azimuth angle ψ, the pitch angle and roll angle θ are composed of three Euler angles, about the azimuth angle ψ, pitch angle and the roll angle θ is already in the above Figure 20 to Figure 22The illustrated embodiment has been described in detail, and for the sake of brevity, it will not be repeated here.

[0292] According to the attitude angle of the pointing device 2200 corresponding to the previous frame relative to the first coordinate system and the attitude angle of the pointing device 2200 corresponding to the current frame relative to the first coordinate system, the change value of the attitude angle corresponding to the current frame can be determined, that is, the change value Δψ of the azimuth angle ψ corresponding to the current frame and the pitch angle Δψ can be obtained. The change value And the change value Δθ of the roll angle θ.

[0293] In some embodiments, the sensor module 2212 includes a gyroscope sensor and an acceleration sensor. The gyroscope sensor can be used to calculate the attitude change value of the remote control in real time, and the attitude change value and the attitude of the pointing device 2200 measured by the UWB base station 2100 are fused and filtered to obtain a more accurate attitude of the pointing device 2200; the acceleration sensor can obtain the position change value of the pointing device 2200 through secondary integration, and the position change value of the pointing device 2200 and the positioning measurement value of the pointing device 2200 performed by the UWB base station 2100 are fused and filtered to obtain a more accurate position of the pointing device 2200. Therefore, the measurement results of the UWB base station 2100 and the sensor module 2212 can be fused by Kalman filtering or other methods to obtain the accurate attitude and position of the remote control in the first coordinate system.

[0294] The projection calculation module 2221 is used to determine the x variable and the y variable corresponding to the current frame.

[0295] Among them, the x variable is the change in the pointing coordinates corresponding to the current frame relative to the pointing coordinates corresponding to the previous frame in the X-axis direction, the y variable is the change in the pointing coordinates corresponding to the current frame relative to the pointing coordinates corresponding to the previous frame in the Y-axis direction, and the pointing coordinates refer to the coordinates of the intersection of the direction indicated by the pointing device 2200 and the large screen 2300.

[0296] In an example, in the previous frame, the coordinates of the large screen 2300 pointed by the pointing device 2200 are (x1, y1), and in the current frame, the coordinates of the large screen 2300 pointed by the pointing device 2200 are (x2, y2). Then, the x variable corresponding to the current frame is x2-x1, and the y variable corresponding to the current frame is y2-y1.

[0297] Specifically, the x variable and the y variable corresponding to the current frame are determined according to the pointing position of the pointing device 2200 on the large screen 2300 corresponding to the previous frame and the pointing position of the pointing device 2200 on the large screen 2300 corresponding to the current frame.

[0298] The adaptive filtering module 2222 is used to adjust the change amount of the cursor in the X-axis direction according to the attitude azimuth change value Δψ of the pointing device 2200 and the distance d between the pointing device 2200 and the large screen 2300; according to the attitude pitch angle change value Δψ of the pointing device 2200 The distance d between the pointing device 2200 and the large screen 2300 is used to adjust the change amount of the cursor in the Y-axis direction.

[0299] In some embodiments, the adaptive filtering module 2222 determines a first damping coefficient according to a change value Δψ of the attitude azimuth of the pointing device 2200 and a distance d between the pointing device 2200 and the large screen 2300; and determines a first damping coefficient according to a change value Δψ of the attitude pitch angle of the pointing device 2200. and the distance d between the pointing device 2200 and the large screen 2300 to determine the second damping coefficient; the change amount Δx of the cursor in the X-axis direction is calculated according to the first damping coefficient. r (i.e., the change in the horizontal axis) is adjusted, and the change in the cursor in the Y-axis direction Δy is adjusted according to the second damping coefficient. r (i.e. the change in the vertical axis) to make adjustments.

[0300] In some embodiments, the adaptive filtering module 2222 adjusts the change amount of the cursor in the X-axis direction and the change amount in the Y-axis direction according to the following formula:

[0301] Δx d =B(Δψ,d)*Δx r (2)

[0302]

[0303] Where Δx d represents the change of the adjusted cursor in the X-axis direction corresponding to the current frame, B(Δψ,d) represents the calculation function of the first damping coefficient, d represents the distance between the remote control and the large screen corresponding to the current frame, Δx r Indicates the x variable corresponding to the current frame; Δy d Indicates the change in the Y-axis direction of the adjusted cursor corresponding to the current frame. represents the calculation function of the second damping coefficient, d represents the distance between the remote control and the large screen corresponding to the current frame, Δy r Indicates the y variable corresponding to the current frame.

[0304] The adaptive filtering module 2222 is further used to calculate the cursor coordinates of the current frame according to the adjusted change amount of the cursor in the X-axis direction, the change amount in the Y-axis direction and the cursor coordinates of the previous frame.

[0305] Specifically, the adaptive filtering module 2222 calculates the horizontal coordinate of the cursor coordinates of the current frame according to the adjusted change of the cursor in the X-axis direction and the horizontal coordinate of the cursor coordinates of the previous frame, and calculates the vertical coordinate of the cursor coordinates of the current frame according to the adjusted change of the cursor in the Y-axis direction and the vertical coordinate of the cursor coordinates of the previous frame.

[0306] The second UWB module 2211 is further used to send the calculated cursor coordinates of the current frame to the large screen 2300 .

[0307] The drawing module 2310 is used to draw the cursor of the current frame according to the cursor coordinates of the current frame.

[0308] The display module 2320 is used to display the cursor of the current frame on the screen of the large screen 2300 .

[0309] In the embodiments of the present application, the spatial perception ability of the pointing remote control can be utilized to perceive the spatial relationship between the cursor and the interactive large screen in real time, and the sensitivity of the cursor can be adaptively adjusted according to the measured position information of the remote control relative to the large screen. Furthermore, the cursor jitter filtering effect can be adaptively adjusted according to the distance between the remote control and the large screen and / or the control state of the remote control, so that the user can use the remote control in any position to obtain the experience of small cursor movements without jitter and large cursor movements without delay.

[0310] One or more of the modules or units described herein can be implemented by software, hardware or a combination of the two. When any of the above modules or units are implemented in software, the software exists in the form of computer program instructions and is stored in a memory, and a processor can be used to execute the program instructions and implement the above method flow. The processor may include but is not limited to at least one of the following: a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a microcontroller (MCU), or an artificial intelligence processor and other types of computing devices that run software, each computing device may include one or more cores for executing software instructions to perform operations or processing. The processor may be built into an SoC (system on chip) or an application specific integrated circuit (ASIC), or it may be an independent semiconductor chip. In addition to the core used to execute software instructions for operations or processing in the processor, necessary hardware accelerators may be further included, such as a field programmable gate array (FPGA), a PLD (programmable logic device), or a logic circuit that implements a dedicated logic operation.

[0311] When the modules or units described in this document are implemented in hardware, the hardware can be any one or any combination of a CPU, a microprocessor, a DSP, an MCU, an artificial intelligence processor, an ASIC, a SoC, an FPGA, a PLD, a dedicated digital circuit, a hardware accelerator, or a non-integrated discrete device, which can run the necessary software or be independent of the software to execute the above method flow.

[0312] When the modules or units described herein are implemented using software, they can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, a computer, a server, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server, or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state drive (SSD)), etc.

[0313] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0314] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0315] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0316] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0317] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0318] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0319] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A cursor control method, characterized in that: The method comprises: When the distance between the first pointing device and the first display screen is a first distance, the first pointing device is used to control the pointing position to move by a first amplitude, so that the cursor is synchronously moved by a second amplitude on the first display screen, wherein the first amplitude is greater than the second amplitude, and the pointing position is the position on the first display screen pointed to by the first pointing device; When the distance between the first pointing device and the first display screen is switched to a second distance, the pointing position is controlled by the first pointing device to move a third amplitude, so that the cursor moves the second amplitude synchronously on the first display screen, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance.

2. The method according to claim 1, characterized in that The method further comprises: When the pointing position moves on the first display screen, a damping coefficient is determined according to the distance between the first pointing device and the first display screen, and the damping coefficient is negatively correlated with the distance between the first pointing device and the first display screen; The display position of the cursor is adjusted according to the damping coefficient.

3. The method according to claim 2, characterized in that The determining the damping coefficient according to the distance between the first pointing device and the first display screen includes: determining a damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, and i is a natural number, i=1, 2, 3, ...; The adjusting the display position of the cursor according to the damping coefficient includes: Determine an x ​​variable corresponding to the i-th frame and a y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is a change in the horizontal coordinate of the pointing position corresponding to the i-th frame relative to the horizontal coordinate of the pointing position corresponding to the i-1-th frame, and the y variable corresponding to the i-th frame is a change in the vertical coordinate of the pointing position corresponding to the i-th frame relative to the vertical coordinate of the pointing position corresponding to the i-1-th frame; The cursor coordinates corresponding to the i-th frame are determined according to the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame and the y variable corresponding to the i-th frame, and the cursor coordinates corresponding to the i-th frame are used to display the cursor corresponding to the i-th frame on the first display screen.

4. The method according to claim 3, characterized in that The determining the cursor coordinates corresponding to the i-th frame according to the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame includes: Determine the sum of the first product and the abscissa of the cursor coordinate corresponding to the i-1th frame as the abscissa of the cursor coordinate corresponding to the i-th frame, wherein the first product is the product of the damping coefficient corresponding to the i-th frame and the x variable corresponding to the i-th frame; The sum of the second product and the ordinate of the cursor coordinate corresponding to the i-1th frame is determined as the ordinate of the cursor coordinate corresponding to the i-th frame, and the second product is the product of the damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

5. The method according to any one of claims 2 to 4, characterized in that The determining the damping coefficient according to the distance between the first pointing device and the first display screen includes: A damping coefficient is determined according to the distance between the first pointing device and the first display screen and a posture change value of the first pointing device, and the damping coefficient is positively correlated with the posture change value of the first pointing device.

6. The method according to claim 5, characterized in that The determining of the damping coefficient according to the distance between the first pointing device and the first display screen and the posture change value of the first pointing device includes: Determine a first damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame and the first posture change value corresponding to the i-th frame; Determining a second damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame and the second posture change value corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, and i is a natural number, i=1, 2, 3…; The adjusting the display position of the cursor according to the damping coefficient includes: Determine an x ​​variable corresponding to the i-th frame and a y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is a change in the horizontal coordinate of the pointing position corresponding to the i-th frame relative to the horizontal coordinate of the pointing position corresponding to the i-1-th frame, and the y variable corresponding to the i-th frame is a change in the vertical coordinate of the pointing position corresponding to the i-th frame relative to the vertical coordinate of the pointing position corresponding to the i-1-th frame; The cursor coordinates corresponding to the i-th frame are determined according to the first damping coefficient corresponding to the i-th frame, the second damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame and the y variable corresponding to the i-th frame, and the cursor coordinates corresponding to the i-th frame are used to display the cursor corresponding to the i-th frame on the first display screen.

7. The method according to claim 6, characterized in that The determining the cursor coordinates corresponding to the i-th frame according to the first damping coefficient corresponding to the i-th frame, the second damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame includes: Determine the sum of the third product and the abscissa of the cursor coordinates corresponding to the i-1th frame as the abscissa of the cursor coordinates corresponding to the i-th frame, wherein the third product is the product of the first damping coefficient corresponding to the i-th frame and the x variable corresponding to the i-th frame; The sum of the fourth product and the ordinate of the cursor coordinate corresponding to the i-1th frame is determined as the ordinate of the cursor coordinate corresponding to the i-th frame, and the fourth product is the product of the second damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

8. The method according to claim 6 or 7, characterized in that: The first posture change value corresponding to the i-th frame includes the change value of the azimuth angle of the first pointing device relative to the posture corresponding to the i-1-th frame, and the second posture change value corresponding to the i-th frame includes the change value of the pitch angle of the first pointing device relative to the posture corresponding to the i-1-th frame.

9. The method according to any one of claims 2 to 8, characterized in that The method further comprises: When the pointing position moves on the first display screen, the position and posture of the first pointing device are determined in real time, the position of the first pointing device is used to obtain the distance between the first pointing device and the first display screen, and the posture of the first pointing device is used to obtain the posture change value of the first pointing device.

10. The method according to any one of claims 2 to 9, characterized in that The damping coefficient is greater than 0, and the damping coefficient is less than or equal to 1.

11. The method according to any one of claims 1 to 10, characterized in that The first pointing device is a remote controller.

12. A cursor control method, characterized in that: The method comprises: When the distance between the first pointing device and the first display screen is a first distance, in response to controlling the pointing position to move by a first amplitude through the first pointing device, the cursor synchronously moves by a second amplitude on the first display screen, wherein the first amplitude is greater than the second amplitude, and the pointing position is the position in the first display screen pointed to by the first pointing device; When the distance between the first pointing device and the first display screen is switched to a second distance, in response to controlling the pointing position to move a third amplitude through the first pointing device, the cursor synchronously moves the second amplitude on the first display screen, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance.

13. A cursor control system, characterized in that: The system comprises a first pointing device and a first display screen, The first pointing device is used for: When the distance between the first pointing device and the first display screen is a first distance, controlling the pointing position to move by a first amplitude, the pointing position being the position on the first display screen pointed to by the first pointing device; The first display screen is used for: In response to the pointing position moving by a first amplitude, controlling the cursor to move synchronously by a second amplitude on the first display screen, wherein the first amplitude is greater than the second amplitude; The first pointing device is further used to: when the distance between the first pointing device and the first display screen is a second distance, control the pointing position to move by a third amplitude; The first display screen is also used for: In response to the pointing position moving by a third amplitude, the cursor is controlled to synchronously move by the second amplitude on the first display screen, wherein the third amplitude is greater than the first amplitude, and the second distance is greater than the first distance.

14. The system according to claim 13, characterized in that The first pointing device is specifically used for: When the pointing position moves on the first display screen, a damping coefficient is determined according to the distance between the first pointing device and the first display screen, and the damping coefficient is negatively correlated with the distance between the first pointing device and the first display screen; The display position of the cursor is adjusted according to the damping coefficient.

15. The system according to claim 14, characterized in that The first pointing device is specifically used for: determining a damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, and i is a natural number, i=1, 2, 3, ...; Determine an x ​​variable corresponding to the i-th frame and a y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is a change in the horizontal coordinate of the pointing position corresponding to the i-th frame relative to the horizontal coordinate of the pointing position corresponding to the i-1-th frame, and the y variable corresponding to the i-th frame is a change in the vertical coordinate of the pointing position corresponding to the i-th frame relative to the vertical coordinate of the pointing position corresponding to the i-1-th frame; Determine the cursor coordinates corresponding to the i-th frame according to the damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the i-1-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame; The first display screen is specifically used for: The cursor corresponding to the i-th frame is displayed on the first display screen according to the cursor coordinates corresponding to the i-th frame.

16. The system according to claim 15, characterized in that The first pointing device is specifically used for: Determine the sum of the first product and the abscissa of the cursor coordinate corresponding to the i-1th frame as the abscissa of the cursor coordinate corresponding to the i-th frame, wherein the first product is the product of the damping coefficient corresponding to the i-th frame and the x variable corresponding to the i-th frame; The sum of the second product and the ordinate of the cursor coordinate corresponding to the i-1th frame is determined as the ordinate of the cursor coordinate corresponding to the i-th frame, and the second product is the product of the damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

17. A system according to any one of claims 14 to 16, characterized in that The first pointing device is specifically used for: A damping coefficient is determined according to the distance between the first pointing device and the first display screen and a posture change value of the first pointing device, and the damping coefficient is positively correlated with the posture change value of the first pointing device.

18. The system according to claim 17, characterized in that The first pointing device is specifically used for: Determine a first damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame and the first posture change value corresponding to the i-th frame; Determining a second damping coefficient corresponding to the i-th frame according to the distance corresponding to the i-th frame and the second posture change value corresponding to the i-th frame, wherein the distance corresponding to the i-th frame refers to the distance between the first pointing device and the first display screen corresponding to the i-th frame, and i is a natural number, i=1, 2, 3…; Determine an x ​​variable corresponding to the i-th frame and a y variable corresponding to the i-th frame, wherein the x variable corresponding to the i-th frame is a change in the horizontal coordinate of the pointing position corresponding to the i-th frame relative to the horizontal coordinate of the pointing position corresponding to the i-1-th frame, and the y variable corresponding to the i-th frame is a change in the vertical coordinate of the pointing position corresponding to the i-th frame relative to the vertical coordinate of the pointing position corresponding to the i-1-th frame; Determine the cursor coordinates corresponding to the i-th frame according to the first damping coefficient corresponding to the i-th frame, the second damping coefficient corresponding to the i-th frame, the cursor coordinates corresponding to the (i-1)-th frame, the x variable corresponding to the i-th frame, and the y variable corresponding to the i-th frame; The first display screen is specifically used for: The cursor corresponding to the i-th frame is displayed on the first display screen according to the cursor coordinates corresponding to the i-th frame.

19. The system according to claim 18, characterized in that The first pointing device is specifically used for: Determine the sum of the third product and the abscissa of the cursor coordinates corresponding to the i-1th frame as the abscissa of the cursor coordinates corresponding to the i-th frame, wherein the third product is the product of the first damping coefficient corresponding to the i-th frame and the x variable corresponding to the i-th frame; The sum of the fourth product and the ordinate of the cursor coordinate corresponding to the i-1th frame is determined as the ordinate of the cursor coordinate corresponding to the i-th frame, and the fourth product is the product of the second damping coefficient corresponding to the i-th frame and the y variable corresponding to the i-th frame.

20. The system according to claim 18 or 19, characterized in that The first posture change value corresponding to the i-th frame includes the change value of the azimuth angle of the first pointing device relative to the posture corresponding to the i-1-th frame, and the second posture change value corresponding to the i-th frame includes the change value of the pitch angle of the first pointing device relative to the posture corresponding to the i-1-th frame.

21. The system according to any one of claims 14 to 20, characterized in that The first pointing device is specifically used for: When the pointing position moves on the first display screen, the position and posture of the first pointing device are determined in real time, the position of the first pointing device is used to obtain the distance between the first pointing device and the first display screen, and the posture of the first pointing device is used to obtain the posture change value of the first pointing device.

22. The system according to any one of claims 14 to 21, characterized in that The damping coefficient is greater than 0, and the damping coefficient is less than or equal to 1.

23. The system according to any one of claims 13 to 22, characterized in that The first pointing device is a remote controller, and the first display screen is a large screen.

24. An electronic device, characterized in that: include: one or more processors; one or more memories; And one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, and the one or more computer programs include instructions, which, when executed by the one or more processors, enable the electronic device to perform the method as described in any one of claims 1 to 11, or perform the method as described in claim 12.

25. A computer-readable storage medium, characterized in that: The storage medium stores a program or an instruction. When the program or the instruction is executed, the method according to any one of claims 1 to 11 or the method according to claim 12 is implemented.

26. A chip, characterized in that: The chip stores instructions, and when the instructions are executed, the method according to any one of claims 1 to 11 or the method according to claim 12 is implemented.

27. A computer program product, characterized in that The computer program product stores a program or an instruction, and when the program or the instruction is executed, the method according to any one of claims 1 to 11 or the method according to claim 12 is implemented.

Images