Generation method for cursor position of remote controller and remote controller
Through the cursor position generation method combined with the inertial measurement unit and the wireless communication box, the problem of high hardware cost of the remote control is solved, and the effect of the remote control action is realized on the screen in real time, expanding the application scenario of the smart TV and reducing the hardware cost. .
Patent Information
- Application Number
- CN202411471769.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-22
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2044-10-22
AI Technical Summary
The existing remote control with mouse function requires complex hardware design, which leads to high development costs, which is not conducive to large-scale promotion and application.
The cursor position generation method combined with an inertial measurement unit and a wireless communication box is adopted. By obtaining the absolute pitch angle and relative heading angle of the remote control, the relative heading angle is converted into absolute heading angle by using the Kalman filtering fusion algorithm, the cursor position is updated in real time, and the cursor position is reduced. Hardware cost.
It realizes that the remote control action is reflected in the screen cursor movement in real time, expands the application scenarios of smart TVs, reduces hardware costs, and is conducive to large-scale promotion and application.
Smart Images

Figure CN119011916A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of remote controllers, and in particular to a method for generating a cursor position of a remote controller and the remote controller. Background Art
[0002] The remote control can control the smart TV through buttons to meet the user's usage needs. As the functions of smart TVs increase, the buttons of the remote control are increasingly unable to meet the diverse scene requirements.
[0003] To meet diverse needs in various scenarios, related technologies often use dedicated remote controls with mouse functions. However, these remote controls require complex hardware design, resulting in high development costs and hindering large-scale promotion and application. Summary of the Invention
[0004] Based on this, it is necessary to provide a method for generating a cursor position of a remote control and a remote control to address the problem that remote controls in related technologies require complex hardware design, resulting in high development costs and being unfavorable for large-scale promotion and application.
[0005] A method for generating a cursor position of a remote controller, applied to a remote controller, comprising: Acquire raw measurement data from an inertial measurement unit, and determine an absolute pitch angle and a relative heading angle of the remote controller based on the raw measurement data from the inertial measurement unit; Obtaining raw measurement data of the wireless communication box, and determining a first observation angle of the remote control and a distance from the remote control to the smart TV screen based on the raw measurement data of the wireless communication box, wherein the first observation angle is a horizontal angle between a line connecting the wireless communication box and the remote control and a pointing line of the remote control, wherein the wireless communication box is installed on the smart TV; Determining a vertical movement distance of the cursor on the screen according to the absolute pitch angle and the distance between the remote control and the smart TV screen; Converting the relative heading angle into an absolute heading angle based on the first observation angle using a Kalman filter fusion algorithm; Determine the horizontal movement distance of the cursor on the screen according to the absolute heading angle and the distance from the remote control to the smart TV screen; The vertical movement distance and the horizontal movement distance are sent to the smart TV so that the screen of the smart TV displays the cursor position.
[0006] When executing the above-mentioned remote control cursor position generation method, the method first obtains raw measurement data from the inertial measurement unit and determines the absolute pitch angle and relative heading angle of the remote control based on the raw measurement data from the inertial measurement unit. The method then obtains raw measurement data from the wireless communication box and determines the first observation angle of the remote control and the distance from the remote control to the smart TV screen based on the raw measurement data from the wireless communication box. The method then determines the vertical movement distance of the cursor on the screen based on the absolute pitch angle and the distance from the remote control to the smart TV screen. The method then converts the relative heading angle into an absolute heading angle using the first observation angle as a reference using a Kalman filter fusion algorithm. The method then determines the horizontal movement distance of the cursor on the screen based on the absolute heading angle and the distance from the remote control to the smart TV screen. The method then sends the vertical movement distance and the horizontal movement distance to the smart TV so that the cursor position is displayed on the smart TV screen. As can be seen, by configuring the inertial measurement unit and the wireless communication box, the relative heading angle of the remote control can be converted into an absolute heading angle, allowing the user's actions on the remote control to be reflected in the movement of the on-screen cursor in real time. This facilitates user operation of the smart TV and expands the application scenarios of smart TVs. The method also reduces hardware costs and facilitates large-scale promotion and application.
[0007] In one embodiment, converting the relative heading angle into an absolute heading angle based on the first observation angle by using a Kalman filter fusion algorithm includes: When the first observation angle is updated, the absolute heading angle corresponding to the current frame is calculated using the following formula:
[0008] in, Indicates the absolute heading angle corresponding to the current frame, Indicates the absolute heading angular velocity corresponding to the current frame, Indicates the absolute heading angular acceleration corresponding to the current frame, Indicates the absolute heading angle corresponding to the previous frame, Indicates the absolute heading angular velocity corresponding to the previous frame, Indicates the absolute heading angular acceleration corresponding to the previous frame, represents the first observation angle, and They respectively represent the relative heading angular velocity and relative heading angular acceleration determined according to the original measurement data of the inertial measurement unit, KT represents the first filter coefficient, KV represents the second filter coefficient, and KA represents the third filter coefficient.
[0009] In one embodiment, converting the relative heading angle into an absolute heading angle based on the first observation angle by using a Kalman filter fusion algorithm further comprises: When the first observation angle is not updated, the following formula is used to predict the absolute heading angle corresponding to the next frame:
[0010] in, Indicates the absolute heading angle corresponding to the next frame, Indicates the absolute heading angular velocity corresponding to the next frame, Indicates the absolute heading angular acceleration corresponding to the next frame, Indicates the time interval between two adjacent frames of data.
[0011] In one embodiment, before converting the relative heading angle into an absolute heading angle based on the first observation angle using a Kalman filter fusion algorithm, the method further includes: The heading angle, heading angular velocity, heading angular acceleration, first filter coefficient, second filter coefficient, and third filter coefficient are initialized.
[0012] In one embodiment, the method includes: Determining an initial value of the heading angular velocity and an initial value of the heading angular acceleration according to the relative heading angle; The first frame data of the first observation angle is determined as the initial value of the heading angle.
[0013] In one embodiment, the method further comprises: determining whether the remote control has moved laterally according to the first observation angle; If the remote control is judged to have moved horizontally, the KT value is increased; If it is determined that the remote control has not moved horizontally, the KT value is reduced.
[0014] In one embodiment, the method further comprises: When the first observation angle is updated, determining whether the first observation angle is credible; If it is determined that the first observation angle is not credible, the KT value is set to zero.
[0015] In one embodiment, determining the absolute pitch angle and relative heading angle of the remote controller based on the raw measurement data of the inertial measurement unit includes: Deducting the three-axis acceleration bias and angular velocity bias from the original measurement data of the inertial measurement unit; Perform attitude calculation to obtain the quaternion representation of the remote controller's attitude; The remote controller's Euler angle representation is obtained based on the quaternion representation, and the absolute pitch angle and relative heading angle are determined based on the Euler angle representation.
[0016] In one embodiment, the raw measurement data of the wireless communication box includes the distance between the wireless communication box and the remote control, a second observation angle, and a third observation angle, wherein the second observation angle is the horizontal angle between the line connecting the wireless communication box and the remote control and the center line of the wireless communication box, and the third observation angle is the vertical angle between the line connecting the wireless communication box and the remote control and the center line of the wireless communication box; the method further includes: The distance from the remote control to the smart TV screen is determined by the distance between the wireless communication box and the remote control, the second observation angle and the third observation angle.
[0017] A remote controller includes a processor and a memory, wherein the memory is used to store a computer program, and when the computer program is executed by the processor, the method for generating a cursor position of the remote controller is implemented. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 Schematic diagram of the flow of a method for generating a cursor position of a remote controller according to the present invention; Figure 2 Schematic diagram of the top view of the remote control and smart TV of the present invention; Figure 3 Schematic diagram of the side structure of the remote control and smart TV of the present invention; Figure 4 It is a structural schematic diagram of the remote control of the present invention. DETAILED DESCRIPTION
[0019] To make the above-mentioned objects, features, and advantages of the present invention more readily apparent, specific embodiments of the present invention are described in detail below with reference to the accompanying drawings. The following description sets forth numerous specific details to facilitate a full understanding of the present invention. However, the present invention can be implemented in many other ways than those described herein, and those skilled in the art may make similar modifications without departing from the scope of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.
[0020] It should be noted that when an element is referred to as being "fixed to" another element, it may be directly on the other element or there may be an intermediate element. When an element is considered to be "connected to" another element, it may be directly connected to the other element or there may be an intermediate element at the same time. In contrast, when an element is referred to as being "directly on" another element, there is no intermediate element. The terms "vertical," "horizontal," "left," "right," and similar expressions used herein are for illustrative purposes only."
[0021] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which the present invention pertains. The terms used herein in the specification of the present invention are for the purpose of describing specific embodiments only and are not intended to limit the present invention. The term "and / or" as used herein includes any and all combinations of one or more of the associated listed items.
[0022] The invention discloses a method for generating a cursor position of a remote controller and the remote controller.
[0023] like Figures 1 to 4 As shown, the remote control cursor position generation method is applied to the remote control end and includes: Step S01: Obtaining raw measurement data from an inertial measurement unit, and determining the absolute pitch angle and relative heading angle of the remote controller based on the raw measurement data from the inertial measurement unit.
[0024] In this step, an inertial measurement unit (IMU) is installed on the remote controller. This six-axis IMU includes an accelerometer and a gyroscope. The accelerometer measures acceleration along the x, y, and z axes, while the gyroscope measures angular velocity along these axes. The IMU's heading, roll, and pitch angles are calculated using an attitude calculation algorithm. The roll and pitch angles are calculated based on the component of gravity in the plane of the roll and pitch angles and are absolute angles.
[0025] Determining the absolute pitch angle and relative heading angle of the remote controller based on the raw measurement data from the inertial measurement unit further includes: deducting the three-axis acceleration bias and angular velocity bias from the raw measurement data from the inertial measurement unit; performing attitude solution to obtain a quaternion representation of the remote controller's attitude; obtaining the remote controller's Euler angle representation based on the quaternion representation; and determining the absolute pitch angle and relative heading angle based on the Euler angle representation. Because the measurements of the accelerometer and gyroscope contain errors such as bias, these biases must be deducted before performing attitude solution to ensure the accuracy and stability of the calculated attitude data.
[0026] Step S02: Obtaining raw measurement data of the wireless communication box, and determining a first observation angle of the remote control and the distance from the remote control to the smart TV screen based on the raw measurement data of the wireless communication box, wherein the first observation angle is the horizontal angle between a line connecting the wireless communication box and the remote control and a pointing line of the remote control, and the wireless communication box is installed on the smart TV.
[0027] In this step, the wireless communication box can be an SLP communication box or an UWB communication box. The SLP (Sparkling Position) communication box uses sparkling positioning technology and can calculate the absolute distance between two points by multiplying the signal's time of flight (TOF) by the speed of light. The first observation angle can be calculated using the signal's phase difference of arrival (PDOA). The UWB (Ultra Wide Band) communication box uses wireless carrier communication technology and transmits data using nanosecond-level, non-sinusoidal narrow pulses. The SLP communication box can calculate the absolute distance between two points by multiplying the signal's time of flight (TOF) by the speed of light. The first observation angle can be calculated using the signal's phase difference of arrival (PDOA).
[0028] The raw measurement data of the wireless communication box also includes the distance between the wireless communication box and the remote control, a second observation angle, and a third observation angle. The second observation angle is the horizontal angle between the line connecting the wireless communication box and the remote control and the centerline of the wireless communication box, and the third observation angle is the vertical angle between the line connecting the wireless communication box and the remote control and the centerline of the wireless communication box. This step further includes determining the distance from the remote control to the smart TV screen using the distance between the wireless communication box and the remote control, the second observation angle, and the third observation angle. It is understood that the distance from the remote control to the smart TV screen is the shortest distance between the remote control and the smart TV screen.
[0029] Step S03: Determine the vertical movement distance of the cursor on the screen according to the absolute pitch angle and the distance from the remote control to the smart TV screen.
[0030] In this step, since the absolute pitch angle is an absolute angle, no conversion is required. Once the distance from the remote control to the smart TV screen is determined, the vertical movement distance of the cursor on the screen can be directly calculated. This calculation process can be performed using conventional formulas and will not be further described here.
[0031] Step S04: Using a Kalman filter fusion algorithm, the relative heading angle is converted into an absolute heading angle based on the first observation angle.
[0032] In this step, the heading angle has no external reference data as a benchmark. Therefore, the heading angle of the six-axis IMU is based on the initial moment when the IMU is powered on as 0 degrees. It is a relative angle and cannot sense the direction of the screen. It is necessary to use a wireless communication box to convert the relative heading angle into an absolute heading angle.
[0033] Furthermore, when the relative heading angle is converted to the absolute heading angle based on the first observation angle through the Kalman filter fusion algorithm, when the first observation angle is updated, the absolute heading angle corresponding to the current frame is calculated using the following formula:
[0034] in, Indicates the absolute heading angle corresponding to the current frame, Indicates the absolute heading angular velocity corresponding to the current frame, Indicates the absolute heading angular acceleration corresponding to the current frame, Indicates the absolute heading angle corresponding to the previous frame, Indicates the absolute heading angular velocity corresponding to the previous frame, Indicates the absolute heading angular acceleration corresponding to the previous frame, represents the first observation angle, and They respectively represent the relative heading angular velocity and relative heading angular acceleration determined according to the original measurement data of the inertial measurement unit, KT represents the first filter coefficient, KV represents the second filter coefficient, and KA represents the third filter coefficient.
[0035] Furthermore, when the relative heading angle is converted to the absolute heading angle based on the first observation angle through the Kalman filter fusion algorithm, when the first observation angle is not updated, the absolute heading angle corresponding to the next frame is predicted using the following formula:
[0036] in, Indicates the absolute heading angle corresponding to the next frame, Indicates the absolute heading angular velocity corresponding to the next frame, Indicates the absolute heading angular acceleration corresponding to the next frame, Indicates the time interval between two adjacent frames of data.
[0037] Furthermore, before converting the relative heading angle to an absolute heading angle using the first observation angle as a reference using the Kalman filter fusion algorithm, the heading angle, heading angular velocity, heading angular acceleration, first filter coefficient, second filter coefficient, and third filter coefficient may be initialized to improve the accuracy of the calculation process. Furthermore, the initial values of the heading angular velocity and heading angular acceleration may be determined based on the relative heading angle; and the first frame of data at the first observation angle may be determined as the initial heading angle value.
[0038] Among them, when the first observation angle is updated, if the remote control does not move laterally, it is often due to abnormal interference. In order to eliminate the influence of abnormal interference, in the process of converting the relative heading angle into the absolute heading angle, it is judged whether the remote control has moved laterally based on the first observation angle. If it is judged that the remote control has moved laterally, the KT value is increased to increase the degree of trust in the first observation angle; if it is judged that the remote control has not moved laterally, the KT value is reduced to reduce the degree of trust in the first observation angle. Furthermore, when the first observation angle is updated, it can be first judged whether the first observation angle is credible. If it is judged that the first observation angle is not credible, the KT value is set to zero to prevent interference from the first observation angle. For example, when the first observation angle jumps or reverses, the KT value is set to zero.
[0039] Step S05: Determine the horizontal movement distance of the cursor on the screen according to the absolute heading angle and the distance from the remote control to the smart TV screen.
[0040] In this step, since the absolute heading angle is an absolute angle, the horizontal movement distance of the cursor on the screen can be directly calculated by determining the distance from the remote control to the smart TV screen. This calculation process can use a conventional calculation formula and will not be repeated here.
[0041] It should be noted that since the update frequencies of the relative heading angle and the first observation angle are often different, and the update frequency of the first observation angle is often lower, when the first observation angle is updated, the absolute heading angle corresponding to the current frame can be directly used to calculate the horizontal movement distance of the cursor on the screen; when the first observation angle is not updated, the absolute heading angle corresponding to the predicted next frame is used to calculate the horizontal movement distance of the cursor on the screen. Therefore, when the update frequency of the first observation angle is low, the horizontal movement distance can still be generated at a higher frequency.
[0042] Step S06: sending the vertical moving distance and the horizontal moving distance to the smart TV so that the screen of the smart TV displays the cursor position.
[0043] In this step, after obtaining the vertical movement distance and the horizontal movement distance, the smart TV can update the cursor position in real time through the screen.
[0044] When executing the above-mentioned remote control cursor position generation method, the method first obtains raw measurement data from the inertial measurement unit and determines the absolute pitch angle and relative heading angle of the remote control based on the raw measurement data from the inertial measurement unit. The method then obtains raw measurement data from the wireless communication box and determines the first observation angle of the remote control and the distance from the remote control to the smart TV screen based on the raw measurement data from the wireless communication box. The method then determines the vertical movement distance of the cursor on the screen based on the absolute pitch angle and the distance from the remote control to the smart TV screen. The method then converts the relative heading angle into an absolute heading angle using the first observation angle as a reference using a Kalman filter fusion algorithm. The method then determines the horizontal movement distance of the cursor on the screen based on the absolute heading angle and the distance from the remote control to the smart TV screen. The method then sends the vertical movement distance and the horizontal movement distance to the smart TV so that the cursor position is displayed on the smart TV screen. As can be seen, by configuring the inertial measurement unit and the wireless communication box, the relative heading angle of the remote control can be converted into an absolute heading angle, allowing the user's actions on the remote control to be reflected in the movement of the on-screen cursor in real time. This facilitates user operation of the smart TV and expands the application scenarios of smart TVs. The method also reduces hardware costs and facilitates large-scale promotion and application.
[0045] The present invention also discloses a remote control. The remote control 40 includes a processor 41 and a memory 42. The memory 42 is configured to store a computer program 43. When executed by the processor 41, the computer program 43 implements the aforementioned method for generating a cursor position for the remote control. By implementing the aforementioned method for generating a cursor position for the remote control, the remote control can conveniently control a smart TV by controlling the movement of the cursor, thereby improving the user experience, being cost-effective, and facilitating widespread application.
[0046] The technical features of the above-mentioned embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above-mentioned embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0047] The above-described embodiments merely illustrate several implementations of the present invention, and while their descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the patent. It should be noted that a person skilled in the art would be able to make numerous variations and improvements without departing from the spirit of the present invention, all of which fall within the scope of protection of the present invention. Therefore, the scope of protection of the patent for this invention shall be determined by the appended claims.
Claims
1. A method for generating a cursor position of a remote controller, characterized in that: Applied to a remote controller, the method includes: Acquire raw measurement data of an inertial measurement unit, and determine an absolute pitch angle and a relative heading angle of the remote controller according to the raw measurement data of the inertial measurement unit; Acquire raw measurement data of the wireless communication box, and determine a first observation angle of the remote control and a distance from the remote control to the smart TV screen according to the raw measurement data of the wireless communication box, wherein the first observation angle is a horizontal angle between a line connecting the wireless communication box and the remote control and a pointing line of the remote control, and the wireless communication box is installed on the smart TV; Determine the vertical movement distance of the cursor on the screen according to the absolute pitch angle and the distance from the remote control to the smart TV screen; By using a Kalman filter fusion algorithm, the relative heading angle is converted into an absolute heading angle based on the first observation angle; Determine the horizontal movement distance of the cursor on the screen by using the absolute heading angle and the distance from the remote control to the smart TV screen; The vertical moving distance and the horizontal moving distance are sent to the smart TV so that the screen of the smart TV displays the cursor position.
2. The method for generating a cursor position of a remote controller according to claim 1, characterized in that: The converting the relative heading angle into an absolute heading angle based on the first observation angle by using a Kalman filter fusion algorithm comprises: When the first observation angle is updated, the absolute heading angle corresponding to the current frame is calculated using the following formula: in, Indicates the absolute heading angle corresponding to the current frame, Indicates the absolute heading angular velocity corresponding to the current frame, Indicates the absolute heading angular acceleration corresponding to the current frame, Indicates the absolute heading angle corresponding to the previous frame, Indicates the absolute heading angular velocity corresponding to the previous frame, Indicates the absolute heading angular acceleration corresponding to the previous frame, represents the first observation angle, and They respectively represent the relative heading angular velocity and the relative heading angular acceleration determined according to the original measurement data of the inertial measurement unit, KT represents the first filter coefficient, KV represents the second filter coefficient, and KA represents the third filter coefficient.
3. The method for generating a cursor position of a remote controller according to claim 2, characterized in that: The converting the relative heading angle into an absolute heading angle based on the first observation angle by using a Kalman filter fusion algorithm also includes: When the first observation angle is not updated, the following formula is used to predict the absolute heading angle corresponding to the next frame: in, Indicates the absolute heading angle corresponding to the next frame, Indicates the absolute heading angular velocity corresponding to the next frame, Indicates the absolute heading angular acceleration corresponding to the next frame, Indicates the time interval between two adjacent frames of data.
4. The method for generating a cursor position of a remote controller according to claim 3, characterized in that: Before converting the relative heading angle into an absolute heading angle based on the first observation angle by using a Kalman filter fusion algorithm, the method further includes: The heading angle, the heading angular velocity, the heading angular acceleration, the first filter coefficient, the second filter coefficient, and the third filter coefficient are initialized.
5. The method for generating a cursor position of a remote controller according to claim 4, characterized in that: The method comprises: Determine an initial value of the heading angular velocity and an initial value of the heading angular acceleration according to the relative heading angle; The first frame data of the first observation angle is determined as the initial value of the heading angle.
6. The method for generating a cursor position of a remote controller according to any one of claims 2 to 5, characterized in that: The method further comprises: Determining whether the remote control moves laterally according to the first observation angle; If it is determined that the remote control has moved horizontally, the KT value is increased; If it is determined that the remote controller does not generate lateral movement, the KT value is reduced.
7. The method for generating a cursor position of a remote controller according to claim 6, characterized in that: The method further comprises: When the first observation angle is updated, determining whether the first observation angle is credible; If it is determined that the first observation angle is not credible, the KT value is set to zero.
8. The method for generating a cursor position of a remote controller according to any one of claims 1 to 5, characterized in that: Determining the absolute pitch angle and relative heading angle of the remote controller according to the original measurement data of the inertial measurement unit includes: Deducting the three-axis acceleration bias and angular velocity bias according to the original measurement data of the inertial measurement unit; Perform attitude calculation to obtain the quaternion representation of the remote controller's attitude; The Euler angle representation of the remote controller is obtained according to the quaternion representation, and the absolute pitch angle and relative heading angle are determined according to the Euler angle representation.
9. The method for generating a cursor position of a remote controller according to any one of claims 1 to 5, characterized in that: The original measurement data of the wireless communication box includes the distance between the wireless communication box and the remote control, the second observation angle and the third observation angle, wherein the second observation angle is the horizontal angle between the line connecting the wireless communication box and the remote control and the center line of the wireless communication box, and the third observation angle is the vertical angle between the line connecting the wireless communication box and the remote control and the center line of the wireless communication box; the method further includes: The distance from the remote control to the smart TV screen is determined by the distance between the wireless communication box and the remote control, the second observation angle and the third observation angle.
10. A remote controller, characterized in that: The remote controller comprises a processor and a memory, wherein the memory is used to store a computer program, and when the computer program is executed by the processor, the method for generating a cursor position of the remote controller according to any one of claims 1 to 9 is implemented.
Citation Information
Patent Citations
Space absolute displacement sensing method and space absolute displacement sensing device
CN103970297A
Method for controlling movement of cursor on host screen, and gamepad
CN107391005A
Intelligent pushing robot integrated navigation system and method based on multi-sensor fusion
CN114216458A
Pedestrian collaborative navigation method based on distance and angle
CN116067369A
Inertial measurement unit (IMU) based vehicles tracking
US11656096B1
Cited By
Cursor positioning method and device for pointing remote controller and pointing remote controller
CN119573716A
A cursor positioning method and device pointing to a remote controller and a pointing remote controller
CN119573716B
Display control method, electronic device, and system
WO2026158324A1
