Active pen and interaction system
By using UWB modules and multiple antennas in active pens to determine the position and direction, the problem of low operating sensitivity and positioning accuracy of the existing active pen flying mouse function is solved, achieving higher operating performance and user experience.
Patent Information
- Application Number
- CN202510220239.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-25
- Publication Date
- 2025-06-17
AI Technical Summary
The existing Flying Squirrel function implementation methods in active pens have problems with low operational sensitivity and positioning accuracy, which affects the user experience.
Set up the UWB module and multiple antennas in the active pen, and determine the position and direction of the active pen through the UWB signal to improve operational sensitivity and positioning accuracy.
Improves the Flying Squirrel operation performance and laser pointer indication performance of the active pen, provides a better user experience, and reduces hardware costs.
Smart Images
Figure CN120161957A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the technical field of smart pens, and particularly to an active pen and an interaction system. Background Art
[0002] With the continuous development of science and technology, in order to achieve convenient input for electronic devices, active pens have emerged. By continuously moving the tip of the active pen on the display screen of the electronic device, accurate and fast handwritten input can be achieved. Currently, in addition to the most basic writing function, more and more new technologies and functions have been added to active pens. The addition of the air mouse function to active pens is an important new technology, which is applied to host wireless screen mirroring control, document explanation, etc., and can replace the mouse to perform cursor positioning and control on the screen.
[0003] Currently, the implementation method of the air mouse function in existing active pens mainly uses an Inertial Measurement Unit (IMU), which cooperates with an algorithm to identify the acceleration and angular velocity information of the user's manipulation of the up, down, left, and right movement or shaking of the active pen to move the position of the cursor on the host screen. However, the IMU can only identify relative movement amounts and cannot identify the relative position between the active pen and the host, resulting in problems of low operation sensitivity and positioning accuracy, thus affecting the user experience. Summary of the Invention
[0004] This application provides an active pen and an interaction system, which is beneficial to improving the operation performance of the active pen and providing a better user experience for users.
[0005] In a first aspect, an active pen is provided, including: a UWB module; a plurality of antennas connected to the UWB module, and the plurality of antennas are used to interact with a display device through UWB signals, and the UWB signals are used to determine the position and direction of the active pen to determine the corresponding cursor position of the active pen in the display interface of the display device.
[0006] Through the technical solution of the embodiments of this application, by setting a UWB module and a plurality of antennas in the active pen, relatively accurate positioning and direction detection of the active pen can be performed, which is beneficial to improving the operation sensitivity of the active pen to the display device, so as to improve the air mouse operation performance of the active pen, especially the indication performance when the active pen is used as a laser pointer, achieving the effect of pointing exactly where it reaches. This technical solution can greatly improve the user experience of using the active pen.
[0007] In some possible implementation manners, the plurality of antennas include two antennas, the two antennas are disposed at the end of the active pen, and the connection direction of the two antennas is perpendicular to the central axis direction of the active pen.
[0008] In this technical solution, two antennas can be arranged side by side at the end of the active pen. These two antennas can meet the accurate positioning of the active pen and identify the pointing direction of the active pen. In addition, these two antennas do not need to occupy a large longitudinal space of the active pen, can adapt to the compact internal space of the active pen, and are beneficial to the position design of other components inside the active pen, thereby optimizing the overall structural performance and application performance of the active pen.
[0009] In some possible implementation manners, UWB signals are interacted between the two antennas in the active pen and the two antennas in the display device; the phase difference of the UWB signals between the two antennas in the active pen and the first antenna in the display device is used to determine the first angle between the line connecting the two antennas in the active pen and the first antenna, and the flight time of the UWB signal between the third antenna in the active pen and the first antenna in the display device is used to determine the first distance between the active pen and the first antenna; the phase difference of the UWB signals between the two antennas in the active pen and the second antenna in the display device is used to determine the second angle between the line connecting the two antennas in the active pen and the second antenna, and the flight time of the UWB signal between the third antenna in the active pen and the second antenna in the display device is used to determine the second distance between the active pen and the second antenna; the first angle, the second angle, the first distance, and the second distance are used to determine the position and pointing direction of the active pen.
[0010] Through the technical solution of the embodiments of the present application, 2 antennas can be provided both in the display device and the active pen, so as to achieve relatively accurate positioning of the active pen, thereby improving the operation accuracy and operation sensitivity of the active pen when used as a flying mouse or a laser pointer. While taking into account the improvement of the performance of the active pen, this technical solution can also reduce the number of antennas in the active pen and the display device, and reduce the hardware costs of the active pen and the display device.
[0011] In some possible implementation manners, the UWB module and multiple antennas are used to detect the position and pointing direction of the active pen at a preset frequency to determine the corresponding cursor movement of the active pen on the display interface of the display device.
[0012] In some possible implementation manners, the active pen further includes: an IMU module, which is used to detect the pose information of the active pen, and the pose information is used to determine the corresponding cursor movement of the active pen on the display interface of the display device and / or correct the position and pointing direction of the active pen.
[0013] In some possible implementation manners, the IMU module detects multiple pose information of the active pen at a preset frequency, and the multiple pose information is used to determine the corresponding cursor movement of the active pen on the display interface of the display device.
[0014] In this technical solution, based on the UWB module and multiple antennas of the active pen, the initial position and direction of the active pen can be accurately positioned. Based on this, subsequently, the pose information of the active pen measured by the IMU module can be used to detect the relative changes in the position and direction of the active pen, so as to obtain the corresponding cursor position of the active pen in the display interface of the display device, and realize functions such as the fly mouse function and laser pointer function of the active pen. The algorithm complexity of this technical solution is relatively low, which is beneficial to improving the response speed and real-time performance of the active pen for cursor control.
[0015] In some possible implementation manners, the IMU module detects multiple pose information of the active pen at a first preset frequency, and the UWB module and multiple antennas are used to detect multiple positions and directions of the active pen at a second preset frequency. The multiple pose information is used to correct the multiple positions and directions, and the corrected multiple positions and directions are used to determine the cursor movement corresponding to the active pen in the display interface of the display device.
[0016] In this implementation manner, the real-time relative changes of the active pen measured by the IMU module can be utilized, and the real-time position changes and direction changes of the active pen measured by the UWB module and multiple antennas can also be utilized. By combining the information measured by the IMU module to correct the information measured by the UWB module, the drift error of the UWB measurement can be reduced. And by fusing the data of UWB and IMU, the limitations of a single sensor can be effectively overcome, and a more accurate positioning result can be achieved, so as to improve the accuracy of the active pen for cursor control of the display device, and improve the real-time performance and stability of the system.
[0017] In some possible implementation manners, the active pen further includes: a communication module, configured to send the pose information of the active pen to the display device. The display device determines the position and direction of the active pen according to the UWB signal, and displays a cursor in the display interface according to the pose information and the position and direction of the active pen.
[0018] In some possible implementation manners, the active pen further includes: a communication module, configured to determine the position and direction of the active pen according to the UWB signal, correct the position and direction of the active pen according to the pose information of the active pen, and send the corrected position and direction of the active pen to the display device, so that the display device displays a cursor in the display interface.
[0019] In some possible implementation manners, the communication module is further configured to receive a switch control signal, and control the on / off states of the UWB module and / or the IMU module according to the switch control signal.
[0020] In some possible implementation manners, the communication module includes a low-power Bluetooth module.
[0021] In some possible embodiments, the active pen further includes: a switch module, which is configured to detect user operations and control the on / off states of the UWB module and / or the IMU module according to the user operations.
[0022] Through the technical solution of the embodiments of the present application, a switch module, such as a button, etc., is provided on the active pen. The mouse function can be turned on based on user needs for positioning detection of the active pen. In other periods, the UWB module and the IMU module can be in the off state to reduce the power consumption of the active pen. While improving the use of the mouse function of the active pen to enhance the user experience, the battery life of the active pen can also be improved.
[0023] In a second aspect, an interaction system is provided, including: a display device, and the active pen in the first aspect or any one of the possible embodiments in the first aspect, where the active pen is configured to control the position of the cursor in the display interface of the display device.
[0024] In some possible embodiments, the display device includes a UWB module and multiple antennas. Description of the Drawings
[0025] Figure 1 Shows an interaction schematic diagram of an active pen and a display device provided by an embodiment of the present application.
[0026] Figure 2 Shows a schematic structural block diagram of an active pen provided by an embodiment of the present application.
[0027] Figure 3 Shows a structural schematic diagram of an active pen provided by an embodiment of the present application.
[0028] Figure 4 Shows a positioning schematic diagram of two antennas in an active pen provided by an embodiment of the present application.
[0029] Figure 5 Shows another schematic structural block diagram of an active pen provided by an embodiment of the present application.
[0030] Figure 6 Shows another structural schematic diagram of an active pen provided by an embodiment of the present application.
[0031] Figure 7 Shows a schematic diagram of an interaction system provided by an embodiment of the present application. Detailed Embodiments
[0032] Next, the technical solutions in the present application will be described with reference to the accompanying drawings.
[0033] An active stylus, also known as an active pen, is an advanced electronic writing tool that interacts with a touch screen through built-in electronic components and sensors, providing a more precise and smooth writing experience than traditional passive styli. With the continuous development of technology, the functions and performance of active pens are also constantly improving, making them an essential accessory for smart devices.
[0034] In some application scenarios, in addition to operating on the screen, the active pen can also incorporate the Airmouse (or also known as the air mouse) function to be used as an air mouse to control various display devices such as computers, TVs, mobile phones, projectors, etc.
[0035] Figure 1 The figure shows an interaction schematic diagram of an active pen and a display device provided by an embodiment of the present application.
[0036] As shown in Figure 1 the figure, the active pen 10 can be used as an air mouse to control the display device 11. The active pen 10 can be wirelessly connected to the display device 11 so that the relevant control signals of the active pen 10 can reach the display device 11 through wireless transmission, and the display device 11 can perform relevant operations according to the control signals of the active pen 10.
[0037] As an example, Figure 1 the active pen 10 can have a laser pointer function. Through the information interaction between the active pen 10 and the display device 11, the display device 11 can identify the movement of the active pen 10, thereby displaying a cursor corresponding to the active pen 10.
[0038] Figure 1 In the active pen 10 shown in the figure, an IMU 101 can be provided. Through this IMU 101, motion data such as the acceleration and angular velocity of the active pen 10 in all directions in space can be detected. Based on the motion data detected by this IMU 101 and in conjunction with an algorithm, the relative movement of the active pen 10 in space can be identified, such as moving up, down, left, or right. Based on this relative movement, the display device 11 can display a cursor corresponding to the active pen 10, and the movement of this cursor is consistent with the relative movement of the active pen 10, thereby realizing the laser pointer function of the active pen 10.
[0039] In the above case where the IMU 101 is used to implement the laser pointer function or other functions of the active pen 10, the IMU 101 can only identify the relative movement amount of the active pen 10, and cannot achieve the relative position between the active pen 10 and the display device 11, nor can it accurately determine whether the active pen 10 is operating directly facing the display device 11. Therefore, in this technical solution, the positioning accuracy of the display device 11 for the active pen 10 is poor, and the operation sensitivity of the active pen 10 for the display device 11 is also correspondingly poor, which easily affects the user experience of using the active pen 10.
[0040] In view of this, the embodiments of the present application provide an improved active pen solution, which can improve the operation performance of the active pen, such as improving the flying mouse operation performance of the active pen, thereby improving the user experience.
[0041] Figure 2 Fig. shows a schematic structural block diagram of an active pen provided by an embodiment of the present application.
[0042] As Figure 2 shown, the active pen 200 includes: an Ultra-Wide Band (UWB) module 210 and a plurality of antennas 220 (two antennas 220 are shown schematically in the figure). Among them, the plurality of antennas 220 are connected to the UWB module 210, and the plurality of antennas 220 are used to interact with the display device with UWB signals, and the UWB signals are used to determine the position and pointing of the active pen 200 to determine the cursor position corresponding to the active pen 200 in the display interface of the display device.
[0043] In the embodiment of the present application, the active pen 200 may be provided with a UWB module 210, and the UWB module 210 may include, for example, a UWB chip. The UWB technology is a wireless communication technology that transmits information by using a very wide frequency band, thereby achieving high-speed data transmission and precise positioning functions. The UWB technology can provide centimeter-level positioning accuracy, and thus is more suitable for indoor positioning systems. By mounting the UWB module 210 on the active pen 200, the positioning accuracy of the active pen 200 can be improved.
[0044] To achieve UWB interaction with the active pen 200, a UWB module and an antenna are also correspondingly provided in the display device. In the active pen 200, the UWB module 210 is connected to multiple antennas 220, so that the multiple antennas 220 can realize the interactive transmission of UWB signals. The UWB module 210 and the multiple antennas 220 can form a UWB module in the active pen 200. The UWB module formed by the UWB module and the antenna in the display device can interact with the UWB module in the active pen 200 for UWB signals, and through algorithms, the relative position of any one or more of the multiple antennas 220 in the active pen 200 and the display device, as well as the relative direction between the multiple antennas 220, can be calculated.
[0045] Furthermore, given the positions of the multiple antennas 220 in the active pen 200, the relative position between the active pen 200 and the display device can be determined based on the relative positions of the multiple antennas 220 and the display device, and the pointing direction of the active pen 200 relative to the display device can be determined based on the relative direction between the multiple antennas 220. Based on the relative position and pointing direction of the active pen 200 and the display device, a cursor corresponding to the active pen 200 can be more accurately displayed on the display interface of the display device. For the sake of convenience in description, in the following related embodiments, the relative position between the active pen 200 and the display device may also be simply referred to as the position of the active pen 200, and the relative position between the antenna 220 in the active pen 200 and the display device may also be simply referred to as the position of the antenna 220.
[0046] Through the technical solution of the embodiments of the present application, by setting a UWB module and multiple antennas in the active pen, the active pen can be positioned more accurately, which is beneficial to improving the operation sensitivity of the active pen to the display device, so as to improve the fly mouse operation performance of the active pen, especially the indication performance when the active pen is used as a laser pen, and achieve the effect of what is pointed is what is reached. This technical solution can greatly improve the user experience of using the active pen.
[0047] In some embodiments, two antennas 220 may be provided in the above-mentioned active pen 200, and the two antennas 220 may be provided at the same end of the active pen 200. Figure 3 The structural schematic diagram of an active pen provided by the embodiments of the present application is shown.
[0048] As Figure 3 shown, in the active pen 200, the two antennas 220 may be arranged side by side at the pen tail end of the active pen 200, and the connection direction of the two antennas 220 may be perpendicular to the central axis direction of the active pen 200.
[0049] The UWB module 210 can be disposed on one side of the two antennas 220 facing the inside of the active pen 200 and is electrically connected to the two antennas 220. The UWB module 210 and the two antennas 220 can jointly form a UWB module, and the UWB module can be further electrically connected to the main circuit board 201 in the active pen 200. A control module (such as a control chip), a communication module (such as a communication chip), or other functional modules of the active pen 200 can be disposed on the main circuit board 201. The control module can be used to control the operation of the UWB module 210 and can receive the detection signal of the UWB module 210 to further process the detection signal.
[0050] In this technical solution, two antennas can be arranged side by side at the end of the active pen. The two antennas can meet the accurate positioning of the active pen and identify the pointing direction of the active pen. In addition, the two antennas do not need to occupy a large longitudinal space of the active pen, can adapt to the compact internal space of the active pen, and are beneficial to the position design of other components inside the active pen, thereby optimizing the overall structural performance and application performance of the active pen.
[0051] Next, taking the active pen including two antennas as an example, the related methods for determining the position and pointing direction of the active pen according to the UWB signals of the two antennas provided in the embodiments of the present application will be described.
[0052] Figure 4 The positioning schematic diagram of two antennas in an active pen provided in the embodiments of the present application is shown.
[0053] As Figure 4 shown, the two antennas in the active pen are denoted as antenna A and antenna B, and the display device can also be correspondingly provided with multiple antennas. One of the antennas C is schematically shown in the figure. The positions of the multiple antennas in the display device are not specifically limited in the embodiments of the present application, and the position of the antenna C shown in the figure is only for illustration.
[0054] In some embodiments, the antenna C can send UWB signals to the antenna A and the antenna B. For the convenience of description, the UWB signal received by the antenna A can be referred to as the first UWB signal, and the UWB signal received by the antenna B can be referred to as the second UWB signal. According to the signal arrival phase difference (PDOA) algorithm or the arrival angle (AOA) algorithm, the active pen can calculate the direction angles of the two UWB signals arriving at the antenna A and the antenna B according to the phase difference between the first UWB signal and the second UWB signal. For example, the angle α at which the antenna B receives the second UWB signal is shown in the figure. The angle α can be the included angle between the line connecting the antenna A and the antenna B and the antenna C.
[0055] In Figure 4In the example shown, the antennas A, B, and C may be in a far-field condition. Among them, the distance difference between the far field and the near field is generally bounded by (2D 2 / λ), where D is the size of the antenna and λ is the wavelength of the UWB signal. Taking D = 2 cm as an example, the distance between the transmitting and receiving antennas can be in the far-field condition when it is more than a dozen centimeters. In the interaction scenario between the active pen and the display device involved in the embodiments of the present application, the distance between the active pen and the display device is generally in the far-field condition. Under the far-field condition, the first UWB signal and the second UWB signal sent by the antenna C to the antennas A and B can be parallel waves as shown in the figure.
[0056] Under this far-field condition, the angle α at which the antenna B receives the second UWB signal can be calculated by the following formula: ; where λ is the wavelength of the UWB signal sent by the antenna C, d is the distance between the antennas A and B, is the phase difference between the first UWB signal received by the antenna A and the second UWB signal received by the antenna B. Further, the distance r between the antenna B and the antenna C can be calculated according to the time of flight (TOF) of the UWB signal between the antenna B and the antenna C.
[0057] In the case where the display device includes multiple antennas, based on another antenna of the display device other than the antenna C, the distance and angle between the antenna and the active pen can also be calculated according to the above method. As an example, the display device may further include an antenna D, and the antenna D can send UWB signals to the antennas A and B in the active pen. For the sake of description, the UWB signal received by the antenna A can be called the third UWB signal, and the UWB signal received by the antenna B can be called the fourth UWB signal. Based on a similar method as above, the angle α' at which the antenna B receives the fourth UWB signal can be calculated according to the phase difference between the third UWB signal and the fourth UWB signal. The angle α' can be the included angle between the line connecting the antennas A and B and the antenna D, and the distance r' between the antenna B and the antenna D can be obtained according to the time of flight between the antenna B and the antenna D. According to the above angles α, α', distances r, and r', the position of the antenna B in the three-dimensional space and the relative direction of the line connecting the antennas A and B can be determined. Further, the position and direction of the active pen can be determined.
[0058] Through the technical solution of the embodiments of the present application, two antennas can be provided in both the display device and the active pen, so as to achieve relatively accurate positioning of the active pen, thereby improving the operation accuracy and operation sensitivity of the active pen when it is used as a flying mouse or a laser pointer. While taking into account the improvement of the performance of the active pen, this technical solution can also reduce the number of antennas in the active pen and the display device, and reduce the hardware costs of the active pen and the display device.
[0059] Optionally, in order to improve the positioning accuracy, the display device may also include more than two antennas, and each of the antennas can interact with the two antennas in the active pen for UWB signals. For example, the display device includes three antennas, and the three antennas can perform relatively accurate positioning of the active pen. In some examples, the three antennas in the display device can determine the spatial position of any one of the antennas in the active pen, so as to determine the accurate position of the active pen. On this basis, based on the two included angles between the connections of any two antennas in the display device and the antennas in the active pen, the connection direction of the two antennas in the active pen can be determined, so as to determine the pointing direction of the active pen.
[0060] In some embodiments, the UWB module and multiple antennas can be used to detect the position and pointing direction of the active pen at a preset frequency, so as to determine the corresponding cursor movement of the active pen on the display interface of the display device.
[0061] In this embodiment, the active pen can perform real-time UWB communication with the display device, so as to detect the real-time position change and pointing change of the active pen. The display device can adjust the position of the cursor correspondingly on its display interface according to the real-time position change and pointing change of the active pen, so as to achieve the effect of the cursor following the movement of the active pen.
[0062] Figure 5 Another schematic structural block diagram of the active pen provided by the embodiments of the present application is shown.
[0063] As Figure 5 shown, in the embodiments of the present application, in addition to including a UWB module 210 and multiple antennas 220, the active pen 200 may further include an IMU module 230. The IMU module 230 can be used to detect the pose information of the active pen 200, and the pose information can be used to determine the corresponding cursor movement of the active pen 200 on the display interface of the display device and / or correct the position and pointing direction of the active pen 200.
[0064] In the embodiments of the present application, the IMU module 230 may include a 3-axis gyroscope and a 3-axis accelerometer to measure information such as the acceleration and angular velocity of the active pen. The acceleration information of the active pen can reflect the relative position change of the active pen, and the angular velocity information of the active pen can reflect the attitude and attitude change of the active pen. In the embodiments of the present application, information such as the relative position change of the active pen and the attitude and attitude change of the active pen can be referred to as the pose information of the active pen. Optionally, the pose information of the active pen 200 may include acceleration and angular velocity information. In some embodiments, the IMU module 230 can detect the acceleration and angular velocity information of the active pen in real time. For example, the acceleration and angular velocity information of the active pen can be detected at a preset frequency. After determining the initial position and direction of the active pen based on the UWB signal, subsequently, according to the acceleration and angular velocity and other information of the active pen 200 detected by the IMU module 230, the position movement and angle change of the active pen 200 can be determined, so as to correspondingly adjust the position of the cursor in the display interface of the display device, thereby achieving the effect of the cursor following the movement of the active pen.
[0065] In this technical solution, based on the UWB module and multiple antennas of the active pen, the initial position and direction of the active pen can be accurately positioned. Based on this, subsequently, the pose information of the active pen measured by the IMU module can be used to detect the relative changes in the position and direction of the active pen, so as to obtain and adjust the corresponding cursor position of the active pen in the display interface of the display device, and realize functions such as the air mouse function and the laser pointer function of the active pen. The algorithm complexity of this technical solution is relatively low, which is beneficial to improving the response speed and real-time performance of the active pen for cursor control.
[0066] In order to further improve the accuracy of the active pen for cursor control, in some other embodiments, IMU and UWB can be combined to detect the position and direction of the active pen in real time. For example, the IMU module 230 detects multiple pose information of the active pen at a first preset frequency, and the UWB module 210 and multiple antennas 220 are used to detect multiple positions and directions of the active pen 200 at a second preset frequency. The multiple pose information can be used to correct the multiple positions and directions, and the corrected multiple positions and directions are used to determine the corresponding cursor movement of the active pen in the display interface of the display device.
[0067] In this embodiment, the real-time relative changes of the active pen can be measured by the IMU module, and the real-time position changes and pointing changes of the active pen can also be measured by the UWB module and multiple antennas. The information measured by the UWB module is corrected in combination with the information measured by the IMU module, which can reduce the drift error of the UWB measurement. By fusing the data of UWB and IMU, the limitations of a single sensor can be effectively overcome and more accurate positioning results can be achieved, thereby improving the accuracy of the active pen's cursor control of the display device and improving the real-time and stability of the system.
[0068] Optionally, the first preset frequency and the second preset frequency may be equal or unequal. For example, the first preset frequency and the second preset frequency may be equal, so as to synchronously detect changes in parameters such as the position and angle of the active pen. For another example, the first preset frequency may be greater than the second preset frequency, so as to reduce the detection frequency of the UWB module, while taking into account the positioning accuracy, reducing the power consumption of the UWB module and the active pen.
[0069] Continue to see Figure 5 As shown, in some embodiments, the active pen 200 may further include a communication module in addition to the UWB module 210, the plurality of antennas 220, and the IMU module 230. As an example, the communication module is Figure 5 The figure shows a Bluetooth Low Energy (BLE) module 240. In other examples, the communication module may also be other types of wireless communication modules, which are not specifically limited in the present application. The communication module may include a wireless communication chip. The BLE module 240 may include a BLE chip.
[0070] The BLE module 240 can be used for wireless communication between the active pen 200 and the display device. In some embodiments, the BLE module 240 can be used to send the posture information of the active pen measured by the IMU module to the display device. A BLE module can also be provided in the display device to communicate with the BLE module in the active pen.
[0071] In some embodiments, the positioning of the active pen can be performed by a display device. For example, the BLE module in the active pen is used to send the posture information of the active pen detected by the IMU module to the display device, and the display device determines the position and direction of the active pen according to the UWB signal interacting with multiple antennas in the active pen, and displays a cursor in the display interface according to the posture information and the position and direction of the active pen.
[0072] Alternatively, in some other embodiments, the positioning of the active pen can also be performed by the active pen itself. For example, the BLE module in the active pen is used to determine the position and orientation of the active pen based on the UWB signal interacting with the display device, correct the position and orientation of the active pen according to the pose information of the active pen, and send the corrected position and orientation of the active pen to the display device so that the display device can display a cursor on the display interface.
[0073] Figure 6 FIG. shows another schematic structural diagram of the active pen provided by the embodiments of the present application.
[0074] As shown in Figure 6 In the embodiments of the present application, the BLE module 240 and the IMU module 230 can be disposed on the main circuit board 201, and the BLE module 240, the IMU module 230, and the UWB module 210 can transmit signals to each other through the main circuit board 201. Additionally, as shown in Figure 6 The active pen 200 may further include a battery 203, and the battery 203 can supply electrical energy to the main circuit board 201 and other electrical components in the active pen 200.
[0075] Optionally, in some embodiments, the active pen 200 may further be provided with a switch module, and the switch module may be, for example, Figure 6 the button 202 shown in FIG., or may be a touch input module such as a capacitive film, or may be a voice input recognition module, etc. The switch module can be used to detect the operations of the user on the active pen 200 and control the on / off states of the UWB module 210 and / or the IMU module 230 according to the user operations.
[0076] As an example, when the switch module includes the button 202, if it is detected that the user performs a target operation on the button (such as pressing, long pressing, double clicking, etc.), indicating that the air mouse function needs to be enabled, the UWB module 210 and the IMU module 230 can be controlled to wake up, so that UWB ranging and positioning are performed between the UWB module 210 and the display device, and the IMU module 230 performs pose detection of the active pen 200. When it is detected again that the user performs a target operation on the button, indicating that the air mouse function can be disabled, the UWB module 210 and the IMU module 230 can be controlled to turn off to reduce the power consumption of the active pen 200.
[0077] In other examples, if the switch module includes a capacitive film or a voice input recognition module, specific operation gestures of the user on the capacitive film (such as long pressing, double clicking, sliding, etc.) or the user's voice input content can be detected, so as to turn on or off the air mouse function, and thus turn on or off the UWB module 210 and the IMU module 230.
[0078] In some embodiments, the switch states of the UWB module 210 and / or the IMU module 230 can be controlled through a communication module, such as the BLE module 240. For example, the BLE module 240 can obtain the operations of the user on the switch module of the active pen, so as to control the switches of the UWB module 210 and / or the IMU module 230.
[0079] Through the technical solution of the embodiments of the present application, a switch module, such as a button, etc., is provided on the active pen, and the mouse function can be turned on based on the user's needs for positioning detection of the active pen. In other periods, the UWB module and the IMU module can be in a closed state to reduce the power consumption of the active pen. While improving the use of the mouse function of the active pen to enhance the user experience, the battery life of the active pen can also be improved.
[0080] The present application also provides an interaction system. Figure 7 The figure shows a schematic diagram of an interaction system provided by an embodiment of the present application.
[0081] As Figure 7 shown, the interaction system 300 may include: an active pen 200 and a display device 400. Among them, the active pen 200 may be the active pen 200 provided in any of the above embodiments. The active pen 200 can be used to control the cursor position in the display interface of the display device 400. The display device 400 may include, for example, a computer, a television, a mobile phone, a projector, etc. The embodiments of the present application do not limit its specific type.
[0082] The display device 400 may include a UWB module 410, and the UWB module 410 may include a UWB module and multiple antennas. Optionally, the UWB module 410 may be disposed near the display area of the display device 400. For example, in Figure 7 the illustrated example, the UWB module 410 may be disposed above the display area of the display device 400. When the display device 400 includes a projector, the UWB module 410 may be disposed above the projector screen or other positions around the screen. Optionally, the UWB module 410 may be integrated inside the display device 400, or may be separately disposed from the main body of the display device 400. The UWB module 410 may be fixed at a fixed position on the screen edge and connected to the main body of the display device 400 through an interface such as USB.
[0083] In the display device 400, the UWB module 410 can perform UWB communication with the UWB module including the UWB module 210 and multiple antennas 220 in the active pen 200, so as to achieve precise positioning of the active pen 200.
[0084] In addition, the display device 400 further includes a communication module, such as Figure 7The BLE module 420 shown in [figure], the BLE module 420 can communicate with the BLE module 240 in the active pen 200 to achieve signal transmission between the active pen 200 and the display device 400.
[0085] In the interaction system 700, after the receiving end (display device 400) and the active pen 200 are paired via Bluetooth, the user can enter the mouse mode by operating the buttons on the pen tip (long press / double click, etc.). At this time, both the pen tip and the receiving end activate the UWB module and send UWB radio frequency signals to each other for distance and pointing measurement. A data frame signal for ranging is transmitted between the two UWB channels.
[0086] In the active pen, by default, the UWB module and the IMU module can be in the off state to reduce power consumption. When the BLE module detects a button operation, it activates the UWB module and the IMU module to enter the mouse mode. The IMU sends the acceleration and angular velocity signals of the active pen to the BLE module in real time, and the UWB module sends the measured distance and direction information to the BLE module. The BLE module fuses the data through an algorithm to obtain the pointing information of the active pen relative to the screen end and transmits it to the screen end via Bluetooth. The screen end includes a UWB module and a BLE module. After receiving the pointing information from the pen tip, the screen end converts it into coordinate information and displays the corresponding cursor in real time on the screen.
[0087] Alternatively, when the BLE module detects a button operation to activate the UWB module and the IMU module and enters the mouse mode, the UWB antenna array in the active pen emits a specific pulse signal to the antenna matrix at the screen end. The UWB receiving antenna array at the screen end records the time difference of signal arrival to identify the position of the pen and the pen's placement angle information. After algorithm processing, the absolute position of the pen pointing to the screen end is displayed as a cursor on the screen end. The IMU sends the acceleration and angular velocity signals of the active pen to the BLE module in real time and transmits them to the BLE module at the screen end via the BLE antenna. The screen end controls the cursor movement by identifying the acceleration and angular velocity information of the pen, thereby achieving precise positioning control of the cursor.
[0088] The orientation terms appearing in the above description are the directions shown in the figure, and do not limit the specific structure of the present application. In the description of the present application, it should also be noted that unless otherwise clearly specified and limited, the terms "installation", "connection", and "coupling" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a direct connection, or an indirect connection through an intermediate medium. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to specific circumstances.
[0089] In this application, the term "and / or" is merely a description of the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can represent three situations: the existence of A, the existence of both A and B, and the existence of B.
[0090] Unless otherwise defined, all technical and scientific terms used in this application have the same meaning as those commonly understood by those skilled in the technical field to which this application belongs; the terms used in the description of the application in this application are only for the purpose of describing specific embodiments and are not intended to limit this application; the terms "including" and "having" and any variations thereof in the description and claims of this application and the above drawings are intended to cover non-exclusive inclusion. The terms "first", "second", etc. in the description and claims of this application or the above drawings are used to distinguish different objects and not to describe a specific order or primary-secondary relationship.
[0091] Referring to "embodiment" in this application means that the specific features, structures or characteristics described in connection with the embodiment can be included in at least one embodiment of this application. The appearance of this phrase in various positions in the description does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described in this application can be combined with other embodiments.
[0092] Those of ordinary skill in the art can realize that the units, modules and algorithm steps of each example described in connection with the embodiments disclosed in this article can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professionals can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.
[0093] In several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division, and there can be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection to each other can be through some interfaces, and the indirect coupling or communication connection of the device or unit can be in an electrical, mechanical or other form.
[0094] The unit described as a separation component may or may not be physically separated. The component shown as a unit may or may not be a physical unit, that is, it may be located in one place or distributed across multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0095] In addition, in each embodiment of the present application, each functional unit can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit.
[0096] If the above-mentioned function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes such as USB flash drives, mobile hard disks, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical discs.
[0097] The above is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application, and all should be covered by the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
Claims
1. An active pen, characterized in that: include: UWB module; Multiple antennas are connected to the UWB module, and the multiple antennas are used to exchange UWB signals with the display device. The UWB signals are used to determine the position and direction of the active pen to determine the cursor position corresponding to the active pen in the display interface of the display device.
2. The active pen according to claim 1, characterized in that: The multiple antennas include two antennas, the two antennas are arranged at the ends of the active pen, and the connection direction of the two antennas is perpendicular to the central axis direction of the active pen.
3. The active pen according to claim 2, characterized in that: The two antennas in the active pen interact with the two antennas in the display device through UWB signals; The phase difference of the UWB signal between the two antennas in the active pen and the first antenna in the display device is used to determine a first angle between a line connecting the two antennas in the active pen and the first antenna, and the flight time of the UWB signal between the third antenna in the active pen and the first antenna in the display device is used to determine a first distance between the active pen and the first antenna; The phase difference of the UWB signal between the two antennas in the active pen and the second antenna in the display device is used to determine a second angle between a line connecting the two antennas in the active pen and the second antenna, and the flight time of the UWB signal between the third antenna in the active pen and the second antenna in the display device is used to determine a second distance between the active pen and the second antenna; The first angle, the second angle, the first distance, and the second distance are used to determine the position and orientation of the active pen.
4. The active stylus according to any one of claims 1 to 3, characterized in that: The UWB module and the multiple antennas are used to detect the position and orientation of the active pen at a preset frequency to determine the corresponding cursor movement of the active pen in the display interface of the display device.
5. The active pen according to any one of claims 1 to 3, characterized in that: The active pen further includes: an IMU module, which is used to detect the posture information of the active pen, and the posture information is used to determine the corresponding cursor movement of the active pen in the display interface of the display device and / or correct the position and direction of the active pen.
6. The active pen according to claim 5, characterized in that: The IMU module detects multiple posture information of the active pen at a preset frequency, and the multiple posture information is used to determine the corresponding cursor movement of the active pen in the display interface of the display device.
7. The active pen according to claim 5, characterized in that: The IMU module detects multiple posture information of the active pen at a first preset frequency, and the UWB module and the multiple antennas are used to detect multiple positions and orientations of the active pen at a second preset frequency. The multiple posture information is used to correct the multiple positions and orientations, and the corrected multiple positions and orientations are used to determine the corresponding cursor movement of the active pen in the display interface of the display device.
8. The active pen according to claim 5, characterized in that: The active pen also includes: a communication module, which is used to send the posture information of the active pen to the display device, and the display device determines the position and direction of the active pen according to the UWB signal, and displays a cursor in the display interface according to the posture information and the position and direction of the active pen.
9. The active pen according to claim 5, characterized in that: The active pen also includes: a communication module, which is used to determine the position and orientation of the active pen according to the UWB signal, correct the position and orientation of the active pen according to the posture information of the active pen, and send the corrected position and orientation of the active pen to the display device, so that the display device displays a cursor in the display interface.
10. The active pen according to claim 9, characterized in that: The communication module is also used to receive a switch control signal and control the switch state of the UWB module and / or the IMU module according to the switch control signal.
11. The active pen according to claim 9, characterized in that: The communication module includes a low-power Bluetooth module.
12. The active stylus according to any one of claims 1 to 3, characterized in that: The active pen further includes: a switch module, which is used to detect user operations and control the switch state of the UWB module and / or the IMU module according to the user operations.
13. An interactive system, characterized in that: include: Display devices, and The active pen according to any one of claims 1 to 12, wherein the active pen is used to control a cursor position in a display interface of the display device.
14. The interactive system according to claim 13, characterized in that: The display device includes a UWB module and a plurality of antennas.