A touch device and touch system
This touch device, which calculates the pixel coordinates of touch points using a UWB sensing module and signal processor, solves the problem of needing to modify or integrate existing touch technologies, and achieves plug-and-play precise touch functionality, suitable for a variety of display devices.
Patent Information
- Application Number
- CN202611156842.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-07-31
- Publication Date
- 2026-11-17
AI Technical Summary
Existing touch technologies require professional installation or deep integration with display devices, resulting in long deployment times and high costs, making it difficult to meet the needs of rapid upgrades to touch-enabled devices in scenarios such as commercial displays and educational training.
A touch device is provided that calculates the pixel coordinates of the touch point on the display screen through a UWB sensing module and a signal processor, so as to realize the plug-and-play touch function without modifying the display device. The touch point position is measured by ultra-wideband pulse signal and echo signal and output to the host device through human-machine interface.
It enables display devices without touch functionality to gain plug-and-play precise touch functionality without modification, reducing deployment costs and time, supporting direct finger touch, and is suitable for a variety of display devices.
Smart Images

Figure CN123114295A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of touch technology, and in particular to a touch device and touch system. Background Technology
[0002] With the development of human-computer interaction technology, touch operation has become an important interaction method for display devices. Currently common touch technologies include infrared touch frames, capacitive touchscreens, and electromagnetic touchpads. Infrared touch frames require the installation of infrared emitters and receivers around the display device, placing strict requirements on installation location, resulting in a less streamlined appearance and susceptibility to ambient light interference. Capacitive touchscreens require integrated manufacturing with the display screen, making retrofitting on existing devices impossible, thus preventing the low-cost upgrade of existing ordinary TVs and projection screens to touchscreens. Electromagnetic touch technology requires a dedicated electromagnetic pen and electromagnetic induction board, and cannot support direct finger touch, limiting its application scenarios. It is evident that the above-mentioned existing touch solutions all require professional installation or deep integration with display devices, leading to long deployment times and high costs, making it difficult to meet the needs of commercial displays, educational training, and other scenarios for quickly upgrading ordinary display devices to touch-enabled devices. Summary of the Invention
[0003] This application provides a touch device and a touch system that enables display devices without touch functionality to easily and conveniently acquire touch functionality.
[0004] It enables plug-and-play external touch functionality without requiring modification of the display device.
[0005] In a first aspect, embodiments of this application provide a touch device detachably mounted on a display device to enable the display device to have touch functionality. The touch device includes: a housing with a fixing component for detachably mounting the housing on the display device; a UWB sensing module, including a first UWB sensing sub-module and a second UWB sensing sub-module, disposed inside the housing, for transmitting ultra-wideband pulse signals to the outside of the housing and receiving echo signals formed after the ultra-wideband pulse signals are reflected by a detected target; a signal processor, connected to the first UWB sensing sub-module and the second UWB sensing sub-module respectively, for calculating the pixel coordinates of a touch point on the display screen of the display device based on the first arrival time of the echo signal received by the first UWB sensing sub-module, the second arrival time of the echo signal received by the second UWB sensing sub-module, and the arrival time difference between the first arrival time and the second arrival time; and a human-machine interface, disposed on the outer shell of the housing and connected to the signal processor, for converting the pixel coordinates of the display screen into data for a host device to recognize and outputting it to the host device so that the host device can perform corresponding operations.
[0006] Secondly, embodiments of this application also provide a touch system, the touch system comprising: a display device for displaying images; a host device communicatively connected to the display device for processing data; and the aforementioned touch device, wherein the touch device is deployed on the display device and communicatively connected to the host device, the touch device is used to transmit the pixel coordinates of a touch point to the host device, the host device generates a corresponding touch response command based on the pixel coordinates, and executes the touch operation corresponding to the touch response command and displays feedback on the display device.
[0007] The aforementioned touch device and system transmit ultra-wideband pulse signals and receive echo signals reflected by the detected target through the first and second UWB sensing sub-modules, respectively. The absolute arrival time of the echoes received by the two sub-modules is measured to obtain the absolute distance of the detected target relative to each sub-module. Simultaneously, the time difference between the first and second UWB sensing sub-modules receiving the echoes is measured. Combined with the plane equation and affine transformation matrix of the display plane in the UWB coordinate system, pre-determined by the calibration guidance unit, the unique true position of the touch point on the display plane is calculated and converted into pixel coordinates of the display screen. Finally, the pixel coordinates are output to the host device through a human-machine interface or wireless communication unit. This allows ordinary televisions, projection screens, monitors, and other display devices without touch functionality to achieve plug-and-play, accurate, and reliable touch functionality simply by attaching this touch device externally to the display device, without any internal modifications. Attached Figure Description
[0008] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on the structures shown in these drawings without creative effort.
[0009] Figure 1 This is a schematic diagram of the structure of the touch system provided in an embodiment of this application.
[0010] Figure 2 This is a schematic diagram of the internal hardware structure of the touch device provided in the embodiments of this application.
[0011] Figure 3 This is a schematic diagram of the internal hardware structure of the UWB sensing sub-module provided in an embodiment of this application.
[0012] Figure 4 This is a schematic diagram of the position calibration module provided in an embodiment of this application.
[0013] Figure 5 This is a schematic diagram of the display screen calibration markers provided in an embodiment of this application.
[0014] Figure 6 This is a schematic diagram of the structure of the touch positioning module provided in an embodiment of this application.
[0015] Figure 7 This is a schematic diagram of the structure of the multi-touch module provided in the embodiments of this application.
[0016] Figure 8 This is a schematic diagram of a multi-module deployment of a large-size display device provided in an embodiment of this application.
[0017] Explanation of the labels in the diagram: 100 - Touch device; 100a - First touch device; 100b - Second touch device; 10 - Housing; 20 - UWB sensing module; 20a - First UWB sensing sub-module; 20b - Second UWB sensing sub-module; 21 - UWB RF chip; 22 - Directional antenna; 22a - First directional antenna; 22b - Second directional antenna; 23 - Low-noise amplifier; 24 - Power amplifier; 25 - Clock circuit; 30 - Signal processor; 40 - Human-machine interface; 41 - Communication unit; 42 - Power supply unit; P1, P2, P3, P4 - Calibration markers; 200 - Display device; 201 - Display screen; 300 - Host device; 400 - Position calibration module; 401 - Calibration point display unit; 402 - Calibration point acquisition unit; 403 - Plane fitting unit; 404 - Matrix calculation unit; 500 - Touch positioning module; 501 - Time acquisition unit; 502 - Distance calculation unit; 503 - Time difference calculation unit; 504 - Intersection calculation unit; 505 - Position determination unit; 506 - Coordinate mapping unit; 600 - Multi-touch module; 601 - Echo decomposition unit; 602 - Coordinate calculation unit; 603 - Identity tracking unit; 1000 - Touch system.
[0018] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation
[0019] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application. All other embodiments obtained by those skilled in the art based on the embodiments in this application without inventive effort are within the scope of protection of this application.
[0020] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar planned objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data are interchangeable where appropriate; in other words, the described embodiments are implemented according to a sequence other than that illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, may also include other content; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0021] It should be noted that the use of terms such as "first" and "second" in this application is for descriptive purposes only and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. Furthermore, the technical solutions of the various embodiments can be combined with each other, but this must be based on the ability of a person skilled in the art to implement them. If the combination of technical solutions is contradictory or impossible to implement, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection claimed in this application.
[0022] Please refer to the following: Figure 1 and Figure 2 This is a schematic diagram of the structure of the touch device 100 provided in this application embodiment. The touch device 100 includes a housing 10, a UWB sensing module 20, a signal processor 30, and a human-machine interface 40. The housing 10 serves as the mounting carrier, with the UWB sensing module 20 and signal processor 30 disposed inside the housing 10, and the human-machine interface 40 disposed on the outer shell of the housing 10. The UWB sensing module 20 is connected to the signal processor 30 and is used to transmit ultra-wideband pulse signals and receive echo signals, transmitting the received echo signals to the signal processor 30. The signal processor 30 calculates the pixel coordinates of the touch point on the display screen 201 based on the echo signals. The human-machine interface 40 is connected to the signal processor 30 and is used to convert the pixel coordinates of the display screen 201 into data that can be recognized by the host device 300, and output it to the host device 300 so that the host device 300 can perform corresponding operations.
[0023] The housing 10 is used to house and protect the electrical components of the touch device 100. A fixing component is provided on the housing 10 for detachably mounting the housing 10 to the frame or back of the display device 200. Optionally, the fixing component can be any one or more combinations of a clamping structure, magnetic structure, adhesive structure, or snap-on structure, so that the user can install the touch device 100 on different models or sizes of display devices 200, or remove it from the display device 200, according to usage needs. In this embodiment, the housing 10 is cuboid in shape, with dimensions not exceeding 80mm × 40mm × 15mm, and is made of ABS plastic or aluminum alloy. It is understood that the shape of the housing 10 can be flexibly adjusted according to the actual application scenario, including but not limited to square, circular, elliptical, or other regular or irregular shapes; this application does not specifically limit this.
[0024] The UWB sensing module 20 is disposed inside the housing 10 and is used to transmit ultra-wideband pulse signals to the outside of the housing 10 and receive the echo signals formed by the reflection of the ultra-wideband pulse signals by the detected target. The UWB sensing module 20 includes a first UWB sensing sub-module 20a and a second UWB sensing sub-module 20b, which are spaced apart inside the housing 10. In this embodiment, the first UWB sensing sub-module 20a and the second UWB sensing sub-module 20b are symmetrically arranged on the left and right sides inside the housing 10 to form a certain spatial baseline, thereby improving positioning accuracy.
[0025] Please refer to Figure 3 The first UWB sensing sub-module 20a and the second UWB sensing sub-module 20b are both independent transceiver modules. Each of the first UWB sensing sub-module 20a and the second UWB sensing sub-module 20b includes a UWB radio frequency chip 21, a directional antenna 22, a low-noise amplifier 23, a power amplifier 24, and a clock circuit 25.
[0026] The UWB RF chip 21 is used to generate ultra-wideband pulse signals and receive echo signals formed after reflection from the detected target. In this embodiment, the UWB RF chip 21 operates in the frequency band of 6.0 GHz to 8.5 GHz, which covers the commonly used frequency band of UWB technology and can provide sufficiently high range resolution while ensuring signal penetration capability. The UWB RF chip 21 integrates a pulse generator and a receiving front end, supporting bidirectional ranging and time-of-arrival measurement functions.
[0027] The directional antenna 22 is connected to the UWB RF chip 21 and is used to directionally radiate the ultra-wideband pulse signal generated by the UWB RF chip 21 to the outside of the housing 10 in the form of electromagnetic waves, and to receive the echo signal reflected back after being detected by the target. In this embodiment, the beamwidth of the directional antenna 22 is 30° to 90°. The smaller the beamwidth, the stronger the directivity of the directional antenna 22 and the higher the spatial resolution, but the coverage area is correspondingly reduced; the larger the beamwidth, the wider the coverage area, but the weaker the directivity. Setting the beamwidth to 30° to 90° can achieve a reasonable balance between spatial resolution and coverage area, which can accurately sense the position of the touch point while covering the effective touch area of the display screen 201.
[0028] Furthermore, a first directional antenna 22a is provided in the first UWB sensing sub-module 20a, and a second directional antenna 22b is provided in the second UWB sensing sub-module 20b. The angle between the first directional antenna 22a and the second directional antenna 22b is 60° to 180°. When the angle is 60°, the beam intersection area of the first directional antenna 22a and the second directional antenna 22b is relatively large, which is beneficial for achieving a wider coverage range at close range. When the angle is 180°, the beams of the first directional antenna 22a and the second directional antenna 22b are emitted almost back-to-back, which is suitable for scenarios requiring a large lateral coverage area. By arranging the two directional antennas 22 according to the above-mentioned angle range, the line-of-sight directions of the two directional antennas 22 can form a certain spatial angle, thereby forming an intersection coverage area above the touch area, providing a geometric basis for the subsequent dual-resolution cancellation positioning algorithm based on the time difference of arrival.
[0029] A low-noise amplifier 23 is connected between the directional antenna 22 and the receiving end of the UWB RF chip 21. It amplifies the weak echo signal received by the directional antenna 22 with low noise during reception, thereby improving receiving sensitivity and signal-to-noise ratio. Since the echo signal strength is significantly attenuated after reflection from the detected target, the low-noise amplifier 23 can effectively increase the amplitude of the weak signal while introducing as little noise as possible, ensuring that the subsequent signal processor 30 can accurately extract the arrival time of the echo signal.
[0030] Power amplifier 24 is connected between the transmitter of UWB RF chip 21 and directional antenna 22. During transmission, it amplifies the ultra-wideband pulse signal generated by UWB RF chip 21, enhancing the radiated power to ensure sufficient echo signal strength for the receiver to detect even after the ultra-wideband pulse signal is radiated into space and reflected by the target. Through the amplification effect of power amplifier 24, touch device 100 can operate stably at a larger touch distance and within a wider touch range.
[0031] Clock circuit 25 is connected to UWB RF chip 21 and provides a high-precision timing reference to UWB RF chip 21 to determine the arrival time of the echo signal. In this embodiment, the clock accuracy of clock circuit 25 is better than ±10ppm, which can effectively support the accurate measurement of the first and second arrival times and the calculation of the arrival time difference, thereby ensuring the accuracy of the touch point coordinate calculation. Clock circuit 25 can be implemented using temperature-compensated crystal oscillators or voltage-controlled crystal oscillators to maintain a stable frequency output under different temperature conditions.
[0032] A signal processor 30 is disposed inside the housing 10 and is connected to the first UWB sensing sub-module 20a and the second UWB sensing sub-module 20b, respectively. The signal processor 30 receives the echo signals output from the first UWB sensing sub-module 20a and the second UWB sensing sub-module 20b, and calculates the pixel coordinates of the touch point on the display screen 201 of the display device 200 based on the first arrival time of the echo signals received by the first UWB sensing sub-module 20a, the second arrival time of the echo signals received by the second UWB sensing sub-module 20b, and the time difference between the first and second arrival times. The signal processor 30 can be implemented using a digital signal processor, a field-programmable gate array, a microcontroller unit, or an application-specific integrated circuit; this application does not specifically limit its implementation.
[0033] The human-machine interface 40, disposed on the outer shell of the housing 10 and connected to the signal processor 30, is used to convert the pixel coordinates of the display screen 201 into data that can be recognized by the host device 300 and output it to the host device 300 so that the host device 300 can perform corresponding operations. Specifically, the human-machine interface 40 encapsulates the touch point pixel coordinates output by the signal processor 30 into a standard mouse report format. This report format includes displacement increment data and button status data, so that the host device 300 can recognize the touch device 100 as a standard mouse or touchpad device and work normally without the need to install additional dedicated drivers.
[0034] The human-machine interface 40 includes a communication unit 41 and a power supply unit 42. The power supply unit 42 is connected to the UWB sensing module 20 and the signal processor 30, providing power to both. The communication unit 41 is connected to the signal processor 30 and is used to output the pixel coordinates calculated by the signal processor 30 to the host device 300, so that the host device 300 can perform corresponding operations.
[0035] The communication unit 41 supports both wired and wireless communication methods and is used for data transmission with the host device 300. In this embodiment, the communication unit 41 is preferably a USB interface or a Bluetooth module, used to transmit the pixel coordinates calculated by the signal processor 30 to the host device 300, so that the host device 300 can perform corresponding touch operations based on the pixel coordinates.
[0036] The power supply unit 42 is disposed inside the housing 10 and is used to provide operating power to the various power modules in the touch device 100. Each power module includes a UWB sensing module 20, a signal processor 30, a human-machine interface 40, and a communication unit 41. The power supply unit 42 can be powered by a battery or by an external power source. Battery power supply includes dry cell batteries, button batteries, or rechargeable lithium batteries. External power supply includes drawing power from the host device 300 via a power interface. In this embodiment, the power supply unit 42 is preferably a rechargeable lithium battery, which is charged via the power interface to ensure the portability and continuous operation of the touch device 100.
[0037] The power interface can reuse the USB interface of the communication unit 41, obtaining 5V / 500mA DC power from the USB port of the host device 300. That is, the USB interface simultaneously undertakes data transmission functions, realizing the multiplexing of power supply and communication. The power output from the power interface is converted into two DC power supplies, 3.3V and 1.8V, by an LDO regulator, providing stable operating voltages for the UWB sensing module 20, signal processor 30, and human-machine interface 40. In this embodiment, the operating power consumption of the power interface is less than 1W, and the standby power consumption is less than 50mW. When no touch operation continues for more than a set time, such as more than 5 seconds, the signal processor 30 controls the UWB sensing module 20 to enter a low duty cycle working mode or a sleep state, thereby reducing the overall power consumption to the standby power consumption level. Through the above power consumption control method, the touch device 100 can achieve energy saving while meeting the power supply limitations of the power interface, extending the single-use time of the rechargeable lithium battery.
[0038] The human-computer interface 40 also supports touch press detection, which can identify the pressed and released states of a user's finger and embed the corresponding button information into the mouse report. When the touch object is detected to be in contact with the surface of the display screen 201, the human-computer interface 40 determines it to be in a pressed state and generates a button press report; when the touch object is detected to be leaving the surface of the display screen 201, it determines it to be in a released state and generates a button release report. In this way, users can replace the traditional mouse click operation with touch operation on the display screen 201. For two-point touch operation, the human-computer interface 40 maps the coordinate information and motion trajectory of the two touch points into two-finger gesture commands, including but not limited to two-finger zoom commands and two-finger rotation commands, to support users to zoom and rotate the content of the host device 300 through two-finger operation.
[0039] Furthermore, the touch device 100 also includes multiple status indicator lights disposed on the outer casing of the housing 10. The status indicator lights use multi-color LEDs to indicate the operating status of the touch device 100. In this embodiment, green indicates normal operation, orange indicates calibration in progress, and red indicates an abnormality. Users can quickly determine the current status by observing the indicator light colors. It is understood that in other embodiments, the status indicator lights can also be implemented using dual-color LEDs or full-color LEDs, and the correspondence between the indicator light colors and the operating status can be flexibly configured according to actual needs. For example, blue can be used to indicate normal operation, yellow to indicate calibration in progress, and purple to indicate an abnormality, as long as different colors can distinguish the different operating states of the touch device 100. This application does not impose specific limitations on this.
[0040] Furthermore, the touch device 100 also includes multiple configuration buttons disposed on the outer casing of the housing 10. In this embodiment, a short press of the configuration button enables the touch device 100 to enter calibration mode to perform calibration operations on the position information of the display screen 201; a long press of the configuration button, for example, pressing continuously for more than 3 seconds, resets all configuration parameters of the touch device 100 and restores factory settings, clearing user-defined calibration data and configuration information; a double-click of the configuration button switches between wired output mode and wireless output mode to adapt to different host device 300 connection requirements. It is understood that in other embodiments, the configuration buttons can also be implemented using touch buttons or toggle switches, and the correspondence between the button operation mode and function can be flexibly configured according to actual needs, such as single-click to enter calibration, double-click to restore factory settings, long-press to switch modes, etc., as long as the corresponding control function can be triggered through different operation methods, this application does not make specific limitations in this regard.
[0041] Furthermore, the touch device 100 also includes a firmware update interface, which is disposed on the outer shell of the housing 10. In this embodiment, the firmware update interface reuses the charging interface, eliminating the need for the user to create an additional dedicated interface on the housing 10, thus maintaining the structural simplicity and sealing of the housing 10. The user connects the touch device 100 to the host device 300 via a USB cable and can use a dedicated tool to upgrade the firmware program inside the touch device 100 online to obtain functional optimization, performance improvement, or defect repair. It is understood that in other embodiments, the firmware update interface may also be implemented using a dedicated burning interface, JTAG interface, or SWD interface, or even online firmware upgrades may be performed via wireless communication. This application does not specifically limit this, as long as the writing and updating of firmware data can be achieved.
[0042] Please refer to the following: Figure 4 and Figure 5The signal processor 30 also includes a position calibration module 400 for calibrating the position information of the display screen 201. The position calibration module 400 determines the spatial position of the display screen 201 in the UWB coordinate system, that is, establishes the mapping relationship between the UWB coordinate system and the screen pixel coordinate system. Since the installation position, angle, and size of the matching display device 200 of the touch device 100 may vary each time, a calibration process must be performed upon first use to eliminate the influence of installation deviations on positioning accuracy. The position calibration module 400 includes a calibration point display unit 401, a calibration point acquisition unit 402, a plane fitting unit 403, and a matrix calculation unit 404.
[0043] The calibration point display unit 401 is used to sequentially display four calibration marks on the display screen 201, allowing the user to touch the position of each calibration mark in the display screen 201 according to the display order. The four calibration marks are located in the four corner areas of the display screen 201, such as the upper left, upper right, lower left, and lower right corners, and the four calibration marks are not collinear. Preferably, the four calibration marks form a rectangle or quadrilateral to ensure the accuracy and stability of subsequent plane fitting. In this embodiment, the calibration marks can be presented in the form of a crosshair, a circular bullseye, or a highlighted square to guide the user to accurately touch the center position of the mark. The display order of the four calibration marks can be from the upper left to the upper right to the lower left to the lower right, or vice versa. This application does not specifically limit this, as long as the four calibration marks can be touched by the user in sequence.
[0044] The calibration point acquisition unit 402 is used to acquire the echo signals received by the first UWB sensing sub-module 20a and the second UWB sensing sub-module 20b corresponding to each calibration mark point when the user touches each calibration mark point in sequence, and to determine the three-dimensional coordinates of each calibration mark point in the UWB coordinate system based on each echo signal. Specifically, when the user touches a calibration mark point, the first UWB sensing sub-module 20a and the second UWB sensing sub-module 20b respectively emit ultra-wideband pulse signals and receive the echo signals formed after being reflected by the user's finger. The calibration point acquisition unit 402 acquires the first arrival time of the echo signal received by the first UWB sensing sub-module 20a and the second arrival time of the echo signal received by the second UWB sensing sub-module 20b. Based on the first arrival time and the second arrival time, the distances from the first UWB sensing sub-module 20a and the second UWB sensing sub-module 20b to the calibration mark point are calculated respectively. Then, combined with the known positions of the first UWB sensing sub-module 20a and the second UWB sensing sub-module 20b within the housing 10, the three-dimensional coordinates of the calibration mark point in the UWB coordinate system are determined using triangulation. Repeating the above process, the calibration point acquisition unit 402 sequentially determines the three-dimensional coordinates of each of the four calibration mark points in the UWB coordinate system, denoted as P1. P2 P3 P4 .
[0045] The plane fitting unit 403 is used to fit the plane equation of the screen plane in the UWB coordinate system based on the three-dimensional coordinates of the four calibration marker points. Since the four calibration marker points are all located on the screen plane of the display screen 201, the three-dimensional coordinates of these four points in the UWB coordinate system together define a spatial plane. The plane fitting unit 403 performs plane fitting on the four three-dimensional coordinates using the least squares method or singular value decomposition method to obtain the plane equation of the screen plane in the UWB coordinate system, namely Ax + By + Cz + D = 0, where A, B, C, and D are the parameters of the plane equation. Through this plane equation, any spatial point in the UWB coordinate system can be mapped to the corresponding position on the screen plane through projection operations.
[0046] The matrix calculation unit 404 is used to calculate the affine transformation matrix between the UWB coordinate system and the screen pixel coordinate system based on the plane equation, in order to calibrate the position information of the display screen 201. The position information of the display screen 201 includes the plane equation and the affine transformation matrix. Specifically, the preset pixel coordinates of the four calibration markers on the display screen 201 are known values. For example, the pixel coordinates of the upper left calibration marker are (0,0), the upper right calibration marker are (W,0), the lower right calibration marker are (W,H), and the lower left calibration marker are (0,H), where W is the total number of pixels in the width direction of the display screen 201, and H is the total number of pixels in the height direction of the display screen 201. The matrix calculation unit 404 uses the correspondence between the three-dimensional coordinates and pixel coordinates of any three or four of the four calibration markers to obtain the affine transformation matrix from the UWB coordinate system to the screen pixel coordinate system by solving an overdetermined system of equations. The affine transformation matrix includes rotation components, translation components, and scaling components. The rotation component is used to correct angular deviations caused during the installation of the touch device 100, the translation component is used to correct positional offsets between the touch device 100 and the display screen 201, and the scaling component is used to achieve a proportional conversion between spatial distance in the UWB coordinate system and screen pixel distance. Through this affine transformation matrix, any three-dimensional coordinate in the UWB coordinate system can be converted into two-dimensional pixel coordinates in the screen pixel coordinate system, thereby achieving a precise mapping from the physical touch point to the pixel position on the display screen 201. Finally, the fitted plane equation and affine transformation matrix are stored in non-volatile memory. Each subsequent touch operation, the signal processor 30 directly calls these parameters to map the real-time measured UWB coordinates to screen pixel coordinates, achieving precise touch control. If the touch device 100 is moved or the display device 200 is replaced, the user can rerun the calibration program to overwrite the original parameters, ensuring positioning accuracy.
[0047] Please refer to Figure 6 This is a schematic diagram of the structure of the touch positioning module 500 provided in the embodiments of this application. The signal processor 30 also includes the touch positioning module 500, which is used to determine the pixel coordinates of the touch point on the display screen 201. The touch positioning module 500 includes a time acquisition unit 501, a distance calculation unit 502, a time difference calculation unit 503, an intersection calculation unit 504, a position determination unit 505, and a coordinate mapping unit 506.
[0048] The time acquisition unit 501 is used to acquire the first arrival time and the second arrival time, respectively. Specifically, when the user touches the display screen 201, the first UWB sensing sub-module 20a and the second UWB sensing sub-module 20b of the UWB sensing module 20 respectively receive the echo signal formed after being reflected by the user's finger. The time acquisition unit 501 extracts the first arrival time from the echo signal received by the first UWB sensing sub-module 20a. The second arrival time is extracted from the echo signal received by the second UWB sensing sub-module 20b. First arrival time The second arrival time represents the round-trip time required for an ultra-wideband pulse signal to be transmitted from the first UWB sensing sub-module 20a, reflected by the user's finger, and return to the first UWB sensing sub-module 20a. This represents the round-trip time required for an ultra-wideband pulse signal to be emitted from the second UWB sensing sub-module 20b, reflected by the user's finger, and returned to the second UWB sensing sub-module 20b.
[0049] The distance calculation unit 502 is used to calculate the first distance from the first UWB sensing sub-module 20a to the touch point based on the first arrival time, and to calculate the second distance from the second UWB sensing sub-module 20b to the touch point based on the second arrival time. Specifically, since the propagation speed c (speed of light) of the ultra-wideband pulse signal is a known constant, multiplying each arrival time by the speed of light yields the absolute distance from the detected target to each UWB sensing sub-module, i.e.: in, The first distance from the touch point to the first UWB sensing sub-module 20a20a The second distance is from the touch point to the second UWB sensing sub-module 20b20b.
[0050] The time difference calculation unit 503 is used to calculate the difference between the first arrival time and the second arrival time to obtain the arrival time difference. Specifically, the arrival time difference is obtained by subtracting the second arrival time from the first arrival time. The sign of the arrival time difference reflects the positional bias of the touch point relative to the first UWB sensing sub-module 20a and the second UWB sensing sub-module 20b. That is, when the arrival time difference is positive, it means that the touch point is closer to the first UWB sensing sub-module 20a; when the arrival time difference is negative, it means that the touch point is closer to the second UWB sensing sub-module 20b.
[0051] The intersection calculation unit 504 is used to determine two candidate two-dimensional coordinates of the touch point on the plane of the display screen 201 based on the first distance, the second distance, and the plane equation. Specifically, a first sphere is constructed with the position of the first UWB sensing sub-module 20a as the center and the first distance as the radius, and a second sphere is constructed with the position of the second UWB sensing sub-module 20b as the center and the second distance as the radius. The intersection line of the first sphere and the second sphere is a spatial circle, which intersects the screen plane calibrated by the position calibration module 400, generating two intersection points, namely the two candidate two-dimensional coordinates of the touch point on the plane of the display screen 201. The two candidate two-dimensional coordinates are symmetrical about the perpendicular bisectors of the first UWB sensing sub-module 20a and the second UWB sensing sub-module 20b, and one of them is the actual touch point position. The other is a false location. .
[0052] The position determination unit 505 selects one of two candidate two-dimensional coordinates as the true two-dimensional coordinate of the touch point based on the sign of the arrival time difference. Since the two candidate two-dimensional coordinates are located on opposite sides of the perpendicular bisector of the first UWB sensing sub-module 20a and the second UWB sensing sub-module 20b, respectively, and the sign of the arrival time difference indicates which side the touch point is biased towards, the position determination unit 505 can determine which side of the perpendicular bisector the true touch point is located on based on the sign of the arrival time difference, thereby eliminating false positions from the two candidate two-dimensional coordinates. Preserve true two-dimensional coordinates .
[0053] The coordinate mapping unit 506 is used to map the real two-dimensional position to pixel coordinates of the display screen 201 according to the affine transformation matrix. Specifically, it maps the real two-dimensional coordinates determined by the position determination unit 505 to the pixel coordinates of the display screen 201. Matrix multiplication is performed on the affine transformation matrix M calculated by matrix calculation unit 404 to map the real two-dimensional coordinates from the UWB coordinate system to the screen pixel coordinate system, thus obtaining the pixel coordinates of the touch point on the display screen 201. The pixel coordinates are output to the host device 300 via the communication unit 41, so that the host device 300 can perform the corresponding touch response operation.
[0054] Please refer to Figure 7 This is a schematic diagram of the touch positioning module 500 provided in this embodiment. The signal processor 30 also includes a multi-touch module 600, used to identify and locate each touch point when multiple touch points exist in the touch interaction area. The multi-touch module 600 includes an echo decomposition unit 601, a coordinate calculation unit 602, and an identity tracking unit 603.
[0055] The echo decomposition unit 601 performs time-domain peak detection on the echo signals received by the first UWB sensing sub-module 20a and the second UWB sensing sub-module 20b. Based on the difference between the first arrival time and / or the second arrival time, it separates the echo components corresponding to each touch point from the mixed echo signal. Specifically, when a user simultaneously performs touch operations on the display screen 201 using multiple fingers, the echo signals received by the first UWB sensing sub-module 20a and the second UWB sensing sub-module 20b are mixed signals of echoes reflected from multiple touch points. The echo decomposition unit 601 performs time-domain peak detection on this mixed signal, identifying each peak moment where the signal amplitude exceeds a preset threshold. Each peak moment corresponds to the arrival time of the echo signal reflected by a touch point. Because the distances between different touch points and the UWB sensing sub-modules are different, each echo component exhibits a different arrival time in the time domain. Based on this, the echo decomposition unit 601 separates the echo components corresponding to each touch point from the mixed signal. For example, when a user touches the device with two fingers, the echo decomposition unit 601 identifies two peak moments from the mixed signal, corresponding to the echo components of the first touch point and the second touch point, respectively. In this embodiment, the echo decomposition unit 601 uses a peak detection algorithm to perform a sliding window search on the received signal. When the signal amplitude within the window exceeds a preset threshold and is a local maximum, the position is determined to be the arrival moment of an echo component. It is understood that in other embodiments, the echo decomposition unit 601 may also use a matched filtering algorithm, a deconvolution algorithm, or a machine learning-based signal separation algorithm to separate multiple echo components; this application does not specifically limit this.
[0056] The coordinate calculation unit 602 is used to calculate the pixel coordinates of each touch point based on the first arrival time, the second arrival time, and the arrival time difference corresponding to each echo component. Specifically, for each echo component, the coordinate calculation unit 602 calculates the corresponding touch point pixel coordinates in the same way as single-point touch positioning. That is, the coordinate calculation unit 602 obtains the first arrival time of the echo component on the first UWB sensing sub-module 20a and the second arrival time on the second UWB sensing sub-module 20b, calculates the first distance, the second distance, and the arrival time difference, and then determines the true two-dimensional coordinates of the touch point according to the same principle as the intersection calculation unit 504 and the position determination unit 505. Finally, the coordinate mapping unit 506 maps the true two-dimensional coordinates to pixel coordinates. The coordinate calculation unit 602 traverses each echo component and calculates the pixel coordinates of each touch point one by one.
[0057] The identity tracking unit 603 assigns a different identity identifier to each touch point and matches the pixel coordinates of each touch point calculated in the current frame with the pixel coordinates of the touch points with corresponding identity identifiers in the previous frame. Specifically, since each touch point may move during multi-touch, it is necessary to continuously track the movement trajectory of each touch point to accurately respond to the user's multi-finger gestures. The identity tracking unit 603 assigns a unique identity identifier to the first detected touch point, such as ID1, ID2, ID3, etc., with different identity identifiers corresponding to different touch points. For consecutive frames, the identity tracking unit 603 matches the pixel coordinates of each touch point calculated in the current frame with the pixel coordinates of the touch points with corresponding identity identifiers in the previous frame to determine which touch point in the previous frame each touch point in the current frame corresponds to. In this embodiment, the identity tracking unit 603 uses a nearest neighbor matching algorithm for matching. Specifically, the identity tracking unit 603 calculates the Euclidean distance between the pixel coordinates of each touch point in the current frame and the pixel coordinates of each touch point in the previous frame, matches the touch points in the current frame with the nearest touch point in the previous frame as the same touch point, and keeps their identity identifier unchanged. When a touch point existed in the previous frame but disappears in the current frame, the identity tracking unit 603 marks the touch point as having left the touch area and releases its identity identifier. When a touch point appears for the first time in the current frame but did not exist in the previous frame, the identity tracking unit 603 assigns a new identity identifier to the touch point. It is understood that in other embodiments, the identity tracking unit 603 may also use a Kalman filter tracking algorithm or a prediction-based tracking algorithm to achieve cross-frame matching of touch points, and this application does not specifically limit this.
[0058] Please refer to it again. Figure 1 This is the touch system 1000 provided in this application embodiment. The touch system 1000 includes a display device 200, a host device 300, and a touch device 100. The touch device 100 is deployed on the display device 200 and is communicatively connected to the host device 300. The touch device 100 is used to transmit the pixel coordinates of the touch point to the host device 300. The host device 300 generates a corresponding touch response command based on the pixel coordinates and executes the touch operation corresponding to the touch response command and displays feedback on the display device 200.
[0059] The display device 200 is used to display images. The display device 200 can be a liquid crystal display, a light-emitting diode display, an organic light-emitting diode display, a miniature light-emitting diode display, or a projection display device 200, etc. This application does not limit the specific type of the display device 200. The display device 200 has a display screen 201 for displaying images, and the display screen 201 has a preset total number of pixels in width and a preset total number of pixels in height.
[0060] The host device 300 is communicatively connected to the display device 200 for data processing. The host device 300 can be a personal computer, laptop computer, tablet computer, smartphone, industrial control host, or embedded system, etc. This application does not limit the specific type of the host device 300. The host device 300 connects to the display device 200 via a communication interface and outputs image signals to the display device 200, causing the display device 200 to display corresponding image content.
[0061] Furthermore, the display device 200 and the host device 300 can be independent devices or integrated into one unit. In this embodiment, the display device 200 and the host device 300 are independent devices. The display device 200 is an independent monitor or television, such as a liquid crystal display, a light-emitting diode display, or a projection screen, which does not have data processing capabilities or only has limited image display processing capabilities. The host device 300 is an independent personal computer host, laptop, set-top box, game console, or industrial control host. The display device 200 and the host device 300 communicate with each other through video transmission interfaces such as high-definition multimedia interfaces, display port interfaces, video graphics array interfaces, or digital video interfaces. The host device 300 transmits the image signal to be displayed to the display device 200, which then displays the image. In another embodiment, the display device 200 and the host device 300 are integrated into one unit. The display device 200 and the host device 300 are integrated into an all-in-one computer, a touch screen all-in-one computer, or a smart interactive flat panel. The host device 300 is built into the housing of the display device 200, and the two communicate with each other through an internal bus or an inter-board connector. In the all-in-one structure, the display device 200 and the host device 300 share the same housing, and the image signals from the host device 300 are directly output to the display device 200 for display via internal wiring. It is understood that regardless of whether the display device 200 and the host device 300 are independent devices or integrated into one unit, the touch device 100 is detachably deployed on the display device 200 without requiring any modification to the original hardware of the display device 200 or the host device 300; it is plug-and-play and has broad compatibility and versatility.
[0062] Please refer to Figure 8 This is a schematic diagram of the multi-module deployment of a large-size display device 200 provided in the embodiments of this application. When the size of the display device 200 is greater than or equal to a preset size, at least two touch devices 100 are deployed on the display device 200. Each touch device 100 coordinates its work through a time synchronization protocol and covers different touch areas respectively.
[0063] In this embodiment, for large display devices 200 with a size greater than or equal to a preset size, such as large conference whiteboards or educational display screens 201, the UWB beam coverage of a single touch device 100 may not be able to completely cover the entire screen. In this embodiment, the preset size is 55 inches. When the screen size of the display device 200 is greater than or equal to 55 inches, one touch device 100 is deployed on each of the left and right sides of the top bezel of the display device 200, respectively denoted as the first touch device 100a and the second touch device 100b. Each touch device 100 is responsible for touch positioning in its lower half area. The first touch device 100a covers the left half of the screen, and the second touch device 100b covers the right half of the screen. The two beam coverage areas overlap to a certain extent in the center of the screen to ensure touch continuity in the central area of the screen.
[0064] To avoid mutual interference between the ultra-wideband pulse signals of the two touch devices 100, the first touch device 100a and the second touch device 100b coordinate their operation through a time synchronization protocol. Specifically, each touch device 100 alternately transmits and receives ultra-wideband pulse signals in a time-division manner, ensuring that only one touch device 100 is in working state at any given time, thereby effectively avoiding signal conflicts and crosstalk.
[0065] The host device 300 is connected to both the first touch device 100a and the second touch device 100b. The host device 300 can connect to multiple touch devices 100 via a USB hub, or it can connect to each touch device 100 individually using one of its multiple USB ports. The driver running on the host device 300 receives touch coordinates reported by the two touch devices 100 and performs coordinate stitching and fusion based on the coverage area of each touch device 100, mapping the touch points in the left and right halves of the screen to a complete screen coordinate system. When a user's finger touches the overlapping area in the center of the screen, the driver selects the touch device 100 data with higher reliability based on signal strength or historical trajectory, or performs a weighted average of the data from the two touch devices 100, to ensure smooth continuous touch across different areas.
[0066] In the above embodiments, by attaching the touch device externally to the display device, no internal modifications or structural damage to the original display device are required. The installation and calibration process can be completed in just a few minutes, achieving plug-and-play functionality. This touch system supports both wired and wireless connection methods, flexibly adapting to different usage environments. For large screens, multiple touch devices can be deployed, combined with time synchronization and coordinate fusion technologies, to achieve full-screen touch control.
[0067] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.
[0068] It should be understood that although the steps in the flowcharts of the accompanying figures are shown sequentially as indicated by the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the accompanying figures may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the sub-steps or stages of other steps.
[0069] The above-listed embodiments are merely preferred embodiments of this application and should not be construed as limiting the scope of this application. Therefore, any equivalent variations made in accordance with the claims of this application shall still fall within the scope of this application.
Claims
1. A touch device, detachably mounted on a display device to enable the display device to have touch functionality, characterized in that, The touch device includes: The housing is provided with a fixing component for detachably mounting the housing to the display device; The UWB sensing module includes a first UWB sensing sub-module and a second UWB sensing sub-module, which are disposed inside the housing and are used to transmit ultra-wideband pulse signals to the outside of the housing and receive the echo signals formed by the ultra-wideband pulse signals after being reflected by the detected target. The signal processor is connected to the first UWB sensing sub-module and the second UWB sensing sub-module respectively. Based on the first arrival time of the echo signal received by the first UWB sensing sub-module, the second arrival time of the echo signal received by the second UWB sensing sub-module, and the arrival time difference between the first arrival time and the second arrival time, the pixel coordinates of the touch point on the display screen of the display device are calculated. A human-computer interaction interface is disposed on the outer shell of the housing and connected to the signal processor. It is used to convert the pixel coordinates of the display screen into data that can be recognized by the host device and output it to the host device so that the host device can perform corresponding operations.
2. The touch device as described in claim 1, characterized in that, Each of the first UWB sensing sub-module and the second UWB sensing sub-module includes: UWB radio frequency chip, used to generate the ultra-wideband pulse signal; A directional antenna, connected to the UWB radio frequency chip, is used to transmit the ultra-wideband pulse signal and receive the echo signal; A clock circuit, connected to the UWB RF chip, is used to provide a timing reference to the UWB RF chip to determine the arrival time of the received echo signal.
3. The touch device as described in claim 2, characterized in that, The first UWB sensing sub-module includes a first directional antenna, and the second UWB sensing sub-module includes a second directional antenna. The angle between the first directional antenna and the second directional antenna is 60° to 180°.
4. The touch device as described in claim 1, characterized in that, The signal processor further includes a position calibration module for calibrating the position information of the display screen, wherein the position calibration module includes: A calibration point display unit is used to sequentially display four calibration marks on the display screen, so that the user can sequentially touch the position of each calibration mark on the display screen; The calibration point acquisition unit is used to acquire the echo signals received by the first UWB sensing sub-module and the second UWB sensing sub-module corresponding to each calibration point when the user touches each calibration point in sequence, and to determine the three-dimensional coordinates of each calibration point in the UWB coordinate system based on each echo signal. A plane fitting unit is used to fit the plane equation of the screen plane in the UWB coordinate system based on the four three-dimensional coordinates. The matrix calculation unit is used to calculate the affine transformation matrix between the UWB coordinate system and the screen pixel coordinate system according to the plane equation, so as to calibrate the position information of the display screen, wherein the position information of the display screen includes the plane equation and the affine transformation matrix.
5. The touch device as described in claim 4, characterized in that, The signal processor further includes a touch positioning module for determining the pixel coordinates of the touch point on the display screen, wherein the touch positioning module includes: A time acquisition unit is used to acquire the first arrival time and the second arrival time, respectively. The distance calculation unit is used to calculate a first distance from the first UWB sensing sub-module to the touch point based on the first arrival time, and to calculate a second distance from the second UWB sensing sub-module to the touch point based on the second arrival time. A time difference calculation unit is used to calculate the difference between the first arrival time and the second arrival time to obtain the arrival time difference; The intersection calculation unit is used to determine two candidate two-dimensional coordinates of the touch point on the display screen plane based on the first distance, the second distance, and the plane equation; The position determination unit is used to select one of the two candidate two-dimensional coordinates as the true two-dimensional coordinate of the touch point based on the positive or negative sign of the arrival time difference. The coordinate mapping unit is used to map the real two-dimensional position to the pixel coordinates of the display screen according to the affine transformation matrix.
6. The touch device as claimed in claim 1, characterized in that, The signal processor further includes a multi-touch module, used to identify and locate each touch point when multiple touch points exist within the touch interaction area, wherein the multi-touch module includes: The echo decomposition unit is used to perform time-domain peak detection on the echo signals received by the first UWB sensing sub-module and the second UWB sensing sub-module, and to separate the echo components corresponding to each of the touch points from the mixed echo signals according to the difference between the first arrival time and / or the second arrival time. The coordinate calculation unit is used to calculate the pixel coordinates of each touch point based on the first arrival time, the second arrival time, and the arrival time difference corresponding to each echo component. The identity tracking unit is used to assign different identity identifiers to each of the touch points, and to match the pixel coordinates of each touch point calculated in the current frame with the pixel coordinates of the touch points with corresponding identity identifiers in the previous frame.
7. The touch device as claimed in claim 1, characterized in that, The human-computer interaction interface includes a communication unit that supports both wired and wireless communication methods and is used for data transmission with the host device.
8. A touch system, characterized in that, The touch system includes: Display devices used to display images; The host device, communicatively connected to the display device, is used for processing data; and The touch device according to any one of claims 1-7, wherein the touch device is deployed on the display device and is communicatively connected to the host device, the touch device is used to transmit the pixel coordinates of the touch point to the host device, the host device generates a corresponding touch response command based on the pixel coordinates, and executes the touch operation and display feedback corresponding to the touch response command on the display device.
9. The touch system as described in claim 8, characterized in that, The display device and the host device are independent devices or integrated together.
10. The touch system as described in claim 8, characterized in that, When the size of the display device is greater than or equal to the preset size, at least two touch devices are deployed on the display device, and each touch device coordinates its work through a time synchronization protocol to cover different touch areas.
