A screen touch detection module, method, apparatus, system, and device

Abstract

The embodiment of the present application discloses a screen touch detection module, method, device, system and equipment. The technical scheme provided by the embodiment of the present application shoots the picture of the space in front of the screen of the display device through the camera unit, and sends the shot picture information to the control unit. The touch detection data is obtained by detecting the screen touch operation of the display device through the ranging unit, and the touch detection data is sent to the control unit. The driving unit is used to control the rotation of the ranging unit to adjust the touch detection direction of the ranging unit. The control unit identifies the target touch object in the picture information, and adjusts the touch detection direction of the ranging unit to the direction corresponding to the target touch object through the driving unit. The screen touch data is output according to the touch detection data. The ranging unit can keep aiming at the target touch object and accurately detect the screen touch operation. The accuracy of the screen touch operation detection can be effectively improved, and the screen touch operation detection effect can be improved.

Description

Technical Field

[0001] This application relates to the field of electronic device technology, and in particular to a screen touch detection module, method, apparatus, system and device. Background Technology

[0002] With the development of electronic device technology, the application of screen display products such as projectors, commercial displays, and televisions is becoming increasingly widespread. Due to reasons such as the high cost of adding touch functionality, aesthetic requirements, or inconvenience in installing touch modules in certain usage scenarios, these screen display products generally do not have touch interaction capabilities, resulting in their overly limited functionality.

[0003] To enrich the user experience of screen display products, touch detection equipment can be added to detect touch operations and process the results accordingly. Existing touch detection equipment is generally based on LiDAR touch positioning technology. A motor drives the LiDAR to rotate 360°, forming a laser scanning surface on the screen. When an object touches the screen, it blocks the laser scanning line, thus obtaining the object's specific coordinates and detecting the touch operation.

[0004] However, with this screen touch operation detection method, the target can only be scanned once per revolution of the motor. The detection frequency is limited by the motor speed, which seriously affects the accuracy of screen touch operation detection and results in poor screen touch operation detection performance. Summary of the Invention

[0005] This application provides a screen touch detection module, method, apparatus, system, and device to solve the technical problems of low accuracy and poor screen touch operation detection in related technologies, and can effectively improve the accuracy and effect of screen touch operation detection.

[0006] In a first aspect, embodiments of this application provide a screen touch detection module, including a control unit, a camera unit, a ranging unit, and a driving unit, wherein the control unit is connected to the camera unit, the ranging unit, and the driving unit, wherein:

[0007] The camera unit is used to capture images of the space in front of the display device screen and send the captured image information to the control unit.

[0008] The ranging unit is used to detect touch operations on the display device to obtain touch detection data, and to send the touch detection data to the control unit;

[0009] The driving unit is used to control the rotation of the ranging unit to adjust the touch detection direction of the ranging unit;

[0010] The control unit is used to identify the target touch object in the screen information, and adjust the touch detection direction of the ranging unit to the direction corresponding to the target touch object through the driving unit, and output screen touch data according to the touch detection data.

[0011] This embodiment of the application captures an image of the space in front of the display device's screen using a camera unit and sends the captured image information to the control unit. A ranging unit detects touch operations on the display device to obtain touch detection data, which is also sent to the control unit. A driving unit controls the rotation of the ranging unit to adjust its touch detection direction. The control unit identifies the target touch object in the image information and adjusts the ranging unit's touch detection direction to the direction corresponding to the target touch object using the driving unit. It also outputs screen touch data based on the touch detection data. This allows the ranging unit to remain aligned with the target touch object and accurately detect touch operations. Screen touch operation detection can be achieved without rotating the ranging unit to form a scanning surface. The screen touch operation detection frequency is no longer limited by the motor speed, effectively improving the accuracy and effectiveness of screen touch operation detection.

[0012] Furthermore, the screen touch detection module also includes a mounting base, and the driving unit includes a drive motor, wherein:

[0013] The ranging unit is rotatably mounted on the mounting base, the driving unit is fixedly mounted on the mounting base, and the output shaft of the driving unit is connected to the ranging unit via a transmission connection.

[0014] As described above, by controlling the rotation of the ranging unit through the drive motor, the touch detection direction can be flexibly adjusted, and the touch detection direction of the ranging unit can be accurately controlled.

[0015] In a second aspect, embodiments of this application provide a screen touch detection method applied to a control unit in a screen touch detection module as described in any of the first aspects, wherein the control unit is connected to a camera unit, a ranging unit, and a driving unit in the screen touch detection module, and includes:

[0016] Acquire the image information output by the camera unit;

[0017] The system identifies the target touch object in the screen information and adjusts the touch detection direction of the ranging unit to the direction corresponding to the target touch object through the driving unit.

[0018] The touch detection data output by the ranging unit is acquired, and screen touch data is output based on the touch detection data.

[0019] This embodiment of the application captures an image of the space in front of the display device's screen using a camera unit and sends the captured image information to the control unit. A ranging unit detects touch operations on the display device to obtain touch detection data, which is also sent to the control unit. A driving unit controls the rotation of the ranging unit to adjust its touch detection direction. The control unit identifies the target touch object in the image information and adjusts the ranging unit's touch detection direction to the direction corresponding to the target touch object using the driving unit. It also outputs screen touch data based on the touch detection data. This allows the ranging unit to remain aligned with the target touch object and accurately detect touch operations. Screen touch operation detection can be achieved without rotating the ranging unit to form a scanning surface. The screen touch operation detection frequency is no longer limited by the motor speed, effectively improving the accuracy and effectiveness of screen touch operation detection.

[0020] Furthermore, before adjusting the touch detection direction of the ranging unit to the direction corresponding to the target touch object via the driving unit, the method further includes:

[0021] The target angle is determined based on the position of the target touch object in the screen information;

[0022] Accordingly, adjusting the touch detection direction of the ranging unit to the direction corresponding to the target touch object via the driving unit includes:

[0023] The driving unit controls the ranging unit to rotate toward the target angle.

[0024] As described above, by determining the target angle based on the position of the target touch object in the screen and controlling the ranging unit to turn to the target angle, accurate control of the touch detection direction is achieved.

[0025] Further, the step of outputting screen touch data based on the touch detection data includes:

[0026] The touch detection data is converted into a preset format to obtain screen touch data, and then the screen touch data is output.

[0027] As described above, by converting the touch detection data format into a preset format, the display device can directly respond to screen touch data, thereby improving touch response speed.

[0028] Furthermore, before outputting screen touch data based on the touch detection data, the method further includes:

[0029] Determine the target object type of the target touch object;

[0030] Accordingly, the step of outputting screen touch data based on the touch detection data includes:

[0031] Screen touch data is output based on the touch detection data and the target object type.

[0032] As described above, by identifying the target object type of the target touch object and outputting screen touch data based on the touch detection data and the target object type, the display device can make corresponding touch responses based on the touch detection data and the target object type, effectively enriching the touch experience.

[0033] Furthermore, after acquiring the image information output by the camera unit, the method further includes:

[0034] The gesture detection results are obtained by performing gesture detection on the screen information and then output.

[0035] As described above, by performing gesture detection on the screen information, the display device can respond to the gesture control based on the gesture detection results, effectively enriching the touch experience.

[0036] In a third aspect, embodiments of this application provide a screen touch detection device applied to a control unit in a screen touch detection module as described in any of the first aspects. The control unit is connected to a camera unit, a ranging unit, and a driving unit in the screen touch detection module, and includes an image acquisition module, a direction control module, and a touch detection module, wherein:

[0037] The image acquisition module is used to acquire image information output by the camera unit;

[0038] The direction control module is used to identify the target touch object in the screen information, and adjust the touch detection direction of the ranging unit to the direction corresponding to the target touch object through the driving unit;

[0039] The touch detection module is used to acquire the touch detection data output by the ranging unit and output screen touch data based on the touch detection data.

[0040] This embodiment of the application captures an image of the space in front of the display device's screen using a camera unit and sends the captured image information to the control unit. A ranging unit detects touch operations on the display device to obtain touch detection data, which is also sent to the control unit. A driving unit controls the rotation of the ranging unit to adjust its touch detection direction. The control unit identifies the target touch object in the image information and adjusts the ranging unit's touch detection direction to the direction corresponding to the target touch object using the driving unit. It also outputs screen touch data based on the touch detection data. This allows the ranging unit to remain aligned with the target touch object and accurately detect touch operations. Screen touch operation detection can be achieved without rotating the ranging unit to form a scanning surface. The screen touch operation detection frequency is no longer limited by the motor speed, effectively improving the accuracy and effectiveness of screen touch operation detection.

[0041] In a fourth aspect, embodiments of this application provide a screen touch control system, including a screen touch detection module as described in any of the first aspects and a display device, wherein the screen touch detection module is installed on the display device and is communicatively connected to the display device, wherein:

[0042] The display device is used to receive screen touch data sent by the screen touch detection module and to perform touch response based on the screen touch data.

[0043] This embodiment of the application captures an image of the space in front of the display device's screen using a camera unit and sends the captured image information to the control unit. A ranging unit detects touch operations on the display device to obtain touch detection data, which is also sent to the control unit. A driving unit controls the rotation of the ranging unit to adjust its touch detection direction. The control unit identifies the target touch object in the image information and adjusts the ranging unit's touch detection direction to the direction corresponding to the target touch object using the driving unit. It also outputs screen touch data based on the touch detection data. The display device can then accurately respond to touch based on the screen touch data. The ranging unit remains aligned with the target touch object and accurately detects touch operations. This eliminates the need to rotate the ranging unit to form a scanning surface for screen touch operation detection. The screen touch operation detection frequency is no longer limited by the motor speed, effectively improving the accuracy and effectiveness of screen touch operation detection.

[0044] Furthermore, the screen of the display device is within the shooting range of the camera unit in the screen touch detection module.

[0045] The above ensures that the screen touch detection module can accurately detect target touch objects approaching the screen and promptly control the ranging unit to rotate to the direction corresponding to the target touch object, thus ensuring the accuracy of screen touch detection.

[0046] In a fifth aspect, embodiments of this application provide a screen touch detection device, including: a memory and one or more processors;

[0047] The memory is used to store one or more programs;

[0048] When the one or more programs are executed by the one or more processors, the one or more processors implement the screen touch detection method as described in the second aspect.

[0049] In a fourth aspect, embodiments of this application provide a storage medium for storing computer-executable instructions, which, when executed by a computer processor, are used to perform the screen touch detection method as described in the second aspect. Attached Figure Description

[0050] Figure 1 This is a schematic diagram of the principle of a screen touch detection module provided in an embodiment of this application;

[0051] Figure 2 This is a schematic diagram of the structure of a screen touch detection module provided in an embodiment of this application;

[0052] Figure 3 This is a flowchart of a screen touch detection method provided in an embodiment of this application;

[0053] Figure 4 This is a schematic diagram of the structure of a screen touch detection system provided in an embodiment of this application;

[0054] Figure 5 This is a schematic diagram of the structure of a screen touch detection device provided in an embodiment of this application;

[0055] Figure 6 This is a schematic diagram of the structure of a screen touch detection device provided in an embodiment of this application.

[0056] Reference numerals: 100, screen touch detection module; 1, control unit; 2, camera unit; 3, ranging unit; 4, drive unit; 5, mounting base; 200, display device. Detailed Implementation

[0057] To make the objectives, technical solutions, and advantages of this application clearer, specific embodiments of this application will be described in further detail below with reference to the accompanying drawings. It is understood that the specific embodiments described herein are merely for explaining this application and not for limiting it. Furthermore, it should be noted that, for ease of description, only the parts relevant to this application are shown in the accompanying drawings, not all of them. In the description of the embodiments of this application, unless otherwise expressly specified and limited, the terms "connected," "linked," and "fixed" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral part; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication of two elements or the interaction between two elements. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances.

[0058] Before discussing the exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe the operations (or steps) as sequential processes, many of these operations can be performed in parallel, concurrently, or simultaneously. Furthermore, the order of the operations can be rearranged. The process can be terminated when its operation is completed, but additional steps not included in the figures may also be present. The process can correspond to a method, function, procedure, subroutine, subroutine, etc.

[0059] Conventional touchscreen implementations typically utilize capacitive touchscreens and infrared-framed touchscreens. However, capacitive touchscreens are expensive, have complex bonding processes, and can affect screen color. Furthermore, the touchscreen size must be matched to the screen size. Infrared-framed touchscreens install an infrared touch frame on the screen, but the infrared touch frame is also expensive and requires size matching. To reduce the cost of touchscreen implementation and minimize the impact on screen color, current touchscreen implementations in display products generally use LiDAR for touch detection. For example, a motor drives the LiDAR to rotate 360°, forming a laser scanning surface on the screen. When an object touches the screen, it blocks the laser scanning line, thus obtaining the object's specific coordinates and enabling touchscreen operation detection. However, in this screen touch operation detection method, a single screen touch operation detection is performed only after one revolution of the motor. The detection frequency is controlled by the motor speed, but the motor speed is not suitable for meeting the scanning frequency requirements. Currently, motor speeds are generally between 5 and 25 Hz, resulting in an excessively low screen touch operation detection frequency, significant touch operation delay, and a low position refresh rate due to the low scanning frequency caused by the low speed. This leads to a larger positional error in the detected touch position. Increasing the motor speed would increase the requirements for the display device's usage scenarios, and the vibration caused by the high-speed motor rotation would adversely affect the motor's lifespan, measurement accuracy, and the normal operation of the display device. Furthermore, increasing the scanning frequency would reduce the amount of point cloud data per revolution, resulting in fewer or even no point cloud data obtained from obstacles, which would also lead to a larger position calculation error. Based on this, this application provides a screen touch operation detection method to solve the technical problems of low accuracy and poor screen touch operation detection effect in existing methods.

[0060] Figure 1 A schematic diagram of the principle of a screen touch detection module provided in an embodiment of this application is given, such as... Figure 1 The screen touch detection module includes a control unit 1, a camera unit 2, a ranging unit 3, and a driving unit 4, wherein the control unit 1 is connected to the camera unit 2, the ranging unit 3, and the driving unit 4.

[0061] The camera unit 2 provided in this application can be installed facing the space in front of the screen of the display device, so that the image captured by the camera unit can record objects approaching and touching the screen of the display device. The camera unit 2 provided in this application can be used to capture the image of the space in front of the screen of the display device and send the captured image information to the control unit 1. For example, the camera unit 2 continuously captures and outputs image information. When the screen of the display device is touched by a hand or pen (such as a stylus or touch pen), the content recorded in the continuous image information shows a process of change from never having a hand or pen displayed, to the beginning of the appearance of a hand or pen, to the continuous appearance of a hand or pen, and finally returning to the state of not having a hand or pen displayed when the screen touch operation is completed. The display device provided in this application can be a projector (the screen of the display device can be the screen corresponding to the projector or the area corresponding to the projection position (such as a wall), a commercial monitor, a television, or other screen display products.

[0062] In one embodiment, the ranging unit 3 is used to detect touch operations on the display device to obtain touch detection data, and then send the touch detection data to the control unit 1. The ranging unit 3 can detect objects in the touch detection direction (which can be a range corresponding to a ray direction or a preset angle range) and output the distance and / or direction corresponding to the detected object. The ranging unit 3 provided in this application can be installed facing the space in front of the display device's screen. When an object is about to touch or touches the screen of the display device, and is in the touch detection direction of the ranging unit 3, the ranging unit 3 can detect the presence of the object and output the corresponding distance and / or direction. Optionally, the ranging unit 3 provided in this application can be a laser radar ranging module, an ultrasonic radar ranging module, etc. The ranging method of the ranging unit 3 can be single-point ranging or multi-point ranging, such as a radar ranging module with a field of view, a solid-state radar, etc.

[0063] The driving unit 4 provided in this application can be used to control the rotation of the ranging unit 3 to adjust the touch detection direction of the ranging unit 3. By adjusting the touch detection direction of the ranging unit 3, the ranging unit 3 can detect objects at different positions on the screen of the display device.

[0064] The control unit 1 provided in this application can be used to identify target touch objects in the screen information, and adjust the touch detection direction of the ranging unit 3 to the direction corresponding to the target touch object through the driving unit 4, and output screen touch data according to the touch detection data. Optionally, after detecting a target touch object in the screen information, the driving unit 4 continuously controls the ranging unit 3 to rotate according to the position of the target touch object in the newly acquired screen information, thereby realizing the tracking of the target touch object. The target touch object can be a human limb (e.g., fingers, palm, etc.), an object (e.g., a stylus, stylus, chalk, ruler, eraser, etc.), etc.

[0065] For example, when a user performs a screen touch operation with their finger on the display device, as the finger approaches the screen, the control unit 1 can detect the finger in the screen information. Based on the finger's position in the screen information, the control unit 1 controls the ranging unit 3 to rotate via the drive unit 4, so that the touch detection direction of the ranging unit 3 rotates towards the finger. During this process, the control unit 1 continuously tracks the finger's position by controlling the ranging unit 3 to rotate via the drive unit 4, based on the newly acquired screen information. Since the user's finger is not in contact with the screen at this time, the ranging unit 3 does not detect the finger. When the user's finger touches the screen and slides on the screen to perform a screen touch operation, the ranging unit 3 detects the user's finger and outputs touch detection data that accurately measures the position and / or angle of the user's finger. Based on the touch detection data, screen touch data reflecting the screen touch operation can be output.

[0066] Figure 2 A schematic diagram of the structure of a screen touch detection module provided in an embodiment of this application is given, as follows: Figure 2 As shown, the screen touch detection module provided in this application also includes a mounting base 5, and the drive unit 4 includes a drive motor, such as a stepper motor.

[0067] The control unit 1 can be housed within the mounting base 5. The ranging unit 3 is rotatably mounted on the mounting base 5, and the drive unit 4 is fixedly mounted on the mounting base 5. The output shaft of the drive unit 4 is connected to the ranging unit 3 via a transmission connection. For example, if the ranging unit 3 is fixedly connected to the output shaft of the drive unit 4, the rotation of the ranging unit 3 can be controlled by controlling the rotation of the output shaft of the drive unit 4, thereby controlling the touch detection direction of the ranging unit 3. This application achieves flexible adjustment of the touch detection direction and accurate control of the touch detection direction of the ranging unit 3 by controlling the rotation of the ranging unit 3 through a drive motor.

[0068] As described above, the camera unit 2 captures the image of the space in front of the display device's screen and sends the captured image information to the control unit 1. The ranging unit 3 detects touch operations on the display device to obtain touch detection data, which is also sent to the control unit 1. The drive unit 4 controls the rotation of the ranging unit 3 to adjust its touch detection direction. The control unit 1 identifies the target touch object in the image information and adjusts the touch detection direction of the ranging unit 3 to the direction corresponding to the target touch object through the drive unit 4. The control unit 1 also outputs screen touch data based on the touch detection data. This allows the ranging unit 3 to remain aligned with the target touch object and accurately detect touch operations. Screen touch operation detection can be achieved without rotating the ranging unit 3 to form a scanning surface. The screen touch operation detection frequency is no longer limited by the motor speed, which can effectively improve the accuracy and effect of screen touch operation detection.

[0069] Figure 3 A flowchart of a screen touch detection method provided in an embodiment of this application is given. This screen touch detection method can be applied to the control unit in the screen touch detection module provided in any of the above embodiments. The control unit is connected to the camera unit, ranging unit and driving unit in the screen touch detection module. The screen touch detection method provided in this application embodiment can be executed by a screen touch detection device. The screen touch detection device can be implemented by hardware and / or software and integrated into the screen touch detection equipment.

[0070] The following description uses a screen touch detection device to perform a screen touch detection method as an example. (Reference) Figure 3 The screen touch detection method includes:

[0071] S110: Acquire image information output by the camera unit.

[0072] For example, the control unit in the screen touch detection module continuously acquires the image information output by the camera unit. When the screen touch detection module is installed on the display device, the image information can display the image of the space in front of the screen of the display device.

[0073] S120: Identifies the target touch object in the screen information and adjusts the touch detection direction of the ranging unit to the direction corresponding to the target touch object through the driving unit.

[0074] For example, for each piece of screen information acquired, the control unit performs image recognition processing on the screen information to identify the target touch object in the screen information. After identifying the target touch object from the screen information, the drive unit can adjust the touch detection direction of the ranging unit to the direction corresponding to the target touch object, so that when the target touch object performs a screen touch operation, the ranging unit can accurately detect the position of the target touch object.

[0075] In one possible embodiment, before adjusting the touch detection direction of the ranging unit to the direction corresponding to the target touch object through the driving unit, the screen touch detection method provided in this application can also determine the target angle based on the position of the target touch object in the screen information.

[0076] For example, the correspondence between each pixel and angle in the image information captured by the camera unit can be predetermined. This angle can be the angle of the target touch object relative to the ranging unit. After rotating the touch detection direction of the ranging unit to the corresponding angle, the target touch object is located in the touch detection direction of the ranging unit. After identifying the target touch object from the image information, the target angle can be determined based on the above correspondence and the position of the target touch object in the image information.

[0077] Accordingly, the touch detection direction of the ranging unit can be adjusted to the direction corresponding to the target touch object by the driving unit, which can be achieved by controlling the ranging unit to rotate towards the target angle.

[0078] For example, after determining the target angle, the ranging unit can be controlled by the driving unit to rotate towards the target angle, so that the orthographic projection position of the target touch object on the screen is located at the orthographic projection position of the ranging unit's touch detection direction on the screen. When the target touch object touches the screen, the ranging unit can accurately detect the target touch object. This application achieves accurate control of the touch detection direction by determining the target angle based on the position of the target touch object on the screen and controlling the ranging unit to rotate towards the target angle.

[0079] S130: Acquire touch detection data output by the ranging unit, and output screen touch data based on the touch detection data.

[0080] For example, the control unit continuously acquires touch detection data output by the ranging unit and outputs screen touch data based on the touch detection data, such as sending screen touch data to the connected display device, and the display device can make corresponding touch responses based on the screen touch data.

[0081] In this process, as the target touch object moves, its position on the screen changes synchronously. The control unit adjusts the touch detection direction of the ranging unit according to the target touch object's position on the screen, ensuring that the ranging unit's touch detection direction is synchronized with the target touch object's movement. This allows the ranging unit to accurately detect the target touch object's screen touch operation. Correspondingly, when the display device responds to touch based on screen touch data, it can determine the corresponding touch trajectory based on continuous screen touch data and respond accordingly, such as writing on the screen, switching images, or moving displayed elements.

[0082] In one possible embodiment, the screen touch detection method provided in this application may further determine the target object type of the target touch object before outputting screen touch data based on touch detection data. Accordingly, outputting screen touch data based on touch detection data may be based on both the touch detection data and the target object type.

[0083] For example, after acquiring the image information output by the camera unit, the control unit performs image recognition processing on the image information to identify the target touch object in the image information and the target object type corresponding to the target touch object (e.g., finger, palm, pen tip, pen cap, pen eraser, etc.). After acquiring the touch detection data output by the ranging unit, screen touch data can be output according to the touch detection data and the target object type. At this time, the screen touch data can reflect the position information of the target touch object performing screen touch operation on the screen and the target object type of the target touch object.

[0084] Accordingly, when the display device responds to touch based on screen touch data, it can execute corresponding touch responses based on the position information corresponding to the screen touch data and the type of the target object. Different target object types can correspond to different touch response types. For example, the touch response type for a finger can be switching the screen or moving the displayed element based on the position information corresponding to the screen touch data; the touch response type for a pen tip can be writing on the screen; and the touch response type for a palm, pen cap, or pen eraser can be erasing the writing on the screen based on the position information corresponding to the screen touch data. This application identifies the target object type of the target touch object and outputs screen touch data based on the touch detection data and the target object type. The display device can then perform corresponding touch responses based on the touch detection data and the target object type, effectively enriching the touch experience.

[0085] In one possible embodiment, after obtaining the screen touch detection information output by the camera unit, the screen touch detection method provided in this application can also perform gesture detection on the screen information to obtain gesture detection results and output the gesture detection results.

[0086] For example, after the control unit acquires the image information output by the camera unit, it performs gesture detection on the image information to obtain a gesture detection result, and sends the gesture detection result to the display device. The display device can then respond with gesture control based on the gesture detection result, such as writing, erasing, zooming in, or zooming out on the content displayed on the screen. This application effectively enriches the touch experience by performing gesture detection on the image information, allowing the display device to respond with corresponding gesture control based on the gesture detection result.

[0087] In one possible embodiment, before outputting screen touch data based on touch detection data, the screen touch detection method provided in this application can further convert the data format of the touch detection data into a preset format to obtain screen touch data, and then output the screen touch data. For example, converting the touch detection data into a preset format corresponding to the USB HID protocol to obtain screen touch data, that is, converting the position information or distance information of the touch detection data into standard USB touch device events, so that the display device can respond to the screen touch data without drivers. By converting the data format of the touch detection data into a preset format, this application allows the display device to directly respond to the screen touch data, thereby improving the touch response speed.

[0088] As described above, the camera unit captures an image of the space in front of the display device's screen and sends the captured image information to the control unit. A ranging unit detects touch operations on the display device to obtain touch detection data, which is also sent to the control unit. A drive unit controls the rotation of the ranging unit to adjust its touch detection direction. The control unit identifies the target touch object in the image information and adjusts the ranging unit's touch detection direction to the direction corresponding to the target touch object using the drive unit. It also outputs screen touch data based on the touch detection data. This allows the ranging unit to remain aligned with the target touch object and accurately detect touch operations. Screen touch operation detection can be achieved without rotating the ranging unit to form a scanning surface. The screen touch operation detection frequency is no longer limited by the motor speed, effectively improving the accuracy and effectiveness of screen touch operation detection.

[0089] Figure 4 A schematic diagram of a screen touch detection system provided in an embodiment of this application is given, with reference to... Figure 4 The screen touch detection system includes a screen touch detection module 100 as provided in any of the above embodiments and a display device 200. The screen touch detection module 100 is mounted on the display device 200 and is communicatively connected to the display device 200. Optionally, the screen touch detection module 100 and the display device 200 can be wired (e.g., connected via a USB interface) or wirelessly connected (e.g., via Bluetooth or hotspot connection).

[0090] The display device 200 is used to receive screen touch data sent by the screen touch detection module 100 and to perform touch response based on the screen touch data.

[0091] In one embodiment, the screen of the display device 200 is within the shooting range of the camera unit in the screen touch detection module 100, ensuring that the screen touch detection module 100 can accurately detect target touch objects approaching the screen and promptly control the ranging unit to rotate to the direction corresponding to the target touch object, thus ensuring the accuracy of screen touch detection. Optionally, the screen touch detection module 100 can be installed above or to the side of the display device 200, and the shooting unit in the screen touch detection module 100 is installed facing the space in front of the screen of the display device 200, so that the camera unit can capture the image of the space in front of the screen of the display device 200. Figure 4 Taking the screen touch detection module 100 installed above the display device 200 as an example, the shooting direction of the camera unit is downward.

[0092] The camera unit provided in this application offers a high frame rate, enabling rapid identification of the target touch object and its angle within the screen. It quickly controls the ranging unit to rotate towards the target touch object, and captures a complete view of the screen. Even before the target touch object appears from a distance and the screen is touched, the camera unit can detect it and preemptively rotate the ranging unit to the corresponding angle, thus improving screen touch detection speed. Furthermore, when the screen touch detection module 100 is installed on one side of the display device 200, the drive motor only needs to handle the rotation within the 0-180 degree range. Compared to related technologies that require 360-degree rotation with LiDAR, this eliminates the need to measure the ineffective 180-270 degree range. Additionally, the drive motor can rotate in both directions, quickly driving the ranging unit to the target angle corresponding to the target touch object, resulting in even faster screen touch detection.

[0093] As described above, the camera unit captures an image of the space in front of the screen of the display device 200 and sends the captured image information to the control unit. The ranging unit detects touch operations on the display device 200 to obtain touch detection data, which is also sent to the control unit. The driving unit controls the rotation of the ranging unit to adjust its touch detection direction. The control unit identifies the target touch object in the image information and adjusts the touch detection direction of the ranging unit to the direction corresponding to the target touch object using the driving unit. The control unit also outputs screen touch data based on the touch detection data. This allows the ranging unit to stay aligned with the target touch object and accurately detect touch operations. It eliminates the need to rotate the ranging unit to form a scanning surface for screen touch operation detection. The screen touch operation detection frequency is no longer limited by the motor speed, effectively improving the accuracy and effectiveness of screen touch operation detection.

[0094] Figure 5A schematic diagram of a screen touch detection device according to an embodiment of this application is provided. This screen touch detection device can be applied to the control unit in the screen touch detection module provided in any of the above embodiments, wherein the control unit is connected to the camera unit, ranging unit, and driving unit in the screen touch detection module. (Reference) Figure 5 The screen touch detection device includes an image acquisition module 51, an orientation control module 52, and a touch detection module 53.

[0095] The image acquisition module 51 is used to acquire the image information output by the camera unit; the direction control module 52 is used to identify the target touch object in the image information and adjust the touch detection direction of the ranging unit to the direction corresponding to the target touch object through the driving unit; the touch detection module 53 is used to acquire the touch detection data output by the ranging unit and output the screen touch data according to the touch detection data.

[0096] As described above, the camera unit captures an image of the space in front of the display device's screen and sends the captured image information to the control unit. A ranging unit detects touch operations on the display device to obtain touch detection data, which is also sent to the control unit. A drive unit controls the rotation of the ranging unit to adjust its touch detection direction. The control unit identifies the target touch object in the image information and adjusts the ranging unit's touch detection direction to the direction corresponding to the target touch object using the drive unit. It also outputs screen touch data based on the touch detection data. This allows the ranging unit to remain aligned with the target touch object and accurately detect touch operations. Screen touch operation detection can be achieved without rotating the ranging unit to form a scanning surface. The screen touch operation detection frequency is no longer limited by the motor speed, effectively improving the accuracy and effectiveness of screen touch operation detection.

[0097] In one possible embodiment, the screen touch detection device further includes an angle determination module, which is used to:

[0098] Determine the target angle based on the position of the target touch object in the screen information;

[0099] Accordingly, the direction control module 52 adjusts the touch detection direction of the ranging unit to the direction corresponding to the target touch object through the driving unit, including:

[0100] The rangefinding unit is controlled by the drive unit to rotate toward the target angle.

[0101] In one possible embodiment, the touch detection module 53 outputs screen touch data based on the touch detection data, including:

[0102] The touch detection data is converted into a preset format to obtain screen touch data, and then the screen touch data is output.

[0103] In one possible embodiment, the screen touch detection device further includes a type determination module, which is used for:

[0104] Determine the type of the target object being touched;

[0105] Accordingly, the touch detection module 53 outputs screen touch data based on the touch detection data, including:

[0106] The screen touch data is output based on the touch detection data and the type of the target object.

[0107] In one possible embodiment, the screen touch detection device further includes a gesture detection module, which is used for:

[0108] Perform gesture detection on the image information to obtain the gesture detection results, and output the gesture detection results.

[0109] It is worth noting that in the embodiments of the screen touch detection device described above, the various units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be achieved; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of this application.

[0110] This application also provides a screen touch detection device, which can integrate the screen touch detection apparatus provided in this application. Figure 6 This is a schematic diagram of the structure of a screen touch detection device provided in an embodiment of this application. (Reference) Figure 6 The screen touch detection device includes: an input device 63, an output device 64, a memory 62, and one or more processors 61; the memory 62 is used to store one or more programs; when one or more programs are executed by one or more processors 61, the one or more processors 61 implement the screen touch detection method provided in the above embodiments. The input device 63, output device 64, memory 62, and processors 61 can be connected via a bus or other means. Figure 6 Taking the example of a connection between China and Israel via a bus.

[0111] The memory 62, as a computing device readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as program instructions / modules corresponding to the screen touch detection method provided in any embodiment of this application (e.g., the screen acquisition module 51, orientation control module 52, and touch detection module 53 in the screen touch detection device). The memory 62 may primarily include a program storage area and a data storage area. The program storage area may store the operating system and at least one application program required for a function; the data storage area may store data created based on the use of the device, etc. Furthermore, the memory 62 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 62 may further include memory remotely located relative to the processor 61, and these remote memories can be connected to the device via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0112] Input device 63 can be used to receive input digital or character information, and to generate key signal inputs related to user settings and function control of the device. Output device 64 may include display devices such as a display screen.

[0113] The processor 61 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory 62, thereby realizing the screen touch detection method described above.

[0114] The screen touch detection device, equipment, and computer provided above can be used to execute the screen touch detection method provided in any of the above embodiments, and have corresponding functions and beneficial effects.

[0115] This application embodiment also provides a storage medium for storing computer-executable instructions. When executed by a computer processor, the computer-executable instructions are used to execute the screen touch detection method provided in the above embodiment. The screen touch detection method includes: acquiring image information output by a camera unit; identifying a target touch object in the image information and adjusting the touch detection direction of a ranging unit to the direction corresponding to the target touch object through a driving unit; acquiring touch detection data output by the ranging unit and outputting screen touch data based on the touch detection data.

[0116] Storage medium – any type of memory device or storage device. The term “storage medium” is intended to include: mounting media, such as CD-ROMs, floppy disks, or magnetic tape devices; computer system memory or random access memory, such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc.; non-volatile memory, such as flash memory, magnetic media (e.g., hard disks or optical storage); registers or other similar types of memory elements, etc. Storage media may also include other types of memory or combinations thereof. Furthermore, storage media may reside in a first computer system in which a program is executed, or may reside in a different second computer system connected to the first computer system via a network (such as the Internet). The second computer system can provide program instructions to the first computer for execution. The term “storage medium” can include two or more storage media that may reside in different locations (e.g., in different computer systems connected via a network). Storage media may store program instructions (e.g., specifically implemented as a computer program) executable by one or more processors.

[0117] Of course, the computer-executable instructions provided in the embodiments of this application are not limited to the screen touch detection method provided above, but can also perform related operations in the screen touch detection method provided in any embodiment of this application.

[0118] The screen touch detection device, equipment, and storage medium provided in the above embodiments can execute the screen touch detection method provided in any embodiment of this application. For technical details not described in detail in the above embodiments, please refer to the screen touch detection method provided in any embodiment of this application.

[0119] The above description is merely a preferred embodiment and the technical principles employed in this application. This application is not limited to the specific embodiments provided herein, and various obvious changes, readjustments, and substitutions that can be made by those skilled in the art will not depart from the scope of protection of this application. Therefore, although this application has been described in detail through the above embodiments, this application is not limited to the above embodiments, and may include many other equivalent embodiments without departing from the concept of this application, the scope of which is determined by the scope of the claims.

Claims

1. A screen touch detection module, characterized in that, It includes a control unit, a camera unit, a ranging unit, and a driving unit. The control unit is connected to the camera unit, the ranging unit, and the driving unit, wherein: The camera unit is used to capture images of the space in front of the display device screen and send the captured image information to the control unit. The ranging unit is used to detect touch operations on the display device to obtain touch detection data, and to send the touch detection data to the control unit; The driving unit is used to control the rotation of the ranging unit to adjust the touch detection direction of the ranging unit; The control unit is used to identify the target touch object in the screen information, and adjust the touch detection direction of the ranging unit to the direction corresponding to the target touch object through the driving unit, and output screen touch data according to the touch detection data.

2. The screen touch detection module according to claim 1, characterized in that, The screen touch detection module further includes a mounting base, and the driving unit includes a drive motor, wherein: The ranging unit is rotatably mounted on the mounting base, the driving unit is fixedly mounted on the mounting base, and the output shaft of the driving unit is connected to the ranging unit via a transmission connection.

3. A screen touch detection method, applied to a control unit in a screen touch detection module as described in claim 1 or 2, wherein the control unit is connected to a camera unit, a ranging unit, and a driving unit in the screen touch detection module, characterized in that, include: Acquire the image information output by the camera unit; The system identifies the target touch object in the screen information and adjusts the touch detection direction of the ranging unit to the direction corresponding to the target touch object through the driving unit. The touch detection data output by the ranging unit is acquired, and screen touch data is output based on the touch detection data.

4. The screen touch detection method according to claim 3, characterized in that, Before adjusting the touch detection direction of the ranging unit to the direction corresponding to the target touch object via the driving unit, the method further includes: The target angle is determined based on the position of the target touch object in the screen information; Accordingly, adjusting the touch detection direction of the ranging unit to the direction corresponding to the target touch object via the driving unit includes: The driving unit controls the ranging unit to rotate toward the target angle.

5. The screen touch detection method according to claim 3, characterized in that, The step of outputting screen touch data based on the touch detection data includes: The touch detection data is converted into a preset format to obtain screen touch data, and then the screen touch data is output.

6. The screen touch detection method according to claim 3, characterized in that, Before outputting screen touch data based on the touch detection data, the method further includes: Determine the target object type of the target touch object; Accordingly, the step of outputting screen touch data based on the touch detection data includes: Screen touch data is output based on the touch detection data and the target object type.

7. The screen touch detection method according to claim 3, characterized in that, After acquiring the image information output by the camera unit, the method further includes: The gesture detection results are obtained by performing gesture detection on the screen information and then output.

8. A screen touch control system, characterized in that, Includes a screen touch detection module as described in claim 1 or 2 and a display device, wherein the screen touch detection module is installed on the display device and is communicatively connected to the display device, wherein: The display device is used to receive screen touch data sent by the screen touch detection module and to perform touch response based on the screen touch data.

9. The screen touch control system according to claim 8, characterized in that, The screen of the display device is within the shooting range of the camera unit in the screen touch detection module.

10. A screen touch detection device, characterized in that, include: Memory and one or more processors; The memory is used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the screen touch detection method as described in any one of claims 3-7.

11. A storage medium for storing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the screen touch detection method as described in any one of claims 3-7.

Images