A millimeter wave-based hovering touch display device and a control method thereof

Abstract

This invention relates to a millimeter-wave-based air-touch display device and control method, comprising the following steps: when a millimeter-wave radar detects a first human hand within an effective touch area, a hand dwell timer is activated; if the dwell time of the first human hand exceeds a set time, the next step is performed; otherwise, no action is taken; air-touch function is activated; the image display SOC receives the distance value from the first human hand to the millimeter-wave radar as measured by the millimeter-wave radar, and determines the current touch ratio based on the display size and the distance value; the millimeter-wave radar activates the detection of a second human hand; the image display SOC adjusts the display based on the combined gestures of the first and second human hands detected by the millimeter-wave radar, combined with the touch ratio; by applying the method of this application, the touch ratio can be adjusted according to the actual location and air-touch can be achieved, thereby significantly improving the flexibility of device control.

Description

Technical Field

[0001] This invention relates to the field of display control technology, and more specifically, to a millimeter-wave-based air-touch display device and control method. Background Technology

[0002] Millimeter-wave ranging works by transmitting and receiving millimeter-wave signals and calculating the distance between the target object and the radar using the signal's propagation time. Specifically, a millimeter-wave radar transmits a high-frequency millimeter-wave signal. When this signal encounters a target object, it is reflected back. The radar receives the reflected signal and calculates the distance between the target object and the radar by measuring the time difference between the transmitted and received signals.

[0003] This ranging principle is based on the constant propagation speed of electromagnetic waves. Millimeter-wave signals travel at approximately the speed of light in air; by measuring the propagation time of the signal, the distance can be calculated based on the relationship between the speed of light and time. Millimeter-wave ranging has advantages such as high precision, high resolution, and strong anti-interference capabilities. In another method, a radar emits a millimeter-wave signal, which is reflected when it encounters a hand. The radar receives the reflected signal and analyzes changes in its frequency, phase, and amplitude to obtain information such as the hand's position, speed, and angle. Based on this information, it further extracts gesture features, such as the degree of finger bending, palm orientation, and the trajectory of the gesture, thereby achieving gesture recognition.

[0004] Currently, some solutions that combine millimeter-wave radar with displays typically only perform simple gesture recognition or human body sensing control, and cannot achieve the effect of touch control. If touch control is required, it still depends on hardware such as touch control screens. Therefore, a millimeter-wave-based air-touch display device and control method that can achieve air-touch control of the display screen is needed. Summary of the Invention

[0005] The technical problem to be solved by the present invention is to provide a millimeter-wave-based air-touch display device and a millimeter-wave-based air-touch display control method, in view of the above-mentioned defects of the prior art.

[0006] The technical solution adopted by this invention to solve its technical problem is:

[0007] A method for controlling a touch display based on millimeter waves is constructed, comprising the following steps:

[0008] Set the millimeter-wave radar on the display, with the detection direction of the millimeter-wave radar facing the front of the display, and define the effective touch area within the coverage area of ​​the millimeter-wave radar.

[0009] When the millimeter-wave radar detects a first human hand that meets the first set condition within the effective touch area, it starts the hand dwell timer. If the dwell time of the first human hand exceeds the set time, it proceeds to the next step; otherwise, it does not take any action.

[0010] When the air touch function is enabled, the SOC image display shows the first OSD, which is used to indicate whether the air touch function is enabled.

[0011] The image shows the distance value from the first human hand to the millimeter-wave radar measured by the SOC. At the same time, the image shows the SOC displaying a second OSD, which is used to identify the distance value. The image shows the SOC determining the current touch ratio based on the display size and the distance value.

[0012] The millimeter-wave radar activates the detection of the second human hand, and when a second human hand that meets the first set conditions is detected, the image display SOC displays the third OSD, which is used to identify the position of the second human hand.

[0013] The image shows that the SOC adjusts and controls the display based on the combined gestures of the first and second human hands detected by the millimeter-wave radar, combined with the touch ratio.

[0014] The air-touch display control method based on millimeter waves described in this invention, wherein the millimeter-wave radar is mounted on the display, with its detection direction facing the front of the display, and an effective touch area is defined within the coverage area of ​​the millimeter-wave radar, includes:

[0015] The millimeter-wave radar is centered at the top or bottom of the display, with its detection direction facing directly in front of the display.

[0016] The effective touch area of ​​the cone-shaped coverage area is determined based on the user's actual observation distance range.

[0017] The air-touch display control method based on millimeter waves described in this invention, wherein the image display SOC determines the current touch ratio based on the display size and distance value, including:

[0018] Multiple display sizes are set from smallest to largest, and corresponding h values ​​are calculated. These h values ​​form multiple sub-intervals that define the effective touch area. The calculation formula is as follows:

[0019] r = h·tanΘ;

[0020]

[0021] 2·r=L3;

[0022] Where Θ is the transmission angle of the millimeter-wave radar; L1 and L2 are the length and width values ​​of the display, L3 is the length of the diagonal of the display; and h is the straight-line distance from the touch plane to the millimeter-wave radar.

[0023] Get the sub-interval where the distance value is located, get the smaller endpoint h value of the sub-interval, and get the set display size corresponding to the smaller endpoint h value;

[0024] Touch ratio x = Actual display size / Set display size.

[0025] The present invention discloses a millimeter-wave-based air-touch display control method, wherein the millimeter-wave radar detects a human hand and performs gesture detection; if the gesture is a palm shape, it is identified as a first human hand, and the plane on which the palm of the first human hand is located is a virtual touch control surface; when the millimeter-wave radar activates the detection of a second human hand, if it detects a human hand, it performs gesture detection; if the gesture is a finger shape, it is identified as a second human hand.

[0026] The air-touch display control method based on millimeter waves described in this invention involves the millimeter-wave radar detecting gestures from multiple human hands. If only one gesture is a palm, the human hand corresponding to the palm is identified as the first human hand. If multiple gestures are palms, the human hand corresponding to the closest palm is identified as the first human hand. If no gesture is a palm, no action is taken.

[0027] The air-touch display control method based on millimeter waves described in this invention, wherein after the air-touch function is enabled, if the gesture of the first human hand changes to a finger pattern, the first human hand and the second human hand can cooperate to perform multi-point touch operation; after a preset time without operation is reached or after the millimeter-wave radar detects the set gesture action of the first human hand and / or the second human hand, the air-touch function is disabled.

[0028] The air-touch display control method based on millimeter waves described in this invention includes an externally input signal source for the image display SOC. When the image display SOC performs display adjustment control, it processes the combined gestures of the first and second human hands detected by millimeter-wave radar into touch coordinates and click events, and sends them to the external signal source for display adjustment.

[0029] The air-touch display control method based on millimeter waves described in this invention includes a signal generated by the image display SOC itself, wherein the image display SOC performs display adjustment control itself during display adjustment.

[0030] A millimeter-wave-based air-touch display device, according to the above-described millimeter-wave-based air-touch display control method, wherein the device includes an image display SOC, a display module, a millimeter-wave module, and an external signal source;

[0031] The millimeter-wave radar is placed on the display, with the detection direction of the millimeter-wave radar facing the front of the display, and an effective touch area is set in the coverage area of ​​the millimeter-wave radar.

[0032] When the millimeter-wave radar detects a first human hand that meets the first set condition within the effective touch area, it starts the hand dwell timer. If the dwell time of the first human hand exceeds the set time, it proceeds to the next step; otherwise, it does not take any action.

[0033] When the air touch function is enabled, the image display SOC displays the first OSD, which is used to indicate whether the air touch function is enabled.

[0034] The image shows the distance value from the first human hand to the millimeter-wave radar measured by the millimeter-wave radar received by the SOC. At the same time, the image shows the SOC displaying a second OSD, which is used to identify the distance value. The image shows the SOC determining the current touch ratio based on the display size and the distance value.

[0035] The millimeter-wave radar activates the detection of the second human hand, and when a second human hand that meets the first set conditions is detected, the image display SOC displays the third OSD, which is used to identify the position of the second human hand.

[0036] The image shows that the SOC processes the combined movements of the first and second human hands detected by the millimeter-wave radar into touch coordinates and click events, and sends them to an external signal source for display adjustment and control.

[0037] A millimeter-wave-based air-touch display device, according to the above-described millimeter-wave-based air-touch display control method, wherein the device includes an image display SOC, a display module, and a millimeter-wave module;

[0038] The millimeter-wave radar is mounted on the display, with its detection direction facing the front of the display. An effective touch area is defined within the coverage area of ​​the millimeter-wave radar.

[0039] When the millimeter-wave radar detects a first human hand that meets the first set condition within the effective touch area, it starts the hand dwell timer. If the dwell time of the first human hand exceeds the set time, it proceeds to the next step; otherwise, it does not take any action.

[0040] When the air touch function is enabled, the SOC image display shows the first OSD, which is used to indicate whether the air touch function is enabled.

[0041] The image shows the distance value from the first human hand to the millimeter-wave radar measured by the SOC. At the same time, the image shows the SOC displaying a second OSD, which is used to identify the distance value. The image shows the SOC determining the current touch ratio based on the display size and the distance value.

[0042] The millimeter-wave radar activates the detection of the second human hand, and when a second human hand that meets the first set conditions is detected, the image display SOC displays the third OSD, which is used to identify the position of the second human hand.

[0043] The image shows that the SOC adjusts and controls the display based on the combined gestures of the first and second human hands detected by the millimeter-wave radar, combined with the touch ratio.

[0044] The beneficial effects of this invention are as follows: by applying the method of this application, the touch ratio can be adjusted according to the actual location and air touch can be realized, thereby greatly improving the flexibility of device control. At the same time, the solution can be improved and upgraded on existing displays, providing richer functional upgrade options for existing displays, and the cost is also low. Attached Figure Description

[0045] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the present invention will be further described below in conjunction with the accompanying drawings and embodiments. The drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort:

[0046] Figure 1 This is a flowchart of a preferred embodiment of the air-touch display control method based on millimeter waves of the present invention;

[0047] Figure 2 This is a schematic plan view of the millimeter wave detection range of the air-touch display control method based on millimeter waves according to a preferred embodiment of the present invention;

[0048] Figure 3 This is a schematic diagram of the size partitioning of the air-touch display control method based on millimeter waves according to a preferred embodiment of the present invention;

[0049] Figure 4 This is an OSD diagram illustrating a preferred embodiment of the air-touch display control method based on millimeter waves according to the present invention.

[0050] Figure 5 This is a laser-assisted schematic diagram of a millimeter-wave-based air-touch display control method according to a preferred embodiment of the present invention.

[0051] Figure 6 This is a block diagram illustrating the principle of a millimeter-wave-based air-touch display control device according to a preferred embodiment of the present invention. Detailed Implementation

[0052] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, a clear and complete description will be provided below in conjunction with the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the protection scope of the present invention.

[0053] Example 1

[0054] A preferred embodiment of the present invention is a millimeter-wave-based air-touch display device and control method, such as... Figure 1 As shown, see also Figures 2-5 This includes the following steps:

[0055] S01: Set the millimeter-wave radar on the display, with the detection direction of the millimeter-wave radar facing the front of the display, and set the effective touch area within the coverage area of ​​the millimeter-wave radar;

[0056] S02: When the millimeter-wave radar detects a first human hand that meets the first set condition within the effective touch area, start the hand dwell timer. If the dwell time of the first human hand exceeds the set time, proceed to the next step; otherwise, do not take any action.

[0057] S03: Enable the air touch function, and at the same time, the image display SOC displays the first OSD, which is used to indicate whether the air touch function is enabled;

[0058] S04: The image displays the distance value from the first human hand to the millimeter-wave radar measured by the millimeter-wave radar received by the SOC. At the same time, the image displays the second OSD, which is used to identify the distance value. The image displays the SOC to determine the current touch ratio based on the display size and the distance value.

[0059] S05: The millimeter-wave radar activates the detection of the second human hand, and when a second human hand that meets the first set condition is detected, the image display SOC displays the third OSD, which is used to identify the position of the second human hand.

[0060] S06: The image display SOC adjusts and controls the display based on the combined gestures of the first and second human hands detected by the millimeter-wave radar, combined with the touch ratio.

[0061] By applying the method of this application, the touch ratio can be adjusted according to the actual location and air touch can be achieved, thereby greatly improving the flexibility of device control. At the same time, the solution can be improved and upgraded on existing displays, providing richer functional upgrade options for existing displays, and the cost is also low.

[0062] The benefits of air-touch technology include: 1. Writing text during video conferences while seated on the sofa, allowing for document sharing and explanation; 2. Controlling yoga remotely via millimeter waves without needing to search for a remote. It also allows for recording and comparing movements for accuracy, whereas previous camera-based recordings involved privacy concerns; 3. It enables zooming in and out of images from a distance, among other special applications, demonstrating a very broad range of potential uses.

[0063] The monitor in this solution can be a television or any other existing display device; there are no restrictions. The following explanation uses a television as an example:

[0064] like Figure 2 The millimeter-wave detection range is shown in the schematic diagram:

[0065] In the diagram, points A to J represent the length of the television set, E is the installation location of the millimeter-wave radar, F and I are inactive areas, G and H are active touch areas, and line C is the proportionally scaled touch plane (with the same length as the television set).

[0066] Taking a 65-inch 16:9 television as an example, the television is approximately 144 cm long and 83 cm wide; the industry-standard viewing distance is between 2.5 and 3.5 meters; let's define the television rectangle as A and the millimeter-wave emission angle as 16 degrees. The proportional touch calculation method from E to C is as follows:

[0067] Cone parameters: Taking the center point of rectangle A to J as the vertex (position E), with a semi-vertex angle of 16° and a height of h, the radius of the cross-section circle r = h·tan16° ≈ h·0.2867

[0068] Diagonal constraint of a rectangle: The diagonal of the television rectangle A is:

[0069]

[0070] The diagonal must be less than or equal to the diameter of the circle, 2r, that is:

[0071] 2·0.2867h≥166.21

[0072] Solve for the height h:

[0073] The recommended viewing distance is between 2.5 meters and 3.5 meters, which is in line with the industry standard. If the calculated viewing distance does not conform to the industry standard, the angle of the semi-apex angle can be changed to meet the requirement.

[0074] in:

[0075] When a TV SOC receives external image input, the signal is not limited to HDMI and Type-C, but can also be AHD, AV, YpbPr, CVBS, etc. It completes image scaling and OSD processing, and outputs LVDS, EDP, VBO, and other signals to the display module. When the TV SOC is connected to an external input, it also needs to connect a USB signal to the signal source for touch data interaction.

[0076] A TV's SOC can also operate without receiving external signal input, because it is an IC with its own system and can generate its own picture, similar to a mobile phone.

[0077] The button module handles functions such as power on / off, volume adjustment, brightness adjustment, and OSD option selection; the button module also has an infrared receiver, so these functions can also be handled via remote control.

[0078] The WIFI module provides the SOC with network connectivity.

[0079] The TV SOC and millimeter-wave module establish data delivery through interfaces such as SPI or URAT.

[0080] Implementation process:

[0081] When the TV's SOC is connected to an external input, the USB signal also needs to be connected to the signal source for touch data interaction.

[0082] After the millimeter-wave radar detects the presence of a hand, it informs the TV's SOC, thus activating the air touch function and displaying OSD prompts on the screen (e.g., ...). Figure 4 (The air touch function is enabled.)

[0083] When a human body is within the detection range (GH zone), extending their palm and holding it for a preset time (this time can be selected in the TV's SOC menu (2S, 3S, 5S, etc., with no specific limit, or customized according to user preference) activates the air touch function after the palm has remained in the GH zone for the preset time. Simultaneously, the TV's SOC displays the first OSD (plus sign), such as... Figure 4 As shown. This (plus sign) style can be selected by the user. The style is preset in the TV SOC's OSD program and can be selected through button operation.

[0084] The television SOC then uses the distance measured by the millimeter-wave radar, and simultaneously displays a second OSD (current distance in XX cm) on the television SOC. For example... Figure 4As shown, the current touch ratio is also calculated. Assuming that the current distance of the palm is at the position 289.8 cm away from the millimeter-wave radar (calculated according to the above formula), the proportional touch positions of a 60-inch TV should be calculated as 266.3 cm according to the above formula, and the proportional touch position of a 55-inch TV is at 243.5 cm. When we take integers, the position for a 65-inch TV is 290 cm, for a 60-inch TV is 266 cm, and for a 55-inch TV is 244 cm. As Figure 3 shown.

[0085] Taking a 65-inch TV as an example, at the position of 290 cm, it is a 1:1 touch. Assuming that the palm appears at the position of 244 cm, we will see that due to the angle of the millimeter-wave emission waveform, if the touch ratio of the 65-inch TV is still used, part of the screen will not be touched. Therefore, the touch ratio needs to be reduced. So it is set that: x≥290CM is defined as a 1:1 ratio, 266 < x < 290, then it is reduced according to the 60-inch ratio, and 244 < x < 266, then it is reduced according to the 55-inch ratio, and so on.

[0086] The proportional relationships of 65-inch, 60-inch, and 55-inch are as follows:

[0087] For the comparison between 65-inch and 60-inch, let the ratio be x1;

[0088] x1 = 65 / 60 = 13 / 12 ≈ 1.0833

[0089] For the comparison between 65-inch and 55-inch, let the ratio be x2;

[0090] x2 = 65 / 55 = 13 / 11 ≈ 1.1818

[0091] After calculating the current touch ratio according to the above formula, the TV SOC calculates the ratio between the touch size and the actual display screen size, and then obtains the click coordinates and click events, and notifies the signal source to process the operation through the USB channel to change the display screen;

[0092] At this time, assuming the position is at 290 CM, the touch ratio is in the 1:1 mode. Then, when another finger of the user appears in different areas and is recognized by the millimeter-wave radar, it notifies the TV SOC to display the third OSD on the screen, similar to the display of a mouse. At the same time, the OSD shows the distance between the finger and the display screen, as Figure 4 shown (cursor 1 is XX CM away), then the corresponding content on the screen can be clicked and fed back to the signal source through the USB channel for touch reverse control. The specific implementation method is: when the finger moves to the position to be clicked (the cursor on the TV OSC screen follows the finger movement because the millimeter-wave reports the position to the TV SOC in real time), the finger advances a preset value, and a click event occurs.

[0093] For example, if your finger is currently positioned at 290cm and you want to click a location, then moving your finger forward by more than 5cm will confirm a click event. In other words, 290 - (≥5)cm. If a long press is required, the finger will remain at the 290 - (≥5)cm position for a preset duration.

[0094] Therefore, with air touch enabled, the operator can use one finger on each hand for multi-touch. When two fingers are detected by the millimeter-wave radar, the TV's SOC is notified to display the fourth OSD on the screen, resulting in two cursors (e.g., ...). Figure 4 The distance between the two cursors is shown as XX cm. The "plus sign" disappears, and the two cursors can then reference each other. The two-hand zoom-in / zoom-out method is handled as follows: Two fingers reach the selected position (both cursors will also reach that position), and both hands move forward 290° (≥5 cm) to bring the two cursors closer together or separate them, thus zooming in or out of the image. All click events are detected by millimeter-wave sensors, the position and distance are determined by the SOC, and then transmitted to the signal source via USB.

[0095] If two or more hands appear in regions G and H, the principle of proximity will be applied, meaning that the hand closest to the TV will be used as the primary identifier, and the other hand will be discarded by the TV SOC.

[0096] Air touch will disappear after a preset time of inactivity (the time can be set by the operator). For example, if there is no operation for 5 seconds, this function and its associated OSD will be turned off. Alternatively, a hand gesture, such as a hand grasping gesture, can be set to turn off this function.

[0097] When the palm appears in area F, the OSD will indicate that the distance is too close; when the palm appears in area I, the OSD will indicate that the distance is too far.

[0098] When cursor 1 or 2 overlaps with other OSDs, the TV SOC will reposition the other OSDs to prevent them from obstructing the clickable area of ​​cursor 1 or 2. Figure 4 The coordinates shown are all generated by the TV's SOC, so all OSD coordinates are known to avoid OSD overlap.

[0099] To better apply this solution, a laser-assisted device can also be installed. A top-down view of the coverage area of ​​the laser-assisted device is shown below. Figure 5 As shown: A laser-assisted range will be installed at the position of the cone-shaped waveform emitted by the millimeter-wave radar to facilitate user reference to the waveform position. The laser can be turned on and off via a button, meaning that users can use this laser to know the millimeter-wave detection range and thus know whether the detection range or touch boundary has been exceeded, which can bring convenience to debugging, testing and user applications.

[0100] Example 2

[0101] A millimeter-wave-based air-touch display device, according to the aforementioned millimeter-wave-based air-touch display control method, such as... Figure 6 As shown, the device includes an image display SOC, a display module, a millimeter-wave module, and an external signal source;

[0102] Set the millimeter-wave radar on the display, with the detection direction of the millimeter-wave radar facing the front of the display, and define the effective touch area within the coverage area of ​​the millimeter-wave radar.

[0103] When the millimeter-wave radar detects a first human hand that meets the first set condition within the effective touch area, it starts the hand dwell timer. If the dwell time of the first human hand exceeds the set time, it proceeds to the next step; otherwise, it does not take any action.

[0104] When the air touch function is enabled, the SOC image display shows the first OSD, which is used to indicate whether the air touch function is enabled.

[0105] The image shows the distance value from the first human hand to the millimeter-wave radar measured by the SOC. At the same time, the image shows the SOC displaying a second OSD, which is used to identify the distance value. The image shows the SOC determining the current touch ratio based on the display size and the distance value.

[0106] The millimeter-wave radar activates the detection of the second human hand, and when a second human hand that meets the first set conditions is detected, the image display SOC displays the third OSD, which is used to identify the position of the second human hand.

[0107] The image shows that the SOC processes the combined gestures of the first and second human hands detected by the millimeter-wave radar into touch coordinates and click events, which are then sent to an external signal source for display adjustment and control.

[0108] The device using this application can adjust the touch ratio according to the actual location and achieve air touch, thereby greatly improving the flexibility of device control. At the same time, the solution can be improved and upgraded on existing displays, providing richer functional upgrade options for existing displays, and the cost is also low.

[0109] Example 3

[0110] This embodiment is basically the same as the previous embodiment, and the similarities will not be repeated. The difference is that the device includes an image display SOC, a display module, and a millimeter-wave module.

[0111] The millimeter-wave radar is mounted on the display, with its detection direction facing the front of the display. An effective touch area is defined within the coverage area of ​​the millimeter-wave radar.

[0112] When the millimeter-wave radar detects a first human hand that meets the first set condition within the effective touch area, it starts the hand dwell timer. If the dwell time of the first human hand exceeds the set time, it proceeds to the next step; otherwise, it does not take any action.

[0113] When the air touch function is enabled, the SOC image display shows the first OSD, which is used to indicate whether the air touch function is enabled.

[0114] The image shows the distance value from the first human hand to the millimeter-wave radar measured by the SOC. At the same time, the image shows the SOC displaying a second OSD, which is used to identify the distance value. The image shows the SOC determining the current touch ratio based on the display size and the distance value.

[0115] The millimeter-wave radar activates the detection of the second human hand, and when a second human hand that meets the first set conditions is detected, the image display SOC displays the third OSD, which is used to identify the position of the second human hand.

[0116] The image shows that the SOC adjusts and controls the display based on the combined gestures of the first and second human hands detected by the millimeter-wave radar, combined with the touch ratio.

[0117] In other words, the image display SOC does not use external input; the image is generated internally by the image chip. Therefore, the corresponding display adjustment and control are also performed internally, without needing to interact with the outside world.

[0118] It should be understood that those skilled in the art can make improvements or modifications based on the above description, and all such improvements and modifications should fall within the protection scope of the appended claims.

Claims

1. A method for controlling a millimeter-wave-based hovering touch display, the method comprising: Includes the following steps: Set the millimeter-wave radar on the display, with the detection direction of the millimeter-wave radar facing the front of the display, and define the effective touch area within the coverage area of ​​the millimeter-wave radar. When the millimeter-wave radar detects a first human hand that meets the first set condition within the effective touch area, it starts the hand dwell timer. If the dwell time of the first human hand exceeds the set time, it proceeds to the next step; otherwise, it does not take any action. When the air touch function is enabled, the SOC image display shows the first OSD, which is used to indicate whether the air touch function is enabled. The image shows the distance value from the first human hand to the millimeter-wave radar measured by the SOC. At the same time, the image shows the SOC displaying a second OSD, which is used to identify the distance value. The image shows the SOC determining the current touch ratio based on the display size and the distance value. The millimeter-wave radar activates the detection of the second human hand, and when a second human hand that meets the first set conditions is detected, the image display SOC displays the third OSD, which is used to identify the position of the second human hand. The image shows that the SOC adjusts and controls the display based on the combined gestures of the first and second human hands detected by the millimeter-wave radar, combined with the touch ratio.

2. The air-touch display control method based on millimeter waves according to claim 1, characterized in that, The step of placing the millimeter-wave radar on the display, with the detection direction of the millimeter-wave radar facing the front of the display, and defining an effective touch area within the coverage area of ​​the millimeter-wave radar includes: The millimeter-wave radar is centered at the top or bottom of the display, with its detection direction facing directly in front of the display. The effective touch area of ​​the cone-shaped coverage area is determined based on the user's actual observation distance range.

3. The air-touch display control method based on millimeter waves according to claim 2, characterized in that, The image display SOC determines the current touch ratio based on the display size and distance value, including: Multiple display sizes are set from smallest to largest, and corresponding h values ​​are calculated. These h values ​​form multiple sub-intervals that define the effective touch area. The calculation formula is as follows: r = h·tanΘ; 2·r＝L3； Where Θ is the transmission angle of the millimeter-wave radar; L1 and L2 are the length and width values ​​of the display, L3 is the length of the diagonal of the display; and h is the straight-line distance from the touch plane to the millimeter-wave radar. Get the sub-interval where the distance value is located, get the smaller endpoint h value of the sub-interval, and get the set display size corresponding to the smaller endpoint h value; Touch ratio x = Actual display size / Set display size.

4. The air-touch display control method based on millimeter waves according to claim 1, characterized in that, After the millimeter-wave radar detects a human hand, it performs gesture detection. If the gesture is in the shape of a palm, it is identified as the first human hand, and the plane on which the palm of the first human hand is located is the virtual touch control surface. When the millimeter-wave radar activates the detection of the second human hand, if it detects a human hand, it performs gesture detection. If the gesture is in the shape of fingers, it is identified as the second human hand.

5. The air-touch display control method based on millimeter waves according to claim 4, characterized in that, When the millimeter-wave radar detects multiple human hands, it performs gesture detection on all of them. If only one gesture is a palm, the human hand corresponding to the palm is identified as the first human hand. If multiple gestures are palms, the human hand corresponding to the palm that is closest to the other hand is identified as the first human hand. If no gesture is a palm, no action is taken.

6. The air-touch display control method based on millimeter waves according to claim 4, characterized in that, After the air touch function is enabled, if the gesture of the first human hand changes to a finger pattern, the first human hand and the second human hand can cooperate to perform multi-touch operations; after the preset time without operation is reached or after the millimeter-wave radar detects the set gesture of the first human hand and / or the second human hand, the air touch function is disabled.

7. The air-touch display control method based on millimeter waves according to claim 1, characterized in that, The signal source of the image display SOC is externally input. When the image display SOC performs display adjustment control, it processes the combined gestures of the first and second human hands detected by the millimeter-wave radar into touch coordinates and click events and sends them to the external signal source for display adjustment.

8. The air-touch display control method based on millimeter waves according to claim 1, characterized in that, The signal of the image display SOC is generated by itself, and the image display SOC adjusts itself when performing display adjustment control.

9. A millimeter-wave-based air-touch display device, comprising the millimeter-wave-based air-touch display control method according to any one of claims 1-7, characterized in that, The device includes an image display SOC, a display module, a millimeter-wave module, and an external signal source; The millimeter-wave radar is placed on the display, with the detection direction of the millimeter-wave radar facing the front of the display, and an effective touch area is set in the coverage area of ​​the millimeter-wave radar. When the millimeter-wave radar detects a first human hand that meets the first set condition within the effective touch area, it starts the hand dwell timer. If the dwell time of the first human hand exceeds the set time, it proceeds to the next step; otherwise, it does not take any action. When the air touch function is enabled, the image display SOC displays the first OSD, which is used to indicate whether the air touch function is enabled. The image shows the distance value from the first human hand to the millimeter-wave radar measured by the millimeter-wave radar received by the SOC. At the same time, the image shows the SOC displaying a second OSD, which is used to identify the distance value. The image shows the SOC determining the current touch ratio based on the display size and the distance value. The millimeter-wave radar activates the detection of the second human hand, and when a second human hand that meets the first set conditions is detected, the image display SOC displays the third OSD, which is used to identify the position of the second human hand. The image shows that the SOC sends the combined gestures of the first and second human hands detected by the millimeter-wave radar, as well as the touch ratio, to an external signal source, which then controls the display.

10. A millimeter-wave-based air-touch display device, comprising the millimeter-wave-based air-touch display control method according to any one of claims 1-6, 8, characterized in that, The device includes an image display SOC, a display module, and a millimeter-wave module; The millimeter-wave radar is mounted on the display, with its detection direction facing the front of the display. An effective touch area is defined within the coverage area of ​​the millimeter-wave radar. When the millimeter-wave radar detects a first human hand that meets the first set condition within the effective touch area, it starts the hand dwell timer. If the dwell time of the first human hand exceeds the set time, it proceeds to the next step; otherwise, it does not take any action. When the air touch function is enabled, the SOC image display shows the first OSD, which is used to indicate whether the air touch function is enabled. The image shows the distance value from the first human hand to the millimeter-wave radar measured by the SOC. At the same time, the image shows the SOC displaying a second OSD, which is used to identify the distance value. The image shows the SOC determining the current touch ratio based on the display size and the distance value. The millimeter-wave radar activates the detection of the second human hand, and when a second human hand that meets the first set conditions is detected, the image display SOC displays the third OSD, which is used to identify the position of the second human hand. The image shows that the SOC adjusts and controls the display based on the combined gestures of the first and second human hands detected by the millimeter-wave radar, combined with the touch ratio.

Images