An automobile device, a gesture recognition method thereof and a computer readable storage medium

Abstract

The present disclosure discloses a car device and a gesture recognition method thereof and a computer readable storage medium, and relates to the field of cars.The car device comprises a microwave radar module and a central processing unit;wherein: the microwave radar module is configured to receive a trigger signal to trigger a microwave signal; and the car device is configured to, when receiving a microwave reflection signal returned after a user gesture is blocked within a preset distance, identify a current user gesture signal in the microwave reflection signal, and execute a control instruction corresponding to the gesture signal according to the gesture signal.Thus, when operating the car device, the user can use a gesture to operate nearby, without needing to touch a display touch screen, thereby improving driving safety and enhancing user experience.

Description

Technical Field

[0001] This disclosure relates to the field of automotive technology, and in particular to an automotive device and its gesture recognition method, automotive equipment, and computer-readable storage medium. Background Technology

[0002] With the gradual electrification and intelligentization of automobiles, more and more cars are equipped with central control screens to realize in-car map navigation, audio and video multimedia, and wireless connectivity functions; the demand for the convenience and practicality of car device interaction is getting higher and higher.

[0003] Traditional human-computer interaction solutions for central control screens mainly consist of touch screens and voice recognition control. For touch screen interaction, due to safety considerations, it is difficult for users to operate the central control screen while driving, as their line of sight and hands are limited. Voice interaction control is affected by external noise such as open windows, tire noise, and wind noise while driving, which directly affects the accuracy of voice recognition and thus the user experience.

[0004] Therefore, a new automotive device interaction scheme is needed to meet the requirements of driving safety. Summary of the Invention

[0005] The present disclosure aims to provide an automotive device and its gesture recognition method, automotive equipment, and computer-readable storage medium, in order to solve the problem that existing automotive devices require touch operation on a display touchscreen, which cannot meet the needs of driving safety.

[0006] To address the aforementioned technical problems, the first aspect of this disclosure provides the following technical solution: an automotive device, the automotive device comprising: a microwave radar module and a central processing unit; wherein:

[0007] The microwave radar module is used to receive a trigger signal to trigger the transmission of microwave signals;

[0008] When the vehicle device receives a microwave reflection signal that is blocked by a user's gesture within a preset distance, it identifies the current user's gesture signal in the microwave reflection signal and executes the control command corresponding to the gesture signal.

[0009] Optionally, performing the function corresponding to the gesture signal based on the gesture signal includes:

[0010] The gesture signal is converted into a corresponding control character according to a preset method;

[0011] Execute the corresponding control command based on the control character.

[0012] Optionally, the microwave radar module includes a microwave radar chip and a microwave radar antenna; wherein:

[0013] The microwave radar chip is used to receive a trigger signal to trigger the transmission of a microwave signal;

[0014] The microwave radar antenna is used to transmit microwave signals emitted by the microwave radar chip to the outside world, and to receive microwave reflected signals that are blocked by the user's gesture within a preset distance.

[0015] Optionally, the vehicle device further includes at least one microwave receiving module, which is used to receive microwave reflected signals that are blocked by the user's gesture within a preset distance.

[0016] Optionally, the microwave radar chip identifies the current user's gesture signal in the microwave reflected signal received by the microwave radar antenna and the microwave receiving module, converts the gesture signal into control characters according to a preset method, and transmits the control characters to the central processing unit; or,

[0017] The central processing unit identifies the current user's gesture signal in the microwave reflected signal received by the microwave radar antenna and the microwave receiving module, and converts the gesture signal into control characters according to a preset method.

[0018] Optionally, the central processing unit is further configured to execute control instructions corresponding to the control character based on the control character.

[0019] Optionally, the preset mode includes one of the following: palm gesture mode, fist gesture mode, scissor gesture mode, OK gesture mode, and a corresponding conversion relationship between the preset mode and the control character is set;

[0020] The control commands include one of the following: screen display, closing the sunroof, playing music, and setting the correspondence between control commands and control characters.

[0021] Optionally, the central processing unit is used to send a trigger signal to the microwave radar module to control the triggering of the microwave radar module.

[0022] Optionally, the vehicle device further includes an external function interface for the central processing unit to read data from the steering wheel hand detection sensor through the external function interface, and to coordinate the control commands with external vehicle devices through the external function interface.

[0023] Optionally, the vehicle device further includes a display touchscreen for providing an interactive interface and displaying vehicle-related information according to the control commands.

[0024] To address the aforementioned technical problems, a second aspect of this disclosure provides the following technical solution: a gesture recognition method, applied in the automotive device provided in the first aspect of this disclosure, the gesture recognition method comprising:

[0025] Trigger the transmission of microwave signals;

[0026] Receive microwave reflected signals that are blocked by the user's gesture within a preset distance;

[0027] The current user's gesture signal is identified in the microwave reflected signal;

[0028] Based on the gesture signal, execute the control command corresponding to the gesture signal.

[0029] Optionally, performing the function corresponding to the gesture signal based on the gesture signal includes:

[0030] The gesture signal is converted into a corresponding control character according to a preset method;

[0031] Execute the corresponding control command based on the control character.

[0032] To solve the above-mentioned technical problems, the third aspect of the present disclosure provides the following technical solution: a computer-readable storage medium, characterized in that the computer-readable storage medium stores a program of a gesture recognition method, and when the program of the gesture recognition method is executed by a processor, it implements the steps of the gesture recognition method provided in the second aspect of the present disclosure.

[0033] Compared with the prior art, the present disclosure provides an automotive device and its gesture recognition method, as well as a computer-readable storage medium. The automotive device includes a microwave radar module and a central processing unit. The microwave radar module is used to receive a trigger signal to trigger the transmission of a microwave signal. When the automotive device receives a microwave reflection signal that is blocked by a user's gesture within a preset distance, it identifies the current user's gesture signal in the microwave reflection signal and executes a control command corresponding to the gesture signal based on the gesture signal. This allows the microwave radar module to emit microwave signals based on a trigger signal, enabling the vehicle's gesture detection. The wide detection range of microwave radar gesture recognition easily covers the entire area of ​​the car's driver's seat, allowing users to operate the vehicle's devices using gestures without needing to touch the display screen. This does not affect driving safety and improves driving safety, meeting the interactive needs of the vehicle and enhancing the user experience. Furthermore, microwave radar gesture recognition is insensitive to common automotive interference factors such as sound and light; changes in noise or light intensity do not affect the gesture recognition effect, resulting in strong gesture recognition performance. In addition, by installing the microwave radar module inside the car's interior, the penetrating nature of microwaves does not affect the car's exterior design, ensuring the vehicle's aesthetic appeal. Attached Figure Description

[0034] One or more embodiments are illustrated by way of example with reference numerals in the accompanying drawings. These illustrations do not constitute a limitation on the embodiments. Elements with the same reference numerals in the drawings are denoted as similar elements. Unless otherwise stated, the figures in the drawings are not to be limited by scale.

[0035] Figure 1 This is a structural schematic diagram of an automotive device provided in this disclosure;

[0036] Figure 2 This is a first detailed structural schematic diagram of an automotive device provided in this disclosure;

[0037] Figure 3 This is a second specific structural schematic diagram of an automotive device provided in this disclosure;

[0038] Figure 4 This is a third specific structural schematic diagram of an automotive device provided in this disclosure;

[0039] Figure 5 This is a schematic diagram of the operation of a microwave radar module and a microwave receiving module in an automotive device provided in this disclosure.

[0040] Figure 6 This is a flowchart illustrating a gesture recognition method provided in this disclosure;

[0041] Figure 7 This is a structural schematic diagram of an automotive device provided in this disclosure. Detailed Implementation

[0042] To facilitate understanding of this disclosure, a more detailed description is provided below with reference to the accompanying drawings and specific embodiments. It should be noted that when an element is described as being "fixed to" another element, it can be directly on the other element, or one or more intermediate elements may exist between them. When an element is described as being "connected" to another element, it can be directly connected to the other element, or one or more intermediate elements may exist between them. The terms "upper," "lower," "inner," "outer," "bottom," etc., used in this specification indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, and are only for the convenience of describing this disclosure and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this disclosure. Furthermore, the terms "first," "second," "third," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0043] Unless otherwise defined, all technical and scientific terms used in this specification have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. The terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the scope of this disclosure. The term "and / or" as used in this specification includes any and all combinations of one or more of the associated listed items.

[0044] Furthermore, the technical features involved in the different embodiments of this disclosure described below can be combined with each other as long as they do not conflict with each other.

[0045] In one embodiment, such as Figure 1 As shown, this disclosure provides an automotive device, the automotive device comprising: a microwave radar module 1 and a central processing unit 2; wherein:

[0046] The microwave radar module 1 is used to receive a trigger signal to trigger the transmission of a microwave signal;

[0047] When the vehicle device receives a microwave reflection signal that is blocked by a user's gesture within a preset distance, it identifies the current user's gesture signal in the microwave reflection signal and executes the control command corresponding to the gesture signal.

[0048] In this embodiment, the automotive device includes a microwave radar module and a central processing unit. The microwave radar module receives a trigger signal to trigger the transmission of a microwave signal. When the automotive device receives a microwave reflection signal returned after being obscured by a user's gesture within a preset distance, it identifies the current user's gesture signal in the reflected microwave signal and executes a control command corresponding to the gesture signal. This allows the microwave radar module to trigger the transmission of a microwave signal based on the trigger signal, enabling the automotive device to detect gestures. The wide detection range of microwave radar gesture recognition easily covers the entire area of ​​the car's user seat, allowing users to operate the device using gestures nearby without needing to touch the display screen, thus improving driving safety and meeting the interactive needs of the automotive device, enhancing the user experience. Furthermore, microwave radar gesture recognition is insensitive to common automotive interference factors such as sound and light; changes in noise or light intensity do not affect the gesture recognition effect, resulting in strong gesture recognition performance. In addition, by installing the microwave radar module inside the car's driver's compartment, the penetrating nature of microwaves does not affect the car's exterior design, ensuring the car's aesthetic appeal.

[0049] In one embodiment, performing the function corresponding to the gesture signal includes:

[0050] The gesture signal is converted into a corresponding control character according to a preset method;

[0051] Execute the corresponding control command based on the control character.

[0052] In one embodiment, the vehicle device further includes at least one receiving unit and a processing unit, wherein the receiving unit is configured to receive microwave reflection signals that are obscured by a user's gesture within a preset distance and send the microwave reflection signals to the processing unit;

[0053] The processing unit is configured to identify the current user's gesture signal in the microwave reflection signal, convert the gesture signal into a control character according to a preset method, and execute the control command corresponding to the control character.

[0054] In this embodiment, the automotive device includes, but is not limited to, a central control screen for automobiles and automotive equipment containing a microcontroller unit (MCU) and a central control screen.

[0055] In one embodiment, such as Figures 1 to 4 As shown, the central processing unit 2 is located inside the vehicle device, for example, mounted on the motherboard of the vehicle device.

[0056] In one embodiment, such as Figures 2 to 4 As shown, the microwave radar module 1 includes a microwave radar chip 11 and a microwave radar antenna 12; wherein:

[0057] The microwave radar chip 11 is installed inside the vehicle device (e.g., on the motherboard of the vehicle device) and is electrically connected to the microwave radar antenna 12; the microwave radar chip 11 is used to receive a trigger signal to trigger the transmission of a microwave signal, which is then transmitted externally through the microwave radar antenna 12.

[0058] The microwave radar antenna 12 is installed inside the vehicle device and electrically connected to the microwave radar chip 12. The microwave radar antenna 12 is used to transmit the microwave signal emitted by the microwave radar chip 11 and to receive microwave reflected signals that are blocked by a user's gesture within a preset distance. In this case, the microwave radar antenna 12 is one of the receiving units of the aforementioned vehicle device. The preset distance is the reflection distance between the microwave radar antenna 12 and the side wall inside the vehicle's driver's compartment.

[0059] In one embodiment, such as Figures 2 to 4 As shown, the automotive device also includes at least one microwave receiving module 3. Figure 4 Taking a microwave receiving module 3 as an example, the microwave receiving module 3 is installed in the car's driver's cab, separated from the microwave radar antenna 12 of the microwave radar module 1. The microwave receiving module 3 is used to receive microwave reflected signals that are blocked by the user's gesture within a preset distance. At this time, the microwave receiving module 3 is one or more of the receiving units of the aforementioned automotive device. It can also be understood that any device in the car that can receive microwave radar signals can act as a microwave receiving module and transmit the signals to the central processing unit 2 and / or the microwave radar chip 11.

[0060] When the vehicle device further includes two or more microwave receiving modules 3, the microwave receiving modules 3 are arranged separately in the vehicle's driver's cab according to the principle of equal distance, so as to receive microwave reflected signals that are blocked by the user's gesture within a preset distance.

[0061] Specifically, such as Figure 5 The diagram shown is a schematic representation of the operation of the microwave radar module 1 and the microwave receiving module 3.

[0062] exist Figure 5 The microwave radar chip 11 emits microwave signals, which are then transmitted externally via the microwave radar antenna 12 (e.g., ...). Figure 5 (As indicated by the black arrow in the image).

[0063] exist Figure 5In scenario A: the microwave radar antenna 12 transmits microwave signals (such as...) Figure 5 (As shown by the black arrow in the image) If the user does not make any gesture, there is almost no reflection, no microwave reflection signal, and the microwave radar antenna 12 and the microwave receiving module 3 cannot receive the microwave reflection signal returned after being blocked by the user's gesture.

[0064] exist Figure 5 In scenario B: the microwave radar antenna 12 transmits microwave signals (such as...) Figure 5 After the black arrow in the image shows the microwave signal being blocked by the user's hand gesture (e.g., as indicated by the black arrow), Figure 5 As shown in the black circle of B in the image, the occluded area will reflect back a microwave reflection signal corresponding to the user's gesture occlusion (e.g., ...). Figure 5 As indicated by the dashed arrow in B), the microwave radar antenna 12 and / or the microwave receiving module 3 will receive the microwave reflected signal, and the microwave radar antenna 12 and / or the microwave receiving module 3 will transmit the received microwave reflected signal to the microwave radar chip 11 and / or the central processing unit 2.

[0065] In this embodiment, since the microwave radar chip 11 can emit microwave signals at multiple frequencies, such as 5.8GHz or 24GHz, via the microwave radar antenna 12, the microwave radar gesture recognition has a wide detection range, easily covering the entire area inside the car's driver's compartment. By separately configuring the microwave radar antenna 12 and at least one microwave receiving module 3 within the car's driver's compartment, the microwave radar antenna 12 and the microwave receiving module 3 respectively receive microwave reflection signals that are obscured by the user's gesture within a preset distance. This achieves a system where the microwave radar antenna 12 primarily receives the microwave reflection signals, while the microwave receiving module 3 secondarily receives them. The microwave reflection signals received by both complement each other, thus accurately and without omission receiving microwave reflection signals that are obscured by the user's gesture within a preset distance, improving recognition accuracy. Furthermore, microwave signals are insensitive to common interference factors in automobiles, such as sound and light. Changes in noise or light intensity do not affect the gesture recognition performance of the microwave radar chip, resulting in strong anti-interference capabilities and a high-performance gesture recognition effect.

[0066] In one embodiment, such as Figure 2 As shown, the microwave radar chip 11 is electrically connected to the microwave receiving module 3 and the central processing unit 2, respectively.

[0067] The microwave radar antenna 12 and the microwave receiving module 3 both transmit the received microwave reflected signals to the microwave radar chip 11.

[0068] The microwave radar chip 11 is used to identify the current user's gesture signal in the microwave reflected signal transmitted by the microwave radar antenna 12 and the microwave receiving module 3, convert the gesture signal into control characters according to a preset method, and transmit the control characters to the central processing unit 2 through a preset transmission path. At this time, the function processed by the microwave radar chip 11 is part of the processing function of the processing unit of the aforementioned automotive device. Preferably, the preset transmission path is a serial bus.

[0069] In this embodiment, the microwave radar chip 11 receives the microwave reflected signals transmitted by the microwave radar antenna 12 and the microwave receiving module 3, respectively. It integrates and analyzes the received microwave reflected signals to form a complete microwave reflected signal. From this complete microwave reflected signal, it identifies the current user's gesture signal and converts it into control characters according to a preset method. Therefore, by utilizing the processing power of the microwave radar chip 11 to process the microwave reflected signals, the processing and computational burden on the central processing unit can be reduced, increasing the stability of the vehicle device.

[0070] In one embodiment, such as Figure 3 As shown, the microwave radar chip 11 is electrically connected to the central processing unit 2, the microwave receiving module 3 is electrically connected to the central processing unit 2, and the microwave radar antenna 12 is electrically connected to the central processing unit 2.

[0071] The microwave radar antenna 12 and the microwave receiving module 3 both transmit the received microwave reflected signals to the central processing unit 2.

[0072] The central processing unit 2 is used to identify the current user's gesture signal in the microwave reflected signal transmitted by the microwave radar antenna 12 and the microwave receiving module 3, and convert the gesture signal into control characters according to a preset method. In this case, the central processing unit 2 is the processing unit of the aforementioned automotive device.

[0073] In this embodiment, the central processing unit 2 receives the microwave reflected signals transmitted by the microwave radar antenna 12 and the microwave receiving module 3, integrates and analyzes the received microwave reflected signals to form a complete microwave reflected signal, identifies the current user's gesture signal from the complete microwave reflected signal, and converts the gesture signal into control characters according to a preset method. Thus, the processing power of the central processing unit is used to process the microwave reflected signals, eliminating the need for additional computing equipment and reducing unnecessary hardware costs.

[0074] In one embodiment, such as Figure 4As shown, the microwave radar chip 11 is electrically connected to the central processing unit 2, and the microwave receiving module 3 is electrically connected to the central processing unit 2.

[0075] The microwave radar antenna 12 receives the microwave reflected signal and transmits it to the microwave radar chip 11; the microwave receiving module 3 receives the microwave reflected signal and transmits it to the central processing unit 2.

[0076] The microwave radar chip 11 is used to identify the current user's gesture signal in the microwave reflected signal transmitted by the microwave radar antenna 12, convert the gesture signal into a first control character according to a preset method, and transmit the first control character to the central processing unit 2 through a preset transmission path. At this time, the functions processed by the microwave radar chip 11 are part of the functions processed by the processing unit of the aforementioned automotive device.

[0077] The central processing unit 2 is used to identify the current user's gesture signal in the microwave reflected signal transmitted by the microwave receiving module 3, and convert the gesture signal into a second control character according to a preset method. In this case, the central processing unit 2 is the processing unit of the aforementioned automotive device.

[0078] The central processing unit 2 determines whether the first control character and the second control character are the same. If they are the same, it outputs one of them as the unified control character; if they are not the same, it outputs the first control character as the unified control character.

[0079] In this embodiment, the microwave radar chip 11 receives the microwave reflected signal transmitted by the microwave radar antenna 12, analyzes and processes the received microwave reflected signal, identifies the current user's gesture signal from the microwave reflected signal, converts the gesture signal into a first control character according to a preset method, and transmits the first control character to the central processing unit 2. The central processing unit 2 receives the microwave reflected signal transmitted by the microwave receiving module 3, analyzes and processes the received microwave reflected signal, identifies the current user's gesture signal from the microwave reflected signal, and converts the gesture signal into a second control character according to a preset method. The central processing unit 2 determines whether the first control character and the second control character are the same, and outputs a unified control character based on the determination result. Thus, by utilizing the processing power of the microwave radar chip 11 and working together with the central processing unit 2 to process the microwave reflected signal, the processing and computational burden on the central processing unit can be reduced, and the stability of the vehicle device can be increased.

[0080] Specifically, as an example, the preset methods include, but are not limited to, one of the following gesture modes: palm gesture mode, fist gesture mode, scissor gesture mode, and OK gesture mode, and a corresponding conversion relationship between the preset methods and control characters is set. This is shown in the table below, "Correspondence Conversion Relationship Table between the Preset Methods and Control Characters":

[0081] The correspondence between the preset method and the control character conversion table

[0082] Hand gesture 0X01 fist gesture 0X02 scissor gesture 0X03 OK gesture 0X04

[0083] In one embodiment, the central processing unit 2 is further configured to execute control instructions corresponding to the control character based on the control character.

[0084] Specifically, the central processing unit 2 executes control commands corresponding to the received control characters to control the vehicle's functional operations. These functional operations include operation of the central control screen or actions of external vehicle devices.

[0085] Specifically, as an example, the control commands include, but are not limited to, one of the following: screen display, closing the sunroof, playing music, and setting a correspondence between control commands and control characters. The table below, "Correspondence between Control Commands and Control Characters," illustrates this:

[0086] The correspondence between the preset method and the control character conversion table

[0087]

[0088] In this embodiment, the central processing unit 2 receives microwave reflected signals from the microwave receiving module 3 and the microwave radar antenna 12, identifies the current user's gesture signal, and converts the gesture signal into control characters according to a preset method; or, it controls and reads data from the microwave radar chip 11 through the serial communication interface of the serial bus to obtain control characters; then, it executes control commands corresponding to the control characters to control the vehicle's functions, including central control screen operation or external device actions, so that the user can use gestures to operate the vehicle's devices without having to touch the display touchscreen, thereby achieving coordinated control of other external devices related to the central control screen without affecting driving safety, improving driving safety, meeting the interactive needs of the vehicle's devices, and enhancing the user experience.

[0089] In one embodiment, the central processing unit 2 is used to send a trigger signal to the microwave radar module 1 to control the triggering of the microwave radar module 1; specifically including:

[0090] The central processing unit 2 reads data from the steering wheel hand detection sensor to determine the user's hand status. When it is determined that the user's hand is on the steering wheel, the microwave radar module is in a reference calibration state, which acquires changes in the in-vehicle environment in real time as an environmental reference to correct the working mode and accuracy of the microwave radar module, so as to reduce the malfunction of the microwave radar module caused by environmental changes and improve the inspection accuracy.

[0091] When it is determined that the user's hand has left the steering wheel, a trigger signal is sent to the microwave radar module, which is then controlled in real time to perform gesture detection and periodically acquire the user's hand gestures.

[0092] In this embodiment, by reading data from the steering wheel hand detection sensor inside the vehicle through the central processing unit, the user's hand movements can be identified. The user's hand movements can be predicted in advance, and when a change in the user's hand movements is detected, the microwave radar module is triggered in real time to perform gesture detection. Furthermore, the changes in the in-vehicle environment acquired in real time can be used as an environmental benchmark to correct the working mode and accuracy of the microwave radar module, thereby shielding most of the environmental interference, reducing the false operation of the microwave radar module caused by environmental changes, and improving the accuracy and precision of detection.

[0093] In one embodiment, such as Figures 2 to 4 As shown, the vehicle device also includes an external function interface 8, through which the central processing unit 2 reads data from the steering wheel hand detection sensor and sends control commands from the central processing unit 2 to external vehicle devices for coordinated control.

[0094] The vehicle device also includes a display touchscreen 4 for providing an interactive interface and displaying vehicle-related information according to the control instructions of the central processing unit 2.

[0095] The vehicle device also includes a radio 5, which is used to turn on and play a specified radio channel according to the control instructions of the central processing unit 2.

[0096] The vehicle device also includes a sound output device 6 for outputting sound according to the control instructions of the central processing unit 2.

[0097] In this embodiment, the central processing unit 2 reads data from the steering wheel hand detection sensor through the external functional interface 8, predicts the user's hand movements in advance, and triggers the microwave radar module 1 to perform gesture detection in real time when a change in the user's hand movements is detected. It also identifies the current user's gesture signal based on the microwave reflected signal received from the microwave receiving module 3 and the microwave radar antenna 12, and converts the gesture signal into control characters according to a preset method. Alternatively, it controls and reads data from the microwave radar chip 11 through the serial communication interface of the serial bus to obtain control characters. Then, it executes control commands corresponding to the control characters to control the vehicle's functions, including operations on the central control screen or external devices. This allows the user to operate the vehicle's devices using gestures, eliminating the need for touchscreen operation, thus enabling coordinated control of other external devices related to the central control screen without affecting driving safety. This improves driving safety, meets the interactive needs of the vehicle's devices, and enhances the user experience.

[0098] Based on the same concept, in one embodiment, such as Figure 6 As shown, this disclosure provides a gesture recognition method, applied to an automotive device described in any of the above embodiments; the gesture recognition method includes:

[0099] S1, trigger the transmission of microwave signals;

[0100] S2. Receive microwave reflected signals that are blocked by the user's gesture within a preset distance;

[0101] S3. Identify the current user's gesture signal in the microwave reflected signal;

[0102] S4. Execute the control command corresponding to the gesture signal according to the gesture signal.

[0103] In this embodiment, a microwave signal is triggered and transmitted to receive microwave reflection signals that are obscured by the user's gesture within a preset distance. The user's gesture signal is then identified within the reflected microwave signal. Based on the gesture signal, a control command corresponding to the gesture signal is executed. Thus, the microwave signal is triggered to transmit, enabling the vehicle device to detect gestures. The wide detection range of microwave radar gesture recognition easily covers the entire area of ​​the car's user seat, allowing users to operate the vehicle device using gestures nearby without needing to touch the display screen. This does not affect driving safety and improves driving safety, meeting the interactive needs of the vehicle device and enhancing the user experience. Furthermore, microwave radar gesture recognition is insensitive to common interference factors in automobiles, such as sound and light; changes in noise or light intensity do not affect the gesture recognition effect, resulting in strong gesture recognition performance.

[0104] In one embodiment, step S4, which involves executing the function corresponding to the gesture signal, includes:

[0105] The gesture signal is converted into a corresponding control character according to a preset method;

[0106] Execute the corresponding control command based on the control character.

[0107] In one embodiment, the vehicle device further includes a central processing unit disposed inside the vehicle device, for example, mounted on the motherboard of the vehicle device.

[0108] In one embodiment, the automotive device includes a microwave radar module, which includes a microwave radar chip and a microwave radar antenna. In step S1, triggering the transmission of a microwave signal includes:

[0109] The microwave radar chip receives a trigger signal and triggers the transmission of a microwave signal, which is then transmitted externally through the microwave radar antenna.

[0110] The microwave radar antenna transmits the microwave signals emitted by the microwave radar chip to the outside world.

[0111] In one embodiment, in step S2, receiving the microwave reflected signal that is blocked by the user's gesture within a preset distance includes: the microwave radar antenna receiving the microwave reflected signal that is blocked by the user's gesture within a preset distance.

[0112] In one embodiment, the vehicle device further includes at least one microwave receiving module. In step S2, receiving the microwave reflected signal that has been obstructed by a user's gesture within a preset distance includes: the microwave receiving module receiving the microwave reflected signal that has been obstructed by a user's gesture within the preset distance.

[0113] In one embodiment, in steps S3 and S4, identifying the current user's gesture signal in the microwave reflected signal and converting the gesture signal into corresponding control characters according to a preset method includes:

[0114] The microwave radar antenna and the microwave receiving module both transmit the received microwave reflected signals to the microwave radar chip.

[0115] The microwave radar chip identifies the current user's gesture signal in the microwave reflected signal transmitted by the microwave radar antenna and the microwave receiving module, converts the gesture signal into control characters according to a preset method, and transmits the control characters to the central processing unit through a preset transmission path.

[0116] In one embodiment, in steps S3 and S4, identifying the current user's gesture signal in the microwave reflected signal and converting the gesture signal into corresponding control characters according to a preset method includes:

[0117] The microwave radar antenna and the microwave receiving module both transmit the received microwave reflected signals to the central processing unit.

[0118] The central processing unit identifies the current user's gesture signal in the microwave reflected signal transmitted by the microwave radar antenna and the microwave receiving module, and converts the gesture signal into control characters according to a preset method.

[0119] In one embodiment, in steps S3 and S4, identifying the current user's gesture signal in the microwave reflected signal and converting the gesture signal into corresponding control characters according to a preset method includes:

[0120] The microwave radar antenna receives the microwave reflected signal and transmits it to the microwave radar chip.

[0121] The microwave receiving module transmits the received microwave reflected signal to the central processing unit.

[0122] The microwave radar chip identifies the current user's gesture signal in the microwave reflected signal transmitted by the microwave radar antenna, converts the gesture signal into a first control character according to a preset method, and transmits the first control character to the central processing unit through a preset transmission path.

[0123] The central processing unit identifies the current user's gesture signal in the microwave reflected signal transmitted by the microwave receiving module, and converts the gesture signal into a second control character according to a preset method.

[0124] The central processing unit determines whether the first control character and the second control character are the same. If they are the same, it outputs one of them as the unified control character; if they are not the same, it outputs the first control character as the unified control character.

[0125] Specifically, as an example, the preset methods include, but are not limited to, one of the following gesture modes: palm gesture mode, fist gesture mode, scissor gesture mode, and OK gesture mode, and a corresponding conversion relationship between the preset methods and control characters is set. This is shown in the table below, "Correspondence Conversion Relationship Table between the Preset Methods and Control Characters":

[0126] The correspondence between the preset method and the control character conversion table

[0127] Hand gesture 0X01 fist gesture 0X02 scissor gesture 0X03 OK gesture 0X04

[0128] In one embodiment, step S4, executing the control instruction corresponding to the control character according to the control character, includes: the central processing unit executing the control instruction corresponding to the control character according to the control character.

[0129] Specifically, the central processing unit executes control commands corresponding to the received control characters to control the vehicle's functional operations. These functional operations include operation of the central control screen or actions of external vehicle devices.

[0130] Specifically, as an example, the control commands include, but are not limited to, one of the following: screen display, closing the sunroof, playing music, and setting a correspondence between control commands and control characters. The table below, "Correspondence between Control Commands and Control Characters," illustrates this:

[0131] The correspondence between the preset method and the control character conversion table

[0132] In this embodiment, the central processing unit (CPU) identifies the current user's gesture signal based on the microwave reflected signal received from the microwave receiving module and the microwave radar antenna, and converts the gesture signal into control characters according to a preset method; alternatively, it controls and reads data from the microwave radar chip through the serial communication interface of the serial bus to obtain control characters; then, it executes control commands corresponding to the control characters to control the vehicle's functions, including operations on the central control screen or actions of external devices, allowing the user to operate the vehicle's devices using gestures nearby without needing to touch the display touchscreen. This achieves coordinated control of other external devices related to the central control screen without affecting driving safety, improving driving safety, meeting the interactive needs of the vehicle's devices, and enhancing the user experience.

[0133] In one embodiment, the gesture recognition method includes: the central processing unit sending a trigger signal to the microwave radar module to control the triggering of the microwave radar module; specifically including:

[0134] The central processing unit reads data from the steering wheel hand detection sensor to determine the user's hand status. When it determines that the user's hand is on the steering wheel, the microwave radar module is in a reference calibration state, which acquires changes in the in-vehicle environment in real time as an environmental reference to correct the working mode and accuracy of the microwave radar module, thereby reducing malfunctions of the microwave radar module caused by environmental changes and improving inspection accuracy.

[0135] When it is determined that the user's hand has left the steering wheel, a trigger signal is sent to the microwave radar module, which is then controlled in real time to perform gesture detection and periodically acquire the user's hand gestures.

[0136] In this embodiment, by reading data from the steering wheel hand detection sensor inside the vehicle through the central processing unit, the user's hand movements can be identified. The user's hand movements can be predicted in advance, and when a change in the user's hand movements is detected, the microwave radar module is triggered in real time to perform gesture detection. Furthermore, the changes in the in-vehicle environment acquired in real time can be used as an environmental benchmark to correct the working mode and accuracy of the microwave radar module, thereby shielding most of the environmental interference, reducing the false operation of the microwave radar module caused by environmental changes, and improving the accuracy and precision of detection.

[0137] In one embodiment, the automotive device further includes an external functional interface. The gesture recognition method includes: the central processing unit reading data from the steering wheel hand detection sensor through the external functional interface, and coordinating control commands from the central processing unit with external automotive devices through the external functional interface.

[0138] In this embodiment, the central processing unit reads data from the steering wheel hand detection sensor through the external functional interface, predicts the user's hand movements in advance, and triggers the microwave radar module to perform gesture detection in real time when a change in the user's hand movements is detected. It also identifies the current user's gesture signal based on the microwave reflected signal received from the microwave receiving module and the microwave radar antenna, and converts the gesture signal into control characters according to a preset method. Alternatively, it controls and reads data from the microwave radar chip through the serial communication interface of the serial bus to obtain control characters. Then, it executes control commands corresponding to the control characters to control the vehicle's functions, including operations on the central control screen or external devices. This allows the user to operate the vehicle's devices using gestures, eliminating the need for touchscreen operation, thus enabling coordinated control of other external devices related to the central control screen without affecting driving safety. This improves driving safety, meets the interactive needs of the vehicle's devices, and enhances the user experience.

[0139] It should be noted that the above gesture recognition method embodiment and the automotive device embodiment belong to the same concept. For details of its implementation process, please refer to the automotive device embodiment. Furthermore, the technical features in the automotive device embodiment are all applicable to the gesture recognition method embodiment, and will not be repeated here.

[0140] Furthermore, based on the same concept, a third aspect of this disclosure provides an automotive device, such as... Figure 7As shown, the automotive device 900 includes: a memory 902, a processor 901, and one or more computer programs stored in the memory 902 and executable on the processor 901. The memory 902 and the processor 901 are coupled together via a bus system 903. When the one or more computer programs are executed by the processor 901, they implement the steps of a gesture recognition method provided in the second aspect of the present disclosure.

[0141] The methods disclosed in the above embodiments of this disclosure can be applied to, or implemented by, the processor 901. The processor 901 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by integrated logic circuits in the hardware of the processor 901 or by instructions in software form. The processor 901 may be a general-purpose processor, a DSP, or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The processor 901 can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this disclosure. The general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the methods disclosed in the embodiments of this disclosure can be directly manifested as execution by a hardware decoding processor, or execution by a combination of hardware and software modules in the decoding processor. The software modules may be located in a storage medium, specifically in memory 902. The processor 901 reads information from memory 902 and, in conjunction with its hardware, completes the steps of the aforementioned method.

[0142] It is understood that the memory 902 in this embodiment of the present disclosure may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic random access memory (FRAM), flash memory or other memory technologies, compact disk read-only memory (CD-ROM), digital video disk (DVD) or other optical disc storage, magnetic cartridges, magnetic tapes, disk storage or other magnetic storage devices; the volatile memory can be random access memory (RAM). By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM). Memory), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), SyncLink Dynamic Random Access Memory (SLDRAM), and Direct Rambus Random Access Memory (DRRAM).The memories described in the embodiments of this disclosure are intended to include, but are not limited to, these and any other suitable types of memories.

[0143] It should be noted that the above-described automotive equipment embodiments and method embodiments belong to the same concept. For details of their implementation process, please refer to the method embodiments. Furthermore, the technical features in the method embodiments are all applicable to the automotive equipment embodiments, and will not be repeated here.

[0144] In addition, in an exemplary embodiment, the fourth aspect of this disclosure provides a computer storage medium, specifically a computer-readable storage medium, such as a memory 902 storing a computer program, wherein one or more programs of a gesture recognition method are stored on the computer storage medium, and when the one or more programs of the gesture recognition method are executed by a processor 901, they implement the steps of the gesture recognition method provided in the second aspect of this disclosure.

[0145] It should be noted that the above-mentioned gesture recognition method program embodiment and method embodiment on the computer-readable storage medium belong to the same concept. For details of its specific implementation process, please refer to the method embodiment. Furthermore, the technical features in the method embodiment are all applicable to the above-mentioned computer-readable storage medium embodiment, and will not be repeated here.

[0146] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0147] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this disclosure, and not to limit them; under the concept of this disclosure, the technical features of the above embodiments or different embodiments can also be combined, the steps can be implemented in any order, and there are many other variations of different aspects of this disclosure as described above, which are not provided in detail for the sake of brevity; although this disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this disclosure.

Claims

1. An automotive device, characterized in that, The automotive device includes: a microwave radar module, a central processing unit, and at least one microwave receiving module; the microwave radar module includes a microwave radar chip and a microwave radar antenna; wherein: The central processing unit is used to read data from the steering wheel hand detection sensor to determine the user's hand status; when it determines that the user's hand is on the steering wheel, it controls the microwave radar module to be in a reference calibration state, acquires changes in the in-vehicle environment in real time as an environmental reference, and corrects the working mode of the microwave radar module; when it determines that the user's hand leaves the steering wheel, it sends a trigger signal. The microwave radar chip is used to receive the trigger signal and control the microwave radar antenna to transmit microwave signals. The microwave radar antenna is used to transmit the microwave signal to the outside and receive the first microwave reflected signal that is blocked by the user's gesture within a preset distance, and transmit the first microwave reflected signal to the microwave radar chip. The microwave receiving module is used to receive the second microwave reflection signal that returns after being blocked by the user's gesture within a preset distance, and to transmit the second microwave reflection signal to the central processing unit. The microwave radar chip is also used to identify the current user's gesture signal in the first microwave reflected signal, convert the gesture signal into a first control character according to a preset method, and transmit the first control character to the central processing unit. The central processing unit is also used to identify the current user's gesture signal in the second microwave reflection signal, convert the gesture signal into a second control character according to a preset method; and determine whether the first control character and the second control character are the same. If they are the same, one of them is output as a unified control character. If they are different, the first control character is output as a unified control character. The vehicle device executes control commands corresponding to the unified control characters.

2. The automotive device according to claim 1, characterized in that, The preset modes include one of the following: palm gesture mode, fist gesture mode, scissor gesture mode, and OK gesture mode, and the corresponding conversion relationship between the preset modes and control characters is set; The control commands include one of the following: screen display, closing the sunroof, playing music, and setting the correspondence between control commands and control characters.

3. The automotive device according to claim 1, characterized in that, The vehicle device also includes a touchscreen display for providing an interactive interface and displaying vehicle-related information according to control commands.

4. A gesture recognition method, applied in an automotive device as described in any one of claims 1-3, characterized in that, The gesture recognition method includes: The central processing unit reads data from the steering wheel hand detection sensor to determine the user's hand status. When the user's hand is on the steering wheel, the microwave radar module is controlled to enter the reference calibration state to acquire changes in the in-vehicle environment in real time as an environmental reference to correct the working mode of the microwave radar module. When the user's hand is removed from the steering wheel, the central processing unit sends a trigger signal. The trigger signal is received by the microwave radar chip, which then triggers the microwave radar antenna to transmit microwave signals. The microwave radar antenna receives the first microwave reflection signal that returns after being blocked by the user's gesture within a preset distance, and transmits the first microwave reflection signal to the microwave radar chip. The microwave receiving module receives the second microwave reflection signal that returns after being blocked by the user's gesture within a preset distance, and transmits the second microwave reflection signal to the central processing unit. The microwave radar chip identifies the current user's gesture signal in the first microwave reflected signal, converts the gesture signal into a first control character according to a preset method, and transmits the first control character to the central processing unit. The central processing unit identifies the current user's gesture signal in the second microwave reflection signal and converts the gesture signal into a second control character according to a preset method. The central processing unit determines whether the first control character and the second control character are the same. If they are the same, one of them is output as the unified control character. If they are different, the first control character is output as the unified control character. Based on the unified control character, execute the control instruction corresponding to the control character.

5. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a program for a gesture recognition method, which, when executed by a processor, implements the steps of the gesture recognition method as described in claim 4.

Images