Vehicle-mounted millimeter wave gesture recognition system

Abstract

The invention relates to the field of vehicle-mounted gesture devices, and discloses a vehicle-mounted millimeter wave gesture recognition system, which comprises an instruction module for performing data calculation and corresponding calculation; the acquisition module is used for triggering and gesture acquisition and is electrically connected with the instruction module; the learning module is used for recording, learning and comparing, and is electrically connected with the instruction module; the display module is used for displaying and corresponding touch operation and is electrically connected with the instruction module and the learning module, radar waves are used as a leading part, and in cooperation with shooting of ultrasonic waves and optical signals, corresponding gestures can be stably collected, and multi-directional noise reduction can be conducted on the gestures; therefore, the gesture can be judged more quickly and accurately, errors are reduced, overall operation is facilitated, the operation time of a driver is shortened, and the driving risk is further reduced.

Description

Technical Field

[0001] The present invention relates to the field of vehicle-mounted gesture devices, and in particular to a vehicle-mounted millimeter wave gesture recognition system. Background Art

[0002] Gesture recognition is an issue that uses mathematical algorithms to identify human gestures. Gesture recognition can come from the movement of various parts of the human body, but generally refers to the movement of the face and hands. Users can use simple gestures to control or interact with devices, allowing computers to understand human behavior. Its core technologies are gesture segmentation, gesture analysis, and gesture recognition. In in-vehicle recognition, it can reduce the driver's contact with the distant touch screen, reduce the possibility of distraction, and thus reduce the risk of driving.

[0003] However, existing gesture recognition generally uses cameras for multi-directional recognition systems, which results in a large overall sampling volume. At the same time, during vehicle driving, image shaking and the relatively single camera placement make overall recognition difficult to capture, and the large amount of calculation can easily lead to inaccurate recognition, affecting overall use. Summary of the invention

[0004] In order to solve the technical problem of inaccurate recognition, the present invention provides a vehicle-mounted millimeter wave gesture recognition system.

[0005] The present invention is implemented by the following technical scheme: an on-vehicle millimeter wave gesture recognition system, comprising: an instruction module, which performs data calculation and corresponding calculation; an acquisition module, which performs triggering and gesture acquisition, and is electrically connected to the instruction module; a learning module, which performs recording, learning and comparison, and is electrically connected to the instruction module; a display module, which performs display and corresponding touch operations, and is electrically connected to the instruction module and the learning module.

[0006] As a further improvement of the above scheme, the instruction module includes: a main processor, which is electrically connected to a noise reduction unit and a conversion unit, the noise reduction unit and the main processor are both electrically connected to the acquisition unit, and the conversion unit is electrically connected to the learning module; microprocessor 1, which is electrically connected to the main processor; microprocessor 2, which is electrically connected to the main processor; a storage recognition unit, which is electrically connected to the main processor;

[0007] As a further improvement of the above solution, one side of the main processor is also electrically connected to a plurality of capacitors.

[0008] As a further improvement of the above scheme, the acquisition module includes: a millimeter-wave radar sensor, which is provided in plurality, and the millimeter-wave radar sensor is electrically connected to the main processor and the noise reduction unit; an infrared sensor, which is electrically connected to microprocessor one; an ultrasonic sensor, which is electrically connected to microprocessor two; and a camera, which is electrically connected to the storage and identification unit.

[0009] As a further improvement of the above scheme, the learning module includes: a call-up and comparison unit, which is electrically connected to the conversion unit, and one side of the call-up module is electrically connected to a transmission unit connected to the display module; a storage unit one, which is electrically connected to the call-up and comparison unit; a storage unit two, which is electrically connected to the call-up and comparison unit; and a storage unit three, which is electrically connected to the call-up and comparison unit, the storage unit one and the storage unit two.

[0010] As a further improvement of the above scheme, the display module includes: a processor group, which performs overall data processing, the processor group is electrically connected to a transmission unit 2, and the processor group is electrically connected to the main processor and the transmission unit; a touch screen, which is electrically connected to the processor group; a resetter, which is electrically connected to the processor group; and an actuator, which is electrically connected to the processor group.

[0011] As a further improvement of the above solution, 4 to 8 millimeter wave radar sensors are provided, and 1 to 2 infrared sensors are provided.

[0012] As a further improvement of the above solution, the capacitor adopts 0.1μF to 100μF, and the storage unit 1, storage unit 2 and storage unit 3 adopt 512M to 2024M capacity for storage.

[0013] As a further improvement of the above solution, the transmission unit 1 adopts the BLE5.0 protocol.

[0014] As a further improvement of the above solution, the identification system is implemented based on an identification device.

[0015] Compared with the prior art, the present invention has the following beneficial effects:

[0016] 1. By taking radar waves as the main method and coordinating the shooting of ultrasonic and optical signals, the corresponding gestures can be stably collected and noise reduction can be performed in all directions, so that the judgment of gestures can be faster and more accurate, reducing errors, facilitating overall operation, reducing the driver's operating time, and further reducing driving risks.

[0017] 2. Through the cooperation between multiple modules, fast and stable judgment can be carried out. At the same time, gesture learning, online updates, low-power standby, etc. can be carried out. It can better adapt to the vehicle environment, cooperate with the upper cover, etc., can be easily installed, adapt to multiple position replacement, and facilitate the driver's operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 is a system diagram of the present invention;

[0019] Figure 2 is a schematic diagram of the identifier structure;

[0020] Figure 3 It is a schematic diagram of the main view of the identifier;

[0021] Figure 4 It is a left view schematic diagram of the recognizer;

[0022] Figure 5 It is a schematic diagram of the identifier viewed from above;

[0023] Figure 6 It is a schematic diagram of the structure of the identification device;

[0024] Figure 7 It is a top view cross-sectional schematic diagram of the identification device.

[0025] Description of main symbols:

[0026] 01. Outer frame; 02. Upper cover; 03. Protective lens; 04. Battery; 05. Alarm; 06. Conversion connector; 11. Main board; 12. Comparator; 13. Converter; 14. Sound wave sensor; 15. Bluetooth; 16. CPU; 17. Capacitor; 18. Camera component; 19. Radar transceiver; 20. CPU; 21. Interface 2; 22. Noise reducer; 23. Memory 1; 24. Infrared instrument; 25. Processor 2; 26. Processor 1; 27. Memory 2. DETAILED DESCRIPTION

[0027] The present invention is further described below in conjunction with the accompanying drawings and specific implementation methods. It should be noted that, under the premise of no conflict, the various embodiments or technical features described below can be arbitrarily combined to form a new embodiment.

[0028] Example:

[0029] Please combine Figure 1-7 , A vehicle-mounted millimeter wave gesture recognition system includes: an instruction module, which performs data calculation and corresponding calculation, the instruction module supplies instructions and processes and retrieves signals, an acquisition module, which performs triggering and gesture acquisition, and is electrically connected to the instruction module, and the acquisition module performs gesture acquisition and triggers the acquisition needs, a learning module, which performs recording, learning and comparison, and is electrically connected to the instruction module, and the learning module performs learning records to facilitate faster extraction of corresponding instructions and signal processing, and a display module, which performs display and corresponding touch operations, and is electrically connected to the instruction module and the learning module, and the display module performs display touch operations of the main body.

[0030] A vehicle-mounted millimeter wave gesture recognition system includes: an instruction module, which performs data calculation and corresponding calculation, the instruction module supplies instructions and processes and retrieves signals, an acquisition module, which performs triggering and gesture acquisition, and is electrically connected to the instruction module, and the acquisition module performs gesture acquisition and triggers the acquisition needs, a learning module, which performs recording, learning and comparison, and is electrically connected to the instruction module, and the learning module performs learning records to facilitate faster extraction of corresponding instructions and signal processing, and a display module, which performs display and corresponding touch operations, and is electrically connected to the instruction module and the learning module, and the display module performs display touch operations of the main body.

[0031] The instruction module includes: a main processor, which is electrically connected to a noise reduction unit and a conversion unit, the noise reduction unit and the main processor are both electrically connected to the acquisition unit, the conversion unit is electrically connected to the learning module, the main processor processes data, the noise reduction unit cooperates with different data received by multiple radar sensors, performs integrated noise reduction, and recognizes accurate gesture information, microprocessor one is electrically connected to the main processor, microprocessor two is electrically connected to the main processor, the two microprocessors integrate and process the recognized infrared information and ultrasonic information respectively, and then transmit them to the main processor for subsequent processing, and a storage and recognition unit is electrically connected to the main processor, the storage and recognition unit collects, stores, recognizes and processes facial or other optical information, and then transmits the signal to the main processor for subsequent processing.

[0032] One side of the main processor is also electrically connected to a plurality of capacitors, and the capacitors are used to stabilize the internal current.

[0033] The acquisition module includes: a millimeter-wave radar sensor, which is provided with multiple ones. The millimeter-wave radar sensors are electrically connected to the main processor and the noise reduction unit. The millimeter-wave radar sensors transmit and collect signals. Each millimeter-wave radar sensor collects corresponding gestures. After the multiple millimeter-wave radar sensors collect, they are integrated by the noise reduction unit to eliminate external interference and ensure subsequent transmission. An infrared sensor is electrically connected to microprocessor one. The infrared sensor detects the arrival of people and performs corresponding power work. An ultrasonic sensor is electrically connected to microprocessor two. The ultrasonic sensor performs positioning and identifies whether the gesture is an erroneous operation. A camera is electrically connected to the storage and recognition unit. The camera takes pictures to assist in confirming the identity of the owner and further collect gestures. The accuracy of gesture collection is guaranteed through recognition and coordinated processing.

[0034] The learning module includes: a retrieval and comparison unit, which is electrically connected to the conversion unit, and one side of the retrieval module is electrically connected to a transmission unit connected to the display module. The retrieval and comparison unit retrieves and compares data, and then can quickly retrieve the corresponding gesture command, which is then transmitted to the main processor through the conversion unit, and further transmitted to the processor group through the transmission unit 1 for subsequent data processing and display, a storage unit 1, which is electrically connected to the retrieval and comparison unit; a storage unit 2, which is electrically connected to the retrieval and comparison unit; a storage unit 3, which is electrically connected to the retrieval and comparison unit, the storage unit 1 and the storage unit 2, and the three storage units respectively correspond to the storage of preset gesture information, preset instruction information and learning gesture information.

[0035] The display module includes: a processor group, which performs overall data processing, the processor group is electrically connected to a transmission unit 2, the processor group is electrically connected to the main processor and the transmission unit, the processor group performs corresponding processing, and at the same time outputs the corresponding overall data and receives information sent and received by the transmission unit 2 from the background, updates the stored gestures or performs overall data updates and other operations of the operating program, a touch screen, which is electrically connected to the processor group, the touch screen performs touch control, a resetter, which is electrically connected to the processor group, the resetter performs overall reset, and performs hardware guarantee for system safety, and an actuator, which is electrically connected to the processor group, and the actuator stores part of the data.

[0036] The number of the millimeter wave radar sensors is 4 to 8, the number of the infrared sensors is 1 to 2, and the multiple sensors collect multiple data to ensure subsequent noise reduction and stability of the gesture data.

[0037] The capacitor is 0.1μF~100μF, and the storage unit 1, storage unit 2 and storage unit 3 are 512M~2024M capacity storage. The capacitor integrates and stabilizes the current. In conjunction with the use of other modules, the actuator meets the corresponding storage needs.

[0038] The transmission unit 1 adopts the BLE5.0 protocol.

[0039] The identification system is implemented based on an identification device.

[0040] Among them, the identification device includes: an outer frame 01, to which a battery 04, a conversion connector 06 and an alarm 05 are fixedly connected. The outer frame 01 is packaged as a whole, and the entire device is installed on the corresponding vehicle body in conjunction with the upper cover 02. The battery 04 is used to power the system, and provides basic power supply when the vehicle is turned off or not used for a long time. The upper cover 02 is snapped onto the outer frame 01, and a plurality of protective lenses 03 are provided on the upper cover 02. A plurality of mounting holes are provided on the upper cover 02. An identifier is connected inside the upper cover 02, and the identifier cooperates with the system to perform the identification work of the main body.

[0041] The identifier includes: a main board 11, which is an existing structure, on which a camera component 18 and an infrared device 24 are installed. The main board 11 is connected with a radar transceiver 19 on all four sides. The main board 11 is constructed accordingly according to the existing technology to achieve power conduction in multiple places. The camera component 18 performs photography, the infrared device 24 performs infrared work, and the radar transceiver 19 transmits and receives millimeter waves to collect gestures.

[0042] Interface 1 20 is connected to the main board 11, and the main board 11 is connected with interface 2 21, noise reducer 22, CPU 16, processor 1 26, processor 2 25, Bluetooth 15, converter 13, comparator 12, capacitor 17, and acoustic sensor 14. Interface 1 20 and interface 2 21 are connected to different ports for input and output, Bluetooth 15 performs signal transmission, processor 2 25 and processor 1 26 perform corresponding infrared information and ultrasonic information processing, capacitor 17 performs current integration, CPU 16 performs overall data calculation, converter 13 performs data conversion, identifier 22 performs identification and storage, and 12 performs data comparison, calculation and judgment.

[0043] The memory 1 23 is connected to the bottom of the main board 11 , and one side of the memory 1 23 is provided with a plurality of memory 2 27 connected to the main board 11 , and the memory 1 23 and the memory 2 27 are used for data storage and calling.

[0044] The implementation principle of the embodiment of the present application is:

[0045] When installing on the vehicle, install 01 and 02 with 11 to the designated position of the vehicle. The whole device can be set with multiple ones, corresponding to different positions, to facilitate the operation of the car owner. After the installation is completed, the corresponding program input storage and pre-stored gestures and corresponding operation records are performed for preliminary settings.

[0046] During operation, the power is turned on. At this time, the infrared sensor performs periodic monitoring according to the program timing to detect whether there is a person approaching. When there is no current or a person, the whole system, except for infrared work, is in sleep or low-power standby. After detecting the human body, it is triggered, and the camera collects the portrait. At the same time, the face recognition is performed through the storage and recognition unit to determine whether it is the owner of the car, and then the corresponding authority is set. The ultrasonic sensor works indirectly to determine the surrounding moving objects. When performing gesture operations, gesture scanning is first performed. The ultrasonic sensor receives moving objects of a certain speed and size. At the same time, the infrared sensor performs infrared sensing, and then the microprocessor performs data calculation and transmits it to the main processor to determine whether it is a moving object with heat. If one of them is judged as no, it enters the high-frequency standby state. The infrared sensor and the ultrasonic sensor perform high-frequency monitoring. After the timing program in the main processor counts to a certain time, it enters the low-frequency monitoring to save energy and protect the equipment. After the moving object with heat is met, the radar sensor and the camera enter the working state. The camera reconfirms the personnel and captures the gesture image to assist in noise reduction. The radar sensor determines the moving speed, moving direction, moving trend and other information of the moving object, enters the information, forms the gesture movement trajectory, and then integrates and reduces the noise through the noise reduction unit, passes the data to the main processor, and then passes the data to the retrieved comparison unit through the conversion unit, calls and compares the data in actuators one, two, and three, obtains the instruction information corresponding to the gesture, and then passes it to the main processor and the processor group through the transmission unit for corresponding processing. The processor group processes the data and then outputs it through the touch screen to realize display. At the same time, it controls other corresponding entities to execute the gesture instruction. After the instruction is completed, if the main memory processor does not receive the corresponding instruction information again within the unit time, the camera, millimeter wave radar sensor and other units will enter the standby state. At the same time, the ultrasonic sensor and infrared sensor will patrol at a low frequency. When the internal timer ends again, the ultrasonic sensor will standby and the infrared sensor will scan and patrol at a lower frequency, waiting for subsequent operations.

[0047] When modification is needed, the touch screen can be used to operate, so that the internal program enters the modification mode, the millimeter wave radar sensor and other devices enter the working state, and the personnel perform the corresponding gesture operation. After data conversion and comparison of the comparison unit, it is confirmed that there is no corresponding gesture record for the corresponding instruction, and it is stored in the storage unit. Repeat the operation until the operation is completed, the acquisition module enters the standby module, and other corresponding modules wait for triggering and enter the low power mode.

[0048] The above-mentioned embodiments are only preferred embodiments of the present invention and cannot be used to limit the scope of protection of the present invention. Any non-substantial changes and substitutions made by technicians in this field on the basis of the present invention shall fall within the scope of protection required by the present invention.

Claims

1. A vehicle-mounted millimeter wave gesture recognition system, characterized in that: include: The instruction module performs data calculation and corresponding calculation; A collection module, which performs triggering and gesture collection and is electrically connected to the instruction module; A learning module, which performs recording, learning and comparison, and is electrically connected to the instruction module; The display module performs display and corresponding touch operation, and is electrically connected to the instruction module and the learning module.

2. The vehicle-mounted millimeter wave gesture recognition system according to claim 1, characterized in that: The instruction module comprises: A main processor, which is electrically connected to a noise reduction unit and a conversion unit, wherein the noise reduction unit and the main processor are both electrically connected to the acquisition unit, and the conversion unit is electrically connected to the learning module; Microprocessor 1, which is electrically connected to the main processor; A second microprocessor electrically connected to the main processor; The storage identification unit is electrically connected to the main processor.

3. The vehicle-mounted millimeter wave gesture recognition system according to claim 2, characterized in that: One side of the main processor is also electrically connected to a plurality of capacitors.

4. The vehicle-mounted millimeter wave gesture recognition system according to claim 2, characterized in that: The acquisition module comprises: A millimeter wave radar sensor, which is provided in plurality, wherein the millimeter wave radar sensor is electrically connected to the main processor and the noise reduction unit; An infrared sensor electrically connected to the microprocessor; An ultrasonic sensor electrically connected to the microprocessor; The camera is electrically connected to the storage identification unit.

5. The vehicle-mounted millimeter wave gesture recognition system according to claim 2, characterized in that: The learning modules include: A call-and-contrast unit electrically connected to the conversion unit, wherein one side of the call-and-contrast module is electrically connected to a transmission unit connected to the display module; A storage unit 1, which is electrically connected to the retrieval and comparison unit; A second storage unit electrically connected to the comparison unit; The storage unit three is electrically connected to the comparison unit, the storage unit one and the storage unit two.

6. The vehicle-mounted millimeter wave gesture recognition system according to claim 5, characterized in that: The display module comprises: A processor group, which performs overall data processing, the processor group is electrically connected to a transmission unit 2, and the processor group is electrically connected to the main processor and the transmission unit; A touch screen electrically connected to the processor group; A resetter electrically connected to the processor group; The actuator is electrically connected to the processor group.

7. The vehicle-mounted millimeter wave gesture recognition system according to claim 6, characterized in that: The number of the millimeter wave radar sensors is 4 to 8, and the number of the infrared sensors is 1 to 2.

8. The vehicle-mounted millimeter wave gesture recognition system according to claim 6, characterized in that: The capacitor is 0.1 μF to 100 μF, and the storage unit 1, storage unit 2 and storage unit 3 are 512M to 2024M in capacity.

9. The vehicle-mounted millimeter wave gesture recognition system according to claim 6, characterized in that: The transmission unit 1 adopts the BLE5.0 protocol.

10. The vehicle-mounted millimeter wave gesture recognition system according to claim 6, characterized in that: The identification system is implemented based on an identification device.

Images