Vehicle-mounted millimeter wave gesture recognition device and method

Abstract

The invention discloses a vehicle-mounted millimeter wave gesture recognition device and method.The gesture recognition device comprises a shell, the shell is arranged on an interaction panel located above a display screen, a millimeter wave gesture recognition assembly is contained in the shell, and the millimeter wave gesture recognition assembly is used for capturing gesture actions of people in a vehicle; outputting a corresponding gesture judgment result; and the controller performs searching and matching in a pre-input gesture library according to the current gesture judgment result, and if the current gesture judgment result is matched, an operation corresponding to a corresponding gesture in the gesture library is executed and is displayed on the display screen. According to the device, the millimeter wave gesture recognition assembly, the controller and other components are arranged on the interaction panel, due to the characteristics of the millimeter wave radar, the device is not affected by illumination changes during recognition, high-precision gesture recognition can be achieved while privacy of passengers is protected, accuracy and stability are ensured, and the safety of passengers is improved. And through the positioning device, when detection and maintenance are needed, disassembly and assembly detection operation can be conveniently and efficiently completed on the identification device.

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle-mounted human-computer interaction, and in particular to a vehicle-mounted millimeter wave gesture recognition device and method. Background Art

[0002] With the development of vehicle technology, vehicle convenience and intelligence have become the direction of vehicle development today. Most vehicles are equipped with an on-board central control system, but the conventional on-board central control system is only controlled by physical buttons or virtual buttons on the touch screen. When the driver wants to control the on-board central control system during driving, he needs to determine the button position before controlling it, which is inconvenient. Therefore, using on-board gesture recognition to control the on-board central control system has become a major trend in the development of vehicle technology. How to reduce costs while realizing the on-board gesture recognition function and ensure the beauty of the vehicle has become one of the problems that need to be solved at present.

[0003] Traditional in-vehicle gesture recognition systems mostly rely on cameras and infrared sensors. These systems perform poorly in low-light conditions and are usually sensitive to environmental changes, such as changes in light, temperature, and humidity, which affect the accuracy and stability of recognition. In addition, traditional in-vehicle recognition systems are mostly installed on interactive panels by bolts, making it inconvenient to disassemble and replace them when they need to be inspected and maintained. Summary of the invention

[0004] In order to solve the technical problems raised in the above background technology, the present invention provides a vehicle-mounted millimeter wave gesture recognition device and method.

[0005] The present invention is implemented by the following technical scheme: a vehicle-mounted millimeter wave gesture recognition device is installed on an interactive panel located at the front side of the middle channel of the vehicle, the interactive panel is installed with a display screen and a controller, the gesture recognition device comprises a shell, the shell is arranged on the interactive panel located above the display screen, and the millimeter wave gesture recognition component is accommodated inside the shell,

[0006] The millimeter wave gesture recognition component is used to capture the gesture movements of the occupants of the vehicle and output the corresponding gesture judgment results;

[0007] The controller searches for a match in a pre-recorded gesture library according to the current gesture judgment result. If a match is found, the controller executes the operation corresponding to the corresponding gesture in the gesture library and displays it on the display screen;

[0008] Wherein, the shell is installed on the interactive panel through a positioning device.

[0009] As a further improvement of the above solution, the millimeter wave gesture recognition component includes a millimeter wave radar module, a signal processing unit, a feature extraction unit, and a gesture recognition engine;

[0010] The millimeter wave radar module is used to transmit and receive millimeter wave signals to capture the gestures of people in the car;

[0011] The signal processing unit is used to receive the original signal of the millimeter wave radar module and perform preprocessing;

[0012] The feature extraction unit is used to extract gesture features related to the gesture from the preprocessed signal;

[0013] The gesture recognition engine is used to analyze the extracted gesture features to recognize a specific gesture as a gesture determination result.

[0014] As a further improvement of the above solution, the preprocessing at least includes denoising, window function application and fast Fourier transform.

[0015] As a further improvement of the above solution, the gesture features include at least distance, angle, speed and acceleration.

[0016] As a further improvement of the above solution, a machine learning algorithm is used to analyze the extracted gesture features to identify a specific gesture as a gesture judgment result.

[0017] As a further improvement of the above solution, the machine learning algorithm includes any one of the following: a convolutional neural network or a recurrent neural network.

[0018] As a further improvement of the above solution, a mounting groove is provided on the interactive panel, a mounting seat is provided in the mounting groove, and the shell is placed in the mounting seat.

[0019] As a further improvement of the above scheme, the positioning device includes a positioning plate, which is rotatably sleeved on the outer peripheral side of the shell, and a fixing ring concentric with the positioning plate is fixed on the top of the interactive panel. The inner side of the fixing ring is provided with an internal thread, and the outer side of the positioning plate is provided with an external thread matching the internal thread.

[0020] As a further improvement of the above scheme, a slot for inserting the shell is provided on the mounting seat, a bottom cavity is provided on the bottom side of the mounting seat wall, and side cavities communicating with the bottom cavity are provided on both sides of the mounting seat wall, and hydraulic oil is contained in the bottom cavity and the side cavity;

[0021] A first plug groove connected to the bottom cavity is provided at the bottom of the slot, a first piston is arranged in the first plug groove, a pressure-bearing rod which can be inserted into the slot is fixed on the top of the first piston, and the top of the pressure-bearing rod can be pressed and matched with the bottom of the shell which enters the slot;

[0022] A partition is provided at a position near the bottom cavity in the side cavity, a pressure plate is provided in the side cavity, the top and bottom of the pressure plate are respectively slidably sealed and clamped with the top wall of the side cavity and the bottom of the partition, a first through hole connecting the side cavity and the bottom cavity is provided on the partition, a clamping column is fixedly and horizontally inserted on the pressure plate, and a clamping hole matching with the clamping column is provided on the side wall of the mounting groove;

[0023] The end of the clamping column close to the slot is provided with a second plug groove for hydraulic oil to enter, and a second piston is arranged in the second plug groove. The clamping column is rotatable relative to the other end and a screw rod concentric therewith is inserted therein, and a connecting rod is fixed to the end of the second piston close to the screw rod, and one end of the connecting rod is inserted into the end of the screw rod close to the slot. A first spring is sleeved on the outer side of the connecting rod, and a spiral groove is provided inside the screw rod along its axial direction. A convex block is provided on the connecting rod and is slidably engaged with the groove, and a screw hole engaged with the screw rod is provided on the inner wall of the clamping hole;

[0024] The pressure plate has a cavity inside, the top of the cavity is provided with a roller that rolls and frictionally cooperates with the top wall of the side cavity, a wire wheel is coaxially fixed on the roller, a sealing plate is coaxially provided in the cavity, the sealing plate is inserted through the clamping column and can close the notch of the second plug slot, a second through hole is opened on the sealing plate, a tensioned pull rope is wound around the wire wheel, the free end of the pull rope is fixed to the top of the sealing plate, and the bottom of the sealing plate is connected to the bottom wall of the cavity through a second spring;

[0025] When the pressure plate moves radially in a direction away from the slot, the sealing plate moves up to make the second through hole correspond to the position of the second plug slot notch, the second spring is in a tensile deformation state, and the first spring is in a compressive deformation state.

[0026] The present invention also provides a vehicle-mounted millimeter wave gesture recognition method applied to the above device, comprising the following steps:

[0027] S1, the millimeter wave radar module transmits and receives millimeter wave signals to capture the gestures of people in the car;

[0028] S2, receiving the original signal of the millimeter wave radar module and performing preprocessing;

[0029] S3, extracting gesture features related to the gesture;

[0030] S4, analyzing the extracted gesture features to identify a specific gesture as a gesture judgment result;

[0031] S5. Search for a match in the pre-recorded gesture library according to the current gesture judgment result. If a match is found, the operation corresponding to the corresponding gesture in the gesture library is executed and displayed on the display screen.

[0032] As a further improvement of the above scheme,.

[0033] Compared with the prior art, the present invention has the following beneficial effects:

[0034] The vehicle-mounted millimeter-wave gesture recognition device of the present invention, through the millimeter-wave gesture recognition components, controller and other components arranged on the interactive panel, can be unaffected by changes in illumination during recognition due to the characteristics of the millimeter-wave radar, and can achieve high-precision gesture recognition while protecting the privacy of passengers, ensuring accuracy and stability. Moreover, through the positioning device, when inspection and maintenance are required, the recognition device can be disassembled and inspected conveniently and efficiently, thereby reducing maintenance costs.

[0035] The vehicle-mounted millimeter wave gesture recognition method of the present invention uses a machine learning algorithm to continuously learn and adapt, thereby improving recognition accuracy and response speed, and providing the driver with a safer and more convenient driving experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 A schematic diagram of the structure of the gesture recognition device provided in Embodiment 1 of the present invention installed on an interactive panel;

[0037] Figure 2 for Figure 1 A schematic diagram of a partial structural section in the middle (the gesture recognition device is in the installed state);

[0038] Figure 3 for Figure 2 A schematic diagram of a partial cross-sectional structure of the main view when the gesture recognition device is installed on the interactive panel;

[0039] Figure 4 for Figure 3 The enlarged structural diagram at A in the middle;

[0040] Figure 5 for Figure 2 A schematic diagram of a partial cross-sectional structure when no gesture recognition device is installed on the middle interactive panel;

[0041] Figure 6 for Figure 5 The enlarged structural diagram at B in the middle;

[0042] Figure 7 for Figure 5 Schematic diagram of the cross-sectional structure of the middle clamp column and screw;

[0043] Figure 8 This is a flow chart of a gesture recognition method provided in Embodiment 2 of the present invention.

[0044] Description of main symbols:

[0045] 1. Interactive panel; 3. Display screen; 4. Shell; 5. Mounting groove; 6. Mounting seat; 7. Pressure rod; 8. First plug groove; 9. First piston; 10. Bottom cavity; 11. Side cavity; 12. Partition; 13. First through hole; 14. Pressure plate; 15. Clamping column; 16. Clamping hole; 17. Roller; 18. Wire wheel; 19. Closing plate; 20. Second through hole; 21. Second piston; 22. Connecting rod; 23. Screw; 24. Screw hole; 25. Groove; 26. Bump; 27. Fixing ring; 28. Positioning plate. DETAILED DESCRIPTION

[0046] The present invention is further described below in conjunction with the accompanying drawings and specific implementation methods. It should be noted that, under the premise of no conflict, the various embodiments or technical features described below can be arbitrarily combined to form a new embodiment.

[0047] Example 1

[0048] Please combine Figures 1 to 7 The vehicle-mounted millimeter wave gesture recognition device is installed on an interactive panel 1 located at the front side of the middle channel of the vehicle. The interactive panel 1 is installed with a display screen 3 and a controller. The gesture recognition device includes a shell 4, which is arranged on the interactive panel 1 located above the display screen 3. The millimeter wave gesture recognition component is accommodated in the shell 4.

[0049] The millimeter wave gesture recognition component is used to capture the gestures of people in the car and output the corresponding gesture judgment results;

[0050] The controller searches for a match in the pre-recorded gesture library according to the current gesture judgment result. If a match is found, the operation corresponding to the corresponding gesture in the gesture library is executed and displayed on the display screen 3.

[0051] The millimeter wave gesture recognition component includes a millimeter wave radar module, a signal processing unit, a feature extraction unit, and a gesture recognition engine;

[0052] The millimeter-wave radar module is used to transmit and receive millimeter-wave signals to capture the gestures of people in the car;

[0053] The signal processing unit is used to receive the original signal of the millimeter wave radar module and perform pre-processing;

[0054] The feature extraction unit is used to extract gesture features related to the gesture from the preprocessed signal;

[0055] The gesture recognition engine is used to analyze the extracted gesture features to recognize a specific gesture as a gesture judgment result.

[0056] The preprocessing includes at least denoising, window function application and fast Fourier transform.

[0057] The gesture features include at least distance, angle, speed and acceleration.

[0058] The extracted gesture features are analyzed by using a machine learning algorithm to identify a specific gesture as a gesture judgment result. The machine learning algorithm includes any of the following: a convolutional neural network or a recurrent neural network.

[0059] Furthermore, a mounting groove 5 is provided on the interactive panel 1 , a mounting seat 6 is provided in the mounting groove 5 , the shell 4 is placed in the mounting seat 6 , a positioning device is provided on the mounting seat 6 , and the positioning device is used to lock and fix the shell 4 on the interactive panel 1 .

[0060] The positioning device includes a positioning disk 28, which is rotatably sleeved on the outer peripheral side of the shell 4. A fixing ring 27 concentric with the positioning disk 28 is fixed on the top of the interactive panel 1. The fixing ring 27 is provided with an internal thread on the inside, and the positioning disk 28 is provided with an external thread matching the internal thread on the outside.

[0061] By rotating the positioning disk 28 so that it is screwed and fixed to the fixing ring 27 , the housing 4 together with the mounting seat 6 can be installed and fixed on the interactive panel 1 , and the housing 4 can also move axially downward relative to the mounting seat 6 .

[0062] The mounting seat 6 is provided with a slot for inserting the housing 4, a bottom cavity 10 is provided at the bottom side of the inner wall of the mounting seat 6, and side cavities 11 connected to the bottom cavity 10 are provided on both sides of the inner wall of the mounting seat 6, and hydraulic oil is contained in the bottom cavity 10 and the side cavity 11;

[0063] A first plug slot 8 connected to the bottom cavity 10 is provided at the bottom of the slot, a first piston 9 is provided in the first plug slot 8, a pressure bearing rod 7 which can be inserted into the slot is fixed on the top of the first piston 9, and the top of the pressure bearing rod 7 can be pressed and matched with the bottom of the housing 4 which enters the slot;

[0064] A partition 12 is provided at a position near the bottom chamber 10 in the side chamber 11, and a pressure plate 14 is provided in the side chamber 11. The top and bottom of the pressure plate 14 are respectively slidably sealed and clamped with the top wall of the side chamber 11 and the bottom of the partition 12. A first through hole 13 connecting the side chamber 11 and the bottom chamber 10 is provided on the partition 12. A clamping column 15 is fixedly and horizontally inserted on the pressure plate 14, and a clamping hole 16 matching the clamping column 15 is provided on the side wall of the installation groove 5.

[0065] The end of the clamping column 15 close to the slot is provided with a second plug groove for hydraulic oil to enter, and a second piston 21 is arranged in the second plug groove. The clamping column 15 is rotated relative to the other end and a screw rod 23 concentric therewith is inserted therein. A connecting rod 22 is fixed to the end of the second piston 21 close to the screw rod 23. One end of the connecting rod 22 is inserted into the end of the screw rod 23 close to the slot. A first spring is sleeved on the outer side of the connecting rod 22. A spiral groove 25 is provided inside the screw rod 23 along its axial direction. A convex block 26 that is slidably engaged with the groove 25 is provided on the connecting rod 22. A screw hole 24 that is engaged with the screw rod 23 is provided on the inner wall of the clamping hole 16.

[0066] The pressure plate 14 has a cavity inside, and a roller 17 is arranged at the top of the cavity to roll and frictionally cooperate with the top wall of the side cavity 11, and a wire wheel 18 is coaxially fixed on the roller 17. A sealing plate 19 is coaxially arranged in the cavity, and the sealing plate 19 is inserted through the clamping column 15 and can close the notch of the second plug slot. A second through hole 20 is opened on the sealing plate 19, and a tensioned pull rope is wound around the wire wheel 18, and the free end of the pull rope is fixed on the top of the sealing plate 19, and the bottom of the sealing plate 19 is connected to the bottom wall of the cavity through a second spring;

[0067] When the pressure plate 14 moves radially in a direction away from the slot, the sealing plate 19 moves upward to make the second through hole 20 correspond to the position of the second plug slot notch, the second spring is in a tensile deformation state, and the first spring is in a compressive deformation state.

[0068] When the shell 4 needs to be installed on the interactive panel 1, first put the mounting seat 6 into the mounting groove, then put the shell 4 into the slot of the mounting seat 6, rotate the positioning plate 28 to screw it with the fixing ring 27 to achieve the installation and fixation of the shell 4 together with the mounting seat 6 on the interactive panel 1, and at the same time, the shell 4 will move axially downward relative to the mounting seat 6, which will squeeze the pressure-bearing rod 7 to force it to drive the first piston 9 to move downward in the first plug groove 8, so as to squeeze the hydraulic oil in the bottom chamber 10 to the side chamber 11, which will increase the oil pressure in the side chamber 11, forcing the pressure-bearing plate 14 to move centrifugally, so as to drive the clamping column 15 to be clamped into the clamping hole 16, and complete the fixation of the mounting seat 6 in the mounting groove 5. In this process The movement of the middle pressure plate 14 will also cause the roller 17 to rotate, and the roller 17 drives the wire wheel 18 to rotate to reel in the wire, so that the closing plate 19 is pulled up by the pull rope to move the second through hole 20 to correspond to the notch of the second plug groove, and the hydraulic oil can flow into the second plug groove and squeeze the second piston 21. The second piston 21 drives the connecting rod 22 to axially extend into the screw 23, so that the protrusion 26 continuously rubs and squeezes the groove wall of the axially spiral groove 25, forcing the screw 23 to rotate. Since the clamping column 15 can drive the screw 23 to move centrifugally synchronously, the screw 23 can be rotated and screwed into the screw hole 24, so that the clamping column 15 is locked and fixed in the clamping hole 16, thereby completing the installation and fixation of the shell 4 on the interactive panel 1.

[0069] When the shell 4 needs to be dismantled, replaced or maintained, the above steps can be reversed, that is, only the positioning disk 28 needs to be rotated in the opposite direction to release the locking state between the shell 4, the mounting seat 6 and the interactive panel 1, which is convenient and efficient.

[0070] Example 2

[0071] Please combine Figure 8 This embodiment also provides a vehicle-mounted millimeter wave gesture recognition method applied to the above device, comprising the following steps:

[0072] S1, gesture capture, through the millimeter wave radar module to transmit and receive millimeter wave signals to capture the gestures of people in the car;

[0073] S2, preprocessing, receiving the original signal of the millimeter wave radar module and performing preprocessing;

[0074] S3, feature extraction, extracting gesture features related to the gesture;

[0075] S4, feature analysis, analyzing the extracted gesture features to identify a specific gesture as a gesture judgment result;

[0076] S5, matching decision, searching for a match in the pre-recorded gesture library according to the current gesture judgment result, if a match can be found, executing the operation corresponding to the corresponding gesture in the gesture library and displaying it on the display screen 3.

[0077] The above-mentioned embodiments are only preferred embodiments of the present invention and cannot be used to limit the scope of protection of the present invention. Any non-substantial changes and substitutions made by technicians in this field on the basis of the present invention shall fall within the scope of protection required by the present invention.

Claims

1. A vehicle-mounted millimeter wave gesture recognition device, which is installed on an interactive panel located at the front side of the middle channel of the vehicle, and the interactive panel is equipped with a display screen and a controller, characterized in that: The gesture recognition device comprises a housing, which is arranged on an interactive panel located above the display screen, and a millimeter wave gesture recognition component is accommodated inside the housing. The millimeter wave gesture recognition component is used to capture the gesture movements of the occupants of the vehicle and output the corresponding gesture judgment results; The controller searches for a match in a pre-recorded gesture library according to the current gesture judgment result. If a match is found, the controller executes the operation corresponding to the corresponding gesture in the gesture library and displays it on the display screen; Wherein, the shell is installed on the interactive panel through a positioning device.

2. The vehicle-mounted millimeter wave gesture recognition device according to claim 1, characterized in that: The millimeter wave gesture recognition component includes a millimeter wave radar module, a signal processing unit, a feature extraction unit, and a gesture recognition engine; The millimeter wave radar module is used to transmit and receive millimeter wave signals to capture the gestures of people in the car; The signal processing unit is used to receive the original signal of the millimeter wave radar module and perform preprocessing; The feature extraction unit is used to extract gesture features related to the gesture from the preprocessed signal; The gesture recognition engine is used to analyze the extracted gesture features to recognize a specific gesture as a gesture determination result.

3. The vehicle-mounted millimeter wave gesture recognition device according to claim 2, characterized in that: The preprocessing at least includes denoising, window function application and fast Fourier transform.

4. The vehicle-mounted millimeter wave gesture recognition device according to claim 2, characterized in that: The gesture features include at least distance, angle, speed and acceleration.

5. The vehicle-mounted millimeter wave gesture recognition device according to claim 2, characterized in that: The extracted gesture features are analyzed by using a machine learning algorithm to identify a specific gesture as a gesture judgment result.

6. The vehicle-mounted millimeter wave gesture recognition device according to claim 5, characterized in that: The machine learning algorithm includes any of the following: a convolutional neural network or a recurrent neural network.

7. The vehicle-mounted millimeter wave gesture recognition device according to claim 1, characterized in that: The interactive panel is provided with a mounting groove, a mounting seat is arranged in the mounting groove, and the shell is placed in the mounting seat.

8. The vehicle-mounted millimeter wave gesture recognition device according to claim 7, characterized in that: The positioning device includes a positioning disk, which is rotatably sleeved on the outer peripheral side of the shell, and a fixing ring concentric with the positioning disk is fixed on the top of the interactive panel. The inner side of the fixing ring is provided with an internal thread, and the outer side of the positioning disk is provided with an external thread matching the internal thread.

9. The vehicle-mounted millimeter wave gesture recognition device according to claim 8, characterized in that: The mounting seat is provided with a slot for inserting the housing, the bottom side of the mounting seat wall is provided with a bottom cavity, and the two sides of the mounting seat wall are provided with side cavities connected to the bottom cavity, and the bottom cavity and the side cavity contain hydraulic oil; A first plug groove connected to the bottom cavity is provided at the bottom of the slot, a first piston is arranged in the first plug groove, a pressure-bearing rod which can be inserted into the slot is fixed on the top of the first piston, and the top of the pressure-bearing rod can be pressed and matched with the bottom of the shell which enters the slot; A partition is provided at a position near the bottom cavity in the side cavity, a pressure plate is provided in the side cavity, the top and bottom of the pressure plate are respectively slidably sealed and clamped with the top wall of the side cavity and the bottom of the partition, a first through hole connecting the side cavity and the bottom cavity is provided on the partition, a clamping column is fixedly and horizontally inserted on the pressure plate, and a clamping hole matching with the clamping column is provided on the side wall of the mounting groove; The end of the clamping column close to the slot is provided with a second plug groove for hydraulic oil to enter, and a second piston is arranged in the second plug groove. The clamping column is rotatable relative to the other end and a screw rod concentric therewith is inserted therein, and a connecting rod is fixed to the end of the second piston close to the screw rod, and one end of the connecting rod is inserted into the end of the screw rod close to the slot. A first spring is sleeved on the outer side of the connecting rod, and a spiral groove is provided inside the screw rod along its axial direction. A convex block is provided on the connecting rod and is slidably engaged with the groove, and a screw hole engaged with the screw rod is provided on the inner wall of the clamping hole; The pressure plate has a cavity inside, the top of the cavity is provided with a roller that rolls and frictionally cooperates with the top wall of the side cavity, a wire wheel is coaxially fixed on the roller, a sealing plate is coaxially provided in the cavity, the sealing plate is inserted through the clamping column and can close the notch of the second plug slot, a second through hole is opened on the sealing plate, a tensioned pull rope is wound around the wire wheel, the free end of the pull rope is fixed to the top of the sealing plate, and the bottom of the sealing plate is connected to the bottom wall of the cavity through a second spring; When the pressure plate moves radially in a direction away from the slot, the sealing plate moves up to make the second through hole correspond to the position of the second plug slot notch, the second spring is in a tensile deformation state, and the first spring is in a compressive deformation state.

10. A vehicle-mounted millimeter wave gesture recognition method applied to the device as claimed in claim 2, characterized in that: The steps include: S1, the millimeter wave radar module transmits and receives millimeter wave signals to capture the gestures of people in the car; S2, receiving the original signal of the millimeter wave radar module and performing preprocessing; S3, extracting gesture features related to the gesture; S4, analyzing the extracted gesture features to identify a specific gesture as a gesture judgment result; S5. Search for a match in the pre-recorded gesture library according to the current gesture judgment result. If a match is found, the operation corresponding to the corresponding gesture in the gesture library is executed and displayed on the display screen.

Images