Interaction control system of vehicle steering wheel, vehicle and method

Abstract

The invention relates to the technical field of vehicles, in particular to an interaction control system of a vehicle steering wheel, a vehicle and a method.The interaction control method comprises the steps that whether identity information of a user meets a driving condition or not is detected through a detection module, and when the identity information of the user meets the driving condition, an interaction module is started; the driving behavior data of a user, the driving physiological state data of the user and the environment data of a vehicle are collected through a collection module, so that a driving control strategy of the vehicle is generated according to the driving behavior data of the user, the driving physiological state data of the user and the environment data of the vehicle; and controlling the vehicle to execute the target action by using a multi-source data fusion algorithm. Therefore, the problems that a steering wheel is single in design function, fixed in monitoring performance and the like are solved, the driving behavior data of the user, the driving physiological state data and the environment data of the vehicle are collected through the multifunctional collection module, the interaction function design of the steering wheel is improved, and the diversified requirements of the user are met.

Description

Technical Field

[0001] This application relates to the technical field of vehicles, and particularly to an interactive control system, a vehicle and a method for a vehicle steering wheel. Background Art

[0002] With the development of automotive intelligence, networking, and electrification, the steering wheel has gradually transformed from a traditional mechanical steering device into a core human-machine interaction terminal integrating intelligent interaction, safety monitoring, and personalized control. The multifunctional steering wheel not only facilitates the user's operating performance but also brings new breakthroughs to the development of vehicle monitoring systems.

[0003] In related technologies, the functional design of the steering wheel usually monitors the user's driving state and the driving environment inside the vehicle based on a single monitoring system.

[0004] However, the single monitoring method lacks the correlation analysis of each monitoring module inside the vehicle cockpit, resulting in relatively fixed monitoring performance and insufficient human-machine interaction adaptability, thus reducing the user's driving and riding experience, which urgently needs to be solved. Summary of the Invention

[0005] This application provides an interactive control system, a vehicle and a method for a vehicle steering wheel to solve problems such as the single design function of the steering wheel and relatively fixed monitoring performance.

[0006] The first aspect of the embodiments of this application provides an interactive control system for a vehicle steering wheel, including:

[0007] A detection module, configured to detect whether the user's identity information meets the driving conditions;

[0008] An acquisition module, configured to acquire the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data when the user's identity information meets the driving conditions, so as to generate a driving control strategy for the vehicle according to the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data;

[0009] A control module, configured to control the vehicle to perform a target action based on the driving control strategy of the vehicle by using a multi-source data fusion algorithm.

[0010] Further, in some embodiments, the detection module includes:

[0011] An information acquisition unit, configured to acquire the user's identity information, where the identity information includes at least one of the user's fingerprint information, facial feature information, and voiceprint information;

[0012] An information determination unit, configured to determine that the user's identity information meets the driving conditions when the user's identity information satisfies the user identity recognition verification.

[0013] Further, in some embodiments, the acquisition module includes:

[0014] An environment acquisition unit, configured to acquire a preset gas concentration inside the vehicle and the vehicle interior temperature;

[0015] An environment warning unit, configured to generate an in-vehicle environment warning reminder when the preset gas concentration is greater than a preset concentration threshold, or when the vehicle interior temperature is greater than a preset temperature threshold.

[0016] Further, in some embodiments, the acquisition module further includes:

[0017] A driving behavior acquisition unit, configured to acquire the change frequency of the user's steering wheel grip force and the steering wheel operation frequency;

[0018] A driving behavior warning unit, configured to generate a driving behavior warning reminder when the change frequency of the user's steering wheel grip force is greater than a preset grip force frequency, or when the steering wheel operation frequency is greater than a preset operation frequency, and dynamically adjust the steering wheel operation mode according to the change frequency of the steering wheel grip force or the steering wheel operation frequency.

[0019] Further, in some embodiments, the acquisition module further includes:

[0020] A driving physiological state acquisition unit, configured to acquire the user's body temperature data, the user's heart rate data, the user's blood oxygen data, and the user's breathing frequency;

[0021] A physiological state warning unit, configured to generate a physiological state warning reminder when the user's body temperature data does not meet the preset body temperature data, or when the user's heart rate data does not meet the preset heart rate threshold, or when the user's blood oxygen data does not meet the preset blood oxygen threshold, or when the user's breathing frequency does not meet the preset breathing frequency threshold;

[0022] A strategy generation unit, configured to adjust the preset gas concentration and the vehicle interior temperature based on the user's body temperature data, the user's heart rate data, the user's blood oxygen data, and the user's breathing frequency.

[0023] Further, in some embodiments, the acquisition module further includes:

[0024] An audio acquisition unit, configured to acquire the user's voice data;

[0025] A control unit for controlling the vehicle to perform a target action according to the voice data of the user.

[0026] Further, in some embodiments, the acquisition module further includes:

[0027] A gesture acquisition unit for acquiring the gesture sliding position of the user;

[0028] A gesture generation unit for generating the gesture information of the user according to the gesture sliding position;

[0029] A gesture recognition unit for matching the best interaction action from a preset gesture database according to the gesture information of the user, so as to control the vehicle to perform a target action according to the best interaction action.

[0030] According to the vehicle steering wheel interaction control system of the embodiments of the present application, the detection module detects whether the user's identity information meets the driving conditions. When the user's identity information meets the driving conditions, the acquisition module acquires the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data, so as to generate a vehicle driving control strategy according to the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data, and the control module uses a multi-source data fusion algorithm to control the vehicle to perform a target action based on the vehicle driving control strategy. Thus, problems such as the single design function of the steering wheel and the relatively fixed monitoring performance are solved. The driving behavior data, the driving physiological state data, and the vehicle's environmental data of the user are acquired through a multi-functional acquisition module, thereby improving the interaction function design of the steering wheel and meeting the diversified needs of users.

[0031] An embodiment of the second aspect of the present application provides a vehicle, including the vehicle steering wheel interaction control system described in any one of the above.

[0032] According to the vehicle of the embodiments of the present application, the detection module detects whether the user's identity information meets the driving conditions. When the user's identity information meets the driving conditions, the acquisition module acquires the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data, so as to generate a vehicle driving control strategy according to the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data, and the control module uses a multi-source data fusion algorithm to control the vehicle to perform a target action based on the vehicle driving control strategy. Thus, problems such as the single design function of the steering wheel and the relatively fixed monitoring performance are solved. The driving behavior data, the driving physiological state data, and the vehicle's environmental data of the user are acquired through a multi-functional acquisition module, thereby improving the interaction function design of the steering wheel and meeting the diversified needs of users.

[0033] A third - aspect embodiment of the present application provides an interactive control method for a vehicle steering wheel. The method uses the interactive control system for a vehicle steering wheel described in any one of the above, and wherein the method includes the following steps:

[0034] Detect whether the user's identity information meets the driving conditions;

[0035] When the user's identity information meets the driving conditions, collect the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data, so as to generate a driving control strategy for the vehicle according to the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data;

[0036] Control the vehicle to perform a target action based on the driving control strategy of the vehicle.

[0037] Further, in some embodiments, the collecting of the user's driving physiological state data includes:

[0038] Collect the user's body temperature data, the user's heart rate data, the user's blood oxygen data, and the user's breathing rate;

[0039] When the user's body temperature data does not meet the preset body temperature data, or the user's heart rate data does not meet the preset heart rate threshold, or the user's blood oxygen data does not meet the preset blood oxygen threshold, or the user's breathing rate does not meet the preset breathing rate threshold, generate a physiological state warning reminder;

[0040] Adjust the preset gas concentration and the vehicle interior temperature based on the user's body temperature data, the user's heart rate data, the user's blood oxygen data, and the user's breathing rate.

[0041] According to the interactive control method for a vehicle steering wheel of the embodiments of the present application, the detection module detects whether the user's identity information meets the driving conditions. When the user's identity information meets the driving conditions, the acquisition module collects the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data, so as to generate a driving control strategy for the vehicle according to the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data, and the control module uses the multi - source data fusion algorithm to control the vehicle to perform a target action based on the driving control strategy of the vehicle. Thus, problems such as the single - function design of the steering wheel and the relatively fixed monitoring performance are solved. By using the multi - function acquisition module to collect the user's driving behavior data, driving physiological state data, and vehicle environmental data, the interactive function design of the steering wheel is improved, meeting the diverse needs of users.

[0042] Additional aspects and advantages of the present application will be given in part in the following description, become apparent in part from the following description, or be learned through the practice of the present application. Brief Description of the Drawings

[0043] The above-mentioned and / or additional aspects and advantages of the present application will become apparent and be readily understood from the following description of embodiments in conjunction with the accompanying drawings, where:

[0044] Figure 1 is a block diagram of an interactive control system for a vehicle steering wheel provided according to an embodiment of the present application;

[0045] Figure 2 is a schematic diagram of the multi-functional design of the steering wheel according to an embodiment of the present application;

[0046] Figure 3 is a flowchart of an interactive control method for a vehicle steering wheel according to an embodiment of the present application. Detailed Embodiments

[0047] Embodiments of the present application will be described in detail below. Examples of the embodiments are shown in the accompanying drawings, where the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to explain the present application and should not be construed as limiting the present application.

[0048] An interactive control system for a vehicle steering wheel, a vehicle, and a method according to embodiments of the present application will be described below with reference to the accompanying drawings. In view of the problems of the single function design of the steering wheel and the relatively fixed monitoring performance mentioned in the above background art, the present application provides an interactive control system for a vehicle steering wheel. In this system, a detection module is used to detect whether the user's identity information meets the driving conditions. When the user's identity information meets the driving conditions, a collection module is used to collect the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data, so as to generate a driving control strategy for the vehicle based on the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data, and a control module is used to control the vehicle to perform a target action based on the driving control strategy of the vehicle by using a multi-source data fusion algorithm. Thus, problems such as the single function design of the steering wheel and the relatively fixed monitoring performance are solved. The driving behavior data, the driving physiological state data, and the vehicle's environmental data of the user are collected through a multi-functional collection module, thereby improving the interactive function design of the steering wheel and meeting the diversified needs of users.

[0049] Specifically, Figure 1 is a block diagram of an interactive control system for a vehicle steering wheel provided according to an embodiment of the present application.

[0050] As Figure 1As shown, the interactive control system 10 of the vehicle steering wheel includes: a detection module 100, a collection module 200, and a control module 300.

[0051] Among them, the detection module 100 is used to detect whether the user's identity information meets the driving conditions; the collection module 200 is used to collect the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data when the user's identity information meets the driving conditions, so as to generate a vehicle driving control strategy based on the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data; the control module 300 is used to control the vehicle to perform target actions based on the vehicle's driving control strategy by using a multi-source data fusion algorithm.

[0052] Specifically, in the related art, the functions of the vehicle steering wheel are relatively single and cannot meet the functional requirements of users for the steering wheel, which will reduce the personalized interaction between the user and the vehicle. Therefore, in the embodiments of the present application, a multi-functional interaction design is carried out on the steering wheel based on factors such as the user's health status, driving status, and the vehicle interior environment, so that the steering wheel can control the vehicle to perform different target actions correspondingly based on the vehicle interior environment, the user's health status, and the driving status, thereby ensuring the user's driving safety and meeting the user's personalized needs.

[0053] Specifically, as Figure 2 shown, the multi-functional design of the steering wheel in the embodiments of the present application mainly includes a steering wheel body, a detection module 100, such as a fingerprint touch collection module 1, a pressure plate 2, a collection module 200, such as a heart rate and blood oxygen module 3, an infrared probe opening 4, an infrared wrist temperature collection module 5, data processing units 6 (two), a CO2 and temperature collection module 7, a ventilation hole 8, a microphone opening 9, etc., and a control module 300, so as to collect the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data through the above-mentioned various modules, generate a vehicle driving control strategy based on the collected data, and control the vehicle to perform target actions by using a multi-source data fusion algorithm based on the driving control strategy to meet the user's driving requirements.

[0054] Among them, as Figure 2As shown in the figure, the steering wheel serves as the main body to provide an installation structure for other modules. There are microphone openings and ventilation holes on its surface. The CO2 and temperature acquisition module 7 and the microphone opening 9 are embedded directly below the steering wheel. The steering wheel is connected to the data processing unit 6 through a wire harness to provide power supply. The communication method is to communicate with the data processing unit 6 through a serial port. The microphone audio data on the steering wheel is differentially output through two twisted pairs to the cockpit domain controller for audio processing. The infrared wrist temperature acquisition module 5, the pressure plate 2, the fingerprint touch acquisition module 1, and the heart rate and blood oxygen module 3 are distributed on both sides of the steering wheel and communicate and supply power with the data processing unit 6 through the CAN (Controller Area Network) bus. The two data processing units 6 are respectively distributed below the buttons on both sides of the airbag, responsible for processing and receiving information from each module, and are connected to the cockpit domain controller through an Ethernet bus. The two data processing units 6 communicate through a flexible cable for CAN bus communication, and the power is provided by the battery or the cockpit domain controller. One of the data processing units 6 is additionally responsible for integrating and packing the data and sending it to the cockpit domain controller through the Ethernet for processing.

[0055] Further, in some embodiments, the detection module 100 includes: an information acquisition unit for acquiring the user's identity information, where the identity information includes at least one of the user's fingerprint information, facial feature information, and voiceprint information; and an information determination unit for determining that the user's identity information meets the driving conditions when the user's identity information satisfies the user's identity recognition verification.

[0056] Specifically, to ensure the vehicle and property safety of the user, first, before the user uses the vehicle, it is necessary to verify the user's identity information, mainly including at least one of the user's fingerprint information, facial feature information, and voiceprint information. If the user's identity information meets the driving conditions, the vehicle is controlled to start.

[0057] Specifically, first, at least one of the user's fingerprint information, facial feature information, and voiceprint information is acquired through the information acquisition unit. For example, the user's fingerprint information is acquired through the fingerprint touch acquisition module 1, and the current hash value corresponding to the real-time acquired fingerprint information is calculated through the SHA (Secure Hash Algorithm)-3 algorithm. The current hash value is matched with the hash value corresponding to the pre-stored fingerprint information. If the current hash value matches the pre-stored hash value, it means that the user's identity information satisfies the user's identity recognition verification, and it can be determined that the user's identity information meets the driving conditions.

[0058] Optionally, embodiments of the present application can also collect the user's facial information in real time through a facial collection module, extract feature vectors from the collected facial information in real time, for example, only analyze areas related to the driving state such as the eyes and mouth (such as detecting the blink frequency), blur or ignore other facial areas, and convert the extracted feature vectors into irreversible identifiers through a one-way hash function (such as SHA-256), and match them with the irreversible identifiers corresponding to the pre-stored feature vectors. If the match is passed, it indicates that the user's identity information meets the user's identity verification, and it can be determined that the user's identity information meets the driving conditions.

[0059] Optionally, embodiments of the present application can also collect the user's voiceprint information in real time through a voiceprint collection module, extract feature vectors from the collected voiceprint information in real time, for example, extract information such as the user's vocal cord vibration characteristics, and perform SHA-3-256 hash processing on the extracted feature vectors to generate a unique identifier, and match the identifier with the pre-stored identifier. If the match is passed, it indicates that the user's identity information meets the user's identity verification, and it can be determined that the user's identity information meets the driving conditions.

[0060] It should be noted that the fingerprint touch collection module 1 provides fingerprint data entry after the vehicle is started. The fingerprint data is encrypted by the data processing unit 6 and provided to the vehicle controller. The vehicle controller decrypts it to judge the user, and then can switch different system menus and personalized settings according to different users. After entering the system, the fingerprint touch collection module 1 no longer performs fingerprint collection, but only functions as a touchpad, and can provide four-way sliding operations and single / double click operations.

[0061] Thus, based on the above identity verification method, the vehicle property safety of the user is guaranteed.

[0062] Furthermore, in some embodiments, the collection module 200 includes: an environment collection unit for collecting the preset gas concentration inside the vehicle and the internal temperature of the vehicle; an environment warning unit for generating an in-vehicle environment warning reminder when the preset gas concentration is greater than the preset concentration threshold, or when the internal temperature of the vehicle is greater than the preset temperature threshold.

[0063] Further, in some embodiments, the acquisition module 200 further includes: a driving physiological state acquisition unit, configured to acquire the user's body temperature data, the user's heart rate data, the user's blood oxygen data, and the user's breathing rate; a physiological state warning unit, configured to generate a physiological state warning reminder when the user's body temperature data does not meet the preset body temperature data, or the user's heart rate data does not meet the preset heart rate threshold, or the user's blood oxygen data does not meet the preset blood oxygen threshold, or the user's breathing rate does not meet the preset breathing rate threshold; a policy generation unit, configured to adjust the preset gas concentration and the vehicle interior temperature based on the user's body temperature data, the user's heart rate data, the user's blood oxygen data, and the user's breathing rate.

[0064] Among them, the preset concentration threshold, the preset temperature threshold, the preset body temperature data, the preset heart rate threshold, the preset blood oxygen threshold, and the preset breathing rate threshold can all be set by those skilled in the art according to actual driving requirements, or can be obtained through a limited number of computer simulations, and no specific limitation is made here.

[0065] Specifically, after determining that the user's identity information meets the driving conditions, the environmental acquisition unit (such as the CO2 and temperature acquisition module 7) acquires the preset gas concentration (such as the CO2 concentration) inside the vehicle and the vehicle interior temperature. Among them, the CO2 and temperature acquisition module 7 uses non-dispersive infrared technology to acquire the CO2 concentration. Since the infrared radiation emitted by the infrared light source changes after being absorbed by a certain concentration of CO2 gas, the spectral intensity proportional to the CO2 gas concentration will change. Therefore, by calculating the change in the spectral light intensity, the concentration of the CO2 gas can be deduced.

[0066] Further, when the vehicle is in the power-off state, the CO2 and temperature acquisition module 7 can be used to acquire the CO2 concentration inside the vehicle and the vehicle interior temperature to help the user view them on the mobile phone APP (Application, application software). Since the CO2 concentration and the vehicle interior temperature will affect the user's driving health, when the CO2 concentration is greater than the preset concentration threshold (for example, the CO2 concentration is greater than 1000 ppm), or the vehicle interior temperature is greater than the preset temperature threshold (for example, the vehicle interior temperature is greater than 25 °C), the user can be reminded to conveniently open the window or turn on the air conditioner for ventilation in advance to provide a comfortable driving experience.

[0067] Furthermore, if the vehicle is in a driving state, the gas exhaled by the user will disturb the airflow, resulting in a change in the CO2 concentration near the steering wheel. When the CO2 concentration is low, it is the CO2 concentration inside the vehicle, and when the CO2 concentration is high, it is the exhaled CO2 gas concentration. Thus, the user's breathing rate can be judged. In addition, by cooperating with the data of the driving physiological state acquisition unit (such as the heart rate and blood oxygen module 3), when the user's blood oxygen is low (for example, the blood oxygen concentration is less than 92%) and the CO2 concentration inside the vehicle reaches a certain threshold (for example, the CO2 concentration is greater than 1000 ppm), an early warning reminder for the vehicle interior environment is generated at this time. For example, a prompt such as "The oxygen concentration inside the vehicle is low, please ventilate in time" can be displayed on the instrument or the multimedia display screen.

[0068] For example, during driving, if the CO2 gas concentration inside the vehicle is detected to be 900 ppm, at this time, prompts such as "The air inside the vehicle is slightly turbid, and the ventilation has been automatically enhanced" can be displayed through the multimedia display screen; if the blood oxygen of the user is detected to be 93% through the heart rate and blood oxygen module 3, at this time, the blood oxygen is slightly low, and prompts such as "The blood oxygen is slightly low, the ventilation has been enhanced, please keep natural breathing" can be displayed through the multimedia display screen; if the CO2 gas concentration inside the vehicle is detected to be 1200 ppm + blood oxygen < 90%, at this time, the CO2 gas concentration is greater than 1000 ppm and the blood oxygen concentration is less than 92%, at this time, prompts such as "Severe hypoxia! Maximum ventilation is in progress, please stop safely immediately" can be displayed through the multimedia display screen.

[0069] Furthermore, if the temperature data of the user detected by the driving physiological state acquisition unit (such as the infrared wrist temperature acquisition module 5) does not meet the preset temperature data (for example, body temperature > 37.3°C), it can be determined at this time that the user's body temperature is on the high side, and an early warning reminder for the physiological state is generated at this time, and the temperature inside the vehicle is adjusted; if the heart rate data of the user collected by the driving physiological state acquisition unit does not meet the preset heart rate threshold (such as heart rate > 90), it can be determined at this time that the user is in a state of stress or fatigue or heat stress, and the rapid cooling mode can be triggered at this time by adjusting the temperature inside the vehicle and enhancing ventilation.

[0070] Among them, the embodiment of the present application can also be adjusted in coordination with the CO2 concentration. For example, when CO2 > 1000 ppm and heart rate > 85, the fresh air volume can be preferentially increased rather than overcooled.

[0071] Furthermore, during the process of adjusting the preset gas concentration and the temperature inside the vehicle, the vehicle system can record the temperature preferences corresponding to the user at different heart rates to gradually optimize the adjustment strategy. For example, user A is used to cooling down by 1°C when the heart rate is 85, and the system will preferentially adopt this preference at this time.

[0072] It should be noted that in the embodiments of the present application, the infrared wrist temperature acquisition module 5 mainly calculates the body temperature change of the user by collecting the infrared radiation emitted by the user's wrist, so as to monitor the user's health condition; the heart rate and blood oxygen module 3 uses photoplethysmography to collect the user's heart rate and blood oxygen data. Oxygenated hemoglobin and hemoglobin in the human artery have different absorption rates for light of different wavelengths, while other tissues such as muscles, bones, and veins have basically the same absorption rate for light. The photodiode converts the intensity of the reflected light into an electrical signal, and the ADC (Analog-to-Digital Converter) collects the magnitude of the current generated during reflection to calculate data such as the user's heart rate and blood oxygen, so as to provide the user's health status monitoring during driving to determine whether medical treatment is needed in a timely manner.

[0073] Further, in some embodiments, the acquisition module 200 further includes: a driving behavior acquisition unit for collecting the change frequency of the user's steering wheel grip force and the operation frequency of the steering wheel; a driving behavior warning element for generating a driving behavior warning reminder when the change frequency of the user's steering wheel grip force is greater than a preset grip force frequency, or the operation frequency of the steering wheel is greater than a preset operation frequency, and dynamically adjusting the steering wheel operation mode according to the change frequency of the steering wheel grip force or the operation frequency of the steering wheel.

[0074] Among them, both the preset grip force frequency and the preset operation frequency can be set by those skilled in the art according to actual driving requirements, or can be obtained through a limited number of computer simulations, and specific limitations are not made here.

[0075] Specifically, the embodiments of the present application can collect the change frequency of the user's steering wheel grip force and the operation frequency of the steering wheel through the driving behavior acquisition unit (such as the pressure plate 2) to optimize the steering wheel operation mode, driving mode adaptation, and safety warning by adjusting the change frequency of the steering wheel grip force and the operation frequency of the steering wheel.

[0076] Among them, the pressure plate 2 can use a ceramic capacitive pressure sensor to measure the change in the grip force of the driver's steering wheel to provide different steering wheel assistances, and can also be used in combination with the user's heart rate and blood oxygen data for steering wheel release detection.

[0077] Specifically, the steering wheel grip force change frequency can be represented by GFVR (Grip Force Variation Rate), which is defined as the degree of fluctuation of the grip force intensity per unit time (unit: N / s). Thus, the steering wheel grip force change frequency of the user can be collected through the pressure plate 2 (for example, at the 3 / 9 o'clock position of the steering wheel, sampling rate ≥ 100Hz), and the vehicle vibration noise can be removed through the Kalman filter algorithm, so as to ensure the accuracy of the steering wheel grip force change frequency. In the embodiments of the present application, different steering wheel grip force change frequencies correspond to different steering wheel operation modes.

[0078] For example, if the GFVR is 0 to 1 N / s, it can be determined that the vehicle is in a steady driving (relaxed state) at this time, and the corresponding steering wheel operation mode can be a gentle mode; if the GFVR is 1 to 3 N / s, it can be determined that the vehicle is in normal control (moderate force) at this time, and the corresponding steering wheel operation mode can be a standard mode; if the GFVR is 3 to 5 N / s, it can be determined that the vehicle is in intense driving (high dynamic adjustment) at this time, and the corresponding steering wheel operation mode can be a sports mode; if the GFVR is > 5 N / s, it can be determined that the vehicle is in abnormal fluctuation (fatigue / disease) at this time, and the corresponding steering wheel operation mode can be to trigger a safety warning + gradually increase the damping.

[0079] Furthermore, if the GFVR suddenly rises in a short period (such as 0.5 N / s → 4 N / s), the user may be in a state of muscle twitching or sudden illness at this time. Therefore, it is necessary to generate a driving behavior warning reminder, such as triggering an audible and visual alarm, and dynamically adjusting the steering wheel operation mode according to the steering wheel grip force change frequency; if the GFVR drops in a long period (such as continuously < 0.3 N / s for 5 minutes), the user may be in a state of fatigue driving at this time. Therefore, it is necessary to generate a driving behavior warning reminder, such as starting a seat vibration reminder, and dynamically adjusting the steering wheel operation mode according to the steering wheel grip force change frequency.

[0080] Furthermore, the steering wheel operation frequency can be represented by SWOF (Steering Wheel Operation Frequency). When the SWOF is <5 times / minute, it can be determined that the user is in a fatigued / overly dependent on assisted driving state at this time. Thus, a driving behavior warning reminder can be generated (such as a voice prompt "Please check your attention"), and an assisted return torque of 0.5 to 1 N·m is applied to the steering wheel to prevent the user from unconsciously deviating from the lane. When the SWOF is 5 to 15 times / minute, it can be determined that the user is in normal control at this time, and the standard power assist mode is continued. When the SWOF is 15 to 30 times / minute, it can be determined that the user is in a complex road condition or aggressive driving state at this time, and the road feel feedback needs to be increased to ensure driving safety. When the SWOF is >30 times / minute, it can be determined that the user is in an emergency avoidance or out-of-control state at this time. At this time, a driving behavior warning reminder is generated (such as steering wheel vibration + red alarm on the instrument panel), and the activation of the stable steering assist (automatically compensating for oversteering) process is required to achieve a safer and more user-friendly steering wheel interaction.

[0081] Furthermore, in some embodiments, the acquisition module 200 further includes: an audio acquisition unit for acquiring the user's voice data; and a control unit for controlling the vehicle to perform a target action according to the user's voice data.

[0082] Specifically, first, in the embodiment of the present application, a dual microphone array is integrated at the 3 o'clock and / or 9 o'clock positions of the steering wheel to directionally acquire the user's voice data, and the spectral subtraction suppression engine or wind noise is used to reduce the noise of the voice data to achieve the purpose of noise reduction of the voice data. Second, keyword recognition of the voice data is performed. For example, if the user's voice information collected is "lower the temperature inside the vehicle by 2 degrees", the key information "lower the temperature by 2 degrees" can be recognized at this time. Then, according to the user's voice data, the air conditioner is controlled to lower the temperature inside the vehicle by 2 degrees. However, to ensure driving safety, before the vehicle performs the target action, it is also necessary to determine the risk level of the user's voice data. For example, if the user's voice data collected is of a low risk level (such as temperature adjustment, music, etc.), the temperature adjustment action or music playback action of the vehicle can be immediately performed at this time. If the user's voice data collected is of a medium risk level (such as switching the driving mode), a secondary confirmation is required at this time (such as pressing the steering wheel button for secondary confirmation), and after the secondary confirmation, the vehicle's switching driving mode action is performed. If the user's voice data collected is of a high risk level (such as emergency braking), a dual authentication is required at this time (such as voiceprint + fingerprint dual authentication), and after the authentication is passed, the vehicle's emergency braking action is performed.

[0083] Further, after the vehicle executes the target action, real-time feedback on the executed target action is required. For example, the execution result of the target action can be displayed on the display screen (such as the temperature has been increased by 2 degrees). If the user accidentally wakes up the voice by mistake, the user can not issue an instruction within 5 seconds, so that the voice mode can be automatically exited.

[0084] Further, in some embodiments, the acquisition module 200 further includes: a gesture acquisition unit for acquiring the gesture sliding position of the user; a gesture generation unit for generating the gesture information of the user according to the gesture sliding position; and a gesture recognition unit for matching the best interaction action from a preset gesture database according to the gesture information of the user, so as to control the vehicle to execute the target action according to the best interaction action.

[0085] Among them, the preset gesture database can be related gesture actions pre-stored by the user.

[0086] Specifically, first, in the fingerprint touch acquisition module 1, the gesture acquisition unit acquires the gesture sliding position of the user, such as acquiring the starting position and the ending position of the user's gesture, and maps the gesture starting position and the gesture ending position to gesture coordinates. For example, the left and right directions of the steering wheel are defined (left swipe = negative, right swipe = positive), and the up and down directions of the steering wheel are defined (up swipe = positive, down swipe = negative), so that the gesture information of the user can be generated according to the coordinate mapping result. For example, if the gesture is a swipe from right to left, it can represent the activation of the left turn signal + a slight left adjustment of the lane keeping assist at this time. If the gesture is a swipe from bottom to top, it can represent an increase in volume / opening of the sunroof, etc.

[0087] Further, when the vehicle is in a low-speed driving state (such as <20 km / h), it can also be set that the best interaction action can be triggered by a small gesture at this time. When the vehicle is in a high-speed driving state (such as >80 km / h), it can be set that the best interaction action can be triggered by a complete gesture, so as to ensure the driving safety of the user. If there is an accidental gesture operation, it can also be cancelled by means such as voice or double-clicking the steering wheel, so as to improve the personalized interaction experience of the user.

[0088] In summary, based on the above multi-functional design of the steering wheel, the embodiments of the present application can achieve the following beneficial effects:

[0089] (1) By synchronously analyzing data such as the user's heart rate, blood oxygen, breathing rate, and body temperature, the present application improves the accuracy of user fatigue recognition, so that the user can match corresponding driving strategies in different physiological states, which not only ensures the driving safety of the user, but also improves the driving and riding experience of the user;

[0090] (2) This application automatically switches modes (gentle / standard / sports) according to the change rate of the steering wheel grip force, which can reduce the degree of muscle fatigue of the user, so that the user can match the corresponding driving strategies in different driving behavior states, thereby enhancing the user's driving and riding experience;

[0091] (3) This application identifies the user's identity information (voiceprint, fingerprint, facial expression, etc.), which ensures the safety of the user's vehicle property. At the same time, according to the collection of different user identities, the driving preferences of the user can be correspondingly matched, so as to meet the driving needs of different users.

[0092] According to the vehicle steering wheel interaction control system of the embodiment of the present application, the detection module detects whether the user's identity information meets the driving conditions. When the user's identity information meets the driving conditions, the acquisition module acquires the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data, so as to generate the vehicle's driving control strategy according to the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data, and the control module uses the multi-source data fusion algorithm to control the vehicle to execute the target action based on the vehicle's driving control strategy. Thus, problems such as the single design function of the steering wheel and the relatively fixed monitoring performance are solved. By using the multi-functional acquisition module to acquire the user's driving behavior data, driving physiological state data, and vehicle environmental data, the interaction function design of the steering wheel is improved, and the diversified needs of users are met.

[0093] The embodiment of the present application also provides a vehicle, which includes the above-mentioned vehicle steering wheel interaction control system.

[0094] According to the vehicle of the embodiment of the present application, the detection module detects whether the user's identity information meets the driving conditions. When the user's identity information meets the driving conditions, the acquisition module acquires the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data, so as to generate the vehicle's driving control strategy according to the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data, and the control module uses the multi-source data fusion algorithm to control the vehicle to execute the target action based on the vehicle's driving control strategy. Thus, problems such as the single design function of the steering wheel and the relatively fixed monitoring performance are solved. By using the multi-functional acquisition module to acquire the user's driving behavior data, driving physiological state data, and vehicle environmental data, the interaction function design of the steering wheel is improved, and the diversified needs of users are met.

[0095] Figure 3 It is a flowchart of the vehicle steering wheel interaction control method of the embodiment of the present application.

[0096] As Figure 3As shown, the interactive control method of the vehicle steering wheel adopts the above-mentioned interactive control system of the vehicle steering wheel. Among them, the method includes the following steps:

[0097] In step S301, it is detected whether the user's identity information meets the driving conditions.

[0098] In step S302, when the user's identity information meets the driving conditions, the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data are collected to generate a vehicle driving control strategy based on the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data.

[0099] In step S303, the vehicle is controlled to perform the target action based on the vehicle's driving control strategy.

[0100] Further, in some embodiments, collecting the user's driving physiological state data includes:

[0101] Collecting the user's body temperature data, the user's heart rate data, the user's blood oxygen data, and the user's breathing rate;

[0102] When the user's body temperature data does not meet the preset body temperature data, or the user's heart rate data does not meet the preset heart rate threshold, or the user's blood oxygen data does not meet the preset blood oxygen threshold, or the user's breathing rate does not meet the preset breathing rate threshold, a physiological state warning reminder is generated;

[0103] Adjust the preset gas concentration and the vehicle interior temperature based on the user's body temperature data, the user's heart rate data, the user's blood oxygen data, and the user's breathing rate.

[0104] According to the interactive control method of the vehicle steering wheel in the embodiments of the present application, it is detected by the detection module whether the user's identity information meets the driving conditions. When the user's identity information meets the driving conditions, the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data are collected by the collection module to generate a vehicle driving control strategy based on the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data, and the control module is used to control the vehicle to perform the target action based on the vehicle's driving control strategy by using the multi-source data fusion algorithm. Thus, problems such as the single design function of the steering wheel and the relatively fixed monitoring performance are solved. The user's driving behavior data, driving physiological state data, and vehicle environmental data are collected by the multi-functional collection module, thereby improving the interactive function design of the steering wheel and meeting the diversified needs of users.

[0105] In the description of this specification, the descriptions referring to terms such as "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" etc. mean that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of this application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in any one or N embodiments or examples in a suitable manner. In addition, without contradiction, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples.

[0106] In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include at least one of such features. In the description of this application, the meaning of "N" is at least two, such as two, three, etc., unless otherwise specifically defined.

[0107] Any process or method description shown in the flowchart or described in other ways herein can be understood as representing a module, segment, or part of code including one or more N executable instructions for implementing a customized logical function or process, and the scope of the preferred embodiments of this application includes additional implementations, where the functions can be executed in a substantially simultaneous manner or in a reverse order according to the functions involved, rather than in the order shown or discussed, which should be understood by those skilled in the art of the embodiments of this application.

[0108] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a definable sequence list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other systems that can fetch and execute instructions from the instruction execution system, apparatus, or device), or used in conjunction with these instruction execution systems, apparatus, or devices. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer-readable media include the following: an electrical connection portion (electronic device) having one or N wirings, a portable computer diskette (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium can even be paper or other suitable media on which a program can be printed, because the program can be obtained electronically, for example, by optically scanning the paper or other media, followed by editing, interpretation, or otherwise processing as appropriate, and then storing it in a computer memory.

[0109] It should be understood that the various parts of the present application can be implemented using hardware, software, firmware, or a combination thereof. In the above-described embodiments, the N steps or methods can be implemented using software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented using hardware, as in another embodiment, any one or a combination of the following techniques well known in the art can be used: discrete logic circuits having logic gate circuits for implementing logical functions on data signals, application-specific integrated circuits having appropriate combinational logic gate circuits, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0110] Those of ordinary skill in the art of this technology can understand that all or part of the steps carried by the method of implementing the above embodiments can be completed by a program instructing relevant hardware. The program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiments.

[0111] In addition, each functional unit in various embodiments of the present application may be integrated into one processing module, or each unit may exist physically alone, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. When the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0112] The above-mentioned storage medium may be a read-only memory, a magnetic disk, an optical disc, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present application. Those of ordinary skill in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present application.

Claims

1. An interactive control system for a vehicle steering wheel, characterized in that: include: A detection module, used to detect whether the user's identity information meets the driving conditions; a collection module, configured to collect the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data when the user's identity information satisfies the driving condition, so as to generate a driving control strategy for the vehicle according to the user's driving behavior data, the user's driving physiological state data, and the vehicle's environmental data; The control module is used to control the vehicle to perform a target action based on the driving control strategy of the vehicle and using a multi-source data fusion algorithm.

2. The system according to claim 1, characterized in that The detection module comprises: An information collection unit, configured to collect the identity information of the user, wherein the identity information includes at least one of the fingerprint information, facial feature information, and voiceprint information of the user; The information determination unit is used to determine that the identity information of the user meets the driving condition when the identity information of the user meets the identity recognition verification of the user.

3. The system according to claim 1, characterized in that The acquisition module comprises: An environment collection unit, used to collect a preset gas concentration and an internal temperature of the vehicle; The environmental warning unit is used to generate an environmental warning reminder inside the vehicle when the preset gas concentration is greater than a preset concentration threshold, or the internal temperature of the vehicle is greater than a preset temperature threshold.

4. The system according to claim 3, characterized in that The acquisition module further includes: A driving behavior collection unit, used to collect the user's steering wheel grip force change frequency and steering wheel operation frequency; The driving behavior warning unit is used to generate a driving behavior warning reminder when the user's steering wheel grip force change frequency is greater than a preset grip force frequency, or the steering wheel operation frequency is greater than a preset operation frequency, and dynamically adjust the steering wheel operation mode according to the steering wheel grip force change frequency or the steering wheel operation frequency.

5. The system according to claim 4, characterized in that The acquisition module further includes: A driving physiological state collection unit, used to collect the user's body temperature data, the user's heart rate data, the user's blood oxygen data and the user's breathing frequency; A physiological state warning unit, configured to generate a physiological state warning reminder when the body temperature data of the user does not meet the preset body temperature data, or the heart rate data of the user does not meet the preset heart rate threshold, or the blood oxygen data of the user does not meet the preset blood oxygen threshold, or the breathing rate of the user does not meet the preset breathing rate threshold; A strategy generating unit is used to adjust the preset gas concentration and the vehicle interior temperature based on the user's body temperature data, the user's heart rate data, the user's blood oxygen data and the user's breathing frequency.

6. The system according to claim 5, characterized in that The acquisition module further includes: An audio collection unit, used to collect voice data of the user; A control unit is used to control the vehicle to perform a target action according to the user's voice data.

7. The system according to claim 6, characterized in that The acquisition module further includes: A gesture collection unit, used to collect the gesture sliding position of the user; A gesture generating unit, used to generate the gesture information of the user according to the gesture sliding position; A gesture recognition unit is used to match the best interaction action from a preset gesture database according to the user's gesture information, so as to control the vehicle to perform a target action according to the best interaction action.

8. A vehicle, characterized in that: include: An interactive control system for a vehicle steering wheel as claimed in any one of claims 1 to 7.

9. A method for interactive control of a vehicle steering wheel, characterized in that: An interactive control system for a vehicle steering wheel according to any one of claims 1 to 7, wherein the method comprises the following steps: Check whether the user's identity information meets the driving conditions; When the identity information of the user meets the driving condition, collecting the driving behavior data of the user, the driving physiological state data of the user and the environmental data of the vehicle, so as to generate a driving control strategy of the vehicle according to the driving behavior data of the user, the driving physiological state data of the user and the environmental data of the vehicle; The vehicle is controlled to perform a target action based on the driving control strategy of the vehicle.

10. The method according to claim 9, characterized in that The collecting of the driving physiological state data of the user includes: Collecting the user's body temperature data, the user's heart rate data, the user's blood oxygen data, and the user's breathing rate; When the body temperature data of the user does not meet the preset body temperature data, or the heart rate data of the user does not meet the preset heart rate threshold, or the blood oxygen data of the user does not meet the preset blood oxygen threshold, or the breathing rate of the user does not meet the preset breathing rate threshold, a physiological state warning reminder is generated; The preset gas concentration and the vehicle interior temperature are adjusted based on the user's body temperature data, the user's heart rate data, the user's blood oxygen data, and the user's breathing frequency.

Images