Vehicle start control method, device and electronic equipment

By using door edge force sensors and various feature data to confirm the driver's emotional state when the vehicle is not in motion, and delaying the vehicle start-up, the problem of driver instability affecting driving safety is solved, thus improving driving safety.

CN118753299BActive Publication Date: 2025-11-07GUANGZHOU AUTOMOBILE GROUP CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202410962367.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-07-17
Publication Date
2025-11-07
Estimated Expiration
2044-07-17

AI Technical Summary

Technical Problem

Existing in-vehicle passenger monitoring systems have not been able to effectively improve driving safety when monitoring the state of the driver or passengers, especially when the driver is emotionally unstable, which may affect driving safety.

Method used

By using door edge force sensor data to determine the driver's emotional state when the vehicle is not in motion, and combining it with first driving characteristic data, first body temperature characteristic data and first voice characteristic data for multiple confirmations, if the emotional state is still unstable, the accelerator pedal sensor is triggered to be turned off within a specified time to delay the start of the vehicle.

Benefits of technology

To ensure that drivers are in a relatively calm and stable emotional state while driving, improve driving safety and avoid safety risks caused by emotional instability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118753299B_ABST
    Figure CN118753299B_ABST
Patent Text Reader

Abstract

The application discloses a vehicle starting control method and device and electronic equipment. The method comprises the following steps: acquiring door edge force sensor data corresponding to a driving position when a vehicle is in a non-driving state, and determining the emotional state of a driver based on the door edge force sensor data; if the emotional state indicates that the driver has a first emotional tendency, acquiring first emotional feature data of the driver; determining the emotional state of the driver again based on the first emotional feature data; if the emotional state determined again still indicates that the driver has the first emotional tendency, triggering the closing of a throttle pedal sensor of the vehicle within a specified time length to control the delayed starting of the vehicle. The method determines the emotional tendency of the driver multiple times, and triggers the vehicle starting control mode under the corresponding emotional tendency based on the determined emotional tendency, so that the driver can drive in a relatively calm and stable emotional state, and the driving safety is improved.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of intelligent control, and more particularly, to a vehicle starting control method and device and electronic equipment. BACKGROUND

[0002] With the rapid development of automobile technology and the improvement of intelligent level, the functions of intelligent vehicles are gradually improved, and the safety performance is also concerned. As a way, the state of the driver or passenger can be monitored in real time through OMS (Occupancy Monitoring System, vehicle passenger monitoring system) to prevent traffic accidents. However, the current state monitoring scheme still needs to be improved, which affects the safety in the driving process to some extent. SUMMARY

[0003] In view of the above problems, the present application provides a vehicle starting control method and device and electronic equipment to improve the above problems.

[0004] In a first aspect, the present application provides a vehicle starting control method, which comprises: acquiring door edge force sensor data corresponding to a driving position when a vehicle is in a non-driving state, and determining an emotional state of a driver based on the door edge force sensor data; if the emotional state represents that the driver has a first emotional tendency, acquiring first emotional feature data of the driver, the first emotional feature data comprising first driving feature data, first body temperature feature data and first voice feature data; determining the emotional state of the driver again based on the first emotional feature data; if the emotional state after the re-determination still represents that the driver has a first emotional tendency, triggering the closing of a throttle pedal sensor of the vehicle within a specified time length to control the delayed starting of the vehicle.

[0005] In a second aspect, the present application provides a vehicle starting control device, which comprises: an emotional state determination module configured to acquire door edge force sensor data corresponding to a driving position when a vehicle is in a non-driving state, and determine an emotional state of a driver based on the door edge force sensor data; an emotional feature data acquisition module configured to acquire first emotional feature data of the driver if the emotional state represents that the driver has a first emotional tendency, the first emotional feature data comprising first driving feature data, first body temperature feature data and first voice feature data; the emotional state determination module is further configured to determine the emotional state of the driver again based on the first emotional feature data; and a vehicle starting control module configured to trigger the closing of a throttle pedal sensor of the vehicle within a specified time length if the emotional state after the re-determination still represents that the driver has a first emotional tendency, to control the delayed starting of the vehicle.

[0006] In a third aspect, the present application provides an electronic device, comprising one or more processors and a memory; one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method described above.

[0007] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores program codes, and the program codes perform the method described above when the program codes are executed.

[0008] The vehicle starting control method, device and electronic device provided by the present application can obtain door edge force sensor data corresponding to the driver's seat when the vehicle is in a non-driving state, and determine the emotional state of the driver based on the door edge force sensor data. If the emotional state indicates that the driver has a first emotional tendency, the first emotional feature data of the driver is obtained, and the first emotional feature data includes first driving feature data, first body temperature feature data and first voice feature data. The emotional state of the driver is determined again based on the first emotional feature data. If the emotional state determined again still indicates that the driver has a first emotional tendency, the throttle pedal sensor of the vehicle is closed within a specified time period to control the delayed starting of the vehicle. The method determines the emotional tendency of the driver multiple times, and then triggers the vehicle starting control mode under the corresponding emotional tendency based on the determined emotional tendency, so as to ensure that the driver can drive in a relatively calm and stable emotional state, thereby improving the safety during driving. BRIEF DESCRIPTION OF DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0010] Figure 1 A flowchart of a vehicle starting control method according to an embodiment of the present application is shown.

[0011] Figure 2 A flowchart of a vehicle starting control method according to another embodiment of the present application is shown.

[0012] Figure 3 A flowchart of a vehicle starting control method according to another embodiment of the present application is shown.

[0013] Figure 4 A flowchart of the method of step S332 in Figure 3 is shown.

[0014] Figure 5 A structural block diagram of a vehicle starting control device is shown.

[0015] Figure 6 A structural block diagram of an electronic device is shown. DETAILED DESCRIPTION

[0016] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present application.

[0017] In the embodiments of the present application, the inventor proposes a vehicle starting control method and device and an electronic device. In the vehicle is in a non-driving state, door edge force sensor data corresponding to a driving position is acquired, and the emotional state of a driver is determined based on the door edge force sensor data. If the emotional state indicates that the driver has a first emotional tendency, first emotional feature data of the driver is acquired, the first emotional feature data including first driving feature data, first body temperature feature data, and first voice feature data. The emotional state of the driver is determined again based on the first emotional feature data. If the emotional state determined again still indicates that the driver has a first emotional tendency, a throttle pedal sensor of the vehicle is closed within a specified time length, so as to control the delayed starting of the vehicle. The method determines the emotional tendency of the driver multiple times, and then triggers the vehicle starting control mode under the corresponding emotional tendency based on the determined emotional tendency, so as to ensure that the driver can drive in a relatively calm and stable emotional state, thereby improving the safety during driving.

[0018] Please refer to Figure 1 A vehicle starting control method provided by an embodiment of the present application can be applied to an intelligent driving scene, and can be specifically used for controlling the starting of a vehicle or controlling the time when the vehicle starts to start. The method comprises the following steps.

[0019] In step S110, in a vehicle in a non-driving state, door edge force sensor data corresponding to a driving position is acquired, and the emotional state of a driver is determined based on the door edge force sensor data.

[0020] In the embodiments of the present application, the non-driving state of the vehicle can represent the state of the vehicle after being unlocked and before driving. The vehicle in the non-driving state is in a static state, i.e., the vehicle is only unlocked at this time, but the vehicle is not started. As an implementation manner, if it is detected that the driver sits on the driving seat after the vehicle is unlocked, but the vehicle is not started, it can be determined that the vehicle is in the non-driving state. In this regard, whether the driver sits on the driving seat can be detected by a seat pressure sensor, and the specific detection implementation process will not be described here.

[0021] The door edge force sensor can include a force sensor arranged at the door edge of the vehicle. Optionally, a force sensor can be arranged at each door of the vehicle. In the embodiments, the force sensor arranged at the door edge of the driving seat can be used to detect the door closing force signal after the driver gets on the vehicle, so that the door edge force sensor data can include the door closing force signal after the driver gets on the vehicle.

[0022] It can be understood that the driver's emotion affects the driving style to some extent, and when the driver's emotion is in an unstable state, it is easy to affect the driving safety. In order to improve this problem, in the embodiments of the present application, the door edge force sensor data corresponding to the driving seat can be acquired when the vehicle is in the non-driving state, and the emotional state of the driver can be determined based on the door edge force sensor data, so as to monitor the emotional state of the driver before the vehicle drives.

[0023] Optionally, if the driver opens and closes the door of the vehicle multiple times when the vehicle is in the non-driving state, the door closing force signal after the driver gets on the vehicle the last time can be acquired as the door edge force sensor data, i.e., the door edge force sensor data can be dynamically changed.

[0024] In the process of determining the emotional state of the driver based on the door edge force sensor data, the change rate of the door edge force sensor data relative to the corresponding preset data can be acquired first; and then the emotional state of the driver can be determined based on the comparison result of the change rate and the preset threshold. The type of the preset data corresponding to the door edge force sensor is the same as the data type of the door edge force sensor data, i.e., the preset data can be understood as the initial data (preset data) of the door edge force sensor.

[0025] As an implementation manner, the change difference of the door edge force sensor data compared with the preset data thereof can be acquired to obtain the change rate, and then the change rate is compared with the preset threshold, and the emotional state of the driver is determined according to the comparison result. Specifically, if the change rate is greater than the preset threshold, it can be determined that the current emotional state represents that the driver has a first emotional tendency, i.e., the current emotional change of the driver is relatively large; and if the change rate is less than or equal to the preset threshold, it can be determined that the current emotional state represents that the driver does not have the first emotional tendency, i.e., the current emotional change of the driver is relatively small.

[0026] The first emotional tendency can include unstable emotional tendencies such as anger, irritation, restlessness, or excitement. The specific value of the preset threshold can not be limited, for example, the value of the preset threshold can be 20%, 30%, or 50%, and optionally, the value of the preset threshold can also be adjusted according to actual needs.

[0027] In a specific application scenario, assuming that the initial data of the door edge force sensor is F0, and the preset threshold is 20%, the door edge force sensor data F corresponding to the driver's seat can be obtained when it is detected that the vehicle is in a non-driving state. D Then, the emotional state of the driver is determined according to the following formula:

[0028]

[0029] Wherein, The change rate of the door edge force sensor data relative to the corresponding preset data, optionally, if the change rate is greater than 20%, it can be determined that the current emotional change of the driver is large, and the first emotional tendency exists; if the change rate is not greater than 20%, it can be determined that the current emotional change of the driver is small, and the first emotional tendency does not exist.

[0030] Optionally, if it is determined that the driver has the first emotional tendency, it indicates that the user's emotion is relatively intense. In order to accurately determine the emotional state of the driver next time when the vehicle is already in a non-driving state, the initial data of the door edge force sensor can be updated to F D That is, F0=F D That is, the door edge force sensor data of the last time is based on the monitoring data of the last time; and if it is determined that the driver does not have the first emotional tendency, it indicates that the user's emotion is relatively flat. In order to more accurately monitor the emotional state of the driver subsequently, the initial data of the door edge force sensor can still be updated, for example, F0 can be updated by the following formula:

[0031]

[0032] Wherein, F0 on the left side of the formula represents the updated F0.

[0033] Step S120: If the emotional state indicates that the driver has the first emotional tendency, first emotional feature data of the driver is obtained, the first emotional feature data including first driving feature data, first body temperature feature data, and first voice feature data.

[0034] As an implementation, if the initially determined emotional state indicates that the driver has a first emotional tendency, first emotional feature data of the driver can be acquired to determine the emotional state of the driver again through the first emotional feature data. The first emotional feature data includes first driving feature data, first body temperature feature data, and first voice feature data.

[0035] In the embodiment, the first driving feature data can include seat pressure sensor data, steering wheel force sensor data, and seat belt rotation speed sensor data. The seat pressure sensor data can be pressure sensor data installed in the seat, the steering wheel force sensor data can be force sensor data installed on the steering wheel rim, and the seat belt rotation speed sensor data can be rotation speed sensor data installed on the seat belt roller. The first body temperature feature data can be obtained by an infrared temperature sensor installed in the camera or by an infrared temperature sensor installed in the vehicle interior. The first voice feature data includes various types of voice feature data, such as pitch signal, decibel signal, speech rate signal, and text content, etc.

[0036] As an implementation, the first emotional feature data of the driver can be acquired when it is determined that the driver has a first emotional tendency. Specifically, when the initially determined emotional state indicates that the driver has a first emotional tendency, the body swing force (seat vibration amplitude) and vibration frequency (frequency signal) of the driver can be acquired by a pressure sensor installed in the seat, the beating force / intensity of the driver on the steering wheel (steering wheel force signal) can be acquired by a force sensor installed on the steering wheel rim, the speed of the driver pulling the seat belt (seat belt pulling speed signal) can be acquired by a rotation speed sensor installed on the seat belt roller, the current body temperature of the driver (infrared temperature signal) can be acquired by an infrared temperature sensor installed in the camera or separately, and the voice pitch (pitch signal), decibel (decibel signal), speech rate (speech rate signal), and text content, etc. of the driver can be acquired by a voice acquisition device configured in the vehicle. Optionally, the first emotional feature data can be acquired in parallel.

[0037] As another implementation manner, the first emotional feature data can be acquired synchronously while the door edge force sensor data corresponding to the driving position is acquired. In this manner, all the acquired data can be stored in the driver information database, so that when the corresponding data is needed, the corresponding data can be quickly read from the driver information database. Optionally, in the process of storing all the acquired data in the driver information database, the acquired data can be first uploaded to the ECU (Electronic Control Unit, i.e., an electronic control unit, which is a special microcomputer controller in an automobile, also known as a driving computer or a vehicle-mounted computer) of the vehicle, and then transmitted to the driver information database by the ECU of the vehicle for storage.

[0038] Step S130: determining the emotional state of the driver again based on the first emotional feature data.

[0039] It can be understood that the emotional state of the driver preliminarily determined based on the door edge force sensor data can lack accuracy and reliability due to individual differences of the driver. For example, if the driver has a large closing force in a stable emotional state, it can be caused by personal habits. At this time, in order to more accurately determine the emotional state of the driver, the emotional state of the driver can be determined again based on the emotional feature data of the driver. That is, based on the preliminary determination of the emotional state of the driver based on the door edge force sensor data, the emotional state of the driver is determined again based on other emotional feature data of the driver.

[0040] As an implementation manner, in the case where it is preliminarily determined that the driver has the first emotional tendency, in order to improve the accuracy of monitoring the emotional state of the driver, the emotional state of the driver can be determined again based on the first emotional feature data to determine whether the driver really has the first emotional tendency. Optionally, if it is still determined that the driver has the first emotional tendency after the determination again, it is determined that the driver has the first emotional tendency; and if it is not determined that the driver has the first emotional tendency after the determination again, it is determined that the driver does not have the first emotional tendency. By combining the monitoring data of multiple sensors to comprehensively determine the emotional state of the driver, the accuracy, effectiveness and reliability of monitoring the emotional state of the driver can be improved.

[0041] Step S140: if the emotional state after the determination again still indicates that the driver has the first emotional tendency, triggering the closing of the accelerator pedal sensor of the vehicle within a specified time length to control the delayed starting of the vehicle.

[0042] As an implementation, if the re-determined emotional state still represents that the driver has the first emotional tendency, in order to avoid the current emotional state of the driver affecting the driving safety, the accelerator pedal sensor of the vehicle can be triggered to be closed within a specified time period, that is, the accelerator of the vehicle is temporarily disabled to achieve the control of delaying starting the vehicle. Optionally, the accelerator pedal sensor can be automatically unlocked after the specified time period. The specific value of the specified time period can not be limited, for example, the specified time period can be 1 minute or 3 minutes.

[0043] In order to enable the driver to quickly adjust the emotion or avoid misoperation, the voice prompt can be triggered at the same time when the accelerator of the vehicle is temporarily disabled, and the voice prompt can be used to prompt the driver that the current emotional state is not suitable for driving immediately, and the voice prompt can include "your current emotional state is not suitable for driving immediately, please adjust your emotion in time". Optionally, in order to as far as possible not to delay the driver's time, the switch control of "driver unlocking the accelerator" can also be popped up at the same time when the voice prompt is triggered. Optionally, the switch control can be displayed on the central control display screen of the vehicle. If the driver needs to drive immediately, the switch control can be touched to unlock (turn on) the accelerator pedal sensor, so as to quickly start the vehicle.

[0044] In order to as far as possible quickly help the driver to adjust the emotion, the soothing audio can also be played to the driver at the same time when the voice prompt is triggered. The soothing audio can include soothing speech and / or soothing music, and the specific content of the soothing audio can not be limited. For example, soothing speech can be played to the driver first, and then soothing music is played, or soothing speech is played to the driver at the same time when soothing music is played, so as to quickly soothe the extreme emotion of the driver.

[0045] As another implementation, if the re-determined emotional state represents that the driver does not have the first emotional tendency, it can be determined that the emotional state of the driver is a normal emotional state, and at this time the vehicle can be controlled to start normally, that is, the starting time of the vehicle is not limited.

[0046] The vehicle starting control method provided by the embodiment comprises the following steps.

[0047] Please refer to Figure 2 The vehicle starting control method provided by another embodiment of the application comprises the following steps.

[0048] In the step S210, the door edge force sensor data corresponding to the driver's seat is acquired when the vehicle is in a non-driving state, and the emotional state of the driver is determined based on the door edge force sensor data.

[0049] The specific implementation of the step S210 can refer to the related description of the step S110 in the foregoing embodiment, and will not be described here again.

[0050] In the step S220, if the emotional state indicates that the driver has a first emotional tendency, the first emotional feature data of the driver is acquired, and the first emotional feature data comprises first driving feature data, first body temperature feature data and first voice feature data.

[0051] The specific implementation of the step S220 can refer to the related description of the step S120 in the foregoing embodiment, and will not be described here again.

[0052] In the step S230, the change rates of the seat pressure sensor data, the steering wheel force sensor data, the safety belt rotation speed sensor data, the first body temperature feature data and the plurality of types of voice feature data with respect to the respective corresponding preset data are acquired, a plurality of change rates are obtained, and the preset data corresponding to different emotional feature data is different.

[0053] In the process of determining the emotional state of the driver again based on the first emotional characteristic data, as an implementation manner, the change rates of the aforementioned seat pressure sensor data, steering wheel force sensor data, safety belt rotation speed sensor data, first body temperature characteristic data and various types of voice characteristic data with respect to the respective corresponding preset data can be obtained to obtain a plurality of change rates, so as to determine the emotional change amplitude of the driver again according to the plurality of change rates. The preset data corresponding to different emotional characteristic data is different, that is, the preset data corresponding to the seat pressure sensor data is the initial data of the seat pressure sensor, the preset data corresponding to the steering wheel force sensor data is the initial data of the steering wheel force sensor, the preset data corresponding to the safety belt rotation speed sensor data is the initial data of the safety belt rotation speed sensor, and so on.

[0054] Optionally, the process of obtaining the plurality of change rates is similar to the process of obtaining the change rate of the door edge force sensor data with respect to the corresponding preset data, which will not be described here again.

[0055] Step S240: determining the emotional state of the driver again based on the comparison results of the plurality of change rates with the preset threshold.

[0056] As an implementation manner, the plurality of change rates can be compared with the preset threshold, and then the emotional state of the driver is determined again based on the comparison results of the plurality of change rates with the preset threshold. Specifically, the emotional state of the driver can be determined again according to the following formula:

[0057]

[0058] Wherein, X represents the first emotional characteristic data, and i can represent any one of the first emotional characteristic data, that is, i = the driving force of the body swing of the driver (the vibration amplitude of the seat), the vibration frequency (the frequency signal), the driving force of the driver on the steering wheel (the force signal of the steering wheel), the speed of the driver pulling the safety belt (the speed signal of the safety belt), the current body temperature of the driver (the infrared temperature signal), the voice tone of the driver (the tone signal), the decibel (the decibel signal), the speech speed (the speech speed signal) or the text content. Different i corresponds to different X0. If the change rate shown in formula 3 is greater than 20%, it indicates that the driver indeed has the first emotional tendency; if the change rate shown in formula 3 is not greater than 20%, it indicates that the driver does not have the first emotional tendency.

[0059] Optionally, in order to more accurately determine the emotional state of the driver, in the process of determining the emotional state of the driver again based on the comparison results of the plurality of change rates and the preset threshold, it can also be monitored whether there are impolite text words such as abuse in the voice content of the driver. If there are text words such as abuse in the voice content of the driver, it can be represented that the driver indeed has the first emotional tendency. If there are no text words such as abuse in the voice content of the driver, it can be represented that the driver does not have the first emotional tendency.

[0060] It can be understood that if a change rate greater than a preset threshold is determined as the driver indeed having the first emotional tendency, or as long as there are text words such as abuse in the voice content of the driver, it can be determined that the driver indeed has the first emotional tendency, which may result in a misjudgment. As an implementation manner, in order to more fully and accurately evaluate the emotional state of the driver, the comparison results of the plurality of change rates and the preset threshold, and whether there are text words such as abuse in the voice content of the driver can be counted, and then the emotional state of the driver is comprehensively judged according to the statistical results.

[0061] Specifically, the number of change rates whose values are greater than the preset threshold can be counted. Optionally, if there are text words such as abuse in the voice content of the driver, they can also be added to the counted number. For example, assuming that the values of 3 change rates are greater than the preset threshold, and there are text words such as abuse in the voice content of the driver, it can be considered that the values of 4 change rates are greater than the preset threshold.

[0062] In this way, if the number of change rates greater than the preset threshold exceeds a first specified threshold, it can be determined that the current emotional state of the driver represents that the driver still has the first emotional tendency, wherein the specific change rates greater than the preset threshold can not be limited. If the number of change rates greater than the preset threshold does not exceed the first specified threshold, it can be determined that the current emotional state of the driver represents that the driver does not have the first emotional tendency. The specific value of the first specified threshold can be determined according to actual conditions. For example, the first specified threshold in the embodiment can be 3, 4, or 5, and the specific value can not be limited.

[0063] Step S250: If the emotional state determined again still represents that the driver has the first emotional tendency, triggering the closing of the accelerator pedal sensor of the vehicle within a specified time length to control the delayed start of the vehicle.

[0064] The specific implementation of step S250 can refer to the related description of step S140 in the foregoing embodiments, which will not be described here.

[0065] Optionally, the embodiment can pre-configure the emotion monitoring function for the vehicle, and the user can decide whether to turn on the function. If the emotion monitoring function is in the on state, the vehicle will automatically detect the emotional state of the driver and execute the vehicle start control method in the embodiment to prevent the user from driving in a bad mood and affecting the driving safety. Optionally, the emotion monitoring function can be configured as a default on state or a default off state.

[0066] Optionally, if the vehicle is used for the first time, the driver will decide whether to turn on the emotion monitoring function. If the driver confirms to turn on the emotion monitoring function, the vehicle will apply to record the personal information of the driver, such as gender, height, age, and weight, and then generate the preset data according to big data. It is worth noting that the preset data includes the driver's action habit, speech characteristics, and body temperature state data, that is, the preset data includes the driver's body swing force (seat vibration amplitude), vibration frequency (frequency signal), driver's hammering force on the steering wheel (steering wheel force signal), driver's speed of pulling the seat belt (seat belt pulling speed signal), driver's current body temperature (infrared temperature signal), driver's voice tone (tone signal), decibel (decibel signal), speech speed (speech speed signal), or text content, and the initial data of each preset data is different.

[0067] Optionally, in order to improve the effectiveness and reference value of the preset data, the driver's action habit, speech characteristics, and body temperature state can be recorded and learned within the target time length (for example, 24 hours) of the emotion monitoring function being turned on, and then the learned data is used to correct the preset data; and in the later specific use process, the preset data can also be updated according to the actual situation in the manner described above.

[0068] The vehicle starting control method provided by the embodiment comprises the following steps.

[0069] By comprehensively judging the emotional state of the driver according to the monitoring data of the plurality of sensors, the emotional state of the driver can be more accurately and comprehensively re-judged, and the effectiveness and reliability of the emotional state judgment are improved.

[0070] Please refer to Figure 3 The vehicle starting control method provided by another embodiment of the application comprises the following steps.

[0071] In the step S310, the door edge force sensor data corresponding to the driver's seat is acquired when the vehicle is in a non-driving state, and the emotional state of the driver is determined based on the door edge force sensor data.

[0072] The specific implementation of the step S310 can refer to the related description of the step S110 in the foregoing embodiments, and will not be described here again.

[0073] In the step S321, if the emotional state indicates that the driver has a first emotional tendency, the first emotional feature data of the driver is acquired, and the first emotional feature data comprises first driving feature data, first body temperature feature data and first voice feature data.

[0074] The specific implementation of the step S321 can refer to the related description of the step S120 in the foregoing embodiments, and will not be described here again.

[0075] Step S331: determining the emotional state of the driver again based on the first emotional feature data.

[0076] The specific implementation of step S331 can refer to the related description of step S130 in the foregoing embodiments, and details are not described herein again.

[0077] Step S341: if the emotional state determined again still represents that the driver has the first emotional tendency, triggering the closing of the accelerator pedal sensor of the vehicle within a specified time length to control the delayed start of the vehicle.

[0078] The specific implementation of step S341 can refer to the related description of step S140 in the foregoing embodiments, and details are not described herein again.

[0079] Step S322: if the emotional state represents that the driver does not have the first emotional tendency, obtaining second emotional feature data of the driver, the second emotional feature data including second body temperature feature data and second voice feature data.

[0080] In the embodiments of the present application, if the emotional state determined initially represents that the driver does not have the first emotional tendency, the second emotional feature data of the driver can be obtained to re-judge the emotional state of the driver according to the second emotional feature data, wherein the second emotional feature data can include second body temperature feature data and second voice feature data.

[0081] If the driver does not have the first emotional tendency, it means that the driver does not have extreme emotions such as anger or excitement, but in order to be on the safe side, it is still possible to continue to judge whether the driver has other bad emotions that affect driving, such as sadness or fatigue. It can be understood that if the driver does not have the first emotional tendency, the driver's emotions will be different, so the second body temperature feature data in the second emotional feature data is different from the first body temperature feature data, and the second voice feature data is also different from the first voice feature data. Optionally, the acquisition process of the second body temperature feature data and the second voice feature data is similar to that of the first body temperature feature data and the first voice feature data, and details are not described herein again.

[0082] Step S332: determining whether the emotional state of the driver has a second emotional tendency based on the second emotional feature data.

[0083] As an embodiment, in the case where it is initially determined that the driver does not have the first emotional tendency, in order to avoid the misjudgment of the emotional state of the driver and affect the safety of the subsequent driving of the driver, it is possible to determine whether the emotional state of the driver has a second emotional tendency based on the second emotional feature data. The second emotional tendency can include negative emotional tendencies such as sadness, fatigue, sadness, or sorrow.

[0084] In this embodiment, the second voice feature data can include multiple types of voice feature data. Similar to the first voice feature data, the second voice feature data can also include pitch signals, decibel signals, speech rate signals, and text content data. It should be noted that the second voice feature data is of the same type as the first voice feature data, but the specific data is different. The specific process of determining whether the driver's emotional state has a second emotional tendency based on the second emotional feature data is described as follows:

[0085] As a way, please refer to Figure 4 , step S332 can include:

[0086] Step S3321: Obtain the change rate of the second body temperature feature data and the multiple types of voice feature data with respect to the respective corresponding preset data, to obtain multiple change rates. The respective corresponding preset data of different emotional feature data is different.

[0087] In the process of determining the emotional state of the driver based on the second emotional feature data, as an embodiment, the change rate of the second body temperature feature data and the multiple types of voice feature data with respect to the respective corresponding preset data can be obtained to obtain multiple change rates. Then, the emotional change amplitude of the driver is determined again according to the multiple change rates. Among them, the respective corresponding preset data of different emotional feature data is different.

[0088] Optionally, the process of obtaining the multiple change rates is similar to the process of obtaining the change rate of the door edge force sensor data with respect to the corresponding preset data, which will not be described here.

[0089] Step S3322: Determine the emotional state of the driver again based on the comparison results of the multiple change rates with the preset threshold.

[0090] As an embodiment, the multiple change rates can be compared with the preset threshold, and then the emotional state of the driver is determined again based on the comparison results of the multiple change rates with the preset threshold. Specifically, the emotional state of the driver can be determined again according to the following formula:

[0091]

[0092] Wherein, Y represents the second emotional characteristic data, and i can represent any one of the first emotional characteristic data, i.e. i = the current body temperature of the driver (infrared temperature signal), the voice tone of the driver (pitch signal), decibel (decibel signal), speech rate (speech rate signal) or text content. Different i corresponds to different Y0. Wherein, if the change rate shown in formula 4 is greater than 20%, it represents that the driver has the second emotional tendency; if the change rate shown in formula 4 is not greater than 20%, it represents that the driver does not have the second emotional tendency, i.e. the emotional state of the driver is normal.

[0093] Similarly, in order to more accurately determine the emotional state of the driver, in the process of determining the emotional state of the driver again based on the comparison results of the plurality of change rates and the preset threshold, it can also be monitored whether there are negative text words such as depression or sadness in the voice content of the driver. Wherein, if there are negative text words such as depression or sadness in the voice content of the driver, it can represent that the driver has the second emotional tendency; if there are no negative text words such as depression or sadness in the voice content of the driver, it can represent that the driver does not have the second emotional tendency.

[0094] It can be understood that if a certain change rate is greater than the preset threshold to determine that the driver has the second emotional tendency, or as long as there are negative text words such as depression or sadness in the voice content of the driver to determine that the driver has the second emotional tendency, it may produce a misjudgment. As an implementation mode, in order to more comprehensive and accurate evaluation of the emotional state of the driver, the comparison results of the plurality of change rates and the preset threshold, and whether there are negative text words such as depression or sadness in the voice content of the driver can be counted, and then the emotional state of the driver is comprehensively judged according to the statistical results.

[0095] Specifically, the number of change rates whose values are greater than the preset threshold can be counted. Optionally, if there are negative text words such as depression or sadness in the voice content of the driver, it can also be added to the number of the statistics. For example, assuming that the values of 2 change rates are greater than the preset threshold, and there are negative text words such as depression or sadness in the voice content of the driver, then it can be considered that the values of 3 change rates are greater than the preset threshold.

[0096] In this way, if the number of change rates greater than the preset threshold exceeds the second specified threshold, it can be determined that the emotional state of the driver has the second emotional tendency; and if the number of change rates greater than the preset threshold does not exceed the second specified threshold, it can be determined that the emotional state of the driver does not have the second emotional tendency. Wherein, the specific value of the second specified threshold can be determined according to the actual situation. For example, the second specified threshold in the embodiment can be a value of 2 or 3, and the specific value can not be limited.

[0097] Step S3421: If the emotional state of the driver has the second emotional tendency, playing a caring audio to the driver and performing a body massage to the driver.

[0098] As an implementation, if it is determined that the emotional state of the driver has the second emotional tendency, in order to quickly help the driver to calm down the bad mood, a caring audio can be played to the driver and a body massage can be performed to the driver. The caring audio can include a speech comfort and a happy music, and the specific content of the caring music can not be limited. The body massage can include a shoulder and neck massage, a limb massage, a head massage, etc., and the specific content can not be limited. Optionally, the playing of the caring audio and the body massage can be performed simultaneously or separately, and the specific content can be set according to the actual needs.

[0099] Step S3422: If the emotional state of the driver does not have the second emotional tendency, determining that the emotional state is a normal emotional state, and controlling the vehicle to start normally.

[0100] As another implementation, if it is determined that the emotional state of the driver does not have the second emotional tendency, it indicates that the emotional state of the driver is normal, and at this time the vehicle can be controlled to start normally. Optionally, at this time the aforementioned preset data can also be updated to realize effective recording of data and real-time updating of data.

[0101] The vehicle starting control method provided in the embodiment comprises the following steps: when the vehicle is in a non-driving state, door edge force sensor data corresponding to a driving position is acquired, and the emotional state of a driver is determined based on the door edge force sensor data; if the emotional state indicates that the driver has a first emotional tendency, first emotional feature data of the driver is acquired, the first emotional feature data comprising first driving feature data, first body temperature feature data and first voice feature data; the emotional state of the driver is determined again based on the first emotional feature data; if the emotional state determined again still indicates that the driver has the first emotional tendency, a throttle pedal sensor of the vehicle is closed within a specified time period, so as to control the delayed starting of the vehicle; if the emotional state indicates that the driver does not have the first emotional tendency, second emotional feature data of the driver is acquired, the second emotional feature data comprising second body temperature feature data and second voice feature data; whether the emotional state of the driver has a second emotional tendency is determined based on the second emotional feature data; if the emotional state of the driver has the second emotional tendency, caring audio is played to the driver and the driver is given a body massage; if the emotional state of the driver does not have the second emotional tendency, the emotional state is determined as a normal emotional state, and the vehicle is started normally. The method can determine the emotional tendency of the driver multiple times, and then trigger the vehicle starting control mode and the pacifying function corresponding to the determined emotional tendency, so as to ensure that the driver can drive in a relatively calm and stable emotional state, thereby improving the safety during driving.

[0102] The emotional state of the driver can be determined more accurately and comprehensively by combining the monitoring data of multiple sensors, and the effectiveness and reliability of the emotional state determination can be improved.

[0103] Please refer to Figure 5 The vehicle starting control device 400 provided in the application comprises an emotional state determination module 410, an emotional feature data acquisition module 420 and a vehicle starting control module 430.

[0104] The emotional state determination module 410 is configured to acquire door edge force sensor data corresponding to a driving position when the vehicle is in a non-driving state, and determine the emotional state of a driver based on the door edge force sensor data.

[0105] As an implementation form, the emotional state determination module 410 can be specifically configured to acquire the change rate of the door edge force sensor data relative to corresponding preset data; and determine the emotional state of the driver based on the comparison result of the change rate and a preset threshold.

[0106] The determining the emotional state of the driver based on the comparison result of the change rate and the preset threshold value can include: if the change rate is greater than the preset threshold value, determining that the emotional state represents that the driver has a first emotional tendency; and if the change rate is less than or equal to the preset threshold value, determining that the emotional state represents that the driver does not have the first emotional tendency.

[0107] The emotion feature data acquisition module 420 is configured to acquire first emotional feature data of the driver if the emotional state represents that the driver has the first emotional tendency, and the first emotional feature data includes first driving feature data, first body temperature feature data and first voice feature data.

[0108] The emotion state determining module 410 is further configured to determine the emotional state of the driver again based on the first emotional feature data.

[0109] In the embodiments of the present application, the first driving feature data includes seat pressure sensor data, steering wheel force sensor data and seat belt rotation speed sensor data, and the first voice feature data includes a plurality of types of voice feature data. In this way, the emotion state determining module 410 can be specifically configured to obtain a plurality of change rates by obtaining change rates of the seat pressure sensor data, the steering wheel force sensor data, the seat belt rotation speed sensor data, the first body temperature feature data and the plurality of types of voice feature data with respect to respective corresponding preset data, and the respective corresponding preset data of different emotional feature data is different; and determine the emotional state of the driver again based on comparison results of the plurality of change rates and respective corresponding preset threshold values.

[0110] The determining the emotional state of the driver again based on the comparison results of the plurality of change rates and the preset threshold values can include: if a number of change rates greater than the preset threshold value exceeds a first specified threshold value, determining that the emotional state represents that the driver still has the first emotional tendency; and if the number of change rates greater than the preset threshold value does not exceed the first specified threshold value, determining that the emotional state represents that the driver does not have the first emotional tendency.

[0111] The vehicle start control module 430 is configured to trigger a throttle pedal sensor of a vehicle to be closed within a specified time length to control the vehicle to be started with a delay if the emotional state determined again represents that the driver has the first emotional tendency.

[0112] Optionally, the vehicle start control module 430 can be further configured to determine that the emotional state is a normal emotional state if the emotional state determined again represents that the driver does not have the first emotional tendency, and control the vehicle to be started normally.

[0113] As an implementation, if the emotional state represents that the driver does not have the first emotional tendency, the emotional feature data acquisition module 420 can be configured to acquire second emotional feature data of the driver, the second emotional feature data including second body temperature feature data and second voice feature data. In this way, the emotional state determination module 410 can be configured to determine, based on the second emotional feature data, whether the emotional state of the driver has a second emotional tendency; and the vehicle starting control module 430 can be configured to, if the emotional state of the driver has the second emotional tendency, play a caring audio to the driver and perform a body massage on the driver; if the emotional state of the driver does not have the second emotional tendency, determine that the emotional state is a normal emotional state, and control the vehicle to start normally.

[0114] In the embodiments of the present application, the second voice feature data can include a plurality of types of voice feature data. In this way, the above-mentioned determination of whether the emotional state of the driver has a second emotional tendency based on the second emotional feature data can include: obtaining a change rate of the second body temperature feature data and the plurality of types of voice feature data with respect to the respective corresponding preset data, obtaining a plurality of change rates, and the respective corresponding preset data of different emotional feature data being different; and determining the emotional state of the driver again based on a comparison result of the plurality of change rates with a preset threshold.

[0115] As an implementation, the determination of the emotional state of the driver again based on the comparison result of the plurality of change rates with the preset threshold includes: if the number of change rates greater than the preset threshold exceeds a second specified threshold, determining that the emotional state of the driver has a second emotional tendency; and if the number of change rates greater than the preset threshold does not exceed the second specified threshold, determining that the emotional state of the driver does not have the second emotional tendency.

[0116] The following will be described in combination with Figure 6 A vehicle provided by the present application will be described.

[0117] Please refer to Figure 6 Based on the above-mentioned vehicle starting control method and device, the present application further provides another electronic device 100 which can execute the above-mentioned vehicle starting control method. The electronic device 100 includes one or more (only one is shown in the figure) processors 102, a memory 104, and a data acquisition module 106 which are coupled to each other. The memory 104 stores programs which can execute the contents of the above-mentioned embodiments, and the processor 102 can execute the programs stored in the memory 104.

[0118] The processor 102 can include one or more processing cores. The processor 102 connects various parts within the entire electronic device 100 by various interfaces and lines, performs various functions of the electronic device 100 and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory 104, and calling data stored in the memory 104. Optionally, the processor 102 can be implemented in at least one hardware form of a neural network processing unit (NPU), a digital signal processing (DSP), a field-programmable gate array (FPGA), and a programmable logic array (PLA). The processor 102 can be integrated with a combination of one or several of a central processing unit (CPU), a graphics processing unit (GPU), a neural network processing unit (NPU), and a modem. Among them, the CPU mainly processes operating systems, user interfaces, and application programs; the GPU is responsible for rendering and drawing display content; the NPU is responsible for processing multimedia data such as video and images; and the modem is used for processing wireless communication. It can be understood that the above-mentioned modem can also not be integrated into the processor 102, but can be implemented separately by a communication chip.

[0119] The memory 104 can include a random access memory (RAM) and can also include a read-only memory (ROM). The memory 104 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 104 can include a program storage area and a data storage area, wherein the program storage area can store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing each of the following method embodiments, etc. The data storage area can also store data created by the electronic device 100 in use (such as a phonebook, audio and video data, chat record data), etc.

[0120] The data acquisition module 106 can be used to obtain the driving state information of the electronic device 100, and the data acquisition module 106 can be a laser radar, a camera, a sensor, a global positioning system (GPS) navigation, etc.

[0121] The embodiment of the present application provides a computer readable storage medium. The computer readable storage medium stores program codes, and the program codes can be invoked by a processor to execute the method described in the above method embodiment.

[0122] The computer readable storage medium can be an electronic storage such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk or a ROM. Alternatively, the computer readable storage medium comprises a non-transitory computer readable storage medium. The computer readable storage medium has a storage space for storing program codes for executing any method steps in the above method. The program codes can be read from or written into one or more computer program products. The program codes can be compressed in a suitable form, for example.

[0123] To sum up, the vehicle starting control method, device and electronic equipment provided by the present application, by acquiring the door edge force sensor data corresponding to the driver seat when the vehicle is in a non-driving state, and determining the emotional state of the driver based on the door edge force sensor data; if the emotional state represents that the driver has a first emotional tendency, acquiring the first emotional feature data of the driver, the first emotional feature data comprising first driving feature data, first body temperature feature data and first voice feature data; determining the emotional state of the driver again based on the first emotional feature data; if the emotional state after the re-determination still represents that the driver has a first emotional tendency, triggering the closing of the accelerator pedal sensor of the vehicle within a specified time period to control the delayed starting of the vehicle. The method determines the emotional tendency of the driver multiple times, and then triggers the vehicle starting control mode under the corresponding emotional tendency based on the determined emotional tendency, to ensure that the driver can drive in a relatively calm and stable emotional state, thereby improving the safety during driving.

[0124] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement to part of the technical features; and these modifications or replacements do not drive the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A vehicle start control method characterized by, The method comprises: acquiring door edge force sensor data corresponding to a driving position when the vehicle is in a non-driving state, and acquiring a rate of change of the door edge force sensor data relative to corresponding preset data, and determining an emotional state of a driver based on a comparison result of the rate of change and a preset threshold value; if the emotional state represents that the driver has a first emotional tendency, acquiring first emotional feature data of the driver, the first emotional feature data comprising first driving feature data, first body temperature feature data and first voice feature data; the first driving feature data comprises seat pressure sensor data, steering wheel force sensor data and seat belt rotation speed sensor data, and the first voice feature data comprises multiple types of voice feature data; acquiring rates of change of the seat pressure sensor data, the steering wheel force sensor data, the seat belt rotation speed sensor data, the first body temperature feature data and the multiple types of voice feature data relative to corresponding preset data respectively, to obtain multiple rates of change, and the preset data corresponding to different emotional feature data is different; determining the emotional state of the driver again based on comparison results of the multiple rates of change and preset threshold values respectively; if the emotional state determined again still represents that the driver has a first emotional tendency, triggering the closing of an accelerator pedal sensor of the vehicle within a specified time period to control the delayed starting of the vehicle.

2. The method of claim 1, wherein, The determination of the emotional state of the driver based on the comparison result of the rate of change and the preset threshold value comprises: if the rate of change is greater than the preset threshold value, it is determined that the emotional state represents that the driver has a first emotional tendency; if the rate of change is less than or equal to the preset threshold value, it is determined that the emotional state represents that the driver does not have a first emotional tendency.

3. The method of claim 1, wherein, The determination of the emotional state of the driver again based on the comparison result of the multiple rates of change and preset threshold values respectively comprises: if the number of rates of change greater than the preset threshold value exceeds a first specified threshold value, it is determined that the emotional state represents that the driver still has a first emotional tendency; if the number of rates of change greater than the preset threshold value does not exceed the first specified threshold value, it is determined that the emotional state represents that the driver does not have a first emotional tendency.

4. The method of claim 3, wherein, The method further comprises: if the emotional state determined again represents that the driver does not have a first emotional tendency, it is determined that the emotional state is a normal emotional state, and the vehicle is controlled to start normally.

5. The method of claim 2, wherein, The method further comprises: if the emotional state represents that the driver does not have a first emotional tendency, acquiring second emotional feature data of the driver, the second emotional feature data comprising second body temperature feature data and second voice feature data; determining whether the emotional state of the driver has a second emotional tendency based on the second emotional feature data; if the emotional state of the driver has a second emotional tendency, playing a caring audio to the driver and performing a body massage on the driver; if the emotional state of the driver does not have a second emotional tendency, it is determined that the emotional state is a normal emotional state, and the vehicle is controlled to start normally.

6. The method of claim 5, wherein, The second voice feature data comprises multiple types of voice feature data, and the determining whether the emotional state of the driver has a second emotional tendency based on the second emotional feature data comprises: Obtaining the change rates of the second body temperature feature data and the multiple types of voice feature data with respect to the respective corresponding preset data, obtaining multiple change rates, and the respective corresponding preset data of different emotional feature data being different; Determining the emotional state of the driver again based on the comparison results of the multiple change rates with the preset threshold.

7. A vehicle start control device characterized by comprising: The device comprises: An emotional state determination module configured to, when the vehicle is in a non-driving state, obtain door edge force sensor data corresponding to the driver's seat, obtain a change rate of the door edge force sensor data with respect to corresponding preset data, and determine the emotional state of the driver based on the comparison result of the change rate with the preset threshold; An emotional feature data acquisition module configured to, if the emotional state indicates that the driver has a first emotional tendency, acquire first emotional feature data of the driver, the first emotional feature data comprising first driving feature data, first body temperature feature data, and first voice feature data; the first driving feature data comprising seat pressure sensor data, steering wheel force sensor data, and seatbelt rotation speed sensor data, and the first voice feature data comprising multiple types of voice feature data; The emotional state determination module is further configured to obtain the change rates of the seat pressure sensor data, the steering wheel force sensor data, the seatbelt rotation speed sensor data, the first body temperature feature data, and the multiple types of voice feature data with respect to the respective corresponding preset data, obtain multiple change rates, and the respective corresponding preset data of different emotional feature data being different; and determine the emotional state of the driver again based on the comparison results of the multiple change rates with the preset threshold. A vehicle start control module configured to, if the determined emotional state still indicates that the driver has a first emotional tendency, trigger the closing of the accelerator pedal sensor of the vehicle within a specified time period to control the delayed start of the vehicle.

8. An electronic device, comprising: One or more processors and a memory; One or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to perform the method of any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, The computer readable storage medium stores program codes, and when the program codes are run by a processor, the method of any one of claims 1-6 is performed.

Citation Information

Patent Citations

  • Driver driving emotion recognition method, computer device and storage medium

    CN116269396A

  • Driving assistance system based on voice recognition and vehicle

    CN213565639U