Driving safety assistance method and system
By using a driving safety assistance system to detect and analyze drivers' negative emotions in real time, and adjusting driving conditions and procedures, the system addresses the issue of driving safety when drivers are in a negative emotional state and reduces the risk of traffic accidents.
Patent Information
- Application Number
- CN202110742704.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-07-01
- Publication Date
- 2025-12-05
- Estimated Expiration
- 2041-07-01
AI Technical Summary
How to provide driving safety assistance and reduce the risk of traffic accidents when drivers are affected by negative emotions.
The driving safety assistance system analyzes audio and video data from the passenger space to determine negative emotional states and adjust dangerous driving conditions and procedures, including voice analysis, image recognition, and dynamic setting of dangerous driving conditions.
In a state of negative emotion, we provide stricter judgment criteria and proactive handling mechanisms to reduce the risk of driving accidents.
Smart Images

Figure CN115556757B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to an assisting method, in particular to a driving safety assisting method suitable for application to a vehicle. The present application also relates to a driving safety assisting system capable of implementing the driving safety assisting method. BACKGROUND
[0002] Human emotions can affect their own behavior. For example, if a driver drives in a tense, anxious, or angry state, he or she is more likely to exhibit impulsive and dangerous driving behavior (e.g., so-called "road rage"). In addition, negative emotions can cause the driver to be distracted and unable to respond appropriately to unexpected situations on the road, which increases the risk of traffic accidents.
[0003] Although negative emotions are inevitable, if a driver drives in a distracted or dangerous manner under the influence of negative emotions, it may result in a serious accident that cannot be remedied. Therefore, how to provide appropriate driving safety assistance from the perspective of emotions is a topic worth exploring. SUMMARY
[0004] The technical problem to be solved by the present application is to provide a driving safety assisting method that can automatically adjust to provide more cautious and appropriate driving safety assistance mechanisms by detecting negative driving emotions.
[0005] To solve the above technical problem, the driving safety assisting method of the present application is implemented by a driving safety assisting system at least partially disposed in a vehicle. The driving safety assisting method includes: the driving safety assisting system performing sound collection on a passenger space defined by the vehicle to obtain a sound collection data, and performing voice analysis on the sound collection data, and determining whether a negative emotional state occurs according to the results of voice analysis. The driving safety assisting system also determines whether the operating condition of the vehicle meets a dangerous driving condition corresponding to a dangerous driving pattern, and executes a dangerous driving processing program corresponding to the dangerous driving pattern when the determination result is yes. In addition, the driving safety assisting system determines at least one of the dangerous driving condition and the dangerous driving processing program according to the determination result of whether the negative emotional state occurs.
[0006] Preferably, the driving safety assistance system stores a dangerous driving program data corresponding to the dangerous driving state, and the dangerous driving program data comprises a first operation condition related to the operation condition of the vehicle, and a second operation condition related to the operation condition of the vehicle and which is prior to the first operation condition. When the driving safety assistance system judges that the negative emotion state does not occur, the driving safety assistance system sets the first operation condition as the dangerous driving condition, and when the driving safety assistance system judges that the negative emotion state occurs, the driving safety assistance system sets the second operation condition as the dangerous driving condition.
[0007] Preferably, the driving safety assistance system stores a dangerous driving program data corresponding to the dangerous driving state, and the dangerous driving program data comprises a first operation condition related to the operation condition of the vehicle, and a second operation condition related to the operation condition of the vehicle and which is prior to the first operation condition. When the driving safety assistance system judges that the negative emotion state does not occur, the driving safety assistance system sets the first operation condition as the dangerous driving condition, and when the driving safety assistance system judges that the negative emotion state occurs, the driving safety assistance system sets the second operation condition as the dangerous driving condition.
[0008] Preferably, the driving safety assistance system analyzes the sound data in a voice manner, which comprises performing semantic recognition and volume detection on the voice presented by the sound data, and calculating a negative emotion index according to the results of the semantic recognition and the volume detection, and the driving safety assistance system judges whether the negative emotion state occurs according to whether the negative emotion index reaches a threshold value.
[0009] Preferably, the driving safety assistance system further photographs the surroundings of the vehicle to obtain an image data, and the driving safety assistance system judges whether the operation condition of the vehicle meets the dangerous driving condition by performing image recognition on the image data.
[0010] Preferably, the dangerous driving condition is taken as a target dangerous driving condition, and the driving safety assistance system selects the target dangerous driving condition corresponding to the current time and / or the current position of the vehicle from a plurality of dangerous driving conditions according to the current time and / or the current position of the vehicle, and the driving safety assistance system only judges whether the operation condition of the vehicle meets the dangerous driving condition, and does not judge whether the operation condition of the vehicle meets other dangerous driving conditions except the dangerous driving condition.
[0011] Another technical problem to be solved by the present application is to provide a driving safety assistance system capable of implementing the driving safety assistance method.
[0012] The present application discloses a driving safety assistance system for a vehicle, which comprises a radio unit adapted to be arranged on the vehicle, and a processing unit electrically connected to the radio unit. The processing unit is configured to control the radio unit to perform radio on a passenger space defined by the vehicle to obtain a radio data, and to perform voice analysis on the radio data, and to determine whether a negative emotional state occurs according to the result of the voice analysis. The processing unit is further configured to determine whether an operation condition of the vehicle meets a dangerous driving condition corresponding to a dangerous driving pattern, and to execute a dangerous driving processing procedure corresponding to the dangerous driving pattern when the determination result is positive, and the processing unit is configured to determine at least one of the dangerous driving condition and the dangerous driving processing procedure according to the determination result of whether the negative emotional state occurs.
[0013] Preferably, the driving safety assistance system further comprises a storage unit electrically connected to the processing unit. The storage unit stores a dangerous driving procedure data corresponding to the dangerous driving pattern, and the dangerous driving procedure data comprises a first operation condition related to the operation condition of the vehicle, and a second operation condition related to the operation condition of the vehicle and meeting the dangerous driving condition more preferentially than the first operation condition. When the processing unit determines that the negative emotional state does not occur, the processing unit sets the first operation condition as the dangerous driving condition, and when the processing unit determines that the negative emotional state occurs, the processing unit sets the second operation condition as the dangerous driving condition.
[0014] Preferably, the driving safety assistance system further comprises a storage unit electrically connected to the processing unit. The storage unit stores a dangerous driving procedure data corresponding to the dangerous driving pattern, and the dangerous driving procedure data comprises a first processing procedure and a second processing procedure different from the first processing procedure. When the processing unit determines that the negative emotional state does not occur, the processing unit sets the first processing procedure as the dangerous driving processing procedure, and when the processing unit determines that the negative emotional state occurs, the processing unit sets the second processing procedure as the dangerous driving processing procedure.
[0015] Preferably, the processing unit performs voice analysis on the radio data by performing semantic recognition and volume detection on the voice presented by the radio data, and calculating a negative emotional index according to the result of the semantic recognition and the volume detection, and determining whether the negative emotional state occurs according to whether the negative emotional index reaches a threshold value.
[0016] Preferably, the driving safety assistance system further comprises a photographing unit adapted to be disposed on the vehicle and electrically connected to the processing unit. The processing unit further controls the photographing unit to photograph the surroundings of the vehicle to obtain an image data from the photographing unit, and the processing unit determines whether the operation condition of the vehicle meets the dangerous driving condition by performing image recognition on the image data.
[0017] Preferably, the dangerous driving condition is taken as a target dangerous driving condition, and the driving safety assistance system selects the target dangerous driving condition corresponding to the current time and / or the current location of the vehicle from a plurality of dangerous driving conditions according to the current time and / or the current location of the vehicle, and the driving safety assistance system only determines whether the operation condition of the vehicle meets the dangerous driving condition, but does not determine whether the operation condition of the vehicle meets other dangerous driving conditions other than the dangerous driving condition.
[0018] Compared with the prior art, the driving safety assistance system of the present application determines the dangerous driving condition and / or the dangerous driving processing procedure according to the determination result of whether the negative emotional state occurs, so that the driving safety assistance system can use different determination standards and / or processing procedures to detect and assist the dangerous driving state in the case of "no negative emotional state occurs" and "negative emotional state has occurred", respectively. Therefore, the driving safety assistance system is beneficial to providing assistance for driving safety in the high-risk driving environment where the negative emotional state occurs, with more stringent determination standards and / or more active processing mechanisms, thereby reducing the potential risk of driving accidents. BRIEF DESCRIPTION OF DRAWINGS
[0019] Other features and effects of the present application will be clearly presented in the embodiments with reference to the drawings, in which:
[0020] Figure 1 is a block diagram of an embodiment of the driving safety assistance system of the present application; and
[0021] Figure 2 is a flowchart for exemplarily illustrating how the embodiment implements a driving safety assistance method. DETAILED DESCRIPTION
[0022] Before the present application is described in detail, it should be noted that "electrically connected" as described in the present patent specification refers to "wired electrical connection" between electronic devices / devices / components through conductive materials, and "wireless electrical connection" through wireless communication technology for single / dual-directional wireless signal transmission, unless specifically defined. Moreover, "electrically connected" as described in the present patent specification refers to "wired electrical connection" between electronic devices / devices / components through conductive materials, and "wireless electrical connection" through wireless communication technology for single / dual-directional wireless signal transmission, unless specifically defined.
[0023] Also referred to as a "direct electrical connection" between the electronic devices / apparatuses / components, and an "indirect electrical connection" between the electronic devices / apparatuses / components via other electronic devices / apparatuses / components.
[0024] Referring to Figure 1 One embodiment of the present application is adapted to be applied to a vehicle 5 defining a passenger space. In the application of the present embodiment, the vehicle 5 can be, for example, a large-sized bus, and the passenger space is for accommodating the driver and passengers of the vehicle 5. However, in other applications of the present application, the vehicle 5 can also be, for example, a medium-sized bus, a small-sized bus, a nine-seater, a seven-seater or a four-seater car, and thus the vehicle to which the present application is applied is not limited to the large-sized bus as exemplified in the present embodiment.
[0025] In the present embodiment, the vehicle safety assistance system 1 comprises, for example, a storage unit 11, a sound receiving unit 12, an output unit 13, and a processing unit 14 electrically connected to the storage unit 11, the sound receiving unit 12 and the output unit 13.
[0026] The storage unit 11 is, in the present embodiment, implemented as, for example, a memory module disposed in the vehicle 5 and used for storing digital data. However, in other embodiments, the storage unit 11 can also be implemented as, for example, a conventional hard disk, a solid state disk or other kinds of computer readable recording media, or a combination of different kinds of computer readable recording media. Further, the storage unit 11 can also be implemented as, for example, a cloud storage device instead of being disposed in the vehicle 5, and thus the actual implementation of the storage unit 11 is not limited to the present embodiment.
[0027] The sound receiving unit 12 comprises, in the present embodiment, a plurality of microphones disposed in the vehicle 5 and used for receiving sound in the passenger space under the control of the processing unit 14. Preferably, at least one of the microphones is disposed, for example, in the passenger space adjacent to the driver's seat, so as to receive sound in the surrounding environment of the driver's seat. However, in other embodiments, if the vehicle 5 is a small-sized vehicle (e.g. a four-seater car), the sound receiving unit 12 can also comprise only one microphone, and thus the actual implementation of the sound receiving unit 12 is not limited to the present embodiment.
[0028] The output unit 13 may, for example, include a display and a buzzer in the present embodiment, and the display and the buzzer may, for example, be disposed around a driver's seat of the vehicle 5. However, the output unit 13 may, for example, include only one of the display and the buzzer in other embodiments, and thus the actual implementation of the output unit 13 is not limited to the present embodiment.
[0029] The processing unit 14 may, for example, include a central processing unit disposed inside the vehicle 5 in the present embodiment, and the processing unit 14 is electrically connected to and capable of communicating with a driving computer (not shown) of the vehicle 5, and obtains various operation parameters (such as driving speed, throttle signal, brake signal, etc.) of the vehicle 5 from the driving computer. In addition, the processing unit 14 may, for example, further include a cloud server electrically connected to and capable of communicating with the central processing unit through a network in other embodiments, that is, the processing unit 14 may, for example, be only partially disposed in the vehicle 5 in other embodiments, and is not limited to the present embodiment. Furthermore, in the embodiment in which the processing unit 14 further includes the cloud server, the storage unit 11 may, for example, be disposed inside the cloud server as a part of the cloud server.
[0030] It is additionally noted that the driving safety assistance system 1 of the present embodiment may, for example, be independently manufactured and sold, and the driving safety assistance system 1 may, for example, be installed on the vehicle 5 after the vehicle 5 is manufactured. However, the driving safety assistance system 1 may, for example, be built in the vehicle 5 before the vehicle 5 is manufactured in other embodiments, and the processing unit 14 may, for example, be implemented as the driving computer itself of the vehicle 5 or a part of the driving computer of the vehicle 5, and thus the actual implementation of the driving safety assistance system 1 is not limited to the present embodiment.
[0031] The storage unit 11 stores, for example, a negative emotion evaluation model and a plurality of dangerous driving procedure data in the present embodiment. However, the storage unit 11 may, for example, store only a single piece of dangerous driving procedure data in other embodiments, and is not limited to the present embodiment.
[0032] In the present embodiment, the negative emotion evaluation model is implemented, for example, by using speech recognition and natural language processing techniques. More specifically, by running the negative emotion evaluation model, the processing unit 14 is capable of performing sentiment recognition and volume detection on the results of the soundings performed by the sound unit 12 in real time, and calculating a negative emotion index according to the results of the sentiment recognition and volume detection. For example, the processing unit 14 can calculate the negative emotion index according to whether the speech in the results of the soundings performed by the sound unit 12 contains words or sentences that express negative emotions, and whether the volume of the speech in the results of the soundings is gradually increasing. However, the manner in which the processing unit 14 calculates the negative emotion index can be freely designed and adjusted according to experience and requirements, and the manner in which the negative emotion index is calculated is not the technical focus of the present patent specification, so the details thereof will not be described herein.
[0033] On the other hand, in the present embodiment, the dangerous driving procedure data correspond, for example, to a plurality of dangerous driving patterns related to the operating conditions of the vehicle 5. For example, the dangerous driving patterns in the present embodiment include a speeding driving pattern, a frequent sudden acceleration driving pattern, and a frequent sudden braking driving pattern, but are not limited thereto. Further, in the present embodiment, each dangerous driving procedure data includes, for example, a first operating condition related to the operating conditions of the vehicle 5, a second operating condition related to the operating conditions of the vehicle 5 and more preferentially satisfied than the first operating condition, a first processing procedure corresponding to the first operating condition, and a second processing procedure corresponding to the second operating condition and different from the first processing procedure, but are not limited thereto.
[0034] For example, the dangerous driving procedure data corresponding to the "speeding driving pattern" includes a first operating condition that can represent, for example, "driving speed higher than 60 km / h", and a second operating condition that can represent, for example, "driving speed higher than 50 km / h", but are not limited thereto. Therefore, if the vehicle 5 accelerates to more than 60 km / h during driving, the second operating condition representing "driving speed higher than 50 km / h" will necessarily be more preferentially satisfied than the first operating condition representing "driving speed higher than 60 km / h". On the other hand, the first processing procedure included in the dangerous driving procedure data can represent, for example, "controlling the output unit 13 to output a speeding warning notification" to remind the driver of the vehicle 5, and the second processing procedure included in the dangerous driving procedure data can represent, for example, "limiting the maximum driving speed of the vehicle 5 to 40 km / h" to forcibly limit the maximum driving speed of the vehicle 5, but are not limited thereto.
[0035] Taking the dangerous driving procedure data corresponding to "frequent rapid acceleration driving pattern" as another example, the first operating condition included in the dangerous driving procedure data may represent, for example, "the accelerator pedal of vehicle 5 is pressed hard 3 times within a predetermined time period," while the second operating condition included in the dangerous driving procedure data may represent, for example, "the accelerator pedal of vehicle 5 is pressed hard 2 times within the predetermined time period," but it is not limited to this. Therefore, if the accelerator pedal of vehicle 5 is pressed hard by the driver more than 3 times within the predetermined time period, the second operating condition representing "the accelerator pedal is pressed hard 2 times" will definitely be met with higher priority than the first operating condition representing "the accelerator pedal is pressed hard 3 times." On the other hand, the first processing procedure included in the dangerous driving procedure data may, for example, represent "controlling the output unit 13 to output an avoid aggressive driving prompt" to remind the driver of the vehicle 5, while the second processing procedure included in the dangerous driving procedure data may, for example, represent "transmitting an aggressive driving warning notification to an external electronic device", wherein the external electronic device may, for example, be held by a manager of the transportation service organization to which the vehicle 5 belongs, and by outputting the aggressive driving warning notification through the external electronic device, the aggressive driving warning notification can indicate that the driver of the vehicle 5 has exhibited abnormal aggressive driving behavior, which helps the manager to intervene in real time to understand the situation, but is not limited to this.
[0036] It should be further noted that each of the first and second processing procedures can be freely adjusted and designed according to the dangerous driving conditions associated with them. For example, the first processing procedures can be implemented to control the output unit 13 to output various warning notices to remind the driver of the vehicle 5 by emitting sound and / or displaying text or graphics, while the second processing procedures can include, for example, activating the vehicle 5's warning lights, horn, or driver assistance mechanisms (such as automatic deceleration or automatic parking) through the vehicle computer, but are not limited thereto.
[0037] See also Figure 1 and Figure 2 The following describes in detail, by way of example, how the driving safety assistance system 1 of this embodiment implements a driving safety assistance method.
[0038] First, in step S1, the processing unit 14 controls the radio unit 12 to record sound, so as to obtain radio data generated by the radio unit 12. The radio data is equivalent to the result of the radio unit 12 recording sound in real time in the passenger space.
[0039] While the radio unit 12 continues to receive radio data and the processing unit 14 continues to receive real-time updated radio data from the radio unit 12, the process proceeds to step S2.
[0040] In step S2, the processing unit 14 performs real-time speech analysis on the recorded audio data by running the negative emotion assessment model, then calculates the negative emotion index based on the results of the speech analysis, and updates the negative emotion index in real time as the recorded audio data is updated. Furthermore, in this embodiment, the processing unit 14 performs speech analysis on the recorded audio data in a manner that includes, for example, semantic recognition and volume detection of the speech presented in the recorded audio data, thereby calculating the negative emotion index, but is not limited to this. While the processing unit 14 continues to calculate and update the negative emotion index, the process proceeds to step S3.
[0041] In step S3, the processing unit 14 compares the negative emotion index with a threshold value to determine whether a negative emotional state has occurred in the corresponding passenger space. More specifically, in this embodiment, the processing unit 14 determines that a negative emotional state has occurred if the negative emotion index reaches the threshold value, and determines that a negative emotional state has not occurred if the negative emotion index does not reach the threshold value. Moreover, since the processing unit 14 calculates the negative emotion index by performing voice analysis on the recorded audio data, if the processing unit 14 determines that a negative emotional state has occurred, it may mean, for example, that a verbal dispute or conflict has occurred in the passenger space (e.g., a verbal dispute between the driver and passengers), but it is not limited to this.
[0042] If the judgment result of the processing unit 14 in step S3 is negative, the process proceeds to step S4; on the other hand, if the judgment result of the processing unit 14 in step S3 is positive, the process proceeds to step S5.
[0043] In step S4, following step S3, once the processing unit 14 determines that the negative emotional state has not occurred based on the negative emotional index, the processing unit 14 sets the first operating conditions of the dangerous driving procedure data as multiple dangerous driving conditions, and sets the first processing procedures of the dangerous driving procedure data as multiple dangerous driving processing procedures corresponding to the respective dangerous driving conditions, without setting any second operating condition as a dangerous driving condition or any second processing procedure as a dangerous driving processing procedure. In other words, when it is determined that the negative emotional state has not occurred, the processing unit 14 will only treat the first operating conditions as the dangerous driving conditions and only treat the first processing procedures as the dangerous driving processing procedures. After the processing unit 14 completes the setting of the dangerous driving conditions and the dangerous driving processing procedures, the process proceeds to step S6.
[0044] In step S5, following step S3, once the processing unit 14 determines that a negative emotional state has occurred based on the negative emotion index, the processing unit 14 sets the second operating conditions of the dangerous driving procedure data as multiple dangerous driving conditions, and sets the second processing procedures of the dangerous driving procedure data as multiple dangerous driving processing procedures corresponding to the respective dangerous driving conditions, without setting any first operating condition as a dangerous driving condition or any first processing procedure as a dangerous driving processing procedure. In other words, when it is determined that a negative emotional state has occurred, the processing unit 14 will only treat the second operating conditions as dangerous driving conditions and only treat the second processing procedures as dangerous driving processing procedures. After the processing unit 14 completes the setting of the dangerous driving conditions and dangerous driving processing procedures, the process proceeds to step S6.
[0045] In step S6, which follows step S4 or step S5, the processing unit 14 determines, for example, whether the operating condition of the vehicle 5 meets any of the dangerous driving conditions through communication between itself and the vehicle's on-board computer.
[0046] Specifically, if the processing unit 14 determines in step S3 that the negative emotional state "has not" occurred, the process proceeds to step S4. In step S4, the processing unit 14 will only set the first operating conditions to the dangerous driving conditions. In this case, in step S6, the processing unit 14 will actually determine whether the operation of the vehicle 5 meets any of the first operating conditions, without using any of the second operating conditions for judgment. On the other hand, if the processing unit 14 determines in step S3 that the negative emotional state "has" occurred, the process proceeds to step S5. In step S5, the processing unit 14 will only set the second operating conditions to the dangerous driving conditions. In this case, in step S6, the processing unit 14 will actually determine whether the operation of the vehicle 5 meets any of the second operating conditions, without using any of the first operating conditions for judgment.
[0047] If the determination result of the processing unit 14 in step S6 is yes, the process proceeds to step S7. On the other hand, if the determination result of the processing unit 14 in step S6 is no, the process, for example, starts again from step S3.
[0048] In step S7, which follows step S6, once the processing unit 14 determines that the operating condition of the vehicle 5 meets any of the dangerous driving conditions, the processing unit 14 executes the dangerous driving handling procedure corresponding to that dangerous driving condition. Furthermore, after the processing unit 14 completes the execution of the dangerous driving handling procedure, the process may, for example, restart from step S3, but is not limited to this.
[0049] Specifically, if the processing unit 14 determines in step S3 that the negative emotional state "has not" occurred, the process proceeds to step S4. In step S4, the processing unit 14 will only set the first processing procedures as the dangerous driving processing procedures. In this case, the dangerous driving processing procedure executed by the processing unit 14 in step S7 will actually be one of the first processing procedures, and not any of the second processing procedures. On the other hand, if the processing unit 14 determines in step S3 that the negative emotional state "has" occurred, the process proceeds to step S5. In step S5, the processing unit 14 will only set the second processing procedures as the dangerous driving processing procedures. In this case, the dangerous driving processing procedure executed by the processing unit 14 in step S7 will actually be one of the second processing procedures, and not any of the first processing procedures.
[0050] Taking the aforementioned dangerous driving procedure data corresponding to the "speeding mode" as an example, assuming that the processing unit 14 determines in step S3 that the negative emotional state "has not" occurred, then in step S4, the processing unit 14 will set the first operating condition representing "driving speed higher than 60 km / h" as one of the dangerous driving conditions, and set the first processing procedure representing "controlling the output unit 13 to output the speeding warning notification" as one of the dangerous driving processing procedures. In other words, if the negative emotional state "has not" occurred, then in step S6, the processing unit 14 will use the first operating condition of "driving speed higher than 60 km / h" to determine whether the operating condition of the vehicle 5 conforms to the speeding mode. Furthermore, in the aforementioned situation, assuming that the processing unit 14 determines in step S6 that the operation of the vehicle 5 meets the dangerous driving conditions representing a speed exceeding 60 km / h, then the processing unit 14 will execute the dangerous driving processing procedure of "controlling the output unit 13 to output the speeding warning notification" in step S7 to remind the driver of the vehicle 5 to reduce speed. In other words, if the negative emotional state "does not" occur, the processing unit 14 will...
[0051] The first processing procedure, "controlling the output unit 13 to output the overspeed warning notification," serves as a driving safety assistance mechanism after the vehicle 5 meets the overspeed driving condition.
[0052] Taking the dangerous driving procedure data corresponding to the "speeding mode" as another example, assuming that the processing unit 14 determines in step S3 that the negative emotional state "has occurred", then in step S4, the processing unit 14 will set the second operating condition representing "driving speed higher than 50 km / h" as one of the dangerous driving conditions, and set the second processing procedure representing "limiting the maximum driving speed to 40 km / h" as one of the dangerous driving processing procedures. In other words, if the negative emotional state "has occurred", then in step S6, the processing unit 14 will use the second operating condition of "driving speed higher than 50 km / h" to determine whether the operating condition of the vehicle 5 conforms to the speeding mode. Furthermore, in the aforementioned situation, assuming that the processing unit 14 determines in step S6 that the operation of the vehicle 5 meets the dangerous driving condition representing a "driving speed higher than 50 km / h", then the processing unit 14 will execute the dangerous driving handling procedure of "limiting the maximum driving speed to 40 km / h" in step S7 to forcibly reduce the driving speed of the vehicle 5 to below 40 km / h. In other words, if the negative emotional state "has" occurred, the processing unit 14 will use the second handling procedure of "limiting the maximum driving speed to 40 km / h" as a driving safety assistance mechanism after the vehicle 5 meets the speeding condition.
[0053] In summary, in this embodiment, each of the dangerous driving conditions and dangerous driving procedures is determined by the processing unit 14 based on the judgment result of whether the negative emotional state has occurred. Therefore, for the same dangerous driving situation, the dangerous driving conditions set by the processing unit 14 are different when the negative emotional state "has not occurred" and "has occurred." Furthermore, it is worth noting that the dangerous driving conditions set by the processing unit 14 when the negative emotional state "has occurred" are more likely to be met than the dangerous driving conditions set when the negative emotional state "has not occurred." Further, when the vehicle 5's operating condition meets the dangerous driving conditions, the dangerous driving procedures executed by the processing unit 14 are also different when the negative emotional state "has not occurred" and "has occurred." Moreover, the dangerous driving procedures executed by the processing unit 14 when the negative emotional state "has occurred" are more proactive than the dangerous driving procedures executed when the negative emotional state "has not occurred," that is, more related to actively and forcibly controlling the vehicle 5, thereby reducing the risk of human operation to driving safety. Therefore, the driving safety assistance system 1 of this embodiment can provide assistance for driving safety in high-risk driving environments where negative emotional states occur (such as when the driver and passengers are arguing), with stricter judgment criteria and more proactive processing mechanisms, thereby reducing the potential risk of driving accidents.
[0054] The above is an example of how the driving safety assistance system 1 in this embodiment implements the driving safety assistance method. It should be understood that the foregoing descriptions of steps S1 to S7 and... Figure 2 The flowchart is merely an example illustrating one possible implementation of the driving safety assistance method. Furthermore, even if steps S1 to S7 are combined or their order is adjusted, as long as the same effect as this embodiment can be achieved, it is considered an implementable state of the driving safety assistance method. Therefore, the order of steps S1 to S7 is not intended to limit the scope of implementation of this invention.
[0055] The present invention also provides a second embodiment of the driving safety assistance system 1. Compared to the first embodiment, the second embodiment differs in that each dangerous driving procedure data includes only a single operating condition and the first and second processing procedures. Furthermore, in the driving safety assistance method implemented in the second embodiment, the processing unit 14 only sets the dangerous driving procedure(s) in steps S4 and S5, and does not set the dangerous driving conditions(s). More specifically, in the second embodiment, for the same dangerous driving state, the processing unit 14 only sets different dangerous driving procedures based on whether the negative emotional state occurs, and does not set different dangerous driving conditions based on whether the negative emotional state occurs. In other words, in the second embodiment, the dangerous driving conditions corresponding to each dangerous driving state are fixed, regardless of whether the negative emotional state occurs.
[0056] The present invention also provides a third embodiment of the driving safety assistance system 1. Compared to the first embodiment, the third embodiment differs in that each dangerous driving procedure data includes only a single processing procedure and the first operating condition and the second operating condition. Furthermore, in the driving safety assistance method implemented in the third embodiment, the processing unit 14 only sets the dangerous driving conditions(s) in steps S4 and S5, and does not set the dangerous driving processing procedures(s). More specifically, in the third embodiment, for the same dangerous driving state, the processing unit 14 only sets different dangerous driving conditions based on whether the negative emotional state occurs, and does not set different dangerous driving processing procedures based on whether the negative emotional state occurs. In other words, in the third embodiment, the dangerous driving processing procedure corresponding to each dangerous driving state is fixed, regardless of whether the negative emotional state occurs.
[0057] The present invention also provides a fourth embodiment of the driving safety assistance system 1. Compared with the first embodiment, the driving safety assistance system 1 of the fourth embodiment further includes, for example, a camera unit (not shown) electrically connected to the processing unit 14, and the camera unit may include, for example, multiple camera lens modules disposed on the vehicle 5 to record the environment around the vehicle 5. Moreover, in the fourth embodiment, the dangerous driving states corresponding to the dangerous driving procedure data may include, for example, one or more of the following states: a state indicating that the vehicle 5 is too close to the vehicle in front (failure to maintain a safe distance); a state indicating that the vehicle 5 changes lanes too frequently (wobbling); a state indicating that the vehicle 5 fails to yield to oncoming traffic when turning (failure to yield to oncoming traffic); and a state indicating that the vehicle 5 fails to yield to pedestrians in a pedestrian crossing (failure to yield to pedestrians in a pedestrian crossing). Furthermore, for each of the aforementioned dangerous driving state patterns corresponding to each of the dangerous driving procedure data, the first and second operating conditions included in each of them are determined by the processing unit 14, for example, based on image data generated by the imaging unit in real time. More specifically, in the driving safety assistance method implemented in the fourth embodiment, the processing unit 14, for example, controls the imaging unit to perform real-time recording in step S1 to obtain the image data from the imaging unit, and in step S6, the processing unit 14, for example, performs image recognition on the image data, and determines whether any of the dangerous driving conditions are met based on the result of the image recognition. It should be noted that, for each of the dangerous driving state patterns corresponding to each of the dangerous driving procedure data described in the fourth embodiment, the second operating condition included therein only needs to be met with higher priority than the first operating condition, and its detailed implementation is not the focus of this patent specification, so its details will not be described in excessive detail here.
[0058] The present invention also provides a fifth embodiment of the driving safety assistance system 1. Compared with the first embodiment, the fifth embodiment differs in that, in the driving safety assistance method implemented in the fifth embodiment, after the processing unit 14 completes the setting of the dangerous driving conditions, for example, it first selects at least one target dangerous driving condition corresponding to the current time and / or the current position of the vehicle 5 itself from the dangerous driving conditions. Furthermore, in step S6 of the fifth embodiment, the processing unit 14, for example, only uses the target dangerous driving conditions(s) to determine whether the operation of the vehicle 5 meets any one of the target dangerous driving conditions(s), and does not determine whether the operation of the vehicle 5 meets other dangerous driving conditions(s) besides the target dangerous driving conditions(s). In other words, the processing unit 14 in the fifth embodiment does not use other dangerous driving conditions (not the target dangerous driving conditions) to determine the operation of the vehicle 5. Therefore, the driving safety assistance system 1 of the fifth embodiment can provide driving safety assistance only for high-risk target dangerous driving conditions (e.g., the driving mode of the vehicle 5 conforms to the failure to yield to pedestrians) during specific time periods (e.g., school hours) and / or within specific geographical areas (e.g., school districts around schools), thereby reducing unnecessary calculations. Outside of specific time periods and / or specific geographical areas, it uses all such dangerous driving conditions to determine the operating status of the vehicle 5 in order to provide driving safety assistance.
[0059] Furthermore, it should be understood that the technical means in the first to fifth embodiments described above can be implemented in combination with each other. For example, in one embodiment, for some dangerous driving situations, the processing unit 14 will, as described in the first embodiment, set different dangerous driving conditions and different dangerous driving handling procedures based on whether the negative emotional state occurs. For other dangerous driving situations, the processing unit 14 will, as described in the second embodiment, set only different dangerous driving handling procedures based on whether the negative emotional state occurs. For still some dangerous driving situations, the processing unit 14 will, as described in the third embodiment, set only different dangerous driving conditions based on whether the negative emotional state occurs. Moreover, the processing unit 14 may, for example, use image recognition as described in the fourth embodiment to determine whether the operation of the vehicle 5 meets some of the dangerous driving conditions, and may, for example, as described in the fifth embodiment, use only the target dangerous driving conditions selected by the processing unit 14 based on the current time and / or current location to determine the operation of the vehicle 5 within a specific time period and / or within a specific geographical area.
[0060] In summary, by implementing this driving safety assistance method, the driving safety assistance system 1 determines the dangerous driving conditions and / or dangerous driving procedures based on the judgment result of whether the negative emotional state has occurred. Thus, the driving safety assistance system 1 can detect and assist in dangerous driving situations using different judgment criteria and / or procedures when the negative emotional state "has not occurred" and "has occurred." Therefore, the driving safety assistance system 1 is advantageous in providing assistance for driving safety and reducing the potential risk of driving accidents in high-risk driving environments where negative emotional states occur, by using stricter judgment criteria and / or more proactive handling mechanisms. Therefore, it effectively achieves the purpose of this invention.
[0061] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.
Claims
1. A driving safety assistance method, implemented by a driving safety assistance system disposed at least partially in a vehicle, the method comprising: The driving safety assistance method comprises: The driving safety assistance system obtains a sound data by sound collecting in a passenger space defined by the vehicle, and performs voice analysis on the sound data, and judges whether a negative emotion state occurs according to the result of voice analysis, and judges whether the operation condition of the vehicle meets a dangerous driving condition corresponding to a dangerous driving mode, and executes a dangerous driving processing program corresponding to the dangerous driving mode when the result of judgment is yes, and the driving safety assistance system determines at least one of the dangerous driving condition and the dangerous driving processing program according to the judgment result of whether the negative emotion state occurs.
2. The driving safety assistance method of claim 1, wherein: The driving safety assistance system stores a dangerous driving program data corresponding to the dangerous driving mode, and the dangerous driving program data comprises a first operation condition related to the operation condition of the vehicle, and a second operation condition related to the operation condition of the vehicle and meeting the first operation condition more preferentially; and When the driving safety assistance system judges that the negative emotion state does not occur, the driving safety assistance system sets the first operation condition as the dangerous driving condition, and when the driving safety assistance system judges that the negative emotion state occurs, the driving safety assistance system sets the second operation condition as the dangerous driving condition.
3. The driving safety assistance method of claim 1, wherein: The driving safety assistance system stores a dangerous driving program data corresponding to the dangerous driving mode, and the dangerous driving program data comprises a first processing program and a second processing program different from the first processing program; and When the driving safety assistance system judges that the negative emotion state does not occur, the driving safety assistance system sets the first processing program as the dangerous driving processing program, and when the driving safety assistance system judges that the negative emotion state occurs, the driving safety assistance system sets the second processing program as the dangerous driving processing program. The driving safety assistance system performs voice analysis on the sound data, which comprises semantic recognition and volume detection of the voice presented by the sound data, and calculates a negative emotion index according to the results of semantic recognition and volume detection, and the driving safety assistance system determines whether the negative emotion state occurs according to whether the negative emotion index reaches a threshold value.
4. The vehicle safety assistance method of claim 1, wherein, The driving safety assistance system also obtains an image data by photographing the surroundings of the vehicle, and the driving safety assistance system judges whether the operation condition of the vehicle meets the dangerous driving condition by image recognition on the image data.
5. The vehicle safety assistance method of claim 1, wherein, 6. The vehicle safety aid method of claim 1, wherein, The dangerous driving condition is taken as a target dangerous driving condition, and the driving safety assistance system selects the target dangerous driving condition corresponding to the current time and / or the current position of the vehicle from a plurality of dangerous driving conditions according to the current time and / or the current position of the vehicle itself, and the driving safety assistance system only judges whether the operation condition of the vehicle meets the dangerous driving condition, and does not judge whether the operation condition of the vehicle meets other dangerous driving conditions.
7. A driving safety assistance system adapted for a vehicle, the system comprising: Comprise: a receiving unit adapted to be arranged on the vehicle; and a processing unit electrically connected to the receiving unit; wherein the processing unit is configured to control the receiving unit to receive a sound from a passenger space defined by the vehicle to obtain a sound data, and perform voice analysis on the sound data, and determine whether a negative emotional state occurs according to the result of voice analysis, and the processing unit is further configured to determine whether the operation condition of the vehicle meets a dangerous driving condition corresponding to a dangerous driving pattern, and execute a dangerous driving processing program corresponding to the dangerous driving pattern when the determination result is positive, and the processing unit determines at least one of the dangerous driving condition and the dangerous driving processing program according to the determination result of whether the negative emotional state occurs.
8. The driving safety assistance system of claim 7, further comprising a storage unit electrically connected to the processing unit, wherein: the storage unit stores a dangerous driving program data corresponding to the dangerous driving pattern, and the dangerous driving program data comprises a first operation condition related to the operation condition of the vehicle, and a second operation condition related to the operation condition of the vehicle and which is more likely to be met than the first operation condition; and when the processing unit determines that the negative emotional state does not occur, the processing unit sets the first operation condition as the dangerous driving condition, and when the processing unit determines that the negative emotional state occurs, the processing unit sets the second operation condition as the dangerous driving condition.
9. The driving safety assistance system of claim 7, further comprising a storage unit electrically connected to the processing unit, wherein: the storage unit stores a dangerous driving program data corresponding to the dangerous driving pattern, and the dangerous driving program data comprises a first processing program and a second processing program different from the first processing program; and when the processing unit determines that the negative emotional state does not occur, the processing unit sets the first processing program as the dangerous driving processing program, and when the processing unit determines that the negative emotional state occurs, the processing unit sets the second processing program as the dangerous driving processing program. The processing unit performs voice analysis on the sound data by performing semantic recognition and volume detection on the voice presented by the sound data, and calculating a negative emotional index according to the results of semantic recognition and volume detection, and the processing unit determines whether the negative emotional state occurs according to whether the negative emotional index reaches a threshold value.
10. The vehicle safety aid system of claim 7, wherein, 11. The driving safety auxiliary system according to claim 7, further comprising a photographing unit adapted to be disposed on the vehicle and electrically connected to the processing unit, wherein the photographing unit is adapted to capture the image of the driver and the processing unit is adapted to determine the driving safety state of the driver based on the captured image. 5 The processing unit also controls the photographing unit to photograph the surroundings of the vehicle to obtain an image data from the photographing unit, and the processing unit determines whether the operation condition of the vehicle meets the dangerous driving condition by performing image recognition on the image data.
12. The vehicle safety aid system of claim 7, wherein, The dangerous driving condition is a target dangerous driving condition, and the processing unit selects the target dangerous driving condition corresponding to the current time and / or the current location of the vehicle from a plurality of dangerous driving conditions according to the current time and / or the current location of the vehicle, and the processing unit only determines whether the operation condition of the vehicle meets the dangerous driving condition, and does not determine whether the operation condition of the vehicle meets other dangerous driving conditions other than the dangerous driving condition.
Citation Information
Patent Citations
KR20200055171A