A method, device and storage medium for vehicle dangerous driving early warning

Abstract

The application relates to a vehicle dangerous driving early warning method and device and a storage medium, and relates to the technical field of vehicles. The method comprises the following steps: acquiring image information of a driver and driving information of a vehicle corresponding to the driver; performing behavior feature recognition on the image information to obtain behavior information of the driver; judging whether the behavior information belongs to a violation behavior; if the behavior information belongs to the violation behavior, judging whether the violation behavior belongs to a dangerous behavior based on the driving information; and if the violation behavior belongs to the dangerous behavior, outputting early warning information. The application has the effect of improving the accuracy of early warning information of a dangerous early warning system.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and in particular to a method, device and storage medium for warning of dangerous driving in a vehicle. Background Technology

[0002] As a means of transportation, vehicles have gradually permeated all aspects of life, such as transportation and travel. However, due to sudden external situations during driving (such as a vehicle suddenly changing lanes in front or a vehicle suddenly approaching from behind) and the driver's driving status (making or receiving phone calls or not wearing a seat belt), which may pose a life-threatening danger to the driver and other drivers, many vehicles have been equipped with hazard warning systems to ensure driver safety.

[0003] Currently, warning signals are only issued by judging whether the driver's actions are illegal in order to alert the driver that an accident may occur, such as picking up a mobile phone. However, the specific scenario or purpose of the user's illegal action is different, and the probability of a dangerous accident will vary. Therefore, the warning signal issued only after the illegal action is identified has low accuracy and large error.

[0004] Therefore, how to improve the accuracy of early warning signals has become a problem. Summary of the Invention

[0005] To improve the accuracy of alarm commands in a hazard warning system, this application provides a method, apparatus, and storage medium for vehicle dangerous driving warning.

[0006] Firstly, this application provides a method for warning of dangerous driving by a vehicle, employing the following technical solution:

[0007] A method for issuing a warning of dangerous driving by a vehicle includes:

[0008] Acquire the driver's image information and the driving information of the vehicle corresponding to the driver;

[0009] Behavioral feature recognition is performed on the image information to obtain the driver's behavioral information;

[0010] Determine whether the behavioral information constitutes a violation;

[0011] If the behavioral information constitutes a violation, then the driving information is used to determine whether the violation constitutes a dangerous behavior.

[0012] If the violation is considered a dangerous act, a warning message will be issued.

[0013] By employing the aforementioned technical solution, driver image information is acquired to facilitate subsequent behavioral feature recognition, thereby obtaining the driver's behavioral information and determining whether the driver's behavior constitutes a violation. This allows for a clear understanding of whether the driver is potentially in danger. The driving information of the vehicle corresponding to the driver is also acquired. When the driver's behavior is found to be a violation, the driving information can be used to determine whether the violation is dangerous. If the violation is deemed dangerous, it indicates a high probability of the driver being in danger, and a warning message is output to remind the driver of the potential for an accident based on their current driving behavior and vehicle information. Even when a violation is detected, since violations are not necessarily dangerous, further evaluation is conducted to determine whether the violation is dangerous. If it is deemed dangerous, a warning message is output, thus improving the accuracy of the warning information and making it more precise in indicating the dangerous situation.

[0014] In another possible implementation, determining whether the behavioral information constitutes a violation, and if the behavioral information does constitute a violation, then determining whether the violation constitutes a dangerous behavior based on the driving information, includes:

[0015] The behavioral information is matched with the behavioral information in a preset behavioral information database;

[0016] If a match is found, the behavior information is determined to be a violation.

[0017] If the behavior information is a violation, then it is determined whether the driving information is dangerous driving information. The dangerous driving information is the driving information corresponding to when the violation is a dangerous behavior.

[0018] If so, the violation is determined to be a dangerous act.

[0019] By adopting the above technical solution, the preset behavior information database is a pre-set database of behavior information used as a standard to determine whether behavior information constitutes a violation. Behavior information is matched against behavior information in the preset database; when a match is successful, it indicates that the behavior information constitutes a violation. Since a driver's behavior information constitutes a violation does not necessarily pose a danger to the driver, it is necessary to determine whether the violation constitutes a dangerous behavior. This can be done by judging whether the driving information corresponds to a dangerous form of behavior, where dangerous driving information refers to the driving information corresponding to a dangerous violation. When dangerous driving information is detected, it indicates that the driver's violation is a dangerous behavior, thus achieving the effect of determining whether the driver's violation constitutes a dangerous behavior.

[0020] In another possible implementation, the method further includes:

[0021] Determine the category information corresponding to the dangerous behavior, and the category information is related to the dangerous behavior;

[0022] Based on the aforementioned category information, the warning information corresponding to the dangerous behavior is determined.

[0023] By adopting the above technical solution, since drivers engage in various behaviors during vehicle operation, it is possible to identify the types of dangerous behaviors, with a corresponding relationship between these types and the dangerous behaviors. Based on this type information, corresponding warning information is determined, enabling the warning information to more accurately represent the currently existing dangerous behaviors. This allows drivers to clearly understand which behaviors constitute dangerous actions and make targeted adjustments.

[0024] In another possible implementation, the output warning information further includes:

[0025] Obtain the location information of the vehicle;

[0026] Based on the location information, determine the image acquisition device within the preset range corresponding to the location information;

[0027] Acquire image information acquired by the image acquisition device;

[0028] Based on the image information, determine the vehicle distribution within the preset range of the vehicle;

[0029] Based on the dangerous behavior and the vehicle distribution, an event to be caused is determined, wherein the event to be caused is an event that may be caused by the dangerous behavior;

[0030] Output the event to be occurred.

[0031] By adopting the above technical solution, the vehicle's location information is obtained to clarify the vehicle's current location. Based on the location information, an image acquisition device within a preset range corresponding to the location information is determined. The preset range is a pre-defined area, and the image acquisition device within the preset range is a device capable of capturing the surrounding vehicle conditions. Therefore, by acquiring the image information collected by the image acquisition device, the distribution of vehicles within the preset range can be determined based on the image information. This allows for the subsequent identification of potential events (i.e., events to be triggered) based on the driver's dangerous behavior, and the event to be triggered is output. This enables the driver to clearly understand the possible consequences of their current behavior, allowing them to more intuitively understand the impact of their actions, thereby improving the warning effect of the hazard warning system.

[0032] In another possible implementation, the process of determining the event to occur based on the dangerous behavior and the vehicle distribution further includes:

[0033] Determine the solution corresponding to the event to be occurred;

[0034] The solution is output so that the driver can adjust the driving information according to the solution;

[0035] If the driving information does not reach the target driving information within a preset time, the target device corresponding to the solution is controlled to execute according to the solution, which corresponds to the target driving information and the target device.

[0036] By adopting the above technical solution, since drivers may panic upon learning of the impending event, preventing them from formulating a good solution and adjusting the current driving information, the electronic device, after identifying the impending event, can determine the corresponding solution and output it. This allows the driver to adjust the driving information according to the solution, thereby improving driver safety. Because drivers may not be able to rationally and clearly adjust the driving information according to the solution in a panicked state, the driving information can be checked within a preset time. This preset time is a pre-set period for the driver to adjust. If the driving information does not reach the target driving information within the preset time, it indicates that the driver has not adjusted the driving information according to the solution. Therefore, the electronic device can control the target device corresponding to the solution to execute according to the solution, thus better protecting the driver's life safety during driving. The solution corresponds to target driving information and a target device. The target driving information is the driving information obtained after processing according to the solution. The target device is the equipment required to operate during the execution of the solution.

[0037] In another possible implementation, if the driving information does not reach the target driving information within a preset time, the method further includes:

[0038] Output a notification message to alert other vehicles.

[0039] By adopting the above technical solution, when the vehicle's driving information fails to reach the target driving information within a preset time, it indicates that the vehicle is in a dangerous state and is likely to have an accident with other vehicles. Therefore, a prompt message can be output to remind other vehicles that the vehicle is in danger, so that other vehicles can take corresponding actions and avoid accidents to a certain extent.

[0040] In another possible implementation, the method further includes:

[0041] Obtain the current time and the time when the driver last committed the violation;

[0042] Based on the occurrence time and the frequency of the violation, a target time for the driver to commit the violation is predicted, and the violation has a corresponding frequency.

[0043] Calculate the time difference between the current time and the target time;

[0044] If the time difference is less than the preset time difference, then it is determined whether the current driving information belongs to the dangerous driving information corresponding to the violation.

[0045] If it falls under this category, then the warning information will be output.

[0046] By employing the aforementioned technical solution, the time of the driver's last violation is obtained. Based on the occurrence time and the frequency of the violation, the target time for the driver to commit the violation can be predicted, thus enabling advance knowledge of the potential timeframe for the violation. The current time is then obtained to calculate the time difference between the current time and the target time. A pre-set time difference value is used. When the time difference is less than this value, it indicates that the driver is about to commit the violation. The current driving information is then assessed to determine if it falls under the category of dangerous driving information corresponding to the violation, thus helping to assess whether the driver is about to commit a dangerous act. If the current driving information falls under the category of dangerous driving information corresponding to the violation, it indicates that the driver is about to commit a dangerous act, and a warning message is output to warn the driver in advance, thereby preventing the driver from committing a dangerous act to a certain extent.

[0047] Secondly, this application provides a vehicle dangerous driving warning device, which adopts the following technical solution:

[0048] A vehicle dangerous driving warning device, comprising:

[0049] The first acquisition module is used to acquire the driver's image information and the driving information of the vehicle corresponding to the driver;

[0050] The recognition module is used to perform behavioral feature recognition on the image information to obtain the driver's behavioral information;

[0051] The first judgment module is used to determine whether the behavior information constitutes a violation.

[0052] The second judgment module is used to determine whether the violation is a dangerous behavior based on the driving information when the behavior information is a violation.

[0053] The first output module is used to output warning information when the violation is a dangerous behavior.

[0054] By adopting the above technical solution, the first acquisition module acquires the driver's image information, enabling the subsequent recognition module to perform behavioral feature recognition on the image information, thereby obtaining the driver's behavioral information. The first judgment module then determines whether the driver's behavior constitutes a violation, thus clearly understanding whether the driver is potentially in danger. Simultaneously, the first acquisition module acquires the vehicle's driving information. When the driver's behavior is found to be a violation, the second judgment module can determine whether the violation is a dangerous behavior based on the driving information. If the violation is deemed dangerous, it indicates a high probability of the driver being in danger. Therefore, the first output module outputs a warning message to remind the driver of the potential accident, indicating a high likelihood of danger. When a violation is detected, since a violation does not necessarily constitute a dangerous behavior, further judgment is made to determine whether the violation is dangerous. If it is deemed dangerous, a warning message is output, thus making the warning message more accurately represent the dangerous situation and improving the accuracy of the warning information.

[0055] In another possible implementation, when the first judgment module determines whether the behavior information constitutes a violation, and when the second judgment module determines whether the violation constitutes a dangerous behavior based on the driving information when the behavior information constitutes a violation, the specific functions are as follows:

[0056] The behavioral information is matched with the behavioral information in a preset behavioral information database;

[0057] If a match is found, the behavior information is determined to be a violation.

[0058] If the behavior information is a violation, then it is determined whether the driving information is dangerous driving information. The dangerous driving information is the driving information corresponding to when the violation is a dangerous behavior.

[0059] If so, the violation is determined to be a dangerous act.

[0060] In another possible implementation, the device further includes:

[0061] The first determining module is used to determine the type information corresponding to the dangerous behavior, and the type information has a corresponding relationship with the dangerous behavior;

[0062] The second determining module is used to determine the warning information corresponding to the dangerous behavior based on the category information.

[0063] In another possible implementation, the device further includes:

[0064] The second acquisition module is used to acquire the location information of the vehicle;

[0065] The third determining module is used to determine the image acquisition device within a preset range corresponding to the location information based on the location information;

[0066] The third acquisition module is used to acquire image information acquired by the image acquisition device;

[0067] The fourth determining module is used to determine the vehicle distribution within the preset range of the vehicle based on the image information;

[0068] The fifth determining module is used to determine the event to be caused based on the dangerous behavior and the vehicle distribution, wherein the event to be caused is an event that may be caused by the dangerous behavior;

[0069] The second output module is used to output the event to be occurred.

[0070] In another possible implementation, the device further includes:

[0071] The sixth determining module is used to determine the solution corresponding to the event to be occurred;

[0072] The third output module is used to output the solution so that the driver can adjust the driving information according to the solution;

[0073] The control module is used to control the target device corresponding to the solution to execute according to the solution when the driving information does not reach the target driving information within a preset time. The solution corresponds to the target driving information and the target device.

[0074] In another possible implementation, the device further includes:

[0075] The fourth output module is used to output a prompt message to alert other vehicles.

[0076] In another possible implementation, the device further includes:

[0077] The fourth acquisition module is used to acquire the current time and the time when the driver last committed the violation.

[0078] The prediction module is used to predict the target time when the driver will commit the violation based on the occurrence time and the violation frequency corresponding to the violation. The violation has a corresponding violation frequency.

[0079] The calculation module is used to calculate the time difference between the current time and the target time;

[0080] The third judgment module is used to determine whether the current driving information belongs to the dangerous driving information corresponding to the violation when the time difference is less than the preset time difference.

[0081] The fifth output module outputs the warning information when the condition is met.

[0082] Thirdly, this application provides an electronic device that adopts the following technical solution:

[0083] An electronic device comprising:

[0084] One or more processors;

[0085] Memory;

[0086] One or more applications, wherein the applications are stored in memory and configured to be executed by one or more processors, the applications being configured to: perform a method for warning of dangerous driving of a vehicle as shown in any possible implementation of the first aspect.

[0087] Fourthly, this application provides a computer-readable storage medium, which adopts the following technical solution:

[0088] A computer-readable storage medium that, when the computer program is executed in a computer, causes the computer to perform the method for warning of dangerous driving of a vehicle as described in any of the first aspects.

[0089] In summary, this application includes at least one of the following beneficial technical effects:

[0090] 1. Acquire the driver's image information to facilitate subsequent behavioral feature recognition, thereby obtaining the driver's behavioral information and determining whether the driver's behavior constitutes a violation, thus clearly understanding whether the driver is in danger. Acquire the driving information of the vehicle corresponding to the driver so that when the driver's behavior is a violation, the driving information can be used to determine whether the current violation is a dangerous behavior. If the violation is a dangerous behavior, it indicates that the driver is in a high risk of danger, and a warning message is output to remind the driver of the current driving behavior and vehicle driving information, indicating that an accident may occur, i.e., the probability of danger is high. When the driver's behavior is detected as a violation, since a violation is not necessarily a dangerous behavior, further judgment is made on whether the driver's violation is a dangerous behavior. If it is a dangerous behavior, a warning message is output, thus making the warning message more accurately represent the dangerous situation and improving the accuracy of the warning message.

[0091] 2. Because drivers may panic upon learning of the impending event, they may be unable to formulate a good solution or adjust the current driving information. Therefore, after identifying the impending event, the electronic device can determine the corresponding solution and output it, allowing the driver to adjust the driving information accordingly, thereby improving driver safety. Since drivers may not be able to rationally and clearly adjust the driving information according to the solution in a panicked state, a pre-set time limit can be used to check the driving information. This pre-set time is a period for the driver to adjust. If the driving information does not reach the target driving information within the pre-set time, it indicates that the driver has not adjusted the driving information according to the solution. Therefore, the electronic device can control the target device corresponding to the solution to execute the solution, thus better protecting the driver's life safety during driving. The solution corresponds to target driving information and target device. The target driving information is the driving information obtained after processing according to the solution. The target device is the equipment required to operate during the execution of the solution. Attached Figure Description

[0092] Figure 1 This is a flowchart illustrating a method for issuing a warning for dangerous driving of a vehicle, as described in an embodiment of this application.

[0093] Figure 2 This is a schematic diagram of the structure of a vehicle dangerous driving warning device according to an embodiment of this application.

[0094] Figure 3 This is a schematic diagram of the structure of an electronic device according to an embodiment of this application. Detailed Implementation

[0095] The following is in conjunction with the appendix Figure 1-3 This application will be described in further detail.

[0096] After reading this specification, those skilled in the art may make modifications to this embodiment without contributing any inventive step, but such modifications are protected by patent law as long as they fall within the scope of the claims of this application.

[0097] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0098] Furthermore, the term "and / or" in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this article, unless otherwise specified, generally indicates that the preceding and following related objects have an "or" relationship.

[0099] The embodiments of this application will now be described in further detail with reference to the accompanying drawings.

[0100] This application provides a method for issuing a vehicle dangerous driving warning, executed by an electronic device. This electronic device can be a server or a terminal device. The server can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. The terminal device can be a smartphone, tablet, laptop, desktop computer, etc., but is not limited to these. The terminal device and the server can be directly or indirectly connected via wired or wireless communication. This application does not impose any limitations on this. Figure 1 As shown, the method includes steps S101, S102, S103, S104, and S105, wherein,

[0101] Step S101: Obtain the driver's image information and the driving information of the vehicle corresponding to the driver.

[0102] In this embodiment of the application, the vehicle corresponding to the driver refers to the vehicle currently being driven by the driver. Assume the current driver is driver a, and the vehicle driven by driver a is vehicle a. Image information a of driver a is acquired to facilitate subsequent determination of driver a's behavior information based on image information a. Driving information of vehicle a is acquired to facilitate subsequent assessment of whether the driver has engaged in dangerous behavior.

[0103] Specifically, an image acquisition device can be installed in vehicle A, capable of capturing images of driver A and obtaining driver A's image information through the image acquisition device within vehicle A. Driving information of vehicle A can be obtained through vehicle A's onboard terminal.

[0104] Step S102: Perform behavioral feature recognition on the image information to obtain the driver's behavioral information.

[0105] In this embodiment of the application, continuing from the previous example, behavioral feature recognition is performed on image information a to obtain the behavioral information of driver a, so as to determine whether driver a has violated regulations based on the behavioral information of driver a.

[0106] In this embodiment of the application, when performing behavioral feature recognition on image information a, the specific steps are as follows: first, image information a is converted to grayscale to obtain a grayscale image of image information a; then, edge detection is performed on the grayscale image of image information a to obtain the contour information of multiple features in the grayscale image; and the contour information belonging to driver a is determined based on the contour information of multiple features, thereby determining the behavioral information of driver a based on the contour information of driver a.

[0107] In this embodiment, when the electronic device analyzes the driver's behavior information and the vehicle's driving information, the behavior information and driving information can be stored first, specifically through Kafka. Furthermore, since the stored information will be processed and analyzed subsequently, if the amount of stored information fluctuates significantly (e.g., the first segment contains 500 entries, the second 1000, the third 200, and the fourth 300), the stability of the hazard warning system will be poor, thus affecting the output of warning information. Therefore, when storing information, a peak-shaving and valley-filling method can be used to ensure the stability of the hazard warning system. Assuming the current maximum processing capacity is 500 records, when storing the second segment of information, the 1000 records can be divided into two parts: first, 500 records are stored, and then another 500 records from the second segment are stored. When storing the third segment, both the third and fourth segments can be stored simultaneously (valley filling), ensuring that each subsequent analysis always involves 500 records, thus guaranteeing system stability. Further analysis can then be performed using Flink to process the stored information.

[0108] Step S103: Determine whether the behavior information constitutes a violation.

[0109] In this embodiment of the application, it is determined whether the behavior information of driver a constitutes a violation, so as to subsequently determine whether driver a has engaged in dangerous behavior. Assume that the behavior information of driver a involves making or receiving a phone call.

[0110] Step S104: If the behavior information is a violation, then determine whether the violation is a dangerous behavior based on the driving information.

[0111] In the embodiments of this application, when the behavior information of driver a is a violation, it means that the current behavior of driver a may be dangerous, that is, the current behavior of driver a may not be dangerous. Therefore, it is necessary to continue to judge whether the violation of driver a is a dangerous behavior based on the driving information, so as to further determine whether the current behavior of driver a is dangerous.

[0112] Step S105: If the violation is a dangerous behavior, then output a warning message.

[0113] In this embodiment of the application, when driver a's violation is a dangerous act, it indicates that driver a's current behavior is dangerous and outputs a warning message, so that driver a can clearly understand that the current behavior is dangerous.

[0114] In this embodiment of the application, the warning information can be output to the vehicle terminal of the vehicle a driven by driver a, or it can be broadcast through a speaker, or other output methods, which are not limited here.

[0115] Furthermore, in this embodiment, the driver may be an employee of the transportation company. The driver's identity information and the vehicle information of the corresponding vehicle can be obtained. When the driver engages in dangerous behavior, the driver's identity information, vehicle information, and warning information can be output to the display device of the driver's supervisor, allowing the supervisor to promptly understand whether the driver is in a normal working state.

[0116] In one possible implementation of this application embodiment, steps S103 and S104 determine whether the behavior information constitutes a violation. If the behavior information constitutes a violation, then determining whether the violation constitutes a dangerous behavior based on the driving information specifically includes steps Sa (not shown in the figure), Sb (not shown in the figure), Sc (not shown in the figure), and Sd (not shown in the figure).

[0117] Step Sa involves matching the behavioral information with the behavioral information in a preset behavioral information database.

[0118] In this embodiment of the application, the preset behavior information database is a pre-set behavior information database. The preset behavior information database includes multiple behavior information that are violations. The behavior information is matched with the behavior information in the preset behavior information database in order to determine whether the behavior information of driver a is a violation.

[0119] Assume that driver A's behavior information is making or receiving phone calls, and the preset behavior information database includes making or receiving phone calls and holding the steering wheel with one hand.

[0120] In this embodiment of the application, the behavioral information in the preset behavioral information database can be manually entered by the driver, or the electronic device can be connected to the cloud server to update the behavioral information in real time through cloud services.

[0121] Step S1b: If the match is successful, the behavior information is determined to be a violation.

[0122] In this embodiment of the application, when a match is successful, it indicates that driver a's behavior information is in a preset behavior information database, thus indicating that driver a's behavior information constitutes a violation. Continuing the previous example, driver a's behavior information is making and receiving phone calls. The preset behavior information database includes making and receiving phone calls and holding the steering wheel with one hand. Therefore, driver a's current behavior of making and receiving phone calls is a violation, further illustrating that driver a's current behavior of making and receiving phone calls may be dangerous.

[0123] In this embodiment of the application, the driver's violations can also be pre-set, and each violation has a corresponding flag bit. When the driver is detected to have committed the violation, the flag bit corresponding to the violation can be 1. When the violation is not triggered or the violation ends, the flag bit corresponding to the violation is 0.

[0124] Step Sc: If the behavior information is a violation, then determine whether the driving information is dangerous driving information.

[0125] Among them, dangerous driving information refers to the driving information corresponding to violations that are considered dangerous.

[0126] In this embodiment of the application, dangerous driving information is the driving information corresponding to a violation that is considered a dangerous behavior. Therefore, when driver a's behavior information is a violation, it can be determined whether the current driving information is dangerous driving information, thereby determining whether driver a is currently engaging in dangerous behavior.

[0127] Continuing with the previous example, driver A's behavior information is making and receiving phone calls, which is a violation. Assume that the dangerous driving information corresponding to making and receiving phone calls is a speed greater than 60 km / h.

[0128] In this embodiment, the dangerous driving information corresponding to the violation can be manually set by the driver or updated in real time by a cloud server. For example, the dangerous driving information can be updated based on the driver's current driving experience. Specifically, assuming driver A has 3 years of driving experience and driver B has 1 year of driving experience, when driver A is driving vehicle A, the dangerous driving information corresponding to making or receiving a phone call can be a speed greater than 70 km / h. When driver B is driving vehicle A, the dangerous driving information corresponding to making or receiving a phone call can be a speed greater than 50 km / h.

[0129] If step Sd is found to be true, then the violation is determined to be a dangerous behavior.

[0130] In the embodiments of this application, assuming that the vehicle a's speed is 80 km / h, which is dangerous driving information corresponding to making or receiving a phone call, it means that the current driver a's behavior is likely to be dangerous, and it can be determined that the current driver a's behavior of making or receiving a phone call is a dangerous behavior.

[0131] One possible implementation of this application embodiment further includes steps S106 (not shown in the figure) and S107 (not shown in the figure), wherein,

[0132] Step S106: Determine the type information corresponding to the dangerous behavior.

[0133] Among them, the type information corresponds to the dangerous behavior.

[0134] In this embodiment of the application, there is a correspondence between the type information and the dangerous behavior. Since the driver may engage in various behaviors while driving the vehicle, such as driver a’s behavior information including making and receiving phone calls, the type information corresponding to the dangerous behavior is determined so that the corresponding warning information can be output in the future.

[0135] Assume the type of information corresponding to answering a phone call is incorrect hand position.

[0136] Step S107: Based on the category information, determine the warning information corresponding to the dangerous behavior.

[0137] In this embodiment of the application, warning information corresponding to dangerous behavior is determined based on the type information, so that the warning information can more accurately represent the dangerous behavior that currently exists, thereby making it easier for the driver to clearly understand what kind of behavior is dangerous and to make targeted adjustments.

[0138] Continuing with the previous example, if the type of phone call is incorrect (hand position error), the corresponding warning message could be "Your hand is in the wrong position".

[0139] In one possible implementation of this application embodiment, after step S105, steps S108 (not shown in the figure), S109 (not shown in the figure), S110 (not shown in the figure), S111 (not shown in the figure), S112 (not shown in the figure), and S113 (not shown in the figure) are further included, wherein,

[0140] Step S108: Obtain the vehicle's location information.

[0141] In this embodiment of the application, the vehicle's location information is obtained to determine the vehicle's current exact location. Assume the vehicle's location information is: longitude A° (degrees), latitude B°. In this embodiment, the vehicle is equipped with a GPS locator, which can be used to obtain the vehicle's location information.

[0142] Step S109: Based on the location information, determine the image acquisition device within the preset range corresponding to the location information.

[0143] In this embodiment of the application, the preset range is a pre-defined range. Continuing with the previous example, the location information is longitude A° and latitude B°. The preset range corresponding to the location information can be a range with a radius of 1 km centered at longitude A° and latitude B°. The image acquisition device within this range is an image acquisition device capable of acquiring images of the vehicle conditions around vehicle a. The image acquisition device within the preset range corresponding to the location information of vehicle a is determined based on the location information of vehicle a, so that the vehicle conditions around the current vehicle a can be determined subsequently.

[0144] Step S110: Obtain image information acquired by the image acquisition device.

[0145] In this embodiment of the application, since the image acquisition device is an image acquisition device within a preset range, and the image acquisition device within the preset range is an image acquisition device that can acquire the vehicle conditions around the vehicle, the image information acquired by the image acquisition device is obtained so as to subsequently determine the driving conditions of other vehicles around the vehicle.

[0146] Step S111: Based on the image information, determine the vehicle distribution within a preset range.

[0147] In this embodiment of the application, the distribution of vehicles within a preset range is determined based on image information, so as to identify possible events to occur by combining dangerous behaviors.

[0148] In this embodiment of the application, vehicle feature extraction can be performed on image information to determine the vehicle distribution within a preset range. It is assumed that the vehicle distribution within the preset range is as follows: there is vehicle b directly in front of the vehicle with a speed of 60 km / h, vehicle c to the northeast with a speed of 90 km / h, and vehicle d to the southeast with a speed of 70 km / h.

[0149] Step S112: Determine the event to occur based on the dangerous behavior and vehicle distribution.

[0150] Among them, the event to be occurred refers to the event that may be caused by dangerous behavior.

[0151] In this embodiment of the application, the event to be occurred is the event that may be caused by the driver continuing to drive in the dangerous manner. The event to be occurred is determined based on the dangerous behavior and the current vehicle distribution to clarify the traffic accident that the current vehicle may cause. Assume that the dangerous behavior of vehicle a is making or receiving a phone call, and the driving information is a speed of 80 km / h. Since the vehicle distribution is a distribution within a preset range, taking step S109 as an example, the preset range is within 1 km of the current vehicle a, that is, vehicles b, c, and d are relatively close to the current vehicle a. If the driver of vehicle a continues to make or receive a phone call and drives at a speed of 80 km / h, he may collide with vehicle b directly in front of him. And there are currently three vehicles, b, c, and d, around the current vehicle a. Therefore, the event to be occurred can be a collision with other vehicles.

[0152] Step S113: Output the events to be occurred.

[0153] In this embodiment, the event to be triggered is output so that the driver can clearly understand the possible consequences of their current actions. This allows the driver to more intuitively understand the impact of their actions, thereby improving the warning effect of the hazard warning system. In this embodiment, the event to be triggered can be output on the vehicle's in-vehicle terminal or via voice broadcast; there is no limitation on this.

[0154] One possible implementation of this application embodiment further includes steps S114 (not shown in the figure), S115 (not shown in the figure), and S116 (not shown in the figure), wherein step S114 can be executed after step S112, wherein,

[0155] Step S114: Determine the solution corresponding to the event to be occurred.

[0156] In the embodiments of this application, since drivers may panic after learning of the expected time, they may not be able to formulate a good solution or adjust the current driving information. Therefore, after determining the expected event, the electronic device can further determine the solution corresponding to the expected event.

[0157] Taking step S112 as an example, when the event to be occurred is a collision with other vehicles, the solution can be to reduce the vehicle speed.

[0158] Step S115: Output the solution.

[0159] In this embodiment, a solution is output so that the driver can adjust driving information accordingly to avoid collisions with other vehicles. In this embodiment, the solution can be output to the vehicle's in-vehicle terminal for the driver to clearly see, or it can be output via voice announcement so the driver can understand the solution even without seeing the in-vehicle terminal prompts. Other output methods are also possible.

[0160] Step S116: If the driving information does not reach the target driving information within the preset time, the target device corresponding to the control solution shall execute according to the solution.

[0161] The solution includes target driving information and target equipment.

[0162] In this embodiment, the preset time is a pre-defined time range used to determine whether the driver has adjusted the driving information. Let's assume the preset time is 2 minutes. Since a driver in a panic may not be able to rationally and clearly adjust the driving information according to the solution, the driving information can be checked within 2 minutes. If the driving information does not reach the target driving information within 2 minutes, it indicates that the driver has not adjusted the driving information according to the solution. Therefore, the electronic device can control the target device corresponding to the solution to execute according to the solution, thereby better protecting the driver's life safety during driving. The solution corresponds to target driving information and a target device. The target driving information is the driving information obtained after processing according to the solution. The target device is the equipment required to operate during the execution of the solution.

[0163] One possible implementation of this application embodiment further includes step S117 (not shown in the figure), wherein...

[0164] Step S117: Output a prompt message to alert other vehicles.

[0165] In this embodiment of the application, taking step S116 as an example, when it is detected that the driving information has not reached the target driving information within 2 minutes, it indicates that the current vehicle is in a dangerous state and the possibility of an accident with other vehicles is relatively high. Therefore, a prompt message can be output to remind other vehicles that the vehicle is in danger, thereby facilitating their corresponding actions and preventing the event from occurring to some extent. In this embodiment of the application, the prompt message can be the vehicle's hazard lights. When the driving information has not reached the target driving information within 2 minutes, the vehicle can be controlled to turn on its hazard lights to alert other vehicles.

[0166] One possible implementation of this application embodiment further includes steps S118 (not shown in the figure), S119 (not shown in the figure), S120 (not shown in the figure), S121 (not shown in the figure), and S122 (not shown in the figure), wherein step S118 can be executed after step S105, wherein,

[0167] Step S118: Obtain the current time and the time when the driver last committed a violation.

[0168] In this embodiment of the application, the time of the driver's last violation is obtained so that the target time for the driver to commit the violation can be predicted based on the time of occurrence and the frequency of the violation. This makes it easier to know in advance when the driver may commit the violation. The current time is obtained so that the time difference between the current time and the target time can be calculated, thereby making it easier to determine whether the driver is about to commit the violation.

[0169] Suppose that the last time driver a held the steering wheel with one hand was at 9:45, and the current time is 10:12.

[0170] Step S119: Based on the occurrence time and the frequency of violations corresponding to the violations, predict the target time when the driver will commit a violation.

[0171] Among these, violations are categorized by frequency.

[0172] In this embodiment of the application, the violation behavior corresponds to the violation frequency. Assuming that the violation frequency corresponding to holding the steering wheel with one hand is 2 times / hour, and combined with the occurrence time of 9:45, it is calculated that the next time point for driver a to hold the steering wheel with one hand may be 10:15, that is, the target time is 10:15.

[0173] Step S120: Calculate the time difference between the current time and the target time.

[0174] In this embodiment of the application, the time difference can be calculated by subtracting the current time from the target time. Continuing with the previous example, the time difference is 3 minutes. This allows for subsequent determination based on the time difference whether driver A's action of holding the steering wheel with one hand is about to occur.

[0175] Step S121: If the time difference is less than the preset time difference, determine whether the current driving information belongs to dangerous driving information corresponding to the violation.

[0176] In this embodiment of the application, the preset time difference is a pre-set time difference value. Assuming the preset time difference is 5 minutes, when the time difference is less than this value, it indicates that the driver is about to commit the violation. The system then determines whether the current driving information corresponds to the dangerous driving information associated with the violation, thus facilitating the assessment of whether the driver is about to engage in dangerous behavior. Continuing the previous example, 3 minutes is less than 5 minutes, indicating that driver A's action of holding the steering wheel with one hand may be imminent. Assuming the current driving information indicates the vehicle is on a bumpy road, the dangerous driving information corresponding to holding the steering wheel with one hand is that the vehicle is on a bumpy road, meaning that driver A may be about to engage in dangerous behavior.

[0177] Step S121: If it belongs to the category, output the warning information.

[0178] In this embodiment of the application, when the current driving information belongs to the dangerous driving information corresponding to the violation, it indicates that the driver is about to engage in dangerous behavior, and a warning message is output so as to warn the driver in advance, thereby avoiding the driver from engaging in dangerous behavior to a certain extent.

[0179] Continuing with the previous example, the vehicle is currently on a bumpy road, and in 3 minutes, driver A may be about to use one hand to hold the steering wheel. Output a warning message so as to warn driver A in advance, thereby avoiding driver A from engaging in dangerous behavior to a certain extent.

[0180] The above embodiments describe a method for vehicle hazard warning from the perspective of process flow. The following embodiments describe a device for vehicle hazard warning from the perspective of virtual module or virtual unit. For details, please refer to the following embodiments.

[0181] This application provides a vehicle hazard warning device, such as... Figure 2 As shown, the vehicle hazard warning device 20 may specifically include:

[0182] The first acquisition module 201 is used to acquire the driver's image information and the driving information of the vehicle corresponding to the driver;

[0183] The recognition module 202 is used to perform behavioral feature recognition on image information to obtain the driver's behavioral information;

[0184] The first judgment module 203 is used to determine whether the behavior information constitutes a violation.

[0185] The second judgment module 204 is used to determine whether the violation is a dangerous behavior based on the driving information when the behavior information is a violation.

[0186] The first output module 205 is used to output warning information when the violation is a dangerous behavior.

[0187] In this embodiment, the first acquisition module 201 acquires the driver's image information so that the subsequent recognition module 202 can perform behavioral feature recognition on the image information to obtain the driver's behavioral information. The first judgment module 203 then determines whether the driver's behavioral information constitutes a violation, thus clearly understanding whether the driver is in danger. Simultaneously, the first acquisition module 201 acquires the vehicle's driving information. When the driver's behavioral information is a violation, the second judgment module 204 can determine whether the driver's current violation is a dangerous behavior based on the driving information. If the violation is a dangerous behavior, it indicates a high probability of the driver being in danger. Therefore, the first output module 205 outputs a warning message to remind the driver that their current driving behavior and vehicle driving information suggest a possible accident, i.e., a high probability of danger. When a violation is detected, since a violation does not necessarily constitute a dangerous behavior, further judgment is made to determine whether the driver's violation is a dangerous behavior. If it is a dangerous behavior, a warning message is output, thus enabling the warning message to more accurately represent the dangerous situation and improving the accuracy of the warning message.

[0188] In one possible implementation of this application embodiment, when the first judgment module 203 judges whether the behavior information constitutes a violation, and when the second judgment module 204 judges whether the violation constitutes a dangerous behavior based on the driving information when the behavior information constitutes a violation, the module is specifically used for:

[0189] Match the behavioral information with the behavioral information in the preset behavioral information database;

[0190] If a match is found, the behavior information is determined to be a violation.

[0191] If the behavior information is a violation, then determine whether the driving information is dangerous driving information. Dangerous driving information is the driving information corresponding to a violation or dangerous behavior.

[0192] If so, the violation is determined to be a dangerous act.

[0193] In one possible implementation of this application embodiment, the apparatus 20 further includes:

[0194] The first determination module is used to determine the type information corresponding to the dangerous behavior, and the type information has a corresponding relationship with the dangerous behavior.

[0195] The second determination module is used to determine the warning information corresponding to dangerous behaviors based on the category information.

[0196] In one possible implementation of this application embodiment, the apparatus 20 further includes:

[0197] The second acquisition module is used to acquire the vehicle's location information;

[0198] The third determining module is used to determine the image acquisition device within a preset range corresponding to the location information based on the location information;

[0199] The third acquisition module is used to acquire image information acquired by the image acquisition device;

[0200] The fourth determining module is used to determine the distribution of vehicles within a preset range based on image information;

[0201] The fifth determination module is used to determine the event to be caused by the dangerous behavior based on the dangerous behavior and the distribution of vehicles.

[0202] The second output module is used to output the events to be occurred.

[0203] In one possible implementation of this application embodiment, the apparatus 20 further includes:

[0204] The sixth determination module is used to determine the solution corresponding to the event to be occurred;

[0205] The third output module is used to output a solution so that the driver can adjust the driving information according to the solution;

[0206] The control module is used to control the target device corresponding to the solution to execute according to the solution when the driving information does not reach the target driving information within a preset time. The solution corresponds to the target driving information and the target device.

[0207] In one possible implementation of this application embodiment, the apparatus 20 further includes:

[0208] The fourth output module is used to output a prompt message to alert other vehicles.

[0209] In one possible implementation of this application embodiment, the apparatus 20 further includes:

[0210] The fourth acquisition module is used to acquire the current time and the time when the driver last committed a violation;

[0211] The prediction module is used to predict the target time when a driver will commit a violation based on the time of occurrence and the frequency of the violation. The violation is associated with a frequency.

[0212] The calculation module is used to calculate the time difference between the current time and the target time.

[0213] The third judgment module is used to determine whether the current driving information belongs to dangerous driving information corresponding to the violation when the time difference is less than the preset time difference.

[0214] The fifth output module outputs a warning message when it falls under the specified condition.

[0215] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the vehicle dangerous driving warning device 20 described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0216] This application provides an electronic device, such as... Figure 3 As shown, Figure 3 The illustrated electronic device 30 includes a processor 301 and a memory 303. The processor 301 and the memory 303 are connected, for example, via a bus 302. Optionally, the electronic device 30 may also include a transceiver 304. It should be noted that in practical applications, the transceiver 304 is not limited to one type, and the structure of this electronic device 30 does not constitute a limitation on the embodiments of this application.

[0217] Processor 301 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. Processor 301 may also be a combination that implements computational functions, such as including one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.

[0218] Bus 302 may include a pathway for transmitting information between the aforementioned components. Bus 302 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. Bus 302 can be divided into address bus, information bus, control bus, etc. For ease of representation, Figure 3 The symbol is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0219] The memory 303 may be a ROM (Read Only Memory) or other type of static storage device capable of storing static information and instructions, RAM (Random Access Memory) or other type of dynamic storage device capable of storing information and instructions, or an EEPROM (Electrically Erasable Programmable Read Only Memory), CD-ROM (Compact Disc Read Only Memory) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code having an instruction or information structure and accessible by a computer, but not limited thereto.

[0220] The memory 303 is used to store application code that executes the solution of this application, and its execution is controlled by the processor 301. The processor 301 is used to execute the application code stored in the memory 303 to implement the content shown in the foregoing method embodiments.

[0221] Electronic devices include, but are not limited to: mobile terminals such as mobile phones, laptops, digital radio receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and in-vehicle terminals (such as in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Servers can also be included. Figure 3 The electronic device shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.

[0222] This application provides a computer-readable storage medium storing a computer program that, when run on a computer, enables the computer to execute the corresponding content in the aforementioned method embodiments. Compared with related technologies, this application embodiment acquires the driver's image information to facilitate subsequent behavioral feature recognition of the image information, thereby obtaining the driver's behavioral information and determining whether the driver's behavioral information constitutes a violation, so as to clearly understand whether the driver may be in danger. It also acquires the driving information of the vehicle corresponding to the driver, so that when the driver's behavioral information constitutes a violation, it can determine whether the driver's current violation is a dangerous behavior based on the driving information. When the violation is a dangerous behavior, it indicates that the current driver is likely to be in danger, and a warning message is output to remind the driver of the current driving behavior and vehicle driving information, indicating that an accident may occur, i.e., the possibility of danger is high. When the driver's behavioral information is detected to be a violation, since a violation is not necessarily a dangerous behavior, further determination is made as to whether the driver's violation is a dangerous behavior. If it is a dangerous behavior, a warning message is output, thereby making the warning message more accurately represent the dangerous situation and improving the accuracy of the warning message.

[0223] It should be understood that although the steps in the flowcharts of the accompanying figures are shown sequentially as indicated by the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the accompanying figures may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the sub-steps or stages of other steps.

[0224] The above are only some embodiments of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.

Claims

1. A method for issuing a warning of dangerous driving by a vehicle, characterized in that, include: Acquire the driver's image information and the driving information of the vehicle corresponding to the driver; Behavioral feature recognition is performed on the image information to obtain the driver's behavioral information; Determine whether the behavioral information constitutes a violation; If the behavioral information constitutes a violation, then the driving information is used to determine whether the violation constitutes a dangerous behavior. If the violation is classified as a dangerous act, a warning message will be issued. Determine the category information corresponding to the dangerous behavior, and the category information is related to the dangerous behavior; Based on the aforementioned category information, determine the warning information corresponding to the dangerous behavior; The output warning information also includes: Obtain the location information of the vehicle; Based on the location information, determine the image acquisition device within the preset range corresponding to the location information; Acquire image information acquired by the image acquisition device; Based on the image information, determine the vehicle distribution within the preset range of the vehicle; Based on the dangerous behavior and the vehicle distribution, an event to be caused is determined, wherein the event to be caused is an event that may be caused by the dangerous behavior; Output the event to be occurred; The method further includes: Obtain the current time and the time when the driver last committed the violation; Based on the occurrence time and the frequency of the violation, a target time for the driver to commit the violation is predicted, and the violation has a corresponding frequency. Calculate the time difference between the current time and the target time; If the time difference is less than the preset time difference, then it is determined whether the current driving information belongs to the dangerous driving information corresponding to the violation. If it falls under this category, then the warning information will be output.

2. The method for warning of dangerous driving of a vehicle according to claim 1, characterized in that, The step of determining whether the behavioral information constitutes a violation, and if the behavioral information constitutes a violation, then determining whether the violation constitutes a dangerous behavior based on the driving information, includes: The behavioral information is matched with the behavioral information in a preset behavioral information database; If a match is found, the behavior information is determined to be a violation. If the behavior information is a violation, then it is determined whether the driving information is dangerous driving information. The dangerous driving information is the driving information corresponding to when the violation is a dangerous behavior. If so, the violation is determined to be a dangerous act.

3. The method for warning of dangerous driving of a vehicle according to claim 1, characterized in that, The process of determining the event to occur based on the dangerous behavior and the vehicle distribution further includes: Determine the solution corresponding to the event to be occurred; The solution is output so that the driver can adjust the driving information according to the solution; If the driving information does not reach the target driving information within a preset time, the target device corresponding to the solution is controlled to execute according to the solution, which corresponds to the target driving information and the target device.

4. The method for warning of dangerous driving of a vehicle according to claim 3, characterized in that, If the driving information does not reach the target driving information within a preset time, the method further includes: Output a notification message to alert other vehicles.

5. A device for warning of dangerous driving in vehicles, characterized in that, include: The first acquisition module is used to acquire the driver's image information and the driving information of the vehicle corresponding to the driver; The recognition module is used to perform behavioral feature recognition on the image information to obtain the driver's behavioral information; The first judgment module is used to determine whether the behavior information constitutes a violation. The second judgment module is used to determine whether the violation is a dangerous behavior based on the driving information when the behavior information is a violation. The first output module is used to output a warning message when the violation is a dangerous behavior; The first determining module is used to determine the type information corresponding to the dangerous behavior, and the type information has a corresponding relationship with the dangerous behavior; The second determining module is used to determine the warning information corresponding to the dangerous behavior based on the category information. The second acquisition module is used to acquire the location information of the vehicle; The third determining module is used to determine the image acquisition device within a preset range corresponding to the location information based on the location information; The third acquisition module is used to acquire image information acquired by the image acquisition device; The fourth determining module is used to determine the vehicle distribution within the preset range of the vehicle based on the image information; The fifth determining module is used to determine the event to be caused based on the dangerous behavior and the vehicle distribution, wherein the event to be caused is an event that may be caused by the dangerous behavior; The second output module is used to output the event to be occurred; The fourth acquisition module is used to acquire the current time and the time when the driver last committed the violation. The prediction module is used to predict the target time when the driver will commit the violation based on the occurrence time and the violation frequency corresponding to the violation. The violation has a corresponding violation frequency. The calculation module is used to calculate the time difference between the current time and the target time; The third judgment module is used to determine whether the current driving information belongs to the dangerous driving information corresponding to the violation when the time difference is less than the preset time difference. The fifth output module outputs the warning information when the condition is met.

6. An electronic device, characterized in that, It includes: One or more processors; Memory; One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more applications being configured to: perform the method for warning of dangerous driving of a vehicle according to any one of claims 1 to 4.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed in the computer, it causes the computer to perform the vehicle dangerous driving warning method according to any one of claims 1 to 4.

Images