Vehicle surrounding warning method, electronic device, readable storage medium and vehicle

Abstract

The present invention discloses a vehicle periphery warning method, an electronic device, a readable storage medium and a vehicle, mainly relating to the field of vehicle safety technology. By integrating a driver monitoring system and a hazard alarm mechanism, it is possible to automatically trigger hazard alarm information to warn surrounding vehicles and pedestrians when an abnormal driver state is detected, thereby improving road driving safety. Specifically, after detecting an abnormal driver state, the first vehicle exterior warning module is triggered to run. If it is not released within a certain period of time, a second vehicle exterior warning signal is output based on whether there is a target object around the vehicle and the distance between the target object and the vehicle, and it is allowed to stop outputting the warning signal to the outside only under specific conditions. The present invention realizes that when an abnormal driver state is detected, hazard alarm information is automatically triggered for vehicles and pedestrians around the vehicle, and it can play an additional role in assisting in rescuing the driver of the vehicle, thereby effectively improving the safety of vehicle driving.

Description

Technical Field

[0001] The present invention relates to the field of automobile safety technology, and in particular to a vehicle periphery warning method, electronic equipment, a readable storage medium and a vehicle. Background Art

[0002] With the continuous development of automobile technology, advanced driver assistance systems (ADAS) have become an important part of modern automobiles. Among them, the driver monitoring system (DMS), as one of the key subsystems of ADAS, can monitor the driver's fatigue, distraction and other bad driving behaviors in real time. However, most of the current DMS systems only remind the driver of the vehicle through sound or visual prompts inside the vehicle, but lack direct warning methods for external environments such as vehicles and pedestrians outside the vehicle. Therefore, in an emergency, how to quickly and effectively transmit the high-risk situations judged by the DMS to the vehicles and pedestrians around the vehicle has become an urgent problem to be solved.

[0003] To elaborate, when DMS detects abnormal driver status, it needs to issue an alarm in a timely and accurate manner and take corresponding intervention measures, and the response time, alarm method, intervention measures, etc. must be reasonable and effective, and must also meet the requirements of relevant regulations. At present, most DMS only output warning information to the driver through sound or visual means in the car, and the general reminder mode is also mostly implemented by voice broadcast + interface display, such as: voice reminder to the driver to focus on driving, a coffee cup pattern flashing on the dashboard, or directly popping up a toast pop-up window and displaying the corresponding copy for prompting; In addition, in other attempts in this field, in order to pursue product differentiation, in addition to the aforementioned basic reminder mode, a multi-level awakening mode for targeted fatigue relief is proposed, such as: by playing music and turning up the volume, automatically turning on the air conditioner and adjusting the temperature to the lowest and increasing the air volume, and actively tightening the seat belt, etc., the driver's senses are stimulated in all directions to improve the driver's concentration.

[0004] However, these various DMS prompts do not focus on direct warnings to the vehicle's external environment. However, when DMS determines that the driver needs to be prompted, it means that the driver is not in a safe and normal driving state, and there is a certain probability of an emergency, which brings a significant risk of traffic accidents to vehicles and pedestrians around the vehicle. Summary of the invention

[0005] In view of the above, the present invention aims to provide a vehicle periphery warning method, an electronic device, a readable storage medium and a vehicle to solve the above-mentioned technical problems.

[0006] In the first aspect, the technical solution adopted by the present invention is as follows:

[0007] The present invention provides a vehicle surrounding warning method, which includes:

[0008] After the driver monitoring system detects that the driver is in an abnormal state, the control module forcibly triggers the first vehicle exterior warning module to operate;

[0009] If the abnormal state continues for the first period of time and is not resolved, the control module determines whether there is a target object around the vehicle and the distance between the target object and the vehicle;

[0010] Only when it is determined that there is a target object around the vehicle and the distance between the target object and the vehicle is within a preset distance range, the control module triggers the second vehicle exterior warning module to run, and the second vehicle exterior warning module is at least used to output a sound warning signal indicating that the driver's state is abnormal to the outside of the vehicle;

[0011] After detecting one of the following two conditions, at least the first vehicle exterior warning module and the second vehicle exterior warning module are controlled to stop working: the driver monitoring system determines that the driver's abnormal state is lifted, and the driver actively triggers to stop outputting warning information outside the vehicle.

[0012] The main technical route of this embodiment is to integrate the driver monitoring system with the hazard alarm mechanism to form an intelligent safety prompt solution, which can automatically trigger hazard alarm information to warn surrounding vehicles and pedestrians when driver fatigue, distraction or other emergency situations are detected, thereby improving road driving safety. Specifically, after detecting driver abnormality, the conventional vehicle-exterior warning module is triggered to run first. If the abnormality is not resolved for a certain period of time, based on whether there are target objects around the vehicle and the distance between the target object and the vehicle, further warning signals are triggered to be output to the outside of the vehicle to inform relatively nearby people and vehicles outside the vehicle that the driver of the vehicle is in an abnormal state, and the output of warning signals to the outside can only be stopped when specific conditions are met. This embodiment realizes that when the abnormal state of the driver of the vehicle is detected, the danger alarm information is automatically triggered for the vehicles and pedestrians around the vehicle. On the one hand, it reminds the personnel of the external vehicles that the vehicle may have traffic risk hidden dangers due to the abnormal state of the driver, and if necessary, they can avoid the risk; on the other hand, it also has the additional effect of assisting in rescuing the driver of the vehicle, so that the personnel outside the vehicle can rescue the driver of the vehicle in time when they judge that there is no risk to themselves (such as when the vehicle is in a low-speed or stopped condition, the warning signal that has not been eliminated can win the driver of the vehicle a chance of rescue). Therefore, the safety of vehicle driving is effectively improved from at least the above two levels. Of course, the present invention does not exclude that in this scenario, the aforementioned first and second external vehicle warning modules are output synchronously.

[0013] In at least one possible implementation method, the warning control method also includes: when it is determined that there is no target object around the vehicle, or the distance between the identified target object and the vehicle exceeds a preset distance range, the control module triggers the operation of a third external vehicle warning module, and the third external vehicle warning module is at least used to output a visual warning signal to the outside of the vehicle.

[0014] In this embodiment, it is taken into account that in a real driving scenario, there may be no other vehicles or personnel near the vehicle (the vehicles or personnel are far away from the vehicle). In this case, a visual warning signal can be output. This is because light propagation is better than sound propagation in terms of distance. In this case, it is difficult to achieve the warning purpose if only sound warning is used. Therefore, outputting a visual warning signal is considered. It should be pointed out that the visual warning signal here is different from the signal output by the first external warning module. The output of the first external warning module is in a normal state (such as double flash lights), but the output of the second external warning module is a warning signal for other vehicles and personnel at a longer distance. Its visible range, penetration, durability, etc. can be higher than or even much higher than the first external warning module. In addition, there is another detail. The aforementioned sound warning signal specifically refers to the sound content (such as sirens, voices, etc.) that can characterize the abnormality of the driver of this vehicle. This is to enable other vehicle personnel who are relatively close to the vehicle to accurately understand the situation of the driver of this vehicle; and for the situation where there are no other vehicles or personnel in the surrounding close range, the content of the visual warning signal is not limited, and it can be any visual signal or content information that can assist in rescue (the visual warning signal here does not need to prompt to avoid danger); of course, the present invention does not exclude that in this scenario, the aforementioned first, second, and third external vehicle warning modules are output synchronously in a number of combinations.

[0015] In at least one possible implementation, the visual warning signal includes:

[0016] A light signal with a preset initial flashing frequency and brightness; and / or,

[0017] An on-screen graphic signal with an initial flashing frequency and brightness preset to indicate an abnormal driver status.

[0018] As mentioned above, the visual warning signal can be in various forms, and the screen display mentioned here can also be presented in the form of projection. It should be emphasized in this embodiment that no matter what form the visual warning signal is output, it is in accordance with a certain flashing frequency (flashing is not absolute, and those skilled in the art can understand that long light is a special flashing frequency) and brightness (which may also include color).

[0019] In at least one possible implementation, after the third external vehicle warning module is triggered to operate, and the driver's abnormal state continues for more than a second time period without being resolved, the flashing frequency and / or brightness of the visual warning signal is increased, and the second external vehicle warning module is triggered to operate synchronously.

[0020] Based on the above concept, this embodiment further takes into account some special situations, that is, when there are no people or vehicles around and the abnormal state of the driver of the vehicle has not been resolved for a long time, the visual warning signal can be upgraded by increasing the flashing frequency and brightness mentioned above; and if the sound and visual warning are not synchronized, the second vehicle external warning module can be triggered to output the sound warning signal together. Of course, if in other embodiments, the sound and visual warning signals are output synchronously, in this scenario, not only the visual warning level can be increased, but also the sound warning level can be increased, such as increasing the volume, changing the sound frequency, etc.

[0021] In at least one possible implementation, the signal output levels of the second and third external vehicle warning modules are automatically set according to different levels of abnormal driver status fed back by a driver monitoring system.

[0022] In this embodiment, from the perspective of mature technology of the driver monitoring system, the driver monitoring system can determine the abnormality level of the current driver, and according to different levels of abnormality, preset sound and visual warning signal levels can be used.

[0023] In at least one possible implementation manner, the warning information output by the second external vehicle warning module and / or the third external vehicle warning module has a pre-set personalized attribute.

[0024] In this embodiment, in combination with the driver's own needs, the driver can retrieve auditory and visual warning content that meets the specific circumstances of the driver of the vehicle based on the abnormal detection results of the driver monitoring system, such as prompting key information related to physiological status (such as distraction, drowsiness, unclear state, etc.), disease type, emergency contact number, and first aid measures. It can also prompt other vehicle personnel outside the vehicle to take assistance methods according to different situations. Optional reference implementation methods are given later and will not be repeated here.

[0025] In at least one possible implementation manner, the warning control method further includes: if the abnormal state continues for a first period of time and is determined to be resolved, controlling the first external vehicle warning module to stop working.

[0026] In this embodiment, a separate cancellation operation for conventional warnings (such as double flash lights) is designed. This is because the first external vehicle warning module was initially forcibly activated by the system. Therefore, firstly, there may be a false triggering situation, that is, a misjudgment of the abnormal state. Therefore, if no abnormality is detected after a certain period of time, the system can actively control the first external vehicle warning module to stop output; secondly, for non-false triggering situations, there is also an interference effect on external targets. Therefore, the first external vehicle warning module that is forcibly activated can be stopped after a certain period of time based on the judgment of the DMS or the driver's autonomous action.

[0027] In a second aspect, the present invention also provides an electronic device, comprising: one or more processors, a memory and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the electronic device, enable the electronic device to execute the above-mentioned vehicle periphery warning method.

[0028] In a third aspect, the present invention further provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the above-mentioned vehicle periphery warning method when executed by a processor.

[0029] In a fourth aspect, the present invention further provides a vehicle, wherein the vehicle is equipped with the above-mentioned electronic device or the above-mentioned computer-readable storage medium.

[0030] It should be understood that the second to fourth aspects of the embodiments of the present invention are consistent with the technical solutions of the first aspect of the embodiments of the present invention, and the beneficial effects achieved by each aspect and the corresponding possible implementation methods are similar and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to make the purpose, technical solutions and advantages of the present invention more clear, the present invention will be further described below with reference to the accompanying drawings, in which:

[0032] Figure 1 A schematic diagram of a vehicle surrounding warning method provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0033] Embodiments of the present invention are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and cannot be interpreted as limiting the present invention.

[0034] The present invention proposes an embodiment of a vehicle surrounding warning method, specifically, as Figure 1 shown, including:

[0035] Step S1, after the driver monitoring system (DMS) detects that the driver is in an abnormal state, the control module (ECU) forcibly triggers the first vehicle exterior warning module (such as the double flash lights of the original vehicle) to operate;

[0036] Step S2: If the abnormal state continues for a first period of time and is not resolved, the control module determines whether there is a target object around the vehicle and the distance between the target object and the vehicle;

[0037] Step S3: Only when it is determined that there is a target object around the vehicle and the distance between the target object and the vehicle is within a preset distance range, the control module triggers the operation of the second vehicle exterior warning module, and the second vehicle exterior warning module is at least used to output a sound warning signal indicating that the driver's state is abnormal to the outside of the vehicle;

[0038] Step S4, until one of the following two conditions is detected, at least the first vehicle exterior warning module and the second vehicle exterior warning module are controlled to stop working: the driver monitoring system determines that the driver's abnormal state is lifted, and the driver actively triggers the stop of outputting warning information to the outside of the vehicle.

[0039] The design of the first duration mentioned above is intended to avoid false alarms. Therefore, in other embodiments, it can be designed that if the abnormal state continues for the first duration and is determined to be resolved, the first external vehicle warning module is controlled to stop working.

[0040] The foregoing also mentions the detection of the target objects around the vehicle and the distance between the vehicle and the vehicle. This is because if the abnormal state is not resolved after the first time, it means that the abnormal state of the driver may bring hidden dangers to the target objects outside the vehicle (such as vehicles, pedestrians, etc.), or even a safety risk with a high probability. Therefore, at least a warning sound output method is required to enable the target objects with a relatively close distance to hear the warning information output by the vehicle for the first time, so as to attract attention and take different actions. For example, in addition to taking avoidance, it is also possible to approach the vehicle when the vehicle is stationary or at a low speed to assist the driver of the vehicle in dealing with abnormal situations. As proposed in some preferred embodiments of the present invention, at the beginning of the output of the sound warning signal, the information representing the avoidance is used as the output content, and the speed of the vehicle is detected in real time during the process. Once the speed is detected to be lower than the preset speed lower limit, the information representing the avoidance is switched to the information representing the rescue, so that the relatively close vehicle personnel can accurately understand the situation of the vehicle and take timely rescue actions.

[0041] Based on this conception, the scheme of the present invention may also include: when it is determined that there is no target object around the vehicle, or the distance between the identified target object and the vehicle exceeds a preset spacing range, the control module triggers the operation of the third external vehicle warning module, and the third external vehicle warning module is at least used to output a visual warning signal to the outside of the vehicle, so that people at a longer distance can see that the vehicle has an abnormality. In actual operation, the visual warning signal mentioned here may include at least two types: first, a high-penetration warning flash light (such as a red warning light module) with a preset initial flashing frequency and brightness outputs a simple light signal; second, a screen display with a preset initial flashing frequency and brightness that indicates an abnormal driver status (such as a display screen mounted on a window or door, etc. that outputs to the outside).

[0042] Based on this point, in some preferred embodiments of the present invention, after the third external vehicle warning module is triggered to operate, and the driver's abnormal state continues for more than a second time period and is not resolved, the flashing frequency and / or brightness of the visual warning signal output by the third external vehicle warning module is increased. More preferably, the aforementioned second external vehicle warning module is triggered to operate synchronously to improve the overall warning effect.

[0043] Those skilled in the art can understand that the aforementioned conditions for stopping the operation of the control warning module are also applicable to the third vehicle exterior warning module, and are not limited or elaborated herein. What can be further expanded is that a multi-level warning mechanism can be introduced, and in addition to relying on target object and distance detection, the signal output level of the second and third vehicle exterior warning modules can be directly set according to the severity of abnormal conditions such as driver fatigue and distraction.

[0044] Finally, it can be supplemented that the sound and visual warning information output by the aforementioned second and third vehicle-exterior warning modules have personalized settings, that is, it allows limited personalized settings of the linkage mechanism between DMS and vehicle-exterior warnings according to established requirements and standards. For example, in other preferred embodiments, if DMS determines that it is a relatively mild abnormal state (such as distraction or drowsiness), it can output a voice warning signal in the form of voice to a relatively close target within the surrounding range, as follows: The driver of this vehicle is in a fatigued state, please avoid safely and try to honk the horn to remind. Of course, those skilled in the art can understand that this is a schematic description.

[0045] In summary, the main design concept of the present invention is to integrate the driver monitoring system with the hazard alarm mechanism to form an intelligent safety prompt solution, which can automatically trigger hazard alarm information to warn surrounding vehicles and pedestrians when driver fatigue, distraction or other emergency situations are detected, thereby improving road driving safety. Specifically, after detecting driver abnormality, the first external vehicle warning module is triggered to run. If it is not released within a certain period of time, based on whether there is a target object around the vehicle and the distance between the target object and the vehicle, the output of the warning signal to the outside of the vehicle is triggered, and the output of the warning signal to the outside is allowed to stop under specific conditions. The present invention realizes the automatic triggering of hazard alarm information for vehicles and pedestrians around the vehicle when the driver of the vehicle is detected to be in an abnormal state, and can play an additional role in assisting the rescue of the driver of the vehicle, thereby effectively improving the safety of vehicle driving.

[0046] Based on the above control method scheme, the present invention also provides an embodiment of an electronic device, which may include, for example: one or more processors, a memory and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, and when the instructions are executed by the electronic device, the electronic device executes the above vehicle periphery warning method.

[0047] Based on the above control method scheme, the present invention also provides an embodiment of a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the above vehicle surrounding warning method is implemented.

[0048] Based on the same inventive concept and the above hardware carrier solution, the present invention also provides an embodiment of a vehicle, the main feature of which is that it is equipped with the above electronic device or has the above computer-readable storage medium. The selection of the vehicle can be determined based on the correct understanding and reasonable implementation of the above solution by those skilled in the art.

[0049] If the expressions expressing orientation are mentioned in the embodiments of the present invention, they are relative concepts based on the embodiments. In addition, "at least one" means one or more, and "plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, a and b, a and c, b and c, or a and b and c, wherein a, b, c can be single or multiple.

[0050] The above describes in detail the structure, features and effects of the present invention based on the embodiments shown in the drawings, but the above is only a preferred embodiment of the present invention. It should be noted that the technical features involved in the above embodiments and their preferred methods can be reasonably combined and matched into a variety of equivalent schemes by those skilled in the art without departing from or changing the design ideas and technical effects of the present invention; therefore, the present invention is not limited to the scope of implementation shown in the drawings, and all changes made in accordance with the concept of the present invention, or modifications to equivalent embodiments with equivalent changes, which still do not exceed the spirit covered by the specification and drawings, should be within the protection scope of the present invention.

Claims

1. A vehicle surrounding warning method, characterized in that: include: After the driver monitoring system detects that the driver is in an abnormal state, the control module forcibly triggers the first vehicle exterior warning module to operate; If the abnormal state continues for the first period of time and is not resolved, the control module determines whether there is a target object around the vehicle and the distance between the target object and the vehicle; Only when it is determined that there is a target object around the vehicle and the distance between the target object and the vehicle is within a preset distance range, the control module triggers the second vehicle exterior warning module to run, and the second vehicle exterior warning module is at least used to output a sound warning signal indicating that the driver is in an abnormal state to the outside of the vehicle, and the sound warning signal contains information indicating that the driver of the vehicle is being rescued; When it is determined that there is no target object around the vehicle, or the distance between the identified target object and the vehicle exceeds a preset distance range, the control module triggers the operation of the third vehicle exterior warning module, and the third vehicle exterior warning module is at least used to output a visual warning signal to the outside of the vehicle, the visual warning signal includes a visual signal and content information for assisting rescue, and the visual warning signal does not include information prompting avoidance; After detecting one of the following two conditions, at least the first vehicle exterior warning module and the second vehicle exterior warning module are controlled to stop working: the driver monitoring system determines that the driver's abnormal state is lifted, and the driver actively triggers to stop outputting warning information outside the vehicle.

2. The vehicle surrounding warning method according to claim 1, characterized in that: The visual warning signal includes: A light signal with a preset initial flashing frequency and brightness; and / or, An on-screen graphic signal with an initial flashing frequency and brightness preset to indicate an abnormal driver status.

3. The vehicle surrounding warning method according to claim 2, characterized in that: After the third vehicle exterior warning module is triggered to run, and the driver's abnormal state continues for more than a second time period without being resolved, the flashing frequency and / or brightness of the visual warning signal is increased, and the second vehicle exterior warning module is triggered to run synchronously.

4. The vehicle surrounding warning method according to claim 1, characterized in that: According to the different levels of abnormal driver status fed back by the driver monitoring system, the signal output levels of the second exterior vehicle warning module and the third exterior vehicle warning module are automatically set.

5. The vehicle surrounding warning method according to claim 1, characterized in that: The warning information output by the second external vehicle warning module and / or the third external vehicle warning module has a preset personalized attribute.

6. The vehicle surrounding warning method according to any one of claims 1 to 5, characterized in that: The warning method further includes: if the abnormal state continues for a first period of time and is determined to be resolved, controlling the first vehicle exterior warning module to stop working.

7. An electronic device, characterized in that: include: One or more processors, a memory, and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, and when the instructions are executed by the electronic device, the electronic device executes the vehicle periphery warning method described in any one of claims 1 to 6.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the vehicle surrounding warning method described in any one of claims 1 to 6 is implemented.

9. A vehicle, characterized in that: The vehicle is provided with the electronic device of claim 7 or the computer-readable storage medium of claim 8.

Images