Emergency vehicle information reporting device and emergency vehicle information reporting method

The emergency vehicle information notification device coordinates evasive actions among vehicles by detecting emergency vehicles and assessing other vehicles' detection status, ensuring smooth operation through targeted notifications.

JP2024170135AInactive Publication Date: 2024-12-06JVC KENWOOD CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023087131
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-26
Publication Date
2024-12-06
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing systems fail to ensure that surrounding vehicles take appropriate evasive actions in response to approaching emergency vehicles, leading to potential disruptions in smooth vehicle operation.

Method used

An emergency vehicle information notification device that detects the distance and direction of an emergency vehicle, assesses the likelihood of other vehicles detecting the emergency vehicle, and determines a notification mode to coordinate evasive actions among vehicles.

Benefits of technology

Facilitates coordinated evasive maneuvers among vehicles, ensuring smooth operation by informing drivers when and how to respond to emergency vehicles based on the detection status of other vehicles.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024170135000001_ABST
    Figure 2024170135000001_ABST
Patent Text Reader

Abstract

To support smooth traveling of a vehicle while appropriately performing an operation to avoid an emergency vehicle.SOLUTION: An emergency vehicle information notification device includes: an emergency vehicle detection section for detecting a distance between an emergency vehicle approaching an own vehicle and the own vehicle; a possibility calculation section for calculating a possibility value which indicates a possibility that another vehicle existing in the periphery of the own vehicle does not detect the emergency vehicle; a report mode determination section for determining a mode of a report related to the emergency vehicle based on the possibility value calculated by the possibility calculation section when the distance detected by the emergency vehicle detection section is less than a predetermined first threshold; and a reporting section for performing the report based on the mode of the report determined by the report mode determination section.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an emergency vehicle information notification device and an emergency vehicle information notification method for notifying information about an emergency vehicle. [Background technology]

[0002] 2. Description of the Related Art There is known an emergency vehicle information notification device that, when it detects the approach of an emergency vehicle, notifies a passenger of the approach, thereby assisting the passenger in operating the vehicle appropriately (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2011-75396 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, even if the vehicle recognizes the approach of an emergency vehicle and takes an avoidance action, other vehicles traveling around the vehicle at the same time may not take the same avoidance action against the emergency vehicle. For this reason, if the vehicle takes an action to avoid the emergency vehicle too early compared to other vehicles, the smooth running of the vehicle may be hindered.

[0005] The present disclosure has been made to solve such problems, and has as its main objective to provide an emergency vehicle information notification device and an emergency vehicle information notification method that can appropriately perform operations to avoid emergency vehicles while supporting smooth vehicle driving. [Means for solving the problem]

[0006] In order to achieve the above object, one aspect of the present disclosure is to an emergency vehicle detection unit that detects a distance between an emergency vehicle approaching the vehicle and the vehicle; a likelihood calculation unit that calculates a likelihood value indicating a likelihood that other vehicles present around the host vehicle have not detected the emergency vehicle; a notification mode determination unit that determines a mode of notification regarding the emergency vehicle based on the likelihood value calculated by the likelihood calculation unit when the distance detected by the emergency vehicle detection unit is less than a predetermined first threshold value; and a notification unit that performs notification based on the notification mode determined by the notification mode determination unit; An emergency vehicle information notification device comprising: It is. In order to achieve the above object, one aspect of the present disclosure is to an emergency vehicle detection unit that detects a distance between an emergency vehicle approaching the host vehicle and the host vehicle and a direction of the emergency vehicle relative to the host vehicle; a surrounding information acquisition unit that acquires image information about the surroundings of the host vehicle; an other vehicle determination unit that determines whether or not another vehicle other than the emergency vehicle is traveling in the direction of the emergency vehicle and whether or not the other vehicle is performing an avoidance operation based on image information about the surroundings of the host vehicle acquired by the surrounding information acquisition unit; a notification mode determination unit that determines a mode of notification regarding the emergency vehicle based on a determination result by the other vehicle determination unit when the distance detected by the emergency vehicle detection unit is less than a predetermined first threshold value; a notification unit that performs notification based on the notification mode determined by the notification mode determination unit; An emergency vehicle information notification device comprising: may be also possible. In order to achieve the above object, one aspect of the present disclosure is to Detecting a distance between an emergency vehicle approaching the vehicle and the vehicle; calculating a likelihood value indicating a likelihood that other vehicles present around the vehicle have not detected the emergency vehicle; determining a manner of notification regarding the emergency vehicle based on the calculated likelihood value when the detected distance is less than a predetermined first threshold; performing a notification based on the determined notification manner; Emergency vehicle information notification method, may be also possible. In order to achieve the above object, one aspect of the present disclosure is to Detecting a distance between an emergency vehicle approaching the host vehicle and the host vehicle and a direction of the emergency vehicle relative to the host vehicle; acquiring image information about the surroundings of the host vehicle; determining whether or not a vehicle other than the emergency vehicle is traveling in the direction of the emergency vehicle and whether or not the vehicle is taking an avoidance action based on the acquired image information of the surroundings of the vehicle; When the detected distance is less than a predetermined first threshold, determining a manner of notification regarding the emergency vehicle based on the determination result; performing a notification based on the determined notification manner; Emergency vehicle information notification method, may be also possible. Effect of the Invention

[0007] According to the present disclosure, it is possible to provide an emergency vehicle information notification device and an emergency vehicle information notification method that can appropriately perform operations to avoid an emergency vehicle while supporting smooth vehicle driving. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a schematic system configuration of an emergency vehicle information notification device according to an embodiment of the present invention; [Diagram 2] 3 is a flowchart showing a flow of an emergency vehicle information notifying method according to the present embodiment. [Diagram 3] 1 is a block diagram showing a schematic system configuration of an emergency vehicle information notification device according to an embodiment of the present invention; [Figure 4] 3 is a flowchart showing a flow of an emergency vehicle information notifying method according to the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] The present invention will be described below through the present embodiment, but the invention according to the claims is not limited to the following embodiment. In addition, not all of the configurations described in the embodiment are necessarily essential as means for solving the problem. For clarity of explanation, the following description and drawings are omitted and simplified as appropriate. In each drawing, the same elements are given the same reference numerals, and duplicate explanations are omitted as necessary.

[0010] EMBODIMENT 1 Hereinafter, the present embodiment will be described with reference to the drawings. For example, even if the vehicle detects the approach of an emergency vehicle by means of receiving radio waves or the like, if there is a high possibility that other vehicles around the vehicle (hereinafter referred to as other vehicles around the vehicle) have not yet detected the approach of the emergency vehicle, the vehicle may perform an action to avoid the emergency vehicle at a timing that is too early compared to the other vehicles around the vehicle, which may cause a hindrance to the smooth running of many vehicles. Note that the vehicle performing an avoidance action means, for example, that the vehicle is performing an action to avoid the emergency vehicle, such as moving to the side of the road and decelerating, or moving to the side of the road and stopping.

[0011] Therefore, the emergency vehicle information notification device according to the present embodiment notifies the driver of the vehicle and other vehicles around the vehicle to take appropriate timed avoidance action against an emergency vehicle approaching the vehicle and other vehicles, thereby supporting smooth vehicle driving while taking appropriate action to avoid the emergency vehicle.

[0012] 1 is a block diagram showing a schematic system configuration of an emergency vehicle information notification device according to this embodiment. The emergency vehicle information notification device 10 is mounted on, for example, a vehicle.

[0013] The emergency vehicle information notification device 10 of this embodiment includes a surrounding information acquisition unit 11, an emergency vehicle recognition unit 12, an emergency vehicle detection unit 13, a possibility calculation unit 14, a notification mode determination unit 15, and a notification unit 16.

[0014] The emergency vehicle information notification device 10 has a typical computer hardware configuration including, for example, a processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), internal memory such as a RAM (Random Access Memory) or a ROM (Read Only Memory), a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), an input / output I / F for connecting peripheral devices such as a display, and a communication I / F for communicating with devices outside the device.

[0015] The surrounding information acquisition unit 11 acquires information including audio information around the vehicle. For example, the surrounding information acquisition unit 11 acquires image information around the vehicle using a camera and acquires audio information around the vehicle using a microphone. The surrounding information acquisition unit 11 outputs the acquired information around the vehicle to the emergency vehicle recognition unit 12.

[0016] The emergency vehicle recognition unit 12 recognizes emergency vehicles based on the information acquired by the surrounding information acquisition unit 11. Emergency vehicles include vehicles designated as emergency vehicles, such as ambulances, fire engines, police vehicles, guard vehicles, police service vehicles, road maintenance vehicles, rescue operation command vehicles, water tankers, tow trucks, doctor cars, blood donation transport vehicles, etc., that are driving in an emergency with red rotating lights on and sirens sounding.

[0017] The emergency vehicle recognition unit 12 recognizes an emergency vehicle based on, for example, the voice information of the emergency vehicle acquired by the surrounding information acquisition unit 11. The emergency vehicle recognition unit 12 may recognize an emergency vehicle using a learning dictionary generated by performing machine learning, deep learning, or the like. For example, the learning dictionary is generated by learning using learning data of emergency vehicle voices that are labeled (teaching data) with 1 if the acquired voice includes a siren sound emitted by an emergency vehicle and 0 if the acquired voice does not include a siren sound emitted by an emergency vehicle.

[0018] When the voice information acquired by the ambient information acquisition unit 11 is input to the learning dictionary, the learning dictionary outputs a value between 0 and 1 (hereinafter referred to as the learning dictionary output value). This learning dictionary output value is a value indicating the possibility that the voice input to the learning dictionary is the voice of a siren emitted by an emergency vehicle, and is a value indicating the "certainty of the recognition result" when an emergency vehicle is recognized.

[0019] When the learning dictionary output value is equal to or greater than the judgment threshold (e.g., 0.8), the emergency vehicle recognition unit 12 outputs a recognition result indicating that an emergency vehicle has been recognized to the possibility calculation unit 14. On the other hand, when the learning dictionary output value is less than the judgment threshold, the emergency vehicle recognition unit 12 outputs a recognition result indicating that an emergency vehicle has not been recognized to the possibility calculation unit 14. For example, an optimal value experimentally obtained in advance may be set in the emergency vehicle recognition unit 12 as the judgment threshold.

[0020] The emergency vehicle recognition unit 12 may recognize an emergency vehicle based on image information of the emergency vehicle (such as image information of a red rotating light) acquired by the surrounding information acquisition unit 11. The emergency vehicle recognition unit 12 recognizes the emergency vehicle using a learning dictionary of image information, similar to the above-mentioned voice information of the emergency vehicle. It is preferable that the emergency vehicle recognition unit 12 recognizes the emergency vehicle by using both the voice information and image information of the emergency vehicle acquired by the surrounding information acquisition unit 11.

[0021] The emergency vehicle detection unit 13 detects the distance between the vehicle and an approaching emergency vehicle (hereinafter referred to as the emergency vehicle distance). For example, the emergency vehicle detection unit 13 receives radio waves transmitted from the emergency vehicle via a receiving unit such as an antenna, and calculates the emergency vehicle distance based on the signal strength of the radio waves.

[0022] The emergency vehicle detection unit 13 may also calculate the emergency vehicle distance based on information indicating the current position of the emergency vehicle contained in radio waves transmitted from an emergency vehicle approaching the vehicle. The emergency vehicle transmits the current position of the emergency vehicle itself, acquired using a global navigation satellite system (GNSS) or the like, on radio waves. The emergency vehicle detection unit 13 calculates the emergency vehicle distance from the difference between the current position of the vehicle acquired by the vehicle itself using a GNSS or the like. The emergency vehicle detection unit 13 may also acquire information on the current position of the emergency vehicle transmitted over the Internet via a wireless local area network (LAN) and calculate the emergency vehicle distance. In this way, the emergency vehicle detection unit 13 detects the distance between the emergency vehicle and the vehicle itself by receiving radio waves. The distance detected by the emergency vehicle detection unit 13 is not limited to the straight-line distance between the emergency vehicle and the vehicle itself, but may be the route distance required to move on a road, that is, the so-called journey.

[0023] The possibility calculation unit 14 calculates a possibility value (hereinafter referred to as non-detection possibility value) indicating the possibility that other vehicles around the vehicle have not detected the emergency vehicle. The possibility calculation unit 14 calculates the non-detection possibility value of the emergency vehicle based on, for example, the recognition result of the emergency vehicle by the emergency vehicle recognition unit 12. The possibility calculation unit 14 may calculate the non-detection possibility value of the emergency vehicle to be higher based on the emergency vehicle distance detected by the emergency vehicle detection unit 13, as the emergency vehicle distance is longer.

[0024] For example, when the emergency vehicle is not recognized by the emergency vehicle recognition unit 12, the possibility calculation unit 14 calculates the non-detection possibility value as a value equal to or greater than a predetermined detection threshold. In other words, when the siren sound cannot be recognized from the voice acquired by the vehicle, or when the red rotating light cannot be recognized from the image acquired by the vehicle, it is highly likely that the emergency vehicle cannot be seen by other vehicles around the vehicle, or the siren sound cannot be heard, and it is highly likely that the vehicles cannot recognize that the emergency vehicle is approaching. The value equal to or greater than the predetermined detection threshold may be preset in the possibility calculation unit 14. On the other hand, when the emergency vehicle is recognized by the emergency vehicle recognition unit 12, the possibility calculation unit 14 calculates the non-detection possibility value to be low when the certainty of the recognition result is high, and to be high when the certainty of the recognition result is low, based on the value indicating the "certainty of the recognition result" of the recognition of the emergency vehicle, which is the learning dictionary output value output by the learning dictionary of the emergency vehicle recognition unit 12. The possibility calculation unit 14 outputs the non-detection possibility value calculated as described above to the notification mode determination unit 15.

[0025] When the emergency vehicle distance detected by the emergency vehicle detection unit 13 is less than a predetermined first threshold, the notification mode determination unit 15 determines the mode of notification regarding the emergency vehicle based on the non-detection possibility value calculated by the possibility calculation unit 14. Note that the above-mentioned first threshold is a threshold for determining that an emergency vehicle is approaching the vehicle itself, and an optimal value obtained experimentally may be set in advance in the notification mode determination unit 15 as the first threshold.

[0026] When the notification mode determination unit 15 determines that the emergency vehicle distance detected by the emergency vehicle detection unit 13 is less than a predetermined first threshold and, for example, that the non-detection possibility value calculated by the possibility calculation unit 14 is equal to or greater than the detection threshold, the notification mode determination unit 15 determines a notification mode for informing the driver that "it is not yet necessary to take evasive action against the emergency vehicle." Note that the detection threshold is a threshold for determining the evasive action of other vehicles, and an optimal value obtained through experimentation may be set in advance in the notification mode determination unit 15 as the detection threshold.

[0027] This is a situation where the emergency vehicle distance is less than the first threshold and the emergency vehicle detection unit 13 detects by radio that the vehicle and the emergency vehicle are somewhat close to each other, but the emergency vehicle recognition unit 12 does not recognize the emergency vehicle, or the probability of the emergency vehicle recognized by the emergency vehicle recognition unit 12 is low, so the possibility calculation unit 14 calculates that the non-detection possibility value is equal to or greater than the detection threshold. For this reason, a situation is assumed in which other vehicles around the vehicle do not recognize the emergency vehicle and have not yet performed an avoidance operation. Therefore, the notification mode determination unit 15 determines that the vehicle, like the other vehicles, does not yet need to perform an avoidance operation against the emergency vehicle. Therefore, the notification mode determination unit 15 determines a notification mode that notifies the driver that "it is not yet necessary to perform an avoidance operation against the emergency vehicle."

[0028] On the other hand, when the notification mode determination unit 15 determines that the emergency vehicle distance detected by the emergency vehicle detection unit 13 is less than a predetermined first threshold and, for example, that the non-detection possibility value calculated by the possibility calculation unit 14 is less than a detection threshold, it determines the notification mode to inform the driver that "it is better to take evasive action against the emergency vehicle."

[0029] This is a situation where the emergency vehicle distance is less than the first threshold, the emergency vehicle detection unit 13 detects by radio that the vehicle and the emergency vehicle are approaching each other to a certain extent, and the emergency vehicle recognition unit 12 recognizes the emergency vehicle or the emergency vehicle recognized by the emergency vehicle recognition unit 12 is highly likely, so the possibility calculation unit 14 calculates that the non-detection possibility value is less than the detection threshold. Therefore, a situation is assumed in which other vehicles around the vehicle recognize the emergency vehicle and are taking evasive action or are ready to take evasive action. Therefore, the notification mode determination unit 15 determines that the vehicle needs to take evasive action against the emergency vehicle as well as other vehicles. Therefore, the notification mode determination unit 15 determines the notification mode for informing the driver that "it is better to take evasive action against the emergency vehicle."

[0030] In addition, if the notification mode determination unit 15 determines that the non-detection probability value calculated by the possibility calculation unit 14 is less than the detection threshold, it may determine the mode of notification regarding the emergency vehicle depending on the emergency vehicle distance detected by the emergency vehicle detection unit 13.

[0031] For example, when the notification mode determination unit 15 determines that the non-detection probability value calculated by the possibility calculation unit 14 is less than the detection threshold and the emergency vehicle distance detected by the emergency vehicle detection unit 13 is less than the second threshold (second threshold < first threshold), it determines the notification mode to inform the driver that "evasive action will be taken immediately in response to the emergency vehicle."

[0032] This is a situation where the non-detectability value is less than the detection threshold, other vehicles around the vehicle recognize the emergency vehicle and are taking evasive action. Furthermore, the emergency vehicle distance is less than the second threshold, and the vehicle and the emergency vehicle are quite close to each other. For this reason, the driver is prompted to take evasive action quickly to avoid the emergency vehicle by the above notification.

[0033] In addition, when the notification mode determination unit 15 determines that the non-detection probability value calculated by the possibility calculation unit 14 is less than the detection threshold and the emergency vehicle distance detected by the emergency vehicle detection unit 13 is greater than or equal to the second threshold and less than the first threshold, it determines the notification mode to inform the driver that "it is better to take evasive action against the emergency vehicle."

[0034] This is a situation where the non-detectability value is less than the detection threshold, other vehicles around the vehicle recognize the emergency vehicle and are taking evasive action. Furthermore, the emergency vehicle distance is equal to or greater than the second threshold and less than the first threshold, and the vehicle and the emergency vehicle are slightly close to each other. For this reason, the driver is prompted to take evasive action a little more quickly in the vicinity of the emergency vehicle by the above notification.

[0035] Furthermore, when the notification mode determination unit 15 determines that the non-detection probability value calculated by the possibility calculation unit 14 is less than the detection threshold and the emergency vehicle distance detected by the emergency vehicle detection unit 13 is greater than or equal to the first threshold and less than the third threshold (second threshold < first threshold < third threshold), it determines the notification mode to inform the driver that "it would be better to wait a while before taking evasive action against the emergency vehicle."

[0036] This is a situation where the non-detectability value is less than the detection threshold, and other vehicles around the vehicle recognize the emergency vehicle and are taking evasive action. However, the emergency vehicle distance is equal to or greater than the first threshold and equal to the third threshold, and the vehicle and the emergency vehicle are a little apart. For this reason, the driver is prompted by the above notification to take his / her time with the emergency vehicle and to wait a little before taking evasive action.

[0037] When the notification mode determination unit 15 determines that the non-detection probability value calculated by the possibility calculation unit 14 is less than the detection threshold and that the emergency vehicle distance detected by the emergency vehicle detection unit 13 is greater than or equal to the third threshold, it determines the notification mode to inform the driver that "it is better to wait sufficiently before taking evasive action against the emergency vehicle."

[0038] This is a situation where the non-detectability value is less than the detection threshold, and other vehicles around the vehicle recognize the emergency vehicle and are taking evasive action. However, the emergency vehicle distance is equal to or greater than the third threshold, and the vehicle is far away from the emergency vehicle. For this reason, the driver is prompted by the above notification to take his or her own time and wait for the emergency vehicle before taking evasive action.

[0039] In this way, a situation is assumed in which the non-detectability value is less than the detection threshold value, and other vehicles around the vehicle recognize the emergency vehicle and perform avoidance operations. In this case, the vehicle may also perform avoidance operations like the other vehicles, but the urgency of performing the avoidance operations varies depending on the emergency vehicle distance between the vehicle and the vehicle. That is, when the emergency vehicle distance is small and the emergency vehicle is approaching the vehicle, the vehicle needs to perform avoidance operations quickly, but conversely, when the emergency vehicle distance is large and the emergency vehicle is far away from the vehicle, the vehicle does not need to perform avoidance operations so quickly. Therefore, as described above, it is preferable to prompt the vehicle to perform avoidance operations in stages according to the emergency vehicle distance.

[0040] The notification mode determination unit 15 outputs to the notification unit 16 an instruction signal according to the notification mode determined as described above.

[0041] The notification unit 16 issues a notification based on the notification mode determined by the notification mode determination unit 15. The notification unit 16 is composed of, for example, a display device such as a liquid crystal display, an organic EL display, or a head-up display provided in the vehicle, and an audio output device such as a speaker.

[0042] In response to an instruction signal from the notification mode determination unit 15, the notification unit 16 notifies the driver that it is better to take evasive action against the emergency vehicle, for example, by notifying the driver that "it is about time to pull over to the shoulder of the road to avoid the emergency vehicle."

[0043] In addition, in response to an instruction signal from the notification mode determination unit 15, the notification unit 16 notifies the driver that there is no need to take evasive action yet for the emergency vehicle, for example, "There is no need to panic and avoid the emergency vehicle yet."

[0044] The notification unit 16 may notify an emergency vehicle or other vehicles that the vehicle is performing the evasive action when the vehicle performs the evasive action. The notification unit 16 may, in response to the driver's operation, notify the driver that the vehicle is performing the evasive action by using a display device facing the outside of the vehicle. For example, the notification unit 16 may display that the evasive action is being performed on the rear window of the vehicle using a head-up display or an electronic bulletin board installed on the rear tray. This allows other vehicles to more clearly recognize the evasive action of the vehicle, and, for example, the vehicle and other vehicles can cooperate to perform the evasive action more smoothly against the emergency vehicle.

[0045] Next, the emergency vehicle information notifying method according to the present embodiment will be described. Fig. 2 is a flowchart showing the flow of the emergency vehicle information notifying method according to the present embodiment. Note that the process shown in Fig. 2 may be repeatedly executed at predetermined time intervals.

[0046] The emergency vehicle detection unit 13 detects an emergency vehicle approaching the host vehicle and the emergency vehicle distance between the host vehicle and the emergency vehicle (step S101), and outputs the detected distance to the notification mode determination unit 15.

[0047] The possibility calculation unit 14 calculates a non-detection possibility value indicating the possibility that other vehicles around the host vehicle have not detected the emergency vehicle (step S102), and outputs the non-detection possibility value to the notification mode determination unit 15.

[0048] The notification mode determination unit 15 determines whether or not the emergency vehicle distance detected by the emergency vehicle detection unit 13 is less than a predetermined first threshold value (step S103).

[0049] When the notification mode determination unit 15 determines that the emergency vehicle distance detected by the emergency vehicle detection unit 13 is less than the predetermined first threshold (YES in step S103), it determines the mode of notification regarding the emergency vehicle based on the non-detection possibility value calculated by the possibility calculation unit 14 (step S104). On the other hand, when the notification mode determination unit 15 determines that the emergency vehicle distance detected by the emergency vehicle detection unit 13 is not less than the predetermined first threshold (NO in step S103), it ends this process.

[0050] The notification unit 16 performs notification based on the notification mode determined by the notification mode determination unit (step S105).

[0051] As described above, the emergency vehicle information notification device 10 of this embodiment comprises an emergency vehicle detection unit 13 that detects the emergency vehicle distance between an emergency vehicle approaching the host vehicle and the host vehicle, a possibility calculation unit 14 that calculates a non-detection possibility value that indicates the possibility that other vehicles around the host vehicle have not detected the emergency vehicle, a notification mode determination unit 15 that determines the mode of notification regarding the emergency vehicle based on the non-detection possibility value calculated by the possibility calculation unit 14 when the emergency vehicle distance detected by the emergency vehicle detection unit 13 is less than a predetermined first threshold value, and a notification unit 16 that issues a notification based on the notification mode determined by the notification mode determination unit 15.

[0052] According to this embodiment, when the emergency vehicle distance is less than the first threshold value and the vehicle is close to the emergency vehicle to some extent, the mode of notification regarding the emergency vehicle is determined in consideration of the non-detection probability value indicating that the other vehicles around the vehicle have not detected the emergency vehicle. This allows the vehicle to notify the driver so that the vehicle, together with the other vehicles around the vehicle, performs an avoidance operation at an appropriate timing against the emergency vehicle approaching the vehicle and the other vehicles. In addition, when the emergency vehicle is approaching from behind, for example, it is not necessary to constantly monitor with a rearview mirror whether the emergency vehicle is approaching so close that it can be confirmed by sight or sound, and support for performing the avoidance operation can be provided based on the degree of recognition of the siren sound or the red rotating light. Therefore, the vehicle can be supported to run smoothly while performing an appropriate operation to avoid the emergency vehicle.

[0053] EMBODIMENT 2 3 is a block diagram showing a schematic system configuration of an emergency vehicle information notification device according to this embodiment. The emergency vehicle information notification device 20 according to this embodiment includes an emergency vehicle detection unit 21, a surrounding information acquisition unit 22, a vehicle other than the vehicle determination unit 23, a notification mode determination unit 24, and a notification unit 25.

[0054] The emergency vehicle detection unit 21 detects the distance to the emergency vehicle and the direction of the emergency vehicle relative to the vehicle itself. The emergency vehicle detection unit 21 can detect the distance to the emergency vehicle using the signal strength of the radio wave of the emergency vehicle, GNSS information, and the like.

[0055] Furthermore, the emergency vehicle detection unit 21 may detect the direction of the emergency vehicle relative to the vehicle itself, for example, by using a direction detection function of Bluetooth 5.1 (registered trademark). More specifically, the emergency vehicle detection unit 21 may detect the direction of the emergency vehicle relative to the vehicle itself, by using an angle of arrival (AoA) method or an angle of departure (AoD) method based on triangulation. The emergency vehicle detection unit 21 may obtain information indicating the current position of the emergency vehicle using the same method as in the first embodiment, and detect the direction of the emergency vehicle from the difference from the current position of the vehicle itself.

[0056] The surrounding information acquisition unit 22 acquires image information of the surroundings of the host vehicle. The surrounding information acquisition unit 22 acquires image information of the surroundings of the host vehicle using, for example, a camera. The surrounding information acquisition unit 22 outputs the acquired image information of the surroundings of the host vehicle to the other vehicle determination unit 23.

[0057] The other vehicle determination unit 23 determines whether or not another vehicle (hereinafter referred to as the other vehicle) other than the emergency vehicle is traveling in the direction of the emergency vehicle and whether or not the other vehicle is performing an avoidance operation, based on the image information of the surroundings of the vehicle acquired by the surrounding information acquisition unit 22. The other vehicle performing an avoidance operation means, for example, that the other vehicle is moving toward the shoulder of the road or flashing a turn signal toward the shoulder of the road.

[0058] The other vehicle determination unit 23 may determine other vehicles using a learning dictionary generated by performing machine learning, deep learning, or the like. The learning dictionary may be configured with a neural network, or the like. For example, the learning dictionary is generated by learning using learning data of other vehicle images that are labeled (teaching data) with 1 if the image includes another vehicle performing an avoidance operation, and with 0 if the image does not include another vehicle performing an avoidance operation.

[0059] When image information acquired by the surrounding information acquisition unit 22 is input to the learning dictionary, the learning dictionary outputs a learning dictionary output value between 0 and 1.

[0060] When the learning dictionary output value is equal to or greater than the judgment threshold, the other vehicle judgment unit 23 outputs a judgment result that another vehicle existing in the direction of the emergency vehicle is performing an evasive action (hereinafter referred to as an evasive action judgment) to the notification mode determination unit 24. Note that the judgment threshold is a threshold for judging the evasive action of another vehicle, and an optimal value obtained experimentally may be set in advance in the other vehicle judgment unit 23 as the judgment threshold.

[0061] On the other hand, when the learning dictionary output value is less than the judgment threshold value, the other vehicle judgment unit 23 outputs a judgment result (hereinafter referred to as a non-avoidance operation judgment) to the notification mode determination unit 24 that another vehicle located in the direction of the emergency vehicle is not performing an evasive operation.

[0062] The other vehicle determination unit 23 may be configured to determine whether or not another vehicle other than the emergency vehicle is traveling in the direction of the emergency vehicle using learning data of other vehicle images labeled with 1 if the image includes the other vehicle and 0 if the image does not include the other vehicle, and to determine whether or not the other vehicle is taking evasive action based on a change in the position of the area on the image in which the other vehicle is recognized.

[0063] When the emergency vehicle distance detected by the emergency vehicle detection unit 21 is less than a predetermined first threshold, the notification mode decision unit 24 decides the mode of notification regarding the emergency vehicle based on the determination result by the other vehicle determination unit 23.

[0064] When the emergency vehicle distance detected by the emergency vehicle detection unit 21 is less than a predetermined first threshold and the judgment result by the other vehicle judgment unit 23 is a no-avoidance operation judgment, the notification mode determination unit 24 determines a notification mode to inform the driver that "there is no need to perform evasive operation yet for the emergency vehicle."

[0065] This is assumed to be a situation in which the emergency vehicle distance is less than the first threshold value, the vehicle and the emergency vehicle are close to each other to a certain extent, but the judgment result is a non-avoidance operation judgment, and the other vehicle does not recognize the emergency vehicle and has not yet performed an avoidance operation. Therefore, the notification mode determination unit 24 judges that the vehicle, like the other vehicle, does not yet need to perform an avoidance operation for the emergency vehicle. Therefore, the notification mode determination unit 24 determines a notification mode that informs the driver that "it is not yet necessary to perform an avoidance operation for the emergency vehicle."

[0066] On the other hand, when the emergency vehicle distance detected by the emergency vehicle detection unit 21 is less than a predetermined first threshold and the judgment result by the other vehicle judgment unit 23 is an evasive maneuver judgment, the notification mode determination unit 24 determines the notification mode to inform the driver that "it is better to take evasive maneuver against the emergency vehicle."

[0067] This is assumed to be a situation in which the emergency vehicle distance is less than the first threshold, the vehicle and the emergency vehicle are close to each other to a certain extent, the judgment result is an avoidance operation judgment, and the other vehicle recognizes the emergency vehicle and is performing an avoidance operation. Therefore, the notification mode determination unit 24 judges that the vehicle also needs to perform an avoidance operation against the emergency vehicle, just like the other vehicle. Therefore, the notification mode determination unit 24 determines the notification mode for informing the driver that "it is better to perform an avoidance operation against the emergency vehicle."

[0068] The notification mode determination unit 24 outputs an instruction signal according to the notification mode determined as described above to the notification unit 25. The notification unit 25 performs notification based on the notification mode determined by the notification mode determination unit 24.

[0069] In response to an instruction signal from the notification mode determination unit 24, the notification unit 25 notifies the driver that "it would be better to take evasive action for the emergency vehicle" or that "it is not yet necessary to take evasive action for the emergency vehicle."

[0070] Next, the emergency vehicle information notifying method according to the present embodiment will be described. Fig. 4 is a flowchart showing the flow of the emergency vehicle information notifying method according to the present embodiment. Note that the process shown in Fig. 4 may be repeatedly executed at predetermined time intervals.

[0071] The emergency vehicle detection unit 21 detects the emergency vehicle distance and the direction of the emergency vehicle relative to the host vehicle (step S201), and outputs them to the other vehicle determination unit .

[0072] The surrounding information acquisition unit 22 acquires image information of the surroundings of the host vehicle (step S202), and outputs the image information to the other vehicle determination unit .

[0073] The other vehicle determination unit 23 determines, based on image information about the surroundings of the vehicle acquired by the surrounding information acquisition unit 22, whether or not another vehicle other than the emergency vehicle is traveling in the direction of the emergency vehicle and whether or not the other vehicle is performing an evasive maneuver (step S203).

[0074] The notification mode determination unit 24 determines whether the emergency vehicle distance detected by the emergency vehicle detection unit 21 is less than a predetermined first threshold value (step S204).

[0075] If the notification mode determination unit 24 determines that the emergency vehicle distance detected by the emergency vehicle detection unit 21 is less than a predetermined first threshold (YES in step S204), it determines the notification mode regarding the emergency vehicle based on the determination result by the other vehicle determination unit 23 (step S205).

[0076] On the other hand, when the notification mode determination unit 24 determines that the emergency vehicle distance detected by the emergency vehicle detection unit 21 is not less than the predetermined first threshold value (NO in step S204), the notification mode determination unit 24 ends this process.

[0077] The notification unit 25 performs notification based on the notification mode determined by the notification mode determination unit 24 (step S206).

[0078] As described above, the emergency vehicle information notification device 20 of this embodiment comprises an emergency vehicle detection unit 21 that detects the distance between the host vehicle and an emergency vehicle approaching the host vehicle, and the direction of the emergency vehicle relative to the host vehicle, a surrounding information acquisition unit 22 that acquires image information about the surroundings of the host vehicle, an other vehicle determination unit 23 that determines whether or not another vehicle other than the emergency vehicle is traveling in the direction of the emergency vehicle and whether or not the other vehicle is performing evasive maneuvering, based on the image information about the surroundings of the host vehicle acquired by the surrounding information acquisition unit 22, an alert mode determination unit 24 that determines the alert mode regarding the emergency vehicle based on the determination result by the other vehicle determination unit 23 when the distance detected by the emergency vehicle detection unit 21 is less than a predetermined first threshold value, and an alert unit 25 that issues an alert based on the alert mode determined by the alert mode determination unit 24.

[0079] According to this embodiment, when the emergency vehicle distance is less than the first threshold value and the vehicle and the emergency vehicle are relatively close to each other, the mode of notification regarding the emergency vehicle is determined in consideration of the result of the determination of whether or not another vehicle in the direction of the emergency vehicle is performing an avoidance operation. This allows the driver to be notified that the vehicle, together with the other vehicles around the vehicle, should perform an avoidance operation at an appropriate timing against the emergency vehicle approaching the vehicle and the other vehicles. Therefore, the vehicle can be supported to run smoothly while performing an appropriate operation to avoid the emergency vehicle.

[0080] Although some embodiments of the present disclosure have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims.

[0081] The present disclosure can also be implemented by causing a processor to execute a computer program to perform the processes shown in FIG. 2 or FIG.

[0082] The program can be stored and provided to a computer using various types of non-transitory computer readable media. The non-transitory computer readable media includes various types of tangible storage media. Examples of the non-transitory computer readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (random access memories)).

[0083] The program may be provided to the computer by various types of transitory computer readable media. Examples of the transitory computer readable medium include an electric signal, an optical signal, and an electromagnetic wave. The transitory computer readable medium can provide the program to the computer via a wired communication path such as an electric wire and an optical fiber, or via a wireless communication path.

[0084] Each unit constituting the emergency vehicle information notification device 10, 20 according to each of the above-mentioned embodiments can be realized not only by a program, but also in whole or in part by dedicated hardware such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array). [Explanation of symbols]

[0085] 10 Emergency vehicle information notification device 11 Surrounding information acquisition unit 12 Emergency Vehicle Recognition Department 13 Emergency vehicle detection unit 14 Possibility calculation part 15 Notification mode determination unit 16. Notification Department 20 Emergency vehicle information notification device 21 Emergency vehicle detection unit 22 Surrounding information acquisition unit 23 Other Vehicle Judgment Section 24 Notification mode determination unit 25. Notification Department

Claims

1. an emergency vehicle detection unit that detects a distance between an emergency vehicle approaching the vehicle and the vehicle; a likelihood calculation unit that calculates a likelihood value indicating a likelihood that other vehicles present around the host vehicle have not detected the emergency vehicle; a notification mode determination unit that determines a mode of notification regarding the emergency vehicle based on the likelihood value calculated by the likelihood calculation unit when the distance detected by the emergency vehicle detection unit is less than a predetermined first threshold; a notification unit that performs notification based on the notification mode determined by the notification mode determination unit; An emergency vehicle information notification device comprising:

2. 2. The emergency vehicle information notification device according to claim 1, a surrounding information acquisition unit that acquires information including voice information around the host vehicle; An emergency vehicle recognition unit that recognizes the emergency vehicle based on the information acquired by the surrounding information acquisition unit, The possibility calculation unit is If the emergency vehicle is not recognized by the emergency vehicle recognition unit, the likelihood value is calculated as a value equal to or greater than a predetermined detection threshold value; When the emergency vehicle is recognized by the emergency vehicle recognition unit, the possibility value is calculated based on a value indicating a likelihood of the recognition result. Emergency vehicle information notification device.

3. an emergency vehicle detection unit that detects a distance between an emergency vehicle approaching the host vehicle and the host vehicle and a direction of the emergency vehicle relative to the host vehicle; a surrounding information acquisition unit that acquires image information about the surroundings of the host vehicle; an other vehicle determination unit that determines whether or not another vehicle other than the emergency vehicle is traveling in the direction of the emergency vehicle and whether or not the other vehicle is performing an avoidance operation based on image information about the surroundings of the host vehicle acquired by the surrounding information acquisition unit; a notification mode determination unit that determines a mode of notification regarding the emergency vehicle based on a determination result by the other vehicle determination unit when the distance detected by the emergency vehicle detection unit is less than a predetermined first threshold value; a notification unit that performs notification based on the notification mode determined by the notification mode determination unit; An emergency vehicle information notification device comprising:

4. Detecting a distance between an emergency vehicle approaching the vehicle and the vehicle; calculating a likelihood value indicating a likelihood that other vehicles present around the vehicle have not detected the emergency vehicle; determining a manner of notification regarding the emergency vehicle based on the calculated likelihood value when the detected distance is less than a predetermined first threshold; performing a notification based on the determined notification manner; An emergency vehicle information reporting method comprising:

5. Detecting a distance between an emergency vehicle approaching the host vehicle and the host vehicle and a direction of the emergency vehicle relative to the host vehicle; acquiring image information about the surroundings of the host vehicle; determining whether or not a vehicle other than the emergency vehicle is traveling in the direction of the emergency vehicle and whether or not the vehicle is taking an avoidance action based on the acquired image information of the surroundings of the vehicle; When the detected distance is less than a predetermined first threshold, determining a manner of notification regarding the emergency vehicle based on the determination result; performing a notification based on the determined notification manner; An emergency vehicle information reporting method comprising:

Citation Information

Patent Citations

  • Vehicle-to-vehicle communication device

    JP2011075396A