Hazard Information Notification System

Abstract

To appropriately report danger or the like by sharing information of a plurality of vehicles while reducing the amount of information.SOLUTION: A danger information notification system 1 includes: a terminal device 10 having a video data acquisition unit that acquires video data obtained by photographing surroundings of a mobile body, a danger information detection unit that detects danger information and its type from the video data, and a danger information communication control unit that transmits the danger information detected by the danger information detection unit to a server device; and a server device 0 having an identification unit that identifies a notification area where the danger information is notified according to the type of danger information based on the danger information received from the terminal device, and a notification control unit that performs control so as to notify a target mobile body located within the notification area of the danger information.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a danger information notification system.

Background Art

[0002] When receiving a notification from a vehicle, a technique for sending an accident occurrence notification to other vehicles existing within a predetermined range from the accident occurrence position is known (for example, see Patent Document 1). When a predetermined event occurs in any of a plurality of vehicles, a technique for notifying the occurrence of the event to vehicles located in the transmission area based on the characteristic data of the vehicle and the occurrence point is known (for example, see Patent Document 2).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] For example, when using a cloud service or the like to share information of a plurality of vehicles and notify dangers or the like, if video data is communicated as it is, the amount of information may become excessive. Even if the amount of information is suppressed, it is desirable to appropriately notify dangers or the like by sharing information of a plurality of vehicles.

[0005] The present invention has been made in view of the above, and an object thereof is to appropriately notify dangers or the like by sharing information of a plurality of vehicles while suppressing the amount of information.

Means for Solving the Problems

[0006] To solve the above-mentioned problems and achieve the objective, the hazard information notification system according to the present invention comprises a terminal device having a video data acquisition unit that acquires video data of the area around a moving object, a hazard information detection unit that detects hazard information and its type from the video data, and a hazard information communication control unit that transmits the hazard information detected by the hazard information detection unit to a server device, and a server device having a specification unit that identifies a notification area to which the hazard information is to be notified according to the type of hazard information based on the hazard information received from the terminal device, and a notification control unit that controls the notification of the hazard information to target moving objects located within the notification area. [Effects of the Invention]

[0007] According to the present invention, the amount of information can be reduced, and information from multiple vehicles can be shared to appropriately notify of dangers and other issues. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 is a schematic diagram showing an example of the configuration of a hazard information notification system according to an embodiment. [Figure 2] Figure 2 is a block diagram showing an example configuration of a terminal device according to an embodiment. [Figure 3] Figure 3 is a block diagram showing an example configuration of a server device according to the embodiment. [Figure 4] Figure 4 illustrates an example of hazard classification information. [Figure 5] Figure 5 illustrates another example of hazard classification information. [Figure 6] Figure 6 is a sequence diagram showing the processing flow in the hazard information notification system according to the embodiment. [Modes for carrying out the invention]

[0009] Embodiments of the hazard information notification system according to the present invention will be described in detail below with reference to the attached drawings. However, the present invention is not limited to the following embodiments.

[0010] [Embodiment] <Hazard Information Notification System> Figure 1 is a schematic diagram showing an example configuration of a hazard information notification system 1 according to an embodiment. The hazard information notification system 1 includes terminal devices 10 mounted on multiple mobile bodies and a server device 40. Based on hazard information transmitted from the multiple terminal devices 10 to the server device 40, the hazard information notification system 1 notifies target mobile bodies within the notification area of ​​hazard information from the server device 40.

[0011] Hazard information refers to information about dangers that may occur around a road. Hazard information refers to information about dangers that may affect moving objects traveling on a road. Hazard information refers to information about dangers that moving objects should be aware of when traveling on a road. Hazard information refers to information about dangers that require moving objects to, for example, slow down, take a detour, stop, or travel more carefully than in other places.

[0012] A moving object is an object that moves on a road. Moving objects include, for example, vehicles and pedestrians. In the following description, a vehicle will be described as an example of a moving object.

[0013] <Driving support system> Figure 2 is a block diagram showing an example configuration of the terminal device 10 according to this embodiment. The terminal device 10 detects dangerous information around the vehicle from video data captured while the vehicle is in motion and transmits the dangerous information to the server device 40. When the terminal device 10 receives dangerous information from the server device 40, it notifies the passenger of the dangerous information. In this embodiment, the terminal device 10 is a so-called drive recorder. In addition to being mounted on the vehicle, the terminal device 10 may be a portable device that can be used in the vehicle. The terminal device 10 includes a camera 11, a recording unit 12, a display unit 13, a GPS (Global Positioning System) receiving unit 14 which is an example of a GNSS (Global Navigation Satellite System), a recognition dictionary storage unit 16, a communication unit 17, and a control unit 20.

[0014] Camera 11 is a camera that photographs the area around the vehicle. Camera 11 photographs at least the front or rear of the vehicle. In this embodiment, camera 11 is described as two cameras positioned inside the vehicle's cabin that photograph the front and rear, each being an ultra-wide-angle camera capable of photographing approximately 178° horizontally and approximately 60° vertically, thereby enabling photography of almost the entire area around the vehicle. However, it is not limited to this, and may be composed of, for example, a camera with a fisheye lens capable of photographing 360° in all directions, or a group of multiple cameras that photograph each direction. It may also be composed of a stereo camera suitable for measuring the distance of an object, as described later. Camera 11 continuously photographs images from the time the engine is started until it is stopped, that is, while the vehicle is in operation. In this embodiment, camera 11 continuously photographs images while the vehicle's accessory power is ON. Camera 11 outputs the captured video data to the video data acquisition unit 21 of the control unit 20. The video data is, for example, a moving image composed of 30 frames per second. The camera 11 is not limited to one mounted on a vehicle, but may also be a fixed-point camera or security camera installed near the road.

[0015] The recording unit 12 is used for temporary storage of data in the terminal device 10. The recording unit 12 is, for example, a semiconductor memory element such as RAM (Random Access Memory) or flash memory, or a recording unit such as a memory card. Alternatively, it may be an external recording unit wirelessly connected via a communication device (not shown). The recording unit 12 records loop recording data based on control signals output from the recording control unit 24 of the control unit 20.

[0016] The display unit 13 is, for example, a display device unique to the terminal device 10 or a display device shared with another system including a navigation system. The display unit 13 is, for example, a display including a liquid crystal display (LCD) or an organic EL (Electro-Luminescence) display. The display unit 13 displays an image based on the video signal output from the display control unit 25 of the control unit 20. The display unit 13 displays the image captured by the camera 11 or the image recorded in the recording unit 12. The display unit 13 displays information for notifying the driver of the vehicle that a surrounding vehicle is driving dangerously.

[0017] The GPS receiver 14 receives radio waves from GPS satellites (not shown). The GPS receiver 14 outputs the signal of the received radio waves to the position information acquisition unit 26 of the control unit 20.

[0018] The recognition dictionary storage unit 16 stores a recognition dictionary of danger information and the type of danger information. The recognition dictionary storage unit 16 may be a storage device such as an external server that acquires the recognition dictionary via the communication unit 17.

[0019] The types of danger information include, for example, collision accidents, hit-and-run accidents, aggressive driving, highway reverse driving, fires, landslides, blockage of earth and sand or civil engineering roads, ground collapses, tsunamis caused by earthquakes, frozen, snow-covered or flooded road surfaces, and large-scale power outages.

[0020] The communication unit 17 is a communication unit. The communication unit 17 may communicate by any method such as the Internet or a mobile phone line. The communication unit 17 communicates data with the server device 40.

[0021] The control unit 20 is a processing unit (control device) composed of, for example, a CPU (Central Processing Unit). The control unit 20 loads the stored program into memory and executes the instructions contained in the program. The control unit 20 includes internal memory (not shown), which is used for temporary storage of data in the control unit 20. The control unit 20 has a video data acquisition unit 21, a buffer memory 22, a video data processing unit 23, a recording control unit 24, a display control unit 25, a location information acquisition unit 26, a hazard information detection unit 30, and a hazard information communication control unit 32, all connected to the bus 20X.

[0022] The video data acquisition unit 21 acquires video data of the area around the vehicle. The video data acquisition unit 21 acquires video data of the surrounding area as the vehicle is in motion. More specifically, the video data acquisition unit 21 acquires the video data output by the camera 11 and outputs it to the buffer memory 22.

[0023] The buffer memory 22 is an internal memory provided by the control unit 20, and is a memory that temporarily records video data acquired by the video data acquisition unit 21 for a certain period of time, while updating it.

[0024] The video data processing unit 23 encodes the video data temporarily stored in the buffer memory 22 using an arbitrary codec such as H.264 or MPEG-4 (Moving Picture Experts Group), and converts it together with the audio data into an arbitrary file format such as MP4. The video data processing unit 23 generates video data as a file for a certain period of time from the video data temporarily stored in the buffer memory 22. As a specific example, the video data processing unit 23 generates 60 seconds of video data as one file from the video data temporarily stored in the buffer memory 22 in recording order. The video data processing unit 23 outputs the generated video data to the recording control unit 24. The video data processing unit 23 also outputs the generated video data to the display control unit 25. The duration of the video data generated as a file is 60 seconds as an example, but is not limited to this.

[0025] The recording control unit 24 controls the recording unit 12 to record the video data that has been filed by the video data processing unit 23. When the vehicle's accessory power is ON, or during the period when loop recording processing is performed, the recording control unit 24 records the video data that has been filed by the video data processing unit 23 to the recording unit 12 as overwritable video data. More specifically, during the period when loop recording processing is performed, the recording control unit 24 continues to record the video data generated by the video data processing unit 23 to the recording unit 12, and when the capacity of the recording unit 12 becomes full, it overwrites the oldest video data with new video data.

[0026] The recording control unit 24 may, when danger information is detected by the danger information detection unit 30, record the captured video data in the recording unit 12 with overwriting disabled.

[0027] The display control unit 25 controls the display of video data on the display unit 13. The display control unit 25 outputs a video signal that causes the video data to be output to the display unit 13. More specifically, the display control unit 25 displays the video captured by the camera 11 on the display unit 13.

[0028] When the display control unit 25 receives danger information from the server device 40 via the danger information communication control unit 32, it causes the danger information to be displayed on the display unit 13.

[0029] The display control unit 25 may change the display mode depending on the degree of danger of the danger information received from the server device 40. For example, if the degree of danger is "high," the display control unit 25 will display it in a more conspicuous manner than when the degree of danger is "low," so that it is easier for passengers to see.

[0030] The location information acquisition unit 26 calculates the vehicle's current location information using a known method based on the radio waves received by the GPS receiver unit 14. The location information calculated by the location information acquisition unit 26 may be stored together with the video data.

[0031] The hazard information detection unit 30 detects hazard information and its type from the video data acquired by the video data acquisition unit 21. More specifically, the hazard information detection unit 30 detects hazard information and its type from the video data captured by the camera 11, for example, using a recognition dictionary stored in the recognition dictionary storage unit 16. The hazard information detection unit 30 uses the recognition dictionary to detect, for example, collisions, hit-and-run accidents, aggressive driving, driving the wrong way on highways, fires, landslides, road closures due to landslides or civil engineering, ground collapses, tsunamis caused by earthquakes, road freezing, snow accumulation, flooding, and large-scale traffic stops from the captured video data. The method for detecting hazard information and its type from video data is not limited to the method using a recognition dictionary, and known methods can be used. The hazard information detection unit 30 detects hazard information and its type not only in which the vehicle is involved as a party, but also in which the vehicle encounters accidents and disasters while passing by.

[0032] The hazard information detection unit 30 may detect various items according to the type of hazard information it has detected. For example, if the type of hazard information is "collision accident," the hazard information detection unit 30 will detect "scale of accident" as an item of hazard information. The scale of accident is detected by performing image processing on the video data to determine, for example, whether it is a single-vehicle accident, an accident involving property damage, a multi-vehicle accident, or an accident involving pedestrians. The scale of accident is detected by performing image processing on the video data to determine, for example, whether emergency vehicles have been dispatched or whether lanes are restricted. For example, if the type of hazard information is "collision accident," the hazard information detection unit 30 may further detect "presence or absence of injuries" as an item of hazard information. The presence or absence of injuries is detected by performing image processing on the video data.

[0033] The hazard information detection unit 30, for example, if the type of hazard information is "hit-and-run accident," detects "the scale of the accident, the vehicle number, the vehicle color, and the vehicle type" as items of hazard information. The hazard information detection unit 30 may also detect "whether or not there are injured persons" as an additional item of hazard information if the type of hazard information is "hit-and-run accident." The vehicle number, vehicle color, and vehicle type are detected by performing image processing on the video data.

[0034] The hazard information detection unit 30 detects, for example, "vehicle number, vehicle color, and vehicle type" as items of hazard information when the type of hazard information is "aggressive driving". The hazard information detection unit 30 may also detect "presence or absence of passenger trouble" as an additional item of hazard information when the type of hazard information is "aggressive driving". Passenger trouble refers to a situation where, for example, a passenger in one vehicle gets out and approaches the other vehicle. The presence or absence of passenger trouble is detected by performing image processing on the video data.

[0035] The hazard information detection unit 30, for example, if the type of hazard information is "driving the wrong way on a highway," detects "vehicle license plate number, vehicle color, and vehicle type" as items of hazard information. The hazard information detection unit 30 may also detect "the name of the highway where the wrong-way driving occurred, the name of the toll booth, and the name of the entrance / exit" as items of hazard information. The highway name, toll booth name, and entrance / exit name are detected from video data or vehicle location information and map information.

[0036] The hazard information detection unit 30, for example, if the type of hazard information is "fire," detects the following items as hazard information: "scale of disaster," "area of ​​disaster," and "presence or absence of injuries." The scale of the disaster is detected by image processing of the video data, for example, by determining the size of the area where flames or smoke are recognized, the number of buildings, and whether or not the fire has spread. The area of ​​disaster is detected by image processing of the video data, determining the range where flames or smoke are recognized. Then, based on map information (not shown), the area of ​​disaster where the fire was detected is identified. The presence or absence of injuries is detected by image processing of the video data.

[0037] The hazard information detection unit 30, for example, if the type of hazard information is "landslide," detects the following items as hazard information: "scale of the disaster, and whether the current location is in a designated area during the disaster." The scale of the disaster is detected, for example, by performing image processing on the video data to determine the size of the area where the landslide is recognized. Whether the current location is in a designated area during the disaster is detected, for example, by checking whether the current location is registered as a designated area for landslides in the map information stored in a map information storage unit (not shown).

[0038] The hazard information detection unit 30 detects, for example, "scale of disaster" as an item of hazard information when the type of hazard information is "landslide / civil engineering road closure". The scale of disaster is detected by performing image processing on the video data to determine, for example, the size of the area recognized as being blocked by landslide / civil engineering roads.

[0039] The hazard information detection unit 30 detects, for example, "scale of disaster" as an item of hazard information when the type of hazard information is "ground collapse". The scale of disaster is detected, for example, by performing image processing on the video data to determine the size of the area recognized as having collapsed.

[0040] The hazard information detection unit 30, for example, if the type of hazard information is "tsunami caused by earthquake," detects the following items as hazard information: "scale of the disaster, and whether the current location is in a designated area during the disaster." The scale of the disaster is recognized, for example, from earthquake intensity or tsunami information obtained from an external device. Whether the current location is in a designated area during the disaster is detected, for example, by checking whether the current location is registered as a designated area for tsunamis caused by earthquakes in the map information stored in a map information storage unit (not shown).

[0041] The hazard information detection unit 30, for example, if the type of hazard information is "road freezing, snow accumulation, and flooding," detects the following items as hazard information: "scale of disaster, and whether the current location is in a designated area during a disaster." The scale of the disaster is recognized, for example, from road freezing, snow accumulation, and flooding information obtained from an external device. Whether the current location is in a designated area during a disaster is detected, for example, by checking whether the current location is registered as a designated area for road freezing, snow accumulation, and flooding in the map information stored in a map information storage unit (not shown).

[0042] The hazard information detection unit 30, for example, if the type of hazard information is "large-scale power outage," detects "scale of disaster" as an item of hazard information. The scale of disaster is recognized, for example, from information on the power outage area map obtained from an external device.

[0043] The hazard information detection unit 30 may further detect the degree of danger of the detected hazard information. More specifically, the hazard information detection unit 30 may detect the degree of danger from various items of the detected hazard information, such as the "scale of the accident" and the "presence or absence of injuries." For example, if the "scale of the accident" is above a predetermined range, the degree of danger is set to "high." For example, if there are "injured people," the degree of danger is set to "high." For example, if the type of hazard information is "driving the wrong way on a highway," the degree of danger is set to "high." For example, if the type of hazard information is "aggressive driving" and there is "passenger trouble," the degree of danger is set to "high."

[0044] The hazard information communication control unit 32 communicates the hazard information detected by the hazard information detection unit 30 with the server device 40. The hazard information communication control unit 32 transmits the hazard information detected by the hazard information detection unit 30 to the server device 40. The hazard information transmitted includes information indicating the degree of danger, the location where the hazard occurred, and the date and time of occurrence.

[0045] The hazard information communication control unit 32 receives hazard information about the vehicle's surroundings from the server device 40. In this embodiment, if the hazard information communication control unit 32 receives hazard information notified by the server device 40 and determines that it is the same as the hazard information detected by the hazard information detection unit 30 in the vehicle, it may control the system to send the hazard information detected by the vehicle back to the server device 40. This ensures that the latest hazard information is always transmitted from the terminal device 10 to the server device 40.

[0046] The content of the hazard information is considered identical if the hazard information notified from the server device 40 and the hazard information detected by the hazard information detection unit 30 in the vehicle satisfy the following conditions: the two pieces of hazard information are of the same type, the difference in the location of occurrence is within a predetermined distance, and the difference in the date and time of occurrence is within a predetermined time.

[0047] <Server equipment> Figure 3 is a block diagram showing an example configuration of a server device 40 according to the embodiment. The server device 40 includes a communication unit 41, a hazard type information storage unit 42, and a control unit 50.

[0048] The communication unit 41 is a communication unit. The communication unit 41 may communicate by either the internet or a mobile phone line. The communication unit 41 communicates data with terminal devices 10 installed in multiple vehicles.

[0049] The hazard classification information storage unit 42 stores hazard classification information. The hazard classification information storage unit 42 may also be a storage device such as an external server that acquires hazard classification information via the communication unit 41.

[0050] Hazard type information is information related to the notification of hazard information for each type of hazard information. In this embodiment, hazard type information includes, for example, the notification area for hazard information, the items of hazard information to be notified, and the time interval for notification, for each type of hazard information. The notification area for hazard information is the area where hazard information is notified. The items of hazard information to be notified are the items to be notified. The time interval for notification is the time interval at which notification is made.

[0051] Figure 4 illustrates an example of hazard type information. In the example shown in Figure 4, the hazard type "collision accident" has a notification area of ​​"1km radius from the scene," the items of hazard information to be notified are "scale of the accident," and the notification time interval is "every 5 minutes." The hazard type "hit-and-run accident" has a notification area of ​​"5km in the direction of the vehicle's travel," the items of hazard information to be notified are "scale of the accident, vehicle license plate number, vehicle color, vehicle type," and the notification time interval is "every 1 minute." The hazard type "aggressive driving" has a notification area of ​​"5km in the direction of the vehicle's travel," the items of hazard information to be notified are "vehicle license plate number, vehicle color, vehicle type," and the notification time interval is "every 1 minute." The hazard type "driving the wrong way on a highway" has a notification area of ​​"10km in the direction of the wrong-way driving vehicle," the items of hazard information to be notified are "vehicle license plate number, vehicle color, vehicle type," and the notification time interval is "every 30 seconds." The type of hazard information "fire" has a notification area of ​​"1km radius from the site," the items of hazard information to be notified are "scale of the disaster, area where the disaster occurred," and the notification time interval is "every 10 minutes." The type of hazard information "landslide" has a notification area of ​​"5km radius from the site," the items of hazard information to be notified are "scale of the disaster, is the current location a designated area at the time of the disaster?", and the notification time interval is "every 30 seconds." The type of hazard information "landslide / road closure" has a notification area of ​​"1km radius from the site," the items of hazard information to be notified are "scale of the disaster," and the notification time interval is "every 10 minutes." The type of hazard information "ground collapse" has a notification area of ​​"1km radius from the site," the items of hazard information to be notified are "scale of the disaster," and the notification time interval is "every 5 minutes." The type of hazard information "Tsunami due to earthquake" has a notification area of ​​"5km radius from the site," the items of hazard information to be notified are "scale of the disaster, is the current location a designated area during the disaster?", and the notification time interval is "every 30 seconds." The type of hazard information "Icy roads, snow, and flooding" has a notification area of ​​"1km radius from the site," the items of hazard information to be notified are "scale of the disaster, is the current location a designated area during the disaster?", and the notification time interval is "every 10 minutes." The type of hazard information "Large-scale power outage" has a notification area of ​​"1km radius from the site," the items of hazard information to be notified are "scale of the disaster," and the notification time interval is "every 10 minutes."

[0052] The hazard classification information may further include information indicating whether an emergency call is necessary for each type of hazard information. In this embodiment, the hazard classification information may include information indicating whether an emergency call is necessary for each type and degree of hazard information.

[0053] The degree of danger indicates the magnitude of the impact on the surroundings for each type of danger. In this embodiment, the degree of danger indicates the magnitude of the impact on vehicles traveling on the road. The degree of danger is indicated, for example, as "high" or "low". A degree of danger of "high" means, for example, a level where driving on the road is hindered. A degree of danger of "high" means, for example, a level where it is necessary to notify emergency services. A degree of danger of "low" means, for example, a level where caution is needed when driving on the road. A degree of danger of "low" means, for example, a level where it is not necessary to notify emergency services.

[0054] An emergency agency is an agency to which you report in an emergency. Examples of emergency agencies include the police or agencies that handle emergency medical services.

[0055] Figure 5 illustrates another example of hazard type information. In the example shown in Figure 5, information including the notification area, the items of hazard information to be notified, the notification time interval, and whether or not an emergency call is necessary is specified for each level of hazard information type. For hazard information type "aggressive driving" with a level of danger of "high," the notification area is "5km in the direction of the target vehicle's travel," the items of hazard information to be notified are "vehicle license plate number, vehicle color, vehicle type," the notification time interval is "every minute," and emergency call "report." For hazard information type "aggressive driving" with a level of danger of "low," the notification area is "3km in the direction of the target vehicle's travel," the items of hazard information to be notified are "vehicle license plate number, vehicle color, vehicle type," the notification time interval is "every minute," and emergency call "do not report."

[0056] The control unit 50 is an arithmetic processing unit, for example, composed of a CPU. The control unit 50 loads the stored program into memory and executes the instructions contained in the program. The control unit 50 includes internal memory (not shown), which is used for temporary storage of data in the server device 40. The control unit 50 has a danger information reception control unit 51, a specification unit 52, a notification determination unit 53, a notification control unit 54, and a notification control unit 55. The notification determination unit 53 and the notification control unit 55 are not essential components.

[0057] The danger information receiving control unit 51 controls the reception of danger information from terminal devices 10 installed in multiple vehicles via the communication unit 41.

[0058] The identification unit 52 identifies a notification area to notify about the danger information based on the type of danger information received from the terminal device 10. The identification unit 52 identifies a notification area to notify about the received danger information from the danger type information stored in the danger type information storage unit 42. For example, if the type of danger information is "driving the wrong way on a highway," the identification unit 52 identifies the notification area as "10km in the direction of travel of the vehicle driving the wrong way."

[0059] The identification unit 52 may specify a notification area to be notified according to the degree of danger of the received danger information. For example, the identification unit 52 may specify a larger notification area when the degree of danger is "high" compared to when the degree of danger is "low".

[0060] In this embodiment, the identification unit 52 may further identify the items of the hazard information to be notified and the time interval for notification. The identification unit 52 may also identify the items of the hazard information to be notified and the time interval for notification based on the hazard type information stored in the hazard type information storage unit 42 for the received hazard information.

[0061] In this embodiment, the identification unit 52 determines that the content of the received multiple pieces of hazard information is the same, and then re-identifies the notification area. For example, the identification unit 52 may re-identify the notification area based on the latest piece of hazard information. For example, the identification unit 52 may re-identify the notification area based on the average value of the occurrence locations included in the multiple pieces of hazard information. The average value of the occurrence locations is, for example, the average value of the map coordinates of each occurrence location. For example, the identification unit 52 may expand the notification area and re-identify it as the number of received pieces of hazard information increases.

[0062] Multiple pieces of hazard information are considered identical if they satisfy the following conditions: the multiple pieces of hazard information are of the same type, the difference in their locations is within a predetermined distance, and the difference in their dates and times is within a predetermined time.

[0063] The notification determination unit 53 determines whether or not to notify emergency services based on the degree of danger of the danger information received from the terminal device 10. In this embodiment, the notification determination unit 53 determines whether or not to notify emergency services based on the danger type information stored in the danger type information storage unit 42. The notification determination unit 53 determines whether or not to notify emergency services if the degree of danger is "high". The notification determination unit 53 does not make a duplicate notification if it has already notified emergency services about the same danger information.

[0064] The notification determination unit 53 may determine to notify emergency services if the danger information received from the terminal device 10 includes information indicating "there are injured persons" and "no emergency vehicles have been dispatched."

[0065] The notification control unit 54 controls the system to notify target vehicles located within the notification area of ​​danger information. More specifically, the notification control unit 54 controls the system to notify terminal devices 10 of target vehicles located within the notification area of ​​danger information based on the identification result of the identification unit 52.

[0066] In this embodiment, the notification control unit 54 controls the notification to change the items of the danger information or the time interval for notifying the danger information, depending on the type of danger information received. More specifically, the notification control unit 54 controls the notification to change the items of the danger information or the time interval for notifying the danger information, based on the identification result of the identification unit 52.

[0067] The notification control unit 55 controls the notification to emergency services according to the degree of danger of the danger information received from the terminal device 10. More specifically, the notification control unit 55 controls the notification to emergency services when the notification determination unit 53 determines to "notify". The notification control unit 55 controls the communication unit 41 to transmit notification information indicating a notification that includes a dispatch request to emergency services. The notification information includes information identifying the vehicle, information on the vehicle's current location, and information indicating a dispatch request.

[0068] <Processing in the Hazard Information Notification System> Next, with reference to Figure 6, the information processing in the hazard information notification system 1 will be described. Figure 6 is a sequence diagram showing the processing flow in the hazard information notification system 1 according to this embodiment. The terminal device 10 installed in each vehicle is running while the vehicle is running. While the terminal device 10 is running, the camera 11 continuously takes pictures.

[0069] First, the control unit 20 of the terminal device 10 installed in the vehicle acquires vehicle location information (step S11). More specifically, the control unit 20 calculates the vehicle's current location information by a known method based on the radio waves received by the GPS receiver 14, using the location information acquisition unit 26. The control unit 20 then proceeds to step S12.

[0070] The control unit 20 acquires video data (step S12). More specifically, the control unit 20 receives video data captured by the camera 11 around the vehicle from the video data acquisition unit 21. The control unit 20 then proceeds to step S13.

[0071] The control unit 20 detects hazard information (step S13). More specifically, the control unit 20 uses the hazard information detection unit 30 to detect hazard information and its type from the video data captured by the camera 11, using the recognition dictionary stored in the recognition dictionary storage unit 16. The control unit 20 uses the hazard information detection unit 30 to detect various items corresponding to the type of hazard information. The control unit 20 uses the hazard information detection unit 30 to detect the degree of hazard. The control unit 20 proceeds to step S14.

[0072] The control unit 20 transmits hazard information (step S14). More specifically, the control unit 20 transmits the hazard information detected by the hazard information detection unit 30 to the server device 40 via the hazard information communication control unit 32. The hazard information transmitted in step 14 includes information indicating the degree of danger, the location where the hazard information occurred, and the date and time of occurrence.

[0073] The control unit 50 of the server device 40 receives the hazard information (step S21). More specifically, the control unit 50 receives the hazard information from the terminal device 10 installed in the vehicle via the hazard information receiving control unit 51. The control unit 50 then proceeds to step S22.

[0074] The control unit 50 identifies a notification area to notify of the hazard information (step S22). More specifically, the control unit 50 uses the identification unit 52 to identify a notification area to notify of the received hazard information from the hazard type information stored in the hazard type information storage unit 42. The control unit 50 may further identify the items of the hazard information to be notified and the time interval for notification using the identification unit 52. The control unit 50 may use the identification unit 52 to identify the items of the hazard information to be notified and the time interval for notification for the received hazard information from the hazard type information stored in the hazard type information storage unit 42. For example, if the type of hazard information is "driving the wrong way on a highway," the control unit 50 identifies the notification area as "10km in the direction of travel of the vehicle driving the wrong way." For example, if the type of hazard information is "driving the wrong way on a highway," the control unit 50 identifies the items of the hazard information to be notified as "vehicle number, vehicle color, vehicle type" and the time interval as "every 30 seconds." The control unit 50 proceeds to step S23.

[0075] The control unit 50 notifies of danger information (step S23). More specifically, the control unit 50 controls the notification control unit 54 to notify the terminal device 10 of the target vehicle located within the notification area of ​​danger information based on the identification result of the identification unit 52. The control unit 50 controls the notification control unit 54 to notify the terminal device 10 of the target vehicle located "10 km in the direction of travel of the vehicle traveling in the wrong direction" if, for example, the type of danger information is "driving the wrong way on a highway". The control unit 50 proceeds to step S24.

[0076] The control unit 50 determines whether or not to make a notification (step S24). More specifically, the control unit 50 determines whether or not to notify emergency services based on the danger type information stored in the danger type information storage unit 42, using the notification determination unit 53. The control unit 50 then proceeds to step S25.

[0077] The control unit 50 notifies the emergency services (step S25). More specifically, if it is determined in step S24 to "notify", the control unit 50 controls the communication unit 41 via the notification control unit 55 to transmit notification information indicating a notification to the emergency services requesting their dispatch.

[0078] Other terminal devices 10 installed in target vehicles within the notification area receive hazard information (step S31). More specifically, the control unit 20 receives hazard information about the vehicle's surroundings from the server device 40 via the hazard information communication control unit 32. For example, if the type of hazard information is "driving the wrong way on a highway," the terminal device 10 of the target vehicle located "10 km in the direction of travel of the wrong-way vehicle" receives hazard information about the vehicle's surroundings from the server device 40 via the hazard information communication control unit 32. The control unit 20 then proceeds to step S32.

[0079] The control unit 20 notifies the danger information (step S32). More specifically, the control unit 20, via the display control unit 25, displays the danger information received from the server device 40 by the danger information communication control unit 32 on the display unit 13. The control unit 20, via the display control unit 25, displays the type and item of the danger information received from the server device 40 on the display unit 13 at time intervals. If the type of danger information is "driving the wrong way on a highway", the control unit 20, via the display control unit 25, displays information such as "vehicle number △□〇◇, blue "A (A is the vehicle type)" is driving the wrong way" on the display unit 13 at time intervals of "every 30 seconds".

[0080] <Effects> As described above, this embodiment can appropriately notify target vehicles within the notification area of ​​danger information via the server device 40 without requiring operation by the vehicle's occupants. According to this embodiment, for example, even if the vehicle in question is unable to transmit danger information, other passing vehicles can transmit danger information to the server device 40, and the target vehicle can be appropriately notified of the danger information. According to this embodiment, the amount of information transmitted can be reduced compared to when video data is transmitted, and danger information from multiple vehicles can be shared to appropriately notify of dangers.

[0081] According to this embodiment, for example, even if the occupants of the vehicle involved are unable to contact emergency services, other vehicles passing by can transmit danger information to the server device 40, and emergency services can be notified as needed.

[0082] In this embodiment, the items of the hazard information or the time interval for notifying the hazard information can be changed depending on the type of hazard information. This embodiment allows for the appropriate notification of hazard information.

[0083] In this embodiment, if the server device 40 determines that the content of multiple pieces of danger information received is the same, the notification area is identified again. According to this embodiment, the notification area can be appropriately identified.

[0084] In this embodiment, the server device 40 can notify emergency services according to the degree of danger of the danger information it receives. This embodiment enables appropriate notification to necessary emergency services.

[0085] In this embodiment, when danger information is received from the server device 40 and it is determined that the content of the danger information is the same as the danger information detected by the danger information detection unit 30 in the vehicle, the danger information detected by the vehicle can be sent to the server device 40 again. According to this embodiment, the latest danger information can always be sent from the terminal device 10 to the server device 40. According to this embodiment, the server device 40 can receive danger information from a larger number of terminal devices 10.

[0086] The hazard information notification system according to the present invention may be implemented in various different forms other than those described above.

[0087] The components of the illustrated hazard information notification system are functionally conceptual and do not necessarily have to be physically configured as shown. In other words, the specific form of each device is not limited to that shown in the illustration, and all or part of them may be functionally or physically dispersed or integrated in any unit depending on the processing load and usage of each device.

[0088] The configuration of the hazard information notification system is implemented, for example, as software, such as a program loaded into memory. In the above embodiment, these were described as functional blocks implemented through the cooperation of hardware or software. That is, these functional blocks can be implemented in various forms using hardware alone, software alone, or a combination thereof.

[0089] The above-described components include those that are easily conceivable by those skilled in the art, and those that are substantially identical. Furthermore, the above-described components can be combined as appropriate. In addition, various omissions, substitutions, or modifications of the components are possible without departing from the spirit of the present invention.

[0090] In the above, the video data captured by camera 11 may include audio data. The audio data may be processed using speech recognition to detect impact sounds such as accidents, human screams, etc.

[0091] In the above configuration, the terminal device 10 may further include a speaker and an audio output control unit. When the audio output control unit receives danger information from the server device 40 via the danger information communication control unit 32, it outputs an audio notification of the danger information through the speaker. The audio output control unit may change the volume of the notification according to the level of danger of the danger information received from the server device 40. For example, the audio output control unit may output a louder volume when the danger level is "high" compared to when it is "low".

[0092] If the event detection function of the drive recorder in terminal device 10 detects that one of several vehicles has been involved in an accident, the vehicle involved in the accident may request other nearby vehicles to send video data of the accident, along with information about the accident's risks, to server device 40. Server device 40 may then send the video data received from the other vehicles to the vehicle involved in the accident. By receiving the video data taken by the other vehicles, the vehicle involved in the accident can confirm the details of the accident, which may have been difficult to see from its own vehicle due to blind spots or other reasons.

[0093] This disclosure includes matters that contribute to achieving the SDG "Build resilient infrastructure, promote inclusive and sustainable industrialization and foster innovation" and to creating value through IoT solutions. [Explanation of symbols]

[0094] 1. Hazard Information Notification System 10 Terminal devices 11. Camera (Photography Department) 12 Records Section 13 Display section 14 GPS receiver 16 Recognition Dictionary Memory Unit 17 Communications Department 20 Control Unit 21 Video data acquisition unit 22 buffer memory 23 Video Data Processing Unit 24 Recording Control Unit 25 Display Control Unit 26 Location information acquisition section 30 Hazard Information Detection Unit 32. Danger Information Communication Control Unit 40 Server Devices 41 Communications Department 42 Hazard Classification Information Storage Unit 50 Control Unit 51 Danger Information Reception Control Unit 52 Specific part 53 Report Judgment Department 54 Notification Control Unit 55 Notification Control Unit

Claims

1. A video data acquisition unit that acquires video data captured around a moving object, A hazard information detection unit that detects hazard information and its type from the aforementioned video data, A hazard information communication control unit transmits the hazard information detected by the hazard information detection unit to a server device. A terminal device mounted on a mobile body having, A special unit that identifies a notification area to notify the danger information based on the type of danger information received from the terminal device, A notification control unit that controls the notification of the danger information to a target moving object located within the notification area, A server device having, Equipped with, When the hazard information communication control unit receives the hazard information notified from the server device and determines that the received hazard information is identical to the hazard information detected by the hazard information detection unit, it controls the unit to transmit the hazard information detected by the mobile device back to the server device. Danger information notification system.

2. The notification control unit controls the notification to change the items of the danger information or the time interval for notifying the danger information, depending on the type of danger information received. The hazard information notification system according to claim 1.

3. If the identification unit determines that the content of the multiple pieces of danger information received is the same, it will re-identify the notification area. A hazard information notification system according to claim 1 or 2.

4. The server device is A notification control unit that controls the notification to emergency services according to the degree of danger of the received danger information, A hazard information notification system according to any one of claims 1 to 3, comprising:

Images