Terminal device, danger information notification method and program

Abstract

To appropriately report danger or the like by sharing information of a plurality of vehicles while reducing the amount of information.SOLUTION: A terminal device 10 includes: a video data acquisition unit 21 that acquires video data obtained by photographing surroundings of a mobile body; a danger information detection unit 30 that detects danger information and its type from the video data; and a danger information communication control unit 32 that transmits the danger information detected by the danger information detection unit 30 to a server device 40 and receives danger information notified from the server device 40 when located within a notification area identified by the server device 40.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a terminal device, a danger information notification method, and a program. [Background technology]

[0002] There is known a technology that, when a notification is received from a vehicle, notifies other vehicles within a predetermined range from the location where the accident occurred (see, for example, Patent Document 1).There is also known a technology that, when a predetermined event occurs in one of multiple vehicles, notifies vehicles located within a transmission area of ​​the occurrence of the event based on the characteristic data of the vehicle and the location of the occurrence (see, for example, Patent Document 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-117005 [Patent Document 2] Patent No. 6546028 Summary of the Invention [Problem to be solved by the invention]

[0004] For example, when using a cloud service to share information from multiple vehicles and notify them of dangers, transmitting video data as is can result in an excessive amount of information. It is desirable to share information from multiple vehicles and notify them of dangers appropriately, even if the amount of information is reduced.

[0005] The present invention has been made in view of the above, and aims to reduce the amount of information and share information between multiple vehicles to appropriately notify of dangers and the like. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the objectives, the terminal device of the present invention comprises a video data acquisition unit that acquires video data captured around a moving body, a danger information detection unit that detects danger information and its type from the video data, and a danger information communication control unit that transmits the danger information detected by the danger information detection unit to a server device and receives danger information notified from the server device when the terminal device is located within a notification area identified by the server device.

[0007] The danger information notification method of the present invention includes a video data acquisition step of acquiring video data captured around a moving body, a danger information detection step of detecting danger information and its type from the video data, and a danger information communication control step of transmitting the danger information detected by the danger information detection step to a server device and receiving danger information notified from the server device when the moving body is located within a notification area identified by the server device.

[0008] The program of the present invention is executed by a computer operating as a terminal device, which executes the following steps: a video data acquisition step of acquiring video data of the area around a moving object; a danger information detection step of detecting danger information and its type from the video data; and a danger information communication control step of transmitting the danger information detected by the danger information detection step to a server device and receiving danger information notified from the server device when the moving object is located within a notification area specified by the server device. [Effects of the Invention]

[0009] According to the present invention, it is possible to reduce the amount of information and share information among a plurality of vehicles, thereby providing appropriate notification of dangers and the like. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram showing an example of the configuration of a danger information notification system according to an embodiment. [Figure 2] FIG. 2 is a block diagram illustrating an example of the configuration of a terminal device according to the embodiment. [Figure 3] FIG. 3 is a block diagram illustrating an example of the configuration of a server device according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of risk type information. [Figure 5] FIG. 5 is a diagram illustrating another example of the risk type information. [Figure 6] FIG. 6 is a sequence diagram showing the flow of processing in the danger information notification system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A terminal device, a danger information notification method, and a program according to the present invention will be described in detail below with reference to the accompanying drawings. Note that the present invention is not limited to the following embodiments.

[0012] [Embodiment] <Danger Information Notification System> 1 is a schematic diagram showing an example of the configuration of a danger information notification system 1 according to an embodiment. The danger information notification system 1 includes terminal devices 10 mounted on multiple moving objects, and a server device 40. The danger information notification system 1 notifies target moving objects within a notification area of ​​danger information from the server device 40 based on danger information transmitted from the multiple terminal devices 10 to the server device 40.

[0013] Hazard information is information about dangers occurring around roads. Hazard information is information about dangers that may affect mobile objects traveling on roads. Hazard information is information about dangers that mobile objects should be aware of when traveling on roads. Hazard information is information about dangers that require mobile objects to, for example, slow down, take a detour, stop, or pass through more carefully than in other places.

[0014] A moving body is a moving body that moves on a road. The moving body includes, for example, a vehicle and a pedestrian. In the following description, a vehicle will be described as an example of a moving body.

[0015] <Driving assistance devices> FIG. 2 is a block diagram showing an example of the configuration of a terminal device 10 according to an embodiment. The terminal device 10 detects danger information around the vehicle from video data captured while the vehicle is traveling and transmits the danger information to a server device 40. When the terminal device 10 receives danger information from the server device 40, it notifies the passenger of the danger information. In this embodiment, the terminal device 10 is a so-called drive recorder. The terminal device 10 may be installed in the vehicle or may be a portable device that can be used in the vehicle. The terminal device 10 includes a camera 11, a recording unit 12, a display unit 13, a GPS (Global Positioning System) receiving unit 14, which is an example of a GNSS (Global Navigation Satellite System), a recognition dictionary storage unit 16, a communication unit 17, and a control unit 20.

[0016] The camera 11 is a camera that captures the surroundings of the vehicle. The camera 11 captures at least the area in front of or behind the vehicle. In this embodiment, the camera 11 is two cameras arranged in the vehicle cabin to capture the front and rear of the vehicle. Each camera is an ultra-wide-angle camera capable of capturing approximately 178° horizontally and approximately 60° vertically, thereby capturing almost the entire periphery of the vehicle. However, this is not limited to this. For example, the camera 11 may be a camera with a fisheye lens capable of capturing 360° in all directions, or a group of multiple cameras capturing images in each direction. The camera 11 may also be a stereo camera suitable for measuring the distance to an object, as described below. The camera 11 continuously captures video from the time the engine is started until it is stopped, that is, while the vehicle is operating. In this embodiment, the camera 11 continuously captures video while the vehicle's accessory power is ON. The camera 11 outputs the captured video data to the video data acquisition unit 21 of the control unit 20. The video data is a moving image composed of, for example, 30 frames per second. The camera 11 is not limited to one mounted on a vehicle, but may be a fixed camera or a security camera installed near a road.

[0017] The recording unit 12 is used for temporary storage of data in the terminal device 10. The recording unit 12 is, for example, a semiconductor memory element such as RAM (Random Access Memory) or flash memory, or a recording unit such as a memory card. Alternatively, the recording unit 12 may be an external recording unit wirelessly connected via a communication device (not shown). The recording unit 12 records the loop record data based on a control signal output from the recording control unit 24 of the control unit 20.

[0018] The display unit 13 is, for example, a display device specific to the terminal device 10, or a display device shared with other systems including a navigation system. The display unit 13 is, for example, a display including a liquid crystal display (LCD) or an organic electro-luminescence (EL) display. The display unit 13 displays an image based on a video signal output from the display control unit 25 of the control unit 20. The display unit 13 displays an image captured by the camera 11 or an image recorded in the recording unit 12. The display unit 13 displays information to notify the driver of the vehicle that a nearby vehicle is driving recklessly.

[0019] The GPS receiver 14 receives radio waves from a GPS satellite (not shown) and outputs the received radio wave signal to the position information acquisition unit 26 of the control unit 20.

[0020] The recognition dictionary storage unit 16 stores a recognition dictionary for danger information and types of danger information. The recognition dictionary storage unit 16 may be a storage device such as an external server that acquires the recognition dictionary via the communication unit 17.

[0021] The types of danger information include, for example, collision accidents, hit-and-run accidents, tailgating, wrong-way driving on highways, fires, landslides, landslides and civil engineering road closures, ground collapses, tsunamis caused by earthquakes, frozen roads, snow accumulations and flooding, and large-scale power outages.

[0022] The communication unit 17 is a communication unit. The communication unit 17 may perform communication via any method, such as the Internet or a mobile phone line. The communication unit 17 communicates data with the server device 40.

[0023] The control unit 20 is an arithmetic processing unit (control device) configured with, for example, a CPU (Central Processing Unit). The control unit 20 loads a stored program into memory and executes instructions included in the program. The control unit 20 includes an internal memory (not shown) that is used for temporary storage of data in the control unit 20, etc. The control unit 20 has a video data acquisition unit 21, a buffer memory 22, a video data processing unit 23, a recording control unit 24, a display control unit 25, a position information acquisition unit 26, a danger information detection unit 30, and a danger information communication control unit 32, which are connected to the bus 20X.

[0024] The video data acquisition unit 21 acquires video data of the surroundings of the vehicle. The video data acquisition unit 21 acquires video data of the surroundings that are captured while the vehicle is traveling. More specifically, the video data acquisition unit 21 acquires the video data output by the camera 11 and outputs it to the buffer memory 22.

[0025] The buffer memory 22 is an internal memory provided in the control unit 20, and is a memory that temporarily records, while updating, video data for a certain period of time acquired by the video data acquisition unit 21.

[0026] The video data processing unit 23 encodes the video data temporarily stored in the buffer memory 22 using an arbitrary codec, such as H.264 or MPEG-4 (Moving Picture Experts Group), and converts the encoded data together with audio data into an arbitrary file format, such as MP4. The video data processing unit 23 generates video data files for a certain period of time from the video data temporarily stored in the buffer memory 22. As a specific example, the video data processing unit 23 generates 60 seconds of video data as one file in the order of recording from the video data temporarily stored in the buffer memory 22. The video data processing unit 23 outputs the generated video data to the recording control unit 24. The video data processing unit 23 also outputs the generated video data to the display control unit 25. The period of the video data generated as a file is set to 60 seconds as an example, but is not limited to this.

[0027] The recording control unit 24 controls the recording unit 12 to record the video data filed by the video data processing unit 23. During the period when loop recording processing is being performed, such as when the vehicle accessory power is ON, the recording control unit 24 records the video data filed by the video data processing unit 23 as overwritable video data in the recording unit 12. More specifically, during the period when loop recording processing is being performed, the recording control unit 24 continues to record the video data generated by the video data processing unit 23 in the recording unit 12, and when the capacity of the recording unit 12 becomes full, it overwrites the oldest video data with new video data.

[0028] The recording control unit 24 may cause the video data captured when danger information is detected by the danger information detection unit 30 to be recorded in the recording unit 12 in a manner that prohibits overwriting.

[0029] The display control unit 25 controls the display of the video data on the display unit 13. The display control unit 25 outputs a video signal that causes the video data to be output to the display unit 13. More specifically, the display control unit 25 causes the display unit 13 to display the video being captured by the camera 11.

[0030] When danger information communication control section 32 receives danger information from server device 40, display control section 25 causes display section 13 to display the danger information.

[0031] The display control unit 25 may change the display mode depending on the level of danger of the danger information received from the server device 40. For example, when the level of danger is "high," the display control unit 25 displays the information in a more noticeable mode so that the passenger can easily check it, compared to when the level of danger is "low."

[0032] The position information acquisition unit 26 calculates the current position information of the vehicle by a known method based on the radio waves received by the GPS receiving unit 14. The position information calculated by the position information acquisition unit 26 may be stored together with the video data.

[0033] The danger information detection unit 30 detects danger information and its type from the video data acquired by the video data acquisition unit 21. More specifically, the danger information detection unit 30 detects danger information and its type from the video data captured by the camera 11, for example, using a recognition dictionary stored in the recognition dictionary storage unit 16. The danger information detection unit 30 uses the recognition dictionary to detect, for example, collision accidents, hit-and-run accidents, tailgating, wrong-way driving on highways, fires, landslides, landslides and civil engineering road closures, ground collapses, tsunamis caused by earthquakes, frozen roads, snow accumulations, flooding, and large-scale outages from the captured video data. The method of detecting danger information and its type from the video data is not limited to using a recognition dictionary, and known methods can be used. The danger information detection unit 30 detects danger information and its type from accidents and disasters encountered by the vehicle while passing by, as well as accidents and disasters in which the vehicle is involved.

[0034] The danger information detection unit 30 may detect various items of the detected danger information according to the type of danger information. For example, if the type of danger information is a "collision accident," the danger information detection unit 30 detects "scale of the accident" as an item of danger information. The scale of the accident is detected by, for example, performing image processing on the video data to determine whether the accident is a self-inflicted accident, a property damage accident, a multiple accident, or a personal injury accident. The scale of the accident is detected by, for example, performing image processing on the video data to determine whether an emergency vehicle is dispatched or whether lanes are restricted. For example, if the type of danger information is a "collision accident," the danger information detection unit 30 may further detect "presence or absence of injured persons" as an item of danger information. The presence or absence of injured persons is detected by performing image processing on the video data.

[0035] For example, when the type of danger information is "hit-and-run accident," the danger information detection unit 30 detects "scale of the accident, vehicle license plate number, vehicle color, and vehicle model" as items of danger information. For example, when the type of danger information is "hit-and-run accident," the danger information detection unit 30 may further detect "presence or absence of injured persons" as an item of danger information. The vehicle license plate number, vehicle color, and vehicle model are detected by performing image processing on the video data.

[0036] For example, when the type of danger information is "tailgating," the danger information detection unit 30 detects "vehicle number, vehicle color, and vehicle model" as items of danger information. For example, when the type of danger information is "tailgating," the danger information detection unit 30 may further detect "whether or not there is a passenger trouble" as an item of danger information. Passenger trouble is, for example, a state in which a passenger in one vehicle gets off the vehicle and approaches the other vehicle. The presence or absence of passenger trouble is detected by performing image processing on the video data.

[0037] For example, when the type of danger information is "wrong way driving on an expressway," the danger information detection unit 30 detects "vehicle license plate number, vehicle color, and vehicle model" as items of danger information. For example, when the type of danger information is "wrong way driving on an expressway," the danger information detection unit 30 may further detect "the name of the expressway where the wrong way driving occurred, the name of the toll gate, and the name of the entrance / exit" as items of danger information. The name of the expressway, the name of the toll gate, and the name of the entrance / exit are detected from the video data or the vehicle's position information and map information.

[0038] For example, when the type of danger information is "fire," the danger information detection unit 30 detects the "scale of the disaster," "area where the disaster occurred," and "whether or not there are any injured people" as items of danger information. The scale of the disaster is detected by, for example, applying image processing to video data to determine the size of the area where flames or smoke are recognized, the number of buildings, and whether or not the fire has spread. The area where the disaster occurred is detected by applying image processing to video data to determine the range where flames or smoke are recognized. Then, based on map information (not shown), the area where the disaster occurred where the fire was detected is identified. The presence or absence of injured people is detected by applying image processing to the video data.

[0039] For example, when the type of danger information is "landslide," the danger information detection unit 30 detects "scale of the disaster, whether the current location is in a designated area at the time of the disaster" as an item of danger information. The scale of the disaster is detected, for example, by performing image processing on video data to determine the size of the area in which the landslide is recognized. Whether the current location is in a designated area at the time of the disaster is detected, for example, by checking whether the current location is registered as a designated area for landslides in map information stored in a map information storage unit (not shown).

[0040] For example, when the type of danger information is "landslide / civil engineering road closure," the danger information detection unit 30 detects "scale of disaster" as an item of danger information. The scale of the disaster is detected by, for example, performing image processing on video data to determine the size of the area recognized as the range in which roads are closed due to landslide / civil engineering.

[0041] For example, when the type of danger information is "ground collapse," the danger information detection unit 30 detects "scale of disaster" as an item of danger information. The scale of the disaster is detected, for example, by performing image processing on the video data to determine the size of the area recognized as the range of the ground collapse.

[0042] For example, when the type of danger information is "tsunami caused by earthquake," the danger information detection unit 30 detects "scale of the disaster, whether the current location is in a designated disaster area?" as a danger information item. The scale of the disaster is recognized, for example, from the seismic intensity of the earthquake or tsunami information acquired from an external device. Whether the current location is in a designated disaster area is detected, for example, by whether the current location is registered as a designated disaster area in map information stored in a map information storage unit (not shown).

[0043] For example, when the type of danger information is "frozen roads, snow, and flooding," the danger information detection unit 30 detects "scale of the disaster, whether the current location is in a designated disaster area?" as an item of danger information. The scale of the disaster is recognized, for example, from information on frozen roads, snow, and flooding acquired from an external device. Whether the current location is in a designated disaster area is detected, for example, by whether the current location is registered as a designated disaster area in map information stored in a map information storage unit (not shown).

[0044] For example, when the type of danger information is "large-scale power outage," the danger information detection unit 30 detects "scale of disaster" as an item of danger information. The scale of the disaster is recognized from, for example, information on a power outage area map acquired from an external device.

[0045] The danger information detection unit 30 may further detect a danger level for the detected danger information. More specifically, the danger information detection unit 30 may detect the danger level from various items of the detected danger information, such as "scale of the accident" and "presence or absence of injuries." For example, if the "scale of the accident" is equal to or greater than a predetermined range, the danger level is set to "high." For example, if "there are injuries," the danger level is set to "high." For example, if the type of danger information is "wrong-way driving on an expressway," the danger level is set to "high." For example, if the type of danger information is "tailgating" and "occupant trouble," the danger level is set to "high."

[0046] The danger information communication control unit 32 communicates danger information detected by the danger information detection unit 30 with the server device 40. The danger information communication control unit 32 transmits the danger information detected by the danger information detection unit 30 to the server device 40. The danger information to be transmitted includes information indicating the degree of danger, the location where the danger information occurred, and the date and time of occurrence.

[0047] The danger information communication control unit 32 receives danger information about the vicinity of the vehicle from the server device 40. The danger information communication control unit 32 transmits danger information detected by the danger information detection unit 30 to the server device 40, and receives danger information notified from the server device 30 when the terminal device 10 is located within a notification area specified by the server device 30. In this embodiment, when the danger information communication control unit 32 receives danger information notified from the server device 40 and determines that the content of the danger information is identical to the content of the danger information detected by the danger information detection unit 30 in the vehicle, the danger information communication control unit 32 may perform control so that the danger information detected in the vehicle is again transmitted to the server device 40. This ensures that the latest danger information is always transmitted from the terminal device 10 to the server device 40.

[0048] The content of the danger information being the same means that the danger information notified from the server device 40 and the danger information detected by the danger information detection unit 30 in the vehicle satisfy the following conditions: the type of danger information is the same, the difference in the locations where the two pieces of danger information occurred is within a predetermined distance, and the difference in the dates and times of occurrence is within a predetermined time.

[0049] <Server device> 3 is a block diagram showing an example of the configuration of the server device 40 according to the embodiment. The server device 40 includes a communication unit 41, a risk type information storage unit 42, and a control unit 50.

[0050] The communication unit 41 is a communication unit. The communication unit 41 may perform communication via any method, such as the Internet or a mobile phone line. The communication unit 41 communicates data with the terminal devices 10 installed in multiple vehicles.

[0051] The risk type information storage unit 42 stores risk type information. The risk type information storage unit 42 may be a storage device such as an external server that acquires risk type information via the communication unit 41.

[0052] The danger type information is information related to the notification of danger information for each type of danger information. In this embodiment, the danger type information is information including, for each type of danger information, for example, a danger information notification area, an item of danger information to be notified, and a time interval for notification. The danger information notification area is the area in which danger information is notified. The danger information item to be notified is the item to be notified. The time interval for notification is the time interval at which notification is made.

[0053] FIG. 4 is a diagram illustrating an example of danger type information. In the example shown in FIG. 4, for the danger information type "collision accident," the notification area is "1 km radius from the scene," the item of danger information to be notified is "scale of the accident," and the notification time interval is "every 5 minutes." For the danger information type "hit-and-run accident," the notification area is "5 km in the direction of travel of the target vehicle," the items of danger information to be notified are "scale of the accident, vehicle license plate number, vehicle color, and vehicle model," and the notification time interval is "every minute." For the danger information type "tailgating," the notification area is "5 km in the direction of travel of the target vehicle," the items of danger information to be notified are "vehicle license plate number, vehicle color, and vehicle model," and the notification time interval is "every minute." For the danger information type "wrong-way driving on the highway," the notification area is "10 km in the direction of travel of the wrong-way vehicle," the items of danger information to be notified are "vehicle license plate number, vehicle color, and vehicle model," and the notification time interval is "every 30 seconds." For the "fire" type of hazard information, the notification area is "1 km radius from the site," the hazard information items to be notified are "scale of the disaster, area of ​​the disaster occurrence," and the notification interval is "every 10 minutes." For the "landslide" type of hazard information, the notification area is "5 km radius from the site," the hazard information items to be notified are "scale of the disaster, is the current location in a designated disaster area?" and the notification interval is "every 30 seconds." For the "landslide / civil engineering road closure" type of hazard information, the notification area is "1 km radius from the site," the hazard information items to be notified are "scale of the disaster," and the notification interval is "every 10 minutes." For the "ground collapse" type of hazard information, the notification area is "1 km radius from the site," the hazard information items to be notified are "scale of the disaster," and the notification interval is "every 5 minutes." For the type of danger information "tsunami caused by earthquake," the notification area is "5km radius from the site," the danger information items to be notified are "scale of the disaster, is the current location in a designated disaster area?", and the notification interval is "every 30 seconds." For the type of danger information "frozen roads, snow accumulation, and flooding," the notification area is "1km radius from the site," the danger information items to be notified are "scale of the disaster, is the current location in a designated disaster area?", and the notification interval is "every 10 minutes." For the type of danger information "large-scale power outage," the notification area is "1km radius from the site," the danger information items to be notified are "scale of the disaster," and the notification interval is "every 10 minutes."

[0054] The danger type information may further include information indicating whether an emergency call is required for each type of danger information. In the present embodiment, the danger type information may include information indicating whether an emergency call is required for each type and level of danger information.

[0055] The risk level indicates the magnitude of the impact on the surroundings for each risk type. In this embodiment, the risk level indicates the magnitude of the impact on vehicles traveling on the road. The risk level is indicated, for example, as "high" or "low." A "high" risk level is, for example, a level at which traveling on the road is hindered. A "high" risk level is, for example, a level at which an emergency service needs to be notified. A "low" risk level is, for example, a level at which caution is required when traveling on the road. A "low" risk level is, for example, a level at which an emergency service does not need to be notified.

[0056] An emergency organization is an organization to which a call should be made in the event of an emergency. Examples of emergency organizations include police organizations and organizations that handle emergency calls.

[0057] FIG. 5 is a diagram illustrating another example of danger type information. In the example shown in FIG. 5, information including the notification area of ​​the danger information, the items of danger information to be notified, the notification time interval, and whether or not an emergency call is required is specified for each danger level of the type of danger information. For the danger information type "tailgating" and the danger level "high," the notification area is "5 km in the direction of travel of the target vehicle," the items of danger information to be notified are "vehicle number, vehicle color, and model," the notification time interval is "every minute," and the emergency call is "to be notified." For the danger information type "tailgating" and the danger level "low," the notification area is "3 km in the direction of travel of the target vehicle," the items of danger information to be notified are "vehicle number, vehicle color, and model," the notification time interval is "every minute," and the emergency call is "not to be notified."

[0058] The control unit 50 is an arithmetic processing unit configured, for example, with a CPU. The control unit 50 loads a stored program into memory and executes instructions included in the program. The control unit 50 includes an internal memory (not shown) that is used for temporary storage of data in the server device 40. The control unit 50 has a danger information reception control unit 51, an identification unit 52, a report determination unit 53, a notification control unit 54, and a report control unit 55. The report determination unit 53 and the report control unit 55 are not essential components.

[0059] The danger information reception control unit 51 controls the communication unit 41 to receive danger information from the terminal devices 10 mounted on a plurality of vehicles.

[0060] The identification unit 52 identifies a notification area to which the danger information is to be notified according to the type of danger information, based on the danger information received from the terminal device 10. The identification unit 52 identifies a notification area to which the received danger information is to be notified, based on the danger type information stored in the danger type information storage unit 42. For example, when the type of danger information is "wrong way driving on an expressway," the identification unit 52 identifies the notification area as "10 km in the wrong direction of a vehicle traveling."

[0061] The specifying unit 52 may specify a notification area to notify in accordance with the level of danger of the received danger information. For example, the specifying unit 52 may specify a larger notification area when the level of danger is "high" than when the level of danger is "low."

[0062] In the present embodiment, the specifying unit 52 may further specify the items of danger information to be notified and the time interval for notification. The specifying unit 52 may specify the items of danger information to be notified and the time interval for notification for the received danger information from the danger type information stored in the danger type information storage unit 42.

[0063] In this embodiment, when it is determined that the contents of the multiple pieces of danger information received are the same, the identification unit 52 re-identifies the notification area. For example, the identification unit 52 may re-identify the notification area based on the latest danger information. For example, the identification unit 52 may re-identify the notification area based on the average value of the occurrence locations included in the multiple pieces of danger information. The average value of the occurrence locations is, for example, the average value of the map coordinate values ​​of each occurrence location. For example, the identification unit 52 may re-identify the notification area by widening it as the number of pieces of danger information received increases.

[0064] The content of multiple pieces of danger information is the same if the received pieces of danger information satisfy the following conditions: the types of danger information are the same, the difference in the locations where the pieces of danger information occurred is within a predetermined distance, and the difference in the dates and times of occurrence is within a predetermined time.

[0065] The notification determination unit 53 determines whether to notify an emergency agency based on the level of danger of the danger information received from the terminal device 10. In this embodiment, the notification determination unit 53 determines whether to notify an emergency agency based on the danger type information stored in the danger type information storage unit 42. If the level of danger is "high," the notification determination unit 53 determines whether to notify an emergency agency. If the notification determination unit 53 has already notified an emergency agency about danger information with the same content, the notification determination unit 53 does not make a duplicate notification.

[0066] The notification determination unit 53 may determine to notify an emergency organization when the danger information received from the terminal device 10 includes information indicating that "someone is injured" and "no emergency vehicle will be dispatched."

[0067] The notification control unit 54 controls to notify the danger information to the target vehicle located within the notification area. More specifically, the notification control unit 54 controls to notify the danger information to the terminal device 10 of the target vehicle located within the notification area based on the identification result of the identification unit 52.

[0068] In this embodiment, the notification control unit 54 controls the notification so that the items of danger information or the time interval for notifying danger information are changed according to the type of danger information received. More specifically, the notification control unit 54 controls the notification so that the items of danger information or the time interval for notifying danger information are changed based on the identification result of the identification unit 52.

[0069] The notification control unit 55 controls to notify an emergency agency according to the danger level of the danger information received from the terminal device 10. More specifically, when the notification determination unit 53 determines to "notify," the notification control unit 55 controls to notify an emergency agency. The notification control unit 55 controls the communication unit 41 to transmit notification information indicating a notification accompanied by a dispatch request to an emergency agency. The notification information includes information identifying the vehicle, information on the current location of the vehicle, and information indicating the dispatch request.

[0070] <Processing in the danger information notification system> Next, information processing in the danger information notification system 1 will be described with reference to Fig. 6. Fig. 6 is a sequence diagram showing the flow of processing in the danger information notification system 1 according to the embodiment. The terminal device 10 mounted on each vehicle is activated while the vehicle is activated. While the terminal device 10 is activated, the camera 11 constantly takes photographs.

[0071] First, the control unit 20 of the terminal device 10 installed in the vehicle acquires vehicle position information (step S11). More specifically, the control unit 20 causes the position information acquisition unit 26 to calculate the current position information of the vehicle using a known method based on the radio waves received by the GPS receiver 14. The control unit 20 proceeds to step S12.

[0072] The control unit 20 acquires video data (step S12). More specifically, the control unit 20 acquires video data of the area around the vehicle captured by the camera 11 using the video data acquisition unit 21. The control unit 20 proceeds to step S13.

[0073] The control unit 20 detects danger information (step S13). More specifically, the control unit 20 detects danger information and its type from the video data captured by the camera 11 using the recognition dictionary stored in the recognition dictionary storage unit 16, using the danger information detection unit 30. The control unit 20 detects various items corresponding to the type of danger information for the detected danger information using the danger information detection unit 30. The control unit 20 detects the degree of danger for the detected danger information using the danger information detection unit 30. The control unit 20 proceeds to step S14.

[0074] The control unit 20 transmits the danger information (step S14). More specifically, the control unit 20 causes the danger information communication control unit 32 to transmit the danger information detected by the danger information detection unit 30 to the server device 40. The danger information transmitted in step S14 includes information indicating the degree of danger, the location where the danger information occurred, and the date and time of occurrence.

[0075] The control unit 50 of the server device 40 receives the danger information (step S21). More specifically, the control unit 50 receives the danger information from the terminal device 10 mounted on the vehicle via the danger information reception control unit 51. The control unit 50 proceeds to step S22.

[0076] The control unit 50 specifies a notification area for notifying the danger information (step S22). More specifically, the control unit 50 specifies a notification area for notifying the received danger information from the danger type information stored in the danger type information storage unit 42 using the specification unit 52. The control unit 50 may further specify, using the specification unit 52, the items of danger information to be notified and the time interval for notification. The control unit 50 may specify, using the specification unit 52, the items of danger information to be notified and the time interval for notification for the received danger information from the danger type information stored in the danger type information storage unit 42. For example, if the type of danger information is "wrong way driving on an expressway," the control unit 50 specifies, using the specification unit 52, the notification area as "vehicle number, vehicle color, and model" and the time interval as "every 30 seconds" for the items of danger information to be notified. The control unit 50 proceeds to step S23.

[0077] The control unit 50 notifies the danger information (step S23). More specifically, the control unit 50 controls the notification control unit 54 to notify the danger information to the terminal device 10 of the target vehicle located within the notification area based on the identification result of the identification unit 52. For example, if the type of danger information is "wrong way driving on expressway," the control unit 50 controls the notification control unit 54 to notify the danger information to the terminal device 10 of the target vehicle located "10 km in the wrong direction of the vehicle." The control unit 50 proceeds to step S24.

[0078] The control unit 50 determines whether or not a report is required (step S24). More specifically, the control unit 50 determines whether or not to report to an emergency organization using the report determination unit 53 based on the hazard type information stored in the hazard type information storage unit 42. The control unit 50 proceeds to step S25.

[0079] The control unit 50 notifies the emergency organization (step S25). More specifically, if it is determined in step S24 that "notification should be made," the control unit 50 controls the communication unit 41 by the notification control unit 55 to transmit notification information indicating a notification accompanied by a dispatch request to the emergency organization.

[0080] The other terminal device 10 mounted on a target vehicle that is a target vehicle within the notification area receives the danger information (step S31). More specifically, the control unit 20 receives danger information about the vicinity of the vehicle from the server device 40 via the danger information communication control unit 32. For example, if the type of danger information is "wrong way driving on an expressway," the terminal device 10 of the target vehicle located "10 km in the wrong direction of a vehicle traveling" receives danger information about the vicinity of the vehicle from the server device 40 via the danger information communication control unit 32. The control unit 20 proceeds to step S32.

[0081] The control unit 20 notifies the user of the danger information (step S32). More specifically, the control unit 20 causes the display control unit 25 to display the danger information received from the server device 40 by the danger information communication control unit 32 on the display unit 13. The control unit 20 causes the display control unit 25 to display the type of danger information and the items of the danger information received from the server device 40 on the display unit 13 at time intervals. If the type of danger information is "wrong way driving on an expressway," the control unit 20 causes the display control unit 25 to display information such as "A vehicle with license plate number △□〇◇, in blue "A" (A is the model name) is driving the wrong way" on the display unit 13 at time intervals of "every 30 seconds."

[0082] <Effects> As described above, this embodiment can appropriately notify target vehicles within a notification area of ​​danger information via server device 40 without requiring any operation by the vehicle occupants. According to this embodiment, even if the vehicle of the person in question cannot transmit danger information, other passing vehicles can transmit danger information to server device 40, and the target vehicle can be appropriately notified of the danger information. According to this embodiment, the amount of information can be reduced compared to when video data is communicated, and danger information from multiple vehicles can be shared to appropriately notify of danger, etc.

[0083] According to this embodiment, even if the passengers of the vehicle involved are unable to notify emergency services, danger information can be transmitted from another vehicle passing by to the server device 40, and emergency services can be notified as necessary.

[0084] In this embodiment, the items of danger information or the time interval for notifying danger information can be changed depending on the type of danger information. This embodiment can appropriately notify danger information.

[0085] In this embodiment, the notification area is specified again when it is determined that the contents of multiple pieces of danger information received by server device 40 are the same. According to this embodiment, the notification area can be specified appropriately.

[0086] In this embodiment, it is possible to notify emergency organizations in accordance with the degree of danger of danger information received by server device 40. In this embodiment, it is possible to appropriately notify emergency organizations as needed.

[0087] In this embodiment, when danger information notified from the server device 40 is received and it is determined that the content of the danger information is identical to the content of the danger information detected by the danger information detection unit 30 in the vehicle, the danger information detected in the vehicle can be transmitted again to the server device 40. According to this embodiment, the latest danger information can always be transmitted from the terminal device 10 to the server device 40. According to this embodiment, the server device 40 can receive danger information from a larger number of terminal devices 10.

[0088] The danger information notification system according to the present invention may be implemented in various different forms other than the above-described embodiment.

[0089] The components of the danger information notification system shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of each device is not limited to that shown in the figure, and all or part of them may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device.

[0090] The configuration of the danger information notification system is realized, for example, as software, by a program loaded into memory. In the above embodiment, the system has been described as a functional block realized by the cooperation of these hardware and software. In other words, these functional blocks can be realized in various forms, using only hardware, only software, or a combination of both.

[0091] The above-described components include those that can be easily imagined by a person skilled in the art and those that are substantially the same. Furthermore, the above-described configurations can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the configurations are possible within the scope of the gist of the present invention.

[0092] In the above, the video data captured by the camera 11 may include audio data. The audio data may be subjected to audio recognition processing to detect impact sounds such as accident sounds, people screaming, and the like.

[0093] In the above, the terminal device 10 may further include a speaker and an audio output control unit. When the danger information communication control unit 32 receives danger information from the server device 40, the audio output control unit causes the speaker to output audio notifying the danger information. The audio output control unit may notify the danger information by changing the volume according to the danger level of the danger information received from the server device 40. For example, the audio output control unit outputs the audio at a louder volume when the danger level is "high" than when the danger level is "low."

[0094] When the event detection function of the drive recorder included in the terminal device 10 detects that one of the multiple vehicles has been involved in an accident, the vehicle involved in the accident may request other vehicles in the vicinity to transmit video data of the accident along with danger information about the accident to the server device 40. The server device 40 may transmit the video data received from the other vehicles to the vehicle involved in the accident. By receiving the video data captured by the other vehicles, the vehicle involved in the accident can check the situation of the accident, which is difficult to see because it is in a blind spot from the vehicle itself.

[0095] This disclosure will contribute to the realization of the SDG "Build resilient infrastructure, promote inclusive and sustainable industrialization, and foster innovation," and includes matters that contribute to value creation through IoT solutions. [Explanation of symbols]

[0096] 1. Hazard Information Notification System 10 Terminal Equipment 11 Camera (photography section) 12 Recording section 13 Display section 14 GPS receiver 16 Recognition dictionary storage unit 17 Communications Department 20 Control Unit 21 Video data acquisition unit 22 Buffer Memory 23 Video data processing section 24 Recording control section 25 Display control unit 26 Location information acquisition section 30 Danger information detection unit 32 Danger Information Communication Control Unit 40 Server device 41 Communications Department 42 Hazard type information storage unit 50 control section 51 Danger information reception control unit 52 Specific part 53 Report Judgment Department 54 Notification control section 55 Reporting control section

Claims

1. a video data acquisition unit that acquires video data captured around the moving object; a danger information detection unit that detects danger information and its type from the video data; a danger information communication control unit that transmits the danger information detected by the danger information detection unit to a server device, and receives danger information notified from the server device when the device is located within a notification area specified by the server device; Equipped with The danger information communication control unit is a terminal device that, when it receives the danger information notified from the server device and determines that the content of the danger information is identical to the content of the danger information detected by the danger information detection unit in the mobile body, controls the terminal device to again send the danger information detected in the mobile body to the server device.

2. a video data acquisition step of acquiring video data of the periphery of the moving object; a danger information detection step of detecting danger information and its type from the video data; a danger information communication control step of transmitting the danger information detected by the danger information detection step to a server device, and receiving danger information notified from the server device when the vehicle is located within a notification area specified by the server device; a step of transmitting the danger information detected by the mobile body to the server device again when the danger information notified from the server device is received and when it is determined that the content of the danger information is identical to that detected by the mobile body in the danger information detection step; A method for notifying danger information, including:

3. a video data acquisition step of acquiring video data of the periphery of the moving object; a danger information detection step of detecting danger information and its type from the video data; a danger information communication control step of transmitting the danger information detected by the danger information detection step to a server device, and receiving danger information notified from the server device when the vehicle is located within a notification area specified by the server device; a step of transmitting the danger information detected by the mobile body to the server device again when the danger information notified from the server device is received and when it is determined that the content of the danger information is identical to that detected by the mobile body in the danger information detection step; A program executed by a computer operating as a terminal device.

Images