Terminal device, risk information report method and program

Abstract

To share information on a plurality of vehicles and properly report the risk, etc., while suppressing an information quantity.SOLUTION: A terminal device 10 comprises: a video data acquisition section 21 which acquires video data obtained by imaging a periphery of a moving body; a risk information detection section 30 which detects risk information and the kind of the risk information from the video data; and a risk information communication control section 32 by which the risk information which is detected by the risk information detection section 30 is transmitted to a server device 40 and, in a case where the moving body is positioned within a report area which is identified by the server device 40, risk information reported from the server device 40 is received.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a terminal device, a danger information notification method, and a program. [Background technology]

[0002] When a notification is received from a vehicle, the accident is reported to other vehicles within a specified range from the accident location. A technology for notifying an occurrence of an accident is known (see, for example, Patent Document 1). When a predetermined event occurs, the vehicle located in the transmission area is notified based on the vehicle's characteristic data and the location of the event. There is known a technique for informing a vehicle in the vicinity of an occurrence of an event (see, for example, Patent Document 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-117005 [Patent Document 2] Patent No. 6546028 Summary of the Invention [Problem to be solved by the invention]

[0004] For example, by using cloud services, information from multiple vehicles can be shared and used to communicate dangers. When transmitting video data as is, the amount of information may become excessive. Even if this is suppressed, it is desirable to share information between multiple vehicles and properly notify them of dangers, etc.

[0005] The present invention has been made in view of the above, and provides a method for reducing the amount of information and providing information on a plurality of vehicles. The purpose is to share information and properly notify people of dangers, etc. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the object, a terminal device according to the present invention is a video data acquisition unit that acquires video data of a surrounding area; and a danger information detection unit that detects the type of danger; The information is transmitted to a server device, and the server device detects a location within a notification area. and a danger information communication control unit that receives danger information notified from the server device in such a case. can.

[0007] The danger information notification method according to the present invention is a method for acquiring video data of the periphery of a moving object. a data acquisition step; and a danger information detection step for detecting danger information and its type from the video data. a step of transmitting the danger information detected by the danger information detection step to a server device When the device is located within a notification area specified by the server device, the server and a danger information communication control step of receiving danger information notified from the device.

[0008] The program according to the present invention is a video data acquisition program for acquiring video data of the periphery of a moving object. an acquisition step; and a danger information detection step of detecting danger information and its type from the video data. and transmitting the danger information detected by the danger information detection step to a server device. When the device is located within a notification area specified by the server device, a danger information communication control step of receiving danger information notified from the It is executed by a computer. [Effects of the Invention]

[0009] According to the present invention, the amount of information is reduced, and information on dangers and the like is appropriately communicated by sharing information between multiple vehicles. This has the effect of allowing users to know the details. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram showing an example of the configuration of a danger information notification system according to an embodiment. [Figure 2] FIG. 2 is a block diagram illustrating an example of the configuration of a terminal device according to the embodiment. [Figure 3] FIG. 3 is a block diagram illustrating an example of the configuration of a server device according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of risk type information. [Figure 5] FIG. 5 is a diagram illustrating another example of the risk type information. [Figure 6] FIG. 6 is a sequence diagram showing the flow of processing in the danger information notification system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] The terminal device, danger information notification method and program according to the present invention will be described below with reference to the accompanying drawings. The following embodiments will be described in detail. Note that the present invention is not limited to the following embodiments. There is no. [Embodiment] <Danger Information Notification System> FIG. 1 is a schematic diagram showing an example of the configuration of a danger information notification system 1 according to an embodiment. The notification system 1 includes terminal devices 10 mounted on a plurality of mobile objects and a server device 40. The danger information notification system 1 receives information transmitted from a plurality of terminal devices 10 to a server device 40. Based on the danger information, the server device 40 notifies the target moving body within the notification area of ​​the danger information. do.

[0012] Hazard information is information about dangers that occur around the road. This is information about dangers that may affect vehicles traveling on the road. This is information about dangers that a mobile object should be aware of when traveling on a road. For example, slowing down, detouring, stopping, or driving more carefully than in other places This is information about the dangers that need to be addressed.

[0013] A moving object is an object that moves on a road. The moving object includes, for example, a vehicle and a pedestrian. In the following description, a vehicle will be described as an example of a moving object. <Driving assistance devices> FIG. 2 is a block diagram showing an example of the configuration of the terminal device 10 according to the embodiment. detects danger information around the vehicle from video data captured while the vehicle is traveling and provides the danger information to the server device 40. The terminal device 10 receives the danger information from the server device 40. In this embodiment, the terminal device 10 notifies the passenger of danger information. The terminal device 10 is a portable type that is installed in a vehicle, or a vehicle-mounted type. The terminal device 10 may be a device that can be used in the , a display unit 13, and a GNSS (Global Navigation Satellite GPS (Global Positioning System) is an example of a The system includes a receiving unit 14, a recognition dictionary storage unit 16, a communication unit 17, and a control unit 20. .

[0014] The camera 11 is a camera that captures the surroundings of the vehicle. In this embodiment, the camera 11 is disposed in the passenger compartment of the vehicle. There are two cameras that capture the front and rear, each with a horizontal angle of about 178° and a vertical angle of about 178°. By using an ultra-wide-angle camera that can capture images at a downward angle of approximately 60°, the entire perimeter of the vehicle can be captured. However, the present invention is not limited to this, and may be applied to, for example, a camera that can take 360° omnidirectional images. A camera with a fisheye lens that can capture images in different directions, or multiple cameras that capture images in different directions. It may also be configured with a stereo camera suitable for measuring the distance to an object, as described later. The camera 11 may record the time from when the engine starts to when it stops, that is, when the vehicle is running. In this embodiment, the camera 11 is a vehicle accessory. While the power is on, the camera 11 constantly captures video. The camera 11 transmits the captured video data to the control unit. The image data is output to the image data acquisition unit 21 of 20. The image data is, for example, an image of 30 frames per second. The camera 11 is not limited to being mounted on a vehicle, but may be mounted on a road The camera may be a fixed camera or a security camera installed in the vicinity of the location.

[0015] The recording unit 12 is used for temporary storage of data in the terminal device 10. For example, RAM (Random Access Memory), flash memory or a recording unit such as a memory card. The recording unit 12 may be an external recording unit that is wirelessly connected via a communication device. Based on the control signal output from the recording control unit 24, the loop recording data is recorded.

[0016] The display unit 13 may be, for example, a display device specific to the terminal device 10 or a navigation device. The display unit 13 may be a display device shared with other systems including an online system. LCD (Liquid Crystal Display) or Displays including electroluminescence (EL) displays The display unit 13 displays a picture based on a video signal output from the display control unit 25 of the control unit 20. The display unit 13 displays the image captured by the camera 11 or the image recorded by the recording unit. The display unit 12 displays the recorded video. The display unit 13 displays the video when a nearby vehicle is driving recklessly. , and displays information to be notified to the driver of the vehicle.

[0017] The GPS receiver 14 receives radio waves from a GPS satellite (not shown). The received radio wave signal is output to the position information acquisition unit 26 of the control unit 20.

[0018] The recognition dictionary storage unit 16 stores a recognition dictionary for danger information and types of danger information. The dictionary storage unit 16 is a storage device such as an external server that acquires a recognition dictionary via the communication unit 17. That's fine.

[0019] The types of danger information include, for example, collision accidents, hit-and-run accidents, tailgating, wrong-way driving on the highway, and fires. , landslides, landslides and civil engineering road closures, ground collapses, tsunamis caused by earthquakes, road surface freezing, snow accumulation and flooding, and large-scale power outages.

[0020] The communication unit 17 is a communication unit. The communication unit 17 is connected to the Internet or a mobile phone line. The communication unit 17 communicates data with the server device 40. Believe.

[0021] The control unit 20 is, for example, a CPU (Central Processing Unit) The control unit 20 is a processing unit (control device) that is configured with the stored programs. The program is loaded into memory and the instructions contained in the program are executed. The internal memory includes an internal memory (not shown), which is used for temporary storage of data in the control unit 20. The control unit 20 is connected to a bus 20X and a video data acquisition unit 21 and a buffer. a memory 22, a video data processing unit 23, a recording control unit 24, a display control unit 25, and a position The device includes an information acquisition unit 26, a danger information detection unit 30, and a danger information communication control unit 32.

[0022] The video data acquisition unit 21 acquires video data of the surroundings of the vehicle. The acquisition unit 21 acquires video data of the surrounding area taken by the vehicle while the vehicle is traveling. In detail, the video data acquisition unit 21 acquires the video data output by the camera 11 and stores it in a buffer. The data is output to the memory 22.

[0023] The buffer memory 22 is an internal memory provided in the control unit 20, and It is a memory that temporarily records and updates a certain amount of video data acquired by the camera.

[0024] The video data processing unit 23 processes the video data temporarily stored in the buffer memory 22 as follows: For example, H.264 and MPEG-4 (Moving Picture Experts Group group) and then encode it with the audio data, for example, M The video data processing unit 23 converts the video data into an arbitrary file format such as P4 format. The video data temporarily stored in the image storage device 22 is converted into a file of video data for a certain period of time. As a specific example, the video data processing unit 23 generates the video data that the buffer memory 22 temporarily stores. The video data stored in the memory is generated as a single file containing 60 seconds of video data in the order in which it was recorded. The video data processing unit 23 outputs the generated video data to the recording control unit 24. The data processing unit 23 outputs the generated video data to the display control unit 25. The period of the generated video data is set to 60 seconds as an example, but is not limited to this.

[0025] The recording control unit 24 transfers the video data that has been filed by the video data processing unit 23 to the recording unit 1. The recording control unit 24 controls the recording of the vehicle accessory 2 when the accessory power supply of the vehicle is ON. The period during which the loop recording process is executed is the period during which the video data filed by the video data processing unit 23 is recorded. The data is recorded in the recording unit 12 as overwritable video data. During the period in which the loop recording process is being performed, the control unit 24 If the data continues to be recorded in the recording unit 12 and the capacity of the recording unit 12 becomes full, the oldest video New video data is recorded by overwriting the existing data.

[0026] The recording control unit 24 controls the recording of the image captured when the danger information detection unit 30 detects danger information. The video data may be recorded in the recording unit 12 in a manner that prohibits overwriting.

[0027] The display control unit 25 controls the display of the video data on the display unit 13. outputs a video signal that causes the video data to be output to the display unit 13. More specifically, the display control The unit 25 displays the image captured by the camera 11 on the display unit 13.

[0028] The display control unit 25 receives danger information from the server device 40 by the danger information communication control unit 32. If a signal is received, the display unit 13 displays danger information.

[0029] The display control unit 25 changes the display mode according to the degree of danger of the danger information received from the server device 40. For example, when the risk level is "high", the display control unit 25 may change the display to "low". ", the display is made more visible so that passengers can easily check it.

[0030] The position information acquisition unit 26 acquires the current position of the vehicle based on the radio waves received by the GPS receiving unit 14. The position information calculated by the position information acquisition unit 26 is It may be stored with the data.

[0031] The danger information detection unit 30 detects danger information and other information from the video data acquired by the video data acquisition unit 21. More specifically, the danger information detection unit 30 detects the type of danger information from the video data captured by the camera 11. For example, the recognition dictionary stored in the recognition dictionary storage unit 16 is used to identify danger information and its The danger information detection unit 30 detects the type of danger from the captured video data using a recognition dictionary. For example, collision accidents, hit-and-run accidents, tailgating, wrong-way driving on the highway, fires, landslides, and Civil engineering road closures, ground collapses, earthquake-induced tsunamis, frozen roads, snow accumulation, flooding, and large-scale outages The method of detecting danger information and its type from video data is to use a recognition dictionary. The danger information detection unit 30 is not limited to this method, and any known method can be used. Not only information about accidents and disasters that you have been involved in as a person, but also information about things that you have encountered while passing by. Detects information about dangers such as accidents and disasters and their types.

[0032] The danger information detection unit 30 detects the danger information and displays various items according to the type of the danger information. For example, the danger information detection unit 30 may detect the type of danger information as "collision accident". In this case, the "scale of the accident" is detected as an item of risk information. Therefore, the contents of the property damage accident, multiple accident, or personal injury accident are processed into the video data. The scale of the accident can be determined by, for example, whether emergency vehicles are being dispatched or whether lanes are being restricted. The danger information detection unit 30 detects danger information by performing image processing on the video data. If the type of report is "collision accident," the system will further detect "whether there are any injuries" as an item of danger information. The presence or absence of injuries can be detected by performing image processing on the video data.

[0033] For example, when the type of danger information is "hit-and-run accident", the danger information detection unit 30 The information items to be detected are "scale of accident, vehicle number, vehicle color, and vehicle model." For example, when the type of danger information is "hit-and-run accident", the detection unit 30 The vehicle number, color, and model may be used to detect whether or not there are any injured people. The image data is subjected to image processing for detection.

[0034] For example, when the type of danger information is "road rage", the danger information detection unit 30 The items to be detected are "vehicle number, vehicle color, and vehicle model." For example, if the type of danger information is "tailgating," the item of danger information can be further expanded to include "passenger traffic." For example, a passenger problem may be detected when a passenger in one vehicle is in a The passenger has disembarked and is approaching the other vehicle. The detection is performed by image processing.

[0035] For example, when the type of danger information is "driving the wrong way on an expressway," the danger information detection unit 30 The danger information detection unit 30 detects "vehicle number, vehicle color, and vehicle model" as information items. For example, if the type of danger information is "driving the wrong way on the highway," the danger information item can be further set as " The name of the expressway where the wrong-way driving occurred, the name of the toll gate, and the name of the entrance / exit may be detected. The names of the locations and entrances / exits are detected from the video data or the vehicle's position information and map information.

[0036] For example, when the type of danger information is "fire", the danger information detection unit 30 The scale of the disaster, the area where the disaster occurred, and whether there are any injuries are detected. For example, the size of the area where fire or smoke is recognized, the number of buildings, and whether the fire has spread are recorded in the video data. The area where the disaster occurred is detected by processing the image. The area where the fire or smoke is detected is detected by processing the image data. Then, the fire is detected based on map information (not shown). The area where the disaster occurred is identified. The presence or absence of injuries is detected by applying image processing to the video data. do.

[0037] For example, when the type of danger information is "landslide," the danger information detection unit 30 The items to be detected are "scale of the disaster, and whether the current location is in a designated disaster area." For example, the model detects the size of the area where a landslide has been recognized by performing image processing on the video data. Whether or not the current location is in a designated disaster area is recorded in a map information storage unit (not shown), for example. The map information stored in the database is used to detect whether the current location is registered as a designated area for landslides. do.

[0038] For example, when the type of danger information is "landslide / civil engineering road closure," the danger information detection unit 30 The "scale of disaster" is detected as an item of risk information. For example, the scale of disaster is determined by the type of landslide or civil engineering disaster. Therefore, the size of the area recognized as the road closure area is calculated by image processing of the video data. Detect.

[0039] For example, when the type of danger information is "ground collapse", the danger information detection unit 30 The "scale of the disaster" is detected as an item. The scale of the disaster can be, for example, the area where the ground collapsed. The size of the recognized area is detected by performing image processing on the video data.

[0040] For example, when the type of danger information is "tsunami caused by earthquake," the danger information detection unit 30 Information items to be detected include "the scale of the disaster, and whether the current location is in a designated disaster area." The scale of the damage is recognized, for example, from earthquake intensity or tsunami information obtained from an external device. Whether or not the current location is in a designated area in the event of a disaster is stored in, for example, a map information storage unit (not shown). The map information is checked to see if the current location is registered as a designated area for tsunami caused by an earthquake. Put out.

[0041] For example, when the type of danger information is "frozen road, snow accumulation, flooding," the danger information detection unit 30 ,The hazard information items include "the scale of the disaster, and whether the current location is in a designated disaster area." The scale of the disaster can be recognized from, for example, information on frozen roads, snow accumulation, and flooding obtained from external devices. Whether the current location is in a designated area in the event of a disaster or not is determined by, for example, a map information storage unit (not shown). The map information stored in the device indicates that the current location is registered as a designated area for frozen roads, snow, or flooding. It is detected by whether or not the

[0042] For example, when the type of danger information is "large-scale power outage," the danger information detection unit 30 The scale of the disaster is detected as an item of the disaster information. This is recognized from the information on the area map of the power outage.

[0043] The danger information detection unit 30 may further detect the degree of danger for the detected danger information. More specifically, the danger information detection unit 30 detects the danger information by dividing it into "scale of accident" and "number of injured people" and For example, if the "scale of an accident" is within a predetermined range, the degree of risk may be detected from various items such as "presence or absence of an accident." If the number is more than 100, the risk level is "high." For example, if there are "injured people," the risk level is "high." For example, if the type of danger information is "driving the wrong way on the highway," the danger level is set to "high." For example, if the type of danger information is "tailgating" and "passenger trouble," the danger level is "high." "

[0044] The danger information communication control unit 32 transmits the danger information detected by the danger information detection unit 30 to the server. The danger information communication control unit 32 communicates with the device 40. The danger information thus obtained is transmitted to the server device 40. The danger information to be transmitted includes the degree of danger, the date of issue of the danger information, and the like. Contains information indicating the raw location and date and time of occurrence.

[0045] The danger information communication control unit 32 receives danger information about the surroundings of the vehicle from the server device 40. The risk information communication control unit 32 transmits the risk information detected by the risk information detection unit 30 to the server device 40, and when the mobile station is located within the notification area specified by the server device 30, In this embodiment, the danger information communication control unit 3 2 is a case where danger information notified from the server device 40 is received and the vehicle is in danger. If it is determined that the content of the danger information is the same as that detected by the danger information detection unit 30, The vehicle may be controlled to transmit danger information detected in the vehicle to the server device 40. The latest danger information is always transmitted from the terminal device 10 to the server device 40.

[0046] The content of the danger information is the same as that of the danger information notified from the server device 40. The danger information detected by the danger information detection unit 30 satisfies the following conditions. The two pieces of danger information are of the same type and the difference in their occurrence locations is within a predetermined distance, This means that the difference between the occurrence dates and times must be within a predetermined time period. <Server device> 3 is a block diagram showing an example of the configuration of the server device 40 according to the embodiment. 40 includes a communication unit 41, a risk type information storage unit 42, and a control unit 50.

[0047] The communication unit 41 is a communication unit. The communication unit 41 is connected to the Internet or a mobile phone line. The communication unit 41 may be a terminal device mounted on a plurality of vehicles. It communicates data with the terminal device 10.

[0048] The risk type information storage unit 42 stores risk type information. The information may be stored in a storage device such as an external server that acquires the risk type information via the receiving unit 41.

[0049] The danger type information is information about the notification of danger information for each type of danger information. In this embodiment, the danger type information is provided for each type of danger information, for example, the notification area for danger information, This information includes the items of danger information to be notified and the time interval for notification. The rear is the area where danger information is notified. The items of danger information to be notified are The notification interval is the time interval at which notifications are made.

[0050] 4 is a diagram illustrating an example of danger type information. In the example shown in FIG. 4, the types of danger information are For "collision accidents," the notification area is "1 km radius from the scene," and the items of danger information to be notified are "incidents" and " The scale of the accident and the notification interval are set to "every 5 minutes." The notification area is "5km in the direction of travel of the target vehicle" and the risk information items are "accident rules" The information includes the model, vehicle number, vehicle color, and vehicle type, and the notification interval is set to "every minute." The type of danger information "Tailgating" is the notification area "5km in the direction of travel of the target vehicle" and the danger information to be notified. The information items are "vehicle number, vehicle color, model," and the notification interval is "every minute." The type of danger information is "Wrong-way driving on the expressway," and the notification area is "10km in the wrong direction of the vehicle." ", the items of danger information to be notified are "vehicle number, vehicle color, vehicle model", and the time interval for notification The notification area for the type of danger information "fire" is set to "a radius of the site" 1km", the items of danger information to be notified are "scale of disaster, area of ​​disaster occurrence", and the time interval to be notified. The notification interval is set to "every 10 minutes." The type of danger information is "landslides." The notification area is set to "from the site." The items of danger information to be notified are "scale of disaster, current location is within the designated area at the time of disaster, The notification interval is set to "every 30 seconds." The notification area for the "Wooden Road Closure" is "1km radius from the site," and the items of danger information to be notified are "Disaster The scale of the damage and the notification interval are set to "every 10 minutes." ", the notification area is "1km radius from the site" and the item of danger information to be notified is "scale of disaster" The notification interval is set to "every 5 minutes." The type of danger information is "tsunami caused by earthquake." The notification area is "5km radius from the site", and the items of danger information to be notified are "scale of disaster, current location, etc." Is this a designated disaster area? The notification interval is set to "every 30 seconds." For the type of information "frozen roads, snow accumulation, flooding," the notification area is "1km radius from the site" and The items of danger information to be notified include "the scale of the disaster, whether the current location is in a designated disaster area?", and the time of notification. The interval is set to "every 10 minutes." The type of danger information is "large-scale power outage." The notification area is " "1km radius from the site", the item of danger information to be notified is "scale of disaster", the time interval for notification is It is stated to be "every 10 minutes."

[0051] The danger type information may further include information indicating whether an emergency call is required for each type of danger information. In this embodiment, the danger type information is used to notify an emergency call for each type and degree of danger information. The information may include information indicating whether or not the above is required.

[0052] The degree of danger indicates the magnitude of the impact on the surroundings for each type of danger. indicates the degree of impact on vehicles traveling on the road. The risk level can be expressed as "high" or "low", for example. The danger level "high" is, for example, a level at which driving on the road is impeded. "High" is a level where, for example, an emergency service needs to be notified. This is the level at which caution is required when driving on the road. A "low" risk level means that, for example, an emergency call is required. It is not at a level that is necessary.

[0053] An emergency agency is an agency to which you should report in an emergency. For example, an emergency agency is a police agency. This includes agencies that handle emergency calls or make emergency requests.

[0054] 5 is a diagram illustrating another example of the danger type information. In the example shown in FIG. 5, the types of danger information are For each risk level, the risk information notification area, risk information items to be notified, and notification time intervals are displayed. The information also includes whether an emergency call is required. For a "high" risk level, the notification area is "5km in the direction of travel of the target vehicle" and the risk information items to be notified are " "Vehicle number, vehicle color, model", notification interval "Every minute", emergency call "Report The type of danger information is "Tailgating" and the danger level is "Low", and the notification area is "Target "3km in the direction of travel of the vehicle", and the items of danger information to be notified are "vehicle number, vehicle color, vehicle model", The notification interval is set to "every minute" and emergency calls are set to "not be notified."

[0055] The control unit 50 is, for example, a processing unit configured with a CPU or the like. Loads a stored program into memory and executes the instructions contained in the program The control unit 50 includes an internal memory (not shown), and the internal memory stores the data stored in the server device 40. The control unit 50 is used for temporary storage of data. The notification determination unit 52, the notification determination unit 53, the notification control unit 54, and the notification control unit 55. The notification control unit 53 and the notification control unit 55 are not essential components.

[0056] The danger information reception control unit 51 receives danger information from the terminal devices 1 mounted on the plurality of vehicles via the communication unit 41. Controls receiving danger information from 0.

[0057] The identification unit 52 identifies the danger information according to the type of the danger information based on the danger information received from the terminal device 10. The specifying unit 52 specifies the notification area to which the danger information is to be notified. The notification area for notifying the received danger information is identified from the stored danger type information. For example, when the type of danger information is "wrong way driving on an expressway," the unit 52 sets the notification area to "wrong way driving on an expressway." Specify "10km in the direction of travel of the vehicle."

[0058] The specifying unit 52 may specify a notification area to be notified according to the degree of danger of the received danger information. For example, the specifying unit 52 may specify the following when the risk level is "high" compared to when it is "low": An expanded notification area may be specified.

[0059] In this embodiment, the specifying unit 52 further specifies the items of danger information to be notified and The identification unit 52 may identify the time interval. Regarding the danger information received from other information, the items of danger information to be notified and the time of notification An interval may be specified.

[0060] In this embodiment, the identification unit 52 determines that the contents of the received multiple pieces of danger information are the same. For example, the specifying unit 52 may specify the notification area again based on the latest danger information. For example, the specifying unit 52 may specify the notification area again by specifying the notification area included in the plurality of pieces of danger information. The notification area may be redefined based on the average value of the occurrence positions. For example, the identification unit 52 may receive the map coordinates of the respective occurrence positions. As the number of pieces of danger information increases, the notification area may be widened and specified again.

[0061] The contents of multiple pieces of danger information are the same if the received pieces of danger information meet the following conditions: The plurality of pieces of danger information are of the same type and the difference in the occurrence location is within a predetermined distance. The difference between the occurrence dates and times must be within a specified time period.

[0062] The notification determination unit 53 determines whether to notify an emergency organization in accordance with the degree of danger of the danger information received from the terminal device 10. In this embodiment, the notification determination unit 53 determines whether to report the risk type information stored in the risk type information storage unit 42. Whether or not to notify an emergency organization is determined based on the danger type information stored in the If the risk level is "high", the notification unit 53 determines whether to notify an emergency organization. If the same danger information has already been reported to an emergency organization, Section 53 will notify the emergency organization. Do not duplicate.

[0063] The notification determination unit 53 determines that the danger information received from the terminal device 10 is "injured person" and If the information includes information indicating that "no emergency vehicles will be dispatched," it is determined that a call should be sent to an emergency organization. Good too.

[0064] The notification control unit 54 controls to notify the danger information to the target vehicle located within the notification area. More specifically, the notification control unit 54 determines whether or not a notification area is within the notification area based on the result of the determination by the determination unit 52. The terminal device 10 of the target vehicle located at the designated position is controlled to notify the danger information.

[0065] In this embodiment, the notification control unit 54 selects an item of danger information according to the type of the received danger information. Or, control the time interval for notifying danger information. The notification control unit 54 determines the item of danger information or the danger level based on the result of the determination by the determination unit 52. The time interval at which information is notified is controlled to be changed.

[0066] The notification control unit 55 notifies an emergency organization according to the degree of danger of the danger information received from the terminal device 10. More specifically, the notification control unit 55 controls the notification determination unit 53 to "notify". If it is determined that the emergency call is notified, the notification control unit 55 controls the communication unit 41 to notify an emergency organization. The system controls the transmission of notification information indicating a call requesting emergency organizations to respond. The information includes information for identifying the vehicle, information about the current location of the vehicle, and information indicating a request for dispatch. <Processing in the danger information notification system> Next, with reference to FIG. 6, information processing in the danger information notification system 1 will be described. FIG. 6 is a sequence diagram showing the flow of processing in the danger information notification system 1 according to the embodiment. The terminal device 10 installed in each vehicle is running while the vehicle is running. While the terminal device 10 is running, the camera 11 takes pictures at all times.

[0067] First, the control unit 20 of the terminal device 10 installed in the vehicle acquires vehicle position information. More specifically, the control unit 20 uses the position information acquisition unit 26 to acquire the G Based on the radio waves received by the PS receiver 14, the current position information of the vehicle is transmitted by a known method. The control unit 20 proceeds to step S12.

[0068] The control unit 20 acquires the video data (step S12). The image data acquisition unit 21 acquires image data of the surroundings of the vehicle captured by the camera 11. The control unit 20 proceeds to step S13.

[0069] The control unit 20 detects the danger information (step S13). The danger information detection unit 30 extracts the information from the image data captured by the camera 11 and stores it in the recognition dictionary storage unit 12. The control unit 20 detects danger information and its type using the recognition dictionary stored in the control unit 20. The danger information detection unit 30 detects the danger information and generates various types of danger information according to the type of danger information. The control unit 20 detects the danger information detected by the danger information detection unit 30. The control unit 20 then proceeds to step S14.

[0070] The control unit 20 transmits the danger information (step S14). The danger information communication control unit 32 transmits the danger information detected by the danger information detection unit 30 to the server. The danger information transmitted in step S14 includes the degree of danger, the danger It includes information indicating the location and date and time of occurrence of the information.

[0071] The danger information is received by the control unit 50 of the server device 40 (step S21). More specifically, the control unit 50 controls the terminal device mounted on the vehicle by the danger information reception control unit 51. The control unit 50 receives the danger information from the device 10. The control unit 50 proceeds to step S22.

[0072] The control unit 50 specifies a notification area to which the danger information is to be notified (step S22). Alternatively, the control unit 50 may use the identification unit 52 to identify the risk stored in the risk type information storage unit 42. The control unit 50 identifies a notification area to which the received danger information is to be notified based on the type information. The unit 52 further specifies the items of danger information to be notified and the time intervals for notification. The control unit 50 may use the identification unit 52 to identify the risk stored in the risk type information storage unit 42. From the risk type information, the items of risk information to be notified and the The control unit 50 may specify a time interval during which the danger information is If the type is "wrong-way driving on the highway," the notification area is specified as "10 km in the wrong direction of the vehicle." The control unit 50 determines by the identification unit 52, for example, that the type of danger information is "driving the wrong way on an expressway." If there is any, the items of danger information to be notified include "vehicle number, vehicle color, vehicle model", and time The control unit 50 specifies the interval as “every 30 seconds.” The control unit 50 proceeds to step S23.

[0073] The control unit 50 notifies the user of the danger information (step S23). The notification control unit 54 detects the location of the object located within the notification area based on the identification result of the identification unit 52. The control unit 50 controls the terminal device 10 of the target vehicle to notify the danger information. 54, for example, if the type of danger information is "driving in the wrong direction on the expressway," The control unit 10 controls the terminal device 10 of the target vehicle located 10 km away from the target vehicle to notify the danger information. The control unit 50 proceeds to step S24.

[0074] The control unit 50 determines whether or not a notification is required (step S24). The notification determination unit 53 determines whether or not the risk type information is stored in the risk type information storage unit 42. The control unit 50 then determines whether to notify an emergency organization based on the result of the call. The process then proceeds to step S25.

[0075] The control unit 50 notifies an emergency organization (step S25). If it is determined in step 4 that "a notification should be made," the control unit 50 makes a notification by the notification control unit 55. The control unit 41 controls the signaling unit 41 to transmit notification information indicating a notification accompanied by a request for emergency response to an emergency organization.

[0076] The other terminal device 10 mounted on the target vehicle within the notification area receives the danger information. In more detail, the control unit 20 receives the danger information communication control unit 3. 2 receives danger information around the vehicle from the server device 40. For example, If the type is "wrong-way driving on the highway," the target vehicle located 10 km in the "wrong-way vehicle's direction of travel" The terminal device 10 transmits danger information about the surroundings of the vehicle to the server device 32 via the danger information communication control unit 32. 40. The control unit 20 proceeds to step S32.

[0077] The control unit 20 notifies the user of the danger information (step S32). The display control unit 25 receives the danger information from the server device 40 via the danger information communication control unit 32. The control unit 20 causes the display control unit 25 to display the danger information on the server 13. The type and item of danger information received from the device 40 are displayed on the display unit 13 at time intervals. The control unit 20 causes the display control unit 25 to display the danger information. ", "Vehicle number △□〇◇, blue "A (A is the model name)" is driving in the wrong direction." The information is displayed on the display unit 13 at time intervals of "every 30 seconds." <Effects> As described above, in this embodiment, the server device does not require any operation by the vehicle occupant. 40, the danger information can be appropriately notified to the target vehicles within the notification area. For example, even if the vehicle involved cannot transmit danger information, other vehicles passing by can The danger information can be transmitted from the server device 40 to the target vehicle, and the danger information can be appropriately notified to the target vehicle. According to the embodiment, the amount of information is reduced compared to when video data is communicated, and dangers of multiple vehicles are detected. It is possible to share risk information and appropriately notify people of dangers.

[0078] According to this embodiment, for example, when the passengers of the vehicle concerned are unable to report to an emergency organization, In addition, danger information from other passing vehicles is transmitted to the server device 40, and emergency services are notified as necessary. You can report it to.

[0079] In this embodiment, depending on the type of danger information, the item of danger information or the danger information is notified. This embodiment can notify the danger information appropriately by changing the time interval. It is possible.

[0080] In this embodiment, if the content of the plurality of pieces of danger information received by the server device 40 is the same, If it is determined that the notification area is too large, the notification area is specified again. It can be properly identified.

[0081] In this embodiment, the server device 40 determines whether an emergency situation is detected based on the degree of danger of the danger information received. In this embodiment, it is possible to appropriately notify the necessary emergency organizations. can.

[0082] In this embodiment, when danger information is received from the server device 40, In both cases, it is determined that the content of the danger information detected by the danger information detection unit 30 is the same. In this case, the danger information detected by the vehicle can be transmitted to the server device 40 again. According to the embodiment, the latest danger information is always transmitted from the terminal device 10 to the server device 40. According to this embodiment, the server device 40 can handle a larger number of terminal devices 10. You can receive danger information from

[0083] The danger information notification system according to the present invention can be implemented in various different forms in addition to the above-described embodiment. It may be implemented as follows.

[0084] The components of the danger information notification system shown in the figure are functional concepts and are not necessarily physical. The physical configuration of each device does not necessarily have to be as shown in the drawings. It is not limited to the above, but may be used in whole or in part depending on the processing load and usage status of each device. The units may be functionally or physically distributed or integrated.

[0085] The configuration of the danger information notification system is, for example, software loaded into memory. In the above embodiment, the above hardware or software is implemented. These are explained as functional blocks realized by the cooperation of various software. The functional blocks may consist of hardware only, software only, or a combination of both. This can be realized in various ways depending on the combination.

[0086] The above-described components include those that can be easily imagined by a person skilled in the art and those that are substantially the same. Furthermore, the above-mentioned configurations can be combined as appropriate. Various omissions, substitutions or modifications of the configuration are possible within the scope.

[0087] In the above, the video data captured by the camera 11 may include audio data. The data may be subjected to voice recognition processing to detect impact sounds such as accident sounds, people screaming, etc.

[0088] In the above, the terminal device 10 may further include a speaker and an audio output control unit. The output control unit receives danger information from the server device 40 via the danger information communication control unit 32. In this case, the server device outputs a voice message notifying the user of the danger information through a speaker. The volume of the warning message may be changed depending on the level of danger received from the device 40. For example, the control unit may increase the volume when the risk level is "high" compared to when the risk level is "low." Output.

[0089] The terminal device 10 receives a driving record that indicates that one of the vehicles has been involved in an accident. If detected by the event detection function of the coder, the vehicle involved in the accident can The server device 4 transmits the video data of the accident together with the risk information of the accident to both parties. The server device 40 may request the transmission of the video data received from other vehicles. The vehicle involved in the accident may transmit the data captured by the other vehicle. By receiving video data, accident situations that are difficult to see due to blind spots from the vehicle can be identified. You can check the status.

[0090] This disclosure will contribute to the realization of the SDGs' goal of "Building infrastructure, fostering innovation and fostering sustainable industrialization" and promote IoT solutions. This includes matters that contribute to value creation through collaboration. [Explanation of symbols]

[0091] 1. Hazard Information Notification System 10 Terminal Equipment 11 Camera (photography section) 12 Recording section 13 Display section 14 GPS receiver 16 Recognition dictionary storage unit 17 Communications Department 20 Control Unit 21 Video data acquisition unit 22 Buffer memory 23 Video data processing section 24 Recording control section 25 Display control unit 26 Location information acquisition section 30 Danger information detection unit 32 Danger Information Communication Control Unit 40 Server device 41 Communications Department 42 Hazard type information storage unit 50 control section 51 Danger information reception control unit 52 Specific part 53 Report Judgment Department 54 Notification control section 55 Reporting control section

Claims

1. a video data acquisition unit that acquires video data captured around the moving object; a danger information detection unit that detects danger information and its type from the video data; a danger information communication control unit that transmits the danger information detected by the danger information detection unit to a server device, and receives danger information notified from the server device when the device is located within a notification area specified by the server device; Equipped with The danger information detection unit is a terminal device that detects various items according to the type of danger information.

2. a video data acquisition step of acquiring video data of the periphery of the moving object; a danger information detection step of detecting danger information and its type from the video data; a danger information communication control step of transmitting the danger information detected by the danger information detection step to a server device, and receiving danger information notified from the server device when the vehicle is located within a notification area specified by the server device; detecting various items according to the type of the danger information; Including, Hazard notification methods.

3. a video data acquisition step of acquiring video data of the periphery of the moving object; a danger information detection step of detecting danger information and its type from the video data; a danger information communication control step of transmitting the danger information detected by the danger information detection step to a server device, and receiving danger information notified from the server device when the vehicle is located within a notification area specified by the server device; a step of transmitting the danger information detected by the mobile body to the server device again when the danger information notified from the server device is received and when it is determined that the content of the danger information is identical to that detected by the mobile body in the danger information detection step; detecting various items according to the type of the danger information; A program executed by a computer operating as a terminal device.

Images