Information registration support device, method, and program

Abstract

To support information registration to generate a correct hazard map.SOLUTION: An information registration support device (200) includes: a first determination section (232) for determining whether a registration point is included in a photographing range of a photographing device mounted on a mobile body based on the registration point pre-registered in a database and a present position of the mobile body; and a second determination section (233) for determining whether an image photographed by the photographing device at the present position satisfies a registration condition based on a risk of a disaster at the registration point and peripheral road information being the information related to a road existing in the periphery of the registration point when the registration point is included.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to an information registration support apparatus, method, and program. Background Art

[0002] Patent Literature 1 discloses a technology related to a hazard map creation apparatus. The hazard map creation apparatus collects forward images obtained by continuously capturing an area in front of a vehicle with a drive recorder mounted on the vehicle, and displays a hazard map in which dangerous locations are registered and the forward images on a display unit. When an operator or the like presses a registration button to align a dangerous location with the forward image on the display unit, the hazard map creation apparatus registers a danger mark at a position on the hazard map corresponding to the point where the forward image was captured. Prior Art Literature Patent Literature

[0003] Patent Literature 1 Japanese Unexamined Patent Publication No. 2018-180728 Summary of Invention Problem to be Solved by Invention

[0004] However, in Patent Literature 1, an operator needs to compare and visually check the forward images collected by the operator against dangerous locations to register danger marks, so there is a problem that maintaining the accuracy of the hazard map is complicated.

[0005] An object of the present disclosure, in view of the problem described above, is to provide an information registration support apparatus, method, and program for supporting information registration for creating an accurate hazard map. Means for Solving the Problem

[0006] The information registration support device according to this disclosure includes: a first determination unit that determines whether the registered location is included in the shooting range of a shooting device mounted on the mobile body, based on the registered location pre-registered in a database and the current location of the mobile body; and, if the registered location is included, a second determination unit that determines whether the image taken by the shooting device at the current location satisfies the registration conditions, based on the degree of disaster risk at the registered location and surrounding road information, which is information about roads existing around the registered location.

[0007] The information registration support method relating to this disclosure includes a first determination step in which a computer determines whether the registered location is included in the shooting range of a camera mounted on the mobile body, based on the registered location pre-registered in a database and the current location of the mobile body; and a second determination step in which, if the registered location is included, the computer determines whether the image taken by the camera at the current location satisfies the registration conditions, based on the degree of disaster risk at the registered location and surrounding road information, which is information about roads located around the registered location.

[0008] The information registration support program relating to this disclosure causes a computer to perform the following steps: a first determination step of determining whether the registered location is included in the shooting range of a camera mounted on the mobile body, based on the registered location pre-registered in a database and the current location of the mobile body; and, if the registered location is included, a second determination step of determining whether the image taken by the camera at the current location satisfies the registration conditions, based on the degree of disaster risk at the registered location and surrounding road information, which is information about roads existing around the registered location. [Effects of the Invention]

[0009] This disclosure provides an information registration support device, method, and program for assisting in the registration of information necessary to create accurate hazard maps. [Brief explanation of the drawing]

[0010] [Figure 1]This is a block diagram showing the overall configuration of the hazard map creation support system according to this first embodiment. [Figure 2] This figure shows an example of registered location information in the hazard map information DB according to this embodiment 1. [Figure 3] This is a block diagram showing the configuration of the information registration support device according to this first embodiment. [Figure 4] This is a flowchart showing the flow of the hazard map information registration support method according to this embodiment 1. [Figure 5] This diagram illustrates the concept of determining whether a registered point is included in the shooting range according to this embodiment 1. [Figure 6] This diagram schematically shows an example of an aerial view of the relationship between the vehicle, the registered location, and the surrounding roads according to this embodiment 1. [Figure 7] This figure schematically shows an example of an image captured by a camera according to this embodiment 1 and the processing range. [Figure 8] This figure shows an example of surrounding road information registered in the hazard map information database according to this embodiment 1. [Figure 9] This figure shows an example of traffic volume information registered in the hazard map information database according to this embodiment 1. [Modes for carrying out the invention]

[0011] In the following, specific embodiments of this disclosure will be described in detail with reference to the drawings. In each drawing, the same elements are denoted by the same reference numerals, and redundant explanations will be omitted where necessary for clarity.

[0012] <Embodiment 1> Figure 1 is a block diagram showing the overall configuration of the hazard map creation support system 1000 according to this embodiment 1. The hazard map creation support system 1000 comprises an information management device 1 and an information registration support device 200 mounted on a mobile device 2. The information management device 1 and the mobile device 2 are communicated together via a network N. The network N includes a wireless communication network or a mobile phone network, and may also include the Internet.

[0013] Information management device 1 is an information processing device for managing hazard map information, which is information used to create hazard maps. Here, "hazard map" refers to a map that displays areas expected to be affected by natural disasters and the locations of disaster prevention facilities such as evacuation sites and evacuation routes, for the purpose of mitigating damage from natural disasters and for disaster prevention measures. "Natural disasters" include, but are not limited to, landslides and other sediment-related disasters, floods such as river overflows, storm surges, and tsunamis. Furthermore, a hazard map may be map information that comprehensively represents locations and the degree of risk of multiple types of natural disasters. A hazard map may also be called, for example, a disaster prevention map, a damage prediction map, a damage estimation map, a disaster avoidance map, or a disaster risk map. Information management device 1 may be redundantly configured with multiple servers, and each functional block may be implemented with multiple computers. Information management device 1 may also be connected to a computer terminal (not shown) operated by a user creating a hazard map.

[0014] The information management device 1 comprises a hazard map information DB (DataBase) 11, a reception unit 12, a DB search unit 13, a transmission unit 14, and a DB update unit 15. The hazard map information DB 11 is a database for managing hazard map information. The hazard map information DB 11 is implemented by a storage device storing a data group related to hazard map information, and a database management system which is software that controls access to the storage device. The hazard map information DB 11 associates and manages registered point information 110, captured images 120, surrounding road information 130, and traffic volume information 140. It is assumed that a creator of a hazard map has previously registered the registered point information 110 in the hazard map information DB 11 in advance.

[0015] The registered point information 110 is information related to points that are taken into consideration when creating a hazard map, because the points have been affected by natural disasters in the past or have a risk of danger due to natural disasters in the future. The registered point information 110 is, for example, information in which a point ID 111, position information 112, and a risk level 113 are associated with each other. Note that the registered point information 110 is not limited to these. The point ID 111 is identification information of the registered point. The position information 112 is information that enables specifying a position on a hazard map, such as the latitude and longitude of the registered point. The risk level 113 is information indicating the level of risk of natural disaster at the registered point.

[0016] Figure 2 is a diagram showing an example of the registered point information 110 in the hazard map information DB 11 according to the first embodiment. Although the point IDs 111 are exemplified as "A", "B", ..., they may be numerical values, characters, symbols, or combinations thereof that can uniquely identify a registered point in the hazard map information DB 11. Although the position information 112 is exemplified as a combination of latitude and longitude, it is not limited thereto. The risk level 113 is exemplified as a level value where a special warning area for sediment disasters is "2", a warning area is "1", and an undesignated area is "0", but the risk level 113 is not limited to these. That is, the risk level 113 is not limited to three levels, and the type of natural disaster is also not limited to sediment disasters.

[0017] Returning to FIG. 1, the description will be continued. The captured image 120 is image data obtained by capturing an image of the surrounding area including the associated registered point. Specifically, the captured image 120 is image data captured within a predetermined range from the point ID 111. Note that two or more captured images 120 may be associated with the registered point information 110.

[0018] Peripheral road information 130 is information related to peripheral roads that are roads existing around a registered point. The peripheral road information 130 exemplifies, but is not limited to, the presence or absence of a peripheral road, the distance between the registered point and the peripheral road when a peripheral road exists, and the road width of the peripheral road. Note that the peripheral road may be a roadway, a sidewalk, or a combination thereof. Further, the vicinity of the registered point refers to a range within a predetermined distance including the registered point, for example, a range within a 20 m radius distance from the registered point.

[0019] Traffic volume information 140 is information related to the traffic volume of roads around the registered point at the date and time when the captured image 120 was captured. The traffic volume information 140 is, for example, the number of pedestrians, the number of vehicles traveling on the peripheral roads, or the like. Further, when two or more captured images 120 are associated with the registered point information 110, the traffic volume information 140 may be a statistical processing result of traffic volume information for each date and time, an average value for each time slot, or the like.

[0020] The receiving unit 12 receives a request to acquire a registered location from the information registration support device 200 via the network N and notifies the DB search unit 13 of the acquisition request. The receiving unit 12 also receives a registration request from the information registration support device 200 via the network N to associate the captured image 120, surrounding road information 130, and traffic volume information 140 with the location ID 111, and notifies the DB update unit 15 of the registration request. Here, the registration request is assumed to specify the location ID 111 or the registered location information 110 to be associated with the captured image 120, etc., when registering to the hazard map information DB 11. The DB search unit 13 searches the hazard map information DB 11 for registered location information that satisfies the conditions specified in the notified acquisition request and outputs the search results to the transmission unit 14. The transmission unit 14 transmits the search results, which are the registered location information, to the information registration support device 200 via the network N. The DB update unit 15 registers or updates the location ID 111 specified in the registration request notified by the receiving unit 12, along with the captured image 120, surrounding road information 130, and traffic volume information 140 corresponding to the specified location ID 111, in the hazard map information DB 11. The DB update unit 15 also registers, updates, deletes, etc., registered location information 110, captured image 120, surrounding road information 130, or traffic volume information 140 that have been input from an external source in the hazard map information DB 11.

[0021] The information management device 1 includes a processor, memory, and storage device (not shown in the diagram). The storage device stores a computer program that implements the management processing of hazard map information. The processor loads the computer program from the storage device into memory and executes the computer program. This allows the processor to perform the functions of the receiving unit 12, DB search unit 13, transmission unit 14, and DB update unit 15 described above.

[0022] Mobile object 2 is an object that moves between locations included in the hazard map and is capable of external photography and wireless communication. Examples of mobile object 2 include, but are not limited to, vehicles such as automobiles and bicycles, portable wireless information terminals such as smartphones and tablet devices, and self-propelled robots. Mobile object 2 is equipped with a camera 21, a wireless communication unit 22, and an information registration support device 200. Camera 21 takes pictures of a shooting range that includes at least one of the front, side, and rear of mobile object 2 and generates image data. Camera 21 is an example of a shooting device and takes pictures of the scenery outside mobile object 2 and outputs the captured image data to at least the information registration support device 200. For example, if mobile object 2 is an automobile, camera 21 may be an in-vehicle camera used in a drive recorder. Alternatively, two or more cameras 21 may be used to shoot in different directions. Alternatively, camera 21 may be implemented with a single 360-degree camera. Alternatively, camera 21 may periodically switch its shooting direction. Camera 21 may sequentially input the captured video data to the information registration support device 200 frame by frame. Camera 21 is, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor.

[0023] The wireless communication unit 22 performs wireless communication between the network N and the mobile device 2. In particular, the wireless communication unit 22 performs wireless communication between the network N and the information registration support device 200 within the mobile device 2. The wireless communication unit 22 includes an antenna and a communication interface circuit for transmitting signals for wireless communication.

[0024] The information registration support device 200 is an information processing device comprising a first determination unit 232, a second determination unit 233, and a registration unit 235. The hardware configuration of the information registration support device 200 will be described later. The first determination unit 232 determines whether the registered location is included in the shooting range of the camera 21 mounted on the mobile body 2, based on the registered location information 110 pre-registered in the hazard map information DB 11 and the current location of the mobile body 2. If the first determination unit 232 determines that the registered location is included, the second determination unit 233 determines whether the image taken from the camera 21 of the mobile body 2 at the current location of the mobile body 2 satisfies the registration conditions, based on the degree of disaster risk at the registered location and surrounding road information. In particular, the second determination unit 233 may determine that the registration conditions are met if the degree of risk indicating the level of risk of landslides at the registered location is above a predetermined level. Furthermore, the second determination unit 233 may determine that the registration conditions are met if the distance between the slope of the registered location and the surrounding road is less than or equal to a predetermined distance, or if the width of the surrounding road is less than or equal to a predetermined width, or at least one of these conditions. If the second determination unit 233 determines that the registration conditions are met, the registration unit 235 registers the image captured by the camera 21 in the hazard map information DB 11, associating it with the registered location. Specifically, the registration unit 235 registers the captured image 120 in the hazard map information DB 11, associating it with the registered location information 110, by transmitting a registration request including the captured image and the registered location to the information management device 1. Furthermore, the information registration support device 200 may analyze the captured image to calculate surrounding road information and traffic volume information. In that case, the registration unit 235 registers the surrounding road information and traffic volume information together with the captured image in the hazard map information DB 11, associating them with the registered location.

[0025] Figure 3 is a block diagram showing the configuration of the information registration support device 200 according to this embodiment 1. The information registration support device 200 is connected to the camera 21 and the wireless communication unit 22. Figure 3 illustrates the case where the information registration support device 200 is implemented with a single computer. The information registration support device 200 is, for example, an ECU (Electronic Control Unit) when installed in an automobile, but is not limited to this. The information registration support device 200 may also be redundantly implemented with multiple computers, and each functional block may be implemented with multiple computers. Alternatively, all or part of the functions of the information registration support device 200 may be implemented with general-purpose or dedicated circuits such as semiconductor devices.

[0026] The information registration support device 200 comprises a storage unit 210, an IF (Interface) unit 220, and a control unit 230. The storage unit 210 includes a non-volatile storage device such as a hard disk or flash memory, and a memory such as RAM (Random Access Memory), i.e., a volatile storage device. The storage unit 210 stores a program 211, current location information 212, shooting direction 213, registered location information 214, and captured image 215. The current location information 212, shooting direction 213, registered location information 214, and captured image 215 may be temporarily stored in memory. The program 211 is a computer program that implements the processing of the hazard map information registration support method according to this embodiment, and is an example of a hazard map information registration support program.

[0027] Current location information 212 is information indicating the current location of the information registration support device 200, i.e., the mobile body 2. Current location information 212 is location information including latitude and longitude, such as GPS (Global Positioning System) information. Shooting direction 213 is information indicating the direction of shooting of the camera 21. Registered location information 214 is registered location information 110 in the hazard map information DB 11 received from the information management device 1. Note that the information registration support device 200 does not need to acquire all registered location information 110 in the hazard map information DB 11; for example, it may acquire registered location information 110 whose location information 112 is within a predetermined range from the current location information 212 and use that as registered location information 214. Captured image 215 is image data of the scenery outside the mobile body 2, etc., captured by the camera 21. Captured image 215 may be a group of multiple frame images.

[0028] The IF unit 220 is an interface circuit that communicates between the information registration support device 200 and the outside world. Specifically, the IF unit 220 outputs the captured image 215 input from the camera 21 to the storage unit 210 via the control unit 230. The IF unit 220 also communicates between the information registration support device 200 and the information management device 1 via the wireless communication unit 22 and the network N. The IF unit 220 may be implemented, for example, by a general-purpose or dedicated circuit implemented in a semiconductor device.

[0029] The control unit 230 is a control device that controls each component of the information registration support device 200. The control unit 230 is a processor such as a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), or quantum processor (quantum computer control chip). The control unit 230 loads the program 211 from the non-volatile storage device in the storage unit 210 into memory and executes the program 211. In this way, the control unit 230 realizes the functions of the acquisition unit 231, the first determination unit 232, the second determination unit 233, the image processing unit 234, and the registration unit 235. Note that some or all of the acquisition unit 231, the first determination unit 232, the second determination unit 233, the image processing unit 234, and the registration unit 235 may be realized by hardware other than the control unit 230, for example, by general-purpose or dedicated circuits implemented in a semiconductor device.

[0030] The acquisition unit 231 acquires the current location information 212 of the moving object 2 and stores it in the storage unit 210. The acquisition unit 231 also acquires the shooting direction 213 of the camera 21 and stores it in the storage unit 210. The acquisition unit 231 also acquires registered location information 110 within a predetermined range from the hazard map information DB 11 based on the current location information 212 and stores it in the storage unit 210 as registered location information 214. The acquisition unit 231 also acquires the captured image 215 taken by the camera 21 and stores it in the storage unit 210.

[0031] The first determination unit 232 determines whether the registered location information 214 stored in the memory unit 210 is included in the shooting range of the camera 21. Specifically, the first determination unit 232 determines whether the location information of the registered location information 214 is included in the shooting range of the camera 21 based on the current location information 212 and the shooting direction 213. Then, it identifies the location ID and risk level included in the registered location information 214 that is determined to be included in the shooting range.

[0032] If the first determination unit 232 determines that a predetermined registered location is included in the shooting range, the second determination unit 233 determines whether the registration condition RC1, which indicates that the identified risk level is at or above the warning zone level, is met. Furthermore, if the first determination unit 232 determines that a predetermined registered location is included in the shooting range, the second determination unit 233 determines whether the registration condition RC2, which indicates that the distance between the registered location and the surrounding roads included in the surrounding road information calculated by the image processing unit 234 (described later), is below a threshold, is met. Furthermore, if the first determination unit 232 determines that a predetermined registered location is included in the shooting range, the second determination unit 233 determines whether the registration condition RC3, which indicates that the road width of the surrounding roads included in the surrounding road information calculated by the image processing unit 234 (described later), is below a threshold, is met. Note that if all of the above registration conditions RC1 to RC3 are met, the second determination unit 233 executes the processing of the image processing unit 234 and the registration unit 235 (described later). At this time, the order in which the registration conditions RC1 to RC3 are determined does not matter, and they may be determined simultaneously.

[0033] The image processing unit 234 analyzes the captured image 215 taken by the camera 21, calculates surrounding road information for the registered location, and calculates the number of pedestrians and vehicles within a certain processing area of ​​the captured image 215. For example, the image processing unit 234 analyzes the captured image 215 to calculate surrounding road information, including the distance between the slope formed at the registered location and the surrounding roads, and the width of the surrounding roads. The image processing unit 234 also determines the processing area within the captured image 215 from the current location information 212, the shooting direction 213, and the location information of the registered location 214, and calculates traffic volume information from the processing area. Alternatively, for example, the image processing unit 234 may detect a target area for matching using image recognition technology for the captured image 215, and calculate the number of pedestrians and vehicles by matching the detected target area with pre-set shapes of pedestrians and vehicles.

[0034] The registration unit 235 registers the captured image 215, surrounding road information, and traffic volume information in the hazard map information DB 11, associating them with the registration location. Specifically, the registration unit 235 transmits a registration request to the information management device 1 via the network N, which includes the captured image 215, the surrounding road information and traffic volume information calculated by the image processing unit 234, and the location ID of the registration location information 214. The registration request is an instruction message to register the location ID 111 specified in the hazard map information DB 11, associating it with the captured image 120, surrounding road information 130, and traffic volume information 140.

[0035] Figure 4 is a flowchart showing the flow of the hazard map information registration support method according to this embodiment 1. Here, the mobile body 2 is assumed to be an automobile, and it is assumed to be traveling on roads in an area included in the hazard map managed by the hazard map information DB 11. At this time, the acquisition unit 231 acquires current location information such as GPS information via a GPS information receiver and a wireless communication unit 22, which are configured within the mobile body 2 (S101). The acquisition unit 231 then stores the acquired current location information 212 in the storage unit 210.

[0036] Next, the acquisition unit 231 acquires registered location information within a predetermined range from the hazard map information DB 11 based on the current location information 212 (S102). For example, the information registration support device 200 acquires registered location information as follows. First, the acquisition unit 231 transmits a request to acquire registered location information, including the current location information 212, to the information management device 1 via the network N. In response, the receiving unit 12 of the information management device 1 notifies the DB search unit 13 of the received acquisition request. The DB search unit 13 searches the hazard map information DB 11 for location information 112 within a predetermined range centered on the current location information 212 included in the acquisition request, and reads the registered location information 110 corresponding to the searched location information 112 from the hazard map information DB 11. That is, the DB search unit 13 reads from the hazard map information DB 11 a set of location ID 111, location information 112, and risk level 113 within a predetermined range based on the current location information 212 of the moving object 2. The transmission unit 14 then transmits the registered location information 110, which is a set of the read location ID 111, location information 112, and risk level 113, to the information registration support device 200 via the network N. Furthermore, if two or more location information 112 are found, the transmission unit 14 reads the corresponding registered location information 110 from the hazard map information DB 11 and transmits each of the two or more found registered location information 110 to the information registration support device 200. Accordingly, the acquisition unit 231 of the information registration support device 200 acquires one or more registered location information 214 within a predetermined range from the current location information 212 and stores them in the storage unit 210.

[0037] After step S102, the acquisition unit 231 acquires the shooting direction of the camera 21 (S103). Specifically, the acquisition unit 231 acquires the direction of the mobile body 2 from a geomagnetic sensor or the like (configuration not shown) within the mobile body 2, identifies the shooting direction 213 of the camera 21 based on the installation position of the camera 21 and the direction, and stores it in the storage unit 210.

[0038] After step S103, the acquisition unit 231 acquires the captured image 215 from the camera 21 (S104) and stores it in the storage unit 210. Note that the timing of acquiring the captured image 215 may be after step S105 or S106.

[0039] After step S104, the first determination unit 232 determines whether the registered location is included in the shooting range of the camera 21 mounted on the mobile body 2 (S105). That is, based on the current location information 212 and the shooting direction 213, the first determination unit 232 determines whether there is any location information included in the shooting range of the camera 21 from among the location information contained in the registered location information 214 stored in the storage unit 210. If it is determined that such location information is included, the first determination unit 232 identifies the registered location information 214 corresponding to the location information included in the shooting range. The first determination unit 232 may determine that two or more registered location information 214 are included in the shooting range of the camera 21.

[0040] Figure 5 is a diagram illustrating the concept of determining whether a registered point is included in the shooting range according to this embodiment 1. Here, the current position X is an example of the current position information 212 described above, the registered point B is an example of the position information included in the registered point information 214 described above, and the shooting direction d1 of the camera 21 is a vector from the current position X to the midpoint of the shooting range w of the camera 21. Specifically, first, the first determination unit 232 calculates the distance XB between the current position X and the registered point B and the registered point direction d2. Note that the method for calculating the distance and direction between two points using latitude and longitude can be a known technique, for example, the geodesic navigation algorithm. The registered point direction d2 is a vector having a direction from the current position X to the registered point B, that is, a direction. Then, if the distance XB is less than or equal to a predetermined distance, the first determination unit 232 calculates the angle θ2 between the shooting direction d1 of the camera 21 and the registered point direction d2. Note that the predetermined distance is the length of the vector of the shooting direction d1 and is set in advance. The first determination unit 232 may calculate the angle θ2 regardless of whether the distance XB is less than or equal to a predetermined distance. The first determination unit 232 then determines that the registered point B is included in the shooting range w if the angle θ2 is within a predetermined registered point determination angle θ. The registered point determination angle θ is assumed to be set in advance. For example, in a triangle formed by connecting the current position X to both ends of a straight line corresponding to the shooting range w, which is a distance of the vector length of the shooting direction d1 from the current position X, half of the angle θ1 at the current position X may be set as the registered point determination angle θ.

[0041] Returning to Figure 4, the explanation continues. If it is determined in step S105 that the registered location is included in the shooting range, the second determination unit 233 determines whether the risk level of the registered location is at or above the warning zone (S106). For example, if the risk level indicates the level of risk of landslides at the registered location, the second determination unit 233 determines whether the risk level of the registered location information 214 included in the shooting range is "1" or higher. Note that the risk level to be determined is not limited to warning zones or "1".

[0042] If the danger level is determined to be above the warning zone level in step S106, the image processing unit 234 analyzes the captured image 215 and calculates surrounding road information for the registered location (S107). Specifically, the image processing unit 234 identifies roads within a predetermined distance from the registered location as surrounding roads and calculates the distance between the registered location and the identified surrounding roads, as well as the width of the identified surrounding roads. For example, the image processing unit 234 may use a technique to create a three-dimensional map from the captured image 215 to calculate the distance between the registered location and the surrounding roads, and the width of the surrounding roads. Note that known techniques, such as SLAM (Simultaneous Localization and Mapping) technique, may be used for creating the three-dimensional map. Also, as a prerequisite, the mobile body 2 may be equipped with a distance measuring sensor in a configuration not shown. Specifically, the image processing unit 234 binarizes the captured image 215, extracts feature points from the binarized image, measures the distance to the extracted feature points with the distance measuring sensor, and creates a three-dimensional map based on the distance between the feature points. The image processing unit 234 then detects slopes formed at the registered location from a set of feature points in the three-dimensional map, and also detects the shape of the surrounding roads at the registered location. The image processing unit 234 then calculates the distance between the three-dimensional coordinate set of the slope boundary and the three-dimensional coordinate set of the surrounding road boundary, for example, the shortest distance or the average distance, as the distance between the registered location and the surrounding roads. The image processing unit 234 also calculates the road width of the surrounding roads at the registered location from the three-dimensional coordinate set of the detected surrounding road shapes. Note that the calculation of surrounding road information may be performed using methods other than the method of calculating surrounding road information from the captured image 215 as described above. For example, the image processing unit 234 may calculate surrounding road information using hazard maps or surrounding road information and traffic volume information that are pre-registered for each registered location.

[0043] Figure 6 schematically shows an example of an aerial view of the relationship between the vehicle, the registered point, and the surrounding roads according to this embodiment 1. It shows that the registered point A is within the slope 41, and that there is a surrounding road r1 of the slope 41, with sidewalks r21 and r22 on both sides of the surrounding road r1, with other vehicles C1 and C2 on the surrounding road r1, pedestrians U1, U2 and U3 on sidewalk r21, and pedestrian U4 on sidewalk r22. In this example, the image processing unit 234 calculates the shortest distance Ar1 between the slope 41 of the registered point A and the surrounding road r1, and the road width r1d of the surrounding road r1. Alternatively, the image processing unit 234 may calculate the shortest distance between the registered point A and the surrounding road r1 instead of the shortest distance Ar1. The road width may also be the combined width of the surrounding road r1 and sidewalks r21 and r22.

[0044] Returning to Figure 5, the explanation continues. After step S107, the second determination unit 233 determines whether the distance between the registered point and the surrounding road is below a threshold (S108). For example, the second determination unit 233 determines whether the distance between the registered point and the surrounding road, calculated in step S107 for the registered point information 214 included in the shooting range, is 7m or less. Note that the threshold for the distance to be determined is not limited to 7m.

[0045] If step S108 determines that the distance between the registered point and the surrounding road is below a threshold, the second determination unit 233 determines whether the width of the surrounding road is below a threshold (S109). For example, the second determination unit 233 determines whether the width of the surrounding road, calculated in step S107 for the registered point information 214 included in the shooting range, is 6m or less. Note that the threshold for the road width to be determined is not limited to 6m.

[0046] If the image processing unit 234 determines in step S109 that the width of the surrounding roads is below a threshold, it determines the processing range of the captured image 215 (S110). Referring to Figure 6, for example, the image processing unit 234 calculates the angle θ3 between the shooting direction d1 of the camera 21 and the direction d3 of the registered point A, starting from the current position X. The image processing unit 234 determines the processing range w1 as the range where both ends in the horizontal direction are at a predetermined processing range determination angle δ, with the direction d3 of the registered point A as the center, starting from the current position X. Here, the processing range determination angle δ is calculated to be less than or equal to the difference between the registered point determination angle θ and the angle θ3. Figure 7 is a schematic diagram showing an example of a captured image and processing range w1 by the camera according to this embodiment 1. It shows that the processing range w1 is a part of the shooting range w.

[0047] Furthermore, the image processing unit 234 may determine the processing range using a predetermined number of pixels instead of the processing range determination angle δ. For example, the image processing unit 234 identifies the pixel corresponding to the center of registered point A in the captured image as the center point. Then, the image processing unit 234 may determine the processing range as the range of a predetermined number of pixels from the center point in the captured image.

[0048] After step S110, the image processing unit 234 calculates traffic volume information from the processing range w1 (S111). In the example in Figure 7, the captured image shows four pedestrians, U1 to U4, but since pedestrian U4 is outside the processing range w1, the image processing unit 234 calculates the number of pedestrians as "3" (pedestrians U1 to U3) and the number of vehicles as "2" (other vehicles C1 and C2). However, since the mobile vehicle 2 itself is also traveling on the surrounding road r1 of registered point A, it is desirable for the image processing unit 234 to add its own vehicle's "1" to the detected number of vehicles "2" to calculate the number of vehicles as "3".

[0049] Subsequently, the registration unit 235 registers the captured image, surrounding road information, and traffic volume information in the hazard map information DB 11, associating them with the registration location (S112). Specifically, the registration unit 235 selects the captured image 215 acquired in step S104, the surrounding road information calculated in step S107, and the traffic volume information calculated in step 111 as the registration targets. The registration unit 235 then generates an instruction message as a registration request, associating the registration targets with the registration location information 214 determined to be included in the shooting range in step S105. In other words, the registration request includes the captured image, surrounding road information, traffic volume information, and the location ID. The registration unit 235 then transmits the registration request to the information management device 1 via the network N.

[0050] In response, the receiving unit 12 of the information management device 1 receives a registration request from the information registration support device 200 via the network N. The DB update unit 15 then updates the hazard map information DB 11 by associating the captured image 120, surrounding road information 130, and traffic volume information 140 included in the received registration request with the location ID 111. In other words, hazard map information is registered from the information registration support device 200 to the hazard map information DB 11.

[0051] Figure 8 shows an example of surrounding road information 130 registered in the hazard map information DB 11 according to this embodiment 1. The surrounding road information 130 is associated with each point ID 111 and exemplifies, but is not limited to, the presence or absence of surrounding roads, the distance between the registered point corresponding to point ID 111 and the surrounding roads, and the width of the surrounding roads. Note that point ID "D" means there are "no" surrounding roads. For example, if the answer is NO in step S108 or S109 in Figure 4, the registration unit 235 may send a registration request to the information management device 1 that includes the distance to the surrounding roads, the road width, and "no" surrounding roads. Also, if the answer is NO in step S106 in Figure 4, step S107 may be executed, and the registration unit 235 may send a registration request to the information management device 1 that includes "no" surrounding roads in the surrounding road information, as described above.

[0052] Figure 9 shows examples of traffic volume information 140a and 140b registered in the hazard map information DB11 according to this embodiment 1. Traffic volume information 140a is associated with each of the location IDs 111 and exemplifies the date and time, number of pedestrians, and number of vehicles, but is not limited to these. Traffic volume information 140a is traffic volume information data for each image captured by the camera 21. On the other hand, traffic volume information 140b is an example of the statistical processing results of traffic volume information for each date and time, or the average value for each time period. For example, when the mobile vehicle 2 is traveling near a specific registered location, it may be able to capture images including the registered location multiple times within a predetermined time. In that case, the image processing unit 234 may perform statistical processing on multiple traffic volume information calculated from each of the multiple captured images including the same registered location, and calculate the average number of pedestrians and the average number of vehicles for each time period. Alternatively, the image processing unit 234 may select some of the multiple traffic volume information calculated from the same registered location, and the registration unit 235 may register the selected traffic volume information 140a in the hazard map information DB11. For example, the image processing unit 234 may select traffic volume information calculated from images in which the same registered location is included in the shooting range and the degree of agreement between the shooting direction d1 and the registered location direction d2 is high, for example, from the image with the smallest angle θ2. Alternatively, the image processing unit 234 may select traffic volume information with the largest number of pedestrians or vehicles from among multiple traffic volume information calculated from the same registered location. The hazard map information DB 11 may store either one of the traffic volume information 140a and 140b, or both.

[0053] Thus, in this embodiment, when a camera mounted on a moving vehicle passing near a registered location that has been pre-registered in the hazard map information DB captures the direction of the registered location, if the degree of danger of the registered location and the surrounding road information contained in the captured video or image meet predetermined registration conditions, it is possible to support the registration of at least the captured image in the hazard map information DB. As a result, more captured images than necessary are not registered, making it easier to maintain accuracy when creating a hazard map using the registered hazard map information. In other words, by narrowing down the captured images to be registered, the number of times the captured images are compared with dangerous locations is reduced, thereby reducing the burden of hazard map creation work.

[0054] Furthermore, by registering surrounding road information calculated from images taken at specific locations, real-time conditions at registered locations can be quantified and used for analysis and damage prediction. In particular, the more areas designated as prone to landslides and the narrower the surrounding roads, the higher the probability that human intervention will be required in the event of a landslide, making image acquisition highly necessary.

[0055] Furthermore, by registering pedestrian and vehicle traffic volume information calculated from images taken at specific locations, real-time conditions at registered locations can be quantified and easily used for analysis and damage prediction. In other words, it is possible to predict damage when a disaster is likely to occur or when a disaster actually occurs, and utilize this information for disaster prevention measures and rescue operations. Specifically, when it is anticipated that vehicle traffic will be blocked due to landslides, etc., it is possible to predict congestion and the number of vehicles that will need to detour based on traffic volume information, and to secure necessary detours in advance. Also, when patrolling dangerous areas when a landslide is likely to occur, it becomes possible to determine priorities in conjunction with other levels of danger. In addition, when a landslide occurs and pedestrians or vehicles are caught in it, the size of the rescue team to be dispatched can be estimated in advance, enabling a rapid response in the event of a disaster. Moreover, by accumulating images, surrounding road information, and traffic volume information, it becomes easier to grasp the actual situation at registered locations over a certain period using objective indicators.

[0056] <Other Embodiments> Furthermore, the processing order of steps S106 to S109 in Figure 4 described above is not limited to this. For example, after determining in step S105 that the registered point is included in the shooting range, surrounding road information may be calculated in step S107, and steps S106, S108, and S109 may be executed in any order or in parallel, and the process may proceed to step S110 if all the conditions in steps S106, S108, and S109 are met.

[0057] Furthermore, during a predetermined time period, images including the same registered location may be captured by cameras 21 of different mobile devices 2, traffic volume information may be calculated, and registered in the hazard map information DB 11. In that case, the information management device 1 may perform statistical processing on multiple traffic volume information 140a associated with the same location ID for each time period to calculate traffic volume information 140b and update the hazard map information DB 11.

[0058] Furthermore, the information registration support device 200 may have a built-in hazard map information DB. In that case, the acquisition unit 231 directly searches the built-in hazard map information DB in step S102 of Figure 4 to obtain registration point information within a predetermined range from the current location information. The registration unit 235, instead of sending a registration request, directly registers the captured images, etc., to the hazard map information DB. Then, at any time such as after the mobile body 2 has traveled, the information registration support device 200 may transfer the captured images 120, surrounding road information 130, and traffic volume information 140 accumulated during travel to the hazard map information DB 11 in the information management device 1.

[0059] Furthermore, the information registration support device 200 may not be mounted on the mobile body 2, but may reside on the server side. In that case, the in-vehicle device mounted on the mobile body 2 only needs to perform at least the following processing: the in-vehicle device should periodically transmit the captured image, current location information, and shooting direction to the information registration support device 200 via the network N. The information registration support device 200 should then execute the hazard map information registration support method described above based on the captured image, current location information, and shooting direction received from the in-vehicle device.

[0060] Although the present invention has been described above in accordance with the above embodiments, the present invention is not limited to the configuration of the above embodiments, and of course includes various modifications, alterations, and combinations that can be made by a person skilled in the art within the scope of the claims of the present patent application.

[0061] Although the above embodiments were described as hardware configurations, the invention is not limited thereto. This disclosure can also be implemented by having the CPU execute computer programs to perform any desired processing.

[0062] In the examples described above, the program includes a set of instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more of the functions described in the embodiments. The program may be stored on a non-temporary computer-readable medium or a physical storage medium. Examples, but not limited to, include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray® disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The program may be transmitted over a temporary computer-readable medium or a communication medium. Examples, but not limited to, include temporary computer-readable medium or a communication medium that includes electrically, optically, acoustically or otherwise propagating signals. [Explanation of Symbols]

[0063] 1000 Hazard Map Creation Support System 1 Information management device 11. Hazard Map Information Database 110 Registered location information 111 Point ID 112 Location information 113 Danger Level 120 captured images 130 Surrounding Road Information 140 Traffic information 12 Receiver 13 DB Search Section 14. Transmitter 15 DB update section N Network 2 Mobile Units 21 Cameras 22 Wireless Communication Section 200 Information Registration Support Device 210 Storage section 211 Programs 212 Current location information 213 Shooting direction 214 Registered Location Information 215 Captured Images 220 IF section 230 Control Unit 231 Acquisition Department 232 1st Judgment Section 233 Second Judgment Section 234 Image Processing Unit 235 Registration Department

Claims

1. A first determination unit determines whether the registered location is included in the shooting range of the shooting device mounted on the mobile body, based on the registered location pre-registered in the database and the current location of the mobile body. If the aforementioned registered location is included, a second determination unit determines whether the image captured by the camera at the current location satisfies the registration conditions based on the degree of disaster risk at the registered location and surrounding road information, which is information about roads in the vicinity of the registered location. An information registration support device equipped with the following features.

2. Computers A first determination step involves determining whether the registered location is included in the shooting range of the shooting device mounted on the mobile body, based on the registered location pre-registered in the database and the current location of the mobile body. If the aforementioned registered location is included, a second determination step is to determine whether the image captured by the camera at the current location satisfies the registration conditions, based on the degree of disaster risk at the aforementioned registered location and surrounding road information, which is information about roads located around the aforementioned registered location. A method for supporting information registration.

3. A first determination step involves determining whether the registered location is included in the shooting range of the shooting device mounted on the mobile body, based on the registered location pre-registered in the database and the current location of the mobile body. If the aforementioned registered location is included, a second determination step is to determine whether the image captured by the camera at the current location satisfies the registration conditions, based on the degree of disaster risk at the aforementioned registered location and surrounding road information, which is information about roads located around the aforementioned registered location. An information registration support program that instructs a computer to perform the following actions.

Images