Information collection system and learning data collection method

Abstract

To efficiently perform secondary disaster monitoring at a disaster site.SOLUTION: The information collection system comprises an information collection device and an information processing device. An information collection device includes an image acquisition unit, a sensor unit, and a control unit. The information processing device includes a report creation part. The image acquisition unit acquires image information that is information on an omnidirectional image in a horizontal direction. The sensor unit acquires sensor information including at least information on sound and vibration collected by a plurality of sensors. A predetermined notification condition is set for each of the image information and the sensor information, and when a predetermined number or more of the notification conditions are satisfied, the control unit transmits the image information and the sensor information from before a state in which the predetermined number or more of the notification conditions are satisfied to after the state in which the predetermined number or more of the notification conditions are satisfied ends to the information processing apparatus as abnormality information. The report creation unit creates a report based on the abnormality information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information collection system and a learning data collection method for disaster prevention. [Background technology]

[0002] Page 52 of Non-Patent Document 1 and page 2 of Non-Patent Document 2 show examples of installing surveillance cameras to monitor secondary damage during disasters. Non-Patent Document 3 shows that a GPS (Global Positioning System) has been installed near the starting point of the Atami debris flow to detect collapses. The omnidirectional camera device shown in Patent Document 1 is known as prior art suitable for monitoring surrounding conditions. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-52151 [Non-patent literature]

[0004] [Non-Patent Document 1] Ministry of Land, Infrastructure, Transport and Tourism, "Damage and Response in the 2024 Noto Peninsula Earthquake," April 2024, [Retrieved July 17, 2024], Internet<https: / / www.mlit.go.jp / common / 001732467.pdf> . [Non-patent document 2] Ministry of Land, Infrastructure, Transport and Tourism, “Response to the Debris Flow Disaster that Occurred in the Izuyama Aioujo River, Atami City, Shizuoka Prefecture,” July 6, 2021, [Retrieved July 17, 2024], Internet: https: / / www.mlit.go.jp / river / sabo / jirei / r3dosha / 210703_aizomegawa_taioujoukyou.pdf. [Non-patent document 3] Sankei Shimbun, "GPS installed near origin of Atami debris flow to detect collapses," July 21, 2021, [Retrieved July 17, 2024], Internet: https: / / www.sankei.com / article / 20210721-CHSCR6BXLFPP5N277P4QPC7654 / . Summary of the Invention [Problem to be solved by the invention]

[0005] However, conventional technologies have only been able to install existing cameras or sensors individually, and have not been able to efficiently monitor disaster sites. The present invention aims to efficiently monitor secondary disasters at disaster sites. [Means for solving the problem]

[0006] The information collection system of the present invention comprises an information collection device and an information processing device. The information collection device comprises an image acquisition unit, a sensor unit, a collection and recording unit, a collection and communication unit, and a control unit. The information processing device comprises a processing and communication unit, a report creation unit, and a processing and recording unit. The image acquisition unit acquires image information, which is information on images in all horizontal directions. The sensor unit acquires sensor information including at least sound and vibration information collected by multiple sensors. The collection and recording unit records the image information and sensor information. The collection and communication unit communicates with the information processing device. The control unit sets predetermined notification conditions for each of the image information and the sensor information, and when a predetermined number of notification conditions or more are met, transmits the image information and sensor information from before the state in which the predetermined number of notification conditions or more are met to after the state in which the predetermined number of notification conditions or more are met as abnormality information to the information processing device. The processing and communication unit communicates with the information collection device. The report creation unit creates a report based on the abnormality information. The processing and recording unit records the abnormality information and the report. [Effects of the Invention]

[0007] According to the information collection system of the present invention, predetermined notification conditions are set for each of image information and sensor information, and when a predetermined number of notification conditions are met, the image information and sensor information are transmitted as abnormality information to an information processing device from before an abnormal condition occurs until after the abnormal condition ends. The information processing device then creates a report. Therefore, secondary disaster monitoring can be performed efficiently. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of the functional configuration of an information collection system according to the present invention. [Figure 2] FIG. 2 is an exploded perspective view of the exterior of the information collection device 100. [Figure 3] FIG. 2 is a diagram showing an example of a processing flow of the information collection system of the present invention. [Figure 4] A photograph taken before the debris flow occurred. [Figure 5] Figure showing the first photograph during the debris flow event. [Figure 6] A diagram showing the second photograph during the debris flow. [Figure 7] A photo taken after the debris flow ended. [Figure 8] A diagram showing an example of a report format. [Figure 9] FIG. 10 is a diagram showing the processing flow of a learning data collection method. [Figure 10] FIG. 2 is a diagram showing an example of the functional configuration of a computer. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present invention will be described in detail. Components having the same functions are given the same numbers, and duplicated explanations will be omitted. [Example]

[0010] FIG. 1 shows an example of the functional configuration of an information collection system of the present invention. The information collection system 10 comprises an information collection device 100 and an information processing device 200. The information collection device 100 and the information processing device 200 can communicate with each other via wireless lines. The information collection device 100 comprises an image acquisition unit 110, a sensor unit 120, a collection and recording unit 190, a collection and communication unit 130, a control unit 140, a power supply unit 150, and the like. FIG. 2 is an exploded perspective view of the exterior of the information collection device 100. An omnidirectional camera device is used for the image acquisition unit 110. In FIG. 2, a gap is shown between the housing that houses the sensor unit 120, the control unit 140, and the collection and recording unit 190 and the image acquisition unit 110, but in reality they are connected. The black ring placed in the gap is a cushioning material. 2, there is a gap between the housing that houses the sensor unit 120, control unit 140, and collection and recording unit 190 and the collection and communication unit 130, but in reality they are connected via cushioning material. Also, the collection and communication unit 130 and the power supply unit 150 are actually connected via cushioning material. The information processing device 200 includes a processing and communication unit 210, a report creation unit 220, and a processing and recording unit 290. The information processing device 200 may further include an external information acquisition unit 230, an anomaly information transmission instruction unit 240, and a notification condition change unit 250.

[0011] FIG. 3 shows an example of a processing flow of the information collection system of the present invention. The image acquisition unit 110 acquires image information, which is information on images in all horizontal directions (S110). For example, an omnidirectional camera device such as that shown in Patent Document 1 may be used for the image acquisition unit 110. An information collection device 100 using an omnidirectional camera device such as that shown in FIG. 2 can be installed efficiently because it can be installed without worrying about the orientation of the device. The "images" may be videos or still images taken at regular time intervals. FIG. 4 is a photograph taken before the debris flow occurred, FIG. 5 is a first photograph taken during the debris flow, FIG. 6 is a second photograph taken during the debris flow, and FIG. 7 is a photograph taken after the debris flow ended.

[0012] The sensor unit 120 acquires sensor information including at least sound and vibration information collected by a plurality of sensors (S120). The sensor unit 120 may include a microphone, an accelerometer, and the like. If the sensor unit 120 includes an inertial measurement unit (IMU), acceleration and angular velocity information can also be acquired as sensor information. If the sensor unit 120 further includes a global positioning system (GPS), location information can also be acquired as sensor information. The sensor unit 120 may also acquire information such as temperature, humidity, and atmospheric pressure as sensor information.

[0013] The collecting and recording unit 190 records the image information and the sensor information (S190). The collecting and communicating unit 130 communicates with the information processing device 200 via a wireless line. The power supply unit 150 may be a battery, or may receive power from a commercial power source.

[0014] The control unit 140 has preset notification conditions set for each of the image information and the sensor information. If the sensor unit 120 also acquires information on position, acceleration, and angular velocity as sensor information, the control unit 140 may also set notification conditions for the position, acceleration, and angular velocity. When a predetermined number or more of notification conditions are satisfied, the control unit 140 transmits, as abnormality information, image information and sensor information from before the state in which the predetermined number or more of notification conditions are satisfied to after the state in which the predetermined number or more of notification conditions are satisfied has ended to the information processing device 200 (S140). Figure 4 corresponds to image information in which a predetermined number or more of notification conditions are satisfied. Figures 5 and 6 correspond to image information in which a predetermined number or more of notification conditions are satisfied. Figure 7 corresponds to image information after the state in which a predetermined number or more of notification conditions are satisfied has ended.

[0015] For example, the "predetermined number" is set to 2. Then, buildings that are likely to collapse in the initial earthquake disaster are designated on the screen showing the image information. The notification condition for the image information is the movement of the object designated on the screen. The notification condition for the sound sensor information is that the volume is above a threshold. The notification condition for the vibration sensor information is that the vibration is above a threshold. By setting in this way, abnormal information from before the building collapses to after the collapse can be transmitted to the information processing device 200 from the image information, sound sensor information, or vibration sensor information. The above explanation was given as an example of a building collapsing, but if the ground surface is sinking, the ground surface can be designated on the screen.

[0016] For example, the "predetermined number" is set to 2. When there is a possibility that another debris flow will occur following the first one, the notification condition for the image information is set to the movement of an object in a certain direction on the screen displaying the image information. The notification condition for the sound sensor information is set to the volume being equal to or greater than a threshold value. The notification condition for the vibration sensor information is set to the vibration being equal to or greater than a threshold value. By setting the conditions in this way, the information on the next debris flow shown in Figures 4 to 7 can be transmitted to the information processing device 200 as abnormality information.

[0017] For example, the "predetermined number" may be set to 1. The notification condition for the image information may be the appearance of an object of a predetermined size or larger that does not exist on the initial screen. By setting it in this way, it is possible to monitor the intrusion of suspicious people or animals into evacuation areas, and transmit the information as abnormality information to the information processing device 200.

[0018] The processing and communication unit 210 of the information processing device 200 communicates with the information collecting device 100 via a wireless line. The report creation unit 220 creates a report based on the anomaly information (S220). FIG. 8 shows an example of a report format. For example, artificial intelligence (AI) called generative AI may be used for the report creation unit 220. When generative AI is used, information that does not need to be included in the report may be set in the report creation unit 220. For example, it may be set (instructed) to summarize only facts and not include speculation. The processing and recording unit 290 records the anomaly information and report (S290).

[0019] The information processing device 200 may also include an external information acquisition unit 230, an anomaly information transmission instruction unit 240, and a notification condition change unit 250. The external information acquisition unit 230 acquires disaster-related information as external information from outside the information collection system 10 (S230). If the external information satisfies a predetermined condition, the anomaly information transmission instruction unit 240 instructs the control unit 140 to transmit image information and sensor information from before to after the time indicated by the external information to the information processing device 200 as anomaly information. For example, the external information acquisition unit 230 acquires earthquake information as external information. Aftershocks occur after a large earthquake. Aftershock information can be obtained from an external information source. If the earthquake information satisfies the predetermined condition, the anomaly information transmission instruction unit 240 instructs the control unit 140 to transmit image information and sensor information from before the earthquake occurred to after its end as anomaly information to the information processing device 200. The "predetermined condition" here can be set based on seismic intensity. For example, the predetermined condition may be an earthquake of magnitude 3 or higher.

[0020] The notification condition change unit 250 instructs the control unit 140 to change the notification conditions or the predetermined number of changes based on external information (S250). The external information acquisition unit 230 acquires weather or precipitation information from outside the information collection system 10. The weather or precipitation information may be past information or a forecast. The notification condition change unit 250 instructs the control unit 140 to change the notification conditions or the predetermined number of changes. For example, if the amount of precipitation so far is at a level that increases the risk of danger, or if a linear precipitation band is forecast, the notification condition change unit 250 may instruct the control unit 140 to lower the threshold value of the notification conditions. Alternatively, the number of notification conditions that must be met may be reduced, for example, from "2" to "1." In situations where there is a high risk of a secondary disaster occurring, a monitoring system that makes it easier to collect information can be established.

[0021] According to the information collection system 10, predetermined notification conditions are set for each of the image information and the sensor information, and when a predetermined number or more of the notification conditions are met, the image information and the sensor information are transmitted as abnormality information to the information processing device 200 from before the abnormal state until after the abnormal state has ended. Then, a report is created by the information processing device. Therefore, secondary disaster monitoring can be performed efficiently.

[0022] <Learning data collection method> It has been explained that a so-called generation AI may be used for the report creation unit 220. Therefore, the collection of learning data for improving the quality of reports will be described. FIG. 9 shows the processing flow of a learning data collection method. The processing and communication unit 210 of the information processing device 200 acquires anomaly information (anomaly information acquisition step S211). The report creation unit 220 of the information processing device 200 creates a report for the anomaly information (report creation step S220). The report creation step S220 may be executed after the report creation unit 220 has ensured a certain level of quality, but may be omitted if the quality is insufficient. When the report creation step S220 is executed, a person corrects the report and creates a learning report (learning report creation step S301). When the report creation step S220 is not executed, a person creates a learning report, which is a correct report for the anomaly information (learning report creation step S302). The anomaly information and the learning report are combined and recorded as learning data in the processing and recording unit 290 (learning data recording step S291).

[0023] The above-described process can be repeated to accumulate learning data. The report creation unit 220 can improve the quality of reports by performing learning processing using the accumulated learning data.

[0024] [Processor, program, recording medium] The functions performed by the components described herein may be implemented in circuitry or processing circuitry, including general-purpose processors, application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), a CPU (a Central Processing Unit), conventional circuits, and / or combinations thereof, programmed to perform the described functions. A processor includes transistors and other circuits and is considered to be circuitry or processing circuitry. A processor may also be a programmed processor that executes programs stored in memory.

[0025] In this specification, a circuitry, unit, or means is hardware that is programmed to realize or performs the described functions, which may be any hardware disclosed herein or any hardware known to be programmed to realize or perform the described functions.

[0026] If the hardware is a processor considered to be a type of circuitry, the circuitry, means, or unit is a combination of the hardware and software used to configure the hardware and / or processor.

[0027] The various processes described above can be implemented by loading a program that executes each step of the above method into the recording unit 2020 of the computer 2000 shown in Figure 10, and operating the control unit 2010, input unit 2030, output unit 2040, display unit 2050, etc.

[0028] The program describing the processing contents can be recorded on a computer-readable recording medium, which may be, for example, a magnetic recording device, an optical disk, a magneto-optical recording medium, a semiconductor memory, or any other suitable recording medium.

[0029] The program may be distributed, for example, by selling, transferring, lending, etc. a portable recording medium such as a DVD or CD-ROM on which the program is recorded. Furthermore, the program may be stored in a storage device of a server computer, and then transferred from the server computer to another computer via a network, thereby distributing the program.

[0030] A computer that executes such a program may first temporarily store the program recorded on a portable recording medium or transferred from a server computer in its own storage device. Then, when executing a process, the computer reads the program stored on its own recording medium and executes the process in accordance with the read program. Alternatively, the computer may read the program directly from a portable recording medium and execute the process in accordance with the program. Furthermore, the computer may execute the process in accordance with the program each time a program is transferred from a server computer to the computer. The server computer may not transfer the program to the computer, but may instead execute the process through a so-called ASP (Application Service Provider) service, which realizes the processing function by issuing an execution instruction and obtaining the results. Furthermore, the server computer may execute the process on a terminal using a so-called SaaS (Software as a Service) service, which allows users to use part of the server computer along with the program. In this embodiment, the program includes information used for computer processing that is equivalent to a program (such as data that is not a direct instruction to the computer but has properties that define computer processing).

[0031] Furthermore, in this embodiment, the device is configured by executing a predetermined program on a computer, but at least a part of the processing contents may be realized by hardware. [Explanation of symbols]

[0032] 10 Information collection system 100 Information collection device 110 Image acquisition unit 120 Sensor unit 130 collection and communication unit 140 control unit 150 Power supply unit 190 Acquisition and recording unit 200 Information processing equipment 210 Processing and communication department 220 Report Creation Department 230 External Information Acquisition Department 240 Anomaly information transmission instruction unit 250 Notification condition change unit 290 Processing Record Section

Claims

1. An information collection system including an information collection device and an information processing device, The information collection device an image acquisition unit that acquires image information that is information on an image in all horizontal directions; a sensor unit that acquires sensor information including at least sound and vibration information collected by a plurality of sensors; a collection and recording unit that records the image information and the sensor information; a collection and communication unit that communicates with the information processing device; a control unit that, when predetermined notification conditions are set for the image information and the sensor information and a predetermined number or more of the notification conditions are satisfied, transmits, to the information processing device, the image information and the sensor information from before the state in which the predetermined number or more of the notification conditions are satisfied to after the state in which the predetermined number or more of the notification conditions are satisfied has ended, as abnormality information; Equipped with The information processing device a processing and communication unit that communicates with the information collection device; a report creation unit that creates a report based on the abnormality information; a processing and recording unit that records the abnormality information and the report; Equipped with An information collection system comprising:

2. 2. The information collection system according to claim 1, The information processing device includes: an external information acquisition unit that acquires disaster-related information from outside as external information; an anomaly information transmission instruction unit that instructs the control unit to transmit, to the information processing device, the image information and the sensor information from before to after the time indicated by the external information, as anomaly information, when the external information satisfies a predetermined condition; This information gathering system also includes:

3. 2. The information collection system according to claim 1, The information processing device includes: an external information acquisition unit that acquires disaster-related information from outside as external information; a notification condition change unit that instructs the control unit to change the notification condition or the predetermined number based on the external information; This information gathering system also includes:

4. 2. The information collection system according to claim 1, The information processing device includes: an external information acquisition unit that acquires earthquake information; an anomaly information transmission instruction unit that instructs the control unit to transmit, to the information processing device, the image information and the sensor information from before the earthquake occurred until after the earthquake ended as anomaly information when the earthquake information satisfies a predetermined condition; This information gathering system also includes:

5. 2. The information collection system according to claim 1, The information processing device includes: an external information acquisition unit that acquires weather or precipitation information; a notification condition change unit that instructs the control unit to change the notification condition or the predetermined number; This information gathering system also includes:

6. 2. The information collection system according to claim 1, The sensor unit also acquires information on position, acceleration, and angular velocity as sensor information, The control unit also has notification conditions set for position, acceleration, and angular velocity. An information collection system comprising:

7. 2. The information collection system according to claim 1, The image acquisition unit includes an omnidirectional camera device. An information collection system comprising:

8. 2. The information collection system according to claim 1, The report creation section sets information that does not need to be included in the report. An information collection system comprising:

9. A learning data collection method using the information collection system according to any one of claims 1 to 8, an abnormality information acquisition step in which the information processing device acquires the abnormality information; a learning report creation step in which a person creates a learning report that is a correct report for the abnormality information; a learning data recording step of combining the abnormality information and the learning report and recording the combined data as learning data in the processing and recording unit; A learning data collection method to perform.

10. A learning data collection method using the information collection system according to any one of claims 1 to 8, an abnormality information acquisition step in which the information processing device acquires the abnormality information; a report creation step in which the information processing device creates a report on the abnormality information; a learning report creation step in which a person corrects the report and creates a learning report; a learning data recording step of combining the abnormality information and the learning report and recording the combined data as learning data in the processing and recording unit; A learning data collection method to perform.

Images