Damage assessment information system, server device and program

The damage determination information system addresses ambiguity in disaster damage assessments by using image recognition and machine learning to confirm and register damage results, improving satisfaction and efficiency in residential damage surveys.

JP7629021B2Active Publication Date: 2025-02-12FUJIFILM CORP

Patent Information

Application Number
JP2022551947
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-09-23
Filing Date
2021-09-17
Publication Date
2025-02-12
Estimated Expiration
2041-09-17

AI Technical Summary

Technical Problem

The existing residential damage certification surveys for disaster damage assessment face challenges due to ambiguity in damage criteria, leading to uncertain investigator decisions, lengthy investigation times, high costs, and resident dissatisfaction, often necessitating secondary surveys that can overturn primary results, increasing the burden on local governments and residents.

Method used

A damage determination information system comprising a server device and terminal device that manages and displays disaster images related to provisional damage assessments, allowing investigators and residents to confirm and register damage determination results using image recognition and machine learning, reducing ambiguity and the need for secondary surveys.

Benefits of technology

The system enhances satisfaction with damage assessment results, reduces investigation costs, and minimizes variations in damage determination by providing objective information and past disaster images for reference, thereby shortening survey times and minimizing unnecessary secondary investigations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007629021000001
    Figure 0007629021000001
  • Figure 0007629021000002
    Figure 0007629021000002
  • Figure 0007629021000003
    Figure 0007629021000003
Patent Text Reader

Abstract

Provided are a damage assessment information system, a server device, a terminal device, and a program that can bring about at least one among an improved sense of understanding with respect to a damage assessment result, a reduction of inspection costs, and a reduction in discrepancies between damage assessment results by a plurality of inspectors. A preliminary damage assessment result is acquired, and a server device extracts a plurality of disaster images associated with the preliminary damage assessment result from a disaster image database (15) and displays the extracted disaster images on a display device of a terminal device. The input of an instruction to confirm a damage assessment result is received from the terminal device on which the disaster images are displayed, and the confirmed damage assessment result is registered in a damage inspection result database (17).
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a damage assessment information system, a server device, a terminal device and a program, and more particularly to an information processing technique for supporting assessment of the extent of damage to disaster-stricken buildings. [Background technology]

[0002] When a disaster occurs, local governments conduct residential damage certification surveys to determine the extent of damage to affected houses in order to issue disaster damage certificates. Patent Document 1 describes a damage survey system that allows even those who do not have the knowledge to determine the extent of damage to affected objects to collect information necessary to certify the extent of damage to affected objects in the affected area and send that information to non-affected locations. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-165906 A Summary of the Invention [Problem to be solved by the invention]

[0004] The residential damage assessment survey for the purpose of issuing disaster damage certificates is conducted by determining the damage to buildings by integrating survey items subdivided by the structure and parts of the building in accordance with the "Disaster Damage Assessment Criteria" and "Guidelines for the Operation of Disaster-Related Housing Damage Assessment Criteria" issued by the Cabinet Office. Therefore, it is not realistic for the general staff who conduct the survey to understand all of these items and standards. In addition, there is an ambiguity in the standards for determining the degree of damage, which is an issue in damage assessment.

[0005] This makes it difficult for investigators to classify the extent of the damage, and they have to check with the coordinator or get the agreement of the investigation team to make a decision, which leads to longer investigation times for each case.

[0006] Furthermore, the vagueness of the criteria for assessing the extent of damage also affects residents' satisfaction with the assessment results. The assessment results can lead to differences in the amount of reconstruction support that residents receive, and if the municipality is unable to provide evidence that allows residents to accept the assessment results, reinvestigations will be required, leading to increased investigation costs for the municipality.

[0007] There are two types of residential damage assessment surveys: a primary survey, in which investigators determine the extent of damage based only on the exterior of the building, and a secondary survey, in which, upon request from the victims, investigators also check the interior conditions in the presence of the affected residents to determine the extent of damage. If the residents are not satisfied with the results of the primary survey conducted by the local government, a secondary survey will be conducted.

[0008] However, the secondary survey takes twice as long as the primary survey, and if a large number of surveys are conducted, this leads to delays in issuing disaster certificates, placing a heavy burden on both local governments and residents. In addition, the number of cases in which the results of the primary survey are overturned in the secondary survey is roughly around 30% (less than 40%), depending on the type of disaster and the region.

[0009] In the Kumamoto earthquake that occurred in 2016, secondary surveys were conducted on 57,251 cases, which was about 30% of the total number of residential damage certification surveys, and the number of cases in which the determination was overturned after the secondary survey was conducted was less than 40%. It is desirable for local governments to reduce the number of secondary surveys conducted for houses where the determination cannot be overturned even after the secondary survey.

[0010] On the other hand, from the residents' perspective, there is little information to determine the extent of damage to their homes, and the results of the damage assessment affect the amount of support money, so in many cases they simply apply for a secondary survey. Therefore, it is a challenge for local governments to provide residents with objective information regarding the assessment of the extent of damage to affected homes, and reduce the number of cases that result in applications for a secondary survey. In this regard, Patent Document 1 does not mention any measures to obtain satisfactory damage assessment results without conducting the survey itself.

[0011] The present invention has been made in consideration of the above circumstances, and aims to provide a damage assessment information system, server device, terminal device, and program that can achieve at least one of the following: increased satisfaction with damage assessment results, reduced investigation costs for local governments and the like, and reduced variation in damage assessment results among multiple investigators. [Means for solving the problem]

[0012] A damage assessment information system according to one embodiment of the present disclosure is a damage assessment information system including a server device that manages damage assessment results for damaged buildings and damage images taken of the damaged buildings corresponding to the damage assessment results, and a terminal device connected to the server device via a network, wherein the server device includes a first processor and a damage image database that stores the damage assessment results and the damage images in correspondence with each other, and the terminal device includes a second processor, a display device, and an input device, wherein the first processor acquires a provisional damage assessment result and extracts a plurality of damage images related to the provisional damage assessment result from the damage image database based on the acquired provisional damage assessment result and provides the extracted plurality of damage images to the terminal device, the second processor displays the extracted plurality of damage images on the display device and accepts input of an instruction to confirm the damage assessment result from the input device, and the first processor registers the confirmed damage assessment result in the damage investigation result database based on an instruction from the terminal device that has displayed the multiple damage images on the display device.

[0013] According to this damage assessment information system, multiple images of the damage that correspond to the obtained provisional damage assessment result are displayed on the display device of the terminal device, allowing the user to confirm the validity of the provisional damage assessment result by referring to these displayed images, and once the user is satisfied with the validity, the damage assessment result can be registered in the damage investigation results database.

[0014] The terminal device may be carried by, for example, an investigator who carries out a damage investigation, or may be installed at a local government office and used to explain the investigation results to disaster-affected residents. According to this embodiment, at least one of the following can be achieved: an improvement in the satisfaction with the damage assessment results, a reduction in the investigation costs of the local government, and a reduction in the variation in the damage assessment results among multiple investigators.

[0015] In a damage assessment information system according to another aspect of the present disclosure, a provisional damage assessment result may be input from an input device of a terminal device.

[0016] In a damage assessment information system relating to another aspect of the present disclosure, at least one of the first processor and the second processor can be configured to obtain a provisional damage assessment result by image recognition from an image showing the building that is the target of damage assessment.

[0017] In a damage assessment information system relating to another aspect of the present disclosure, at least one of the first processor and the second processor can be configured to perform a damage assessment result estimation process that uses an image depicting the building that is the target of damage assessment and building information regarding the structure and parts of the target building as input, and outputs a damage classification of the parts, and the estimation result by the damage assessment result estimation process can be used as a provisional damage assessment result.

[0018] In a damage assessment information system relating to another aspect of the present disclosure, at least one of the first processor and the second processor can be configured to include a trained model that has been subjected to machine learning processing so as to output an estimated damage classification for parts of the target building when an image depicting the target building and building information regarding the structure and parts of the target building are input.

[0019] In a damage assessment information system relating to another aspect of the present disclosure, the damage classification in the damage assessment criteria is set to multiple stages according to the degree of damage, and the multiple damage images related to the provisional damage assessment result can be configured to include damage images belonging to a damage classification of damage level equal to or greater than the input provisional damage assessment result.

[0020] In a damage assessment information system relating to another aspect of the present disclosure, the multiple damage images related to the provisional damage assessment result may be configured to include damage images belonging to a damage classification having the same degree of damage as the input provisional damage assessment result and damage images belonging to a damage classification having a degree of damage one level higher than that of the provisional damage assessment result.

[0021] A server device according to another aspect of the present disclosure is a server device comprising: a damage image database that stores damage assessment results of damaged buildings in correspondence with damage images taken of the damaged buildings corresponding to the damage assessment results; and a first processor, wherein the first processor acquires a provisional damage assessment result, extracts a plurality of damage images related to the provisional damage assessment result from the damage image database based on the acquired provisional damage assessment result, provides the extracted plurality of damage images to a terminal device connected via a network, and registers the final damage assessment result in the damage investigation result database based on instructions from the terminal device that displays the plurality of damage images.

[0022] A terminal device according to another aspect of the present disclosure is a terminal device connected to the server device according to the above aspect via a network, and is equipped with a second processor, a display device, and an input device, and the second processor displays the extracted multiple disaster images on the display device and accepts input of an instruction to confirm the damage assessment result from the input device.

[0023] A program relating to another aspect of the present disclosure enables a computer to perform the following functions: manage a damage image database that stores damage assessment results of damaged buildings in correspondence with damage images taken of the damaged buildings that correspond to the damage assessment results; acquire a provisional damage assessment result; extract a plurality of damage images related to the provisional damage assessment result from the damage image database based on the acquired provisional damage assessment result; provide the extracted plurality of damage images to a terminal device connected via a network; and, after the damage images are displayed on the display device of the terminal device, register the confirmed damage assessment result in a damage investigation result database based on instructions from the terminal device.

[0024] The program according to this embodiment is applied to the server side.

[0025] A program relating to another aspect of the present disclosure is a program for causing a computer to function as a terminal device connected via a network to a server device that manages damage assessment results for damaged buildings and damage images taken of the damaged buildings corresponding to the damage assessment results, and provides the computer with the following functions: a function for acquiring provisional damage assessment results; a function for transmitting the acquired provisional damage assessment results to the server device; a function for acquiring multiple damage images related to the provisional damage assessment results from the server device and displaying the multiple damage images on a display device; and a function for accepting input of an instruction to confirm the damage assessment results after the damage images are displayed. Effect of the Invention

[0026] According to the present invention, it is possible to achieve at least one of the following: increased satisfaction with damage assessment results, reduced investigation costs for local governments, and reduced variation in damage assessment results among multiple investigators. [Brief description of the drawings]

[0027] [Figure 1] FIG. 1 is a functional block diagram showing in outline the functions of a damage assessment information system according to an embodiment of the present invention. [Diagram 2]FIG. 2 is a block diagram showing an example of a network configuration of the damage assessment information system. [Diagram 3] FIG. 3 is a flowchart showing an example of the operation of the damage assessment information system. [Figure 4] FIG. 4 is a block diagram illustrating an example of the configuration of the server device. [Diagram 5] FIG. 5 is a block diagram illustrating an example of the configuration of a terminal device. [Figure 6] FIG. 6 is an example of a screen displayed on the display device of the terminal device. [Figure 7] FIG. 7 shows another example of a screen displayed on the display device of the terminal device. [Figure 8] FIG. 8 is yet another example of a screen displayed on the display device of the terminal device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0028] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0029] <Outline of the Damage Assessment Information System> 1 is a functional block diagram showing in outline the functions of a damage assessment information system 1 according to an embodiment of the present invention. The damage assessment information system 1 includes a server device 10 that performs server-side processing, and a terminal device 20 that performs client-side processing. The terminal device 20 is connected to the server device 10 via a network (not shown).

[0030] The server device 10 manages the damage assessment results for the damaged buildings and the damage images corresponding to the damage assessment results. The damage assessment results here are, for example, the results of assessment of the degree of damage based on a residential damage certification survey, and the damaged buildings are the houses (dwellings) that are the subject of the damage assessment.

[0031] In the case of a housing damage assessment survey due to an earthquake or other cause, the result of the assessment is classified into one of five categories according to the degree of damage to the housing: "total destruction," "large-scale partial destruction," "partial destruction," "quasi-partial destruction," or "not reaching the level of quasi-partial destruction (partial damage)." In addition to earthquakes, disasters can also include floods and wind damage. According to the criteria for the assessment of the degree of damage stated in the "Guidelines for the Application of Disaster Housing Damage Assessment Criteria" (March 2020) issued by the Cabinet Office, "total destruction" is defined as "a housing that has lost its basic function for living, that is, the entire housing has collapsed, been washed away, buried, or burned, or the housing has been so damaged that it is difficult to reuse it as it was by repairing it, specifically, the floor area of ​​the damaged, burned, or washed away part of the housing is 70% or more of the total floor area of ​​the housing, or the economic damage of the main components of the housing is expressed as a percentage of the damage to the entire housing, and the damage rate of the housing is 50% or more."

[0032] "Large-scale partial destruction" is defined as "a home that is partially destroyed and that is difficult to live in without major repairs, including repairs to the main parts that affect its structural strength. Specifically, it is when the damaged area is between 50% and 70% of the home's total floor area, or when the economic damage to the main components of the home is expressed as a percentage of the damage to the entire home, the damage percentage is between 40% and 50%."

[0033] "Partial destruction" is defined as "a dwelling that has lost part of its basic function for habitation, in other words, a dwelling that has been severely damaged but that can be reused as before if repaired. Specifically, it is when the damaged area is between 20% and 70% of the dwelling's total floor area, or when the economic damage to the main components of the dwelling is expressed as a percentage of the damage to the entire dwelling, and the damage percentage is between 20% and 50%."

[0034] "Semi-destroyed" is defined as "a dwelling that has suffered damage equivalent to being half-destroyed or half-burned, specifically, when the damaged area accounts for more than 10% but less than 20% of the dwelling's total floor area, or when the economic damage to the main components of the dwelling is expressed as a percentage of the damage to the entire dwelling, the damage percentage of the dwelling is more than 10% but less than 20%."

[0035] For example, in the case of disasters caused by earthquakes, the degree of damage to damaged houses can be judged based on appearance, tilt, and part of the house. When judging based on appearance, it is stated that "when judging from the exterior of the house, if it appears that the entire house has collapsed, if some floors of the house have collapsed, if the entire house has been washed away or slid down, or if there is significant damage to the foundation due to ground damage caused by the earthquake, the damage rate of the house will be set at 50% or more and it will be judged as totally destroyed."

[0036] In determining the degree of inclination, for example, in the case of a wooden house, "if the inclination of the house is 1 / 20 or more, the damage rate of the house shall be set at 50% or more and it shall be determined to be totally destroyed." Also, "if the inclination of the house is 1 / 60 or more but less than 1 / 20, the damage rate due to inclination may be set at 15% when calculating the damage rate of the house through 'assessment of the parts.'" In addition, the value of inclination is, in principle, the simple average of measurements taken at the four corners of the pillars or walls on the first floor of the house is used.

[0037] In assessing damage by part, the following stipulations are stated: "The damage rate for each part is calculated based on the results of visual inspections of damage to the main components of the dwelling, and the sum of the damage rates for each part obtained by multiplying this damage rate by the component ratio of each part shall be the damage rate for the dwelling." It also stipulates that "If the damage rate for a dwelling is 50% or more, it will be judged as total destruction, if it is between 40% and 50%, it will be judged as major partial destruction, if it is between 20% and 40%, it will be judged as partial destruction, if it is between 10% and 20%, it will be judged as semi-destroyed, and if it is less than 10%, it will be judged as not reaching the level of semi-destroyed (partial damage)."

[0038] According to the above criteria, the degree of damage to the target damaged building is evaluated, and a damage assessment result is given. The five-level damage classification of "total destruction", "large scale destruction", "destruction", "semi-destruction", and "not reaching semi-destruction (partial damage)" is an example of "damage classification in the damage assessment criteria" in this disclosure, and the five levels are an example of "multiple levels" in this disclosure.

[0039] The terminal device 20 has a user interface (UI) that allows input of damage assessment results and display of images such as disaster images. The server device 10 may be a Web server (World Wide Web server), and the terminal device 20 may be configured to include a Web browser.

[0040] The terminal device 20 may be, for example, a mobile terminal device carried to a disaster site by an investigator or the like, or a computer installed at a local government office that accepts applications for disaster damage certificates. The terminal device 20 may also be a smartphone, tablet, or personal computer owned by a resident or the like. Users of the system, including the operator of the terminal device 20, are referred to as "users."

[0041] The damage assessment information system 1 includes a provisional damage assessment result input unit 12, an image search unit 14, a damage image database 15, an image display unit 24, a damage assessment result input unit 26, a damage assessment result registration unit 16, and a damage investigation result database 17. Each of these units is realized by one or more processors of a computer or the like executing program instructions.

[0042] The provisional damage assessment result input unit 12 receives input of provisional damage assessment results and passes the input information of the provisional damage assessment result to the image search unit 14. The provisional damage assessment result input unit 12 is constructed across both the client side and the server side. A user can input provisional damage assessment results through the provisional damage assessment result input unit 12.

[0043] The server side further includes an image search unit 14, a damage image database 15, a damage assessment result registration unit 16, and a damage investigation result database 17. On the other hand, the client side includes an image display unit 24 and a damage assessment result input unit .

[0044] The damage assessment information system 1 receives input of a provisional damage assessment result through the provisional damage assessment result input unit 12, searches for damage images related to the input provisional damage assessment result from the damage image database 15, and displays the damage images extracted as a result of the search on the terminal device 20.

[0045] The user can judge the validity of the provisional damage assessment result previously input by referring to the damage image displayed on the terminal device 20. After checking the damage image displayed on the terminal device 20, the user can input an instruction to confirm the damage assessment result to be registered by accepting the provisional damage assessment result on the terminal device 20 or, if necessary, performing an input operation to change the damage assessment result. Based on the confirmation instruction thus input from the terminal device 20, the server device 10 registers the damage assessment result in the damage investigation result database 17.

[0046] Here, "provisional" means a decision or provisional assumption at a stage before a final instruction is issued, and may be subject to change. "Final" means that a decision is made regarding registration in the Damage Investigation Results Database 17, where the results of the damage investigation are registered, and the registered items in the Damage Investigation Results Database 17 may be changed thereafter through detailed investigations by the government, etc.

[0047] The image search unit 14 performs image search processing to extract one or more, preferably a plurality of, damaged images related to the provisional damage judgment result from the damaged image database 15 based on the provisional damage judgment result inputted via the provisional damage judgment result input unit 12. The damaged images related to the provisional damage judgment result include, for example, at least one of the following, preferably two or more: a damaged image with a damage degree judgment result that is the same as the provisional damage judgment result, a damaged image with a damage degree judgment result that is one level higher than the provisional damage judgment result, and a damaged image with a damage degree judgment result that is one level lower than the provisional damage judgment result. A damaged image that corresponds to the same damage degree classification as the provisional damage judgment result and / or at least one of the classifications before and after the provisional damage judgment result may be expressed as a "damage image with a similar damage judgment result." A judgment result of a classification showing the same or similar damage degree as the provisional damage judgment result may be expressed as a "similar judgment result" to the provisional damage judgment result.

[0048] The damage image database 15 includes a data group in which confirmed damage assessment results for damaged buildings in past disasters are associated with damage images of the damaged buildings corresponding to the damage assessment results. The damage image database 15 includes a plurality of images of damaged buildings corresponding to each damage assessment result. The damage image database 15 may include data in which an image of a damaged house in the current target disaster is linked to a confirmed damage assessment result for the damaged house. The damage image database 15 may also include data in which a damage image linked to information about the structure and / or information about the parts of the damaged building is linked to a value of the damage ratio by part.

[0049] The image search unit 14 provides information on the search results including a plurality of disaster images related to the provisional damage assessment result extracted from the disaster image database 15 to the terminal device 20 via the network.

[0050] The image display unit 24 displays the multiple disaster images extracted by the image search unit 14 together with the corresponding damage assessment results on a display device such as a liquid crystal display or an organic EL display. The user can check, on the display device of the terminal device 20, the disaster images showing the disaster-affected buildings for which the assessment results of the degree of damage equivalent to and / or close to the provisional damage assessment results have been finalized.

[0051] The damage assessment result input unit 26 receives an input of an instruction to confirm the damage assessment result. R An input processing module. The instruction to finalize the damage assessment result may be to input information to approve the provisional damage assessment result, or to directly input the damage assessment result to be finalized as the registration content. A specific input operation method may be, for example, a method of checking a check box, a method of selecting a specific damage assessment result from a candidate list, or a method of inputting text information of the damage assessment result from a keyboard or the like.

[0052] Based on the information from the damage assessment result input unit 26, the damage assessment result registration unit 16 performs a process of linking the address and other information of the damaged building with the damage assessment result for that damaged building and registering them in the damage investigation result database 17. A part or all of the data registered in the damage investigation result database 17 may be incorporated into the damage image database 15.

[0053] 2 is a block diagram showing an example of a network configuration of the damage assessment information system 1. The server device 10 is constructed on a network 30 within an administrative agency such as a local government or outside the administrative agency. The network 30 may be a local area network or a wide area network. The server device 10 may be a cloud server or an on-premise server.

[0054] The damage assessment information system 1 may include a mobile terminal device 20A capable of communicating with the server device 10, and a personal computer (PC) 20B. Each of the mobile terminal device 20A and the PC 20B corresponds to the terminal device 20 described in Fig. 1. Although Fig. 2 shows one each of the mobile terminal device 20A and the PC 20B, the damage assessment information system 1 may include a plurality of mobile terminal devices 20A and a plurality of PCs 20B.

[0055] The mobile terminal device 20A is connected to the server device 10 via a wide area communication line 32 such as the Internet. The mobile terminal device 20A may be a smartphone or a tablet terminal. The PC 20B may be a computer installed on a network 30 of an administrative agency such as a local government. The network 30 and the wide area communication line 32 are examples of a "network" in this disclosure.

[0056] 《Usage example 1》 A first usage example of the damage assessment information system 1 according to the present embodiment will be described. Here, a usage mode for a damage assessment survey by an investigator (e.g., a local government official) will be described. The investigator uses this system when the degree of confidence of the assessment result of the damage level is low during the damage assessment survey.

[0057] The surveyor inputs the structure of the target building, the part of the building being surveyed, and the provisional damage assessment result into the mobile terminal device 20A. If the surveyor is unable to make a provisional damage assessment result by his / her own judgment, an image of the damaged building may be input, a process of estimating the damage assessment result from the image using image recognition technology may be performed, and the estimated damage assessment result may be used as the provisional damage assessment result. For example, an image showing the damaged target building and information on the structure and parts of the target building may be input, and an AI (Artificial Intelligence) that estimates the damage assessment result from the input information may be used to obtain the provisional damage assessment result. The term "estimation" may be replaced with "prediction." The AI ​​that estimates the damage assessment result may be provided in the server device 10. For example, the provisional damage assessment result input unit 12 on the server side may include an AI processing module that receives an image of the damaged building and associated information including the structure and / or parts of the building as input and estimates the damage assessment result.

[0058] The AI ​​that estimates damage assessment results includes a trained model that has been trained to output a damage classification for each part when it receives a damaged image of the target building for which the damage assessment result is to be estimated, the structure of the target building, and information on the estimated damaged parts.

[0059] Information on the "building structure" is, for example, information on whether the structure is wooden or non-wooden. Information on the estimated damaged parts is, for example, information on the roof, foundation, walls, etc. The damage classification of each part is, for example, for the roof, expressed in five levels from damage level I to V.

[0060] Damage classification for each part may follow the Cabinet Office's "Guidelines for the Operation of Disaster-Related Housing Damage Assessment Standards" (March 2020). The output value from the AI ​​that estimates the damage assessment results may be the probability value (score) of being classified into each category, or the classification level may be expressed as a continuous value.

[0061] The learning method for the AI ​​model may be the same as general machine learning methods such as deep learning.

[0062] The image search unit 14 extracts multiple images of damaged buildings related to past assessment cases corresponding to the assessment results before and after the provisional damage assessment result from the input building structure, parts, and provisional damage assessment result from the damage image database 15, and displays them on the mobile terminal device 20A.

[0063] The assessment results before and after the provisional damage assessment result refer to the damage assessment categories before and after the provisional damage assessment result according to the level of damage. For example, if the provisional damage assessment result is "partially destroyed," then "semi-destroyed" is the category one step before (one step below) "partially destroyed," and "large-scale partially destroyed" is the category one step after (one step above) "partially destroyed."

[0064] The image search unit 14 in this embodiment extracts a plurality of disaster images corresponding to the same determination result as the provisional damage determination result and the determination results of the degree of damage before and after the provisional damage determination result, but it is sufficient that the image search unit 14 is configured to extract disaster images corresponding to at least one of the determination results before and after the provisional damage determination result. The range of damage levels to be extracted as images related to the provisional damage determination result may be preset, or may be configured to be appropriately selected by a user operation.

[0065] From the viewpoint of providing images for the investigator's reference, it is preferable that the image search unit 14 extracts multiple damage images corresponding to each of the provisional damage assessment results and the assessment results of the extent of damage before and after the provisional damage assessment results.

[0066] This allows the investigator to check on the screen of the mobile terminal device 20A the damage images corresponding to the damage assessment results of the sections adjacent to the input provisional damage assessment result. From the pairs of assessment results and damage images of the damaged buildings displayed on the mobile terminal device 20A, the investigator selects an assessment result that includes an image with a similar degree of damage to the target building, and selects the target building. building The judgment result can be determined.

[0067] With the damage assessment information system 1 of this embodiment, the investigator can use a group of images registered from previous assessment results as a reference and determine the extent of damage to the target building with a sense of satisfaction.

[0068] This eliminates the need to go through the conventional process of contacting a coordinator or getting a consensus within the investigation team, shortening the investigation time. In addition, by using this system that uses past images as a reference, it is possible to reduce the discrepancy in the judgment results between investigators.

[0069] 《Usage example 2》 Next, a second use example of the damage assessment information system 1 according to this embodiment will be described. Here, a use example of the damage assessment information system 1 in explaining the results of a damage certification survey to residents when issuing a disaster damage certificate will be described. When a local government receives an application for issuing a disaster damage certificate and explains the survey results (primary survey results) conducted by the local government to residents, this system is used for residents who are not convinced by the survey results.

[0070] In this case, the staff member inputs the damage assessment results from the primary survey of the resident's residential building as the "provisional damage assessment result" from the mobile terminal device 20A or PC 20B. If a new image of the residential building is provided by the resident, the image is input, and the damage assessment result (provisional damage assessment result) is obtained using AI that estimates the damage assessment result by combining information such as the building's structure. In particular, if there are any parts of the assessment that the resident is not satisfied with, they can specify those parts as well.

[0071] Based on the provisional damage assessment results and accompanying information such as structural information of the residents' residential buildings (dwellings), the server device 10 extracts multiple images of damaged buildings from the damage image database 15 that belong to a damage category with a degree of damage equal to or greater than the degree of damage in the provisional damage assessment results, and displays them on the mobile terminal device 20A or the PC 20B.

[0072] Residents can check the displayed assessment results and the group of damaged images to determine whether the damage classification of their home is appropriate for the current damage assessment results. If the resident determines that it is appropriate, they express their consent to the damage assessment results by pressing a GUI (Graphical User Interface) button, and then send a notice to the local government certifying that the resident is satisfied with the assessment results. When the local government receives this notice, it becomes possible to issue a disaster damage certificate to the resident.

[0073] This system allows residents to see images of houses that have been judged similarly in the past, allowing them to feel more convinced and to check whether their own judgment results are valid. This system is expected to improve the explanation to residents, improve their sense of satisfaction, and reduce unnecessary secondary surveys.

[0074] Fig. 3 is a flowchart showing an example of the operation of the damage determination information system 1. Each step shown in Fig. 3 is executed by a first processor that executes the processing of the server device 10 or a second processor that executes the processing of the terminal device 20. Each of the first processor and the second processor may be configured to include multiple processors.

[0075] In step S11, the second processor receives an input of a provisional damage assessment result. The second processor can also receive input of information on a damage category indicating the provisional damage assessment result, and can also receive input of an image showing a target building for damage assessment. When an image is input, building information on the structure and parts of the target building may be input in addition to the image.

[0076] The data input through the terminal device 20 is sent via the network to the server device 10. The first processor receives input of data such as provisional damage assessment results via the terminal device 20 and the network.

[0077] Next, in step S12, the first processor determines whether or not the input data includes an image If the determination result in step S12 is Yes, the first processor proceeds to step S13.

[0078] In step S13, the first processor estimates a damage assessment result from the input image by AI image recognition, and obtains a damage classification according to the degree of damage to the target building. The estimated result by this damage assessment result estimation process is used as a provisional damage assessment result. After step S13, or if the judgment result in step S12 is No, the first processor proceeds to step S14.

[0079] In step S14, the first processor uses the provisional damage assessment result as a search key to extract from the damage image database 15 a damage image having a determination result similar to the provisional damage assessment result, and provides the extracted damage image to the terminal device 20. The second processor on the terminal device 20 side reads in the damage image having a determination result similar to the provisional damage assessment result extracted from the damage image database 15, and causes the read-in damage image to be displayed on the display device of the terminal device 20.

[0080] Next, in step S15, the second processor judges whether or not a damage assessment investigation is in progress. For example, as in the above-mentioned "Use Example 1," when an investigator or the like is using this system during an investigation, if the judgment result in step S15 is Yes, the second processor proceeds to step S16 and accepts input of the damage assessment result to be registered. After the damage image extracted from the damage image database 15 is displayed on the display device of the terminal device 20, when the user inputs the damage assessment result via the damage assessment result input unit 26 of the terminal device 20, the input information is sent to the server device 10.

[0081] Then, in step S 17 , the first processor performs a process of registering the damage assessment result inputted via the damage assessment result input unit 26 in the damage investigation result database 17 .

[0082] After step S17, the flow chart of Fig. 3 ends. If the determination result of step S15 is a No determination, steps S16 to S17 may be skipped and the flow chart of Fig. 3 ends.

[0083] Example of the configuration of the server device 10 4 is a block diagram showing an example of the configuration of the server device 10. The server device 10 can be realized by a computer system configured using one or more computers. Various functions of the server device 10 are realized by installing a program in the computer.

[0084] The server device 10 includes a processor 102, a computer-readable medium 104, which is a non-transitory tangible entity, a communication interface 106, an input / output interface 108, a bus 110, an input device 114, and a display device 116. The processor 102 is an example of a first processor. The computer-readable medium 104 may be referred to as a first storage device.

[0085] The processor 102 includes a central processing unit (CPU). The processor 102 may include a graphics processing unit (GPU). The processor 102 is connected to a computer-readable medium 104, a communication interface 106, and an input / output interface 108 via a bus 110. An input device 114 and a display device 116 are connected to the bus 110 via the input / output interface 108.

[0086] The computer-readable medium 104 includes a memory serving as a main storage device and a storage serving as an auxiliary storage device. The computer-readable medium 104 may be, for example, a semiconductor memory, a hard disk drive (HDD) device, a solid state drive (SSD) device, or a combination of a plurality of these.

[0087] The communication interface 106 controls wired and / or wireless communication. The server device 10 is connected to a network 30 (see FIG. 4) via the communication interface 106.

[0088] A plurality of programs and data for performing various processes are stored in the computer-readable medium 104. For example, a damage assessment result estimation program 130, an image search program 134, a damage assessment result registration program 136, a disaster image database 15, and a damage investigation result database 17 are stored in the computer-readable medium 104.

[0089] The damage assessment result estimation program 130 may be configured to include one or more trained AI models (trained models) that have been trained to obtain an output for a target task by applying machine learning such as deep learning. The AI ​​model may be configured, for example, using a Convolutional Neural Network (CNN) having a convolutional layer.

[0090] One of the AI ​​models included in the damage assessment result estimation program 130 may be a trained model that has been subjected to machine learning processing so as to output a damage classification estimated for a part of the target building when an image showing the target building and building information on the structure and part of the target building are input. The damage assessment result estimation program 130 inputs a damage image showing the damaged building, the structure of the target building, and information on the estimated damage part into the AI ​​model, and obtains a predicted value (estimated value) of the damage assessment result of the target building as an output. Such an AI model is trained in advance by machine learning using a data set of learning data in which the input data including the damage image showing the damaged building, the structure of the target building, and information on the damaged part are associated with the damage assessment result confirmed in the actual damage certification survey as a correct answer label. The estimation process executed according to the damage assessment result estimation program 130 is an example of the "damage assessment result estimation process" in this disclosure. It is also possible to create learning data from data registered in the damage investigation result database 17.

[0091] The damage assessment result estimated by the damage assessment result estimation program 130 is passed to the image search program 134 as a "provisional damage assessment result."

[0092] Based on the provisional damage assessment result, the image search program 134 extracts images having assessment results similar to the provisional damage assessment result from the disaster image database 15. The images extracted by the image search program 134 are sent to the terminal device 20 via the communication interface 106.

[0093] The damage assessment result registration program 136 registers information in the damage assessment result database 17 and manages the database. The damage assessment result registration program 136 performs processing to register in the damage assessment result database 17 a damage assessment result input from the terminal device 20 that displays an image of an assessment result similar to a provisional damage assessment result. In this way, a "confirmed damage assessment result" is registered in the damage assessment result database 17. Note that this registered (confirmed) damage assessment result may be changed by a subsequent secondary investigation, etc.

[0094] Processor 102 executes instructions of damage assessment result estimation program 130, whereby processor 102 functions as a processing unit that estimates a damage assessment result by image recognition. Processor 102 also executes instructions of image search program 134 and damage assessment result registration program 136, whereby processor 102 functions as image search unit 14 and damage assessment result registration unit 16.

[0095] A display control program (not shown) is also stored in the computer-readable medium 104. The display control program generates a display signal required for display output to the display device 116, and controls the display of the display device 116.

[0096] The display device 116 is, for example, a liquid crystal display, an organic electro-luminescence (OEL) display, a projector, or a suitable combination of these. The input device 114 is, for example, a keyboard, a mouse, a touch panel, a multi-touch screen, or other pointing devices, or a voice input device, or a suitable combination of these. The input device 114 accepts various inputs from an operator.

[0097] Note that Figure 4 shows an example in which the damage assessment result estimation program 130, image search program 134, damage assessment result registration program 136, damage image database 15 and damage investigation result database 17 are constructed on one server device 10, but the processing functions and databases of these programs may be realized by distributing the functions among multiple computers.

[0098] Example of the configuration of the terminal device 20 5 is a block diagram showing a configuration example of the terminal device 20. The terminal device 20 includes a processor 202, a computer-readable medium 204 which is a non-transient tangible entity, a communication interface 206, an input / output interface 208, a bus 210, an input device 214, and a display device 216. The hardware configuration of the terminal device 20 may be similar to the hardware configuration of the server device 10 described in FIG.

[0099] The hardware configurations of the processor 202, the computer-readable medium 204, the communication interface 206, the input / output interface 208, the bus 210, the input device 214, and the display device 216 shown in Fig. 5 may be similar to those of the corresponding elements shown in Fig. 4. The processor 202 is an example of a second processor. The computer-readable medium 204 may be referred to as a second storage device.

[0100] The terminal device 20 is communicatively connected to the server device 10 via a communication interface 206 .

[0101] The computer-readable medium 204 stores various programs and data including a provisional damage assessment result input UI (User Interface) program 222, a search result image display processing program 224, and a damage assessment result input UI program 226. The provisional damage assessment result input UI program 222 performs processing to display an input screen for accepting input of provisional damage assessment results and processes the entered information. The search result image display processing program 224 performs processing to display a plurality of damage images provided from the server device 10 on the display device 216. The damage assessment result input UI program 226 accepts input of damage assessment results to be registered and processes the entered information.

[0102] When the processor 202 executes instructions of a provisional damage assessment result input UI (User Interface) program 222, the processor 202 and the input device 214 function as provisional damage assessment result input section 12. Furthermore, when the processor 202 executes instructions of a search result image display processing program 224, the processor 202 and the display device 216 function as image display section 24. Furthermore, when the processor 202 executes instructions of a damage assessment result input UI program 226, the processor 202 and the input device 214 function as damage assessment result input section 26.

[0103] A display control program (not shown) is also stored in the computer-readable medium 204. The display control program generates a display signal required for display output to the display device 216, and controls the display of the display device 216.

[0104] Furthermore, the terminal device 20 may include a camera and / or a media interface, not shown. The target building may be photographed by a camera mounted on the terminal device 20, and the photographed image may be sent to the server device 10, so that the damage assessment result may be estimated in the damage assessment result estimation program 130. In addition, if a damaged image of the target building is stored in a portable external storage medium such as a memory card, the damaged image may be read from the portable external storage medium via a media interface, and the read image may be sent to the server device 10, so that the damage assessment result may be estimated in the damage assessment result estimation program 130.

[0105] In this embodiment, the damage assessment result estimation program 130 is incorporated in the server device 10, but the damage assessment result estimation program 130 may be installed in the terminal device 20. In this case, the processor 202 of the terminal device 20 may function as a processing unit that estimates the damage assessment result.

[0106] <<Example 1 of a display screen on the terminal device 20>> 6 is an example of a screen displayed on the display device 216 of the terminal device 20. The display screen 50 includes fields for entering the name, address, and phone number of the resident of the target building (the person applying for the survey), a damage assessment result input box 52, a first image display area 54, a second image display area 56, and a third image display area 58.

[0107] The damage assessment result input box 52 is a field for inputting a provisional damage assessment result. When a pull-down button 60 displayed beside the damage assessment result input box 52 is pressed, a pull-down menu (pull-down list) including five categories of input candidates, "total destruction", "large scale destruction", "destruction", "semi-destruction", and "not reaching semi-destruction", is displayed, and the user can input a desired assessment result into the damage assessment result input box 52 by selecting a desired assessment result from the pull-down menu. Here, an example is shown in which "destruction" is specified as the provisional damage assessment result. Note that "pressing" a GUI button includes the concept of an action such as "clicking" or "tapping". Note that, although not shown in FIG. 6, in addition to the damage assessment result input box 52, an input box for inputting information on the structure and / or parts of the building may be further provided.

[0108] The first image display area 54 is an area for displaying damaged images corresponding to provisional damage assessment results. Images IM1, IM2, IM3, and IM4 in the figure each represent an example of an image that was assessed as "semi-destroyed" in a past disaster. Here, four images IM1 to IM4 are displayed side-by-side, but the number of images to be displayed and the arrangement of the images are not limited to the example shown in the figure. The same applies to the other image display areas. Images in the first image display area 54 can be scrolled by dragging the knob 62 of the scroll bar 61 displayed at the bottom of the first image display area 54 or clicking the arrow 63.

[0109] The second image display area 56 is an area for displaying disaster images corresponding to a damage assessment result that is one level higher than the provisional damage assessment result. Images IM5 and IM6 in the figure each represent an example of an image that was assessed as "large-scale partial destruction" in a past disaster. The third image display area 58 is an area for displaying disaster images corresponding to a damage assessment result that is one level lower than the provisional damage assessment result. Images IM7 and IM8 in the figure each represent an example of an image that was assessed as "semi-partial destruction" in a past disaster.

[0110] In each of the second image display area 56 and the third image display area 58, images can be scrolled using scroll bars 64, 65, similar to the first image display area 54. Note that instead of or in addition to the scroll bars 61, 64, 65, images may be scrolled for each image display area by a swipe operation or a flick operation.

[0111] Moreover, by pressing a specific image from among a number of images displayed on the screen, it is possible to enlarge and display that image alone.

[0112] In FIG. 6, the image display area is divided into three areas, and examples of houses that are "partially destroyed", "largely partially destroyed", and "semi-partially destroyed" are displayed simultaneously on one screen, but these may be displayed on separate screens. For example, when a title icon 66 "Examples of houses judged to be "partially destroyed"" in the first image display area 54 is pressed, only image examples of houses judged to be "partially destroyed" may be displayed on one screen or in a separate window. Similarly, when a title icon 67 in the second image display area 56 or a title icon 68 in the third image display area 58 is tapped, only image examples corresponding to the respective titles may be displayed on one screen or in a separate window.

[0113] The investigator can check the validity of the provisional damage assessment result input in the damage assessment result input box 52 by referring to past damage images corresponding to the provisional damage assessment result and the assessment results before and after it.

[0114] Display screen 50 includes an OK button 69 for inputting an instruction to register the damage assessment result. OK button 69 may be called a "damage assessment result registration execution button" or a "damage assessment result approval button." When an investigator who has referred to past damage images determines that the provisional damage assessment result entered in damage assessment result input box 52 is appropriate, he or she presses OK button 69 to send an instruction to register the damage assessment result.

[0115] <<Example 2 of display screen on terminal device 20>> Fig. 7 is another example of a screen displayed on the display device 216 of the terminal device 20. Instead of the display screen 50 shown in Fig. 7, a display screen 51 shown in Fig. 7 may be applied. In Fig. 7, elements common to the configuration shown in Fig. 6 are given the same reference numerals, and their description will be omitted. Regarding the configuration shown in Fig. 7, differences from Fig. 6 will be described.

[0116] The first image display area 54 of the display screen 51 shown in FIG. 7 includes a damage level designation box 70 for designating a damage level classification, and a pull-down button 72. The damage level designation box 70 and the pull-down button 72 may be similar to the damage assessment result input box 52 and the pull-down button 72. stomach The input contents of the damage assessment result input box 52 are automatically reflected as the initial input contents of the damage level designation box 70. Therefore, when a provisional damage assessment result (e.g., "partially destroyed") is input in the damage assessment result input box 52, an example of a damage image corresponding to the input provisional damage assessment result is displayed in the first image display area 54. Thereafter, the user can select a desired damage level category from the pull-down button 72 to display a damage image of the selected damage assessment result in the first image display area 54.

[0117] Similarly, the second image display area 56 of the display screen 51 includes a damage level designation box 74 and a pull-down button 76. The damage level designation box 74 automatically reflects the damage assessment result of a damage level one level higher than the provisional damage assessment result input in the damage assessment result input box 52 as the initial input content. Therefore, when a provisional damage assessment result (e.g., "partially destroyed") is input in the damage assessment result input box 52, an example of a disaster image corresponding to the damage level one level higher than the input provisional damage assessment result (here, "large-scale partially destroyed") is displayed in the second image display area 56. Each of the images IM11 to IM14 in the figure represents an example of an image determined to be "large-scale partially destroyed" in a past disaster. After that, the user can select a desired damage level category from the pull-down button 76 to display a disaster image of the selected damage assessment result in the second image display area 56.

[0118] According to the display screen 51 as shown in Fig. 7, examples of disaster images with the same and / or similar degree of damage as the provisional damage assessment result can be confirmed in response to the input of the provisional damage assessment result. The classification of the degree of damage that is automatically displayed in conjunction with the input of the provisional damage assessment result may be preset as described above, or may be configured so that the user can set it as appropriate.

[0119] <<Example 3 of display screen on terminal device 20>> Fig. 8 is yet another example of a screen displayed on the display device 216 of the terminal device 20. Fig. 8 is an example of a display screen 80 that displays information including an estimation result by an AI that estimates a damage assessment result. When a damage assessment result is estimated using an AI, information including the estimation result and an example of a disaster image corresponding to the estimated damage assessment result can be displayed on the display device 216 of the terminal device 20.

[0120] The display screen 80 of the AI ​​estimation results includes an estimation result display area 82 and an image display area 84. The estimation result display area 82 displays a list T of predicted values ​​of the AI ​​damage assessment results and an image G1 of the target building input to the AI.

[0121] List T contains the damage assessment results. measurement As values, the probability values ​​for each of "total destruction," "large scale destruction," "partial destruction," "semi-destruction," and "not reaching semi-destruction" are presented. Here, the probability value for total destruction is 0%, the probability value for large scale destruction is 0%, the probability value for semi-destruction is 5%, the probability value for semi-destruction is 94%, and the probability value for not reaching semi-destruction is 1%. In this way, by presenting the probability values ​​for each damage assessment result, it is possible to leave some room for residents to make a decision regarding the application for a secondary investigation.

[0122] Also, in the image display area 84, examples of images of houses that have been determined to have the same level of damage as the damage assessment result with the highest probability value indicated by the AI ​​estimation result are displayed. In this case, since the probability value of "semi-destroyed" is the highest in list T, images G2, G3, and G4 of houses that have been determined to have the same level of damage as the damage assessment result with the highest probability value indicated by the AI ​​estimation result are displayed. The images displayed in the image display area 84 may be images extracted from the disaster image database 15. In this way, the target building It is hoped that by displaying example images of houses that have been judged to have suffered similar damage along with the estimation results, residents will feel more convinced by the AI's estimation results.

[0123] About the programs that run computers A program that causes a computer to realize some or all of the various processing functions of the server device 10 and the terminal device 20 described in the above embodiments can be recorded on a computer-readable medium such as an optical disk, a magnetic disk, a semiconductor memory, or other tangible, non-transitory information storage medium, and the program can be provided through this information storage medium.

[0124] In addition, instead of providing the program by storing it on such a tangible, non-transitory computer-readable medium, it is also possible to provide the program signal as a download service using a telecommunications line such as the Internet.

[0125] <Hardware configuration of each processing unit> The provisional damage assessment result input unit 12, the image search unit 14, and the damage assessment result registration unit described in FIG. Part 16 The hardware structure of a processing unit that executes various processes in the image display unit 24 and the damage assessment result input unit 26 is, for example, various processors as shown below.

[0126] Various types of processors include CPUs, which are general-purpose processors that execute programs and function as various processing units, GPUs, which are processors specialized for image processing, programmable logic devices (PLDs), such as field programmable gate arrays (FPGAs), whose circuit configuration can be changed after manufacture, and dedicated electrical circuits, such as application specific integrated circuits (ASICs), which are processors with a circuit configuration designed specifically to execute specific processes.

[0127] One processing unit may be composed of one of these various processors, or may be composed of two or more processors of the same type or different types. For example, one processing unit may be composed of multiple FPGAs, or a combination of a CPU and an FPGA, or a combination of a CPU and a GPU. Also, multiple processing units may be composed of one processor. As an example of multiple processing units being composed of one processor, first, as represented by a computer such as a client or a server, one processor is composed of a combination of one or more CPUs and software, and this processor functions as multiple processing units. Second, as represented by a system on chip (SoC), there is a form in which a processor is used that realizes the functions of the entire system including multiple processing units in one IC (Integrated Circuit) chip. In this way, the various processing units are composed of one or more of the above various processors as a hardware structure.

[0128] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit that combines circuit elements such as semiconductor elements.

[0129] Advantages of this embodiment The damage assessment information system 1 according to the embodiment of the present invention has the following advantages.

[0130] [1] The investigator can refer to past damage images with assessment results similar to the provisional damage assessment result on the display device of the mobile terminal device 20A, and can confirm the validity of the provisional damage assessment result. This allows the investigator to determine the damage level of the target building with a sense of satisfaction.

[0131] [2] By using the damage assessment information system 1, investigators can make their own judgments about appropriate damage assessment results, which reduces the number of inquiries to coordinators and shortens the investigation time.

[0132] [3] Furthermore, by having multiple investigators use the damage assessment information system 1, it is expected that the variation in assessment results between investigators will be reduced.

[0133] [4] Furthermore, the damage assessment information system 1 can present residents with specific examples (precedents) of the relationship between damage assessment results and images of damage in past disasters that can be compared with the degree of damage to the target building. This allows residents to check past examples and determine the validity of their own damage assessment results, allowing them to confirm the damage assessment results with a sense of satisfaction and to determine the need for a secondary investigation.

[0134] "others" In the above embodiment, damage assessment in a residential damage certification survey has been described as an example, but the scope of application of the technology disclosed herein is not limited to this example, and can be widely applied to cases where damage assessment is performed on damaged buildings, and there can be various modes for the classification of the degree of damage and the number of categories (number of stages). For example, the damage assessment information system disclosed herein can be applied to cases where damage assessment is performed in disaster insurance surveys, etc. The terminal device in this case may be a computer connected to the insurance company's internal network.

[0135] The above-described embodiment of the present invention may be modified or added to as appropriate without departing from the spirit of the present invention. The present invention is not limited to the above-described embodiment, and many modifications may be made by a person having ordinary knowledge in the relevant field within the technical concept of the present invention. [Explanation of symbols]

[0136] 1. Damage Assessment Information System 10. Server equipment 12 Provisional damage judgment result input section 14 Image Search Section 15 Disaster Image Database 16 Damage assessment result registration department 17 Damage Investigation Results Database 20 Terminal Equipment 20A Portable terminal equipment 20B Personal Computer (PC) 24 Image display section 26 Damage judgment result input section 30 Network 32 Wide area communication lines 50, 51 display screen 52 Damage assessment result input box 54 First image display area 56 Second image display area 58 Third image display area 60 Pull-down button 61 Scrollbar 62 Knob 63 Arrow 64, 65 Scrollbar 66, 67, 68 Title Icons 69 OK button 70 Damage Level Designation Box 72 Pull-down button 74 Damage Level Designation Box 76 Pull-down button 80 display screen 82 Estimation result display area 84 Image display area 102 processors 104 Computer-readable medium 106 Communication Interface 108 Input / Output Interface 110 Bus 114 Input Devices 116 Display device 130 Damage Assessment Result Estimation Program 134 Image Search Program 136 Damage Assessment Result Registration Program 202 Processor 204 Computer-readable medium 206 Communication Interface 208 Input / Output Interface 210 Bus 214 Input Device 216 Display device 222 Provisional damage assessment result input UI program 224 Search result image display processing program 226 Damage Assessment Result Input UI Program IM1~IM8, IM11~IM14 images G1~G4 Images S11~S17 Operational steps of the damage assessment information system

Claims

1. A damage assessment information system including a server device that manages damage assessment results of damaged buildings and damage images of the damaged buildings corresponding to the damage assessment results, and a terminal device that is connected to the server device via a network, The server device includes: A first processor; a disaster image database that stores the damage determination result and the disaster image in association with each other, The terminal device includes a second processor; A display device and an input device, The first processor, Obtain a provisional damage assessment result, extracting, from the damage image database, a plurality of damage images related to the provisional damage assessment result based on the obtained provisional damage assessment result; providing the extracted plurality of disaster images to the terminal device; The second processor comprises: Displaying the extracted plurality of disaster images on the display device; receiving an input of an instruction to confirm a damage assessment result from the input device; The first processor, registering the confirmed damage assessment result in a damage investigation result database based on an instruction from the terminal device that has caused the plurality of damage images to be displayed on the display device; Damage assessment information system.

2. The provisional damage assessment result is input from the input device of the terminal device. A damage assessment information system according to claim 1.

3. At least one of the first processor and the second processor acquires the provisional damage assessment result by image recognition from an image including a target building for damage assessment.

3. A damage assessment information system according to claim 1 or 2.

4. At least one of the first processor and the second processor performing a damage assessment result estimation process that receives an image of a target building for damage assessment and building information related to the structure and parts of the target building as input, and outputs a damage classification of the parts; The estimation result by the damage assessment result estimation process is used as the provisional damage assessment result. A damage assessment information system according to any one of claims 1 to 3.

5. At least one of the first processor and the second processor A trained model that has been subjected to machine learning processing so as to output a damage classification estimated for the part of the target building when an image showing the target building and the building information regarding the structure and part of the target building are input. A damage assessment information system according to claim 4.

6. The damage classification in the damage assessment criteria is set out in multiple stages according to the degree of damage, The plurality of damage images related to the provisional damage assessment result include the damage images belonging to a damage classification having a damage degree equal to or greater than the input provisional damage assessment result. A damage assessment information system according to any one of claims 1 to 5.

7. The plurality of damage images related to the provisional damage assessment result include the damage images belonging to a damage classification having the same degree of damage as the input provisional damage assessment result and the damage images belonging to a damage classification having a degree of damage one level higher than that of the provisional damage assessment result. The damage assessment information system according to claim 6.

8. a damage image database that stores a damage assessment result of a damaged building and a damage image of the damaged building corresponding to the damage assessment result in association with each other; A first processor; A server device comprising: The first processor, Obtain a provisional damage assessment result, extracting, from the damage image database, a plurality of damage images related to the provisional damage assessment result based on the obtained provisional damage assessment result; providing the extracted plurality of disaster images to a terminal device connected via a network; registering the confirmed damage assessment result in a damage investigation result database based on an instruction from the terminal device on which the plurality of damage images are displayed; Server device.

9. On the computer, A function of managing a damage image database that stores a damage assessment result of a damaged building and a damage image of the damaged building corresponding to the damage assessment result in association with each other; A function to obtain provisional damage assessment results; a function of extracting, based on the acquired provisional damage assessment result, a plurality of the damage images related to the provisional damage assessment result from the damage image database; a function of providing the extracted plurality of disaster images to a terminal device connected via a network; A program for realizing the function of registering the confirmed damage assessment result in a damage survey result database based on instructions from the terminal device after the damage image is displayed on the display device of the terminal device.

10. A program for causing a computer to function as a terminal device connected via a network to a server device that manages damage assessment results of damaged buildings and damage images of the damaged buildings corresponding to the damage assessment results, The computer includes: A function to obtain provisional damage assessment results; a function of transmitting the acquired provisional damage assessment result to the server device; a function of acquiring a plurality of damage images related to the provisional damage assessment result from the server device and displaying the plurality of damage images on a display device; a function of receiving an input of an instruction to confirm a damage assessment result after the damage image is displayed; A program to achieve this.

11. A non-transitory computer-readable recording medium having the program according to claim 10 recorded thereon.

Citation Information

Patent Citations

  • Damage investigation system and method of application thereof

    JP2018165906A

  • Disaster information processing apparatus and disaster information processing model learning apparatus

    JP2019175015A

  • Disaster application support server and disaster application support system

    JP2020052795A

Cited By

  • Information processing systems, information processing methods, and programs

    JP7879646B1