Information processing device, information processing method, and program

The information processing device uses historical data to specify target imaging ranges and generate plans for ground surface imaging, addressing limitations in existing technologies by anticipating potential abnormalities and optimizing imaging routes.

JP7586354B2Active Publication Date: 2024-11-19NEC CORP
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2024030119
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2021-02-03
Filing Date
2024-02-29
Publication Date
2024-11-19
Estimated Expiration
2041-12-01

AI Technical Summary

Technical Problem

Existing technologies for imaging the ground surface after disasters or predicting disaster locations are limited in scope, as they only generate imaging plans when abnormalities are detected, restricting the situations in which imaging can be conducted.

Method used

An information processing device that acquires event data, specifies a target range on the ground surface based on historical data, and generates an imaging plan to image this range, using devices like satellites or aircraft to capture data before abnormalities become apparent, and calculates routes avoiding areas of significant change.

Benefits of technology

Enables the generation of comprehensive imaging plans that can anticipate potential abnormalities on the ground surface, supporting detailed imaging and route planning regardless of current conditions, enhancing situational awareness and response capabilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007586354000001
    Figure 0007586354000001
  • Figure 0007586354000002
    Figure 0007586354000002
  • Figure 0007586354000003
    Figure 0007586354000003
Patent Text Reader

Abstract

To provide, as one purpose, an information processing device and the like capable of supporting the generation of an imaging plan.SOLUTION: An information processing device according to one aspect of the present disclosure, includes: acquisition means for acquiring event data being data based on a generated event and including information of a position of a ground surface related to the event; dentification means for identifying, on the basis of the event data, a target range being a range on the ground surface to be imaged by an imaging device; generation means for generating an imaging plan of the imaging device so that the target range is imaged by the imaging device. and route calculation means for calculating a prescribed route. The route calculation means calculates a route which does not include places where change of the ground surface does not exceed a fixed standard on the basis of change information being information generated in accordance with imaging data based on a result imaged by the imaging device and being information showing change of the ground surface which occurs due to a time elapse.SELECTED DRAWING: Figure 15
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to techniques for imaging the Earth's surface. [Background technology]

[0002] In various situations, there is a need to grasp the condition of the ground surface. In such cases, the condition of the ground surface is grasped by using an image of the ground surface captured by a specific imaging device.

[0003] For example, Patent Document 1 describes a method of capturing images of the earth's surface after a disaster occurs using a satellite equipped with a radar device, and determining the damage situation on the earth's surface by comparing the radar image data before and after the disaster.

[0004] In such a disaster scene, it is mainly required to grasp the situation at the place where the disaster occurred. To do so, it is necessary to identify the place where the disaster occurred and make an imaging plan to image the identified place. However, Patent Document 1 does not disclose a method for identifying the place where the disaster occurred (i.e., the range of the ground surface to be imaged).

[0005] In response to this, Patent Document 2 describes a method of predicting where a disaster will occur by monitoring meteorological data, acquiring satellite images from a satellite that is scheduled to capture images of the predicted location, and grasping the situation at the predicted location. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] International Publication No. 2008 / 016153 [Patent Document 2] JP 2003-016153 A Summary of the Invention [Problem to be solved by the invention]

[0007] In the technology described in Patent Document 2, when the value of the meteorological data being monitored exceeds a threshold, such as when the amount of precipitation exceeds a predetermined threshold, the location where the meteorological data exceeding the threshold is observed is identified as the location where an abnormality has occurred, and an imaging plan is generated to image the identified location. However, in the technology described in Patent Document 2, the imaging range is determined only when it is determined that an abnormality has occurred in the meteorological data being monitored. Therefore, the technology described in Patent Document 2 may limit the situations in which an imaging plan is generated.

[0008] The present disclosure has been made in consideration of the above problems, and has an object to provide an information processing device and the like capable of supporting generation of an imaging plan. [Means for solving the problem]

[0009] An information processing device according to one aspect of the present disclosure comprises an acquisition means for acquiring event data based on an event that has already occurred, the event data including information on the position of the ground surface associated with the event, an identification means for identifying a target range, which is the range of the ground surface to be imaged by an imaging device, based on the event data, a generation means for generating an imaging plan for the imaging device so that the imaging device images the target range, and a route calculation means for calculating a predetermined route, wherein the route calculation means calculates a route that does not include locations where changes in the ground surface exceed a certain standard, based on change information, which is information generated in response to imaging data based on the results of imaging by the imaging device and is information indicating changes in the ground surface that occur over time.

[0010] An information processing method according to one aspect of the present disclosure includes the steps of: acquiring event data based on an event that has already occurred, the event data including information on the position of the ground surface associated with the event; identifying a target range that is the range of the ground surface to be imaged by an imaging device based on the event data; generating an imaging plan for the imaging device so that the imaging device images the target range; and calculating a predetermined route; and calculating a route that does not include points where changes in the ground surface exceed a certain standard based on change information that is information generated in response to imaging data based on the results of imaging by the imaging device and is information that indicates changes in the ground surface that occur over time.

[0011] A computer-readable storage medium according to one aspect of the present disclosure is a program that causes a computer to execute an acquisition process for acquiring event data based on an event that has already occurred, the event data including information on the position of the ground surface associated with the event; a specification process for specifying a target range, which is the range of the ground surface to be imaged by an imaging device, based on the event data; a generation process for generating an imaging plan for the imaging device so that the imaging device images the target range; and a route calculation process for calculating a predetermined route, wherein the route calculation process calculates a route that does not include locations where the change in the ground surface exceeds a certain standard, based on change information, which is information generated in response to imaging data based on the results of imaging by the imaging device and is information that indicates changes in the ground surface that occur over time. Effect of the Invention

[0012] According to the present disclosure, generation of an imaging plan can be supported. [Brief description of the drawings]

[0013] [Figure 1] 1 is a diagram illustrating an example of a configuration of an imaging support system including an information processing device according to a first embodiment of the present disclosure. [Diagram 2] 1 is a block diagram showing an example of a functional configuration of an imaging support system according to a first embodiment of the present disclosure. [Diagram 3] 4 is a flowchart illustrating an example of an operation of the information processing device according to the first embodiment of the present disclosure. [Figure 4] 10 is a flowchart illustrating another example of the operation of the information processing device according to the first embodiment of the present disclosure. [Diagram 5] 11 is a block diagram including an example of a functional configuration of an imaging support system according to a second embodiment of the present disclosure. FIG. [Figure 6] 13 is a diagram showing an example of an image output by the imaging support system of the second embodiment of the present disclosure. FIG. [Figure 7] 10 is a flowchart illustrating an example of an operation of the information processing device according to the second embodiment of the present disclosure. [Figure 8] 10 is a flowchart illustrating another example of the operation of the information processing device according to the second embodiment of the present disclosure. [Figure 9] FIG. 13 is a block diagram including an example of a functional configuration of an imaging support system according to a third embodiment of the present disclosure. [Figure 10] 13 is a flowchart illustrating an example of an operation of the information processing device according to the third embodiment of the present disclosure. [Figure 11] 13 is a flowchart illustrating another example of the operation of the information processing device according to the third embodiment of the present disclosure. [Figure 12] FIG. 13 is a block diagram including an example of a functional configuration of an imaging support system according to a fourth embodiment of the present disclosure. [Figure 13] 13 is a flowchart illustrating an example of an operation of the information processing device according to the fourth embodiment of the present disclosure. [Figure 14] 13 is a flowchart illustrating another example of the operation of the information processing device according to the fourth embodiment of the present disclosure. [Figure 15] FIG. 13 is a block diagram including an example of a functional configuration of an information processing device according to a fifth embodiment of the present disclosure. [Figure 16] 13 is a flowchart illustrating an example of an operation of an information processing device according to a fifth embodiment of the present disclosure. [Figure 17]FIG. 2 is a block diagram showing an example of a hardware configuration of a computer device that realizes an information processing device according to the first, second, third, fourth, and fifth embodiments of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0015] <First embodiment> An imaging support system including an information processing device according to a first embodiment will be described.

[0016] FIG. 1 is a diagram illustrating an example of the configuration of an imaging support system 1000 including an information processing device 100 of the first embodiment. As illustrated in FIG. 1, the imaging support system 1000 includes an information processing device 100, an imaging device 200, and a storage device 300. The imaging support system 1000 may be configured to further include a terminal device 400, or may be configured to include the information processing device 100 and the imaging device 200 and to communicate with the storage device 300 and the terminal device 400. The information processing device 100 is connected to the imaging device 200, the storage device 300, and the terminal device 400 via a network, for example, so as to be able to communicate with each other. The storage device 300 may be mounted on the information processing device 100.

[0017] The information processing device 100 generates an imaging plan, which will be described later, in response to a request from the terminal device 400. The imaging device 200 images the ground surface according to the imaging plan, and stores data based on the imaging results in the storage device 300. In this way, the imaging support system 1000 is a system that generates an imaging plan indicating a plan for the imaging device 200 to image the ground surface.

[0018] Next, the imaging support system 1000 will be described in detail with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the functional configuration of the imaging support system 1000 according to the first embodiment.

[0019] [Details of the imaging device 200] The imaging device 200 is a device having a function of imaging the ground surface. There may be a plurality of imaging devices 200. The imaging device 200 is, for example, an artificial satellite. In this case, the imaging device 200 images the ground surface while moving on an orbit in the sky. The imaging device 200 images the ground surface from the sky using, for example, a synthetic aperture radar (SAR) mounted on the imaging device 200. The imaging device 200 generates imaging data that is an image based on the result of imaging the ground surface. Specifically, the imaging device 200 irradiates electromagnetic waves from the sky to the ground surface using the synthetic aperture radar, and acquires electromagnetic waves (reflected waves) reflected from the ground surface in the direction of the synthetic aperture radar. The imaging data includes data on the reflected waves acquired by the imaging device 200. The data on the reflected waves is, for example, data on the intensity, phase, and polarization of the reflected waves. By using a synthetic aperture radar, the imaging device 200 can generate imaging data of the ground surface even in bad weather. The imaging device 200 may image the ground surface from the sky using various sensors or radars capable of imaging, such as optical sensors, instead of using a synthetic aperture radar. In this case, the imaging data is an image based on the result of imaging the ground surface by various sensors or radars.

[0020] Here, the range of the ground surface imaged by the imaging device 200 is also referred to as the imaging range. That is, the imaging data is an image based on the result of imaging the imaging range. The imaging device 200 stores the imaging data in the storage device 300. Specifically, the imaging device 200 stores the imaging data in the imaging data storage unit 310. At this time, the imaging device 200 may store the imaging data, data indicating the imaging range, and data indicating the time when the imaging was performed in association with each other in the imaging data storage unit 310. The data indicating the imaging range may be information of latitude and longitude, or may be other information capable of identifying the position of the ground surface. The data indicating the time when the imaging was performed may be information including the date when the imaging was performed, or may be information including the time when the imaging was performed.

[0021] In this specification, the term "ground surface" includes land and sea. Furthermore, the term "ground surface" includes objects existing on the surface of land or on sea. Objects existing on the surface of land or on sea are, for example, buildings, roads, rivers, forests, sea ice, etc. In addition, in this specification, an example in which the imaging device 200 generates imaging data (images) will be described, but the imaging device 200 does not have to generate imaging data. For example, a ground station device (not shown) may obtain information obtained by various sensors or radar from the imaging device 200, and the ground station device may generate imaging data by imaging the information. In this case, the ground station device stores the imaging data in the imaging data storage unit 310.

[0022] The imaging device 200 captures the ground surface according to an imaging plan. The imaging plan is information that can specify when and where the imaging device 200 will capture images. The imaging plan includes, for example, information indicating the trajectory along which the imaging device 200 moves, the imaging time, and the imaging direction of various sensors or radars used for imaging. The imaging time may include information indicating the time from the start to the end of imaging in addition to information indicating the time point at which imaging is performed. The imaging direction of various sensors or radars includes the angles of the light receivers of the various sensors or the angles of the antennas of the various radars. Note that the imaging plan is not limited to this example as long as it is in a format that can specify when and where the imaging device 200 will capture images.

[0023] [Details of storage device 300] As shown in FIG. 2, the storage device 300 includes an imaging data storage unit 310, an event data storage unit 320, and an imaging plan storage unit 330.

[0024] The imaging data storage unit 310 stores imaging data based on the result of imaging the ground surface by the imaging device 200. The imaging data is transmitted from the imaging device 200 to the storage device 300. The imaging data storage unit 310 may include imaging data generated before the information processing device 100 generates an imaging plan. As described above, in the case where a ground station device (not shown) is present, the imaging data is transmitted from the ground station device to the storage device 300.

[0025] The event data storage unit 320 stores event data. The event data is data based on events that have occurred in the past, and includes information on the position of the ground surface related to the event. For example, the event data may be data (referred to as disaster data) on locations that have suffered damage such as landslides, floods, and ground movements caused by disasters such as earthquakes, typhoons, and tsunamis that have occurred in the past, or a hazard map that indicates the range of damage at the time of the occurrence of a disaster, predicted from information on disasters that have occurred in the past. The event data may also be data in which rainfall and snowfall that have occurred in the past are associated with information on the positions where the rainfall and snowfall were observed. The event data may also be data indicating the number of people who have suffered from a predetermined disease in a plurality of predetermined ranges in the past. The event data may also be data indicating the state of sea ice observed in the past. The event data may also be data indicating the route traveled by a moving body such as an automobile, an airplane, or a ship in the past. The event data is not limited to this example. The event data may differ depending on the scene in which the imaging support system 1000 is used.

[0026] Here, "an event that occurred in the past" refers to an event that occurred before a predetermined time point. In this specification, as an example, "an event that occurred in the past" is described as "an event that occurred before the information processing device 100 accepted a request for generating an imaging plan from the terminal device 400" which will be described later. Note that in this specification, "occurred in the past" may be expressed as "already occurred."

[0027] The imaging plan storage unit 330 stores an imaging plan generated by the information processing device 100. The imaging plan storage unit 330 also stores device information, which is information related to the imaging device 200, in advance. The device information includes, for example, information related to the specifications of the imaging device 200 and the specifications of a sensor or radar mounted on the imaging device 200. Furthermore, if the imaging device 200 is an artificial satellite, the device information includes, for example, information on an orbit on which the imaging device 200 can move. The device information includes at least information required to generate an imaging plan. Note that, if there are multiple imaging devices 200, the imaging plan storage unit 330 stores imaging plans for each of the imaging devices 200 and device information related to each of the imaging devices 200.

[0028] [Details of the terminal device 400] The terminal device 400 is a device equipped with a predetermined input / output means. For example, the terminal device 400 may be a personal computer, or a mobile terminal such as a smartphone or a tablet terminal.

[0029] The terminal device 400 acquires various information via a network and outputs the acquired information. For example, the terminal device 400 may acquire information indicating an imaging plan generated by the information processing device 100 and imaging data generated by the imaging device 200, and output the acquired information to a display provided in the terminal device 400. In addition, the terminal device 400 may transmit various information to the information processing device 100 based on an input by a user. For example, the terminal device 400 may transmit a request to generate an imaging plan to the information processing device 100 based on information input by a user.

[0030] Although the terminal device 400 is not connected to the storage device 300 in FIG. 1 and FIG. 2, the terminal device 400 may be configured to be connected to the storage device 300 so as to be able to communicate with it.

[0031] [Details of the information processing device 100] As shown in FIG. 2, the information processing device 100 includes a reception unit 110, an acquisition unit 120, a specification unit 130, a generation unit 140, an imaging control unit 150, and an output control unit 160.

[0032] The reception unit 110 receives a request for generating an imaging plan from the terminal device 400. Hereinafter, the "request for generating an imaging plan" is also simply referred to as a "generation request." The generation request is notified to the terminal device 400, for example, by a user performing a predetermined input. The generation request includes information specifying a predetermined range on the earth's surface (hereinafter referred to as range designation information). The range designation information may be, for example, information of latitude and longitude, or information indicating a specific region such as "Arctic Ocean," "Japan," or "Kanagawa Prefecture."

[0033] The reception unit 110 may also receive various requests from the terminal device 400. For example, the reception unit 110 may receive an output request for imaging data. In this case, the output request includes, for example, information indicating the range of the earth's surface and information indicating a time point.

[0034] The acquisition unit 120 acquires event data from the storage device 300. At this time, the acquisition unit 120 acquires event data related to a range specified by range designation information included in the generation request, which corresponds to a scene in which the imaging support system 1000 is used. For example, the generation request includes range designation information indicating "Kanagawa Prefecture", and the user of the imaging support system 1000 aims to capture an image of a range where damage is predicted to occur when an earthquake occurs. In this case, the acquisition unit 120 acquires data related to the damage caused by earthquakes that have occurred in the past in "Kanagawa Prefecture", a hazard map for when an earthquake occurs in "Kanagawa Prefecture", and the like. The setting of such a scene in which the imaging support system 1000 is used (i.e., the purpose of use) is set in advance by the user. Note that the method of setting the purpose is not limited to this example. For example, information indicating a purpose generated by a user performing a predetermined input may be included in the generation request. In this case, the acquisition unit 120 acquires event data based on the information indicating the purpose included in the generation request and the range designation information. The acquisition unit 120 may acquire multiple event data.

[0035] In this manner, the acquiring unit 120 acquires event data that is based on an event that has already occurred and that includes information on a position on the earth's surface associated with the event. The acquiring unit 120 is an example of an acquiring means.

[0036] The acquisition unit 120 may also acquire imaging data from the storage device 300. For example, when imaging data in which the target range is imaged is stored in the imaging data storage unit 310, the acquisition unit 120 acquires the imaging data. At this time, the acquisition unit 120 may acquire the imaging data in response to detecting that the imaging data in which the target range is imaged has been stored in the storage device 300, or the acquisition unit 120 may acquire the imaging data by the storage device 300 sending a notification indicating that the imaging data has been stored to the information processing device 100. Furthermore, when the reception unit 110 receives an output request for imaging data, the acquisition unit 120 may acquire imaging data in response to the output request. For example, the acquisition unit 120 acquires imaging data in which the range of the ground surface indicated in the output request is imaged and which has been imaged around the time indicated in the output request.

[0037] The identification unit 130 identifies the range of the ground surface to be imaged based on the event data. In this specification, the range of the ground surface to be imaged is referred to as the "target range". For example, the event data acquired by the acquisition unit 120 is a hazard map for when an earthquake occurs. In this case, the identification unit 130 extracts, for example, from the hazard map, a range in which the ground changes by a predetermined scale or more when an earthquake occurs. Then, the identification unit 130 identifies the extracted range as the target range. In this way, the identification unit 130 identifies, for example, a range in which the topography is estimated to change by a predetermined scale or more from the event data. Note that the above-mentioned method of identifying the target range from the event data is one example and is not limited to this example. The identification unit 130 can extract a predetermined range using various information included in the event data and identify it as the target range. Note that the identification unit 130 may identify multiple target ranges.

[0038] Furthermore, the identification unit 130 may identify the target range based on multiple event data. At this time, the identification unit 130 may extract a range in which the topography is estimated to change by a predetermined scale or more for each event data, and identify the range where the multiple extracted ranges overlap as the target range. Furthermore, the identification unit 130 may calculate a score according to the scale of the topography change for each pre-delimited range of the ground surface based on multiple event data, and identify the range where the score is equal to or greater than a predetermined value as the target range. Note that the example of identifying the target range is not limited to this example.

[0039] In this way, the identifying unit 130 identifies, based on the event data, a target range that is a range of the ground surface that is a target of imaging by the imaging device 200. The identifying unit 130 is an example of an identifying means.

[0040] The generating unit 140 generates an imaging plan. Specifically, the generating unit 140 generates an imaging plan so that the imaging device 200 images the target range identified by the identifying unit 130. For example, the generating unit 140 acquires device information related to the imaging device 200 from the imaging plan storage unit 330. Then, the generating unit 140 uses the device information to generate an imaging plan including a trajectory, an imaging direction, and an imaging time that allow the imaging device 200 to image the target range. At this time, the generating unit 140 may generate an imaging plan that allows the imaging device 200 to image the target range as soon as possible from the time when the receiving unit 110 receives the generation request. In addition, the generating unit 140 may generate an imaging plan so that the imaging device 200 images the target range periodically, not just once. The generating unit 140 stores the generated imaging plan in the imaging plan storage unit 330.

[0041] In this manner, the generation unit 140 generates an imaging plan for the imaging device 200 so that the imaging device 200 images the target range. The generation unit 140 is an example of a generation means.

[0042] The imaging control unit 150 controls the imaging device 200. For example, when an imaging plan is generated by the generation unit 140, the imaging control unit 150 controls the imaging device 200 so that the imaging device 200 captures images according to the generated imaging plan. Note that the method of controlling the imaging device 200 may be various known methods.

[0043] The output control unit 160 outputs various information to the terminal device 400. For example, when the reception unit 110 receives a generation request, the output control unit 160 outputs information indicating the generated imaging plan to the terminal device 400. At this time, the output control unit 160 may output information indicating event data used in the generation of the imaging plan, in addition to the information indicating the imaging plan. Furthermore, when the imaging data is generated, the output control unit 160 may output the imaging data to the terminal device 400.

[0044] [Operation of information processing device 100] Next, an example of the operation of the information processing device 100 will be described with reference to Fig. 3 and Fig. 4. In this disclosure, each step in a flowchart is expressed using a number assigned to each step, such as "S101".

[0045] FIG. 3 is a flowchart for explaining an example of the operation of the information processing device 100. Specifically, FIG. 3 is a diagram for explaining an example of the operation when the information processing device 100 accepts a generation request. The reception unit 110 accepts a generation request for an imaging plan from the terminal device 400 (S101). Next, the acquisition unit 120 acquires event data (S102). For example, the acquisition unit 120 acquires event data according to the generation request and information indicating a preset purpose. The identification unit 130 identifies a target range based on the acquired event data (S103). The generation unit 140 generates an imaging plan so that the imaging device 200 images the target range based on information indicating the identified target range and device information (S104). At this time, the generation unit 140 stores the generated imaging plan in the imaging plan storage unit 330. Then, the imaging control unit 150 controls the imaging device 200 so as to perform imaging according to the generated imaging plan (S105). The output control unit 160 outputs information indicating the generated imaging plan to the terminal device 400 (S106).

[0046] 3, the output control unit 160 outputs information indicating the imaging plan to the terminal device 400, but the information indicating the imaging plan does not necessarily have to be output. The process of S106 may be performed before the process of S105, or may be performed simultaneously with the process of S105.

[0047] Fig. 4 is a flowchart for explaining another example of the operation of the information processing device 100. Specifically, Fig. 4 is a diagram for explaining an example of the operation of the information processing device 100 when imaging data is generated by the imaging device 200. When imaging data in which the target range is imaged is stored in the imaging data storage unit 310 (Yes in S201), the acquisition unit 120 acquires the imaging data in which the target range is imaged (S202). The output control unit 160 outputs the imaging data acquired by the acquisition unit 120 to the terminal device 400.

[0048] As described above, the information processing device 100 of the first embodiment acquires event data that is based on an event that has already occurred and includes information on the position of the ground surface associated with the event. Then, the information processing device 100 specifies a target range, which is a range of the ground surface to be imaged by the imaging device, based on the event data, and generates an imaging plan for the imaging device so that the imaging device images the target range. In this way, since the information processing device 100 uses the event data described above to specify the target range, it is possible to specify the target range and generate an imaging plan regardless of the current situation of the ground surface, for example. Therefore, for example, even before an abnormality occurring on the ground surface becomes apparent, the information processing device 100 can generate an imaging plan with an area where an abnormality is estimated to occur as an imaging target. This means that the scene in which the imaging plan is generated is not limited compared to the case where an imaging plan is generated when an abnormality occurs in data being monitored. As described above, the information processing device 100 of the first embodiment can support the generation of an imaging plan.

[0049] [Variation 1] Although an example in which the imaging device 200 is an artificial satellite has been described, the imaging device 200 is not limited to this example. For example, the imaging device 200 may be a manned or unmanned aircraft. Manned aircraft include, for example, airplanes, helicopters, and airships. Unmanned aircraft are sometimes called UAVs (Unmanned Aerial Vehicles), small unmanned aircraft, or drones. When there is no distinction between manned aircraft and unmanned aircraft, they are simply called aircraft.

[0050] When the imaging device 200 is an aircraft, the imaging device 200 flies according to, for example, a user's instruction and captures an image of the ground surface while flying. Also, the imaging plan is generated as information indicating when, from where, and what range to capture.

[0051] [Variation 2] Although an example in which the information processing device 100 controls the imaging device 200 has been described, a control device (not shown) different from the information processing device 100 may control the imaging device 200. In this case, the control device controls the imaging device based on the imaging plan generated by the information processing device 100. The control device may be configured integrally with the above-mentioned terrestrial station device (not shown), or may be a device different from the terrestrial station device.

[0052] <Second embodiment> Next, a description will be given of an imaging support system according to a second embodiment. In the second embodiment, a detailed description will be given of an imaging support system for creating an imaging plan when a disaster occurs.

[0053] Fig. 5 is a block diagram showing an example of a functional configuration of an imaging support system 1001 according to the second embodiment. As shown in Fig. 5, the imaging support system 1001 includes an information processing device 101 and a storage device 301 instead of the information processing device 100 and the storage device 300 in the first embodiment, and is otherwise similar to the imaging support system 1000 described in the first embodiment. That is, the imaging support system 1001 includes an information processing device 101, an imaging device 200, and a storage device 301. Note that in the second embodiment, some of the contents that overlap with those described in the first embodiment will not be described.

[0054] [Details of storage device 301] The storage device 301 includes a geospatial information storage unit 321 instead of the event data storage unit 320 in the first embodiment.

[0055] The geospatial information storage unit 321 stores geospatial information. The geospatial information is information in which position data indicating a position on the ground surface, data on the topography of the position, data on objects present at the position, data on events occurring at the position, and image data indicating the position are associated with each other. The data on the topography includes, for example, a topographical map, information indicating geology, and information indicating the ground. The data on the objects includes, for example, building information including information on the type and location of buildings, and road maps. The data on events includes, for example, information on disasters and accidents that have occurred in the past, and hazard maps. The image data indicating the position includes, for example, aerial photographs and satellite images. The geospatial information may include data obtained by measurement or investigation, and information representing the results of analysis based on the data. The geospatial information may also include information that is artificially determined based on data obtained by measurement or investigation. The geospatial information may also include disaster data and meteorological data. The geospatial information may also include information that is publicly available on the Internet. That is, the geospatial information also includes the above-mentioned event data.

[0056] The geospatial information is used, for example, in a system called a Geographic Information System (GIS). For example, the GIS outputs a map by superimposing the above-mentioned various data corresponding to positions on the map. The geospatial information is sometimes called GIS data. Note that the geospatial information is not limited to data dedicated to the GIS, and may be used in systems other than the GIS.

[0057] [Details of information processing device 101] As shown in FIG. 5, the information processing device 101 includes a reception unit 110, an acquisition unit 121, a determination unit 131, a generation unit 140, an imaging control unit 150, an output control unit 161, a change information generation unit 170, and a path calculation unit 180.

[0058] The acquiring unit 121 acquires the event data from the geospatial information storage unit 321. For example, the acquiring unit 121 acquires disaster data and hazard maps within a range specified by the generation request as the event data.

[0059] The acquisition unit 121 also acquires real-time data. The real-time data refers to data that is updated at any time even after the reception unit 110 receives a generation request from the terminal device 400. For example, the acquisition unit 121 acquires posted information related to a range specified by the generation request as real-time data. The posted information is information posted to a social networking service (SNS) by a user of the SNS. The posted information includes text information and images. The posted information may also include location information of the SNS user. The acquisition unit 121 acquires the posted information from an SNS server (not shown). In this case, the imaging support system 1001 and the SNS server are communicatively connected via a network. The acquisition unit 121 acquires posted information related to a range specified by the generation request, including content related to a disaster situation. For example, the acquisition unit 120 acquires posted information including text information such as "disaster," "earthquake," "damage," and "flooding." At this time, the acquisition unit 121 acquires posted information to which location information within the range specified by the generation request is added, or posted information containing text information indicating a location within the specified range. For example, it is possible to estimate, from the posted information, a location within the specified range where damage has particularly occurred (i.e., a target range).

[0060] The acquisition unit 121 may also acquire location information of a mobile terminal such as a mobile phone or a smartphone as real-time data. In this case, the mobile terminal is provided with a function capable of identifying its own location information by a global navigation satellite system (GNSS) such as a global positioning system (GPS). For example, the acquisition unit 121 acquires location information of the mobile terminal within a range specified by the generation request as real-time data. For example, when a disaster occurs, people in the vicinity of the disaster occurrence location are likely to move in a certain direction for evacuation. Therefore, for example, it is possible to estimate the disaster occurrence location (i.e., the target range) from a change in the location information of the mobile terminal within a predetermined time. The acquisition unit 121 acquires location information of the mobile terminal from, for example, a management server managed by a communication carrier or the like. In this case, the imaging support system 1001 and the management server are connected to be able to communicate with each other via a network.

[0061] The acquisition unit 121 may also acquire information of the safety confirmation system as real-time data. The safety confirmation system is a system capable of confirming the safety status of registered people when a disaster occurs. For example, the information of the safety confirmation system includes information indicating the location of registered people. For example, when a certain number of people are in a specific shelter, it can be estimated that a disaster has occurred near the specific shelter. The acquisition unit 121 can acquire information of the safety confirmation system from an operation server of the safety confirmation system via a network. In this case, the imaging support system 1001 and the SNS server are connected to be able to communicate with each other via a network.

[0062] Alternatively, the acquisition unit 121 may acquire weather data as real-time data. The weather data may be, for example, the amount of precipitation, the amount of snowfall, position information of rain clouds, the strength of a typhoon, and position information of the typhoon. The acquisition unit 121 acquires the weather data from a weather server that handles weather data via a network. In this case, the imaging support system 1001 and the weather server are connected to be able to communicate with each other via the network.

[0063] Furthermore, the acquisition unit 121 may acquire evacuation shelter information indicating the opening status of evacuation shelters. The evacuation shelter information includes at least information on the location where the evacuation shelter is opened. The evacuation shelter information may include information on a plurality of evacuation shelters, and may be information in which the location of the evacuation shelter, whether it is opened, the number of people in the evacuation shelter, and the supplies present in the evacuation shelter are associated with each other for each evacuation shelter. The acquisition unit 121 may acquire the evacuation shelter information from a safety confirmation system, or from information transmitted by a local government via the Internet. The acquisition unit 121 may also acquire the evacuation shelter information from information reported on television and radio.

[0064] The identification unit 131 identifies a target range based on the event data and real-time data acquired by the acquisition unit 121. For example, the identification unit 131 may extract a range in which a disaster is estimated to have occurred for each of the event data and real-time data, and identify a range where a plurality of extracted ranges overlap as the target range. The identification unit 130 may also calculate a score indicating the possibility of a disaster occurring for each pre-delimited range of the ground surface based on the event data and real-time data, and identify a range where the score is equal to or greater than a predetermined value as the target range. Note that an example of identifying a target range is not limited to this example.

[0065] The change information generating unit 170 generates change information. The change information is information indicating changes in the ground surface that occur over time. For example, the change information includes height displacement information indicating a displacement in the height of the ground surface, and water area information indicating a water area that has occurred on the ground surface. Such change information is generated by detecting various changes from imaging data by SAR. For example, the height displacement information is generated based on the phase difference and intensity difference of the reflected wave included in the imaging data when a predetermined imaging range is imaged by the imaging device 200 at different times. For example, the reflected wave acquired for the same imaging range is made to interfere with each other, and the phase difference is calculated, so that the difference in distance between the ground surface and the radar according to the phase difference can be calculated. The height displacement information is generated by using the calculated difference in distance. This technology is also called interference SAR. Note that the method of generating the height displacement information is not limited to this example. In addition, the water area information is generated by using, for example, the properties of electromagnetic waves. For example, the electromagnetic waves irradiated by the radar are not easily reflected in the direction of the radar on the water surface. Therefore, the location where the reflected wave is not easily acquired is likely to be a water area. By utilizing such properties of electromagnetic waves, water area information is generated from the imaging data. At this time, the water area information may be generated, for example, by comparing a plurality of imaging data, or by comparing the imaging data with a map corresponding to the imaging range. Note that the method of generating the water area information is not limited to this example.

[0066] When generating change information using a plurality of pieces of imaging data, the change information generating section 170 may use imaging data captured by each of the plurality of imaging devices 200. For example, it is assumed that the imaging devices 200 are satellites in a satellite constellation. In this case, the change information generating section 170 may generate change information using imaging data captured by each of the satellites in the satellite constellation.

[0067] The route calculation unit 180 calculates a predetermined route. For example, it is assumed that the reception unit 110 receives an output request for a route to a shelter from the terminal device 400. The route output request includes, for example, information indicating a predetermined starting point. Then, the route calculation unit 180 calculates a route connecting the predetermined starting point and the shelter based on the shelter information and the road map included in the geospatial information. At this time, the route calculation unit 180 may calculate the route using the change information. Specifically, for example, when there is a point on the route connecting the starting point and the shelter where the value indicated by the height displacement information is equal to or greater than a predetermined value, the route calculation unit 180 calculates a route that bypasses the point. Also, for example, when there is a point where a water area occurs on the route connecting the starting point and the shelter, the route calculation unit 180 calculates a route that bypasses the point. There may be a road that is impassable due to a landslide, flood, or the like. For such roads, there is a high possibility that a change is indicated in the change information. Therefore, by calculating a route based on the change information, the route calculation unit 180 can calculate a route that bypasses roads that may be impassable. In addition, when there are multiple evacuation shelters, the route calculation unit 180 may calculate a route from a starting point to each of the evacuation shelters. In addition, the route calculation unit 180 can calculate a route from an arbitrary starting point to an arbitrary arrival point.

[0068] In the above example, the route calculation unit 180 calculates a route from the starting point to the evacuation shelter, but this is not limited to the example. For example, the route calculation unit 180 may simply calculate a passable route around a specific structure such as a evacuation shelter based on the change information, regardless of the starting point.

[0069] In this way, the route calculation unit 180 calculates a route that does not include a location where the change in the ground surface exceeds a certain standard, based on change information that is information generated according to imaging data based on the results of imaging by an imaging device and indicates changes in the ground surface that occur over time. The route calculation unit 180 is an example of a route calculation means.

[0070] The output control unit 161 may output the above-mentioned various information (for example, geospatial information, evacuation shelter information, change information, route information, etc.) to the terminal device 400. The output control unit 161 may output the information to be output to the terminal device 400 as character information or in a table format. The output control unit 161 may also output to the terminal device 400 a superimposed image in which various information is superimposed on a map including a range indicated in the output request. For example, the output control unit 161 may output to the terminal device 400 a superimposed image in which change information and route information are superimposed on a map. FIG. 6 is a diagram showing an example of an image output by the output control unit 161. In FIG. 6, an icon indicating a shelter is superimposed on a position on the map where the shelter is located, and a location where a water area has occurred is indicated by hatching. Furthermore, in FIG. 6, a route from a starting point to the shelter that does not pass through a location where a water area has occurred is also indicated by an arrow. When there are multiple shelters, the output control unit 161 may output multiple shelter icons and multiple routes. The output control unit 161 may also output a passable route regardless of the starting point. In this case, the output control unit 161 may further blink or color the icon of the shelter that is the shortest distance from the starting point or the image showing the route to the shelter.

[0071] Furthermore, when a user selects a shelter by, for example, clicking on an icon of the shelter on the superimposed image output to the terminal device 400, the output control unit 161 may output details of the selected shelter. The details of the shelter may be the opening status of the shelter or the distance from the starting point. In this case, for example, the user selects a shelter through the terminal device 400, and the reception unit 110 receives that a shelter has been selected by the user. Then, when the reception unit 110 receives that a structure has been selected, the output control unit 161 outputs details of the selected shelter to the terminal device 400.

[0072] [Operation of information processing device 101] Next, an example of the operation of the information processing device 101 will be described with reference to FIGS.

[0073] FIG. 7 is a flowchart for explaining an example of the operation of the information processing device 101. Specifically, FIG. 7 is a diagram for explaining an example of the operation when the information processing device 101 accepts a generation request when a disaster occurs. The reception unit 110 accepts a generation request for an imaging plan from the terminal device 400 (S301). The acquisition unit 121 acquires event data and real-time data related to a range specified by the generation request (S302). The event data is, for example, disaster data and a hazard map related to a past disaster. The real-time data may be, for example, at least one of posted information, location information of a mobile terminal, information of evacuees registered in a safety confirmation system, and weather data. Then, the identification unit 131 identifies a target range (S303). Specifically, the identification unit 131 estimates a disaster occurrence location based on the event data and the real-time data, and identifies the estimated disaster occurrence location as a target range. The processes of S304 to S306 are similar to the processes of S104 to S106 in FIG. 3.

[0074] Fig. 8 is a flowchart illustrating another example of the operation of the information processing device 101. Specifically, Fig. 8 is a diagram illustrating an example of the operation of the information processing device 101 after the imaging data is generated by the imaging device 200.

[0075] The reception unit 110 receives a route output request (S401). Here, it is assumed that the reception unit 110 receives an output request for a route from a predetermined starting point to a shelter. That is, the output request includes information on the starting point. The acquisition unit 121 acquires imaging data in which the target range is imaged (S402). The change information generation unit 170 generates change information in the imaging range based on the imaging data (S403). The route calculation unit 180 calculates a route from the starting point to the shelter (S404). The output control unit 161 outputs information indicating the calculated route to the terminal device 400 (S405). For example, the output control unit 161 outputs to the terminal device 400 an image in which a route from the starting point to the shelter that does not include a location where the change in the ground surface exceeds a certain standard is superimposed on a map.

[0076] In this way, the information processing device 101 of the second embodiment acquires event data that is based on an event that has already occurred and includes information on the position of the ground surface associated with the event. Then, based on the event data, the information processing device 101 identifies a target range that is the range of the ground surface to be imaged by the imaging device, and generates an imaging plan for the imaging device so that the imaging device images the target range. In this way, the information processing device 101 of the second embodiment achieves the same effects as the information processing device 100 of the first embodiment. That is, the information processing device 101 of the second embodiment can support the generation of the imaging plan.

[0077] Moreover, the information processing device 101 of the second embodiment acquires at least one of data on locations where damage occurred due to past disasters and a hazard map as event data, and further acquires real-time data including at least one of posted information posted to an SNS and including content related to the disaster situation, location information of a mobile terminal, and information on evacuees registered in a safety confirmation system. Then, the information processing device 101 estimates the location of the disaster based on the event data and the real-time data, and specifies the estimated location of the disaster as the target range. In this way, the information processing device 101 of the second embodiment specifies the target range using the real-time data in addition to the event data, and therefore can specify the target range more accurately. That is, the information processing device 101 can support the generation of an appropriate imaging plan.

[0078] Furthermore, the information processing device 101 of the second embodiment calculates a route that does not include a location where the change in the ground surface exceeds a certain standard, based on change information that is information generated according to imaging data based on the results of imaging by an imaging device and indicates changes in the ground surface that occur over time. For example, a road may become impassable due to a landslide or the like. In the event of a disaster, it is difficult to quickly determine which roads have been damaged. In response to this, the information processing device 101 of the second embodiment can quickly provide a passable route on the ground surface.

[0079] [Variation 3] The method of acquiring real-time data is not limited to the above example. The acquiring unit 121 may acquire real-time data based on information on a range estimated from event data. For example, it is assumed that the acquiring unit 121 acquires event data related to a range specified in a generation request. At this time, the identifying unit 131 estimates a range in which a disaster has occurred to a degree of granularity that can be estimated based on the acquired event data. Then, the acquiring unit 121 acquires real-time data in the estimated range in which the disaster has occurred.

[0080] That is, the information processing device 101 of the third modification narrows down the range where a disaster may occur from the range specified in the generation request based on the event data. Then, the information processing device 101 acquires real-time data in the narrowed down range. This makes it possible for the information processing device 101 of the third modification to acquire real-time data that is more useful when identifying the location where a disaster has occurred.

[0081] <Third embodiment> Next, an information processing apparatus according to a third embodiment will be described.

[0082] In oceans with frozen areas (sea ice), such as the Arctic Ocean, whether ships can pass through depends on the state of the sea ice. In the third embodiment, an imaging support system for generating an imaging plan for grasping the state of sea ice on the earth's surface will be described in detail.

[0083] Fig. 9 is a block diagram showing an example of the configuration of an imaging support system 1002 according to the third embodiment. As shown in Fig. 9, the imaging support system 1002 includes an information processing device 102 and a storage device 302 instead of the information processing device 101 and the storage device 301 in the second embodiment, and is otherwise similar to the imaging support system 1001 described in the second embodiment. That is, the imaging support system 1002 includes an information processing device 102, an imaging device 200, and a storage device 302. Note that in the third embodiment, some of the contents that overlap with those described in the first and second embodiments will not be described.

[0084] [Details of storage device 302] The geospatial information storage unit 322 stores the above-mentioned geospatial information. Furthermore, the geospatial information includes ship route data and sea ice data. The route data is data indicating at least the places where the ship has passed in the past. The route data may further be information correlating the places and times where the ship has passed in the past. The route data may be, for example, data generated based on an AIS (Automatic Identification System) installed on the ship. The sea ice data is data indicating past variations in sea ice. The sea ice data may be, for example, data indicating the state of sea ice observed in the past using a publicly known method.

[0085] [Details of the information processing device 102] As shown in FIG. 9, the information processing device 102 includes a reception unit 110, an acquisition unit 122, an identification unit 132, a generation unit 140, an imaging control unit 150, an output control unit 162, a freezing identification information generation unit 171, and a route calculation unit 181.

[0086] The acquisition unit 122 acquires, for example, at least one of route data and sea ice data within a range specified by the generation request as event data.

[0087] The identification unit 132 identifies the target range based on the event data acquired by the acquisition unit 122. For example, the identification unit 132 estimates a location where the ship can pass from the route data. At this time, the identification unit 132 may extract locations where the ship has passed in the past using the route data, and estimate locations where the ship has passed a certain number of times as locations where the ship can pass. For example, the identification unit 132 may estimate locations where the ship can pass from the past sea ice state of the sea ice data. The identification unit 132 may also estimate locations where the ship can pass by combining the ship data and the sea ice data. The identification unit 132 identifies the estimated locations where the ship can pass as the target range. Then, the generation unit 140 generates an imaging plan to image the target range. In this way, the information processing device 102 can also identify locations where the ship is estimated to be able to pass in advance and generate an imaging plan.

[0088] The method of identifying the target range is not limited to the above example. For example, the identification unit 132 may identify the target range using data other than the route data and the sea ice data. For example, the identification unit 132 may identify the target range by further using weather data predicted in the range specified by the generation request. Here, the weather data includes, for example, temperature information. For example, the identification unit 132 may estimate, as a location where the ship can pass, a location where the number of times the ship has passed in the past is equal to or greater than a certain value and where the temperature is equal to or greater than a predetermined temperature.

[0089] The freezing identification information generating unit 171 generates freezing identification information based on the imaging data. The freezing identification information is information for identifying frozen and unfrozen areas on the sea surface. Such freezing identification information can be generated from imaging data obtained by SAR. For example, electromagnetic waves irradiated by a radar have a characteristic that the water surface and the ice surface reflect the electromagnetic waves in the direction of the radar differently. Also, the water surface and the ice surface have a characteristic that the polarized waves are reflected differently depending on the surface characteristics of the water surface and the ice surface. By utilizing such properties of the electromagnetic waves, it is possible to estimate the frozen area from the imaging data.

[0090] The freezing identification information may also include information on the thickness of sea ice. The thickness of sea ice is calculated based on imaging data captured by SAR. For example, the freezing identification information generating unit 171 uses imaging data captured in the same imaging range at multiple times to calculate the phase difference of the reflected waves in each imaging data, thereby calculating the thickness of sea ice.

[0091] The route calculation unit 181 calculates a route that the ship can pass through based on the ice identification information. For example, the route calculation unit 181 calculates an area that is not iced as a passable route. Furthermore, the route calculation unit 181 may calculate an area where the thickness of sea ice is less than a predetermined threshold as a passable route, in addition to the area that is not iced. The output control unit 162 may output various information in an arbitrary format to the terminal device 400, similar to the output control unit 161 of the second embodiment. Specifically, a superimposed image in which at least one of the ice identification information and the calculated route is superimposed on a map showing the sea may be output.

[0092] The freezing identification information generating unit 171 may be incorporated as one of the functions in the change information generating unit 170 described in the second embodiment. Also, the route calculating unit 181 may be incorporated as one of the functions in the route calculating unit 180 described in the second embodiment.

[0093] [Operation of information processing device 102] Next, an example of the operation of the information processing device 102 will be described with reference to FIGS.

[0094] Fig. 10 is a flowchart for explaining an example of the operation of the information processing device 102. Specifically, Fig. 10 is a diagram for explaining an example of the operation when the information processing device 102 receives a request to generate an imaging plan for the purpose of grasping the state of sea ice on the ground surface.

[0095] The reception unit 110 receives a request to generate an imaging plan from the terminal device 400 (S501). The acquisition unit 122 acquires event data related to the range specified by the generation request (S502). The event data is, for example, route data and sea ice data. Then, the identification unit 132 identifies the target range (S503). Specifically, the identification unit 132 estimates locations where ships can pass based on the event data, and identifies the estimated locations as the target range. The processes of S504 to S506 are similar to the processes of S104 to S106 in FIG. 3.

[0096] Fig. 11 is a flowchart illustrating another example of the operation of the information processing device 102. Specifically, Fig. 11 is a diagram illustrating an example of the operation of the information processing device 102 after the imaging data is generated by the imaging device 200.

[0097] The reception unit 110 receives a request to output a route (S601). Here, it is assumed that the reception unit 110 receives a request to output a route that the ship can navigate from the terminal device 400. The acquisition unit 122 acquires imaging data in which the target range is imaged (S602). The freezing identification information generation unit 171 generates freezing identification information for the imaging range based on the imaging data (S603). The route calculation unit 181 calculates a route that the ship can navigate based on the freezing identification information (S604). The output control unit 162 outputs information indicating the calculated route to the terminal device 400 (S605). For example, the output control unit 162 outputs an image in which the ship's navigable route is superimposed on a map showing the sea to the terminal device 400. At this time, the output control unit 162 may superimpose a diagram showing frozen and unfrozen areas on a map showing the sea, and may further output to the terminal device 400 an image superimposed with routes that ships can pass through.

[0098] In this way, the information processing device 102 of the third embodiment acquires event data that is based on an event that has already occurred and includes information on the position of the ground surface associated with the event. Then, based on the event data, the information processing device 102 identifies a target range that is the range of the ground surface to be imaged by the imaging device, and generates an imaging plan for the imaging device so that the imaging device images the target range. In this way, the information processing device 102 of the third embodiment achieves the same effects as the information processing device 100 of the first embodiment. That is, the information processing device 102 of the third embodiment can support the generation of the imaging plan.

[0099] Furthermore, the information processing device 102 of the third embodiment acquires at least one of ship route data and sea ice data showing sea ice fluctuation as event data, estimates locations where ships can pass based on the event data, and specifies the estimated locations as the target range. This allows the information processing device 102 of the third embodiment to support the generation of an imaging plan for grasping the state of sea ice on the ground surface.

[0100] Furthermore, the information processing device 102 of the third embodiment calculates a passable route for a ship based on ice identification information, which is information generated according to imaging data based on the results of imaging by an imaging device and is information for identifying frozen and unfrozen areas on the sea. In this way, the information processing device 102 of the third embodiment can provide a passable route on the sea where frozen areas exist.

[0101] [Variation 4] The route calculation unit 181 may calculate the route depending on the type of ship.

[0102] Icebreakers are often used in oceans with sea ice. The thickness of the sea ice that can be passed through may change depending on the type of icebreaker. Also, depending on the thickness of the sea ice, even ships that are not icebreakers may be able to pass through. In this way, the thickness of the sea ice may change the type of ship that can pass through.

[0103] The route calculation unit 181 calculates a route according to the type of ship using information on the thickness of sea ice. Information associating the type of ship with the thickness of sea ice through which the ship can pass may be stored in the storage device 302 or may be transmitted from the terminal device 400.

[0104] <Fourth embodiment> Next, an information processing apparatus according to a fourth embodiment will be described.

[0105] In areas where heavy rains occur frequently, large puddles occur. In areas with many such puddles, disease-carrying organisms such as mosquitoes tend to occur easily. Therefore, by understanding the occurrence of puddles, it may be possible to deal with the occurrence of a certain disease. In the fourth embodiment, an imaging support system for generating an imaging plan for understanding the occurrence of water areas including puddles on the ground surface will be described in detail.

[0106] Fig. 12 is a block diagram showing an example of the configuration of an imaging support system 1003 according to the fourth embodiment. As shown in Fig. 12, the imaging support system 1003 includes an information processing device 103 and a storage device 303 instead of the information processing device 102 and the storage device 302 in the third embodiment, and is otherwise similar to the imaging support system 1002 described in the third embodiment. That is, the imaging support system 1003 includes an information processing device 103, an imaging device 200, and a storage device 303. Note that in the fourth embodiment, some of the contents that overlap with the contents described in the first, second, and third embodiments will not be described.

[0107] [Details of storage device 303] The geospatial information storage unit 323 stores the above-mentioned geospatial information. Furthermore, the geospatial information includes data on locations where water areas have occurred in the past (referred to as water area occurrence data), and data associating the number of people who have had a specific disease in the past with their locations (referred to as disease data). Note that the water area occurrence data may include the above-mentioned water area information generated in the past, or may include information generated by observing water areas using other methods. Furthermore, the geospatial information storage unit 323 stores distribution information indicating the distribution of population in a specific area.

[0108] [Details of the information processing device 103] As shown in FIG. 12, the information processing device 103 includes a reception unit 110, an acquisition unit 123, a determination unit 133, a generation unit 140, an imaging control unit 150, an output control unit 163, a change information generation unit 172, and a selection unit 190.

[0109] The acquisition unit 123 acquires, for example, at least one of water area occurrence data and disease data within a range specified by the generation request as event data.

[0110] The identifying unit 133 identifies the target range based on the event data acquired by the acquiring unit 123. For example, the identifying unit 133 estimates the location where the water area occurs from the water area occurrence data. At this time, the identifying unit 133 may extract the location where the water area occurred in the past, and estimate the location where the water area is predicted to remain as the location where the water area occurs. The identifying unit 133 may also extract the location where the water area occurred in the past, and estimate the location where the water area has occurred a predetermined number of times or more as the location where the water area occurs. The identifying unit 133 may also estimate the vicinity of an area where the number of people who have a predetermined disease (e.g., malaria) is greater than or equal to a predetermined number, based on the disease data, as the location where the water area occurs. Then, the identifying unit 133 identifies the estimated location where the water area occurs as the target range.

[0111] The identifying unit 133 may also extract locations where water areas have occurred a predetermined number of times or for a predetermined period of time in the past from the water area occurrence data, and set these locations as locations where water areas are estimated to occur in the future. The identifying unit 133 may then identify these locations as target ranges. This allows the information processing device 103 to identify in advance locations where water areas are likely to occur in the future, and generate an imaging plan.

[0112] The method of identifying the target range is not limited to the above example. For example, the identification unit 133 may identify the target range by using data other than the water area occurrence data and the disease data. For example, the identification unit 133 may identify the target range by further using meteorological data in the range specified by the generation request. Here, the meteorological data includes, for example, information on precipitation. For example, the identification unit 133 may estimate an area where precipitation equal to or greater than a predetermined value is observed as a location where a water area occurs.

[0113] The change information generating unit 172 generates change information based on the imaging data. In particular, the change information generating unit 172 generates water area information. The water area information may include information indicating the location where the water area occurs, or may include information indicating the change in the water area. For example, the imaging data is compared with a map corresponding to the imaging range of the imaging data, thereby generating information indicating the location where the water area occurs. Also, for example, information indicating whether the water area is expanding or shrinking is generated by comparing imaging data of the same imaging range that is captured at multiple times. In this way, the change information generating unit 172 generates change information including water area information indicating the water area that occurs on the ground surface according to imaging data based on the results of imaging by the imaging device.

[0114] The selection unit 190 selects an area to which medicines are provided. As described above, there is a possibility that organisms such as mosquitoes that transmit a certain disease may emerge from puddles. Therefore, it is predicted that the demand for medicines for a certain disease will be high in the vicinity of the location where the water area has occurred. The selection unit 190 selects an area to which medicines are provided based on the water area information and distribution information indicating the distribution of population. For example, the selection unit 190 determines that the certain disease is likely to occur when the population of the area including the location where the water area has occurred is equal to or greater than a threshold. Also, for example, the selection unit 190 may determine that the certain disease is likely to occur when the population of the area including the location where the water area has expanded is equal to or greater than a threshold based on the water area information. Then, the selection unit 190 selects the area determined to be highly likely to cause the certain disease to occur as an area to which medicines are provided.

[0115] The distribution information may also include information on facilities where people gather. In this case, the selection unit 190 may select an area where the medicine is provided using information on the distance from the location where the water area indicated in the water area information occurs to various facilities. The various facilities are facilities where people gather, such as markets, stations, hospitals, and government offices. For example, when the distance from the location where the water area occurs or the location where the expanded water area exists to the facility where people gather is less than a threshold, the selection unit 190 selects an area including the facility as an area where the medicine is provided.

[0116] In this way, the selection unit 190 selects an area for providing medicines for diseases transmitted by organisms originating from water areas, based on the water area information and distribution information indicating population distribution. The selection unit 190 is an example of a selection means.

[0117] The output control unit 163 may output various information in an arbitrary format to the terminal device 400, similar to the above-mentioned output control unit 162. Specifically, a superimposed image in which at least one of water area information and information indicating a selected region is superimposed on a map may be output.

[0118] [Operation of information processing device 103] Next, an example of the operation of the information processing device 103 will be described with reference to FIGS.

[0119] Fig. 13 is a flowchart for explaining an example of the operation of the information processing device 103. Specifically, Fig. 13 is a diagram for explaining an example of the operation when the information processing device 103 receives a request for generating an imaging plan for the purpose of grasping the occurrence state of a water area on the ground surface.

[0120] The reception unit 110 receives a request to generate an imaging plan from the terminal device 400 (S701). The acquisition unit 123 acquires event data related to the range specified by the generation request (S702). The event data is, for example, water area occurrence data and disease data. Then, the identification unit 133 identifies the target range (S703). Specifically, the identification unit 133 estimates the location where the water area occurs based on the event data, and identifies the estimated location as the target range. The processes of S704 to S706 are similar to the processes of S104 to S106 in FIG. 3.

[0121] Fig. 14 is a flowchart illustrating another example of the operation of the information processing device 103. Specifically, Fig. 14 is a diagram illustrating an example of the operation of the information processing device 103 after imaging data is generated by the imaging device 200.

[0122] The reception unit 110 receives an output request for the selection result of the region where the medicine is provided from the terminal device 400 (S801). The acquisition unit 123 acquires imaging data in which the target range is imaged (S802). The change information generation unit 172 generates change information including water area information in the imaging range based on the imaging data (S803). The selection unit 190 selects the region where the medicine is provided based on the water area information and the distribution information (S804). Then, the output control unit 163 outputs information indicating the selected region (S805). For example, the output control unit 163 outputs an image in which information indicating the selected region is superimposed on a map to the terminal device 400. At this time, the output control unit 163 may output an image in which water area information is further superimposed.

[0123] In this way, the information processing device 103 of the fourth embodiment acquires event data that is based on an event that has already occurred and includes information on the position of the ground surface associated with the event. Then, based on the event data, the information processing device 103 specifies a target range that is the range of the ground surface to be imaged by the imaging device, and generates an imaging plan for the imaging device so that the imaging device images the target range. In this way, the information processing device 103 of the fourth embodiment achieves the same effects as the information processing device 100 of the first embodiment. That is, the information processing device 103 of the fourth embodiment can support the generation of the imaging plan.

[0124] Furthermore, the information processing device 103 of the fourth embodiment acquires at least one of data on locations where water bodies have occurred in the past and data associating the number of people who have had a specific disease in the past with their locations as event data, estimates the location where the water body will occur based on the event data, and specifies the estimated location as the target range. This allows the information processing device 103 of the fourth embodiment to support the generation of an imaging plan for grasping the occurrence status of water bodies on the earth's surface.

[0125] Furthermore, the information processing device 103 of the fourth embodiment generates change information including water area information indicating a water area occurring on the ground surface according to imaging data based on the results of imaging by an imaging device, and selects an area to provide medicine for diseases transmitted by organisms occurring in the water area based on the water area information and distribution information indicating population distribution. In this way, the information processing device 103 of the fourth embodiment can support responses to the outbreak of diseases caused in part by water areas.

[0126] The information processing device 103 of the fourth embodiment can also be applied to support searching for water sources. In this case, for example, the output control unit 163 outputs to the terminal device 400 an image in which a location where a new water area has appeared is superimposed on a map based on the water area information.

[0127] The information processing device 103 of the fourth embodiment can also be applied to support the discovery of illegal mining. Mining can cause groundwater to gush out from the mined area. For example, the output control unit 163 outputs an image of a newly generated water area superimposed on a map based on the water area information to the terminal device 400. This allows the information processing device 103 to provide information that a water area has been generated in a place not previously planned by the government or the like.

[0128] <Fifth embodiment> The information processing device according to the present disclosure may have the following configuration.

[0129] Fig. 15 is a block diagram showing an example of a functional configuration of the information processing device 500. The imaging support system 1000 shown in Fig. 1 may be provided with the information processing device 500 instead of the information processing device 100. As shown in Fig. 15, the information processing device 500 includes an acquisition unit 510, an identification unit 520, and a generation unit 530.

[0130] The acquisition unit 510 acquires event data based on an event that has already occurred, including information on a location on the ground surface associated with the event. As described above, the event data includes disaster data, hazard maps, disease data, weather data, sea ice data, and sea route data. Note that the event data is not limited to these examples.

[0131] The identification unit 520 identifies a target range, which is a range of the ground surface to be imaged by the imaging device, based on the event data. For example, the identification unit 520 may identify, as the target range, a range in which it is estimated that there is a change in the ground surface of a predetermined scale or more from the event data.

[0132] The generation unit 530 generates an imaging plan for the imaging device so that the imaging device images the target range.

[0133] 16 is a flowchart for explaining an example of the operation of the information processing device 500. First, the acquisition unit 510 acquires event data, which is data based on an event that has already occurred and includes information on the position of the ground surface related to the event (S501). Next, the identification unit 520 identifies a target range, which is a range of the ground surface to be imaged by the imaging device, based on the event data (S502). Then, the generation unit 530 generates an imaging plan for the imaging device so that the imaging device images the target range (S503).

[0134] With the above-mentioned configuration, the information processing device 500 of the fifth embodiment can specify the target range and generate an imaging plan regardless of the current situation of the ground surface, for example. Therefore, for example, the information processing device 500 can generate an imaging plan with an imaging target being a range where an abnormality is estimated to occur, even before an abnormality occurring on the ground surface becomes apparent. That is, the information processing device 500 of the fifth embodiment can support the generation of an imaging plan.

[0135] <Example of hardware configuration of information processing device> The hardware constituting the information processing device of the above-mentioned first, second, third, fourth and fifth embodiments will be described. Fig. 17 is a block diagram showing an example of the hardware configuration of a computer device that realizes the information processing device in each embodiment. Each block shown in Fig. 17 can be realized by a combination of a computer device 10 that realizes the information processing device and information processing method in each embodiment and software.

[0136] 16, a computer device 10 includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, a storage device 14, an input / output interface 15, a bus 16, and a drive device 17. The information processing device may be realized by a plurality of electric circuits.

[0137] The storage device 14 stores a program (computer program) 18. The processor 11 executes the program 18 of the information processing device using the RAM 12. Specifically, for example, the program 18 includes a program that causes the computer to execute the processes shown in FIG. 3, FIG. 4, FIG. 7, FIG. 8, FIG. 10, FIG. 11, FIG. 13, FIG. 14, and FIG. 16. The processor 11 executes the program 18 to realize the functions of the components of the information processing device. The program 18 may be stored in the ROM 13. The program 18 may be recorded in the storage medium 20 and read out using the drive device 17, or may be transmitted to the computer device 10 from an external device (not shown) via a network (not shown).

[0138] The input / output interface 15 exchanges data with peripheral devices (such as a keyboard, a mouse, and a display device) 19. The input / output interface 15 functions as a means for acquiring or outputting data. The bus 16 connects the various components.

[0139] There are various variations in the method of implementing the information processing device. For example, the information processing device may be implemented as a dedicated device. Furthermore, the information processing device may be implemented based on a combination of multiple devices.

[0140] The scope of each embodiment also includes a processing method for recording a program for implementing each component of the function of each embodiment on a storage medium, reading the program recorded on the storage medium as code, and executing the program on a computer. That is, a computer-readable storage medium is also included in the scope of each embodiment. Also, the storage medium on which the above-mentioned program is recorded and the program itself are included in each embodiment.

[0141] The storage medium is, for example, but not limited to, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD (Compact Disc)-ROM, a magnetic tape, a non-volatile memory card, or a ROM. Furthermore, the programs recorded on the storage medium are not limited to programs that execute processes independently, but also include programs that operate on an OS (Operating System) and execute processes in cooperation with other software and functions of an expansion board, which are included in the scope of each embodiment.

[0142] Although the present invention has been described above with reference to the embodiment, the present invention is not limited to the above embodiment. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

[0143] This application claims priority based on Japanese Patent Application No. 2021-015660, filed on February 3, 2021, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]

[0144] 100, 101, 102, 103, 500 Information processing device 110 Reception 120, 121, 122, 123, 510 Acquisition part 130, 131, 132, 133, 520 Specific part 140, 530 generation section 150 Imaging control section 160, 161, 162, 163 Output control section 170, 172 Change information generating unit 171 Freezing Identification Information Generation Unit 180 Route Calculation Unit 181 Route Calculation Unit 190 Selection Department 200 Imaging device 300, 301, 302, 303 storage device 400 Terminal Equipment

Claims

1. An acquisition means for acquiring event data based on an event that has already occurred, the event data including information on a position on the earth surface associated with the event; a specifying means for specifying a target range, which is a range of the ground surface to be imaged by the imaging device, based on the event data; A generation means for generating an imaging plan for the imaging device so that the imaging device images the target range; A route calculation means for calculating a predetermined route; Equipped with the route calculation means calculates a route that does not include a location where the change in the ground surface exceeds a certain standard based on change information that is information generated in response to imaging data based on the results of imaging by the imaging device and is information that indicates changes in the ground surface that occur over time; Information processing device.

2. The acquiring means acquires at least one of ship route data and sea ice data indicating past changes in sea ice as the event data; The identification means estimates a location where a ship can pass based on the event data, and identifies the estimated location as the target range. The information processing device according to claim 1 .

3. a route calculation means for calculating a route that a ship can travel based on ice identification information, which is information that is generated in response to imaging data based on the results of imaging by the imaging device and that is information that identifies frozen and unfrozen areas on the sea surface; 3. The information processing device according to claim 1 or 2.

4. The acquisition means acquires, as the event data, at least one of data relating to a location where a water body has occurred in the past and data associating the number of people who have contracted a predetermined disease in the past with the location; The identification means estimates a location where a water area occurs based on the event data, and identifies the estimated location as the target range. The information processing device according to claim 1 .

5. a change information generating means for generating change information including water area information indicating a water area occurring on the ground surface in accordance with imaging data based on the results of imaging by the imaging device; and a selection means for selecting an area to which medicines for diseases transmitted by organisms originating from the water area are to be provided based on the water area information and distribution information indicating a population distribution.

5. The information processing device according to claim 1.

6. acquiring event data based on an event that has already occurred, the event data including information about a location on the Earth's surface associated with the event; Identifying a target range, which is a range of the ground surface to be imaged by the imaging device, based on the event data; generating an imaging plan for the imaging device such that the imaging device images the target area; Calculating a given route; 1. A method comprising: Calculating a route that does not include a location where the change in the ground surface exceeds a certain standard based on change information that is information generated in response to imaging data based on the results of imaging by the imaging device and that is information that indicates changes in the ground surface that occur over time; Information processing methods.

7. Acquire at least one of ship route data and sea ice data showing past changes in sea ice as the event data; estimating a location where a ship can pass based on the event data, and identifying the estimated location as the target range; The information processing method according to claim 6.

8. calculating a route that a ship can pass on the basis of ice identification information, which is information generated in response to imaging data based on the results of imaging by the imaging device and is information that identifies frozen and unfrozen areas on the sea surface; 8. The information processing method according to claim 6 or 7.

9. acquiring event data based on an event that has already occurred, the event data including information on a location on the Earth's surface associated with the event; A process of identifying a target range, which is a range of the ground surface to be imaged by the imaging device, based on the event data; A generation process for generating an imaging plan for the imaging device so that the imaging device images the target range; A route calculation process for calculating a predetermined route; A program for causing a computer to execute the following: The route calculation process calculates a route that does not include a location where the change in the ground surface exceeds a certain criterion based on change information that is information generated according to imaging data based on the results of imaging by the imaging device and is information that indicates changes in the ground surface that occur over time. program.

10. The acquisition process acquires at least one of ship route data and sea ice data indicating past changes in sea ice as the event data, The identification process includes estimating a location where a ship can pass based on the event data, and identifying the estimated location as the target range. The program according to claim 9.

Citation Information

Patent Citations

  • Individual geological disaster emergency investigation method based on remote sensing of small unmanned aerial vehicle

    CN105865427A

  • Operation controller for electric power facility

    JP2003016153A

  • Observation plan managing program and method

    JP2005241455A

  • Disaster support system and disaster support program

    JP2012173836A

  • Wide area photographing control system

    JP2012237667A