System, Program, and Method

Abstract

Provided is a system capable of identifying a first area in which a change has occurred and identifying a second area within the first area. 【Solution means】 A system including at least one computer device. The system includes: a first area identification means for identifying a first area in which a change has occurred within the area based on a first image taken at a first time and a second image taken at a second time and capturing at least a part of the area within the first image; a selection reception means for receiving a selection of a second area within the first area based on a third image capturing at least a part of the first area, the first image, or the second image; and an address identification means for identifying an address corresponding to the second area. Further, the first image, the second image, and / or the third image is a captured image taken of the ground from above.

Description

Technical Field

[0001] The present invention relates to a system, a program, and a method.

Background Art

[0002] It is disclosed to determine whether a house in an aerial photograph or a satellite image is an empty house based on machine learning data for estimating an empty house in an image generated based on pixel information of the site of the empty house (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The present invention can solve, for example, any of the following problems. A first problem of the present invention is to provide a system capable of specifying a first area in which a change has occurred and specifying a second area within the first area. A second problem of the present invention is to provide a system capable of specifying a first area in which a change has occurred and further specifying an owner of a real estate corresponding to an address corresponding to the first area.

Means for Solving the Problems

[0005] The problems of the present invention are [1] A system comprising at least one computer device, based on a first image captured at a first time and a second image captured at a second time and capturing at least a part of the region within the first image, a first region specifying means for specifying a first region in which a change has occurred within the region, a selection receiving means for receiving a selection of a second region within the first region based on a third image capturing at least a part of the first region, the first image, or the second image, and an address specifying means for specifying an address corresponding to the second region, wherein the first image, the second image, and / or the third image is a captured image of the ground taken from above; [2] A system comprising at least one computer device, based on a first image captured at a first time and a second image captured at a second time and capturing at least a part of the region within the first image, a first region specifying means for specifying a first region in which a change has occurred within the region, and a second region specifying means for specifying a second region within the first region that satisfies a predetermined condition based on a third image capturing at least a part of the first region, wherein the first image, the second image, and the third image are captured images of the ground taken from above; [3] The system according to [1] or [2], wherein the first image and the second image are captured images with a lower resolution than the third image; [4] The system according to [1] or [2], wherein the third image is an optical image captured during the day, and the first image and the second image are optical images, infrared images, or SAR images captured at night; [5] The first time belongs to a different day from the second time and is a time after the second time, The system according to any one of [1] to [4], wherein the first image and the second image are captured images captured at a predetermined time zone; [6] The system according to any one of [2] to [5], wherein the second region specifying means specifies a second region in which a predetermined change has occurred within the first region and / or a second region having an attribute of a predetermined real estate based on the third image; [7] The system according to [6], wherein the second area specifying means uses, as input data, image data regarding a captured image obtained by photographing the ground from above, and uses a prediction model that has been machine-learned with information regarding a position within the captured image and changes in the area corresponding to the position as output data, to specify a second area in which a predetermined change has occurred; [8] The system according to [6], wherein the second area specifying means uses, as input data, image data regarding a captured image obtained by photographing the ground from above, and uses a prediction model that has been machine-learned with information regarding a position within the captured image and the attributes of real estate in the area corresponding to the position as output data, to specify a second area having predetermined attributes of real estate; [9] The system according to [2], wherein the second area specifying means specifies a second area in which a change has occurred within the first area, based on the third image captured at a third time and a fourth image captured at a fourth time and capturing at least a part of the first area, and the first image and the second image are captured images with lower resolution than the third image and the fourth image, or the third image and the fourth image are optical images captured during the day, and the first image and the second image are optical images, infrared images, or SAR images captured at night;

[10] The system according to [9], wherein the first time belongs to a different day than the second time and is after the second time, the third time is after the first time, and the fourth time is before the second time;

[11] The system according to any one of [2] to

[10] , further comprising address specifying means for specifying an address corresponding to the second area;

[12] The system according to [1] or

[11] , wherein the address specifying means specifies the latitude and longitude corresponding to at least one position within the second area, and specifies the address corresponding to the specified latitude and longitude;

[13] The system according to [1],

[11] or

[12] , further comprising owner specifying means for specifying the owner of the real estate corresponding to the address specified by the address specifying means, based on the correspondence between the address and the owner of the real estate corresponding to the address;

[14] A system comprising at least one computer device, based on a first image taken at a first time and a second image taken at a second time and capturing at least a part of the area within the first image, a first area specifying means for specifying a first area in which a change has occurred within the area, an address specifying means for specifying an address corresponding to the first area, and an owner specifying means for specifying an owner of a real estate corresponding to the address specified by the address specifying means based on the correspondence between the address and the owner of the real estate corresponding to the address. The system, wherein the first image and the second image are captured images taken of the ground from above.

[15] The system according to

[14] , wherein the owner specifying means specifies an owner of a real estate corresponding to the address specified by the address specifying means when a predetermined change has occurred in the first area and / or when the first area has a predetermined real estate attribute.

[16] The system according to any one of

[13] to

[15] , wherein the owner specifying means specifies an owner of a real estate corresponding to the address specified by the address specifying means and the contact information of the owner based on the correspondence between the address and the owner of the real estate corresponding to the address and the contact information of the owner.

[17] The system according to any one of

[13] to

[16] , wherein the address specified by the address specifying means is a lot number, and the owner specifying means specifies an owner of a real estate corresponding to the specified lot number based on the correspondence between the lot number and the owner of the real estate corresponding to the lot number.

[18] A program that causes a computer device to function as a first area specifying means for specifying a first area in which a change has occurred within an area based on a first image taken at a first time and a second image taken at a second time and capturing at least a part of the area within the first image, a selection receiving means for receiving a selection of a second area of the first area based on a third image capturing at least a part of the first area, the first image, or the second image, and an address specifying means for specifying an address corresponding to the second area, wherein the first image, the second image, and / or the third image are captured images taken of the ground from above.

[19] A program that causes a computer device to function as a first region specifying means for specifying a first region in which a change has occurred within a region based on a first image taken at a first time and a second image taken at a second time and capturing at least a part of the region within the first image, and a second region specifying means for specifying a second region that satisfies a predetermined condition within the first region based on a third image capturing at least a part of the first region, wherein the first image, the second image, and the third image are captured images taken of the ground from above;

[20] A program that causes a computer device to function as a first region specifying means for specifying a first region in which a change has occurred within a region based on a first image taken at a first time and a second image taken at a second time and capturing at least a part of the region within the first image, an address specifying means for specifying an address corresponding to the first region, and an owner specifying means for specifying an owner of a real estate corresponding to the address specified by the address specifying means based on a correspondence relationship between the address and the owner of the real estate corresponding to the address, wherein the first image and the second image are captured images taken of the ground from above;

[21] A method executed in a system including at least one computer device, the method including: a first region specifying step of specifying a first region in which a change has occurred within a region based on a first image taken at a first time and a second image taken at a second time and capturing at least a part of the region within the first image; a selection receiving step of receiving a selection of a second region of the first region based on a third image capturing at least a part of the first region, the first image, or the second image; and an address specifying step of specifying an address corresponding to the second region, wherein the first image, the second image, and / or the third image are captured images taken of the ground from above; A method executed in a system including at least one computer device, the method comprising: a first region specifying step of specifying a first region in which a change has occurred within a region based on a first image captured at a first time and a second image captured at a second time and capturing at least a partial region within the first image; and a second region specifying step of specifying a second region satisfying a predetermined condition within the first region based on a third image capturing at least a partial region of the first region, wherein the first image, the second image, and the third image are captured images of the ground taken from above; A method executed in a system including at least one computer device, the method comprising: a first region specifying step of specifying a first region in which a change has occurred within a region based on a first image captured at a first time and a second image captured at a second time and capturing at least a partial region within the first image; an address specifying step of specifying an address corresponding to the first region; and an owner specifying step of specifying an owner of a real estate corresponding to the address specified in the address specifying step based on a correspondence relationship between the address and an owner of the real estate corresponding to the address, wherein the first image and the second image are captured images of the ground taken from above; which can be solved by. [Advantages of the Invention]

[0006] According to the present invention, it is possible to provide a system capable of specifying a first region in which a change has occurred and specifying a second region within the first region. Further, according to the present invention, it is possible to provide a system capable of specifying a first region in which a change has occurred and further specifying an owner of a real estate corresponding to the address corresponding to the first region from the address corresponding to the first region. [Brief Description of the Drawings]

[0007]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0008] Hereinafter, embodiments of the present invention will be described. However, the present invention is not limited to the following embodiments as long as it does not contravene the gist of the present invention. The order of each process constituting the flowchart described below can be changed arbitrarily as long as there are no contradictions or inconsistencies in the process content. Also, as long as there are no contradictions or inconsistencies in the process content, a part of each process constituting the flowchart can be omitted, or a new process can be added to each process constituting the flowchart. Further, the device that is the subject of executing each process constituting the flowchart can be changed to another device as long as it does not contravene the gist of the present invention. In that case, the process content can be changed so that there are no contradictions or inconsistencies in the process content.

[0009] [Configuration of the System] FIG. 1 is a block diagram showing the configuration of a system according to an embodiment of the present invention. System 10 includes at least one computer device. System 10 may include a user terminal 1, a server device 2, and an administrator terminal 3. The user terminal 1, the server device 2, and the administrator terminal 3 are communicably connected to each other via a communication network 4. In system 10, any one of the user terminal 1, the server device 2, and the administrator terminal 3 can function as an information processing device. When any one of the user terminal 1, the server device 2, and the administrator terminal 3 functions as an information processing device, information is transmitted and received between at least two or more of the user terminal 1, the server device 2, and the administrator terminal 3 as necessary. Note that the number of the user terminal 1, the server device 2, and / or the administrator terminal 3 is not particularly limited as long as it is 1 or more.

[0010] Note that system 10 may be composed of, for example, one computer device (standalone type), may be composed of one or more server devices and one or more terminal devices (client - server type), or may be composed of a host device and one or more guest devices (peer - to - peer type). Also, the server device 2 may be distributed and function among a plurality of computer devices. For example, instead of the server device 2, a distributed ledger technology such as a blockchain may be used.

[0011] [User Terminal] The user terminal 1 is a terminal operated by a user of the system 10. FIG. 2 is a block diagram showing the hardware configuration of the user terminal according to an embodiment of the present invention. The user terminal 1 includes a control unit 11, a RAM 12, a storage unit 13, an input unit 14, a display unit 15, and a communication interface 16, which are respectively connected by a bus.

[0012] The control unit 11 is composed of a CPU and a ROM. The control unit 11 executes the program stored in the storage unit 13 and controls the user terminal 1. The RAM 12 is a work area for the control unit 11. The storage unit 13 is a storage medium for storing programs and data. The control unit 11 performs arithmetic processing based on the program and data read from the RAM 12 and the data input at the input unit 14.

[0013] The display unit 15 has a display screen. The control unit 11 outputs a video signal for displaying an image on the display screen according to the result of the arithmetic processing. Here, the display screen of the display unit 15 may be a touch panel provided with a touch sensor. In this case, the touch panel functions as the input unit 14.

[0014] The communication interface 16 can be connected to the communication network 4 wirelessly or by wire, and can transmit and receive data with other computer devices via the communication network 4. The data received via the communication interface 16 is loaded into the RAM 12, and arithmetic processing is performed by the control unit 11.

[0015] [Server device] FIG. 3 is a block diagram showing the hardware configuration of the server device according to the embodiment of the present invention. The server device 2 includes at least a control unit 21, a RAM 22, a storage unit 23, and a communication interface 24, which are connected by an internal bus respectively.

[0016] The control unit 21 is composed of a CPU and a ROM, executes the program stored in the storage unit 23, and controls the server device 2. Further, the control unit 21 is provided with an internal timer for measuring time. The RAM 22 is a work area for the control unit 21. The storage unit 23 is a storage area for storing programs and data. That is, the storage unit 23 functions as a recording medium storing the program. The control unit 21 reads the program and data from the RAM 22, and performs program execution processing based on the information received from each of the user terminal 1 or the administrator terminal 3.

[0017] [Administrator Terminal] The administrator terminal 3 is a terminal operated by an administrator, operator, or provider of the system 10. As the administrator terminal 3, one having the same configuration as the user terminal 1 can be used. The administrator terminal 3 may include, for example, a control unit, a RAM, a storage unit, an input unit, a display unit, and a communication interface, which may be connected by an internal bus respectively.

[0018] Note that the program may be stored in a recording medium such as a CD-ROM. In this case, the program stored in the recording medium may be installed in the user terminal 1, the server device 2, or the administrator terminal 3 to execute a predetermined function. Alternatively, the program may be distributed from a computer device outside the system. In this case, the program distributed from the computer device outside the system may be installed in the user terminal 1, the server device 2, or the administrator terminal 3 to execute a predetermined function.

[0019] [Real Estate and Owner Identification Process] Next, a first embodiment of the real estate and owner identification process in the system according to the embodiment of the present invention will be described. FIG. 5 is a diagram showing a flowchart of the real estate and owner identification process according to the embodiment of the present invention. Note that real estate is a concept including both land and buildings. Hereinafter, for example, the case where the system 10 is composed of the user terminal 1 and the server device 2 will be described.

[0020] The user operates the input unit 14 of the user terminal 1 to identify the area where a change has occurred from the captured image, and starts real estate and owner identification processing (hereinafter, the real estate and owner identification processing is referred to as "identification processing") for identifying the owner of the real estate corresponding to the identified area. First, the user operates the input unit 14 of the user terminal 1 to start the dedicated application software for executing the identification processing. The user inputs the user ID and password for identifying the user into the user terminal 1. The server device 2 receives the user ID and password input at the user terminal 1, authenticates the user, and permits the user to log in to the system 10. Alternatively, the user may log in to the system 10 by accessing the server device 2 from the user terminal 1 via a web browser.

[0021] Next, the user operates the input unit 14 of the user terminal 1 to input a start request for the identification processing. The start request is transmitted from the user terminal 1 to the server device 2 and received by the server device 2. The start request may include information regarding a predetermined change to be identified and / or information regarding the attributes of a predetermined real estate to be identified. Details of the predetermined change and the attributes of the predetermined real estate will be described later. Further, the start request may include information regarding the range for searching for the predetermined change that has occurred and / or the range for searching for real estate having the predetermined attributes in the identification processing, as well as information regarding the period for searching.

[0022] When the server device 2 receives a start request, it acquires a first image and a second image (step S1). The first image and the second image are captured images of the ground taken from above. The captured images may be stored in advance in the storage unit 23 of the server device 2, or may be read by the server device 2 from an external storage device storing the captured images. Further, the server device 2 may acquire the captured images in cooperation with an external system that holds the captured images. The external system is, for example, a system composed of other computer devices. When cooperating with the external system, the server device 2 transmits a request to acquire the first image and the second image to another computer device. The acquisition request includes information regarding the shooting date and time of the captured image to be acquired and information regarding the area where the image was shot. The captured images are stored in association with information regarding the shooting date and time and the area where the image was shot.

[0023] The captured image is not particularly limited as long as it is an image of the ground taken from above, and examples thereof include aerial photographs and satellite images. An aerial photograph is a photograph of the ground taken by a camera mounted on an aircraft. A satellite image is image data acquired by a sensor mounted on an artificial satellite. The satellite image is, for example, an optical image (also referred to as a visible image), an infrared image (also referred to as a thermal infrared image), or a SAR (synthetic aperture radar) image (also referred to as a synthetic aperture radar image). The captured image may be a combination of a plurality of images to form one image. Further, the captured image includes not only the image data acquired as such, but also image data obtained by processing the data acquired by the sensor.

[0024] The first image is a captured image taken at a first time. The second image is a captured image taken at a second time. The first time belongs to a different day than the second time. Also, the first time is a time after the second time. Further, the second time may be a time retroactively preceding the first time by a predetermined period or more. The predetermined period is not particularly limited and can be appropriately set by an administrator or a user. The predetermined period is preferably a period during which changes in real estate can be detected, and may be, for example, a period in units of days, weeks, months, or years. Also, the first time may be the time of shooting of the most recently acquired captured image based on when a start request is input at the user terminal 1 or when the server device 2 receives the start request. For example, when the predetermined period is one week, the time one week before the first time becomes the second time. Note that in step S1, if there is no second image taken at a time that matches the predetermined period, a second image taken before the predetermined period may be acquired. When information regarding the period to search for the start request is included, the first time and the second time are specified so as to match the period.

[0025] Also, the first image and the second image may be captured images taken in a predetermined time zone. Examples of the predetermined time zone include the morning (between 9:00 and 12:00), the afternoon (between 12:00 and 15:00), the evening (16:00 to 18:00), the night (22:00 to 2:00), and the like. By using the first image and the second image taken in the same time zone, it becomes easier to specify the first area in step S2 described later.

[0026] The second image is a captured image that captures at least a partial area within the first image. A captured image that captures at least a partial area within the first image is a captured image that captures part or all of the area captured by the first image. For example, if the first image is a captured image that captures City A and City B, a captured image that captures City A is a captured image that captures at least a partial area within the first image. Note that multiple second images may be acquired for one first image, one second image may be acquired for multiple first images, or multiple second images may be acquired for multiple first images. The second image, which is a captured image that captures at least a partial area within one first image, is also referred to as the second image corresponding to the one first image.

[0027] The first image and the second image corresponding to the first image (also referred to as a set of the first image and the second image) are captured images that capture a predetermined area at different times or dates. The set of the first image and the second image acquired in step S1 may be one or two or more. When two or more sets of the first image and the second image are acquired, part or all of the areas captured by the respective first images are different.

[0028] The shooting ranges of the first image and the second image acquired in step S1 are not particularly limited and can be set as appropriate by the administrator or user. The shooting range may be a range corresponding to the information on the search range included in the start request, or may be a preset range. For example, when information on the search range is input as the area to be the subject of the specific process in the start request, the first image and the second image corresponding to that area are acquired. For example, when it is preset to search the 23 wards of Tokyo, the first image and the second image that capture the 23 wards of Tokyo are acquired in step S1. Also, the shooting ranges of the first image and the second image may be wider than the third image and the fourth image described later.

[0029] The first image and the second image may be captured images with the same resolution or low-resolution captured images, compared to the third image and the fourth image described later. The resolution of a captured image represents how much distance on the ground corresponds to one side of a pixel, which is the smallest unit constituting the image. For example, the resolution of the first image and the second image can be 5 km, and the resolution of the third image and the fourth image can be 1 m. Also, it is preferable that the first image and the second image, or the third image and the fourth image, have the same resolution.

[0030] It is preferable that the first image and the second image, or the third image and the fourth image described later, have the same scale. Having the same scale means that the length in the real world corresponding to a unit distance (e.g., 1 inch) on the image is the same. Also, the scale of the first image and the second image may be the same as or smaller than the scale of the third image and the fourth image. The scale becomes smaller as the length in the real world corresponding to the unit distance is longer. For example, when the scale of the first image and the second image is 1 / 10,000, the scale of the third image and the fourth image may be 1 / 100.

[0031] The first image, the second image, the third image and the fourth image described later may be optical images captured during the day, optical images captured at night (also referred to as night light images), infrared images, or SAR images. At this time, it is preferable that the first image and the second image are captured images with lower resolution than the third image and the fourth image. Alternatively, when the third image and the fourth image described later are optical images captured during the day, the first image and the second image may be optical images captured during the day, night light images, infrared images, or SAR images.

[0032] When the first image and the second image are acquired in step S1, the server device 2 identifies the first area based on the first image and the second image (step S2).

[0033] The first area is an area where a change has occurred within the area. The area where the change has occurred is an area where a predetermined change has occurred in the real world. An area is a concept that includes both an area having a predetermined range and a position indicating a predetermined point. The area may be an area corresponding to one pixel or an area including a plurality of pixels. The area may be shown as rectangular data selected from areas divided into a mesh shape at equal intervals, or may be shown as polygon data in a polygon surrounded by lines.

[0034] The server device 2 compares images (for example, the first image and the second image) taken at different times with the same resolution for the same area, and can identify the area where the change has occurred when there is an area that satisfies a predetermined condition. The predetermined condition is not particularly limited, but may be that the change in the value of pixels (RGB or HSV) within the area is greater than a predetermined value, or may be that a difference has been extracted by difference extraction.

[0035] For example, in step S2, first, the server device 2 performs alignment of the area shown in the first image and the area shown in the second image. A known process can be applied to the alignment process. Next, the server device 2 determines whether or not each predetermined area in the first image and the second image satisfies a predetermined condition. The predetermined area can be set as appropriate, but may be an area corresponding to the resolution, or may be, for example, a rectangular area including nine pixels aligned in a 3×3 pattern. The server device 2 can identify part or all of the area determined to satisfy the predetermined condition as the first area.

[0036] More specifically, for example, an example of a case where the server device 2 identifies the first area using RGB values will be described. The RGB value indicates the color of one pixel by values of R (red), G (green), and B (blue). Each of R, G, and B is indicated by a value in 256 steps from 0 to 255.

[0037] First, the server device 2 identifies the corresponding positions of the first image and the second image. For example, the server device 2 identifies a group of pixels having the same location (e.g., latitude and longitude) in the real world in each of the first image and the second image. The latitude and longitude of a pixel may be, for example, the latitude and longitude at the position in the real world corresponding to the center position of the pixel. Next, the server device 2 identifies the amount of change of the pixels within the window. The window is a portion indicating a predetermined range within the image. The window is a rectangular portion including a plurality of pixels. The number of pixels included in one window can be appropriately designed according to the resolution of the image.

[0038] When identifying the amount of change of the pixels within the window, for example, the server device 2 calculates the amount of change of the RGB values of the pixels within the window. Specifically, for each pixel included in the window, the following calculation is performed between the corresponding pixels of the first image and the second image. First, the server device 2 compares the pixels of the first image and the second image, adds the square of the difference in the R value, the square of the difference in the G value, and the square of the difference in the B value, and multiplies by the weighted value within the window. Then, the server device 2 can calculate the amount of change of the pixels within the window by taking the square root of the multiplied value. The method of weighting within the window is not particularly limited, and a known method can be used. As the weighted value, for example, weighting such as a Gaussian filter or an averaging filter can be used. The weighted value can be set such that the weight increases toward the center of the window and decreases as the distance from the center increases.

[0039] For all pixels within the window, when calculating the amount of change in the pixels, the server device 2 identifies the amount of change within the window by summing up all the amounts of change in the pixels within the window. At this time, since weighted summation is performed within the window, it does not depend on a single pixel, and the change in the entire local area is reflected. Next, the server device 2 moves the window up, down, left, and right (also referred to as a sliding window) using a preset offset value, and similarly identifies the amount of change within the window. The movement of the window may be repeatedly executed until a predetermined range (for example, 80% or more) of the first image and the second image is processed.

[0040] When identifying the amount of change within each window, the server device 2 executes a threshold determination of the amount of change within the window. For example, the server device 2 determines whether the amount of change within the window exceeds a predetermined threshold value. If it exceeds the threshold value, the server device 2 can identify that there has been a change in the area included in the window that exceeds the threshold value. Also, the server device 2 can identify the area as the first area where the change has been detected. The first area may be the entire area of the window, or may be a partial area within the window specified by the offset value. For example, when the offset value is 1 pixel, the central 1 pixel within the specified window may be identified as the area where the change has occurred. Also, for example, when the offset value is 3 pixels, the central 3×3, 9 pixels within the specified window may be identified as the area where the change has occurred.

[0041] When the server device 2 generates polygon data, the server device 2 identifies a window whose amount of change exceeds the threshold value in the same manner as above. The server device 2 can generate polygon data by identifying the contour of the entire specified window or a partial changed area within the window for the window whose amount of change exceeds the threshold value.

[0042] Next, the server device 2 identifies the latitude and longitude of the first area identified in step S2 (hereinafter referred to as latitude and longitude) (step S3). The captured image acquired in step S1 uses image data capable of identifying the latitude and longitude of each point or each area in the captured image. Therefore, when the first area is identified in step S2, the server device 2 can identify the latitude and longitude corresponding to at least one position of the first area based on the position in the first image or the second image of the first area. At least one position of the first area may be a predetermined point included in the first area in the first image or the second image. The predetermined point may be the central position within the identified first area. Also, when the first area is a rectangular area, the predetermined point may be points corresponding to the four points of the upper left, upper right, lower right, and lower left.

[0043] In step S3, when the latitude and longitude of the first area are identified, the server device 2 acquires a third image (step S4). The third image is a captured image taken from above the ground and is a captured image that captures at least a part of the first area. The third image may be a captured image that captures the entire first area. Since the captured image has the same meaning as the captured image described above, the description is omitted.

[0044] Here, the third image is a captured image taken at the third time. The third time may be a time after the first time, may be a time before the second time, or may be a time between the second time and the first time. Also, the third image may be taken after the second time and within a predetermined period (for example, three days) from the first time, or may be the one with the most recent capture time. Which third image to acquire may be determined according to the information regarding the change input in the start request and / or the information regarding the attributes of the real estate.

[0045] The captured image obtained in step S4 uses image data that can identify the date and time of capture and the latitude and longitude of each location or each area in the captured image. Therefore, using the first time and / or the second time, and the latitude and longitude specified in step S3, the server device 2 can identify the third image.

[0046] As described above, the third image may be a captured image with high resolution. As a captured image with high resolution, for example, the resolution may be 1 m or less. Also, the third image may be an optical image captured during the day.

[0047] In addition, in step S4, when the server device 2 cooperates with an external system, the server device 2 sends a request to obtain the third image to another computer device. The acquisition request includes information regarding the capture date and time of the captured image to be acquired and information regarding the captured area (for example, the latitude and longitude specified in step S3). The external system that cooperates in step S4 and the external system that cooperates in step S1 may be the same system or different systems.

[0048] In addition, the acquisition of the third image in step S4 may be executed in response to an input by the user operating the user terminal 1. For example, in response to an input to the user terminal 1, a request to acquire the third image is sent, and thus the process of step S4 may be executed. Alternatively, the user inputs specific information that can identify the third image to the user terminal 1. Then, the specific information is sent from the user terminal 1 to the server device 2, and the server device 2 may acquire the third image based on the received specific information. The specific information includes, for example, information regarding the time when the captured image to be acquired was captured, information that can identify the first area, and the like. Information that can identify the first area is, for example, the latitude and longitude specified in step S3, the address corresponding to the first area, the place name corresponding to the first area, and the like.

[0049] When the third image is acquired in step S4, the server device 2 identifies a second area that satisfies a predetermined condition within the first area based on the third image. The predetermined condition may be, for example, that a predetermined change has occurred, or that it has a predetermined real estate attribute.

[0050] First, the server device 2 identifies a second area in which a predetermined change has occurred within the first area based on the third image (step S5). The change within the area identifies how the real estate has changed from what state to what state, or what state it has changed from what state, etc.

[0051] The predetermined change is not particularly limited, but examples include demolition, new construction, rebuilding, or repair. Demolition means that the building is disassembled and the building disappears from the area. New construction means building a building from a vacant lot. Rebuilding means replacing the building with a new building. Repair means repairing the building, and for example, renovation and exterior work, etc. fall under repair.

[0052] In the third image (captured image), the method for the server device 2 to identify the second area where a predetermined change has occurred is not particularly limited. For example, the server device 2 can use the first prediction model to identify the second area where a predetermined change has occurred based on the third image acquired in step S4. The first prediction model is a prediction model that is machine - learned with the image data (information such as RGB of each pixel constituting the image) in which a change (for example, demolition, new construction, rebuilding, or repair) is obvious among the reference (sample) captured images as input data, and the position within the captured image and information regarding the change in the area corresponding to the position as output data.

[0053] Here, image data indicating the same change as the change specified in step S5 is used as input data. By doing so, the server device 2 can identify a second region in which a predetermined change has occurred from the captured image. For example, when the time when the third image is captured is after the first time, a captured image of the region captured near the time when the change is completed is used as input data. When the time when the third image is captured is before the second time, a captured image near the time when the change occurs is used as input data. When the time when the third image is captured is between the second time and the first time, a captured image during the occurrence of the change is used as input data.

[0054] When the server device 2 identifies disassembly as a predetermined change, that is, when identifying a position on a captured image corresponding to the region before disassembly, the region during disassembly, or the disassembled region, the server device 2 uses a first prediction model with a plurality of image data of the region before disassembly, the region during disassembly, or the disassembled region captured from above as input data.

[0055] When the server device 2 identifies new construction as a predetermined change, that is, when identifying a position on a captured image corresponding to the region before the start of construction of a building, the region after the start of construction or during construction, or the region after completion of the building, the server device 2 uses a first prediction model with a plurality of image data of the region before the start of construction, the region after the start of construction or during construction, or the region after completion of the building captured from above as input data.

[0056] When the server device 2 identifies building replacement as a predetermined change, that is, when identifying a position on a captured image corresponding to the region before disassembly of a building, the region during disassembly of the building, the region after the start of construction or during construction, or the region after completion of the building, the server device 2 uses a first prediction model with a plurality of image data of the region before disassembly of the building, the region during disassembly, the region after the start of construction or during construction, or the region after completion captured from above as input data.

[0057] When the server device 2 identifies repair as a predetermined change, that is, when identifying a position on a captured image corresponding to an area before repair of a building, an area during repair of the building, or an area after repair of the building, the server device 2 uses a first prediction model with a plurality of image data of the area before repair, the area during repair, or the area after repair of the building captured from above as input data.

[0058] The algorithm of machine learning is not particularly limited, and known algorithms can be used, but it is preferable to use deep learning using a multi-layer neural network. The multi-layer neural network has an input layer, an output layer, and a plurality of intermediate layers. Weights are set for the edges connecting the nodes of each layer. Weights corresponding to each input to the node are set for the edge, and the weights corresponding to each input to the node are multiplied, and the value obtained by multiplying these weights and the bias are added. The value obtained by addition is non-linearly transformed using an activation function to calculate an activation value. The calculated activation value becomes the value of the input passed to the nodes of the next layer. The number of intermediate layers can be designed as appropriate.

[0059] In step S5, when the server device 2 identifies a second area where a predetermined change has occurred, the server device 2 identifies a second area having the attributes of a predetermined real estate within the first area based on the third image (step S6). The attributes identify what state the real estate is in, what use it is being put to, or what buildings and facilities exist, etc. In step S6, the server device 2 may identify a second area having the attributes of a predetermined real estate from the second area where the predetermined change identified in step S5 has occurred.

[0060] The predetermined real estate attributes (also referred to as predetermined attributes) are not particularly limited. For example, vacant houses, unused land, parking lots, agricultural land, or material storage areas can be mentioned. A vacant house means a building where no one lives, and unused land means land that is not being utilized. A parking lot is land that is used as a place to park vehicles. Agricultural land is land that is used for agriculture, and for example, fields and farmlands can be mentioned. A material storage area is land that is used as a storage place for materials such as building materials.

[0061] Also, as a predetermined attribute, the existence of a predetermined building can be mentioned. The predetermined building is not particularly limited. For example, condominiums, apartments, single-family houses, or office buildings can be mentioned. Also, as a predetermined building, a building with a construction age of a predetermined number of years or more, or a building with a construction age of a predetermined number of years or less can be mentioned.

[0062] In the third image (captured image), the method for the server device 2 to identify the area corresponding to the real estate having a predetermined attribute is not particularly limited. For example, based on the information about the pixels constituting the captured image (information regarding RGB), the server device 2 can identify the area corresponding to the real estate having a predetermined attribute by identifying the attributes of the real estate corresponding to each area of the captured image.

[0063] For example, the server device 2 can identify a region corresponding to a real estate property having a predetermined attribute based on the third image acquired in step S4 by using the second prediction model. The second prediction model is a prediction model that is machine-learned with, as input data, image data (information such as RGB of each pixel constituting the image) of a reference (sample) captured image in which the attribute of the real estate (for example, vacant house, idle land, parking lot, agricultural land, or material storage yard) is clear, and, as output data, information regarding the position within the captured image and the attribute of the real estate in the region corresponding to the position. Here, image data having the same attribute as the predetermined attribute identified in step S6 is used as the input data. By doing so, the server device 2 can identify a region corresponding to a real estate property having a predetermined attribute from the captured image.

[0064] When the server device 2 identifies a piece of land that is a vacant house as a real estate property having a predetermined attribute, that is, when identifying the position on the captured image corresponding to the land that is a vacant house, the server device 2 uses the second prediction model with, as input data, a plurality of image data of vacant houses captured from above. In an area where snow accumulates, the server device 2 can also use the state of the snow piled up on the houses and in the lots in the captured image as a material for determining whether it is a vacant house.

[0065] Also, when the server device 2 identifies a region on the third image corresponding to a piece of land that is idle land, a parking lot, or agricultural land, the server device 2 uses the second prediction model with, as input data, a plurality of image data of each of the idle land, parking lot, or agricultural land captured from above.

[0066] The machine learning algorithm is not particularly limited, and a known one can be used. Since the machine learning algorithm is the same as above, the description is omitted.

[0067] In addition, in step S5, if the server device 2 does not identify the second area where a predetermined change has occurred, or in step S6, if the server device 2 does not identify the second area having the attributes of a predetermined real estate, the identification process ends.

[0068] On the other hand, in step S6, when the server device 2 identifies the second area having the attributes of a predetermined real estate, the server device 2 determines, based on the position in the third image of the second area that has been identified as having a predetermined change and the attributes of a predetermined real estate, the latitude and longitude corresponding to at least one position of the identified second area (step S7). Next, the server device 2 determines, based on the position in the third image of the second area that has been identified as having a predetermined change and the attributes of a predetermined real estate, the address of the real estate corresponding to the identified second area (step S8). In step S8, the server device 2 may determine the address of the real estate corresponding to the latitude and longitude determined in step S7. Here, "address" is a concept that includes both the dwelling indication and the lot number. The dwelling indication is the address determined by the municipality based on the "Act on Dwelling Indications (Act No. 119 of 1962)", and the lot number is the number assigned to each real estate by the legal affairs bureau.

[0069] The processes of steps S7 and S8 will be described. In the storage unit 23 of the server device 2, map data of the same area as the area where the third image (captured image) was captured is registered in advance. Also, for the captured image acquired in step S4, image data capable of identifying the latitude and longitude of each point or each area in the captured image is used. As the image data, data in which the position in each image data and the latitude and longitude are associated and stored is used. In the map data, the address (lot number or dwelling indication) of each area or each point on the map is stored in association with the latitude and longitude of each area or each point.

[0070] Therefore, in steps S7 and S8, when the second region is specified, the server device 2 can, in the same manner as in step S3, specify the latitude and longitude corresponding to at least one position in the second region based on the position in the captured image of the second region. The description overlapping with that in step S3 is omitted. The server device 2 refers to map data in which the addresses of each region or each location on the map are stored in association with the latitude and longitude of each region or each location, and can specify the address (house number or dwelling indication) corresponding to the latitude and longitude corresponding to at least one position in the specified second region.

[0071] In step S8, in addition to the method of specifying the address of the real estate corresponding to the specified second region using the latitude and longitude, the user terminal 1 can also specify the address of the real estate corresponding to the specified second region using the orthogonal coordinate system on the plane. In this case, step S7 may be omitted. FIG. 6 is a diagram for explaining the process of specifying the address according to the embodiment of the present invention. In the storage unit 23 of the server device 2, map data 31 of the same region as the region where the captured image 32 (third image) was captured is registered in advance.

[0072] In the map data 31, the addresses of each real estate in this region are registered in association with the XY coordinates of the orthogonal coordinate system (XY coordinate system) on the plane. A specific point in this region is set as the origin O. The north-south direction can be set as the Y-axis, with the north side being the first and second quadrants and the south side being the third and fourth quadrants, and the east-west direction can be set as the X-axis, with the east side being the first and fourth quadrants and the west side being the second and third quadrants. The coordinates (X, Y) of the origin O can be represented as (0, 0), and in FIG. 6, the address of the origin O is registered as address E.

[0073] In step S2, a part of the captured image 32 is specified as areas 33a and 33b corresponding to real estate having a predetermined attribute. The scale of the map data 31 is set to the same scale as that of the captured image 32, and the point corresponding to a specific point of the map data 31 in the captured image 32 is made to be the same point as the origin O of the map data 31, and the captured image 32 is overlaid so that the direction of the captured image 32 and the direction of the map data 31 are the same, whereby the address of each area of the captured image 32 can be specified. That is, in the map data 31, an address is registered in association with XY coordinates, and according to this correspondence relationship, based on the XY coordinates of the area in the captured image 32, the address of the area can be specified. Here, the address of area 33a is address D, and the address of area 33b is address I.

[0074] When the address specified in step S8 is a dwelling indication, the server device 2 specifies the lot number corresponding to the dwelling indication specified in step S7 based on the correspondence relationship between the dwelling indication and the lot number (step S9). In the storage unit 23 of the server device 2, an address master table in which a lot number is stored in association with a dwelling indication is registered, and by referring to the address master table, the lot number corresponding to the dwelling indication specified in step S8 can be specified.

[0075] Note that when the process of step S8 is executed based on a captured image of an area where the lot number and the dwelling indication are the same, the process of step S9 can be omitted. The lot number specified in step S8 or S9 is used to specify the owner of the real estate having a predetermined attribute in step S11 described later. When the address specified in step S8 is a lot number, step S9 is omitted and the process proceeds from step S8 to step S10.

[0076] Next, based on the correspondence relationship between the address and the associated information corresponding to the address, the server device 2 identifies the associated information corresponding to the address identified in step S8 (step S10). The associated information is, for example, the land use type classification defined in the urban plan, the building coverage ratio, the floor area ratio, the elementary and junior high schools in the school district, the climate, the estimated future population, the hazard information, the real estate appraisal value, and the like. In step S10, based on the correspondence relationship between the latitude and longitude and the associated information corresponding to the latitude and longitude, the associated information corresponding to the identified latitude and longitude may be identified.

[0077] The land use type of real estate is the classification of the land use types defined in the urban plan. The building coverage ratio is the ratio of the area where buildings can be built within the site. The floor area ratio is the ratio of the floor area of the building to the site area. The upper limits of the building coverage ratio and the floor area ratio are determined according to the land use type of the real estate. The elementary and junior high schools in the school district are the elementary and junior high schools that schoolchildren in a predetermined area should attend. The climate is the average temperature, average precipitation, average snowfall, average sunshine hours, etc. in a predetermined area. The estimated future population is the estimated population in the future (for example, every five years) in a predetermined area. The hazard information is information regarding the risk of disasters for each predetermined area. The real estate appraisal value is information regarding the price of real estate. For example, the real estate appraisal value includes the price of real estate calculated from the public notice price, the route price, the fixed asset tax appraisal value, the surrounding transaction case prices, and the like.

[0078] The method for specifying related information corresponding to an address or latitude and longitude is not particularly limited. The server device 2 may specify various related information corresponding to the latitude and longitude specified in step S7 or the address specified in step S8 by using data in which an address or latitude and longitude and related information corresponding to the address or the latitude and longitude are associated and stored. Alternatively, the server device 2 may specify related information corresponding to the latitude and longitude specified in step S7 or the address specified in step S8 in cooperation with a system composed of other computer devices. The control unit 11 may specify related information corresponding to the latitude and longitude specified in step S7 or the address specified in step S8 by using open data. For example, the server device 2 may access a computer device that stores a database of information regarding related information provided by the Geospatial Information Authority of Japan or local governments and receive related information corresponding to the latitude and longitude or the address.

[0079] Next, the server device 2 specifies the owner of the real estate corresponding to the address specified in step S8 based on the correspondence between the address and the owner of the real estate corresponding to the address (step S11). Information regarding the specified owner of the real estate is stored in the storage unit 23 of the server device 2 in association with information regarding the specified second area (step S12). Information regarding the owner is, for example, the name, contact information, etc. of the owner of the real estate. Information regarding the second area is, for example, the address (dwelling display and / or lot number) of the second area, latitude and longitude, specified changes, attributes of the real estate, etc.

[0080] In step S11, the owner of the real estate corresponding to the address specified in step S8 and the contact information of the owner may be specified based on the correspondence between the address and the owner of the real estate corresponding to the address and the contact information of the owner. In step S8 or S9, when the server device 2 specifies a lot number, the server device 2 specifies the owner of the real estate corresponding to the specified lot number and the contact information thereof based on the correspondence between the lot number and the owner of the real estate corresponding to the lot number.

[0081] The method for identifying the owner of the real estate corresponding to the address and the contact information of the owner is not particularly limited. However, it is preferable that the server device 2 uses the address and the data in which the owner of the real estate corresponding to the address is associated and stored to identify the owner of the real estate and the contact information thereof. For example, in the storage unit 23 of the server device 2, an owner master table in which the owner of the real estate corresponding to the address (lot number) and the contact information of the owner are stored in association with the address (lot number) is registered. The server device 2 can identify the owner corresponding to the address specified in step S8 or the lot number specified in step S8 or S9 and the contact information thereof by referring to the owner master table.

[0082] Alternatively, the server device 2 may cooperate with a system composed of other computer devices to identify the owner corresponding to the lot number specified in step S8 or S9 and the contact information thereof. In this case, the server device 2 can identify the owner corresponding to the address specified in step S8 or the lot number specified in step S8 or S9 and the contact information thereof by cooperating with, for example, the registration and deposit online application system provided by the Ministry of Justice. The server device 2 can receive the register data in which the owner corresponding to the lot number and the contact information thereof are recorded from the registration and deposit online application system.

[0083] The "owner" identified in step S11 is the name of the owner. Further, the contact information of the owner identified in step S11 is not particularly limited, and examples thereof include a fixed telephone number, a mobile phone number, an email address, a facsimile number, an address (dwelling indication), a postal code, and the like. By transmitting the identified name and contact information of the owner from the server device 2 to the user terminal 1 and performing an output such as displaying on the display unit 15 of the user terminal 1, the user can contact the owner of the real estate having a predetermined change and having a predetermined attribute by telephone, email, facsimile, mail, or the like. Regarding which of these contact methods to adopt, it can be appropriately changed according to the purpose.

[0084] Next, in response to the input from the user terminal 1, the server device 2 transmits predetermined information to the identified owner, that is, the owner of the real estate having a predetermined attribute, using the contact information of the owner identified in step S11 (step S13). By executing steps S1 to S13, the identification process ends.

[0085] The predetermined information transmitted in step S13 is not particularly limited. The user can operate the input unit 14 of the user terminal 1 to store the predetermined information in the storage unit 23. The predetermined information stored in the storage unit 23 is read out when executing step S13.

[0086] The predetermined information transmitted to the owner of the real estate in step S13 can be appropriately changed according to a predetermined change, the type of predetermined attribute, the purpose of the user, etc. For example, when the predetermined change is demolition, the server device 2 can transmit a message or a proposal text for selling the real estate, proposing a leased land, proposing a rebuilding, etc. to the owner of the real estate. Also, for example, when the predetermined change is new construction or rebuilding, the server device 2 can transmit a message or a proposal for proposing a rental, introducing a broker of rental properties, proposing new facilities, etc. to the owner of the real estate. Also, for example, when the predetermined attribute is an idle land or a vacant house, the server device 2 can transmit a message or a proposal text for selling the real estate or proposing a leased land to the owner of the real estate. Also, the predetermined information may include the name of the owner as the addressee and information regarding the address (lot number, dwelling indication) of the real estate for identifying which real estate the proposal is about.

[0087] In step S13, the method of transmitting the predetermined information is not particularly limited. For example, the predetermined information is transmitted from the server device 2 to the identified owner by e-mail or facsimile. The method of transmitting the predetermined information may be made selectable by the user operating the input unit 14 of the user terminal 1.

[0088] Alternatively, instead of or in addition to the process of transmitting predetermined information to the owner of the real estate in step S13, a process of transmitting transmission information for transmitting predetermined information or sending information for sending a sending object to the owner identified in step S11 to another computer device, a process of controlling to print the sending information on a medium, and / or a process of storing the sending information in a storage medium may be executed. After the server device 2 executes step S11, it is possible to appropriately design which of these processes to execute. It is also possible to enable a user to select which of these processes to execute by operating the input unit 14 of the user terminal 1.

[0089] By executing a process of transmitting, to another computer device, transmission information for transmitting predetermined information to the owner identified in step S11, the other computer device can transmit the predetermined information to the owner from the other computer device by e-mail or facsimile. The transmission information includes the owner's name, contact information such as an e-mail address or facsimile number, and the address (lot number, dwelling indication) of the identified real estate. Here, the other computer device may be operated by another business operator or the like different from the user.

[0090] Also, by executing a process of transmitting, to another computer device operated by another business operator or the like, sending information for sending a sending object to the owner identified in step S11, the sending object can be sent to the owner by courier or mail from the other business operator or the like. The sending information includes the owner's name, contact information such as the address (dwelling indication) and telephone number, and the address (lot number, dwelling indication) of the identified real estate. The content of the sending object can be appropriately changed according to a predetermined change, predetermined attributes of the real estate, its purpose, etc. For example, when the predetermined attribute is a recreational area or an empty house, a message or proposal text for proposing the sale, rental, or utilization of the real estate can be sent to the owner of the real estate.

[0091] The server device 2 executes a process of controlling to print, on a medium, delivery information (the name and address of the owner) for delivering the delivery item to the owner specified in step S11. For example, it is possible to print a medium such as paper on which the name and address of the owner are displayed. By printing the name and address of the owner on a medium such as paper and attaching this to the delivery item, it becomes possible to deliver the delivery item to the owner. Here, as the medium to be used, a seal-shaped one with an adhesive applied to the back surface of the printing surface and which can be used by peeling off the release paper can be used. The content of the delivery item can be appropriately changed according to a predetermined change, a predetermined attribute of the real estate, its purpose, and the like.

[0092] The server device 2 can also execute a process of storing, in an external storage medium (for example, an optical disk, a flash memory, a hard disk), delivery information (the name of the owner and their contact information, the address (lot number) of the specified real estate) for delivering the delivery item to the owner specified in step S11. By delivering the external storage medium storing the delivery information to another business operator or the like different from the user, it becomes possible to deliver the delivery item from the other business operator to the owner by home delivery or by mail. The content of the delivery item can be appropriately changed according to a predetermined change, a predetermined attribute of the real estate, its purpose, and the like.

[0093] Next, a second embodiment of the specifying process in the system according to the embodiment of the present invention will be described. The specifying process of the second embodiment is different in that the following steps S21 to S24 are executed instead of steps S4 to S6 of the specifying process of the first embodiment. Since the processes of steps S1 to S3 and S7 to S13 are the same processes, the description will be omitted as necessary. Also, the terms described in the first embodiment can be adopted within the necessary range of the content described in the first embodiment.

[0094] In the second embodiment, the processes of steps S1 to S3 are executed. When the latitude and longitude of the first area are specified in step S3, the server device 2 acquires a third image and a fourth image (step S21). The fourth image is a captured image taken from above the ground and is a captured image that captures at least a part of the first area. The fourth image may be a captured image that captures the entire first area. Since the captured image has the same meaning as the captured image described above, the description thereof is omitted.

[0095] The fourth image is a captured image taken at the fourth time. When the first time when the first image is captured is after the second time when the second image is captured, the third time when the third image is captured may be a time after the first time, and the fourth time may be a time before the second time. Alternatively, the third time may be within a predetermined range (for example, three days) from the first time, and the fourth time may be within a predetermined range from the second time. The predetermined range is not particularly limited and can be set as appropriate by the administrator or user.

[0096] For the captured image acquired in step S21, image data that can specify the date and time of capture and the latitude and longitude of each point or each area in the captured image is used. Therefore, using the first time, the second time, and the latitude and longitude specified in step S3, the server device 2 can specify the third image and the fourth image.

[0097] As described above, the third image and the fourth image may be captured images with high resolution. As the captured image with high resolution, for example, the resolution may be 1 m or less. Also, the third image and the fourth image may be optical images captured during the day. The third image and the fourth image may have the same resolution.

[0098] In step S21, when the server device 2 cooperates with an external system, the server device 2 sends a request to acquire the third image and the fourth image to another computer device. The acquisition request includes information regarding the shooting date and time of the captured image to be acquired and information regarding the area where the captured image was taken (for example, the latitude and longitude specified in step S3). The external system that cooperates in step S4 and the external system that cooperates in step S1 may be the same system or different systems.

[0099] Note that the acquisition of the third image and the fourth image in step S21 may also be executed in response to an input by the user operating the user terminal 1, similar to step S4.

[0100] When the third image and the fourth image are acquired in step S21, the server device 2 identifies the second area in which a change has occurred within the first area based on the third image and the fourth image (step S22). Since the process of identifying the second area in step S22 is executed in the same manner as the process of identifying the first area in step S2, the description thereof is omitted.

[0101] When the second area is identified in step S22, the server device 2 determines whether or not a predetermined change has occurred in the identified second area (step S23). The predetermined change determined in step S23 may be input in step S1.

[0102] In step S23, the server device 2 may determine whether or not a predetermined change has occurred in the second area by inputting the third image or the fourth image into the first prediction model, similar to the process of step S5. For example, when the image data corresponding to the third image or the fourth image is input into the first prediction model and the area where the predetermined change has occurred matches the second area identified in step S22, the server device 2 can determine that a predetermined change has occurred in the second area.

[0103] Alternatively, in step S23, the server device 2 may determine whether a predetermined change has occurred in the specified second region based on the third image and the fourth image. The method for the server device 2 to specify the second region in which a predetermined change has occurred based on the third image and the fourth image is not particularly limited. For example, the server device 2 can use the fourth prediction model to determine whether the second region specified in step S22 is the second region in which a predetermined change has occurred. The fourth prediction model is a captured image serving as a reference (sample), and for two or more captured images taken at different times in the same region, image data (information such as RGB of each pixel constituting the image) in which a change (for example, demolition, new construction, rebuilding, or repair) is apparent is used as input data, and a prediction model that is machine-learned with information regarding the position within the captured image and the change in the region corresponding to the position as output data.

[0104] When the server device 2 determines whether the change in the second region is demolition, the server device 2 uses the fourth prediction model with a plurality of image data regarding the region before demolition and the region after demolition captured from above as input data.

[0105] When the server device 2 determines whether the change in the second region is new construction, the server device 2 uses the fourth prediction model with a plurality of image data regarding the region before construction and the region after completion captured from above as input data.

[0106] When the server device 2 determines whether the change in the second region is rebuilding, the server device 2 uses the fourth prediction model with a plurality of image data regarding the region before rebuilding and the region after rebuilding captured from above as input data.

[0107] When the server device 2 determines whether the change in the second region is repair, the server device 2 uses the fourth prediction model with a plurality of image data regarding the region before repair and the region after repair captured from above as input data.

[0108] The machine learning algorithm is not particularly limited, and known algorithms can be used. Since the machine learning algorithm is the same as above, the description thereof is omitted.

[0109] When a predetermined change has occurred in the specified second area (YES in step S23), the server device 2 determines whether the specified second area has a predetermined real estate attribute (step S24). The real estate attribute determined in step S24 can be input in step S1.

[0110] In step S24, the server device 2 may determine whether the second area has a predetermined real estate attribute by inputting the third image or the fourth image into the second prediction model in the same manner as the process of step S6. For example, when image data corresponding to the third image or the fourth image is input into the second prediction model, and the area having the predetermined real estate attribute coincides with the second area determined to have a predetermined change in step S23, the server device 2 can determine that the second area has the predetermined real estate attribute.

[0111] When the specified second area has a predetermined real estate attribute (YES in step S24), the processes of steps S7 to S13 are executed for the specified second area. Thereby, the specific process according to the second embodiment ends. On the other hand, in step S23, when it is determined that no predetermined change has occurred in the second area (NO in step S23), or in step S24, when it is determined that the second area does not have a predetermined real estate attribute (NO in step S23), the specific process according to the second embodiment ends.

[0112] Next, a third embodiment of the specific processing in the system according to the embodiment of the present invention will be described. FIG. 6 is a diagram showing a flowchart of the real estate and owner identification processing according to the third embodiment of the present invention. The specific processing of the third embodiment is executed by the following steps S31 to S43. The specific processing of the third embodiment is different in that the following steps S34 to S36 are executed instead of steps S4 to S6 of the specific processing of the first embodiment. Regarding the processing of steps S31 to S33 and S37 to S43, since the processing is the same as that of steps S1 to S3 and S7 to S13, the description will be omitted as necessary. Also, the terms described in the first embodiment and the second embodiment can be adopted within the necessary range of the content described in the first embodiment and the second embodiment.

[0113] In the third embodiment, in steps S31 to S33, the same processing as that of steps S1 to S3 is executed. When the latitude and longitude of the first area are specified in step S33, the server device 2 acquires a third image (step S34). The acquisition of the third image may be executed in the same manner as the processing of step S4.

[0114] When the third image is acquired in step S34, the server device 2 transmits the third image to the user terminal 1, and the user terminal 1 displays the third image on the display unit 15. The user visually checks the displayed third image. Then, the user operates the user terminal 1 to select an area on the displayed third image, thereby selecting a second area within the first area. As a result, the user terminal 1 accepts the selection of the second area (step S35).

[0115] The second area for which the selection is accepted in step S35 can be arbitrarily selected by the user, and may be an area where a predetermined change has occurred, an area having a predetermined real estate attribute, or both. When the third image is displayed on the user terminal 1, map data may be superimposed and displayed on the third image. The map data may indicate the address of the area shown in the third image, the lot number, or the usage area.

[0116] In the third image displayed in step S35, the contour of the first area specified in step S32 may be displayed, or the latitude and longitude position of the first area specified in step S33 may be displayed in a manner (for example, a label) that can be understood. For example, in the third image, a label indicating the center position of the first area may be displayed. Also, in step S35, the server device 2 may change the display mode of each first area according to the degree of change that has occurred in the first area in the third image. The degree of change that has occurred in the first area corresponds to, for example, the above-described change amount of pixels or the change amount within the window. For example, changing the display mode may mean varying the hue, density, or transparency of the color displayed superimposed on the first area according to the change amount within the window, or blinking the display of the contour of the first area.

[0117] The user terminal 1 transmits information regarding the second area for which selection was received in step S35 to the server device 2. The server device 2 identifies the second area by receiving the information regarding the second area (step S36).

[0118] When the second area is identified in step S36, the processes of steps S37 to S43 are executed, and the identification process of the third embodiment ends. In steps S37 to S43, the processes of the above steps S7 to S13 are executed.

[0119] Note that the process of step S34 may be omitted. In this case, when receiving the selection of the second area in step S35, the captured image displayed on the user terminal 1 may be the first image and / or the second image used in step S31. The first image and / or the second image displayed in step S35 is a captured image of the first area specified in step S32. Alternatively, the user may actually go to the real-world area corresponding to the first area and check the second area. The user may operate the user terminal 1 and input information (for example, an address) that can identify the second area in step S35.

[0120] Note that the processes of steps S34 to S36 may be executed according to an operation on the user terminal 1. Also, the process of step S35 may be executed on the administrator terminal 3. For example, when the first area is specified in the processes of steps S1 to S3, one or a plurality of first areas are displayed on the user terminal 1. The user terminal 1 receives a selection of the first area for specifying the second area and transmits a request for execution of step S35. When the execution request is received by the server device 2, step S34 may be executed to specify the third image. Information regarding the specified third image, information regarding the first image, or information regarding the second image, and information regarding the specification of the second area are received by the administrator terminal 3. On the administrator terminal 3, the first image, the second image, or the third image and information regarding the specification of the second area are displayed. The information regarding the specification of the second area is, for example, information regarding a predetermined change and / or a predetermined real estate attribute for specifying the second area that the user input in step S1. Then, the administrator operates the administrator terminal 3 to select an area on the displayed image, thereby selecting the second area within the first area. Thereby, the administrator terminal 3 receives the selection of the second area.

[0121] Note that in the above, the mode of receiving the selection of the second area by an operation on the user terminal 1 or the administrator terminal 3 has been described, but the reception of the selection of the second area is not limited to this. For example, in step S35, the server device 2 may execute the reception of the selection of the second area. In this case, the server device 2 can receive the selection of the second area by the processes of steps S5, S6, or S22.

[0122] [Other Embodiments] The system 10 according to the present invention is not limited to the above first embodiment, second embodiment, and third embodiment, and can be changed within the scope of the gist thereof. Also, the configuration of the above system 10 and the following configurations may be arbitrarily combined.

[0123] Note that the chronological relationship between the first time and the second time may be reversed. For example, the first time may be before the second time. At this time, in the first embodiment, the third time may be after the second time, before the first time, or between the first time and the second time. In the second embodiment, the third time may be after the second time, and the fourth time may be before the first time.

[0124] Note that the first area specified in step S2 or S32 may be one or plural. When a plurality of first areas are specified, in step S4, S21, or S34, a plurality of third images obtained by photographing each first area, or a plurality of third images and a plurality of fourth images are specified. Also, the second area specified in step S5, S6, or S22, or the second area that receives a selection in step S35 and is specified in step S36 may be one or plural. When a plurality of second areas are specified, the processes after step S7 or S37 are executed for each second area. Therefore, in the identification process, the owners of the real estate to be identified and their contact information may be plural.

[0125] Note that the determination as to whether the second area is the one in which a predetermined change has occurred in step S23, and / or the determination as to whether the second area has the attributes of a predetermined real estate in step S24 may be executed according to the input by the user operating the user terminal 1. For example, the second area specified in step S22 is displayed on the user terminal 1. The user visually determines whether a predetermined change has occurred in the second area, or whether the second area has the attributes of a predetermined real estate. Then, according to the input to the user terminal 1, by inputting the determination result, the processes of step S23 or 24 may be executed. Note that this process may also be executed on the administrator terminal 3.

[0126] Note that step S5 identifies the second area where a predetermined change has occurred from the third image, and step S23 determines whether a predetermined change has occurred in the second area. However, in step S1, the user may operate the input unit 14 of the user terminal 1 to select the above-mentioned predetermined change from options such as demolition, new construction, rebuilding, repair, etc. The user selects one of these options according to what kind of change in the real estate owner and their contact information they want to identify.

[0127] Note that step S6 identifies the area corresponding to the real estate having a predetermined attribute from the third image, and step S24 determines whether the second area has a predetermined real estate attribute. However, in step S1, the user may operate the input unit 14 of the user terminal 1 to select the above-mentioned predetermined attribute from options such as vacant house, idle land, parking lot, agricultural land, etc. The user selects one of these attributes according to what kind of attribute of the real estate owner and their contact information they want to identify. Further, in addition to the selection of the predetermined attribute, in step S1, the user may operate the input unit 14 of the user terminal 1 to select, for example, from options before the change occurs or after the change occurs, the time when the area to be searched has a predetermined real estate attribute. The server device 2 can identify the time when the third image acquired in step S4 was taken according to the selected time. Also, the server device 2 can select the image for executing step S24 from the third image or the fourth image according to the selected time.

[0128] When the time when the area has a predetermined real estate attribute is not selected, it is preferable that the third image is used in S24. Also, at this time, the third image used in step S6 or S24 is preferably a captured image taken after the first time or within a predetermined range from the first time. Also, the third image used in step S6 or S24 may be the one with the most recent shooting date and time.

[0129] Note that the processing in step S3 or S33 may be omitted. In this case, instead of latitude and longitude, an address, a place name, a region, etc. may be specified as information capable of identifying the first region. In step S4, S21, or S34, the third image, or the third image and the fourth image are identified based on the information capable of identifying the first region.

[0130] Note that the processing in step S4 may be omitted. In this case, in steps S5 and S6, instead of the third image, the first image and / or the second image used in step S1 can be used. The first image and / or the second image used in steps S5 and S6 are captured images of the first region specified in step S2. That is, the system 10 can identify the second region within the first region that satisfies a predetermined condition based on the third image, the first image, or the second image that has captured at least a part of the first region.

[0131] Note that the processing in step S21 may be omitted. In this case, in steps S22, S34, and S24, instead of the third image and the fourth image, the first image and the second image used in step S1 can be used. The first image and the second image used in steps S22, S34, and S24 are captured images of the first region specified in step S2.

[0132] Note that the processing in steps S4 to S7, steps S21 to S24 and S7, or steps S34 to S37 may be omitted. At this time, in step S8 or S38, the latitude and longitude specified in step S3 or S33 are used to identify the address of the real estate corresponding to the first region. The address corresponding to the first region may be an address corresponding to at least a part of the region within the first region. Also, the address corresponding to the first region may be one or more addresses. Then, the server device 2 can identify the owner of the real estate corresponding to the address based on the correspondence relationship between the address corresponding to the first region and the owner of the real estate corresponding to the address by executing the processing in steps S9 to 11 or S39 to S41 in the same manner as above.

[0133] Further, when a predetermined change occurs in the first area and / or when the first area has the attributes of a predetermined real estate, the server device 2 may specify the address of the real estate corresponding to the first area, and may also specify the owner of the real estate corresponding to the specified address. In this aspect, the system 10 omits steps S21 and S22 for the first area specified in steps S1 to S3, and executes steps S23 and / or S24. Then, the processing after step S7 is executed.

[0134] In the above description, the aspect in which the system 10 specifies the second area in which a predetermined change has occurred within the first area and the second area having the attributes of a predetermined real estate within the first area based on the third image or the third image and the fourth image has been described, but it is not limited to this. For example, the processing of step S5 or step S23 may be omitted. Also, for example, the processing of step S6 or step S24 may be omitted. That is, the system 10 may specify the second area in which a predetermined change has occurred within the first area or the second area having the attributes of a predetermined real estate within the first area based on the third image or the third image and the fourth image.

[0135] In the second embodiment, the processing of steps S23 and S24 may be omitted. Also, the processing after step S35 of the third embodiment may be executed using the first image, the second image, the third image, or the fourth image in which the second area executed in step S22 was photographed.

[0136] Note that the process of step S10 or S40 may be executed after step S7 or S37. Also, after executing the processes up to step S7 or S37 and the process of step S10 or S40, in response to an operation input to the user terminal 1 or for a second area where a selection has been received at the user terminal 1, the processes of steps S8, S9, S11, and S13, or steps S38, S39, S41, and S43 may be executed. Alternatively, after executing the processes up to step S8 or S38 and the process of step S10 or S40, in response to an operation input to the user terminal 1 or for a second area where a selection has been received at the user terminal 1, the processes of steps S9, S11, and S13, or steps S39, S41, and S43 may be executed.

[0137] Note that the server device 2 executes a process of extracting a contour by a known method based on the third image acquired in step S4, and can divide the third image into a plurality of areas separated by the contour. Then, for each of these plurality of areas, the server device 2 can determine whether it is an area corresponding to a real estate in which a predetermined change has occurred and / or a real estate having a predetermined attribute, using the first prediction model and / or the second prediction model.

[0138] Note that the process of step S4, S21, or S34 may be a process of acquiring a photographed image (first image and second image) having a different nature from the photographed image for specifying the first area. The photographed image having a different nature from the first image and the second image is, for example, one having a different resolution from the first image and the second image, one photographed using a different wavelength, one photographed in a different time zone, etc. The one photographed using a different wavelength is, for example, when the first image and the second image are visible light images, the photographed image having a different nature is a thermal infrared image or a SAR image. The system 10 can specify the first area in which a change has occurred by the processes of steps S1 to S4, steps S1 to S3 and S21, or steps S1 to S3 and S34, and can further specify a photographed image having a different nature from the one that photographed the first area.

[0139] In the above-described embodiment, the mode in which the user terminal 1 and / or the administrator terminal 3 communicate with the server device 2 and specific processing is executed has been described. However, for example, in the user terminal 1, the specific processing may be executed. In this case, the processing executed by the server device 2 in the above-described embodiment is executed by the control unit 11 of the user terminal 1. Information required for the processing in the user terminal 1 may be stored in advance in the storage unit 13, or may be read from an external storage device.

[0140] The user can operate the user terminal 1 to make a request to execute the processing of steps S8, S11, S13, S38, S41, or S43. Also, the system 10 can charge the user when executing the processing of steps S8, S11, S13, S38, S41, or S43. For example, after executing step S8 or S38, the system 10 may control to display on the user terminal 1 the address of the real estate corresponding to the specified second area, as well as the specified change, the attributes of the specified real estate, and / or the map information indicating the second area. When the user selects a request button for executing the processing of step S11 or S41 displayed on the display screen of the user terminal 1, the processing of steps S9 to S11 or S39 to S41 may be executed and the user may be charged.

[0141] As described above, a system including at least one computer device includes: a first area specifying means for specifying a first area in which a change has occurred in the area based on a first image taken at a first time and a second image taken at a second time and capturing at least a part of the area within the first image; a selection receiving means for receiving a selection of a second area within the first area based on a third image capturing at least a part of the first area, the first image, or the second image; and an address specifying means for specifying an address corresponding to the second area. By the first image, the second image, and / or the third image being a captured image taken of the ground from above, the address corresponding to the second area within the first area where the change has occurred can be specified. Also, the address corresponding to the area where the change has occurred early can be discovered.

[0142] As described above, a system including at least one computer device identifies a first region in which a change has occurred within a region based on a first image captured at a first time and a second image captured at a second time and capturing at least a part of the region within the first image, and a second region within the first region that satisfies a predetermined condition based on a third image capturing at least a part of the first region. Since the first image, the second image, and the third image are captured images taken of the ground from above, a second region within the first region that satisfies a predetermined condition can be identified. Also, a region where a change has occurred can be discovered quickly.

[0143] Further, as described above, since the first image and the second image are captured images with lower resolution than the third image, the burden of identifying a second region within the first region that satisfies a predetermined condition is reduced. For example, the processing speed can be improved and the processing cost can be reduced. Also, as described above, since the third image is an optical image captured during the day, and the first image and the second image are optical images, infrared images, or SAR images captured at night, when identifying a second region within the first region that satisfies a predetermined condition, images with different properties are used, so the second region can be identified from different viewpoints. For example, after identifying a region where the population has increased or a region that is growing or developing based on changes in night light images or infrared images, specific changes can be identified using the optical image captured during the day. Also, for example, after identifying a region where the terrain has changed based on changes in SAR images, specific changes can be identified using the optical image captured during the day. Furthermore, by using images with different properties, a changed second region can be detected without omission.

[0144] Further, as described above, since the first time belongs to a different day than the second time and is a time after the second time, and the first image and the second image are captured images captured at a predetermined time zone, based on the first image and the second image, the first region can be identified excluding time zone-dependent changes.

[0145] Also, in this way, by the second region specifying means specifying, based on the third image, a second region in which a predetermined change has occurred within the first region and / or a second region having a predetermined real estate attribute, a second region in which a predetermined change has occurred within the first region and / or a second region having a predetermined real estate attribute can be specified. Also, in this way, by the second region specifying means using, as input data, image data regarding a captured image obtained by photographing the ground from above, and using a prediction model machine-learned with information regarding a position within the captured image and a change or real estate attribute in a region corresponding to the position as output data, to specify a second region in which a predetermined change has occurred, the second region in which a predetermined change has occurred within the first region can be specified using the machine-learned prediction model. Also, in this way, by the second region specifying means using, as input data, image data regarding a captured image obtained by photographing the ground from above, and using a prediction model machine-learned with information regarding a position within the captured image and a change or real estate attribute in a region corresponding to the position as output data, to specify a second region having a predetermined real estate attribute, the second region having a predetermined real estate attribute within the first region can be specified using the machine-learned prediction model.

[0146] Also, in this way, by the second region specifying means specifying, based on the third image captured at the third time and the fourth image captured at the fourth time and capturing at least a part of the first region, a second region in which a change has occurred within the first region, the second region in which a change has occurred within the first region can be accurately specified. Also, for the purpose of accurately specifying the second region, it is preferable that the first image and the second image are captured images with lower resolution than the third image and the fourth image, or that the third image and the fourth image are optical images captured during the day, and the first image and the second image are optical images, infrared images, or SAR images captured at night. Similarly, for the purpose of accurately specifying the second region, it is preferable that the first time belongs to a different day from the second time and is a time after the second time, the third time is a time after the first time, and the fourth time is a time before the second time.

[0147] Also, in this way, by the system including address specifying means for specifying the address corresponding to the second area, the address corresponding to the second area can be specified. Also, in this way, the address specifying means specifies the latitude and longitude corresponding to at least one position within the second area, and specifies the address corresponding to the specified latitude and longitude, thereby specifying the address of the real estate corresponding to the latitude and longitude corresponding to at least one position in the second area. Also, in this way, by the system including owner specifying means for specifying the owner of the real estate corresponding to the address specified by the address specifying means based on the correspondence between the address and the owner of the real estate corresponding to the address, the owner of the real estate corresponding to the address in the second area satisfying a predetermined condition can be specified.

[0148] In this way, a system including at least one computer device includes first area specifying means for specifying a first area in which a change has occurred within the area based on a first image taken at a first time and a second image taken at a second time and capturing at least a partial area within the first image, address specifying means for specifying the address corresponding to the first area, and owner specifying means for specifying the owner of the real estate corresponding to the address specified by the address specifying means based on the correspondence between the address and the owner of the real estate corresponding to the address. Since the first image and the second image are captured images taken of the ground from above, the owner of the real estate at the address corresponding to the first area in which the change has occurred can be specified. Also, in this way, when a predetermined change occurs in the first area and / or when the first area has a predetermined real estate attribute, the owner specifying means specifies the owner of the real estate corresponding to the address specified by the address specifying means, thereby specifying the owner of the real estate at the address corresponding to the first area in which the predetermined change has occurred and / or the first area having the predetermined real estate attribute.

[0149] Also, in this way, based on the correspondence relationship between the address and the owner of the real estate corresponding to the address and the contact information of the owner, the owner of the real estate corresponding to the address identified by the address identification means and the contact information of the owner can be identified by the owner identification means, and thus the owner of the real estate corresponding to the address and the contact information of the owner can be identified. Also, in this way, the address identified by the address identification means is a lot number, and the owner of the real estate corresponding to the identified lot number can be identified by the owner identification means based on the correspondence relationship between the lot number and the owner of the real estate corresponding to the lot number, and thus the owner of the real estate corresponding to the lot number can be identified.

Explanation of Signs

[0150] 1 User terminal 2 Server device 3 Administrator terminal 4 Communication network 10 System 11 Control unit 12 RAM 13 Storage unit 14 Input unit 15 Display unit 16 Communication interface 21 Control unit 22 RAM 23 Storage unit 24 Communication interface 31 Map data 32 Captured image 33 Area

Claims

1. A system comprising at least one computing device, a first region specifying means for specifying a first region in which a change has occurred based on a first image taken at a first time and a second image taken at a second time and capturing at least a partial region in the first image; an address identification means for identifying an address corresponding to the first area; an owner identification means for identifying an owner of real estate corresponding to the address identified by the address identification means based on a correspondence relationship between the address and the owner of the real estate corresponding to the address; Equipped with A system, wherein the first image and the second image are images taken from above the ground.

2. The system of claim 1 , wherein the first image and the second image are SAR images, optical images taken at night, or infrared images.

3. The first time belongs to a different day than the second time and is a time later than the second time, The system according to claim 1 or 2, wherein the first image and the second image are images taken during a predetermined time period.

4. The system described in claim 1 or 2, wherein the owner identification means identifies the owner of real estate corresponding to the address identified by the address identification means when a predetermined change occurs in the first area and / or when the first area has predetermined real estate attributes.

5. The system described in claim 1 or 2, wherein the owner identification means identifies the owner of the real estate corresponding to the address identified by the address identification means and the owner's contact information based on a correspondence between the address and the owner of the real estate corresponding to the address and the owner's contact information.

6. The address identified by the address identification means is a lot number, 3. The system according to claim 1, wherein the owner identification means identifies the owner of the real estate corresponding to the identified lot number based on a correspondence between the lot number and the owner of the real estate corresponding to the lot number.

7. A computer device, a first region specifying means for specifying a first region in which a change has occurred based on a first image taken at a first time and a second image taken at a second time and capturing at least a partial region in the first image; an address identification means for identifying an address corresponding to the first area; an owner specifying means for specifying the owner of real estate corresponding to the address specified by the address specifying means based on a correspondence relationship between the address and the owner of the real estate corresponding to the address; Functioning as a The program, wherein the first image and the second image are images taken from above the ground.

8. In a system including at least one computer device, a method executed by the computer device, comprising: a first region specifying step of specifying a first region in which a change has occurred based on a first image captured at a first time and a second image captured at a second time and capturing at least a part of the first image; an address identifying step of identifying an address corresponding to the first area; an owner identification step of identifying an owner of real estate corresponding to the address identified in the address identification step based on a correspondence relationship between the address and the owner of the real estate corresponding to the address; having A method according to claim 1, wherein the first image and the second image are images taken from above the ground.

Images