System, program, and method

Abstract

The present invention provides a system capable of displaying additional information related to at least one area or one position in a captured image or a map image.　This is a system including at least one computer device. The system comprises: an area identification means for identifying an area corresponding to real estate having a predetermined attribute from a captured image in which an image of the ground is captured from the sky; and a display means for performing control so as to display the area identified by the area identification means on the captured image or a map image corresponding to the captured image in such a manner that the area can be grasped, and to display additional information related to at least one area or one position in the captured image or the map image by superimposition on the captured image or the map image.

Description

System, program and method

[0001] The present invention relates to a system, a program and a method.

[0002] It has been disclosed that a method is used to determine whether a house in an aerial photograph or satellite image is vacant or not, based on machine learning data that estimates vacant houses in images generated based on pixel information of the vacant house's site (see, for example, Patent Document 1).

[0003] International Publication No. 2019 / 225597

[0004] The present invention can solve, for example, any of the following problems.

[0005] A first object of the present invention is to provide a system capable of displaying additional information regarding at least one area or one position in a photographed image or a map image.A second object of the present invention is to provide a system capable of relearning a machine-learned predictive model using image data of at least a portion of an area of ​​a photographed image taken from above the ground as input data and information regarding the attributes of real estate corresponding to that area as output data.A third object of the present invention is to provide a system capable of identifying real estate having predetermined attributes.A fourth object of the present invention is to provide a system capable of identifying the owners of real estate corresponding to multiple points or multiple areas on a photographed image or a map image corresponding to the photographed image.A fifth object of the present invention is to provide a system capable of identifying the owner of real estate having predetermined attributes, the owner of a store or facility, or the owner of land on which a store or facility is located.

[0006] The problems of the present invention can be solved by, for example, [1] to

[28] . [1] A system including at least one computer device, the system comprising: area specifying means for specifying an area corresponding to real estate having a predetermined attribute from a photographed image of the ground taken from above; and display means for displaying the area specified by the area specifying means in a graspable manner on the photographed image or on a map image corresponding to the photographed image, and for controlling the display of additional information relating to at least one area or one position in the photographed image or map image so as to be superimposed on the photographed image or map image; [2] The system according to [1], wherein the additional information includes information relating to parcel numbers, information relating to zoning, information relating to densely wooded areas, information relating to nighttime light, hazard information, information relating to land appraisal values, consumption trend analysis data, statistical data, satellite data, people flow data, and / or traffic volume data; [3] The system according to [1] or [2], which comprises an address specifying means for specifying the address of a real estate corresponding to the area specified by the area specifying means, and an owner specifying means for specifying the owner of the real estate corresponding to the address specified by the address specifying means based on the correspondence between the address and the owner of the real estate corresponding to the address, and the display means controls to display, as additional information on the captured image or on the map image, an area corresponding to the real estate of an owner previously specified by the owner specifying means in a graspable manner, and the area specified by the area specifying means and the area corresponding to the real estate of an owner previously specified by the owner specifying means are displayed in different manners; [4] The system according to any of [1] to [3], which comprises an address specifying means for specifying the address of a real estate corresponding to the area specified by the area specifying means, and a related information specifying means for specifying related information corresponding to the address specified by the address specifying means based on the correspondence between the address and related information corresponding to the address; [5] The system according to [4], wherein the related information is information on use zoning, building coverage ratio, floor area ratio, elementary and junior high schools in school districts, climate, estimated future population, hazard information, and / or real estate appraisal value;[6] The system according to any one of [1] to [5], wherein the area specifying means specifies a plurality of areas corresponding to real estate having predetermined attributes from the photographed image, the display means controls to display a partial image that is at least a part of the photographed image of one of the areas specified by the area specifying means or a partial image that is at least a part of a map image corresponding to the photographed image, and the system includes a display switching means that switches the partial image displayed by the display means to a partial image corresponding to another area; [7] The system described in [6] above, which includes a selection receiving means for receiving input of selection information regarding identification of the owner of a property corresponding to one area identified by the area identifying means and / or selection information regarding not identifying the owner of the property while displaying a partial image of the one area identified by the area identifying means, an address identifying means for identifying the address of the property corresponding to the area identified by the area identifying means, and an owner identifying means for identifying the owner of the property corresponding to the address identified by the address identifying means based on the correspondence between the address and the owner of the property corresponding to the address, and the owner identifying means identifies the owner of the property corresponding to the area for which the input of selection information regarding identification of the property owner has been accepted, or identifies the owner of the property corresponding to an area other than the area for which the input of selection information regarding not identifying the address of the property has been accepted; [8] A system according to any one of [1] to [7] above, wherein the display means displays a sign at at least one position of the area identified by the area identification means on the photographed image or on a map image corresponding to the photographed image, and comprises an address identification means for identifying the address of the real estate corresponding to the area identified by the area identification means, and a position change means for changing the position of the sign displayed by the display means, and the address identification means identifies the address of the real estate based on the position after being changed by the position change means; [9] A program that makes a computer device function as an area identification means for identifying an area corresponding to real estate having a predetermined attribute from a photographed image taken from above the ground, and as a display means that displays the area identified by the area identification means on the photographed image or on a map image corresponding to the photographed image in a graspable manner, and controls the display so that additional information related to at least one area or one position in the photographed image or map image is superimposed on the photographed image or map image;

[10] A method executed in a system including at least one computer device, the method comprising: an area specifying step of specifying an area corresponding to real estate having a predetermined attribute from an image taken of the ground from the air; and a display step of displaying the area specified in the area specifying step in a graspable manner on the image or on a map image corresponding to the image, and controlling the display of additional information related to at least one area or one position in the image or map image so as to be superimposed on the image or map image;

[11] A system including at least one computer device, the system comprising: area specifying means for specifying an area corresponding to real estate having a predetermined attribute from an image taken of the ground from the air, or for specifying the area by accepting a selection of an area on the image or on a map image corresponding to the image; address specifying means for specifying an address of the real estate corresponding to the area specified by the area specifying means; and related information specifying means for specifying related information corresponding to the address specified by the address specifying means based on a correspondence between the address and related information corresponding to the address;

[12] A program that causes a computer device to function as an area specifying means that specifies an area corresponding to real estate having a predetermined attribute from an image taken of the ground from the air, or by accepting a selection of an area on the image or on a map image corresponding to the image, and specifies an area; an address specifying means that specifies an address of real estate corresponding to the area specified by the area specifying means, and related information specifying means that specifies related information corresponding to the address specified by the address specifying means, based on a correspondence between the address and related information corresponding to the address;

[13] A method that is executed in a system including at least one computer device, the method comprising: an area specifying step that specifies an area corresponding to real estate having a predetermined attribute from an image taken of the ground from the air, or by accepting a selection of an area on the image or on a map image corresponding to the image, and specifies an area; an address specifying step that specifies the address of real estate corresponding to the area specified in the area specifying step, and related information specifying step that specifies related information corresponding to the address specified in the address specifying step, based on a correspondence between the address and related information corresponding to the address;

[14] A system including at least one computer device, the system comprising: an area specifying means for specifying an area corresponding to real estate having a predetermined attribute from a photographed image of the ground taken from above, or for specifying the area by accepting a selection of an area on the photographed image or on a map image corresponding to the photographed image; an address specifying means for specifying an address of the real estate corresponding to the area specified by the area specifying means; a display means for displaying a sign on the photographed image or on the map image at at least one position in the area specified by the area specifying means; and a position changing means for changing the position of the sign displayed by the display means, wherein the address specifying means specifies the address of the real estate based on the position changed by the position changing means;

[15] A program that causes a computer device to function as an area specifying means for specifying an area corresponding to real estate having a predetermined attribute from an image taken of the ground from above, or by accepting the selection of an area on the photographed image or on a map image corresponding to the photographed image, an address specifying means for specifying the address of the real estate corresponding to the area specified by the area specifying means, a display means for displaying a sign on the photographed image or on the map image at at least one position in the area specified by the area specifying means, and a position changing means for changing the position of the sign displayed by the display means, wherein the address specifying means specifies the address of the real estate based on the position changed by the position changing means;

[16] A method executed in a system including at least one computer device, the method comprising: an area specifying step of specifying an area corresponding to real estate having a predetermined attribute from a photographed image of the ground taken from above, or by accepting a selection of an area on the photographed image or on a map image corresponding to the photographed image, and specifying the area; an address specifying step of specifying an address of the real estate corresponding to the area specified in the area specifying step; a display step of displaying a sign on the photographed image or on the map image at at least one position of the area specified in the area specifying step; and a position changing step of changing the position of the sign displayed in the display step, wherein the address specifying step specifies the address of the real estate based on the position after the change in the position changing step;

[17] A system including at least one computer device, the system comprising: area specifying means for specifying a plurality of areas corresponding to real estate having a predetermined attribute from an image of the ground photographed from above, or for specifying a plurality of areas by accepting a selection of a plurality of areas on the photographed image or on a map image corresponding to the photographed image; display means for controlling the display of a partial image that is at least a part of the photographed image of one area specified by the area specifying means, or a partial image that is at least a part of the map image corresponding to the photographed image; and display switching means for switching the partial image displayed by the display means to a partial image corresponding to another area;

[18] A program that causes a computer device to function as area specifying means for specifying a plurality of areas corresponding to real estate having a predetermined attribute from an image of the ground photographed from above, or for specifying a plurality of areas by accepting a selection of a plurality of areas on the photographed image or on a map image corresponding to the photographed image; display means for controlling the display of a partial image that is at least a part of the photographed image of one area specified by the area specifying means, or a partial image that is at least a part of the map image corresponding to the photographed image; and display switching means for switching the partial image displayed by the display means to a partial image corresponding to another area;

[19] A method executed in a system including at least one computer device, the method comprising: an area specifying step of specifying a plurality of areas corresponding to real estate having predetermined attributes from an image taken from above the ground, or specifying a plurality of areas by accepting selection of a plurality of areas on the image or on a map image corresponding to the image; a display step of controlling to display a partial image that is at least a part of the image taken of one area specified in the area specifying step, or a partial image that is at least a part of the map image corresponding to the image; and a display switching step of switching the partial image displayed in the display step to a partial image corresponding to another area;

[20] A system including at least one computer device, comprising: area identification means for identifying an area corresponding to real estate having a predetermined attribute from one photographed image of the ground taken from the air using a machine-learned prediction model with input data being image data of at least a partial area of ​​an image of the ground and output data being information on the attributes of real estate corresponding to the area; area reception means for receiving input for identifying an area on the one photographed image or on a map image corresponding to the one photographed image by operation of a user terminal operated by a user; attribute reception means for receiving input of the attributes of real estate corresponding to the area identified by the input; and re-learning means for re-learning the prediction model with input data being image data of the area for which input was received and output data being the attributes of the real estate for which input was received;

[21] A program that causes a computer device to function as: area identification means that identifies an area corresponding to real estate having a predetermined attribute from one photographed image of the ground taken from the air using a machine-learned prediction model with input data being image data of at least a portion of an area in an image taken of the ground from the air and output data being information on the attributes of real estate corresponding to the area; area reception means that receives input for identifying an area on the one photographed image or on a map image corresponding to the one photographed image by operation of a user terminal operated by a user; attribute reception means that receives input of the attributes of real estate corresponding to the area identified by the input; and re-learning means that receives image data of the area whose input has been received as input data and the attributes of the real estate whose input has been received as output data and re-learns the prediction model;

[22] A method executed in a system including at least one computer device, the method comprising: an area identification step of identifying an area corresponding to real estate having predetermined attributes from one photographed image of the ground taken from the air using a machine-learned prediction model with input data being image data of at least a partial area of ​​an image of the ground and output data being information on attributes of real estate corresponding to the area; an area reception step of accepting input to identify an area on the one photographed image or on a map image corresponding to the one photographed image by operation of a user terminal operated by a user; an attribute reception step of accepting input of attributes of real estate corresponding to the area identified by the input; and a re-learning step of re-learning the prediction model with input data being image data of the area for which input was accepted and output data being information on attributes of real estate for which input was accepted;

[23] A system including at least one computer device, comprising: area identification means for identifying an area corresponding to real estate having predetermined attributes from one image photographed from the air using a machine-learned prediction model with input data being image data of at least a partial area of ​​an image of the ground taken from the air and output data being information on the attributes of real estate corresponding to the area; correction receiving means for receiving input to correct the attributes of the real estate corresponding to the area identified by the area identification means; and re-learning means for re-learning the prediction model with input data being image data of an area for which corrections to the attributes of the real estate have been accepted by the correction receiving means and output data being the corrected attributes of the real estate;

[24] A program that causes a computer device to function as an area specifying means that specifies an area corresponding to real estate having a predetermined attribute from one image taken from the air, using a prediction model trained by machine learning with input data being image data of at least a portion of an area in an image taken from the air and output data being information on the attributes of real estate corresponding to the area; a correction accepting means that accepts input to correct the attributes of the real estate corresponding to the area specified by the area specifying means; and a re-learning means that uses input data being image data of an area for which corrections to the attributes of real estate have been accepted by the correction accepting means, output data being the attributes of the real estate after the corrections, and re-learns the prediction model;

[25] A method executed in a system including at least one computer device, the method comprising: an area identification step of identifying an area corresponding to real estate having predetermined attributes from one image photographed from the air using a machine-learned prediction model with input data being image data of at least a partial area of ​​an image of the ground and output data being information on the attributes of real estate corresponding to the area; a correction acceptance step of accepting input to correct the attributes of the real estate corresponding to the area identified in the area identification step; and a re-learning step of re-learning the prediction model with input data being image data of the area for which corrections to the attributes of the real estate have been accepted in the correction acceptance step and output data being the corrected attributes of the real estate;

[26] A system including at least one computer device, the system comprising: area identification means for identifying an area corresponding to real estate having a predetermined attribute from one image photographed from the air using a machine-learned prediction model with input data being image data of at least a partial area of ​​an image of the ground taken from the air and output data being information on the attributes of real estate corresponding to the area; correction receiving means for receiving input to correct the position of the area identified by the area identification means; and re-learning means for re-learning the prediction model with input data being image data of an area corresponding to the position corrected by the correction receiving means and output data being the predetermined attributes;

[27] A program that causes a computer device to function as an area specifying means that specifies an area corresponding to real estate having a predetermined attribute from one image taken from the air, using a prediction model trained by machine learning with input data being image data of at least a portion of an area in an image taken from the air and output data being information on the attributes of real estate corresponding to the area; a correction accepting means that accepts an input to correct the position of the area specified by the area specifying means; and a re-learning means that uses input data being image data of an area corresponding to a position for which a correction has been accepted by the correction accepting means, uses the predetermined attributes as output data, and re-learns the prediction model;

[28] A method executed in a system including at least one computer device, the method comprising: an area specifying step of specifying an area corresponding to real estate having a predetermined attribute from one image photographed from the air using a machine-learned prediction model with input data being image data of at least a partial area of ​​an image of the ground and output data being information on the attributes of real estate corresponding to the area; a correction receiving step of receiving an input to correct the position of the area specified in the area specifying step; and a re-learning step of re-learning the prediction model with input data being image data of the area corresponding to the position for which the correction was received in the correction receiving step and output data being the predetermined attributes;

[0007] The problem of the present invention can be solved by, for example,

[31] to

[52] .

[31] A system including at least one computer device, comprising: an area specifying means for specifying an area corresponding to real estate having a predetermined attribute from an image taken of the ground from above; and an address specifying means for specifying the address of the real estate corresponding to the specified area;

[32] The system described in

[31] above, in which the address specifying means specifies a latitude and longitude corresponding to at least one position in the specified area, and specifies the address of the real estate corresponding to the specified latitude and longitude;

[33] The system described in

[31] or

[32] above, comprising an owner specifying means for specifying the owner of the real estate corresponding to the address specified by the address specifying means based on the correspondence between the address and the owner of the real estate corresponding to the address;

[34] The system described in

[33] above, in which the owner specifying means specifies the owner of the real estate corresponding to the address specified by the address specifying means and the owner's contact information based on the correspondence between the address and the owner of the real estate corresponding to the address and the owner's contact information;

[35] The system according to

[33] above, in which the address specified by the address specifying means is a parcel number, and the owner specifying means specifies the owner of the real estate corresponding to the specified parcel number based on the correspondence between the parcel number and the owner of the real estate corresponding to the parcel number;

[36] The system according to any of

[31] to

[35] above, which comprises a display means for displaying a sign at at least one position of the specified area on the photographed image or on the map image together with the photographed image or a map image corresponding to the photographed image, and a position change means for changing the position of the sign displayed by the display means, and the address specifying means specifies the address of the real estate based on the position after change by the position change means;

[37] The system according to any of

[31] to

[37] above, in which the area specifying means specifies a plurality of areas corresponding to real estate having predetermined attributes from the photographed image, and comprises a display means for displaying a partial image that is at least a part of the photographed image including one area specified by the area specifying means or a partial image that is at least a part of the map image corresponding to the photographed image, and a display switching means for switching the partial image displayed by the display means to a partial image corresponding to another area;

[38] The system according to

[37] , which comprises a selection receiving means for receiving input of selection information relating to identifying the address of a property corresponding to one area identified by the area identifying means and / or selection information relating to not identifying the address, while a partial image including the one area is displayed, and the address identifying means identifies the address of a property corresponding to the area for which the input of selection information relating to identifying the address of the property has been accepted, or identifies the address of a property corresponding to an area other than the area for which the input of selection information relating to not identifying the address of the property has been accepted;

[39] The system according to any of

[33] to

[38] , which comprises a first information transmitting means for transmitting predetermined information to the owner identified by the owner identifying means, a second information transmitting means for transmitting to another computer device transmission information for transmitting the predetermined information or delivery information for sending a mailing to the identified owner, a printing means for controlling printing of the delivery information on a medium, and / or a storage means for storing the delivery information on a storage medium;

[40] The system according to any one of

[31] to

[39] , wherein the area specifying means uses image data of at least a partial area of ​​an image of the ground photographed from the air as input data and information on the attributes of real estate corresponding to the area as output data, using a machine-learned prediction model;

[41] The system according to any one of

[31] to

[40] , wherein the predetermined attribute is a vacant house, unused land, parking lot, agricultural land, or a predetermined building;

[42] A program that causes a computer device to function as area specifying means that specifies an area corresponding to real estate with a predetermined attribute from an image of the ground photographed from the air, and as address specifying means that specifies the address of the real estate corresponding to the specified area;

[43] A method that is executed in a system including at least one computer device, the method comprising an area specifying step that specifies an area corresponding to real estate with a predetermined attribute from an image of the ground photographed from the air, and an address specifying step that specifies the address of the real estate corresponding to the specified area;

[44] A system including at least one computer device, the system comprising: an address specifying means for specifying addresses of real estate corresponding to a plurality of points or a plurality of areas based on the positions of the plurality of points or a plurality of areas on a photographed image or on a map image corresponding to the photographed image, respectively; and an owner specifying means for specifying owners of real estate corresponding to a plurality of addresses specified by the address specifying means based on the correspondence between the addresses and the owners of real estate corresponding to the addresses;

[45] The system according to

[44] above, comprising: a list display means for displaying a list of the plurality of addresses specified by the address specifying means on one display screen, and / or a list display means for displaying a list of owners of real estate corresponding to a plurality of addresses specified by the owner specifying means on one display screen;

[46] A program that causes a computer device to function as address specifying means for specifying addresses of real estate corresponding to a plurality of points or a plurality of areas based on the positions of the plurality of points or a plurality of areas on a photographed image or on a map image corresponding to the photographed image, respectively; and an owner specifying means for specifying owners of real estate corresponding to a plurality of addresses specified by the address specifying means based on the correspondence between the addresses and the owners of real estate corresponding to the addresses;

[47] A method executed in a system including at least one computer device, the method comprising: an address specifying step of specifying addresses of real estate corresponding to a plurality of points or a plurality of areas based on the positions of the plurality of points or a plurality of areas on a photographed image or on a map image corresponding to the photographed image, and an owner specifying step of specifying owners of real estate corresponding to the plurality of addresses specified in the address specifying step based on the correspondence between the addresses and the owners of the real estate corresponding to the addresses;

[48] A system including at least one computer device, the system comprising: address specifying means for specifying an address corresponding to real estate, store or facility that satisfies a predetermined condition based on the correspondence between the address and attribute information of the real estate, store or facility corresponding to the address, and owner specifying means for specifying the owner of the real estate, store or facility corresponding to the specified address;

[49] The system according to

[48] , comprising: character string accepting means for accepting input of a character string, and the address specifying means for specifying an address corresponding to the name of real estate, store or facility that includes the accepted character string;

[50] The system described in

[48] or

[49] above, comprising a first information sending means for sending predetermined information to the owner identified by the owner identifying means, a second information sending means for sending to another computer device transmission information for sending the predetermined information to the identified owner or delivery information for sending a mailing, a printing means for controlling printing of the delivery information on a medium, and / or a storage means for storing the delivery information on a storage medium;

[51] A program that causes a computer device to function as an address identifying means for identifying an address corresponding to a real estate, store or facility that meets predetermined conditions based on the correspondence between an address and attribute information of the real estate, store or facility corresponding to the address, and an owner identifying means for identifying the owner of the real estate, store or facility that corresponds to the identified address;

[52] A method executed in a system including at least one computer device, comprising an address identifying step for identifying an address corresponding to a real estate, store or facility that meets predetermined conditions based on the correspondence between an address and attribute information of the real estate, store or facility that corresponds to the address, and an owner identifying step for identifying the owner of the real estate, store or facility that corresponds to the identified address;

[0008] According to the present invention, a system can be provided that can display additional information regarding at least one area or one position in a photographed image or a map image. According to the present invention, a system can be provided that can retrain a machine-learned predictive model using image data of at least a portion of an area in a photographed image taken from above the ground as input data and information regarding the attributes of real estate corresponding to the area as output data. According to the present invention, a system can be provided that identifies real estate having predetermined attributes. Furthermore, according to the present invention, a system can be provided that identifies the owners of real estate corresponding to multiple points or multiple areas on a photographed image or a map image corresponding to the photographed image. According to the present invention, a system can be provided that identifies the owner of real estate having predetermined attributes, the owner of a store or facility, or the owner of land on which a store or facility is located.

[0009] FIG. 1 is a block diagram showing a hardware configuration of an information processing device according to an embodiment of the present invention. FIG. 2 is a diagram showing a flowchart of real estate and owner identification processing according to an embodiment of the present invention. FIG. 3 is a diagram for explaining address identification processing according to an embodiment of the present invention. FIG. 4 is a diagram showing an example of a display screen according to an embodiment of the present invention. FIG. 5 is a diagram showing an example of a display screen according to an embodiment of the present invention. FIG. 6 is a diagram showing a flowchart of display processing according to an embodiment of the present invention. FIG. 7 is a diagram showing a flowchart of second real estate and owner identification processing according to an embodiment of the present invention. FIG. 8 is a diagram showing a flowchart of information display processing according to an embodiment of the present invention. FIG. 9 is a diagram showing an example of a display screen according to an embodiment of the present invention.

[0010] The following describes embodiments of the present invention, but the present invention is not limited to the following embodiments as long as they do not violate the spirit of the present invention. The order of each process constituting the flowcharts described below is random as long as no contradictions or inconsistencies occur in the process content. Furthermore, it is possible to omit some of the processes constituting the flowcharts or add new processes to each process constituting the flowcharts as long as they do not violate the spirit of the present invention. Furthermore, the device that executes each process constituting the flowcharts can be changed to another device as long as it does not violate the spirit of the present invention. In this case, the process content can be changed so as not to cause contradictions or inconsistencies in the process content.

[0011] A system according to an embodiment of the present invention may be configured, for example, from a single computer device (standalone type), from one or more server devices and one or more terminal devices (client-server type), or from a host device and one or more guest devices (peer-to-peer type). The server device may also function in a distributed manner across multiple computer devices. For example, a distributed ledger technology such as a blockchain may be used instead of a server device. The following describes, for example, a case where a system according to an embodiment of the present invention is configured from a single computer device (hereinafter referred to as an information processing device).

[0012] 1 is a block diagram showing the hardware configuration of an information processing device according to an embodiment of the present invention. The information processing device 1 includes a control unit 11, a RAM 12, a storage unit 13, an input unit 14, a display unit 15, and a communication interface 16, all of which are connected by a bus.

[0013] The control unit 11 is composed of a CPU and a ROM. The control unit 11 executes programs stored in the storage unit 13 and controls the information processing device 1. The RAM 12 is a work area for the control unit 11. The storage unit 13 is a storage medium for saving programs and data. The control unit 11 performs arithmetic processing based on the programs and data read from the RAM 12 and data input via the input unit 14.

[0014] The display unit 15 has a display screen. The control unit 11 outputs a video signal for displaying an image on the display screen in accordance with the result of the arithmetic processing. Here, the display screen of the display unit 15 may be a touch panel equipped with a touch sensor. In this case, the touch panel functions as the input unit 14.

[0015] The communication interface 16 can be connected to the communication network 4 wirelessly or via a wire, and can transmit and receive data to and from other computer devices via the communication network 4. Data received via the communication interface 16 is loaded into the RAM 12, and the control unit 11 performs arithmetic processing on the data.

[0016] The program may be stored on a recording medium such as a CD-ROM. In this case, the program stored on the recording medium may be installed in the information processing device 1 to execute the predetermined functions. Alternatively, the program may be distributed from a computer device external to the system. In this case, the program distributed from the computer device external to the system may be installed in the information processing device 1 to execute the predetermined functions.

[0017] Next, a description will be given of a real estate and owner identification process in a system according to an embodiment of the present invention. FIG. 2 is a diagram showing a flowchart of the real estate and owner identification process according to an embodiment of the present invention. Note that real estate is a concept that includes both land and buildings. A user operates the input unit 14 of the information processing device 1 to launch dedicated application software for executing the real estate and owner identification process (hereinafter, the real estate and owner identification process will be referred to as the "identification process"). The user operates the input unit 14 of the information processing device 1 to identify an area corresponding to real estate having predetermined attributes from an image captured from the air above the ground, and starts the identification process to identify the owner of the real estate corresponding to the identified area.

[0018] First, the user operates the input unit 14 of the information processing device 1 to select a captured image or an area to be subjected to specific processing (step S1). When an area is selected, a captured image corresponding to that area is selected. The captured image may be stored in advance in the storage unit 13 of the information processing device 1, or may be read by the information processing device 1 from an external storage device that stores the captured image. The captured image is not particularly limited as long as it is an image of the ground taken from above, but examples include aerial photographs and satellite images. Aerial photographs are photographs of the ground taken by a camera mounted on an aircraft. Satellite images are image data acquired by a sensor mounted on an artificial satellite. The captured image may be a single image obtained by combining multiple images.

[0019] Next, the control unit 11 of the information processing device 1 identifies an area corresponding to real estate having a predetermined attribute from the captured image (step S2). The attribute identifies the state of the real estate, the purpose for which it is used, or the types of buildings and facilities present therein.

[0020] The predetermined attributes are not particularly limited, but may include, for example, a vacant house, unused land, a parking lot, agricultural land, or a material storage yard. A vacant house means a building where no one lives, and unused land means land that is not being used. A parking lot is land that is used as a place to park vehicles. Agricultural land is land that is used for agriculture, and may include, for example, rice paddies or fields. A material storage yard is land that is used as a storage area for materials such as construction materials.

[0021] Furthermore, the predetermined attribute may be the existence of a predetermined building. The predetermined building is not particularly limited, but may be, for example, a condominium, an apartment, a house, or an office building. The predetermined building may be a building that is more than a predetermined number of years old, or a building that is less than a predetermined number of years old.

[0022] In step S2, an area corresponding to real estate having a predetermined attribute is identified from the captured image, and the user can also select the predetermined attribute from options such as vacant house, unused land, parking lot, agricultural land, etc. by operating the input unit 14 of the information processing device 1. The user selects one attribute from these options depending on the attribute of the real estate owner and his / her contact information that he / she wishes to identify.

[0023] There are no particular limitations on the method by which the information processing device 1 identifies areas in the captured image that correspond to real estate having predetermined attributes. The information processing device 1 can identify areas that correspond to real estate having predetermined attributes by identifying the attributes of real estate that correspond to each area of ​​the captured image based on information about the pixels that make up the captured image (information about RGB).

[0024] For example, the information processing device 1 uses, as input data, image data (such as RGB information for each pixel constituting the image) from among the reference (sample) photographed images, in which the attributes of the real estate (e.g., vacant house, unused land, parking lot, agricultural land, or material storage yard) are clear, and uses information on the attributes of the real estate corresponding to this image data as output data, using a machine-learned prediction model to identify areas corresponding to real estate having the specified attributes from the photographed images selected in step S1. Here, image data having the same attributes as the specified attributes identified in step S2 is used as input data. In this way, the information processing device 1 can identify areas corresponding to real estate having the specified attributes from the photographed images.

[0025] When the information processing device 1 identifies a vacant piece of land as real estate with a predetermined attribute, that is, when it identifies an area on a photographed image that corresponds to a vacant piece of land, the information processing device 1 uses a prediction model that uses multiple image data of vacant houses photographed from the air as input data. In areas where snow accumulates, the information processing device 1 can also use the state of snow accumulated on the house or premises in the photographed image as information for determining whether or not the house is vacant.

[0026] The information processing device 1 can also use the following method when identifying vacant land as real estate with specified attributes. The information processing device 1 uses image data (such as RGB information for each pixel constituting the image) that clearly indicates a building, such as a detached house, as input data. The information processing device 1 uses information on the property attributes corresponding to the image data, i.e., information indicating that the property is a building, such as a detached house, as output data. Using a machine-learned prediction model, the information processing device 1 identifies an area corresponding to a building from the captured image selected in step S1. The information processing device 1 then uses a thermal infrared image, which is a thermal infrared image taken from above the ground and is taken of the same area as the captured image, to identify buildings that are infrequently used or vacant, thereby identifying an area corresponding to a building that is likely to be vacant. More specifically, the information processing device 1 determines whether the building is vacant based on the latitude and longitude of the area corresponding to the building identified in the captured image and the pixel information of the thermal infrared image at that latitude and longitude. For example, the information processing device 1 can determine that a building is vacant if the temperature in the thermal infrared image at that latitude and longitude is lower than that of surrounding buildings by more than a threshold.

[0027] In addition, when the information processing device 1 identifies an area on a photographed image corresponding to land that is vacant land, a parking lot, or agricultural land, the information processing device 1 uses a predictive model that uses multiple image data of each of the vacant land, parking lot, or agricultural land photographed from the air as input data.

[0028] The machine learning algorithm is not particularly limited and any known algorithm can be used, but it is preferable to use deep learning using a multilayer neural network. The multilayer neural network has an input layer, an output layer, and multiple intermediate layers. Weights are set for the edges connecting nodes in each layer. Weights corresponding to each input to the node are set for the edges, and the input to the node is multiplied by the weight corresponding to each input, and the value obtained by multiplying these weights and the bias are added. The value obtained by the addition is subjected to nonlinear transformation using an activation function to calculate an activation value. The calculated activation value becomes the input value passed to the node in the next layer. The number of intermediate layers can be designed as appropriate.

[0029] Furthermore, the control unit 11 executes a process of extracting contours using a known method based on the photographed image selected in step S1, and divides the photographed image into a plurality of regions separated by contours. Then, the control unit 11 can use the prediction model to determine for each of these plurality of regions whether or not the region corresponds to real estate having predetermined attributes.

[0030] In step S2, the control unit 11 may not only identify an area corresponding to real estate having a predetermined attribute, but also calculate the area of ​​the real estate corresponding to the identified area, the length of the sides that constitute the outline of the real estate, the length of the road access, etc. The area of ​​the real estate can be calculated based on the scale of the captured image. The area of ​​the real estate may be calculated using, for example, the captured image and survey data provided by the Ministry of Land, Infrastructure, Transport and Tourism. AI analysis may be used to calculate the area of ​​the real estate.

[0031] Next, the control unit 11 identifies latitude and longitude (hereinafter referred to as latitude and longitude) corresponding to at least one position of the identified area based on the position in the captured image of the area identified as having a predetermined attribute (step S3). Next, the control unit 11 identifies the address of a real estate corresponding to the identified area based on the position in the captured image of the area identified as having a predetermined attribute (step S4). In step S4, the control unit 11 may identify the address of a real estate corresponding to the latitude and longitude identified in step S3. Here, "address" is a concept that includes both a residential address and a parcel number. A residential address is an address designated by a city, town, or village based on the "Act on Residential Addresses (Act No. 119 of 1962)," and a parcel number is a number assigned to each real estate by the Legal Affairs Bureau.

[0032] The processing of steps S3 and S4 will be described. Map data for the same area as the area where the photographed image was taken is pre-registered in the storage unit 13 of the information processing device 1. Furthermore, the photographed image selected in step S1 uses image data that can identify the latitude and longitude of each point or area in the photographed image. The image data used is stored with the position in each image data associated with the latitude and longitude. The map data stores the address (lot number or address number) of each area or each point on the map associated with the latitude and longitude of each area or point.

[0033] Therefore, in step S2, when an area corresponding to real estate having a predetermined attribute is identified in the captured image, the information processing device 1 can identify the latitude and longitude corresponding to at least one position of the area based on the position of the area in the captured image. The at least one position of the area may be a predetermined point included in the area in the captured image. The information processing device 1 can identify the latitude and longitude of a predetermined point included in the identified area. The predetermined point may be the center point of the identified area. The information processing device 1 can refer to map data in which the addresses of each area or each point on the map are stored in association with the latitude and longitude of each area or each point, and can identify an address (lot number or address indication) corresponding to the latitude and longitude corresponding to at least one position of the identified area.

[0034] In step S4, the information processing device 1 can identify the address of the real estate corresponding to the identified area using a Cartesian coordinate system on a plane, in addition to the method of identifying the address of the real estate corresponding to the identified area using latitude and longitude. In this case, step S3 may be omitted. Figure 3 is a diagram for explaining the process of identifying an address according to an embodiment of the present invention. Map data 21 of the same area as the area where the photographed image 22 was taken is pre-registered in the storage unit 13 of the information processing device 1.

[0035] In the map data 21, the addresses of each property in this area are registered in association with the X and Y coordinates of a Cartesian coordinate system (XY coordinate system) on a plane. A specific point in this area is set as the origin O. With the north-south direction as the Y axis, the north side can be designated as the first and second quadrants, and the south side as the third and fourth quadrants. With the east-west direction as the X axis, the east side can be designated as the first and fourth quadrants, and the west side as the second and third quadrants. The coordinates (X, Y) of the origin O can be represented as (0, 0), and in Figure 3, the address of the origin O is registered as address E.

[0036] In step S2, some areas of the photographed image 22 are identified as areas 23a and 23b corresponding to real estate having predetermined attributes. The map data 21 is set to the same scale as the photographed image 22, and the addresses of each area of ​​the photographed image 22 are identified by overlaying the map data 21 so that a point in the photographed image 22 corresponding to a specific point in the map data 21 coincides with the origin O of the map data 21 and so that the direction of the photographed image 22 is the same as that of the map data 21. In other words, addresses are registered in the map data 21 in association with X and Y coordinates, and the addresses of the areas in the photographed image 22 can be identified based on the X and Y coordinates of the areas. Here, the address of area 23a is address D, and the address of area 23b is address I.

[0037] If the address identified in step S4 is a residential address, the control unit 11 identifies the land lot number corresponding to the residential address identified in step S3 based on the correspondence between the residential address and the land lot number (step S5). An address master table in which land lot numbers are stored in association with residential addresses is registered in the storage unit 13 of the information processing device 1, and by referring to the address master table, the land lot number corresponding to the residential address identified in step S4 can be identified.

[0038] Note that, when the identification process is performed based on a photographed image of an area where the lot number and address are the same, the process of step S5 can be omitted. The lot number identified in step S4 or S5 is used to identify the owner of real estate having a predetermined attribute in step S7, which will be described later. If the address identified in step S4 is a lot number, step S5 is omitted, and the process proceeds from step S4 to step S6.

[0039] Next, the control unit 11 identifies related information corresponding to the identified address based on the correspondence between the address and the related information corresponding to the address (step S6). The related information may be, for example, the real estate zoning, building coverage ratio, floor area ratio, elementary and junior high schools in the school district, climate, estimated future population, hazard information, real estate appraisal value, etc. In step S6, the control unit 11 may identify related information corresponding to the identified latitude and longitude based on the correspondence between the latitude and longitude and the related information corresponding to the latitude and longitude.

[0040] A real estate zoning is a classification of land use types determined by urban planning. The building coverage ratio is the percentage of the site that can be used to build a building. The floor area ratio is the ratio of the building's floor area to the site area. Upper limits are set for the building coverage ratio and floor area ratio depending on the real estate zoning.

[0041] Elementary and junior high schools in a school district are those that students planning to attend in a specified area should attend. Climate includes the average temperature, average precipitation, average snowfall, average amount of sunshine, etc. of a specified area. Estimated future population is an estimate of the future population of a specified area (for example, every five years). Hazard information is information about the risk of disasters for each specified area. Disasters include, for example, floods, landslides, high tides, tsunamis, earthquakes, volcanoes, landslides, inland water, etc. Real estate assessed value is information about the price of real estate. For example, real estate assessed value includes the price of real estate calculated from the official price, roadside land value, fixed asset tax assessed value, surrounding sales price, etc.

[0042] The method for identifying the related information corresponding to the address or latitude and longitude is not particularly limited. Preferably, the information processing device 1 identifies various related information corresponding to the latitude and longitude identified in step S3 or the address identified in step S4 using data in which the address or latitude and longitude is associated with and stored, and the related information corresponding to the address or latitude and longitude. For example, the storage unit 13 of the information processing device 1 has registered therein a use zoning master table in which the use zoning, building coverage ratio, and floor area ratio of the real estate corresponding to the address or latitude and longitude are stored in association with the address or latitude and longitude. The control unit 11 can identify the use zoning, building coverage ratio, and floor area ratio of the real estate corresponding to the latitude and longitude identified in step S3 or the address identified in step S4 by referring to the use zoning master table.

[0043] Alternatively, the control unit 11 may cooperate with a system configured with another computer device to identify related information corresponding to the latitude and longitude identified in step S3 or the address identified in step S4. The control unit 11 may use open data to identify related information corresponding to the latitude and longitude identified in step S3 or the address identified in step S4. For example, the information processing device 1 accesses a computer device that operates a national land numerical information download site provided by the Ministry of Land, Infrastructure, Transport and Tourism. The computer device then identifies related information corresponding to the latitude and longitude identified in step S3 or the address identified in step S4, and the information processing device 1 can receive the identified information. The information processing device 1 may access a computer device that stores a database of information related to related information provided by the Geospatial Information Authority of Japan or a local government, and receive related information corresponding to the latitude and longitude or the address.

[0044] When specifying the real estate appraised value, the control unit 11 may use data in which the address or latitude and longitude is associated with the official price, roadside price, fixed asset tax assessed value, or surrounding sales price corresponding to the address or latitude and longitude and stored in association with each other to specify various unit prices corresponding to the latitude and longitude specified in step S3 or the address specified in step S4. Then, the control unit 11 may calculate the price of the real estate by multiplying the specified unit price by the area of ​​the region specified in step S2.

[0045] Next, the control unit 11 identifies the owner of the real estate corresponding to the identified address based on the correspondence between the address and the owner of the real estate corresponding to the address (step S7). In step S7, the control unit 11 may identify the owner of the real estate corresponding to the identified address and the owner's contact information based on the correspondence between the address and the owner of the real estate corresponding to the address. If the control unit 11 identified the lot number in step S4 or S5, the control unit 11 identifies the owner of the real estate corresponding to the identified lot number and the owner's contact information based on the correspondence between the lot number and the owner of the real estate corresponding to the lot number.

[0046] The method for identifying the owner of the property corresponding to the address and the owner's contact information is not particularly limited, but it is preferable that the control unit 11 identifies the owner of the property and the owner's contact information using data stored in association with an address and the owner of the property corresponding to the address. For example, an owner master table is registered in the storage unit 13 of the information processing device 1, in which the owner of the property corresponding to the address (lot number) and the owner's contact information are stored in association with the address (lot number), and the control unit 11 can identify the owner and the contact information corresponding to the address identified in step S4 or the lot number identified in step S4 or S5 by referring to the owner master table.

[0047] Alternatively, the information processing device 1 may cooperate with a system configured with other computer devices to identify the owner and their contact information corresponding to the parcel number identified in step S4 or S5. In this case, the information processing device 1 can cooperate with, for example, the online registration and deposit application system provided by the Ministry of Justice to identify the owner and their contact information corresponding to the address identified in step S4 or the parcel number identified in step S4 or S5. The information processing device 1 can receive registry data in which the owner and their contact information corresponding to the parcel number are recorded from the online registration and deposit application system.

[0048] The "owner" identified in step S7 is the name of the owner. The contact information of the owner identified in step S7 is not particularly limited, but may include a landline telephone number, a mobile telephone number, an email address, a facsimile number, an address (residential address), a postal code, etc. By outputting the identified owner's name and contact information, such as displaying it on the display unit 15 of the information processing device 1, the user can contact the owner of real estate having specified attributes by telephone, email, facsimile, mail, etc. Which of these contact methods is adopted can be changed as appropriate depending on the purpose.

[0049] Next, the information processing device 1 uses the contact information of the owner identified in step S7 to send predetermined information to the identified owner, i.e., the owner of the real estate having the predetermined attributes (step S8). The predetermined information sent in step S8 is not particularly limited. The predetermined information can be sent by the user via the input unit 14 of the information processing device 1 and stored in the storage unit 13. The predetermined information stored in the storage unit 13 is read when step S8 is executed.

[0050] The predetermined information sent to the property owner in step S8 can be changed as appropriate depending on the type of predetermined attribute and the user's purpose. For example, if the predetermined attribute is unused land or a vacant house, the information processing device 1 can send a message or proposal to the property owner proposing the sale or rental of the property. The predetermined information may also include the owner's name as the addressee and information about the property's address (lot number, address number) to identify which property the proposal relates to.

[0051] The method of transmitting the predetermined information in step S8 is not particularly limited. For example, the predetermined information is transmitted from the information processing device 1 to the identified owner by e-mail or facsimile. The method of transmitting the predetermined information may be selected by the user operating the input unit 14 of the information processing device 1.

[0052] Furthermore, instead of or in addition to the process of transmitting predetermined information to the real estate owner in step S8, a process of transmitting transmission information for transmitting predetermined information or delivery information for sending a mailing to another computer device to the owner identified in step S7, a process of controlling printing of the delivery information on a medium, and / or a process of storing the delivery information on a storage medium may be executed. Which of these processes is executed by the information processing device 1 after executing step S7 can be appropriately designed. It is also possible to allow the user to select which of these processes is executed by operating the input unit 14 of the information processing device 1.

[0053] The information processing device 1 executes a process of transmitting transmission information for transmitting predetermined information to the owner identified in step S7 to the other computer device, thereby enabling the other computer device to transmit the predetermined information to the owner from the other computer device by e-mail or facsimile. The transmission information includes the owner's name, contact information such as an e-mail address or facsimile number, and the address (lot number and residential address) of the identified real estate. Here, the other computer device may be operated by a business operator other than the user.

[0054] Furthermore, the information processing device 1 executes a process of transmitting delivery information for sending a mailing to the owner identified in step S7 to another computer device operated by another business, etc., thereby enabling the other business, etc., to send the mailing to the owner by courier or mail. The delivery information includes the owner's name, address (address), contact information such as a telephone number, and the address (lot number, address) of the identified real estate. The content of the mailing can be changed as appropriate depending on the specified attributes of the real estate and its purpose. For example, if the specified attributes are unused land or a vacant house, a message or proposal proposing the sale, rental, or utilization of the real estate can be sent to the real estate owner.

[0055] The information processing device 1 executes a process to control printing on a medium the delivery information (the owner's name and address) for sending an item to the owner identified in step S7, thereby making it possible to print, for example, a medium such as paper on which the owner's name and address are displayed. By printing the owner's name and address on a medium such as paper and attaching it to the item, it becomes possible to send the item to the owner. Here, the medium used can be a sticker-like medium with an adhesive coated on the back of the printed surface and which can be used by peeling off the release paper. The content of the item can be changed as appropriate depending on the specified attributes of the real estate and its purpose.

[0056] The information processing device 1 can also execute processes such as storing delivery information (the owner's name and contact information, and the address (lot number) of the identified real estate) for sending a mailing to the owner identified in step S7 in an external storage medium (e.g., optical disk, flash memory, hard disk). By handing over the external storage medium storing the delivery information to another business other than the user, the other business can send the mailing to the owner by courier or mail. The contents of the mailing can be changed as appropriate depending on the specific attributes and purpose of the real estate.

[0057] The identification process is completed by executing steps S1 to S8. In the identification process, one or more real estate properties having predetermined attributes, owners of the real estate properties, and contact information for the owners may be identified from a single photographed image.

[0058] The process of step S6 may be executed after step S3. Furthermore, after executing the processes of steps S1 to S3 and S6, the processes of steps S4, S5, S7, and S8 may be executed in response to an operation input to the information processing device 1 or for an area for which a selection has been accepted by the information processing device 1. Alternatively, after executing the processes of steps S1 to S4 and S6, the processes of steps S5, S7, and S8 may be executed in response to an operation input to the information processing device 1 or for an area for which a selection has been accepted by the information processing device 1.

[0059] The address (house address and / or lot number) of a property having specified attributes identified by executing the identification process of steps S1 to S8, the owner of the property, and the owner's contact information may be stored in the storage unit 13 of the information processing device 1.

[0060] As shown below, a user can use a system according to an embodiment of the present invention to identify the owner of real estate having specified attributes and their contact information, and make various proposals to the owner. For example, by using the system, a user can identify vacant houses or unused land from photographed images and propose selling or leasing the property to the owners of those properties using the above-mentioned contact methods. Also, a user can identify vacant houses or unused land from photographed images and propose real estate utilization to the owners of those properties using the above-mentioned contact methods. Examples of real estate utilization methods include building apartments or condominiums, building stores or warehouses, or establishing monthly or pay parking lots.

[0061] Users can also use the system to identify old buildings from captured images and propose repairs, renovations, or rebuilding to the owners of those old buildings. Furthermore, users can use the system to identify rental properties such as apartments and condominiums (excluding condominiums) from captured images and propose rental property management services, cleaning services, sign installation, vending machine installation, antenna installation, etc. to the owners of those properties.

[0062] Users can use the system to identify the types of crops being cultivated in fields based on captured images and information about the vegetation in the areas corresponding to the captured images, and then suggest to the owners of those properties what crops they should grow. Users can also use the system to identify buildings that are infrequently used or vacant using regular captured images and thermal infrared images taken from the air, and then propose selling or renting the properties to the owners of those properties. Furthermore, users can identify areas where people are congregating based on captured images and people flow data, and identify land and buildings in those areas where stores are available, and then consult with the owners of those properties about leasing, building, renting, or selling the properties.

[0063] Users can use the system to identify buildings with large roofs or large tracts of land from captured images and propose solar power generation installation to the owners of the identified buildings and land.The system can also be used by local governments and administrative agencies to understand the status of land they have available when building new roads.In this case, the owners of vacant houses and unused land can be identified from captured images and negotiations can be held with those owners.

[0064] In the above-described embodiment, the user operates the information processing device 1 to execute the identification process. However, for example, the user may operate a user terminal and execute the identification process of steps S1 to S8 on a server device that can communicate with the user terminal. In this case, the server device functions as the information processing device 1 in the above-described embodiment. The server device transmits and receives information to and from the user terminal as necessary. The area, latitude and longitude, address, ground, address of real estate having predetermined attributes, and / or the owner and contact information of the real estate obtained as a result of executing the identification process are transmitted from the server device to the user terminal and displayed on the display screen of the user terminal. Note that the number of user terminals is not particularly limited as long as it is one or more.

[0065] In the above-described embodiment, the main focus is on identifying an area corresponding to real estate having a specified attribute from an image taken of the ground from above, and identifying the address of the real estate corresponding to the identified area based on the position of the identified area in the image. However, for example, in a system according to an embodiment of the present invention, it is possible to identify the address of real estate corresponding to one or more points or one or more areas in a photographed image or map image, and to identify the owner of the real estate corresponding to the identified address.

[0066] Here, the map image does not necessarily have to be a photographed image of the ground taken from above, but may be an image displaying a map. The map image may be a photographed image displaying a map. The map image corresponding to a photographed image is a concept that includes a photographed image displaying a map and a map image showing a location corresponding to the photographed image. The range of the displayed map image, enlargement, reduction, or change of the display mode (e.g., photographed image or map illustration) can be changed by a user's operation input to the user terminal (information processing device 1). First, the user operates the input unit 14 of the information processing device 1 to select a location or area in the photographed image or map image, and identifies the address of the real estate corresponding to the selected location or area. The identification of the address of the real estate corresponding to the selected location or area is performed by steps S3 and S4 in the above-described embodiment, or by processing similar to step S4.

[0067] Specifically, the information processing device 1 identifies the address of a real estate corresponding to a selected area based on a selected point or area in a photographed image or a map image. The information processing device 1 may identify the latitude and longitude corresponding to at least one position in the selected area based on the position of the selected point or area in a photographed image or a map image, and identify the address of a real estate corresponding to the identified latitude and longitude.

[0068] The storage unit 13 of the information processing device 1 has pre-registered map data for the same area as the area where the photographed image was taken. Furthermore, the photographed image used for selection is image data that can identify the latitude and longitude of each point or area in the photographed image. The map data stores the address (lot number or address code) of each area or point on the map in association with the latitude and longitude of each area or point. Furthermore, the map image stores the latitude and longitude and address (lot number or address code) of each area or point on the map in association with each area or point.

[0069] Therefore, when a location or area is selected in the captured image, the information processing device 1 can identify the latitude and longitude corresponding to at least one position of the location or area based on the location or area in the captured image. The information processing device 1 can refer to map data in which the addresses of each area or each area on a map are stored in association with the latitude and longitude of each area or each area, and identify an address (land lot number or house number) corresponding to the latitude and longitude corresponding to at least one position of the identified area. Note that the information processing device 1 may identify the address of a real estate corresponding to the location or area based on the location or area in the map image without identifying the latitude and longitude. Alternatively, the information processing device 1 may identify the latitude and longitude and real estate address corresponding to the location or area based on the location or area in the map image. The information processing device 1 may identify the address of a real estate corresponding to the identified area using a Cartesian coordinate system on a plane.

[0070] When the address of the real estate corresponding to the selected location or area is identified, the name and contact information of the owner of the real estate corresponding to the identified address can be identified based on the correspondence between the address and the owner of the real estate corresponding to the address. The name and contact information of the owner of the real estate corresponding to the selected location or area is identified by the same process as in step S7 of the above-described embodiment.

[0071] Specifically, the information processing device 1 can identify the owner of real estate and their contact information using data stored in association with addresses and the owners of real estate corresponding to the addresses. For example, an owner master table is registered in the storage unit 13 of the information processing device 1, in which the owners of real estate corresponding to the addresses (lot numbers) and their contact information are stored in association with addresses (lot numbers). The information processing device 1 can identify the owner and their contact information corresponding to a specified address or a specified lot number by referring to the owner master table. Alternatively, the information processing device 1 may link with a system composed of other computer devices to identify the owner and their contact information corresponding to a specified lot number.

[0072] Alternatively, the user may operate the input unit 14 of the information processing device 1 to select multiple locations or multiple areas in the captured image or map image, and identify the addresses of real estate corresponding to each of the selected locations or multiple areas. The addresses of real estate corresponding to each of the selected locations or multiple areas are identified by performing processing similar to steps S3 and S4 or step S4 in the above-described embodiment for each location or area. Then, based on the correspondence between the addresses and the owners of the real estate corresponding to the addresses, the names and contact information of the owners of the real estate corresponding to each of the identified addresses can be identified. The names and contact information of the owners of the real estate corresponding to the selected locations or areas are identified by performing processing similar to step S7 in the above-described embodiment.

[0073] The information processing device 1 may identify related information corresponding to the identified address based on the correspondence between the address and the related information corresponding to the address. In identifying related information corresponding to the selected location or area, similar to step S6 in the above-described embodiment, the information processing device 1 may refer to a master table stored in the storage unit 13 of the information processing device 1, or may cooperate with a system configured by another computer device.

[0074] When a user operates the input unit 14 of the information processing device 1 to select multiple locations or multiple areas in a photographed image or a map image, the information processing device 1 may display the selected locations or areas on the photographed image or the map image in a manner that allows the user to understand them. The manner in which the selected locations or areas can be understood includes, for example, displaying a sign on the area, superimposing a color on the area, or surrounding the area with a line segment. For example, the information processing device 1 can display a sign on at least one position of the selected locations or areas on the photographed image or the map image, along with the photographed image or the map image. Details of the sign will be described later. A predetermined symbol may be displayed on or near the sign. The predetermined symbol may be a number, a letter, or an illustration. Different symbols are assigned to different locations or areas. For example, depending on the order of the selected locations or areas on the map image, the predetermined symbol corresponding to each location or area may be represented by consecutive numbers such as "1," "2," etc.

[0075] Furthermore, when a user operates the input unit 14 of the information processing device 1 to select multiple locations or multiple areas in a captured image or a map image, the information processing device 1 may display a list of the identified multiple addresses on one display screen, or may display a list of real estate owners and their contact information corresponding to the identified multiple addresses on one display screen. The information processing device 1 also displays the selected locations or areas, the addresses, the real estate owners and their contact information in association with each other. "Displaying in association with each other" means, for example, displaying a predetermined symbol corresponding to the selected location or area on the map image, and displaying the address corresponding to the selected location or area, the real estate owners and their contact information in the same line, along with the same symbol as the predetermined symbol.

[0076] When specifying the related information corresponding to the specified address, the selected location or area, the address, and the related information corresponding to the address may be displayed in association with each other.

[0077] After the user selects multiple points or multiple areas in the captured image or map image, the user may further receive input of selection information regarding identifying the address of a property or the owner of a property, or selection information regarding not identifying the property. The information processing device 1 may identify the address of a property or the owner of a property corresponding to the area for which input of selection information regarding identifying the address of a property or the owner of a property has been received, or may identify the address of a property or the owner of a property corresponding to an area other than the area for which input of selection information regarding not identifying the address of a property or the owner of a property has been received.

[0078] The identification process can be performed through the following process using a system according to an embodiment of the present invention. The process will be described below along with the display screens displayed when each process is executed. FIG. 4 is a diagram showing an example of a display screen according to an embodiment of the present invention. The display screen 30 in FIG. 4 shows the display screen after the processes of steps S1 to S6 have been executed. The display screen 30 displays a first display area 31 and a second display area 41. The first display area 31 is an area for inputting information about the area that is the target of the identification process. The second display area 41 is an area for displaying the latitude and longitude identified in step S3, the address identified in step S4, the parcel number identified in step S4 or S5, the related information identified in step S6, and the owner and contact information identified in step S7.

[0079] Here, a system including a user terminal and a server device will be described in which the server device functions as the information processing device 1. First, a user launches dedicated application software on the user terminal and enters a user ID that identifies the user and a password set for that user ID. The server device receives the user ID and password entered on the user terminal, authenticates the user, and allows the user to log in to the system. Once the user logs in to the system, the display screen 30 is displayed. At this time, the search results 42 are not displayed in the second display area 41.

[0080] After logging in to the system, the user can input the area to be the target of the specific processing into the user terminal (corresponding to step S1). Specifically, the user can input the area to be the target of the specific processing in a first display area 31 of the display screen 30. The first display area 31 is displayed at the top of the display screen 30. The first display area 31 displays a keyword input field 32, a distance input field 33, an attribute selection field 34, and icons 35a and 35b. The user inputs a point to be the target of the specific processing in the keyword input field 32, and inputs a distance (radius) in the distance input field 33 to specify the range to be the target of the specific processing, centered on the point input in the keyword input field 32.

[0081] The keyword input field 32 may be used to input a place name, a specific location, a specific building name, or specific coordinates (e.g., latitude and longitude or address). The distance input field 33 may be used to input a distance numerically or in terms of time. When the distance is input in terms of time, the distance is calculated from the input time based on the correspondence between the distance and the time required to travel that distance. Alternatively, information regarding the correspondence between the distance and the time required to travel that distance may be displayed near the distance input field 33. On the display screen 30, the following is displayed near the bottom of the distance input field 33: "1 minute on foot = approximately 80 m, 1 minute by car = approximately 400 m." For example, by inputting "Kanda Station" in the keyword input field 32 and "100 m" in the distance input field 33, the user can input that the area to be targeted for the specific processing is within a 100-m radius of Kanda Station.

[0082] The user can also input the attributes of the real estate to be identified in the identification process. Specifically, the user inputs the attributes of the real estate to be identified in the identification process in the attribute selection field 34. For example, options for inputting the attributes of the real estate (the type of real estate) include options for real estate attributes such as vacant house, old house, parking lot, old store, field, and apartment, and the user can select any of these by operating the user terminal.

[0083] After the user inputs conditions in the keyword input field 32, distance input field 33, and attribute selection field 34, the user selects icon 35a, which executes the processing from step S2 onwards. Note that the information that the user can input to identify an area is not limited to the above, and for example, information related to keywords, information related to real estate registration such as inheritance or seizure, and area-related information such as zoning may also be input. When icon 35b is selected, the information input in the keyword input field 32, distance input field 33, and attribute selection field 34 is erased.

[0084] When area search 36 displayed on display screen 30 is selected, a keyword input field 32, an attribute selection field 34, and icons 35a and 35b are displayed in first display area 31. The user inputs a place name, a specific location, a specific building name, and specific coordinates (e.g., latitude and longitude) to be the target of specific processing into keyword input field 32. For example, the user inputs a town name such as "Kasumigaseki, Chiyoda-ku, Tokyo" into keyword input field 32. The area to be the target of specific processing is identified according to the input keyword, using a range predetermined in the user terminal or server device or a range corresponding to the input keyword.

[0085] When a user inputs the area to be identified and the attributes of the real estate desired to be identified on the user terminal, the server device executes steps S2 to S4, and identifies addresses where real estate corresponding to the input attributes is located. The server device tallys the number of identified real estate or addresses. The tally of the number of identified real estate or addresses is sent to the user terminal and displayed on the display screen. The user can operate the user terminal to request the display screen to display a list of the addresses of the identified real estate. In this case, the user may be charged when the list of addresses of the identified real estate is displayed.

[0086] When a user selects a button on the display screen of the user terminal to request a display of a list of addresses of identified real estate, a list of real estate addresses is displayed on the display screen of the user terminal. The real estate display list on the display screen displays addresses in association with the attributes of the real estate (e.g., unused land). In addition, a check box is provided for each real estate, and properties with checked check boxes can be registered in the list. For properties registered in the list, addresses, etc. can be displayed and checked on the user terminal even if the application is closed and then restarted.

[0087] Alternatively, when a user inputs the area to be identified and the attributes of the real estate they wish to identify on their user terminal, the server device executes steps S2 to S6, and identifies the latitude and longitude, address, and / or related information of the real estate corresponding to the input attributes. The identified information is sent to the user terminal and displayed on the display screen. The server device also tallies the number of identified real estate or addresses. The tallied number of real estate or addresses is sent to the user terminal and displayed on the display screen.

[0088] Alternatively, when a user inputs the area to be identified and the attributes of the property to be identified on a user terminal, the server device executes the processes of steps S2, S3, and S6, and identifies the latitude and longitude, area, and / or related information of the property corresponding to the input attributes. The identified information is sent to the user terminal and displayed on a display screen.

[0089] The display screen 30 after the user selects the icon 35a will be described. The identified information is displayed in the search results 42 in the second display area 41. The search results 42 display information identified in any of steps S3 to S7 in association with each area identified in step S2. The associated display is not limited to a specific manner, as long as it clearly indicates that information related to the identified area corresponds to the area. For example, the associated display may be such that information related to the identified area is displayed in the same row or column, or within a predetermined range such as a frame. The search results 42 include information such as the address, lot number, latitude, longitude, zoning, area, owner's name, owner's address, owner's postal code, building coverage ratio, floor area ratio, elementary and junior high schools in the school district, climate, estimated future population, hazard information, and real estate appraisal value. It is possible to appropriately configure which identified information to display. Information that has not been identified is displayed as "not acquired."

[0090] The second display area 41 displays icons 45a to 45c for changing the display of the search results 42, and an icon 45d for outputting information about the search results 42. By selecting the icon 45a, the user can change the items to be displayed in the search results 42. For example, when the user selects the icon 45a, a screen is displayed that allows the user to select which items to display in the search results 42.

[0091] By selecting icon 45b and entering information, the area displayed in the search results 42 can be changed to an area that meets a specified condition. For example, when the user selects icon 45b, an input field is displayed for entering an item, an operator, and a value. The items are information identified in the identification process (e.g., address, latitude, longitude, zoning, area, owner's name, owner's address, owner's postal code, building coverage ratio, floor area ratio, elementary and junior high schools in the school district, climate, estimated future population, hazard information, real estate appraisal value, etc.). The operator specifies the calculation used to extract the items to be displayed. The operator may be a character or a symbol. For example, operators such as "contains," "equals," "starts with," "ends with," "empty," "not empty," "=", ">," and "<" are displayed. The operator content may change depending on the entered item. The value is a specific condition for the item to be extracted. The size of the information displayed in the search results 42 can be changed by selecting icon 45c.

[0092] The search result 42 displays a check box 43 and a camera icon 44 for each area identified in step S2. When the user selects the check box 43 and then selects the icon 46, the server device can identify the real estate owner and the owner's contact information for the area selected by the check box 43. In other words, the process of step S7 may be executed by the user operating the user terminal.

[0093] When a user selects the camera icon 44, a captured image or a map image of the area corresponding to the camera icon 44 is displayed. FIG. 6 is a flowchart of the display process according to an embodiment of the present invention. The display process may be executed after the latitude and longitude are identified in step S3 or after the related information is identified in step S6. The user terminal can display the location of the area identified in step S2 (specifically, the latitude and longitude identified in step S3 or the address of the real estate identified in step S4) in association with the captured image or the map image (step S31). The captured image or the map image displayed in step S31 may be at least a portion of the captured image selected in step S1. The captured image or the map image may be the entire captured image or the map image including the area identified in step S2, or may be a partial image that is at least a portion of the captured image including the area identified in step S2, or a partial image that is at least a portion of the map image corresponding to the captured image.

[0094] 5 is a diagram showing an example of a display screen according to an embodiment of the present invention. Here, too, a case will be described in which, in a system including a user terminal and a server device, the server device functions as the information processing device 1 described above. When a user selects the camera icon 44, a third display area 51 corresponding to the selected area is displayed on the display screen. The third display area 51 may be displayed on the same screen as the first display area 31 and the second display area 41, overlapping them, or may be displayed in a separate window. The third display area 51 displays real estate information 52, a map image 53, a pin 54, and icons 55a and 55b.

[0095] The real estate information 52 is information about real estate corresponding to the area displayed in the third display area 51. This real estate information is the same information as the information displayed in the search results 42. The pin 54 displays the location of the area identified in step S2 (specifically, the latitude and longitude identified in step S3 or the address location of the real estate identified in step S4) in correspondence with the map image. In step S31, the user terminal can display a sign at at least one location of the identified area on the photographed image or on the map image, along with the photographed image or a map image corresponding to the photographed image. That is, in step S31, the user terminal can display the identified area on the photographed image or on the map image in a manner that allows the user to grasp the identified area. The at least one location of the area may be a point included in the area in the photographed image, or may be the center of the area. The sign is displayed on the photographed image or on the map image in a manner that makes it clear that it points to a single location. The shape of the mark may be, for example, a dot, an arrow, a polygon, a partially protruding shape, a partially recessed shape, a partially cut-out shape, or a shape with a lead line extending from position 1.

[0096] The pin 54 is an example of a sign. The user terminal can change the position of the displayed sign (step S32). Specifically, the user can change the latitude and longitude or the address of the real estate by moving the pin 54. By moving the pin 54, the server device accepts a change to the position of the displayed area. Note that the change to the position of the sign may be performed not only by an operation input to the user terminal, but also by control of the server device. The user terminal transmits position information regarding the changed position of the sign to the server device.

[0097] Upon receiving the location information, the server device returns to step S3 and identifies the latitude and longitude corresponding to the location based on the received changed location. The server device also identifies the address of the real estate corresponding to the location based on the received changed location (step S4). The server device may also identify related information corresponding to the identified address of the real estate based on the identified address of the real estate (step S6). Furthermore, the server device can identify the owner of the real estate corresponding to the address and their contact information based on the identified address of the real estate (step S7). In the system of this embodiment, the address and owner of the real estate can be identified based on the location after the sign has been moved. As a result, even if the area identified in step S2 deviates from the area corresponding to the real estate attributes desired by the user, the user can adjust the position of the area identifying the real estate owner while viewing the captured image or map image.

[0098] Selecting icon 55a allows the scale of the captured image or map image to be enlarged or reduced. Enlarging or reducing the scale of the captured image or map image may be performed not only by selecting icon 55a, but also by operating the user terminal on the captured image or map image (e.g., scrolling with a mouse). Selecting icon 55b displays a panoramic image of the entire surroundings (also called a street view of the map image) captured at a point selected by the user. Furthermore, the user may switch the map image from map display to aerial photograph display, display the captured image or map image full-screen, or display the captured image or map image in three dimensions, depending on the user's operating input. This allows the user to check the real-world situation of the area corresponding to pin 54 in detail.

[0099] A check box 61 and icons 62a and 62b are displayed in the third display area 51. When the user selects icon 62a or 62b, the area displayed in the third display area 51 is switched to a different area. That is, the server device switches the displayed captured image or map image (partial image) from a captured image or map image corresponding to one area identified in step S2 to a captured image or map image corresponding to another area identified in step S2 in accordance with a predetermined condition (step S33). The predetermined condition for switching the captured image or map image is not particularly limited, but may be, for example, a user operation input such as clicking, swiping, or scrolling, or every predetermined time period (for example, every 10 seconds).

[0100] When the user selects check box 61, check box 43 corresponding to the area displayed in third display area 51 is selected. The user terminal accepts the selection of the area while displaying a photographed image or a map image corresponding to the position of the area identified in step S2. The server device can identify the address or owner of the real estate corresponding to the position of the area for which the selection was accepted, and can identify the owner of the real estate.

[0101] Alternatively, all check boxes 43 may be selected in advance, and when the user selects a check box 61, the check box 43 corresponding to the area displayed in the third display area 51 may be deselected. The server device can identify the address or owner of the property corresponding to the location of an area other than the area for which the selection was accepted, and identify the owner of the property.

[0102] Alternatively, when the user selects the check box 61, the check box 43 corresponding to the area displayed in the third display area 51 may be selected. The server device may identify the address or owner of a property corresponding to the location of an area other than the area for which the selection was accepted, and identify the owner of the property.

[0103] That is, while displaying the partial image including the one area identified in step S2, the server device can accept input of selection information regarding identifying the address of the property or the owner of the property corresponding to the one area and / or selection information regarding not identifying the property (step S34). Then, in step S4, the server device can identify the address of the property or the owner of the property corresponding to the area for which input of selection information regarding identifying the address of the property or the owner of the property has been accepted, or can identify the address of the property or the owner of the property corresponding to an area other than the area for which input of selection information regarding not identifying the address of the property or the owner of the property has been accepted.

[0104] Furthermore, the server device can identify the address of the property and the owner of the property based on the position changed by moving the pin 54. This allows the user to select or cancel the selection of the property by executing steps S7 and S8 while checking the photographed image or map image corresponding to the area identified in step S2.

[0105] The display process ends by executing steps S31 to S34. Note that the display process does not have to be executed. Also, only step S31 may be executed, or the processes of step S31, S32, S33, and / or S34 may be executed.

[0106] The system may be controlled to display a list of execution histories of steps S2 to S6. For example, when icon 35a is selected, the processes from step S2 onward are executed. The conditions entered at that time (e.g., information entered in the keyword input field 32, distance input field 33, attribute selection field 34, etc.), information about the identified area, and the number of identified real estate owners, etc., may be associated with the date and time when the processes from step S2 onward were executed, the user who executed them, etc., and stored in the server device as execution results. When an execution result is selected from the list of execution results, information corresponding to that execution result may be displayed. When an execution result is selected, for example, display screen 30 or a display screen 70 (described below) is displayed.

[0107] 8 is a flowchart of the information display process according to the embodiment of the present invention. The information display process may be executed after the latitude and longitude are identified in step S3, or after the related information is identified in step S6. Here, too, a case will be described in which, in a system including a user terminal and a server device, the server device functions as the information processing device 1 described above.

[0108] In the information display process, the server device displays the area identified in step S2 on the user terminal in a manner that allows the user to grasp it on the captured image or on a map image corresponding to the captured image (a map image corresponding to the captured image may be simply referred to as a map image) (step S41). The area displayed in step S41 may not only be the area identified in step S2, but also an area identified by the user operating the user terminal to select one or more points or areas in the captured image or map image. The manner in which the identified area can be grasped is not particularly limited, and includes, for example, displaying a sign in the area, superimposing a color on the area, or surrounding the area with a line segment. For example, in step S41, the server device may control the display of a sign in at least one position in the area identified in step S2. The sign has the same meaning as above.

[0109] Next, in response to an operation from the user terminal, the server device controls the user terminal to superimpose additional information related to at least one area or one position in the photographed image or map image on the photographed image or map image (step S42). The superimposed additional information may be displayed only in a portion corresponding to the identified area, in a portion corresponding to the vicinity of the area, in a predetermined portion of the photographed image or map image regardless of the area, or on the entire photographed image or map image displayed on the display screen.

[0110] The additional information is information for presenting the user with information about the real-world location of the captured image or map image, and can be designed as appropriate. The additional information includes information about the parcel number, information about the zoning, information about the building coverage ratio, information about the floor area ratio, information about densely wooded areas, information about nighttime light, hazard information, information about the assessed value of the land, consumption trend analysis data, statistical data, satellite data, people flow data, and / or traffic volume data. The additional information may also include information indicating that the owner has been identified in the past by an owner identification means.

[0111] The information about the parcel number includes a number corresponding to the parcel number and information about the parcel boundary, which indicates the line that divides the land when the land is registered. A densely wooded area is an area where wooden houses are built closely together. The information about nighttime light is information about satellite images taken at night. The hazard information is as described above, and includes, for example, information about floods, earthquakes, tsunamis, volcanoes, landslides, high tides, inland waters, etc. The information about the assessed value of land includes information about the price of the land, such as the assessed value for fixed asset tax, the market price, the official land price, the roadside price, etc. The consumption trend analysis data is data for analysis that captures general consumption trends, and includes, for example, the Consumer Traffic Index (CTI), the Consumer Price Index (CPI), etc.

[0112] Statistical data is information about a predetermined object in a predetermined area (for example, a city, ward, town, or village), and includes, for example, the number of hospitals and / or general clinics, the number of beds in hospitals and / or general clinics, the number of people in child-rearing age, the number of criminal offenses reported, the number of traffic accidents, population density, estimated future population, urban park area, large-scale retail store area, the number of food and beverage retail establishments, the number of restaurants, retail sales, average residential land prices, financial strength index, resident tax, average income, average residential total floor area, etc. Satellite data is image data acquired by sensors mounted on artificial satellites and data obtained based on information acquired by sensors mounted on artificial satellites, and includes, for example, earth surface temperature, vegetation, air pollution (for example, NO ２ , S.O. ２ , CO, CH ４ , O ３The data includes data indicating hazard risks due to urbanization (e.g., impermeability index), and weather (e.g., temperature, humidity, wind direction, wind speed, precipitation, snowfall, sunshine hours, solar radiation, dew point, visibility, air pressure, etc.). The impermeability index may be calculated from the percentage of a specified area occupied by impermeable areas, which are artificial ground surfaces that water cannot penetrate. People flow data is data that can determine when, where, and how many people are present. Traffic volume data is data that can determine when, where, and where, and how many vehicles are present.

[0113] The manner in which the additional information is superimposed is not particularly limited, and examples thereof include superimposing specific information on the photographed image or map image, superimposing a color corresponding to information corresponding to each area, superimposing polygon data that divides the area, superimposing predetermined image data, etc. When the additional information is superimposed and displayed on the photographed image or map image, the saturation, brightness, and / or transparency may be varied depending on the additional information and / or the content of the additional information.

[0114] 9 is a diagram showing an example of a display screen according to an embodiment of the present invention. Display screen 70 in FIG. 9 shows another example of a display screen after the processing of steps S1 to S6 has been executed. Display screen 70 in FIG. 9 corresponds to the display screen after step S42 has been executed, and information related to the parcel number is superimposed on the photographed image. In display screen 70, the photographed image (aerial photograph) is shown with a dashed line, and the information related to the superimposed parcel number is shown with a solid line.

[0115] The display screen 70 displays a fourth display area 71 and a fifth display area 81. In the fourth display area 71, information specified in any of steps S3 to S7 is displayed in association with each area specified in step S2. In addition, in the fourth display area 71, information specified in any of steps S3 to S7 is displayed in association with each location or area selected by the user operating the user terminal. In the fourth display area 71, search conditions 72, search results 73, and area display fields 74 (74a to 74c) are displayed. In the search conditions 72, information about the area to be the target of the specified process entered in the first display area 31 is displayed.

[0116] The search result 73 displays the number of areas displayed in the fourth display area 71 and information on how the areas were identified. In an embodiment of the present invention, the method of identifying the areas includes, for example, a method of identifying an area corresponding to real estate having predetermined attributes using a prediction model, and a method of a user operating a user terminal to identify an area from a captured image or a map image.

[0117] A method of identifying an area using a predictive model can be referred to as an AI search, and a method of identifying an area by operating a user terminal can be referred to as a self-search. For example, when icon 101 is selected, a display screen (e.g., first display area 31) for performing an AI search is displayed. Furthermore, when icon 102 is selected, a display screen (e.g., display screen 70) for performing a self-search is displayed. Note that on display screen 70, a user can identify an area by operating the user terminal and selecting one or more points or one or more areas in the captured image or map image displayed in fifth display area 81.

[0118] Information identified in any of steps S3 to S7 is displayed in association with each area identified in step S2 or each area selected on the user terminal in the area display field 74. The area display field 74 may also display information regarding the method by which the area was identified (e.g., AI search or self-search).

[0119] The area display field 74a includes real estate information 75a, an icon 76a, an icon 77a, and an attribute input field 79a. Because the content included in the area display field 74 is the same, the following description will focus on the area display field 74a. The real estate information 75a is information about the real estate corresponding to the area displayed in the fifth display area 81. This real estate information may be information identified in any of steps S3 to S7.

[0120] The icon 76a is an icon for selecting whether to identify the owner and contact information of the property in the area corresponding to the area display field 74. Similar to the processing of step S34 described above, when the user selects the icon 76a, the server device can identify the address or owner of the property corresponding to the location of the area for which the selection was accepted, and identify the owner of the property. Alternatively, when the user selects the icon 76a, the server device may identify the address or owner of the property corresponding to the location of an area other than the area for which the selection was accepted, and identify the owner of the property. The selection of the icon 76a is an example of inputting the above-mentioned selection information.

[0121] When the icon 78 is selected, the real estate owner and contact information for the area selected by the icon 76a are identified (step S7). That is, on the display screen 70, the user can operate the user terminal to select whether or not to identify the real estate owner and contact information for the area identified in the processes of steps S1 to S6 or for the area identified by operating the user terminal.

[0122] The icon 77a displays information for associating the area displayed in the area display field 74 with the sign 82a displayed in the fifth display area 81. For example, the icon 77a and the sign 82a may be displayed in the same color, the same pattern, and / or the same symbol. The symbol may be a number, a letter, or an illustration. A predetermined symbol may be displayed on or near the sign 82a displayed on the map. This allows the user to visually recognize that the icon 77a and the sign 82a correspond to each other and that the location indicated by the sign 82a indicates the address of the real estate information 75a. Different symbols are assigned depending on the area indicated.

[0123] The captured image or the map image is displayed in the fifth display area 81. The fifth display area 81 is an area for displaying a sign on the captured image or the map image at the latitude and longitude specified in step S3 or the address specified in step S4. The fifth display area 81 may be displayed so that the user can decide whether or not to specify the owner and contact information of the real estate for the area specified in step S2.

[0124] The fifth display area 81 includes signs 82a to 82d and icons 83 to 86. The sign 82 has the same meaning as the sign described above. In the captured image or map image, signs 82a, 82b, and 82c are displayed at positions corresponding to the areas displayed in the area display fields 74a, 74b, and 74c. The signs 82a to 82c corresponding to the newly identified area are an example of a first sign. In addition, a sign 82d is displayed in the captured image or map image. The sign 82d indicates the location of an area corresponding to the owner's real estate previously identified by the processing in step S7. The sign 82d is an example of a second sign. In this way, the server device can control the display of the area corresponding to the owner's real estate previously identified in step S7 in a manner that is easy to understand.

[0125] The first sign (the area identified in step S2) and the second sign (the area corresponding to the owner's real estate previously identified in step S7) are displayed in different ways. The different ways include, but are not limited to, different colors, patterns, lighting or flashing, symbols, etc. For example, the first sign may display a number, and the second sign may display the word "Done."

[0126] Furthermore, the display mode of the first markers may be changed. For example, the markers 82a and 82b indicating the area identified by the AI ​​search and the marker 82c indicating the area identified by the self-search may be displayed in different modes.

[0127] The fifth display area 81 includes an additional information input field 90. The additional information input field 90 is an input field for the user to select additional information to be superimposed on the photographed image or map image displayed in the fifth display area 81. The additional information input field 90 displays a parcel boundary indication 91, a land use zone 92, nighttime lighting 93, a wooded area 94, and hazard information 95. The items displayed in the additional information input field 90 are merely examples, and are not particularly limited as long as they can be superimposed and displayed as additional information. On the display screen 70, the parcel boundary indication 91 is input, and a line corresponding to a parcel boundary 91a indicating a parcel and a parcel number 91b are superimposed on the photographed image or the map image.

[0128] When the user selects the use zone 92, a different color is superimposed on the corresponding area for each use zone. Furthermore, the display screen 70 may display the colors and information related to the correspondence between the use zones indicated by the colors, so that the correspondence between the use zones indicated by the colors can be understood. When the user selects the night light 93, a satellite image taken at night is superimposed on the display. When the user selects the densely wooded area 94, information indicating the areas corresponding to the densely wooded area is superimposed on the display. For example, the color of the area may be different depending on the number of wooden houses per unit area for each area. When the user selects the hazard information 95, a different color is superimposed on the corresponding area for each hazard information. Furthermore, the display screen 70 may display information related to the correspondence between the colors and the hazard information indicated by the colors, so that the correspondence between the use zones indicated by the hazard information can be understood. The above-described aspects can also be appropriately adopted and applied when other information is superimposed as additional information.

[0129] When people flow data is displayed as additional information, the display screen 70 displays an operation field for changing the time period. The display screen 70 displays a different color superimposed on the corresponding area for each piece of people flow data corresponding to a time period. When the time period is changed, the people flow data corresponding to the changed time period is displayed. When traffic volume data is displayed as additional information, the display screen 70 displays an operation field for changing the time period. The display screen 70 displays a different color superimposed on the corresponding area for each piece of traffic volume data corresponding to a time period. When the time period is changed, the traffic volume data corresponding to the changed time period is displayed.

[0130] Note that selecting icon 83 allows the user to use a function that can specify the area of ​​an area within the photographed image or map image displayed in the fifth display area 81. The user operates the user terminal to select an area within the photographed image or map image. For example, when four points are selected, the area of ​​the shape specified by the four points is calculated based on the scale of the photographed image or map image and displayed. Selecting icon 84 allows the user to use a function that can specify the length of an area within the photographed image or map image displayed in the fifth display area 81. When the user operates the user terminal to select two points within the photographed image or map image, the length of the line segment specified by the two points is calculated based on the scale of the photographed image or map image and displayed. Icon 85 has the same function as icon 55b. Furthermore, icon 86 has the same function as icon 55a.

[0131] Returning to the description of the flowchart of the information display process, the server device accepts an input to correct the attributes of the real estate corresponding to the area identified in step S2 in response to an operation from the user terminal (step S43). In step S43, the server device accepts the input by associating the area in the captured image with the attributes of the real estate corresponding to that area.

[0132] For example, if the user operates the user terminal and finds that the attributes of the real estate corresponding to the area identified by the AI ​​search are incorrect, the user can select the attribute input field 79a as an input to correct the real estate attributes and input the correct real estate attributes corresponding to the area. Selecting the attribute input field 79a displays a list of pre-set real estate attributes, from which the user can select the correct real estate attributes. In this way, the server device can accept input to correct the attributes of the real estate corresponding to the area identified by the processing in step S2.

[0133] When the server device accepts the input of the correction, the server device uses the image data of the area for which the correction of the property attributes was accepted in step S43 as input data, the corrected property attributes as output data, and re-trains the prediction model (step S44). The prediction model is a prediction model that has been machine-learned using image data of at least a portion of the area of ​​the captured image as input data and information about the property attributes corresponding to that area as output data. In step S44, the server device re-trains the prediction model using the image data corresponding to the area for which the input was accepted as input data and information about the property attributes corresponding to that area as output data. The re-trained prediction model is used in the area identification process in step S2. The information display process ends with the processing of steps S41 to S44.

[0134] Note that steps S43 and S44 may be executed as follows. For example, step S43 may accept input to correct the position of the area identified in step S2. The correction of the area position may be executed in the same manner as step S32. In step S44, image data of the area corresponding to the position for which the correction was accepted in step S43 is used as input data, and the predetermined attributes are used as output data, and the predictive model can be retrained. For example, if the user operates the user terminal and the attributes of the real estate corresponding to the area identified by the AI ​​search are incorrect, the user can operate the sign 82 to input the correct location of the area corresponding to the attributes of the real estate. When the user operates the sign, the area corresponding to the lot number including the point indicated by the sign may be identified as the area in the captured image. In this way, the server device can accept input to correct the area corresponding to the attributes of the real estate identified by the processing of step S2.

[0135] Note that steps S43 and S44 may be executed as follows. For example, in step S43, an input for identifying an area on one captured image or on a map image corresponding to the one captured image may be received through an operation on a user terminal operated by a user. The input for identifying the area includes both an input of a point on the image and an input of the area. Then, attributes of real estate corresponding to the area identified by the input may be received through an operation on a user terminal operated by a user. In step S44, image data of the area for which input has been received may be used as input data, and attributes of the real estate for which input has been received may be used as output data, and the prediction model may be retrained.

[0136] For example, the system may accept input of real estate attributes for an area on a captured image for which the user has accepted input of at least one location through a self-search. In this case, the user can select the attribute input field 79c to input the real estate attribute corresponding to the area. Selecting the attribute input field 79c displays a list of pre-set real estate attributes, from which the user can select a real estate attribute. Furthermore, when the user enters a single location, the area corresponding to the parcel number including the location may be identified as the area on the captured image. Note that in this case, input of the real estate attribute may be omitted. For example, if the user has selected a specific real estate attribute (e.g., a parking lot) through an AI search, the real estate attribute for the area for which input has been accepted through a self-search may be the specific attribute identified by the predictive model.

[0137] The re-learning of the predictive model may be performed each time information in step S43 is received, or may be performed every fixed period (e.g., one month), or may be performed each time the number of times information in step S43 is received exceeds a predetermined number (e.g., 50 times).

[0138] The information display process may not be executed. Alternatively, only step S41 may be executed, or only steps S41 and S42 may be executed, or only steps S43 and S44 may be executed. The order of steps S41 and S42 may be random.

[0139] A user can operate a user terminal to request execution of the process of step S7 or S8. For example, when the process of step S7 or S8 is executed, the user may be charged. When a user selects a request button (icon 46) for executing the process of step S7 displayed on the display screen of the user terminal, the processes of steps S5 and S7, or steps S4, S5, and S7, may be executed. In this case, the user may be charged when the processes of steps S5 and S7, or steps S4, S5, and S7, are executed. Alternatively, when a user selects a request button for executing the process of step S8 displayed on the display screen of the user terminal, the processes of steps S5, S7, and S8, or steps S4, S5, S7, and S8, may be executed. In this case, the user may be charged when the processes of steps S5, S7, and S8, or steps S4, S5, S7, and S8, are executed.

[0140] Next, the second real estate and owner identification process performed by the system according to an embodiment of the present invention will be described. FIG. 7 is a diagram showing a flowchart of the second real estate and owner identification process according to an embodiment of the present invention. The user operates the input unit 14 of the information processing device 1 to launch dedicated application software for executing the second real estate and owner identification process (hereinafter, the second real estate and owner identification process will be referred to as the "second identification process"). The user operates the input unit 14 of the information processing device 1 to start the second identification process for identifying the owner of real estate that meets predetermined conditions.

[0141] When the user operates the input unit 14 of the information processing device 1 to input keywords (also referred to as attribute information) for the real estate, store, or facility that is the target of the second identification process, the information processing device 1 accepts the input keywords (step S11). Here, the keywords (attribute information) for the real estate, etc. may be any of the following: the area, the type of real estate, etc., such as a restaurant or lumber store, the business status, such as whether the store is closed, and the name of the real estate, etc. In step S11, the user inputs the area and other information. Inputting real estate keywords includes inputting a character string, such as a place name, using a keyboard or a software keyboard, or selecting a pre-defined option for each area. In step S11, when the user inputs a character string, the information processing device 1 accepts the input character string.

[0142] Next, the information processing device 1 identifies real estate, stores, or facilities that satisfy predetermined conditions based on the received keywords (step S12). In step S12, real estate, stores, or facilities that satisfy the predetermined conditions, or the names of the real estate, stores, or facilities, may be identified based on the received keywords.

[0143] Next, the information processing device 1 identifies an address (house address or lot number) corresponding to the real estate, store, or facility identified in step S12 based on a preset correspondence between the address and the real estate, store, or facility corresponding to the address (step S13). In step S13, the information processing device 1 may identify an address corresponding to the name of the real estate, store, or facility identified in step S12 based on a preset correspondence between the address and the name of the real estate, store, or facility corresponding to the address.

[0144] The data relating to the correspondence between addresses and the attribute information of real estate, stores, or facilities corresponding to the addresses, which is used in steps S12 and S13, may be stored in advance in the storage unit 13 of the information processing device 1. Furthermore, map data provided on the Internet may be used as the data relating to the correspondence between addresses and the attribute information of real estate, stores, or facilities corresponding to the addresses. The map data stores the correspondence between addresses and the attribute information of real estate, stores, or facilities corresponding to the addresses. When using map data provided on the Internet, the information processing device 1 acquires data relating to the correspondence between addresses in the map data and the attribute information of real estate, stores, or facilities corresponding to the addresses from another computer device.

[0145] For example, if the character string "house" is received in step S11, the name of an old Japanese-style apartment building, such as "XX-house," and the address of that building can be identified in steps S12 and S13. Also, if the character string "restaurant" is received in step S11, the name of a Western-style restaurant, such as "XX-restaurant," and the address of that Western-style restaurant can be identified in steps S12 and S13.

[0146] For example, if the character strings "restaurant" and "closed" are received in step S11, then in steps S12 and S13, a building that is a "restaurant" and that has "closed" can be identified, along with the address of that building. When the information processing device 1 receives the character string "restaurant," it may identify not only stores that include the character string "restaurant," but also stores for which attribute information of eating and drinking establishments is registered. Furthermore, when the information processing device 1 receives the character string "closed," it may identify stores for which similar attribute information, such as "closed," "closed," or "scheduled to close," is registered.

[0147] If the character string received in step S11 is a region, the information processing device 1 can identify real estate, stores, or facilities that have attribute information that completely or partially matches the character string. Also, if the character string received in step S11 is the type of real estate, etc., business status, or name of real estate, etc., the information processing device 1 can identify real estate, stores, or facilities that have attribute information that completely matches, partially matches, or is similar to the character string. In this way, by inputting a character string used for real estate or stores that have specified attribute information in step S11, it is possible to identify real estate that has the specified attribute information.

[0148] Next, the information processing device 1 identifies related information corresponding to the identified address based on the correspondence between the address and the related information corresponding to the address (step S14). In step S14, the information processing device 1 may identify related information corresponding to the identified address based on the correspondence between the address and the related information corresponding to the address.

[0149] There is no particular limitation on the method by which the information processing device 1 identifies the related information corresponding to the address identified. In identifying the related information, the information processing device 1 may use data in which the address or latitude and longitude are associated with the related information corresponding to the address and stored, or may cooperate with a system configured by other computer devices. Note that the processing of step S14 may be omitted.

[0150] Next, the owner of the real estate corresponding to the identified address is identified based on the correspondence between the address and the owner of the real estate corresponding to the address (step S15). In step S15, the owner of the real estate corresponding to the identified address and the owner's contact information may be identified based on the correspondence between the address and the owner of the real estate corresponding to the address and the owner's contact information. If the parcel number is identified in step S13, the owner of the real estate corresponding to the identified parcel number and the contact information are identified based on the correspondence between the parcel number and the owner of the real estate corresponding to the parcel number. Note that the owner of the real estate also includes the owner of a store, facility, or the owner of the land on which the store or facility is located.

[0151] The method for identifying the owner of the property corresponding to the identified address and the owner's contact information is not particularly limited, but it is preferable to identify the owner of the property and the owner's contact information using data stored in association with the address and the owner of the property corresponding to the address. For example, an owner master table is registered in the storage unit 13 of the information processing device 1, in which the owner of the property corresponding to the address (lot number) and the owner's contact information are stored in association with the address (lot number). By referring to the owner master table, the owner corresponding to the address identified in step S13 and the owner's contact information can be identified. Alternatively, the information processing device 1 may cooperate with a system composed of other computer devices to identify the owner corresponding to the lot number identified in step S13 and the owner's contact information.

[0152] The "owner" identified in step S15 is the name of the owner. The contact information of the owner identified in step S15 is not particularly limited, but may include a landline telephone number, a mobile telephone number, an email address, a facsimile number, an address (residential address), a postal code, etc. By outputting the identified owner's name and contact information, such as displaying it on the display unit 15 of the information processing device 1, the user can contact the real estate owner by telephone, email, facsimile, mail, etc.

[0153] Next, the information processing device 1 uses the contact information of the owner identified in step S15 to send the specified information to the identified owner, i.e., the owner of the real estate having the specified attribute information (step S16). The specified information sent in step S16 is not particularly limited. The specified information can be sent by the user via the input unit 14 of the information processing device 1 and stored in the storage unit 13. The specified information stored in the storage unit 13 is read when step S16 is executed.

[0154] The predetermined information transmitted to the real estate owner in step S16 can be changed as appropriate depending on the type of predetermined attribute information and the purpose of the user. The method of transmitting the predetermined information in step S16 is also not particularly limited. The method of transmitting the predetermined information may be selected by the user operating the input unit 14 of the information processing device 1.

[0155] Furthermore, instead of or in addition to the process of transmitting predetermined information to the property owner in step S16, the information processing device 1 may also execute a process of transmitting transmission information for transmitting predetermined information or delivery information for sending a mailing to another computer device to the property owner identified in step S15, a process of controlling the delivery information to be printed on a medium, and / or a process of storing the delivery information on a storage medium. Which of these processes is executed after executing step S15 can be appropriately designed. It is also possible to allow the user to select which of these processes to execute by operating the input unit 14 of the information processing device 1.

[0156] By executing a process of transmitting transmission information for transmitting predetermined information to the owner identified in step S15 to another computer device, it is possible to transmit predetermined information from the other computer device to the owner by e-mail or facsimile. Furthermore, by executing a process of transmitting delivery information for sending an item to the owner identified in step S15 to another computer device operated by another business, etc., it is possible for the other business, etc. to send the item to the owner by courier or mail. By executing a process of controlling printing on a medium delivery information (the owner's name and address) for sending an item to the owner identified in step S15, it is also possible to execute a process of storing on an external storage medium the delivery information for sending an item to the owner identified in step S15 (the owner's name and contact information, and the address (lot number) of the identified real estate).

[0157] The second identification process is completed by executing steps S11 to S16. The address (address and lot number) of the real estate identified by executing the second identification process of steps S11 to S16, the owner of the real estate, and the owner's contact information may be stored in the storage unit 13 of the information processing device 1.

[0158] In the above-described embodiment, the user operates the information processing device 1 to execute the second identification process. However, for example, the user may operate a user terminal and execute the second identification process of steps S11 to S16 on a server device that can be connected to the user terminal for communication. In this case, the server device functions as the information processing device 1 in the above-described embodiment. The server device transmits and receives information to and from the user terminal as necessary. The addresses of real estate having predetermined attribute information, the owners of the real estate, and the owner's contact information obtained as a result of executing the second identification process are transmitted from the server device to the user terminal and displayed on the display screen of the user terminal. The number of user terminals is not particularly limited as long as it is one or more.

[0159] In the above-described embodiment, several ways of identifying a real estate address have been described. For example, a first way has been described in which a server device or a user terminal identifies an area corresponding to a real estate having a predetermined attribute from an image captured from the air above the ground, thereby identifying the real estate address; a second way has been described in which a user selects one or more points or one or more areas in a captured image or a map image in response to an operation on the user terminal, thereby identifying the real estate address corresponding to the selected one or more points or one or more areas; and a third way has been described in which a server device or a user terminal identifies an address corresponding to a real estate, store, or facility that meets predetermined conditions based on received keywords. These first, second, and third ways may be implemented in combination with each other.

[0160] The system according to the embodiment of the present invention can also utilize open data published by the national government, local governments, private companies, etc. Open data that can be utilized in the system according to the embodiment of the present invention is not particularly limited, but may include the number of crimes per capita, the number of traffic accidents per capita, the number of hospitals per capita, the number of community centers per capita, the number of libraries per capita, the number of nursing care facilities per capita, the number of restaurants per capita, the number of retail stores per capita, the number of large supermarkets per capita, the number of department stores per capita, the number of child welfare facilities per capita, the density of green spaces, summer or winter temperatures, population density, local tax revenue, the amount of medical subsidies, the number of people in child-rearing age groups, the earth's surface temperature, and aerosol optical thickness ( Virus infection risk), air pollution, impermeability index, climate (temperature, humidity, wind direction, wind speed, precipitation, snowfall, sunshine hours, solar radiation, dew point, visibility, air pressure), air cleanliness, in- and out-migration ratios, road density, traffic volume, sewage treatment population coverage rate, water rates, noise, earthquakes (active faults), flood control (hazard maps), radiation, cafe density, distance from train stations, distance from bus stops, average residential land prices, financial strength index, resident tax, average income, average residential floor area, urban planning area (zoning), official land price, standard land price, roadside land price, hazard information (landslides, tsunamis, floods), etc. These data are stored in association with, for example, areas, addresses, or latitude and longitude.

[0161] The method for utilizing these open data is not particularly limited, and the open data may be identified as related information in step S6. The identified open data may be displayed on the user terminal, for example, in association with the latitude and longitude identified in step S3, the address identified in step S4, and the owner and contact information identified in step S7. Furthermore, the open data may be identified as related information in step S14. The identified open data may be displayed in the search results 42 in association with the address identified in step S13 and the owner and contact information identified in step S15. Furthermore, the open data may be used as additional information displayed in step S42.

[0162] Furthermore, in step S8 and / or step S16, etc., the content of the information sent to the real estate owner or the mailings sent can be changed according to the open data. For example, even when proposing real estate utilization to the owner of a vacant house in the information sent to the real estate owner or the mailings sent, if the address of the vacant house is in a densely populated area (an area with a population density above a threshold), it can be suggested that the house be utilized as a residence such as a condominium or apartment, and if the address of the vacant house is in a sparsely populated area, it can be suggested that the house be utilized as a facility other than a residence.

[0163] According to an embodiment of the present invention, an area corresponding to real estate having a predetermined attribute is identified from an image captured from the air above the ground, and the address of the real estate corresponding to the identified area is identified, thereby making it possible to identify the address of the real estate having a predetermined attribute from the captured image.Furthermore, according to an embodiment of the present invention, it is possible to identify the latitude and longitude corresponding to at least one position in the identified area, and to identify the address of the real estate corresponding to the identified latitude and longitude.

[0164] According to an embodiment of the present invention, it is possible to identify the owner of real estate having a predetermined attribute based on the correspondence between an address and the owner of the real estate corresponding to the address.

[0165] According to an embodiment of the present invention, it is possible to identify the owner of a property having a predetermined attribute and the owner's contact information based on the correspondence between an address, the owner of the property corresponding to the address, and the owner's contact information. According to an embodiment of the present invention, it is possible to identify the owner of a property corresponding to an identified lot number based on the correspondence between a lot number and the owner of the property corresponding to the lot number.

[0166] According to an embodiment of the present invention, a sign is displayed at at least one position in the identified area on the photographed image or on the map image together with the photographed image or the map image corresponding to the photographed image, and the position of the displayed sign can be changed. Then, the address of the real estate can be identified based on the changed position.

[0167] According to an embodiment of the present invention, a partial image that is at least a part of a photographed image including a specified area or a partial image that is at least a part of a map image corresponding to the photographed image is displayed, and the displayed partial image can be switched to a partial image corresponding to another area.

[0168] According to an embodiment of the present invention, while a partial image including a specified area is displayed, input of selection information regarding identifying the address of a property corresponding to the specified area and / or selection information regarding not identifying the address can be accepted, and the address of a property corresponding to the area for which input of selection information regarding identifying the address of a property has been accepted can be identified, or the address of a property corresponding to an area other than the area for which input of selection information regarding not identifying the address of a property has been accepted can be identified.

[0169] According to an embodiment of the present invention, it is possible to identify the owner of real estate having specified attributes, send specified information to the owner, send transmission information for sending specified information to the owner or delivery information for sending a mailing to another computer device, control the delivery information to be printed on a medium, and / or store the delivery information on a storage medium.

[0170] According to an embodiment of the present invention, the addresses of real estate corresponding to multiple locations or multiple areas can be identified based on the positions of the multiple locations or multiple areas on a map image, and the owners of the real estate corresponding to the identified multiple addresses can be identified based on the correspondence between the addresses and the owners of the real estate corresponding to the addresses.

[0171] According to an embodiment of the present invention, based on the correspondence between an address and attribute information of the real estate, store, or facility corresponding to the address, it is possible to identify an address corresponding to the name of the real estate, store, or facility that meets specified conditions, and to identify the owner of the real estate corresponding to the identified address.

[0172] According to an embodiment of the present invention, it is possible to accept input of a character string and identify an address corresponding to the name of a property, store, or facility that includes the accepted character string.

[0173] According to an embodiment of the present invention, a specified area can be displayed in a graspable manner on a photographed image or a map image corresponding to the photographed image, and additional information regarding at least one area or one position in the photographed image or map image can be superimposed on the photographed image or map image. This allows a user to grasp the situation in the area or its vicinity and can use this information as a reference when deciding whether to identify the owner of real estate corresponding to the area. Furthermore, according to an embodiment of the present invention, it is possible to control the display of an area corresponding to real estate whose owner was previously identified as additional information on the photographed image or map image in a graspable manner. This prevents a user from re-identifying the owner of real estate corresponding to an area where the owner of real estate was previously identified.

[0174] According to an embodiment of the present invention, an area corresponding to real estate having a specified attribute can be identified from an image taken of the ground from above, or an area can be identified by accepting the selection of an area on the captured image or on a map image corresponding to the captured image, and the address of the real estate corresponding to the identified area can be identified, and related information corresponding to the identified address can be identified based on the correspondence between the address and related information corresponding to the address.

[0175] According to an embodiment of the present invention, a user can operate a user terminal to accept input for identifying an area on a single captured image or on a map image corresponding to the single captured image, accept input of real estate attributes corresponding to the area identified by the input, and use image data of the area for which the input was accepted as input data and the attributes of the real estate for which the input was accepted as output data, thereby retraining a prediction model. The prediction model is machine-learned using image data of at least a portion of an area of ​​an image captured from the air above the ground as input data and information on the attributes of the real estate corresponding to the area as output data. Furthermore, according to an embodiment of the present invention, the prediction model can be retrained using image data of an area for which corrections to real estate attributes have been accepted as input data and the corrected real estate attributes as output data. Furthermore, according to an embodiment of the present invention, the prediction model can be retrained using image data of an area corresponding to a position for which corrections have been accepted as input data and the specified attributes as output data.

[0176] 1 Information processing device, 11 Control unit, 12 RAM, 13 Storage unit, 14 Input unit, 15 Display unit, 16 Communication interface, 21 Map data, 22 Captured image, 23 Area, 30 Display screen, 31 First display area, 32 Keyword input field, 33 Distance input field, 34 Attribute selection field, 35 Icon, 36 Area search, 41 Second display area, 42 Search results, 43 Check box, 44 Camera icon 45, 46 Icon, 51 Third display area, 52 Real estate information, 53 Map image 54 Pin, 55 Icon, 61 Check box, 62 Icon 70 Display screen, 71 Fourth display area, 72 Search conditions, 73 Search results, 74, 74a to 74c Area display field, 75 Real estate information 76 to 78 Icons, 79, 79a, 79c Attribute input field, 81 Fifth display area, 82, 82a to 82d Signs, 83 to 86 Icons, 90 Additional information input field, 91 Plot boundary display, 91a Plot boundary, 91b Lot number, 92 Zoning, 93 Nighttime lighting, 94 Densely wooded area, 95 Hazard information, 101, 102 Icons

Claims

1. A system including at least one computer device, A selection receiving means that accepts the selection of an area from which the owner of the real estate corresponding to the area is identified, or an area from which the owner of the real estate corresponding to the area is not identified, on one or more areas on a photographic image of the ground taken from above or on a map image corresponding to the photographic image, A means for identifying the address of real estate corresponding to the area for which a selection was accepted, or real estate corresponding to an area other than the area for which a selection was accepted, Based on the correspondence between an address and the owner of the property corresponding to that address, the owner identification means identifies the owner of the property corresponding to the address identified by the address identification means. A system equipped with these features.

2. Area identification means for identifying an area corresponding to real estate having predetermined attributes from a captured image. Equipped with, The system according to claim 1, wherein the selection receiving means accepts the selection of an area that identifies the owner of the real estate, or the selection of an area that does not identify the owner of the real estate, from among the areas identified by the area identification means.

3. Display means that displays the area identified by the area identification means on the captured image or on a map image corresponding to the captured image in a manner that allows for understanding the area, and controls the display of additional information relating to at least one area or one location in the captured image or map image superimposed on the captured image or map image. The system according to claim 2, comprising:

4. The system according to claim 3, wherein the additional information includes information on land parcel numbers, land use zones, densely wooded areas, nighttime lighting, hazard information, land valuation data, consumer trend analysis data, statistical data, satellite data, pedestrian flow data, and / or traffic volume data.

5. The display means is controlled to display, as additional information, an area corresponding to the property of an owner previously identified by the owner identification means, on the captured image or on the map image, The system according to claim 3 or 4, wherein the area identified by the area identification means and the area corresponding to the owner's real estate previously identified by the owner identification means are displayed in different ways.

6. Related information identification means for identifying related information corresponding to an address identified by an address identification means, based on the correspondence between an address and related information corresponding to said address. The system according to claim 2 or 3, comprising:

7. The system according to claim 6, wherein the relevant information includes land use zones, building coverage ratio, floor area ratio, elementary and junior high schools in the school district, climate, projected future population, hazard information, and / or information regarding the assessed value of real estate.

8. The area identification means identifies multiple areas corresponding to real estate having predetermined attributes from the captured image, The display means is controlled to display a partial image which is at least a part of a captured image of a region identified by the region identification means, or a partial image which is at least a part of a map image corresponding to the captured image. Display switching means that switches a partial image displayed by the display means to a partial image corresponding to another area. The system according to claim 3 or 4, comprising:

9. The display means displays a marker at at least one location in the region identified by the region identification means on the captured image or on the map image corresponding to the captured image. Position changing means for changing the position of a sign displayed by a display means. Equipped with, The system according to claim 3 or 4, wherein the address identification means identifies the address of real estate based on the location after it has been changed by the location changing means.

10. Computer equipment, A selection receiving means that accepts the selection of an area from which the owner of the real estate corresponding to the area is identified, or an area from which the owner of the real estate corresponding to the area is not identified, on one or more areas on a photographic image of the ground taken from above or on a map image corresponding to the photographic image, A means for identifying the address of real estate corresponding to the area for which a selection was accepted, or real estate corresponding to an area other than the area for which a selection was accepted, Owner identification means that identifies the owner of the property corresponding to an address identified by the address identification means, based on the correspondence between an address and the owner of the property corresponding to that address. A program that makes something function as such.

11. A method performed in a system including at least one computer device, A selection acceptance step that accepts the selection of an area from which the owner of the real estate corresponding to the area is identified, or an area from which the owner of the real estate corresponding to the area is not identified, based on one or more areas on an aerial photograph of the ground or on a map image corresponding to the photograph. An address identification step to identify the address of real estate corresponding to the area selected, or real estate corresponding to an area other than the area selected, Based on the correspondence between an address and the owner of the property corresponding to that address, the owner identification step identifies the owner of the property corresponding to the address identified in the address identification step. A method having.