Correction Area Extraction System

Abstract

To solve an ongoing problem, that is, provide a correction area extraction system capable of automatically extracting a candidate for an area, which should be corrected, from primary processing data in consideration of a difference in properties between over-filtering and filtering omission.SOLUTION: A correction area extraction system of the present invention automatically extracts a correction area that is an object of manual filtering processing, and includes over-extraction mesh detection means and un-extraction mesh detection means. The over-extraction mesh detection means applies a label by inputting a removal mesh and altitude to an over-extraction learned model. The un-extraction mesh detection means applies a label by inputting a maintenance mesh and altitude to an un-extraction learned model. A removal mesh to which a ground label has been applied by the over-extraction mesh detection means and the maintenance mesh to which a non-ground label has been applied by the un-extraction mesh detection means are regarded as a correction area.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a technology for generating a ground surface from measurement results obtained by a laser measuring instrument, and more specifically, to a correction area extraction system that can automatically extract areas that should be manually filtered after automatic filtering processing. [Background technology]

[0002] When measuring "ground" or "land features" (hereinafter collectively referred to as "ground, etc.") over a wide area, aerial photogrammetry has been the mainstream method up until now, but recently, various measurement methods have emerged, such as airborne laser measurement, measurement using satellite photos, and measurement using synthetic aperture radar, making it possible to select the most appropriate method depending on the situation. Note that "land features" here refers to "objects" excluding the ground.

[0003] Of these, airborne laser measurement is a method in which an aircraft flies over the target area to be measured and measures the reflected waves of laser pulses irradiated onto the ground and other surfaces within the target area. Aircraft are usually equipped with a positioning device such as a GNSS (Global Navigation Satellite System) and an inertial measurement device such as an IMU (Inertial Measurement Unit), and these GNSS and IMU can record the irradiation position (x, y, z) and irradiation attitude (ω, φ, κ) when the laser pulse is irradiated.

[0004] When a laser pulse is emitted from an aircraft, the time of emission is recorded, and when the laser pulse is reflected from the ground or other surface, it is received by a sensor mounted on the aircraft, and the time of reception is also recorded. Therefore, the distance to the measurement point (the point where the laser pulse is reflected) can be obtained from the time difference between the emission time and the reception time. Since the irradiation position (x, y, z) and irradiation attitude (ω, φ, κ) at the time of laser pulse emission are also recorded, data on the three-dimensional coordinates of the laser pulse irradiation point (i.e., the measurement point) (hereinafter referred to as "measurement point data") can be obtained. Furthermore, when the sensor mounted on the aircraft receives the laser pulse, it records the intensity of the reflected wave (hereinafter referred to as "reflection intensity"). This reflection intensity is, so to speak, the magnitude of the energy of the received reflected wave (the amplitude of the laser pulse) and is measured directly as a voltage. The magnitude of the energy can be obtained by converting this voltage.

[0005] As explained so far, airborne laser measurement is a method of obtaining measurement point data by irradiating laser pulses onto the ground, etc., from an aircraft in flight. These laser pulses are emitted 100,000 to 2,000,000 times per second, so a huge number of measurement point data are obtained in one measurement (flight). Furthermore, when measuring a forest or other target, it is naturally impossible to irradiate the laser pulses only onto the ground as they pass through the trees (i.e., to irradiate the laser pulses aimed at the ground), so in addition to measurement point data reflected by the ground, measurement point data reflected by tree leaves and trunks is also obtained.

[0006] In many cases, airborne laser measurement is performed to determine the ground level within a target area, and measurement point data reflected by tree leaves and trunks (non-ground data) is, so to speak, unnecessary data. Therefore, so-called filtering is performed to remove non-ground data, and various improved filtering techniques have been proposed. For example, Patent Document 1 proposes a technique for comparing a terrain model (so-called surface model) obtained by photogrammetry with measurement point data obtained by airborne laser measurement, and removing non-ground data by determining that measurement point data that approximates the terrain model obtained by photogrammetry is reflected by tree leaves and trunks (corresponding to the surface). [Prior art documents] [Patent documents]

[0007] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-158278 Summary of the Invention [Problem to be solved by the invention]

[0008] As mentioned above, filtering is performed to remove non-ground data in order to determine the ground height. However, it is not practical for a human (operator) to manually remove the vast amount of measurement point data obtained from a single measurement. Therefore, an "automatic filtering process" is generally used to automatically remove non-ground data under certain conditions. Typical examples of automatic filtering include an automatic filtering process that forms a TIN (triangulated irregular network) model from points extracted as initial ground points (the lowest points within a specific range) and then searches the TIN model for ground points near the surface to detect (remove) non-ground data. Another example is an automatic filtering process that removes measurement point data where the reflection intensity (amplitude) of the received laser pulse falls below a predetermined threshold as non-ground data. It is known that the reflection intensity of a laser pulse reflected by leaves, etc. is weaker than that reflected by the ground. Therefore, measurement point data related to laser pulses with low (weak) reflection intensity are unconditionally treated as non-ground data.

[0009] This automatic filtering process automatically extracts non-ground data, significantly reducing the operator's workload, but of course it is not possible to extract all non-ground data using automatic filtering. Therefore, the measurement point data (primary processed data) from which the non-ground data has been removed by automatic filtering is usually subjected to further "manual filtering" by the operator. In other words, the measurement point data (original data) obtained by measurement is subjected to automatic filtering to generate primary processed data, and then this primary processed data is subjected to manual filtering to generate the final measurement point data (ground data).

[0010] Manual filtering is a process in which an operator visually checks the primary processed data to extract areas that need to be corrected and then performs the corrections. This is a very nerve-wracking operation, and it is impossible to completely eliminate incorrect operations (so-called human error). Therefore, the inventors of the present invention decided to automatically extract candidates for areas that need to be corrected from the primary processed data, and further attempted to achieve automatic extraction using artificial intelligence (AI). By presenting the areas that need to be corrected, the operator only needs to target those areas, significantly reducing the work required for manual filtering.

[0011] However, when the area to be corrected was extracted using a trained model generated by machine learning (e.g., deep learning), the extraction could not be performed with a very high degree of accuracy. The inventors then discovered that the cause of this was the difference (i.e., the difference in characteristics) between "excessive filtering" and "omission in filtering" in the automatic filtering process. Here, "excessive filtering" refers to the process of mistakenly removing ground data, while "omission in filtering" refers to the process of not removing (i.e., maintaining) non-ground data. In other words, there was a problem in treating non-ground data that was "over-extracted" due to excessive filtering and data that was "omission in extraction" due to omission in filtering equally.

[0012] The object of the present invention is to solve the problems of the conventional art, that is, to provide a correction area extraction system that can automatically extract candidates for areas to be corrected from primary processed data, taking into consideration the difference in characteristics between excessive filtering due to automatic filtering processing and filtering omissions. [Means for solving the problem]

[0013] The present invention focuses on the fact that the process for extracting over-extracted data and the process for extracting missed-extraction data are executed separately, i.e., a trained model corresponding to excessive filtering and a trained model corresponding to missed-filtering are generated separately, and is an invention based on an idea that has not been seen before.

[0014] The correction area extraction system of the present invention is a system that automatically extracts a correction area to be subjected to manual filtering processing when generating ground data based on a terrain model (a model composed of multiple meshes, each mesh being assigned an elevation), and is equipped with an over-extracted mesh detection means and an unextracted mesh detection means. Of these, the over-extracted mesh detection means is a means for assigning a ground label or a non-ground label to the removed mesh by inputting the removed meshes and elevations that have been excluded by the automatic filtering processing of the terrain model into an over-extraction trained model. The unextracted mesh detection means is a means for assigning a ground label or a non-ground label to the maintained mesh by inputting the maintained meshes and elevations that have not been excluded by the automatic filtering processing of the terrain model into an unextraction trained model. The over-extracted trained model is generated by machine learning using the "ground label or non-ground label (teacher data)" and "elevation (input data)" attached to the removed mesh as training data, while the unextracted trained model is generated by machine learning using the "ground label or non-ground label (teacher data)" and "elevation (input data)" attached to the maintained mesh as training data. The removed mesh to which the ground label has been assigned by the over-extracted mesh detection means and the maintained mesh to which the non-ground label has been assigned by the unextracted mesh detection means are set as the correction area.

[0015] The correction area extraction system of the present invention may further include an elevation difference calculation means. This elevation difference calculation means calculates the elevation difference between the elevation of the removed mesh and the elevation of the ground data generated after the removed mesh is excluded. In this case, the over-extraction mesh detection means assigns a ground label or a non-ground label to the removed mesh by inputting the removed mesh and the elevation difference into an over-extraction trained model. In this case, the over-extraction trained model is generated by machine learning using the "ground label or non-ground label (teacher data)" and "elevation difference (input data)" assigned to the removed mesh as training data.

[0016] The correction region extraction system of the present invention can also be configured to automatically extract a correction region based on the grayscale (or color information) attached to the mesh in addition to the elevation and elevation difference. In this case, the over-extracted mesh detection means assigns a ground label or a non-ground label to the removed mesh by inputting the grayscale (or color information) and elevation (or elevation difference) related to the removed mesh into the over-extraction trained model, and the unextracted mesh detection means assigns a ground label or a non-ground label to the maintained mesh by inputting the grayscale (or color information) and elevation (or elevation difference) related to the maintained mesh into the unextraction trained model. In this case, the over-extraction trained model is generated by machine learning using the ``ground label or non-ground label (teacher data)'' attached to the removal mesh and the ``grayscale or color information, and elevation or elevation difference (input data)'' related to the removal mesh as training data, and the under-extraction trained model is generated by machine learning using the ``ground label or non-ground label (teacher data)'' attached to the maintenance mesh and the ``grayscale or color information, and elevation or elevation difference (input data)'' related to the maintenance mesh as training data.

[0017] The correction region extraction system of the present invention can also automatically extract correction regions based on the grayscale (or color information) attached to the meshes, without including it in the elevation or elevation difference. In this case, the over-extraction mesh detection means assigns a ground label or a non-ground label to the removed meshes by inputting the grayscale (or color information) associated with the removed meshes into the over-extraction trained model, and the unextracted mesh detection means assigns a ground label or a non-ground label to the maintained meshes by inputting the grayscale (or color information) associated with the maintained meshes into the unextraction trained model. In this case, the over-extraction trained model is generated by machine learning using the "ground label or non-ground label (teacher data)" attached to the removed meshes and the "grayscale and color information removed (input data)" associated with the removed meshes as training data, and the unextraction trained model is generated by machine learning using the "ground label or non-ground label (teacher data)" attached to the maintained meshes and the "grayscale and color information (input data)" associated with the maintained meshes as training data.

[0018] The correction region extraction system of the present invention may further include a candidate mesh detection means and a correction region setting means. The candidate mesh detection means is means for selecting, as correction candidate meshes, removed meshes to which a ground label has been assigned by the over-extracted mesh detection means and retained meshes to which a non-ground label has been assigned by the unextracted mesh detection means. The correction region setting means is means for setting a predetermined judgment region as a correction region when the proportion of candidate meshes in the judgment region exceeds a predetermined proportion threshold. [Effects of the Invention]

[0019] The correction region extraction system of the present invention has the following advantages. (1) The process of extracting over-extracted data and the process of extracting under-extracted data are performed separately, so that the region to be subjected to manual filtering can be extracted with relatively high accuracy. (2) The area to be subjected to manual filtering processing is automatically extracted, which significantly reduces the operator's work required for manual filtering processing. (3) In addition, since the areas that should be subject to manual filtering processing are automatically extracted, it becomes easier to avoid human errors that may occur during operator work. [Brief explanation of the drawings]

[0020] [Figure 1] A model diagram showing a terrain model composed of multiple meshes. [Figure 2] A cross-sectional view showing the "ground data" in schematic form. [Figure 3] A model diagram explaining "excessive filtering" and "missed filtering" caused by automatic filtering processing. [Figure 4] FIG. 1 is a block diagram showing the main configuration of a correction region extraction system according to the present invention. [Figure 5] FIG. 3 is a flowchart showing an example of the main processing flow of the correction region extraction system 100 according to the first embodiment. [Figure 6] FIG. 10 is a flowchart showing an example of the main processing flow of the correction region extraction system 100 according to the second embodiment. [Figure 7] FIG. 11 is a flowchart showing an example of the main processing flow of the correction region extraction system 100 according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0021] An example of an embodiment of the correction region extraction system of the present invention will be described with reference to the drawings.

[0022] 1.Definition Before describing the embodiments of the present invention, definitions of terms used herein will be provided.

[0023] (Terrain model) When measuring the ground using airborne laser measurement, a large number of measurement point data with 3D coordinates (hereinafter referred to as a "3D point cloud") are obtained. Here, a "terrain model" is a model generated based on this 3D point cloud, and examples of such models include a digital surface model (DSM) and a digital elevation model (DEM). Typically, a terrain model is composed of small areas (hereinafter referred to as "mesh MS") obtained by dividing the planar area of ​​the measurement target into multiple parts (180 parts in the figure), as shown in Figure 1. These mesh MSs are also called pixels, and are divided into orthogonal grids, for example. Each mesh MS has a representative point assigned an elevation. Because the 3D point cloud obtained by airborne laser measurement is composed of random data (data with an irregular arrangement on a plane), geometric calculations are often used to assign elevations to the representative points of the small areas. Calculation methods include the TIN method, which determines height using an irregular triangulation network formed from random data, the Nearest Neighbor method, which uses the nearest laser measurement point, the Inverse Distance Weighting (IDW) method, the Kriging method, and the averaging method.

[0024] (Ground data) Terrain models generated based on airborne laser measurement typically represent the surface of the ground (e.g., DSM). Here, the surface of an object refers to the top surface of the ground or other objects, such as green cover like farmland or forest, or man-made structures like buildings constructed on the ground. In contrast, "ground data" is data that represents a state without any objects, as shown in Figure 2. In other words, it is data after the objects have been removed from the initial terrain model generated based on airborne laser measurement (hereinafter, specifically referred to as the "original terrain model"). The ground data shown in Figure 2 is a ground model (e.g., DEM) that has been created by removing non-ground data from the original terrain model using automatic filtering, and then performing interpolation on the resulting mesh.

[0025] (Color information and grayscale) Color is inherently perceived visually, and individual perception varies. In recent years, color has begun to be modeled for use on computers. Various color modeling methods exist, including RGB, which uses red, green, and blue as its three primary colors; CMYK, which uses cyan, magenta, yellow, and black as its four primary colors; and the NCS and Ostwald color systems, which use yellow, red, blue, green, black, and white as their six primary colors. Colors have three attributes: hue, saturation, and lightness. For example, RGB expresses various hues, saturations, and lightness by mixing the three primary colors red, green, and blue (additive color mixing). Here, we refer to the values ​​used to identify colors, as defined by color models such as RGB, CMYK, NCS, and the Ostwald color system, as "color information." For example, when RGB is used, the color information of pure red is (255,0,0), the color information of pure green is (0,255,0), and the color information of pure blue is (0,0,255).

[0026] "Grayscale" is a value that specifies the degree of shading in a model that divides the range from white to black into multiple levels. For example, if there are 256 levels from white to black, white can be represented by a grayscale of 255 and black by a grayscale of 0.

[0027] As described above, a terrain model is composed of multiple meshes MS, and each mesh MS is assigned an elevation. Color information or a grayscale may also be set according to the elevation. In other words, in this case, each mesh MS (pixel) that makes up the terrain model can be assigned color information or a grayscale in addition to the elevation. For convenience, a terrain model in which color information or a grayscale is assigned to the mesh MS will be referred to as a "colored terrain model."

[0028] (Removal mesh and maintenance mesh) As mentioned above, when generating ground data based on 3D coordinates, an automatic filtering process is performed on the original terrain model, and then a manual filtering process is performed. For convenience, the data obtained as a result of the automatic filtering process on the original terrain model is referred to as the "intermediate terrain model." In other words, an "intermediate terrain model" is obtained by automatically filtering the "original terrain model," and "ground data" is obtained by manually filtering the "intermediate terrain model."

[0029] In the automatic filtering process, each mesh MS constituting the original terrain model is classified into either a mesh MS representing the ground or a mesh MS that is not ground (non-ground data). Mesh MSs determined to represent ground are left as they are, while mesh MSs determined to represent non-ground data are removed. For convenience, mesh MSs determined to represent ground by the automatic filtering process are referred to as "maintained mesh MSk" and mesh MSs determined to represent non-ground data are referred to as "removed mesh MSe." For example, in Figure 1, of the 180 mesh MSs, 159 are classified as maintained mesh MSk, and the 21 shaded mesh MSs are classified as removed mesh MSe. In general, automatic filtering processes assign new elevations (elevations representing the original ground) to the removed mesh MSe. In other words, elevations are basically assigned to all mesh MSs (maintained mesh MSk and removed mesh MSe) before ground data is generated.

[0030] (Pre-trained model) As mentioned above, automatic filtering can cause "excessive filtering," whereby ground is mistakenly removed as a removed mesh MSe, or "filtering omission," whereby non-ground is retained as a maintained mesh MSk. For example, in the case of Figure 3, non-ground data is removed from the original terrain model by automatic filtering, and interpolation is performed on the removed meshes (e.g., under the levee and under the building on the left). This results in "excessive filtering," whereby the "levee," which is actually ground, is removed but should be retained as a maintained mesh MSk. On the other hand, this results in "filtering omission," whereby the "building," which is a feature, is retained but should be removed as a removed mesh MSe. Therefore, the present invention utilizes machine learning techniques to detect "excessive filtering" and "filtering omission" caused by automatic filtering. In other words, a model generated by machine learning a large amount of training data (teacher data and input data) is used to detect erroneous determinations made by the automatic filtering process. For convenience, the model generated by machine learning will be referred to as the "trained model." In the present invention, various techniques including deep learning can be adopted as machine learning techniques for generating trained models.

[0031] Another technical feature of the present invention is the use of a trained model that processes the removed mesh MSe (hereinafter, specifically referred to as the "over-extracted trained model") and a trained model that processes the maintained mesh MSk (hereinafter, specifically referred to as the "unextracted trained model"). In other words, "excessive filtering" caused by the automatic filtering process is detected by the over-extracted trained model, and "missed filtering" caused by the automatic filtering process is detected by the unextracted trained model. More specifically, the over-extracted trained model assigns a label indicating ground (hereinafter, simply referred to as the "ground label") or a label indicating non-ground (hereinafter, simply referred to as the "non-ground label") to the removed mesh MSe, and the unextracted trained model assigns a ground label or a non-ground label to the maintained mesh MSk.

[0032] (correction area and judgment area) The present invention extracts the area to be subjected to manual filtering by detecting erroneous decisions made by the automatic filtering process. In other words, the target area is extracted by detecting meshes MS that actually represent the ground (hereinafter, specifically referred to as "ground meshes MS") from among the removed meshes MSe classified by the automatic filtering process, and detecting meshes MS that actually do not represent the ground (hereinafter, specifically referred to as "non-ground meshes MS") from among the maintained meshes MSk classified by the automatic filtering process. For convenience, the area to be subjected to manual filtering will be referred to as the "correction area."

[0033] As mentioned above, since ground meshes MS and non-ground meshes MS are detected for each mesh MS, correction areas can be extracted on a mesh MS basis. Alternatively, correction areas can be extracted for each area that groups a certain number of meshes MS together. For convenience, the area used to extract correction areas, i.e., a collection of meshes MS with a predetermined number and arrangement, will be referred to as the "determination area" here. For example, in Figure 1, the determination area is set using meshes MS that are 4 horizontally and 5 vertically, and a total of 9 determination areas are shown.

[0034] 2. Correction area extraction system Next, the correction area extraction system of the present invention will be described in detail with reference to the drawings. Figure 4 is a block diagram showing the main configuration of the correction area extraction system 100 of the present invention. As shown in this figure, the correction area extraction system 100 is configured to include an over-extracted mesh detection means 101 and an unextracted mesh detection means 102, and can also be configured to include an elevation difference calculation means 103, a candidate mesh detection means 104, a correction area setting means 105, an automatic filtering processing means 106, an over-extracted trained model generation means 107, an unextracted trained model generation means 108, a topographical model storage means 109, an over-extracted trained model storage means 110, an unextracted trained model storage means 111, etc.

[0035] The over-extracted mesh detection means 101, un-extracted mesh detection means 102, elevation difference calculation means 103, candidate mesh detection means 104, correction area setting means 105, automatic filtering processing means 106, over-extracted trained model generation means 107, and un-extracted trained model generation means 108 that make up the correction area extraction system 100 can be manufactured as dedicated units, or general-purpose computer devices can be used. That is, the computer device executes arithmetic processing using a predetermined program to perform processing specific to each means. This computer device includes a processor such as a CPU, memory such as ROM and RAM, and some also include input means such as a mouse and keyboard, and a display, and can be configured, for example, as a personal computer (PC) or server.

[0036] Furthermore, the topographical model storage means 109, the over-extracted trained model storage means 110, and the under-extracted trained model storage means 111 can use a storage device of a general-purpose computer (for example, a personal computer) or can be built on a database server. When built on a database server, they can be placed on a local network (LAN: Local Area Network) or can be a cloud server that stores data via the Internet.

[0037] Below, each of the main elements constituting the modified region extraction system 100 of the present invention will be described in detail.

[0038] (Automatic filtering processing means) The automatic filtering processing means 106 is a means for generating an "intermediate terrain model" by automatically filtering the "original terrain model" read from the terrain model storage means 109. For example, the automatic filtering processing means 106 may be a means for performing automatic filtering processing by having a computer device execute calculation processing using a predetermined program. Various conventional (commercially available) programs can be used as this program.

[0039] When the automatic filtering processing means 106 generates an intermediate terrain model, a removed mesh MSe is extracted from the meshes MS that make up the original terrain model. As described above, in the automatic filtering process, a new elevation (an elevation representing the original ground) is assigned to the removed mesh MSe. In other words, for the removed mesh MSe extracted by the automatic filtering processing means 106, an elevation (in the original terrain model) before filtering (hereinafter referred to as "original elevation") and an elevation (in the intermediate terrain model) after filtering (hereinafter referred to as "new elevation") are set.

[0040] (Elevation difference calculation means) The elevation difference calculation means 103 is a means for calculating the difference between the original elevation and the new elevation of the removed mesh MSe (hereinafter referred to as "elevation difference"). This elevation difference can be calculated by subtracting the new elevation from the original elevation, or by subtracting the original elevation from the new elevation, or by calculating the absolute value of the difference between the original elevation and the new elevation. The elevation difference calculation means 103 calculates the elevation difference for all removed meshes MSe extracted by the automatic filtering processing means 106.

[0041] (Method for generating over-extracted trained models) The over-extraction trained model generation means 107 is a means for generating an "over-extraction trained model" by machine learning the combination of the removed mesh MSe and its elevation. Specifically, the means selects the removed mesh MSe to which a "ground label" has been assigned by manual filtering (i.e., the removed mesh MSe when the judgment of the automatic filtering process is incorrect), and prepares "positive training data" consisting of the "ground label (teaching data)" and its "elevation (input data)." The means also selects the removed mesh MSe to which a "non-ground label" has been assigned by manual filtering (i.e., the removed mesh MSe when the judgment of the automatic filtering process is correct), and prepares "negative training data" consisting of the "non-ground label (teaching data)" and its "elevation (input data)." The means then performs machine learning on a large amount of training data to generate an "over-extraction trained model."

[0042] The over-extraction trained model generation means 107 can also be a means for generating an over-extraction trained model using an "elevation difference" instead of the elevation of the removed mesh MSe. That is, machine learning is performed after the combination of the "ground label (teacher data)" and the "elevation difference (input data)" attached to the removed mesh MSe is set as "positive training data," and the combination of the "non-ground label (teacher data)" and the "elevation difference (input data)" attached to the removed mesh MSe is set as "negative training data."

[0043] The over-extraction trained model generation means 107 can also be a means for generating an over-extraction trained model using "grayscale" or "color information" in addition to the removed mesh MSe and elevation (or elevation difference). That is, machine learning is performed by using the combination of the "ground label (teacher data)" attached to the removed mesh MSe and the "elevation or elevation difference, and grayscale or color information (input data)" as "positive training data," and the combination of the "non-ground label (teacher data)" attached to the removed mesh MSe and the "elevation or elevation difference, and grayscale or color information (input data)" as "negative training data."

[0044] Furthermore, the over-extraction trained model generation means 107 can also be used to generate an over-extraction trained model using "grayscale" or "color information" instead of the elevation (or elevation difference) of the removed mesh MSe. In other words, the combination of the "ground label (trainer data)" attached to the removed mesh MSe and the "grayscale or color information (input data)" is used as "positive training data," and the combination of the "non-ground label (trainer data)" attached to the removed mesh MSe and the "grayscale or color information (input data)" is used as "negative training data," and then machine learning is performed. The over-extraction trained model generated by the over-extraction trained model generation means 107 is stored in the over-extraction trained model storage means 110 (Figure 4).

[0045] (Means for generating unextracted trained models) The unextracted trained model generation means 108 is a means for generating an "unextracted trained model" by machine learning the combination of the maintained mesh MSk and its elevation. Specifically, it selects a maintained mesh MSk that has been assigned a "non-ground label" (i.e., a maintained mesh MSk when the automatic filtering process has made an incorrect decision) and prepares "positive training data" consisting of that "non-ground label (teaching data)" and its "elevation (input data)", and also selects a maintained mesh MSk that has been assigned a "ground label" (i.e., a maintained mesh MSk when the automatic filtering process has made a correct decision) and prepares "negative training data" consisting of that "non-ground label (teaching data)" and its "elevation (input data)", and then generates an "unextracted trained model" by machine learning a large amount of training data.

[0046] The unextracted trained model generation means 108 can also be a means for generating an unextracted trained model using "color information" and "grayscale" in addition to the maintained mesh MSk and elevation. That is, machine learning is performed by using the combination of the "non-ground label (teacher data)" attached to the maintained mesh MSk and the "elevation, and grayscale and color information (input data)" as "positive training data," and the combination of the "ground label (teacher data)" attached to the maintained mesh MSk and the "elevation, and grayscale and color information (input data)" as "negative training data."

[0047] The unextracted trained model generating means 108 can also be used to generate an unextracted trained model using "color information" or "grayscale" instead of the elevation of the maintained mesh MSk. In other words, the combination of the "non-ground label (teacher data)" attached to the maintained mesh MSk and the "grayscale or color information (input data)" is considered to be "positive training data," and the combination of the "ground label (teacher data)" attached to the maintained mesh MSk and the "elevation, and grayscale or color information (input data)" is considered to be "negative training data," and then machine learning is performed. The unextracted trained model generated by the unextracted trained model generating means 108 is stored in the unextracted trained model storage means 111 (Figure 4).

[0048] (Mechanism for detecting over-extracted meshes) The over-extracted mesh detection means 101 is a means for assigning either a ground label or a non-ground label to the removed mesh MSe by inputting a combination of the removed mesh MSe extracted by the automatic filtering processing means 106, its elevation, elevation difference, and grayscale (color information) into an over-extraction trained model.The over-extracted mesh detection means 101 then extracts the removed mesh MSe to which the ground label has been assigned as a "ground mesh MS."

[0049] (Method for detecting unextracted meshes) The unextracted mesh detection means 102 is a means for assigning either a non-ground label or a ground label to the maintained mesh MSk by inputting a combination of the maintained mesh MSk extracted by the automatic filtering processing means 106 and its elevation and grayscale (color information) into an unextracted trained model.The unextracted mesh detection means 102 then extracts the maintained mesh MSk to which the non-ground label has been assigned as a "non-ground mesh MS."

[0050] (Candidate mesh detection means) The candidate mesh detection means 104 is a means for detecting meshes MS (hereinafter referred to as "candidate meshes") that make up the correction area. Specifically, it detects the "ground mesh MS (removed mesh MSe with a ground label)" extracted by the over-extracted mesh detection means 101 and the "non-ground mesh MS (maintained mesh MSk with a non-ground label)" extracted by the unextracted mesh detection means 102 as candidate meshes.

[0051] (Correction area setting means) The correction region setting means 105 is a means for setting a "correction region" based on the candidate meshes detected by the candidate mesh detection means 104. The correction region setting means 105 can be configured to set a correction region on a mesh MS basis, i.e., to set all candidate meshes as correction regions. Alternatively, the correction region can be set for each "determination region." In this case, when the proportion of candidate meshes in the determination region exceeds (or is equal to or greater than) a predetermined threshold (hereinafter referred to as the "proportion threshold"), the determination region can be set as a correction region. For example, in FIG. 1, the determination region is composed of 20 meshes MS. If the proportion threshold is set to 25%, the correction region setting means 105 will set a determination region that includes more than 5 candidate meshes (or 5 or more) as a correction region.

[0052] 3. Working Example Next, an embodiment of the correction region extraction system 100 of the present invention will be described in detail with reference to the drawings. The correction region extraction system 100 of the present invention can be broadly divided into an embodiment in which a trained model is generated using the elevation related to the removed mesh MSe (hereinafter referred to as the "first embodiment"), an embodiment in which a trained model is generated using the elevation difference related to the removed mesh MSe (hereinafter referred to as the "second embodiment"), and an embodiment in which a trained model is generated using color information (or grayscale) related to the removed mesh MSe and the maintained mesh MSk (hereinafter referred to as the "third embodiment"). Each embodiment will be described in turn below.

[0053] (First Example) FIG. 5 is a flow diagram showing an example of the main processing flow of the correction area extraction system 100 in the first embodiment, in which the central column shows the processing to be performed, the left column shows what is necessary for that processing, and the right column shows what results from that processing.

[0054] In the first embodiment, the over-extraction trained model generation means 107 generates an "over-extraction trained model" by machine learning a combination of the removed mesh MSe and its elevation. Specifically, "positive training data" consisting of the "ground label (teacher data)" attached to the removed mesh MSe and its "elevation (input data)" is prepared, and "negative training data" consisting of the "non-ground label (teacher data)" attached to the removed mesh MSe and its "elevation (input data)" is prepared, and the over-extraction trained model is generated by machine learning a large amount of training data.

[0055] In this case, the unextracted trained model generation means 108 generates an "unextracted trained model" by machine learning the combination of the maintained mesh MSk and its elevation. Specifically, "positive training data" consisting of a "non-ground label (teacher data)" attached to the maintained mesh MSk and its "elevation (input data)" is prepared, and "negative training data" consisting of a "ground label (teacher data)" attached to the maintained mesh MSk to which a "ground label" has been attached and its "elevation (input data)" is prepared, and an unextracted trained model is generated by machine learning a large amount of training data.

[0056] Once the over-extraction trained model and the under-extraction trained model have been generated, an automatic filtering process is first performed, as shown in FIG. 5 (Step 211 in FIG. 5). Specifically, an "intermediate terrain model" is generated by using the automatic filtering processing means 106 to perform automatic filtering on the "original terrain model" read from the terrain model storage means 109. At this time, removed meshes MSe are extracted from the meshes MS that make up the original terrain model, and new elevations (elevations representing the original ground) are assigned to the removed meshes MSe. Then, meshes MS that are not selected as removed meshes MSe are selected as maintained meshes MSk. In other words, the meshes MS that make up the original terrain model are classified into removed meshes MSe and maintained meshes MSk by the automatic filtering process.

[0057] When the automatic filtering processing means 106 classifies the removed mesh MSe and the maintained mesh MSk, the over-extracted mesh detection means 101 assigns a ground label or a non-ground label to the removed mesh MSe (Step 212 in FIG. 5). Specifically, the combination of the removed mesh MSe and the elevation extracted by the automatic filtering processing means 106 is input into the over-extraction trained model, whereby the removed mesh MSe is assigned either a ground label or a non-ground label. Then, the removed mesh MSe to which the ground label has been assigned is extracted as a "ground mesh MS."

[0058] Next, the unextracted mesh detection means 102 assigns a ground label or a non-ground label to the maintained mesh MSk (Step 213 in FIG. 5). Specifically, the combination of the maintained mesh MSk and the elevation extracted by the automatic filtering processing means 106 is input into the unextracted trained model, thereby assigning either a non-ground label or a ground label to the maintained mesh MSk. Then, the maintained mesh MSk to which the non-ground label has been assigned is extracted as a "non-ground mesh MS."

[0059] When the over-extracted mesh detection means 101 extracts a ground mesh MS and the unextracted mesh detection means 102 extracts a non-ground mesh MS, the candidate mesh detection means 104 detects the ground mesh MS and the non-ground mesh MS as "candidate meshes" (Step 214 in Fig. 5). Then, the correction area setting means 105 sets a "correction area" based on the candidate meshes detected by the candidate mesh detection means 104 (Step 215 in Fig. 5). For example, a determination area in which the proportion of the candidate meshes exceeds a proportion threshold is extracted and set as the correction area. Once the correction area is set, the operator generates "ground data" by performing manual filtering on the correction area (Step 216 in Fig. 5).

[0060] In the first embodiment, an over-extraction trained model or an under-extraction trained model generated using "grayscale" or "color information" in addition to elevation can also be used. In this case, the over-extraction trained model generation means 107 defines the combination of the "ground label (teacher data)" attached to the removed mesh MSe and its "elevation, and grayscale or color information (input data)" as "positive training data," and the combination of the "non-ground label (teacher data)" attached to the removed mesh MSe and its "elevation, and grayscale or color information (input data)" as "negative training data," and then performs machine learning to generate an over-extraction trained model. In addition, the unextracted trained model generation means 108 defines the combination of the ``non-ground label (teacher data)'' attached to the maintenance mesh MSk and its ``elevation, and grayscale or color information (input data)'' as ``positive training data,'' and defines the combination of the ``ground label (teacher data)'' attached to the maintenance mesh MSk and its ``elevation, and grayscale or color information (input data)'' as ``negative training data,'' and then performs machine learning to generate an unextracted trained model.

[0061] Then, by inputting the combination of the removed mesh MSe extracted by the automatic filtering processing means 106, the elevation, and the grayscale (color information) into an over-extraction trained model, the removed mesh MSe is assigned either a ground label or a non-ground label, and the removed mesh MSe assigned the ground label is extracted as a "ground mesh MS." Also, by inputting the combination of the maintained mesh MSk extracted by the automatic filtering processing means 106, the elevation, and the color information (grayscale) into an unextraction trained model, the maintained mesh MSk is assigned either a non-ground label or a ground label, and the maintained mesh MSk assigned the non-ground label is extracted as a "non-ground mesh MS."

[0062] (Second Example) FIG. 6 is a flow diagram showing an example of the main processing flow of the correction area extraction system 100 in the second embodiment, in which the central column shows the processing to be performed, the left column shows what is necessary for that processing, and the right column shows what results from that processing.

[0063] In the second embodiment, the over-extraction trained model generation means 107 generates an "over-extraction trained model" by machine learning the combination of the removed mesh MSe and its elevation difference. Specifically, "positive training data" consisting of the "non-board label (teacher data)" attached to the removed mesh MSe and its "elevation difference (input data)" is prepared, and "negative training data" consisting of the "board label (teacher data)" attached to the removed mesh MSe and its "elevation difference (input data)" is prepared, and the over-extraction trained model is generated by machine learning a large amount of training data. In addition, the unextraction trained model generation means 108 in this case generates an "unextraction trained model" by machine learning the combination of the maintained mesh MSk and its elevation, as in the first embodiment.

[0064] Once the over-extraction trained model and the un-extraction trained model have been generated, as in the first embodiment, as shown in FIG. 6, automatic filtering processing is first performed (Step 221 in FIG. 6). Once the automatic filtering processing means 106 has classified the removed mesh MSe and the maintained mesh MSk, the elevation difference calculation means 103 calculates the "elevation difference" for the removed mesh MSe (Step 222 in FIG. 6). Then, the over-extraction mesh detection means 101 assigns a ground label or a non-ground label to the removed mesh MSe (Step 223 in FIG. 6). Specifically, the combination of the removed mesh MSe and the elevation difference extracted by the automatic filtering processing means 106 is input into the over-extraction trained model, thereby assigning either a ground label or a non-ground label to the removed mesh MSe. Then, the removed mesh MSe to which the ground label has been assigned is extracted as a "ground mesh MS."

[0065] Next, as in the first embodiment, the unextracted mesh detection means 102 assigns a ground label or a non-ground label to the maintained mesh MSk (Step 224 in Fig. 6). When the over-extracted mesh detection means 101 extracts a ground mesh MS and the unextracted mesh detection means 102 extracts a non-ground mesh MS, the candidate mesh detection means 104 detects the ground mesh MS and the non-ground mesh MS as "candidate meshes" (Step 225 in Fig. 6), and the correction area setting means 105 sets a "correction area" based on the candidate meshes detected by the candidate mesh detection means 104 (Step 226 in Fig. 6). Once the correction area has been set, the operator performs manual filtering on the correction area to generate "ground data" (Step 227 in Fig. 6).

[0066] As in the first embodiment, the second embodiment can also use an over-extracted trained model or an under-extracted trained model generated using "grayscale" or "color information" in addition to elevation and elevation difference. In this case, the over-extracted trained model generation means 107 defines the combination of the "ground label (teacher data)" attached to the removed mesh MSe and the "elevation difference, and grayscale or color information (input data)" as "positive training data," and defines the combination of the "non-ground label (teacher data)" attached to the removed mesh MSe and the "elevation difference, and grayscale or color information (input data)" as "negative training data," and then performs machine learning to generate an over-extracted trained model. In addition, the unextracted trained model generation means 108 defines the combination of the ``non-ground label (teacher data)'' attached to the maintained mesh MSk and the ``elevation difference, and grayscale or color information (input data)'' as ``positive training data,'' and the combination of the ``ground label (teacher data)'' attached to the maintained mesh MSk and the ``elevation difference, and grayscale or color information (input data)'' as ``negative training data,'' and then performs machine learning to generate an unextracted trained model.

[0067] Then, by inputting the combination of the removed mesh MSe extracted by the automatic filtering processing means 106, the elevation difference, and the grayscale (color information) into an over-extraction trained model, the removed mesh MSe is assigned either a ground label or a non-ground label, and the removed mesh MSe assigned the ground label is extracted as a "ground mesh MS." Also, by inputting the combination of the maintained mesh MSk extracted by the automatic filtering processing means 106, the elevation, and the color information (grayscale) into an unextraction trained model, the maintained mesh MSk is assigned either a non-ground label or a ground label, and the maintained mesh MSk assigned the non-ground label is extracted as a "non-ground mesh MS."

[0068] (Third Example) FIG. 7 is a flow diagram showing an example of the main processing flow of the correction area extraction system 100 in the third embodiment, in which the central column shows the processing to be performed, the left column shows what is necessary for that processing, and the right column shows what results from that processing.

[0069] In the third embodiment, the over-extraction trained model generation means 107 generates an "over-extraction trained model" by machine learning a combination of the removed mesh MSe and color information and grayscale. Specifically, "positive training data" consisting of a "ground label (teacher data)" attached to the removed mesh MSe and "grayscale and color information based on elevation (input data)" is prepared, and "negative training data" consisting of a "non-ground label (teacher data)" attached to the removed mesh MSe and "grayscale and color information based on elevation (input data)" is prepared. Then, the over-extraction trained model is generated by machine learning a large amount of training data.

[0070] In this case, the unextracted trained model generation means 108 generates an "unextracted trained model" by machine learning the combination of the maintained mesh MSk and the color information or grayscale. Specifically, the combination of the "non-ground label (teacher data)" attached to the maintained mesh MSk and the "color information or grayscale based on elevation (input teacher data)" is defined as "positive training data," and the combination of the "ground label (teacher data)" attached to the maintained mesh MSk and the "color information or grayscale based on elevation (input teacher data)" is defined as "negative training data," and an unextracted trained model is generated by machine learning a large amount of training data.

[0071] Once the over-extraction trained model and the un-extraction trained model have been generated, as in the first and second embodiments, as shown in FIG. 7, an automatic filtering process is first performed (Step 231 in FIG. 7). Once the automatic filtering processing means 106 has classified the removed mesh MSe and the maintained mesh MSk, the over-extraction mesh detection means 101 assigns a ground label or a non-ground label to the removed mesh MSe (Step 232 in FIG. 7). Specifically, the combination of the removed mesh MSe extracted by the automatic filtering processing means 106 and grayscale (color information) is input into the over-extraction trained model, thereby assigning either a ground label or a non-ground label to the removed mesh MSe. Then, the removed mesh MSe to which the ground label has been assigned is extracted as a "ground mesh MS."

[0072] Next, the unextracted mesh detection means 102 assigns a ground label or a non-ground label to the maintained mesh MSk (Step 233 in FIG. 7). Specifically, the combination of the maintained mesh MSk extracted by the automatic filtering processing means 106 and color information (grayscale) is input into the unextracted trained model, thereby assigning either a non-ground label or a ground label to the maintained mesh MSk. Then, the maintained mesh MSk to which the non-ground label has been assigned is extracted as a "non-ground mesh MS."

[0073] When the over-extracted mesh detection means 101 extracts a ground mesh MS and the unextracted mesh detection means 102 extracts a non-ground mesh MS, the candidate mesh detection means 104 detects the ground mesh MS and the non-ground mesh MS as "candidate meshes" (Step 234 in Fig. 7), and the correction area setting means 105 sets a "correction area" based on the candidate meshes detected by the candidate mesh detection means 104 (Step 235 in Fig. 7). Once the correction area is set, the operator performs manual filtering on the correction area to generate "ground data" (Step 236 in Fig. 7). [Industrial Applicability]

[0074] The correction area extraction system of the present invention can be used to obtain ground elevations in various locations, such as mountainous areas, coastal areas, and urban areas, and is particularly suitable for use in locations with forests. Since the present invention can obtain ground elevations with high accuracy, it can be effectively used in planning social infrastructure and disaster prevention plans, and is an invention that can be expected to not only be used industrially but also make a significant contribution to society. [Explanation of symbols]

[0075] 100 Correction area extraction system of the present invention 101 (Revised Region Extraction System) Over-extracted Mesh Detection Method 102 (of the corrected region extraction system) Unextracted mesh detection means 103 (corrected area extraction system) altitude difference calculation means 104 (of the modified region extraction system) candidate mesh detection means 105 (of the correction area extraction system) correction area setting means 106 Automatic filtering processing means (of the correction region extraction system) 107 (Revised Region Extraction System) Over-extraction Trained Model Generation Means 108 (of the correction region extraction system) Unextracted trained model generation means 109 Terrain model storage means (for the modified area extraction system) 110 (of the corrected region extraction system) over-extraction trained model storage means 111 (of the correction region extraction system) Unextracted trained model storage means MS Mesh MSe removal mesh MSk Maintenance Mesh

Claims

1. A system for automatically extracting a correction area to be subjected to manual filtering processing when generating ground data based on a terrain model, comprising: The terrain model generated based on the airborne laser measurement is composed of a plurality of meshes, and each of the meshes is assigned an elevation; an over-extracted mesh detection means for inputting the removed meshes and their elevations, which are removed by automatically filtering the terrain model, into an over-extracted trained model, thereby assigning a ground label or a non-ground label to the removed meshes; an unextracted mesh detection means for inputting the maintained meshes and elevations that have not been excluded by automatically filtering the terrain model into an unextracted trained model, thereby assigning the ground label or the non-ground label to the maintained meshes; The over-extraction trained model is generated by machine learning the removed mesh and elevation to which the ground label or the non-ground label is attached, The unextracted trained model is generated by machine learning the maintained mesh and elevation to which the ground label or the non-ground label is attached, The removed meshes to which the ground labels have been assigned by the over-extracted mesh detection means and the maintained meshes to which the non-ground labels have been assigned by the unextracted mesh detection means are defined as the correction region. A correction region extraction system comprising:

2. A system for automatically extracting a correction area to be subjected to manual filtering processing when generating ground data based on a terrain model, comprising: The terrain model generated based on the airborne laser measurement is composed of a plurality of meshes, and each of the meshes is assigned an elevation; an elevation difference calculation means for calculating an elevation difference between the elevation of a removed mesh that has been removed by automatically filtering the terrain model and the elevation of ground data generated after the removed mesh has been removed; an over-extracted mesh detection means for assigning a ground label or a non-ground label to the removed mesh by inputting the removed mesh and the elevation difference into an over-extracted trained model; an unextracted mesh detection means for inputting the maintained meshes and elevations that have not been excluded by automatically filtering the terrain model into an unextracted trained model, thereby assigning the ground label or the non-ground label to the maintained meshes; the over-extraction trained model is generated by machine learning the removed meshes labeled with the ground labels or the non-ground labels and the elevation differences; The unextracted trained model is generated by machine learning the maintained mesh and elevation to which the ground label or the non-ground label is attached, The removed meshes to which the ground labels have been assigned by the over-extracted mesh detection means and the maintained meshes to which the non-ground labels have been assigned by the unextracted mesh detection means are defined as the correction region. A correction region extraction system comprising:

3. The meshes constituting the terrain model are assigned grayscale or color information that is set according to altitude, the over-extraction mesh detection means assigns the ground label or the non-ground label to the removed mesh by inputting the grayscale or the color information related to the removed mesh into the over-extraction trained model; The unextracted mesh detection means assigns the ground label or the non-ground label to the maintenance mesh by inputting the grayscale or the color information related to the maintenance mesh into the unextracted trained model; the over-extraction trained model is generated by machine learning the grayscale or the color information related to the removed meshes labeled with the ground label or the non-ground label, The unextracted trained model is generated by machine learning the grayscale or the color information related to the maintenance mesh to which the ground label or the non-ground label is attached.

3. The system for extracting a correction area according to claim 1.

4. A system for automatically extracting a correction area to be subjected to manual filtering processing when generating ground data based on a terrain model, comprising: the terrain model generated based on the airborne laser measurement is composed of a plurality of meshes, and each mesh is assigned grayscale or color information set according to altitude; an over-extracted mesh detection means for inputting the removed meshes that have been removed by automatic filtering of the terrain model and the grayscale or color information into an over-extraction trained model, thereby assigning a ground label or a non-ground label to the removed meshes; an unextracted mesh detection means for inputting the maintained meshes that have not been removed by automatically filtering the terrain model and the grayscale or color information into an unextracted trained model, thereby assigning the ground label or the non-ground label to the maintained meshes; the over-extraction trained model is generated by machine learning the removed mesh to which the ground label or the non-ground label is attached and the grayscale or the color information; The unextracted trained model is generated by machine learning the maintained mesh to which the ground label or the non-ground label is attached and the grayscale or the color information, The removed meshes to which the ground labels have been assigned by the over-extracted mesh detection means and the maintained meshes to which the non-ground labels have been assigned by the unextracted mesh detection means are defined as the correction region. A correction region extraction system comprising:

5. a candidate mesh detection means for determining, as correction candidate meshes, the removed meshes to which the ground labels have been assigned by the over-extracted mesh detection means and the maintained meshes to which the non-ground labels have been assigned by the unextracted mesh detection means; and a correction region setting means for setting a predetermined judgment region as the correction region when the proportion of the correction candidate mesh in the predetermined judgment region exceeds a predetermined proportion threshold.

5. The system for extracting a modified region according to claim 1, claim 2, or claim 4.

Images