Point cloud information conversion device, point cloud information conversion method, and program

Abstract

To provide a point cloud information conversion apparatus, and the like, capable of reducing the time required for transmitting / receiving information indicating a class of point cloud.SOLUTION: A point cloud information conversion apparatus includes: an acquisition unit which acquires, in a predetermined coordinate space, point cloud information including coordinate information indicating positions of a plurality of constitution points indicative of shapes of a land surface and a feature, and class information indicating results of classifying the constitution points based on types of objects represented by the constitution points; a setting unit which sets a plurality of regions in the coordinate space; and a conversion unit which selects, from among the regions, a single class region including the constitution points having the same class, and converts the class information into region class information which does not include identification information of the classes of the constitution points included in the single class region and which is configured so that identification information of the single class region is associated with the identification information of the classes of the constitution points included in the single class region.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to a point cloud information conversion device, a point cloud information conversion method, and a program. [Background technology]

[0002] There is known a technique for estimating the shape of an object based on point cloud data acquired by LiDAR (Light Detection and Ranging) measurement or the like. For example, a DSM (Digital Surface Model) and a DEM (Digital Elevation Model) showing the shapes of features and the earth's surface are generated based on point cloud data acquired by airborne laser surveying. In shape estimation based on point cloud data, it is required to appropriately classify the point cloud according to the type of object indicated by the point cloud data. Patent Document 1 describes a method for extracting a road surface candidate point cloud showing a road surface from point cloud data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-173749 A Summary of the Invention [Problem to be solved by the invention]

[0004] A point cloud is classified by setting a class for the type of object (e.g., ground surface, building, noise, etc.) indicated by each of the constituent points that make up the point cloud data. The classes are set automatically by a device such as that described in Patent Document 1, and an operator checks whether the classes have been set appropriately. The classes may also be set entirely manually by an operator. In either case, the point cloud data needs to be transferred between the administrator of the point cloud data and the operator who sets the classes.

[0005] Point cloud data has a large data volume and it takes a long time to transmit it over a network. Therefore, there is a demand for reducing the time required to transmit and receive data between the operator who sets the point cloud classes and the data.

[0006] For example, in the case where a component point of a building class is near a component point of a building class, there are many other component points of the building class, and so on, spatial uneven distribution is generally recognized in the class information of the component points contained in the point cloud data. The inventors have focused on this spatial uneven distribution of class information and invented a method for reducing the amount of data transmitted and received by omitting class information for some of the component points.

[0007] An object of the present invention is to provide a point cloud information conversion device, a point cloud information conversion method, and a program that make it possible to shorten the time required to transmit and receive information indicating a point cloud class. [Means for solving the problem]

[0008] A point cloud information conversion device according to an embodiment of the present invention is characterized in having an acquisition unit that acquires, in a predetermined coordinate space, point cloud information including coordinate information indicating the positions of a plurality of constituent points that indicate the shape of the earth's surface and features, and class information indicating a classification result of each constituent point based on the type of thing that each constituent point indicates; a setting unit that sets a plurality of areas in the coordinate space; and a conversion unit that selects, from the plurality of areas, a single-class area in which all included constituent points have the same class, and converts the class information into area class information that does not include class identification information of each constituent point included in the single-class area, and in which the identification information of the single-class area corresponds to the identification information of the class of the constituent points included in the single-class area.

[0009] In addition, it is preferable that the conversion unit selects a multiple class area including two or more types of constituent points from among the multiple areas, specifies a domain most frequent class having the largest number of corresponding constituent points from among the classes of the constituent points included in the multiple class area, and converts the class information such that the class identification information of the constituent points of the domain most frequent class among the constituent points included in the multiple class area is omitted.

[0010] Moreover, it is preferable that the setting unit sets the multiple regions such that the multiple regions include at least one single-class region.

[0011] In addition, it is preferable that the setting unit sets the multiple regions by identifying a most frequent class corresponding to the largest number of constituent points from among the classes of the multiple constituent points, calculating an approximation plane of the constituent points of the most frequent class, and calculating a plane parallel to the approximation plane as a separation plane separating the multiple regions.

[0012] In addition, it is preferable that the setting unit calculates, as the separation plane, a plane that passes through a component point of a class other than the most frequent class that is closest to the approximation plane in a predetermined coordinate axis direction of the coordinate space and is parallel to the approximation plane.

[0013] Furthermore, it is preferable that, when the inclination of the calculated separation plane satisfies a predetermined condition, the setting section calculates a horizontal plane as the separation plane instead of the calculated separation plane.

[0014] In addition, it is preferable that the point cloud information conversion device further has a classification unit that classifies the constituent points included in the point cloud information into a plurality of groups based on coordinate information of each constituent point, the setting unit sets a plurality of areas in each group, and the conversion unit identifies a single-class area for each group and converts the class information of the constituent points included in the single-class area into area class information.

[0015] A point cloud information conversion method according to an embodiment of the present invention is characterized in that it includes the steps of: acquiring point cloud information in a predetermined coordinate space in which coordinate information indicating the positions of a plurality of constituent points indicating the shape of the earth's surface and features is associated with class information indicating a classification result of each constituent point based on the type of thing that each constituent point indicates; setting a plurality of areas in the coordinate space; selecting a single-class area from the plurality of areas in which all included constituent points have the same class; and converting the class information into area class information that does not include class identification information of each constituent point included in the single-class area, and in which the identification information of the single-class area is associated with the identification information of the class of the constituent points included in the single-class area.

[0016] A program according to an embodiment of the present invention is characterized in that it causes a computer to execute the following steps: acquire point cloud information in a specified coordinate space in which coordinate information indicating the positions of a plurality of constituent points indicating the shape of the earth's surface and features is associated with class information indicating a classification result of each constituent point based on the type of thing that each constituent point indicates; set a plurality of areas in the coordinate space; select from the plurality of areas a single-class area in which all included constituent points have the same class; and convert the class information into area class information that does not include class identification information of each constituent point included in the single-class area, and in which the identification information of the single-class area is associated with the identification information of the class of the constituent points included in the single-class area. Effect of the Invention

[0017] The point cloud information conversion device, point cloud information conversion method, and program according to the present invention make it possible to reduce the time required to transmit and receive information indicating a point cloud class. [Brief description of the drawings]

[0018] [Figure 1] 1 is a schematic diagram showing an example of a schematic configuration of a transmission / reception system 1. FIG. [Diagram 2] 2 is an exemplary functional block diagram of a management device 2. FIG. [Diagram 3] 2 is an exemplary functional block diagram of an editing device 3. FIG. [Figure 4] 11 is a diagram showing an example of the data structure of a point cloud information table T1. FIG. [Diagram 5] 13 is a diagram illustrating an example of the data structure of a class information table T2. [Figure 6] 11 is a sequence diagram illustrating an example of the flow of a class information setting process. [Figure 7] FIG. 11 is a flow diagram showing an example of the flow of a conversion process. [Figure 8] FIG. 13 is a schematic diagram for explaining an example of classification of composition points. [Figure 9] FIG. 13 is a schematic diagram for explaining a result of rearrangement of configuration points. [Figure 10] FIG. 11 is a schematic diagram for explaining coding class information. [Figure 11] FIG. 11 is a flowchart showing an example of the flow of an area setting process. [Figure 12] FIG. 11 is a schematic diagram for explaining normalization of coordinate information. [Figure 13] 11A and 11B are schematic diagrams for explaining calculation of a lower separation surface and an upper separation surface. [Figure 14] 13 is a schematic diagram for explaining calculation of an additional separation surface. FIG. [Figure 15] 11 is a diagram showing an example of the data structure of converted data D generated by a conversion process. FIG. [Figure 16] 11 is a diagram showing an example of the data structure of information E regarding the classes of configuration points included in a multiple class area. FIG. [Figure 17] FIG. 11 is a flow diagram showing an example of the flow of an association process. [Figure 18] 11A and 11B are schematic diagrams for explaining calculation of a lower separation surface and an upper separation surface having mutually different inclinations. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Hereinafter, various embodiments of the present invention will be described with reference to the drawings. It should be noted that the technical scope of the present invention is not limited to these embodiments, but covers the inventions described in the claims and their equivalents.

[0020] FIG. 1 is a diagram showing an example of a schematic configuration of a transmission / reception system 1 according to an embodiment of the present invention. The transmission / reception system 1 transmits and receives class information between a management base that manages point cloud information and an editing base that sets class information indicating a classification result of constituent points included in the point cloud information. The point cloud information includes coordinate information indicating the positions of a plurality of constituent points that indicate the shape of the earth's surface and buildings in a predetermined coordinate space. The class information indicates a classification result of each constituent point based on the type of object that each constituent point indicates. The transmission / reception system 1 has a management device 2 installed at the management base and an editing device 3 installed at the editing base. The management device 2 and the editing device 3 communicate with each other via a network N that is the Internet or an intranet. The management device 2 and the editing device 3 are examples of a receiving device and a transmitting device.

[0021] 2 is an exemplary functional block diagram of the management device 2. The management device 2 is a computer such as a server, a PC (Personal Computer), a tablet terminal, or a smartphone. The management device 2 transmits point cloud information to the editing device 3. The management device 2 also receives class information indicating the class of the configuration points included in the point cloud information from the editing device 3, and associates the class information with the configuration points. The management device 2 has a storage unit 21, a communication unit 22, and a processing unit 23.

[0022] The storage unit 21 is configured to store programs and data, and includes, for example, a semiconductor memory. The storage unit 21 stores, as programs, an operating system program, a driver program, an application program, and the like used in processing by the processing unit 23. The programs are installed in the storage unit 21 from a computer-readable, non-transitory, portable storage medium such as a CD-ROM (Compact Disc Read Only Memory) or a DVD-ROM (Digital Versatile Disc Read Only Memory).

[0023] The communication unit 22 is configured to enable the management device 2 to communicate with other devices, and includes a communication interface circuit. The communication interface circuit is a communication interface circuit for a wired LAN (Local Area Network) or a wireless LAN. The communication unit 22 receives data from other devices and supplies the data to the processing unit 23, and transmits data supplied from the processing unit 23 to other devices.

[0024] The processing unit 23 is configured to comprehensively control the operation of the management device 2, and includes one or more processors and their peripheral circuits. The processing unit 23 includes, for example, a CPU (Central Processing Unit). The processing unit 23 may include a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or the like. The processing unit 23 controls the operation of each component and executes various processes so that the various processes of the management device 2 are executed in an appropriate order based on the programs stored in the storage unit 21.

[0025] The processing unit 23 has, as functional blocks, a transmitting unit 231, a receiving unit 232, and an associating unit 233. These functional blocks are functional modules that are realized by the processing unit 23 executing a program. Each of these units may be implemented in the management device 2 as a dedicated processing circuit.

[0026] 3 is an exemplary functional block diagram of the editing device 3. The editing device 3 is a computer such as a PC, a tablet terminal, or a smartphone. The editing device 3 receives point cloud information from the management device 2. The editing device 3 also sets class information indicating a class of a configuration point included in the point cloud information, and transmits the class information to the management device 2. The editing device 3 has a storage unit 31, a communication unit 32, a display unit 33, an operation unit 34, and a processing unit 35.

[0027] The storage unit 31 is configured to store programs and data, and includes, for example, a semiconductor memory. The storage unit 31 stores, as programs, an operating system program, a driver program, an application program, and the like used in processing by the processing unit 35. The programs are installed in the storage unit 31 from a computer-readable, non-transitory, portable storage medium such as a CD-ROM or a DVD-ROM.

[0028] The communication unit 32 is configured to enable the editing device 3 to communicate with other devices, and includes a communication interface circuit. The communication interface circuit is a communication interface circuit for a wired LAN (Local Area Network) or a wireless LAN. The communication unit 32 receives data from other devices and supplies the data to the processing unit 35, and transmits data supplied from the processing unit 35 to other devices.

[0029] The display unit 33 is a component for displaying an image, and includes a display such as a liquid crystal display or an organic EL (Electro-Luminescence) display. The display unit 33 displays an image based on the display data supplied from the processing unit 35.

[0030] The operation unit 34 is configured to receive operations for the editing device 3, and includes input devices such as a keyboard, a keypad, and a mouse. The operation unit 34 may include a touch panel integrated with the display unit 33. The operation unit 34 supplies a signal corresponding to the received operation to the processing unit 35.

[0031] The processing unit 35 is configured to comprehensively control the operation of the editing device 3, and includes one or more processors and their peripheral circuits. The processing unit 35 includes, for example, a CPU. The processing unit 23 may include a GPU, a DSP, an LSI, an ASIC, an FPGA, or the like. The processing unit 35 controls the operation of each component and executes various processes so that various processes of the editing device 3 are executed in an appropriate order based on the programs stored in the storage unit 31.

[0032] The processing unit 35 has, as functional blocks, a receiving unit 351, a generating unit 352, a transmitting unit 353, a classifying unit 354, a setting unit 355, and a converting unit 356. These functional blocks are functional modules that are realized by the processing unit 35 executing a program. These functional blocks may be implemented in the editing device 3 as dedicated processing circuits.

[0033] 4 is a diagram showing an example of a data structure of the point cloud information table T1. The point cloud information table T1 stores point cloud information. The point cloud information is acquired by LiDAR measurement and stored in the management device 2. The point cloud information is, for example, data in a LAS file format, but is not limited to this example and may be data in any format such as text data.

[0034] The point cloud information stores a constituent point ID for identifying each of the multiple constituent points and coordinate information of each constituent point. Each constituent point corresponds to a reflection point of the laser irradiated in the LiDAR measurement. The constituent point ID is information for identifying each constituent point. The coordinate information is information indicating the position of the constituent point in the coordinate space. The coordinate space is a space according to a planar rectangular coordinate system or an arbitrary mathematical coordinate system (orthogonal coordinate system). The multiple constituent points included in the point cloud information are ordered based on a predetermined criterion. In the example shown in FIG. 4, the multiple constituent points are ordered based on the constituent point ID.

[0035] 5 is a diagram showing an example of the data structure of the class information table T2. The class information table T2 stores class information indicating the class of each of a plurality of constituent points. The class is information indicating the type of object indicated by each constituent point. For example, constituent points associated with class information of the ground surface and building indicate the shapes of the ground surface and building, respectively, in the coordinate space. Furthermore, constituent points associated with class information of noise are caused by noise such as multipath of the laser or reflection from clouds or water vapor in the air, and do not indicate the shape of a specific object.

[0036] The class information is ordered in the same order as the constituent points included in the point cloud information table T4. In this way, the management device 2 that has acquired the class information can associate the class information with each constituent point included in the point cloud information even if the class information does not include the constituent point ID and coordinate information. In the example shown in Fig. 5, the ground class, building class, building class, and noise class are set for the constituent points with the constituent point IDs of 1, 2, 3, and 4, respectively.

[0037] 6 is a sequence diagram showing an example of the flow of class information setting processing executed by the transmission / reception system 1. The class information setting processing is processing for associating class information with point cloud information. The class information setting processing is realized by the processing units of the management device 2 and the editing device 3 working in cooperation with other components of each device.

[0038] First, the transmitting unit 231 of the management device 2 transmits point cloud information to the editing device 3 via the communication unit 22 (step S101). The point cloud information is pre-stored in the storage unit 21. The point cloud information stored in the storage unit 21 is an example of first point cloud information.

[0039] Next, the receiving unit 351 of the editing device 3 receives the point cloud information via the communication unit 32 (step S102). The receiving unit 351 stores the received point cloud information in the storage unit 31. The point cloud information stored in the storage unit 31 is an example of second point cloud information.

[0040] Next, the generating unit 352 of the editing device 3 generates class information (step S103). For example, the generating unit 352 automatically sets a class for each of a plurality of constituent points included in the point cloud information according to a predetermined algorithm. The generating unit 352 may display the constituent points included in the point cloud information on the display unit 33, and manually set a class for each constituent point based on an operation of the operator on the operation unit 34. The generating unit 352 generates class information indicating the class set for each constituent point, and stores the class information in the storage unit 31.

[0041] Next, a conversion process is executed (step S104). The conversion process is a process for generating converted data based on the class information. The converted data is data obtained by losslessly compressing the class information. The details of the conversion process will be described later.

[0042] Next, the transmitting unit 353 of the editing device 3 transmits the converted data to the management device 2 via the communication unit 32 (step S105).

[0043] Next, the receiving unit 232 of the management device 2 receives the converted data via the communication unit 22 (step S106). The receiving unit 232 stores the received converted data in the storage unit 21.

[0044] Next, the association unit 233 of the management device 2 executes the association process (step S107). The association process is a process of associating class information with a plurality of configuration points based on the conversion data. The details of the association process will be described later. With this, the class information setting process is completed.

[0045] 7 is a flow diagram showing an example of the flow of the conversion process, which is executed by the editing device 3 in step S104 of the class information setting process.

[0046] First, the classification unit 354 acquires the point cloud information and the class information from the second storage unit 31 (step S201).

[0047] Next, the classification unit 354 classifies the constituent points included in the point cloud information into a plurality of groups according to a predetermined rule (step S202). For example, the classification unit 354 classifies the constituent points included in the point cloud information into a plurality of groups based on the position information of each constituent point.

[0048] FIG. 8 is a schematic diagram for explaining an example of classification of constituent points. The classification unit 354 specifies a distribution range R in the horizontal direction of a plurality of constituent points P included in the point cloud information. In the example shown in FIG. 8, the horizontal direction is, for example, a direction along a plane including the X direction and the Y direction in an arbitrary mathematical coordinate system (orthogonal coordinate system). In this case, the classification unit 354 specifies a constituent point having a minimum X coordinate, a constituent point having a maximum X coordinate, a constituent point having a minimum Y coordinate, and a constituent point having a maximum Y coordinate from among the plurality of constituent points. The classification unit 354 specifies a rectangular area extending from the position of the minimum X coordinate to the position of the maximum X coordinate in the X direction and extending from the position of the minimum Y coordinate to the position of the maximum Y coordinate in the Y direction as the distribution range R. In the example shown in FIG. 8, a rectangular area having a width Wx in the X direction and a width Wy in the Y direction is specified as the distribution range R.

[0049] The classification unit 354 sets a plurality of buckets, each having a predetermined size and shape, in the distribution range. In the example shown in FIG. 8, each bucket is a rectangular area with a width in the X direction of bx and a width in the Y direction of by, and each bucket is arranged in the X direction and the Y direction within the distribution range. The size of each bucket is set in a range in which the shape of the feature and the ground surface does not change abruptly inside the bucket. For example, bx and by are set to 10 [m] or more and 100 [m] or less, respectively. In the example shown in FIG. 8, N buckets are arranged in the X direction and M buckets are arranged in the Y direction. N is the smallest integer not less than the value obtained by dividing Wx by bx, and M is the smallest integer not less than the value obtained by dividing Wy by by.

[0050] The sorting unit 354 orders the multiple buckets based on their positional relationship. For example, the multiple buckets are ordered so that the buckets adjacent in the X direction or the Y direction are adjacent. In the example shown in FIG. 8, the buckets are ordered so that the buckets adjacent in the X direction are adjacent. That is, in the example shown in FIG. 8, the bucket B1 located at the upper left end of the distribution range R is the first bucket, and the buckets B2, ..., BN located to the right of the bucket B1 are ordered so that they are adjacent to each other. The buckets are ordered so that the bucket B(N+1) adjacent to the bucket B1 in the Y direction is next to the bucket BN located at the upper right end of the distribution range R. Each bucket is ordered according to the same rule.

[0051] The classification unit 354 determines which of a plurality of buckets each of the constituent points is included in based on the horizontal position of each of the constituent points. That is, the classification unit 354 determines in which bucket the horizontal position specified by the X coordinate and the Y coordinate of each of the constituent points is located. The classification unit 354 classifies each of the constituent points into a plurality of groups so that constituent points included in the same bucket are included in the same group. Note that in general point cloud data, each bucket includes several hundred or more constituent points, but for ease of viewing, only a portion of the constituent points are illustrated in FIG. 8.

[0052] Returning to FIG. 7, next, the classification unit 354 rearranges the constituent points included in the point cloud information based on the coordinate information in accordance with a predetermined rule (step S203). For example, the classification unit 354 classifies the constituent points included in each group into a plurality of small groups by setting small buckets inside each group in the same manner as in step S202 for each group. The size of the small buckets is set according to the measurement density of the LiDAR measurement so that the number of constituent points included in each small group is approximately several tens or less. For example, the small buckets are set so that the width in the X direction and the width in the Y direction are 1 [m] or more and 2 [m] or less, respectively. The classification unit 354 orders the plurality of small buckets based on their positional relationship, similar to the ordering of the buckets in step S202.

[0053] The sorting unit 354 sorts the constituent points included in each small group based on the coordinate information. For example, the constituent points included in the small group are sorted in ascending order of X coordinates. If there are multiple constituent points with the same X coordinate, those constituent points are sorted in ascending order of Y coordinates. If there are multiple constituent points with the same X coordinate and Y coordinate, those constituent points are sorted in ascending order of Z coordinates. For example, the sorting unit 354 sorts the constituent points included in the small group by applying quick sort.

[0054] The classification unit 354 rearranges the constituent points included in each group by linking the rearranged constituent points included in each small group within the same group based on the order of each small group. The classification unit 354 rearranges the constituent points included in the point cloud information by linking the rearranged constituent points included in each group based on the order of each group. That is, the classification unit 354 rearranges the constituent points by applying a combination of two-stage bucket sorting and quick sorting. By applying quick sorting, which has a computational complexity of O(NlogN), only to constituent points included in the same small bucket in bucket sorting, which has a computational complexity of O(N), the constituent points can be rearranged faster than when quick sorting is applied to all constituent points.

[0055] 9 is a schematic diagram for explaining the result of rearrangement of the constituent points. The multiple constituent points included in the point cloud information are arranged based on the order of the groups to which each constituent point belongs. The order of the groups is the order of the buckets set in step S202 corresponding to each group. The multiple constituent points belonging to the same group are arranged based on the order of the small groups to which each constituent point belongs. The order of the small groups is the order of the small buckets corresponding to each small group. The multiple constituent points belonging to the same small group are arranged in ascending order of the X coordinate, Y coordinate, and Z coordinate.

[0056] Returning to FIG. 7, next, the classification unit 354 rearranges the class information so as to correspond to the rearranged configuration points (step S204).

[0057] Next, the setting unit 355 selects a group to be processed from among the multiple groups set in step S202 (step S205). For example, the setting unit 355 selects a group to be processed based on the order of the groups.

[0058] Next, the setting unit 355 executes a region setting process (step S206). The region setting process is a process for setting a plurality of regions in the coordinate space based on the coordinate information of the constituent points included in the group to be processed. The details of the region setting process will be described later.

[0059] Next, the conversion unit 356 selects a region to be processed from among the multiple regions that have been set (step S207).

[0060] Next, the conversion unit 356 judges whether the area to be processed is a single-class area or a multiple-class area (step S208). A single-class area is an area in which all of the composition points included in the group to be processed belong to the same class. A multiple-class area is an area in which the composition points included in the group to be processed belong to two or more classes.

[0061] If the area to be processed is a single-class area (step S208-Yes), the conversion unit 356 converts the class information of the configuration points included in the single-class area into area class information (step S209). The area class information is information in which the identification information of the single-class area is associated with the identification information of the class of the configuration points included in the single-class area.

[0062] That is, when the area to be processed is a single-class area, the class of all the constituent points included in the area to be processed is the same, so there is no need to store the class information of each constituent point. The class information of each constituent point is omitted, and instead, only the identification information of the class of the constituent points included in the area to be processed is stored, thereby reducing the amount of data.

[0063] If the area to be processed is a multiple-class area (step S208-No), the conversion unit 356 converts the class information of the configuration points included in the multiple-class area into coded class information (step S210). The coded class information is information obtained by converting the class information of the configuration points included in the multiple-class area so that the identification information of the area most frequent class is omitted. The area most frequent class is a class that corresponds to the largest number of configuration points among the classes of configuration points included in the group to be processed and included in the multiple-class area to be processed.

[0064] 10 is a schematic diagram for explaining the coded class information. The conversion unit 356 extracts class information of the configuration points included in the group to be processed and included in the area to be processed from the class information of the configuration points included in the point group information. At this time, the conversion unit 356 extracts the class information CL so that the order of the class information rearranged in step S204 is maintained.

[0065] The conversion unit 356 identifies the area most frequent class and the non-area most frequent class based on the extracted class information CL. The non-area most frequent class is a class that is included in the group to be processed and is different from the area most frequent class among the classes of the configuration points included in the multi-class area to be processed. In the example shown in Fig. 10, the building class is identified as the area most frequent class, and the ground class and noise class are identified as the non-area most frequent classes.

[0066] The conversion unit 356 counts the types of non-region most frequent classes, and encodes the class information of the non-region most frequent classes with a number of bits according to the counting result. In the example shown in FIG. 10, the class information CL includes three types of classes, a ground class, a building class, and a noise class. Among the three types of classes, the building class is specified as the region most frequent class. Therefore, the non-region most frequent classes include two types of classes, a ground class and a noise class. The class information of the non-region most frequent class is encoded with 1 bit so that these classes can be identified. In the example shown in FIG. 10, the class information of the ground class and the noise class are encoded with bit strings 0 and 1, respectively.

[0067] Furthermore, the conversion unit 356 calculates the maximum number of consecutive classes of the same type for each type of class. In the example shown in FIG. 10, the maximum number of consecutive classes of the ground, building, and noise are 3, 4, and 2, respectively. The conversion unit 356 determines the number of bits for encoding the number of consecutive classes of the same type based on the calculated maximum number. At this time, the conversion unit 356 determines the number of bits for the area most frequent class so that an integer greater than or equal to 0 and less than or equal to the maximum number can be identified. Furthermore, the conversion unit 356 determines the number of bits for the non-area most frequent class so that an integer greater than or equal to 1 and less than or equal to the maximum number can be identified. In the example shown in FIG. 10, the building class, which is the area most frequent class, is encoded with 3 bits so that an integer greater than or equal to 0 and less than or equal to 4 (i.e., 0, 1, 2, 3, and 4) can be identified. The ground class, which is the non-area most frequent class, is encoded with 2 bits so that an integer from 1 to 3 (i.e., 1, 2, or 3) can be identified. The noise class, which is the non-region most frequent class, is coded with one bit so that integers greater than or equal to 1 and less than or equal to 2 (i.e., 1 or 2) can be identified. The conversion unit 356 codes the consecutive numbers according to the determined number of bits.

[0068] The conversion unit 356 generates coded class information by encoding class information of the configuration points included in the multiple class area so that the consecutive number of the area mode class, the identification information of the non-area mode class, and the consecutive number of the non-area mode class are repeated in this order. In the example shown in Fig. 10, for ease of viewing, a hyphen (-) is shown between the identification information of the non-area mode class and the consecutive number of the converted data, and a slash ( / ) is shown between the consecutive number of the area mode class and the identification information of the non-area mode class, and between the consecutive number of the non-area mode class and the consecutive number of the area mode class. As shown in Fig. 10, when different types of non-area mode classes are consecutive, a bit string of 000 (underlined) is inserted between them in the converted data, indicating that the consecutive number of the area mode class is 0 (i.e., there is no area mode class between the non-area mode classes).

[0069] The encoded class information generated in this manner includes identification information of the non-region most frequent class, but does not include identification information of the region most frequent class. In other words, the conversion unit 356 converts the class information of the configuration points included in the multiple class region so that the identification information of the region most frequent class is omitted.

[0070] Returning to FIG. 7, after step S209 or S210, conversion unit 356 determines whether or not all areas have been selected as areas to be processed (step S211).

[0071] If all areas have not been selected as areas to be processed (step S211-No), the conversion process returns to step S207, and the conversion unit 356 selects one of the areas that has not yet been selected as areas to be processed as the area to be processed.

[0072] If all the regions have been selected as the regions to be processed (Yes at step S211), the setting unit 355 determines whether all the groups have been selected as the groups to be processed (step S212).

[0073] If all groups have not been selected as the group to be processed (step S212-No), the conversion process returns to step S205, and the setting unit 355 selects one of the groups that has not yet been selected as the group to be processed as the group to be processed.

[0074] If all groups have been selected as groups to be processed (step S212-Yes), the conversion unit 356 generates conversion data (step S213). The conversion unit 356 concatenates area class information or coding class information for the multiple areas set for each group in a predetermined order. For example, the predetermined order is an order based on the positional relationship of the multiple areas. The conversion unit 356 generates conversion data by concatenating the area class information or coding class information concatenated for each group based on the order of the groups. This ends the conversion process.

[0075] 11 is a flow diagram showing an example of the flow of the region setting process, which is executed by the editing device 3 in step S206 of the conversion process.

[0076] First, the setting unit 355 judges whether or not the condition for calculating a separation surface that separates a plurality of regions is satisfied (step S301). The condition for calculating the separation surface is a condition based on the number of types of classes of the composition points included in the group to be processed. For example, the condition for calculating the separation surface is that the class of the composition points included in the group to be processed is two or more types.

[0077] If the conditions for calculating the separation plane are not satisfied (step S301-No), the region setting process ends.

[0078] When the conditions for calculating the separation plane are met (step S301-Yes), the setting unit 355 normalizes the coordinate information of the composition points included in the group to be processed (step S302).

[0079] 12 is a schematic diagram for explaining normalization of coordinate information. The setting unit 355 performs linear coordinate conversion on the X coordinates and Y coordinates so that the X coordinates and Y coordinates (X, Y) of the four vertices of the bucket B corresponding to the group to be processed, which are set in step S201 of the conversion process, become (-1,-1), (-1,1), (1,-1), and (1,1). The setting unit 355 also calculates the average value Zav, minimum value Zmin, and maximum value Zmax of the Z coordinates of the constituent points included in the group to be processed. When the absolute value of the difference between the average value Zav and the minimum value Zmin is greater than the absolute value of the difference between the average value Zav and the maximum value Zmax, the setting unit 355 performs linear coordinate conversion on the Z coordinates so that the average value Zav becomes 0 and the minimum value Zmin becomes -1. If the absolute value of the difference between the average value Zav and the maximum value Zmax is greater than the absolute value of the difference between the average value Zav and the minimum value Zmin, the setting unit 355 performs linear coordinate transformation of the Z coordinate so that the average value Zav becomes 0 and the maximum value Zmax becomes 1.

[0080] In this way, the coordinate information of the composition points is normalized so that the absolute values ​​of the X, Y and Z coordinates of the composition points included in the group to be processed are equal to or less than 1. Note that instead of the average value Zav of the Z coordinates of the composition points, the median value of the Z coordinates of the composition points may be used.

[0081] Returning to FIG. 11, next, the setting unit 355 identifies the most frequent class corresponding to the most frequent constituent points among the classes of constituent points included in the group to be processed, and calculates an approximation plane of the constituent points of the frequent class (step S303). For example, the setting unit 355 applies singular value decomposition to a matrix having coordinate information of the constituent points of the frequent class as elements, and calculates singular values ​​and singular vectors of the matrix. The setting unit 355 calculates, as the approximation plane of the constituent points of the frequent class, the one that passes through the center of gravity of the constituent points of the frequent class among planes having the three-dimensional singular vector corresponding to the smallest singular value as its normal line. The setting unit 355 may calculate the approximation plane using other methods such as principal component analysis.

[0082] Next, the setting unit 355 calculates a lower separation surface and an upper separation surface as separation surfaces (step S304). The lower separation surface is a separation surface below the approximation plane, and the upper separation surface is a separation surface above the approximation plane. Here, the lower side is the negative direction of the Z axis, and the upper side is the positive direction of the Z axis.

[0083] Fig. 13 is a schematic diagram for explaining the calculation of the lower separation plane and the upper separation plane. In Fig. 13, the configuration points illustrated with white circles are configuration points of the building class, which is the most frequent class. The configuration points illustrated with black circles are configuration points of the ground surface class, which is a non-most frequent class different from the most frequent class. The configuration points illustrated with triangles are configuration points of the noise class, which is a non-most frequent class.

[0084] The setting unit 355 identifies a configuration point that has the smallest distance along the Z direction from the approximate plane AP among the configuration points of the non-most frequent class below the approximate plane AP. The setting unit 355 calculates a plane that passes through the identified configuration point among planes parallel to the approximate plane as a lower separation plane. In the example shown in FIG. 13, a configuration point PL of the ground surface class that has the smallest distance D along the Z direction from the approximate plane AP is identified, and a lower separation plane LP that passes through the configuration point PL is calculated.

[0085] The approximation plane is expressed by the following formula:

number

number

[0086] If there is no component point of the non-modal class below the approximate plane AP, the setting unit 355 does not calculate the lower separation plane.

[0087] Furthermore, the setting unit 355 identifies a configuration point that is the smallest distance along the Z direction from the approximate plane AP among the configuration points of the non-most frequent class above the approximate plane AP. The setting unit 355 calculates a plane that passes through the identified configuration point among planes parallel to the approximate plane as an upper separation plane. In the example shown in Fig. 13, a noise class configuration point PU that is the smallest distance along the Z direction from the approximate plane AP is identified, and an upper separation plane UP that passes through the configuration point PU is calculated.

[0088] The setting unit 355 calculates Zp for each of the non-moderate class points above the approximate plane AP by the above formula. The setting unit 355 can specify the configuration point with the smallest Zp among the non-moderate class points above the approximate plane AP as the configuration point PU with the smallest distance D in the Z direction from the approximate plane AP.

[0089] If there is no component point of the non-modal class above the approximate plane AP, the setting section 355 does not calculate the upper separation plane.

[0090] By calculating the lower separation surface and the upper separation surface in this manner, the area between the lower separation surface and the upper separation surface becomes a single class area. The setting unit 355 stores the parameters (a, b, c, and d) indicating the calculated lower separation surface and upper separation surface in the storage unit 31.

[0091] Returning to FIG. 11, next, the setting unit 355 judges whether or not the conditions for calculating the additional separation surface are satisfied (step S305). The additional separation surface is a separation surface different from the lower separation surface and the upper separation surface. The conditions for calculating the additional separation surface are based on the number of types of classes of the composition points included in the region. For example, the condition for calculating the additional separation surface is that the number of types of classes of the composition points included in any region is three or more.

[0092] If the condition for calculating the additional separation plane is satisfied (step S305-Yes), the setting unit 355 calculates the additional separation plane for the region where the condition is satisfied (step S306).

[0093] Fig. 14 is a schematic diagram for explaining the calculation of an additional separation plane. As in Fig. 13, in Fig. 14, the configuration points illustrated with white circles are configuration points of the building class, which is the most frequent class. The configuration points illustrated with black circles are configuration points of the ground surface class, which is a non-most frequent class different from the most frequent class. The configuration points illustrated with triangles are configuration points of the noise class, which is a non-most frequent class.

[0094] In the example shown in Fig. 14, the area below the lower separation plane LP contains component points of three classes: a building class, a ground class, and a noise class. Therefore, an additional separation plane is calculated for the area below the lower separation plane LP. On the other hand, the area above the upper separation plane UP contains only component points of the noise class. Therefore, an additional separation plane is not calculated for the area above the upper separation plane UP.

[0095] The setting unit 355 identifies a first most frequent class corresponding to the largest number of composition points and a second most frequent class corresponding to the second largest number of composition points among the classes of composition points included in the region where the condition is satisfied. In the example shown in Fig. 14, the ground class is identified as the first most frequent class, and the building class is identified as the second most frequent class.

[0096] The setting unit 355 identifies a constituent point that is included in the region where the condition is satisfied and is a non-moderate class different from the first mode class and the second mode class, and has a minimum distance along the Z direction from the lower separation plane. The setting unit 355 calculates a plane that passes through the identified constituent point, among planes parallel to the lower separation plane, as an additional separation plane. In the example shown in FIG. 13, a constituent point PB of the noise class that has a minimum distance D along the Z direction from the lower separation plane LP is identified, and an additional separation plane BP that passes through the constituent point PB is calculated.

[0097] When an additional separation surface is calculated for an area above the upper separation surface, the setting unit 355 specifies a configuration point that is the smallest distance from the upper separation surface along the Z direction among the configuration points of the non-mode class, and calculates a plane that passes through the specified configuration point among planes parallel to the approximation plane as the additional separation surface. Similarly, when an additional separation surface is calculated for an area below or above the additional separation surface, the setting unit 355 similarly calculates a plane that passes through a configuration point that is the smallest distance from the additional separation surface along the Z direction among planes parallel to the approximation plane as the additional separation surface. The setting unit 355 stores parameters indicating the calculated additional separation surface in the storage unit 31. Since the additional separation surface is parallel to the lower separation surface, the parameters indicating the additional separation surface do not need to include a parameter indicating its inclination.

[0098] Returning to FIG. 11, after step S306, the region setting process returns to step S305, where the setting unit 355 determines whether or not the conditions for calculating the additional separation plane are satisfied.

[0099] If the conditions for calculating the additional separation plane are not satisfied in step S305 (step S305-No), the region setting process ends.

[0100] 15 is a diagram showing an example of the data structure of the conversion data D generated by the conversion process. The conversion data D associates group identification information, the number of regions, parameters of the separation planes, and information on the classes of the composition points included in each region with each other.

[0101] In the example shown in Fig. 15, two separation surfaces are calculated for group G1, so three regions are set. In addition, the separation surface, which is a plane, is specified by four parameters, so the four parameters are stored as the parameters of the separation surface. Information on the class of the configuration points included in each region differs depending on whether the region is a single-class region or a multiple-class region. If the region is a single-class region, the region class information generated in step S209 of the conversion process is stored.

[0102] 16 is a diagram showing an example of the data structure of information E on the classes of configuration points included in a multiple class area. The information E on the classes of configuration points included in a multiple class area associates the number of types of classes of configuration points included in a multiple class area, class information of the configuration points, the number of bits for encoding the consecutive number, identification information of the non-area most frequent class, and encoding class information with each other.

[0103] The class information of the configuration points included in the multiple class area is ordered in descending order of the number of corresponding configuration points. The number of bits for encoding consecutive numbers is ordered in the same manner as the class information of the configuration points. In the example shown in FIG. 16, it is shown that, among the configuration points included in the multiple class area, the number of configuration points of the building class is the largest, and the number of configuration points of the noise class is the smallest. It is also shown that the number of bits for encoding consecutive numbers of the building class, the ground class, and the noise class are 3, 2, and 1, respectively.

[0104] The identification information of the non-region most frequent class is ordered in the same manner as the class information of the composing points. In the example shown in Fig. 16, the identification information of the non-region most frequent class is ordered in descending order of the number of corresponding composing points for classes other than the building class, which is the region most frequent class. That is, it is shown that the identification information of the ground class is 0, and the identification information of the noise class is 1. The encoding class information was generated in step S210 of the conversion process.

[0105] 17 is a flow diagram showing an example of the flow of the association process. The association process is executed by the management device 2 in step S107 of the class information setting process.

[0106] First, the association unit 233 classifies the constituent points included in the point cloud information into a plurality of groups according to a predetermined rule (step S401). The association unit 233 classifies the constituent points into a plurality of groups according to the same rule as the classification in step S201 of the conversion process.

[0107] Next, the association unit 233 rearranges the constituent points included in the point cloud information based on the coordinate information in accordance with a predetermined rule (step S402). The association unit 233 rearranges the constituent points in accordance with the same rule as the rearrangement in step S202 of the conversion process.

[0108] Next, the association unit 233 selects a group to be processed from among the multiple groups (step S403).

[0109] Next, the association unit 233 selects a region to be processed from among the multiple regions set for the group to be processed (step S404).

[0110] Next, the association unit 233 extracts the composition points included in the area to be processed from the rearranged composition points (step S405). The association unit 233 acquires the parameters of the separation plane calculated for the group to be processed from the conversion data. The association unit 233 judges whether each of the composition points included in the group to be processed is located above or below the separation plane based on the acquired parameters of the separation plane. The association unit 233 judges whether each composition point is included in the area to be processed based on the result of the judgment.

[0111] Next, the association unit 233 associates the class information with the extracted configuration points (step S406). The association unit 233 refers to the conversion data and determines whether the area to be processed is a single-class area or a multiple-class area.

[0112] When the area to be processed is a single-class area, the association unit 233 acquires area class information corresponding to the area to be processed from the conversion data. The association unit 233 associates the identification information of the class included in the area class information with each of the extracted composition points.

[0113] When the area to be processed is a multi-class area, the association unit 233 acquires the coding parameters and the coding class information corresponding to the area to be processed from the conversion data. The association unit 233 decodes the coding class information based on the coding parameters to generate class information, and associates the class information with each of the extracted composition points.

[0114] Next, the association unit 233 determines whether or not all the regions have been selected as regions to be processed (step S407).

[0115] If all areas have not been selected as areas to be processed (step S407-No), the matching process returns to step S404, and the matching unit 233 selects one of the areas that has not yet been selected as an area to be processed as the area to be processed.

[0116] If all the regions have been selected as regions to be processed (Yes in step S407), the association unit 233 determines whether all the groups have been selected as groups to be processed (step S408).

[0117] If all groups have not been selected as the group to be processed (step S408-No), the matching process returns to step S403, and the matching unit 233 selects one of the groups that has not yet been selected as the group to be processed as the group to be processed.

[0118] If all groups have been selected as groups to be processed (Yes in step S408), the association process ends.

[0119] As described above, in the transmission / reception system 1, the generation unit 352 of the editing device 3 generates class information that does not include coordinate information of the multiple constituent points and indicates the class of the multiple constituent points. The association unit 233 of the management device 2 associates the class information with the multiple constituent points. This eliminates the need for the editing device 3 to transmit coordinate information to the management device 2, making it possible for the transmission / reception system 1 to shorten the time required to transmit and receive information indicating the class of a point cloud.

[0120] The administrator checks whether the class information associated with the configuration point by the management device 2 is appropriate. If the class information is inappropriate, the editing device 3 corrects the class information and transmits it again to the management device 2. In this way, since the class information may be repeatedly transmitted from the editing device 3 to the management device 2, the time required for transmitting and receiving the class information accounts for a large proportion of the time required for the work of setting the class information. By reducing the time required for transmitting and receiving the class information, the work of setting the class information is greatly made more efficient.

[0121] Further, the classification unit 354 of the editing device 3 rearranges the constituent points included in the point cloud information according to a predetermined rule, and rearranges the class information so as to correspond to the rearranged constituent points. The association unit 233 rearranges the constituent points included in the point cloud information according to a predetermined rule, and associates the rearranged class information with the rearranged constituent points. That is, the constituent points are rearranged by the classification unit 354 and the association unit 233 according to the same rule.

[0122] When an operator operates the editing device 3 to manually set a class to the configuration point, the order of the configuration points may be changed by the operator. The same applies when the operator checks the class automatically set by the editing device 3. In these cases, in order for the management device 2 to appropriately associate the configuration points with the class information, the editing device 3 needs to transmit information indicating the changed order of the configuration points to the management device 2. In the transmission / reception system 1, the classification unit 354 and the association unit 233 rearrange the configuration points according to the same pre-set rule, so that even if the order of the configuration points is changed in the editing device 3 or the management device 2, the configuration points can be associated with class information without transmitting or receiving information indicating the changed order of the configuration points. In other words, even if the order of the configuration points is changed in the management device 2 or the editing device 3, there is no need to transmit or receive information indicating the order of the configuration points, so the transmission / reception system 1 makes it possible to reduce the time required for transmitting and receiving information indicating the class.

[0123] In addition, the classification unit 354 and the association unit 233 classify the configuration points into a plurality of groups according to a predetermined rule, and rearrange the configuration points for each of the plurality of groups. By classifying the configuration points into a plurality of groups, the number of configuration points to be the target of a single rearrangement process is reduced, and the rearrangement process is made more efficient. Therefore, the transmission / reception system 1 makes it possible to shorten the time required for processing associated with the transmission and reception of information indicating a class.

[0124] The classification unit 354 also classifies the constituent points classified into groups for each group into a plurality of groups, and rearranges the constituent points included in each of the plurality of small groups based on the coordinate information. By rearranging the constituent points for each small group based on the coordinate information, the transmission / reception system 1 reduces the calculation load compared to rearranging all the constituent points based on the coordinate information.

[0125] In addition, in the transmission / reception system 1, the setting unit 355 sets a plurality of regions in the coordinate space. The conversion unit 356 converts class information of the constituent points included in the single class region into region class information. This makes it unnecessary to transmit class information of each of the constituent points included in the single class region, and therefore the transmission / reception system 1 can reduce the time required to transmit and receive information indicating the class of a point group.

[0126] Moreover, the conversion unit 356 specifies the area most frequent class from among the classes of the constituent points included in the multiple class area, and converts the class information of the constituent points included in the multiple class area so that the class identification information of the constituent points of the area most frequent class is omitted. As a result, the class information indicating the area most frequent class, which is the largest number of the constituent points included in the multiple class area, is omitted, so that the transmission / reception system 1 can further shorten the time required for transmitting and receiving information indicating the class of the point cloud.

[0127] Furthermore, the setting unit 355 sets the multiple regions so that at least one single-class region is included in the multiple regions. In a single-class region, class information of all constituent points included therein is omitted, whereas in a multiple-class region, only class information of constituent points of the most frequent class in the region is omitted. Therefore, a single-class region has a greater effect of reducing the amount of data of class information than a multiple-class region. By setting the multiple regions so that at least one single-class region is included in the multiple regions, the transmission / reception system 1 can further shorten the time required to transmit and receive information indicating the class of a point cloud.

[0128] In addition, in the transmission / reception system 1, the classification unit 354 classifies the constituent points included in the point cloud information into a plurality of groups based on the coordinate information of each constituent point. The setting unit 355 sets a plurality of regions for each group. In general, when the target geographical region is small, the topography can be considered to be uniform within the geographical region. In this case, the majority (approximately 80% to 90%) of the constituent points included in the point cloud data corresponding to the geographical region are associated with the same class. By classifying the constituent points into a plurality of groups based on their coordinate information, the majority of the constituent points included in the same group are in the same class, so that many constituent points can be included in a single class region. As a result, the class information of many constituent points is omitted, and the transmission / reception system 1 can further shorten the time required for transmitting and receiving information indicating the class of the point cloud.

[0129] Furthermore, in the transmitting and receiving system 1, the point cloud information is data that conforms to the LAS file format. As a result, the transmitting and receiving system 1 makes it possible to reduce the time required to transmit and receive information indicating the class of a point cloud even in a general-purpose system that uses the LAS file format.

[0130] The transmission and reception system 1 may have the following modified examples.

[0131] In the above embodiment, in steps S303 and S304 of the region setting process, the setting unit 355 calculates a lower separation surface and an upper separation surface parallel to the approximation plane of the region most frequent class. However, the present invention is not limited to such an example, and the setting unit 355 may calculate a lower separation surface and an upper separation surface having mutually different inclinations.

[0132] Fig. 18 is a schematic diagram for explaining the calculation of a lower separation surface and an upper separation surface having mutually different inclinations. The setting unit 355 specifies, for each of the small buckets set in step S202 of the conversion process, the component point of the area most frequent class included in the small bucket that is located at the top and the bottom, respectively. In the example shown in Fig. 18, the component point of the area most frequent class included in each small bucket and located at the top is specified as Pmax, and the component point of the area most frequent class included in each small bucket and located at the bottom is specified as Pmin.

[0133] Next, the setting unit 355 calculates an upper separation plane, which is an approximation plane of the constituent points of the most frequent class in the region located at the top in each bucket, and a lower separation plane, which is an approximation plane of the constituent points of the most frequent class in the region located at the bottom in each bucket. For example, the setting unit 355 calculates the upper separation plane and the lower separation plane using singular value decomposition, principal component analysis, etc. In the example shown in FIG. 18, the upper separation plane UP is calculated as an approximation plane of the constituent point Pmax of the most frequent class in the region located at the top in each small bucket. In addition, the lower separation plane LP is calculated as an approximation plane of the constituent point Pmin of the most frequent class in the region located at the bottom in each small bucket.

[0134] The setting unit 355 judges whether the planar position of the intersection line between the upper separation surface and the lower separation surface is inside the bucket corresponding to the group to be processed. In the example shown in Fig. 18, the planar position of the intersection line IL between the upper separation surface UP and the lower separation surface LP is not inside the bucket B. In this case, the setting unit 355 adopts the calculated upper separation surface UP and lower separation surface LP.

[0135] If the planar position of the intersection line is inside the bucket, the upper separation surface may be located below the lower separation surface, and the region will not be set appropriately. Therefore, in this case, the setting unit 355 recalculates the upper separation surface or the lower separation surface so that the planar position of the intersection line is no longer inside the bucket. For example, the setting unit 355 executes the processes of steps S303 and S304 to recalculate the upper separation surface and the lower separation surface, and adopts the upper separation surface and the lower separation surface.

[0136] In this way, by calculating the upper separation plane and the lower separation plane having mutually different inclinations, the constituent points of the same class tend to be unevenly distributed in each region. As described above, in a single-class region, the class identification information of all constituent points is omitted. Also, in a multiple-class region, the class identification information of the constituent points of the most frequent class in the region is omitted. Therefore, the more the constituent points of the same class are unevenly distributed in a specific region, the more the data volume is reduced in the conversion process.

[0137] The setting unit 355 may translate the calculated upper separation surface and lower separation surface so that at least one single-class area is included in the multiple areas. For example, similar to step S304, the setting unit 355 translates the upper separation surface so as to pass through the lowest one of the non-modal class configuration points located above a predetermined position along the Z direction relative to the upper separation surface. The setting unit 355 also translates the lower separation surface so as to pass through the highest one of the non-modal class configuration points located below a predetermined position along the Z direction relative to the lower separation surface. For example, the predetermined position is a position corresponding to the median value of the Z coordinates of the configuration points included in the group to be processed. In the example shown in FIG. 18, the upper separation surface UP is translated to a plane UP' passing through the non-modal class configuration point PU located lowest along the Z direction relative to the upper separation surface UP. Also, the lower separation surface LP is translated to a plane LP' passing through the non-modal class configuration point PL located highest along the Z direction relative to the lower separation surface LP. This makes it easier for points of the same class to be distributed unevenly across each region.

[0138] In the above-described embodiment, the class information is converted into conversion data in the conversion process. The present invention is not limited to such an example, and the conversion process may be omitted. In this case, the transmission unit 353 transmits class information that does not include coordinate information of a plurality of constituent points included in the point cloud information to the management device 2. Even in this manner, it is not necessary to transmit coordinate information, and therefore the time required for transmitting and receiving information indicating the class of the point cloud is reduced.

[0139] Also, the steps after step S204 of the conversion process may be omitted. That is, the transmission unit 353 may transmit class information rearranged according to a predetermined rule to the management device 2. In this manner, the time required for transmitting and receiving information indicating the class of the point cloud is also shortened. Also, even if the order of the configuration points is changed in the management device 2 or the editing device 3, it becomes unnecessary to transmit and receive information indicating the order of the configuration points.

[0140] In the above-described embodiment, in step S201 of the conversion process, the classification unit 354 classifies the constituent points included in the point cloud information into a plurality of groups. This is not a limitation, and the constituent points do not have to be classified into a plurality of groups. In other words, step S201 may be omitted. In cases such as when the distribution range of the constituent points is narrow, even if the constituent points are not classified into a plurality of groups, constituent points of the same class will be ubiquitous in the same area, and the amount of data of the conversion data will be reduced.

[0141] In the above-described embodiment, in steps S202 and S203 of the conversion process, the constituent points and their class information included in the point cloud information are rearranged according to a predetermined rule. The present invention is not limited to such an example, and the classification unit 354 may not rearrange the constituent points and class information. That is, steps S202 and S203 may be omitted. When the order of the constituent points is not changed in the management device 2 or the editing device 3, or when the constituent points included in the point cloud information are rearranged in advance in the management device 2 according to a predetermined rule, the class information is appropriately associated with the constituent points without rearranging the constituent points and class information.

[0142] In the above-described embodiment, the conversion data generated by the conversion process does not include the configuration point ID. The present invention is not limited to this example, and the configuration point ID may be associated with the class information included in the conversion data. This allows the management device 2 to easily associate the configuration points with the class information. Also in this case, the class information of some of the configuration points is omitted, so that the time required to transmit and receive information indicating the class of the point cloud is reduced.

[0143] In the above-described embodiment, in step S209 of the conversion process, the conversion unit 356 converts the class information of the configuration points included in the multiple class area into encoded class information in which the identification information of the class of the configuration points of the most frequent class in the area is omitted. The present invention is not limited to such an example, and the identification information of the class of the configuration points may not be omitted. For example, the conversion unit 356 may convert the class information of the configuration points included in the multiple class area into a run-length code in which the identification information of the class of the configuration points and the consecutive number of the classes are repeated. Furthermore, the conversion unit 356 may convert the class information of the configuration points included in the multiple class area into encoded class information and a run-length code, respectively, and adopt the encoded class information and the run-length code that has the smaller data amount.

[0144] In the above-described embodiment, in steps S303 and S304 of the region setting process, the setting unit 355 calculates an approximate plane for each group to be processed, and calculates a lower separation surface and an upper separation surface parallel to the approximate plane. The present invention is not limited to such an example, and the setting unit 355 does not need to calculate an approximate plane. For example, the setting unit 355 may calculate a lower separation surface and an upper separation surface parallel to the lower separation surface and the upper separation surface of a group adjacent to the group to be processed, respectively. Even in this way, the topography of the adjacent groups is likely to be similar, so that the constituent points can be appropriately classified according to the class. In addition, the calculation load for calculating the approximate plane is reduced. In addition, since the coordinate information is normalized in step S302, when the separation surfaces are parallel, the parameters indicating the inclination of each separation surface can be omitted, and the time required for transmitting and receiving information indicating the class of the point cloud is shortened.

[0145] Furthermore, when the inclination of the lower separation surface or the upper separation surface is small, the setting unit 355 may calculate a horizontal plane as the separation surface instead of the calculated lower separation surface or upper separation surface. For example, when the inclination of the lower separation surface or the upper separation surface is small, it is when v shown in the following formula is equal to or larger than a threshold value.

number

[0146] In the above-described embodiment, the condition for calculating the additional separation surface in step S305 is a condition based on the number of types of classes of the constituent points included in the region. The condition is not limited to this example, and may be a condition based on the number of constituent points included in the region and the number of types of classes included in the region. For example, the condition for calculating the additional separation surface may be that at least one of (1) the number of constituent points included in the region is equal to or greater than a threshold value, and the number of types of classes of the constituent points included in the region is two or more, and (2) the number of types of classes of the constituent points included in the region is three or more is satisfied.

[0147] In this case, if the condition (1) is satisfied, the setting unit 355, like step S301, identifies a region most frequent class and a non-most frequent class from among the classes of the constituent points included in the region, and calculates an additional separation surface. That is, the setting unit 355 calculates an additional separation surface so that a single-class region is separated by the additional separation surface. If the condition (2) is satisfied, the setting unit 355, like step S306, identifies a first region most frequent class, a second region most frequent class, and a non-most frequent class from among the classes of the constituent points included in the region, and calculates an additional separation surface. That is, the setting unit 355 calculates an additional separation surface so that a multi-class region including only constituent points of two classes is separated by the additional separation surface.

[0148] Even if a single-class region is separated by an additional separation surface, if the number of constituent points included in the single-class region is small, the degree of reduction in the amount of data by converting class information into region class information is small. On the other hand, calculating the additional separation surface increases the calculation load on the editing device 3 and the management device 2. The setting unit 355 reduces the calculation load by not calculating the additional separation surface when the number of constituent points included in the region separated by the additional separation surface is small and the degree of reduction in the amount of data is small.

[0149] After calculating the additional separation surface, the setting unit 355 may determine whether or not a condition for adopting the calculated additional separation surface is satisfied. For example, the condition for adopting the additional separation surface is a condition based on the number of composition points included in each of the two regions separated by the additional separation surface.

[0150] In this case, in step S305, the setting unit 355 judges whether the number of types of classes of the constituent points included in the region is two or more. If the number of types of classes of the constituent points included in the region is two or more, in step S306, the setting unit 355 calculates an additional separation surface so that the single-class region is separated. After step S306, the setting unit 355 judges whether the condition for adopting the additional separation surface is satisfied. For example, the setting unit 355 judges whether the number of constituent points included in each of the two regions separated by the additional separation surface is equal to or greater than a threshold. If the number of constituent points included in each of the two regions is equal to or greater than a threshold, the setting unit 355 adopts the additional separation surface, and the region setting process returns to step S305. If the number of constituent points included in at least one of the two regions is less than the threshold, the setting unit 355 does not adopt the additional separation surface. In this case, the setting unit 355 recalculates the additional separation surface so that the multi-class region including only the constituent points of two classes is separated, and adopts the recalculated additional separation surface. Thereafter, the region setting process returns to step S304.

[0151] When the number of configuration points included in the area separated by the additional separation surface is small, the degree of reduction in the amount of data by converting the class information into area class information or encoded class information is small. The setting unit 355 adopts an additional separation surface in which the number of configuration points included in the area separated by the additional separation surface is large and the degree of reduction in the amount of data is large, thereby efficiently shortening the time required to transmit and receive information indicating the class of the point cloud.

[0152] In the above-described embodiment, the lower separation surface, the upper separation surface, and the additional separation surface are flat surfaces. However, the present invention is not limited to such an example, and the lower separation surface, the upper separation surface, or the additional separation surface may be a curved surface such as a quadratic curved surface. This allows the constituent points to be separated more appropriately.

[0153] It should be understood by those skilled in the art that various changes, substitutions, and modifications can be made to the present invention without departing from the scope of the present invention. For example, the above-described embodiments and modifications may be appropriately combined within the scope of the present invention. [Explanation of symbols]

[0154] 2 Management device 231 Transmitter 232 Receiving section 233 Mapping section 3 Editing Equipment 351 Receiving unit 352 Generation part 353 Transmitter 354 Classification Department 355 Settings 356 Conversion Unit

Claims

1. an acquisition unit that acquires point cloud information including coordinate information indicating the positions of a plurality of constituent points that indicate the shape of the earth's surface and features in a predetermined coordinate space, and class information that indicates a classification result of each constituent point based on the type of thing that each constituent point indicates; A setting unit that sets a plurality of regions in the coordinate space; a conversion unit that selects a single-class area in which all of the constituent points included therein have the same class from among the plurality of areas, and converts the class information into area class information that does not include identification information of the class of each of the constituent points included in the single-class area, and in which the identification information of the single-class area and the identification information of the class of the constituent points included in the single-class area are associated with each other; having The conversion unit is A multi-class region including points constituting two or more classes is selected from the plurality of regions; Identifying a region most frequent class having the largest number of corresponding configuration points from among the classes of configuration points included in the multiple class region; converting the class information such that, among the configuration points included in the multiple class region, class identification information of the configuration point of the most frequent class in the region is omitted; A point cloud information conversion device comprising:

2. An acquisition unit that acquires point cloud information including coordinate information indicating positions of a plurality of constituent points that indicate the shape of the earth's surface and features in a predetermined coordinate space, and class information indicating a classification result of each constituent point based on the type of thing that each constituent point indicates; A setting unit that sets a plurality of regions in the coordinate space; a conversion unit that selects a single-class area in which all of the constituent points included therein have the same class from among the plurality of areas, and converts the class information into area class information that does not include identification information of the class of each of the constituent points included in the single-class area, and in which the identification information of the single-class area and the identification information of the class of the constituent points included in the single-class area are associated with each other; having The setting unit is Identifying a most frequent class corresponding to the largest number of component points from among the classes of the plurality of component points; Calculating an approximate plane of the constituent points of the most frequent class; a plane parallel to the approximation plane is calculated as a separation plane that separates the plurality of regions, thereby setting the plurality of regions; A point cloud information conversion device comprising:

3. the setting unit calculates, as the separation plane, a plane that passes through a component point of a class different from the most frequent class that is closest to the approximation plane in a predetermined coordinate axis direction of the coordinate space and is parallel to the approximation plane. The point cloud information conversion device according to claim 2 .

4. the setting unit calculates a horizontal plane as the separation plane instead of the calculated separation plane when the calculated inclination of the separation plane satisfies a predetermined condition. The point cloud information conversion device according to claim 2 .

5. An acquisition unit that acquires point cloud information including coordinate information indicating positions of a plurality of constituent points that indicate the shape of the earth's surface and features in a predetermined coordinate space, and class information indicating a classification result of each constituent point based on the type of object that each constituent point indicates; A setting unit that sets a plurality of regions in the coordinate space; a conversion unit that selects a single-class area in which all of the constituent points included therein have the same class from among the plurality of areas, and converts the class information into area class information that does not include identification information of the class of each of the constituent points included in the single-class area, and in which the identification information of the single-class area and the identification information of the class of the constituent points included in the single-class area are associated with each other; a classification unit that classifies the constituent points included in the point cloud information into a plurality of groups based on coordinate information of each constituent point, The setting unit sets the plurality of regions for each group, the conversion unit identifies the single class area for each group, and converts class information of the configuration points included in the single class area into the area class information. A point cloud information conversion device comprising:

6. the setting unit sets the plurality of regions such that the plurality of regions includes at least one of the single-class regions; The point cloud information conversion device according to claim 1 .

7. acquiring point cloud information in which coordinate information indicating the positions of a plurality of constituent points indicating the shape of the earth's surface and features is associated with class information indicating a classification result of each constituent point based on the type of thing indicated by each constituent point in a predetermined coordinate space; A plurality of regions are set in the coordinate space; a single-class area in which all of the constituent points included therein have the same class is selected from among the plurality of areas, and the class information is converted into area class information that does not include identification information of the class of each of the constituent points included in the single-class area and in which the identification information of the single-class area and the identification information of the class of the constituent points included in the single-class area are associated with each other; Including, A multi-class region including points constituting two or more classes is selected from the plurality of regions; Identifying a region most frequent class having the largest number of corresponding configuration points from among the classes of configuration points included in the multiple class region; converting the class information such that, among the configuration points included in the multiple class region, class identification information of the configuration point of the most frequent class in the region is omitted; A point cloud information conversion method comprising:

8. acquiring point cloud information in which coordinate information indicating the positions of a plurality of constituent points indicating the shape of the earth's surface and features is associated with class information indicating a classification result of each constituent point based on the type of thing indicated by each constituent point in a predetermined coordinate space; A plurality of regions are set in the coordinate space; a single-class area in which all of the constituent points included therein have the same class is selected from among the plurality of areas, and the class information is converted into area class information that does not include identification information of the class of each of the constituent points included in the single-class area and in which the identification information of the single-class area and the identification information of the class of the constituent points included in the single-class area are associated with each other; and have the computer execute the A multi-class region including points constituting two or more classes is selected from the plurality of regions; Identifying a region most frequent class having the largest number of corresponding configuration points from among the classes of configuration points included in the multiple class region; converting the class information such that, among the configuration points included in the multiple class region, class identification information of the configuration point of the most frequent class in the region is omitted; A program that causes a computer to execute the following:

Images