3D image generating method, 3D image generating device, guidance device, and program
By employing multiple measurements and strategic device placement, the method generates three-dimensional images with accurate texture and color representation, addressing the limitations of existing shape-focused techniques and enhancing preservation of cultural properties.
Patent Information
- Application Number
- JP2019183014
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2019-10-03
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2039-10-03
AI Technical Summary
Existing three-dimensional image generation techniques for construction sites primarily focus on capturing the shape of structures but fail to accurately represent the texture and color, which is crucial for preserving cultural properties and historical sites.
A method involving multiple measurements from different positions using a 3D laser scanner to capture point cloud data, combining and processing this data to generate a three-dimensional image that includes texture and color, while minimizing blind spots and noise through strategic device placement and data overlap management.
The technique effectively generates three-dimensional images that accurately represent the texture and color of structures, ensuring high fidelity and reducing data volume, thus improving work efficiency and preserving the details for future generations.
Smart Images

Figure 0007586636000001 
Figure 0007586636000002 
Figure 0007586636000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a three-dimensional image generating method, a three-dimensional image generating device, a guidance device, and a program. [Background technology]
[0002] Patent Document 1 describes a technology in which a 3D scanner is used to measure the 3D data of the surface of the completed form at a construction site in three dimensions as point cloud data in order to grasp the shape of the completed form at the construction stage, and the construction plan is modified according to the actual shape of the completed form before the construction stage. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2007-277813 A Summary of the Invention [Problem to be solved by the invention]
[0004] Three-dimensional images used at construction sites such as those described in the above literature are sufficient if they can grasp the shape; however, in cases where three-dimensional images are generated to preserve buildings such as cultural assets for future generations as a historical legacy, it is desirable to represent not only the shape but also the texture, color, and scenery as closely as possible to the real thing.
[0005] The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a technology for generating three-dimensional images that can express the texture and color of a structure. [Means for solving the problem]
[0006] In order to solve the above-mentioned problems, each aspect of the present invention employs the following configuration.
[0007] The first aspect relates to a method for generating a three-dimensional image. A method for generating a three-dimensional image according to a first aspect of the present invention comprises the steps of: a point cloud data generating step of measuring the structure a plurality of times while varying the installation position of a measuring device in at least one of the horizontal and vertical directions to generate a plurality of point cloud data representing shapes and colors of different portions of the structure; and a three-dimensional image generating step of generating a three-dimensional image of the structure by processing the plurality of point cloud data.
[0008] The second aspect relates to a three-dimensional image generating apparatus. A three-dimensional image generating device according to a second aspect includes a point cloud data acquisition means for acquiring a plurality of point cloud data representing shapes and colors of different portions of a structure by measuring the structure a plurality of times while varying at least one of the horizontal and vertical directions of an installation position of a measuring device, the point cloud data being generated by the three-dimensional image generating method according to the first aspect; and a three-dimensional image generating means for generating a three-dimensional image of the structure by processing the plurality of point cloud data.
[0009] A third aspect relates to a guidance device. A guidance device according to a third aspect includes a presenting means for presenting guidance on a method of generating a three-dimensional image to an operator in order to execute the method of generating a three-dimensional image according to the first aspect.
[0010] Another aspect of the present invention may be a program executed by at least one computer to realize the apparatus according to the second and third aspects, or a computer-readable recording medium having such a program recorded thereon. This recording medium includes a non-transitory tangible medium. The computer program includes computer program code which, when executed by a computer, causes the computer to carry out the processing method on each device.
[0011] Any combination of the above components, and any transformation of the present invention into a method, device, system, recording medium, computer program, etc., are also effective as aspects of the present invention.
[0012] Furthermore, the various components of the present invention do not necessarily have to be independent entities, but may be formed as a single member by multiple components, one component may be formed from multiple components, one component may be a part of another component, or part of one component may overlap with part of another component, etc.
[0013] In addition, although the method and computer program of the present invention describe a number of steps in a sequential order, the order does not limit the order in which the steps are executed. Therefore, when implementing the method and computer program of the present invention, the order of the steps can be changed as long as it does not affect the content.
[0014] Furthermore, the steps of the method and computer program of the present invention are not limited to being executed at different times, and therefore a step may occur while another step is being executed, or the execution timing of a step may overlap partially or entirely with the execution timing of another step, etc. Effect of the Invention
[0015] According to each of the above aspects, a technology for generating three-dimensional images capable of expressing the texture and color of a structure can be provided. [Brief description of the drawings]
[0016] [Figure 1] 1 is a diagram conceptually illustrating a system configuration of an image processing system according to an embodiment of the present invention. [Diagram 2] FIG. 1 illustrates an example of the configuration of a computer that realizes a three-dimensional image generating device. [Diagram 3] FIG. 2 is a functional block diagram showing a logical configuration of the three-dimensional image generating device. [Figure 4]1 is a flow chart illustrating steps of a method for generating a three-dimensional image. [Diagram 5] FIG. 1 is a diagram showing an example of an arrangement of a plurality of measuring devices. [Figure 6] FIG. 2 is a diagram for explaining an overlapping portion of a plurality of point cloud data; [Figure 7] 11A and 11B are diagrams for explaining a method of deleting overlapping portions of point cloud data. [Figure 8] 11A and 11B are diagrams for explaining a method of deleting overlapping portions of point cloud data. [Figure 9] 11A and 11B are diagrams for explaining a method of deleting overlapping portions of point cloud data. [Figure 10] 11A and 11B are diagrams for explaining a method of deleting overlapping portions of point cloud data. [Figure 11] 11A and 11B are diagrams for explaining a method of deleting overlapping portions of point cloud data. [Figure 12] 11A and 11B are diagrams for explaining a method of deleting overlapping portions of point cloud data. [Figure 13] 1A and 1B are diagrams showing an example in which a plurality of measuring devices are arranged in a staggered manner at different heights, and a comparative example in which the measuring devices are arranged at the same height. [Figure 14] FIG. 13 is a diagram showing an example in which measuring devices are placed at positions higher and lower than a structure. [Figure 15] FIG. 2 is a functional block diagram showing a logical configuration of the guidance device. [Figure 16] FIG. 4 is a diagram illustrating a laser irradiation direction of the measuring device. [Figure 17] FIG. 13 is a diagram for explaining a measurement range depending on an installation position of a measurement device. [Figure 18] FIG. 13 is a diagram for explaining a measurement range depending on an installation position of a measurement device. [Figure 19] FIG. 13 is a diagram for explaining a measurement range depending on an installation position of a measurement device. [Figure 20] FIG. 13 is a diagram for explaining a measurement range depending on an installation position of a measurement device. [Figure 21] FIG. 13 is a diagram for explaining a measurement range depending on an installation position of a measurement device. [Figure 22]FIG. 13 is a diagram for explaining an example of installation of a measuring device. [Diagram 23] FIG. 13 is a diagram for explaining an example of installation of a measuring device. [Figure 24] FIG. 13 is a diagram for explaining an example of installation of a measuring device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0017] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same components are given the same reference numerals, and the description will be omitted as appropriate.
[0018] (First embodiment) 1 is a diagram conceptually showing the system configuration of an image processing system 1 according to this embodiment. Note that in the following drawings, configurations of parts that are not related to the essence of the present invention are omitted and are not shown. The image processing system 1 includes a three-dimensional image generating device 100 that generates a three-dimensional image of a structure using measurement data obtained by using a plurality of measuring devices 5. The measuring devices 5 are, for example, 3D laser scanners that perform 3D digital measurement and output point cloud data. The point cloud data is a collection of data of a plurality of points that indicate the three-dimensional shape of the structure, and includes measurement data (relative or absolute coordinate information) that indicates the position of each point, and color information of each point.
[0019] The point cloud data measured by the measuring device 5 may be stored in the storage device 110 via the communication network 3, or may be stored in a recording medium of the measuring device 5. The 3D image generating device 100 can read out the point cloud data from the storage device 110 or the recording medium.
[0020] Each function of the 3D image generating device 100 of this embodiment, which will be described later, is realized by a computer.
[0021] The computer 60 comprises a CPU (Central Processing Unit) 62, a memory 64, a program 80 that realizes the components of the three-dimensional image generating device 100 loaded into the memory 64, a storage 66 that stores the program 80, an I / O (Input / Output) 68, and an interface (communication I / F) 70 for connecting to a communication network.
[0022] The CPU 62, memory 64, storage 66, I / O 68, and communication I / F 70 are connected to one another via a bus 69, and the CPU 62 controls the entire 3D image generating device 100. However, the method of connecting the CPU 62 and other components to one another is not limited to bus connection.
[0023] The memory 64 is a memory such as a random access memory (RAM) or a read only memory (ROM). The storage 66 is a storage device such as a hard disk, a solid state drive (SSD), or a memory card.
[0024] The storage 66 may be a memory such as a RAM or a ROM. The storage 66 may be provided inside the computer 60, or may be provided outside the computer 60 and connected to the computer 60 by wire or wirelessly as long as the computer 60 can access the storage 66. Alternatively, the storage 66 may be provided detachably to the computer 60.
[0025] The CPU 62 reads out a program 80 stored in the storage 66 into the memory 64 and executes it, thereby realizing the functions of the units of the 3D image generating device 100 shown in FIG. 3, which will be described below.
[0026] The I / O 68 controls input and output of data and control signals between the computer 60 and other input and output devices. The other input and output devices include, for example, input devices 72 such as a keyboard, touch panel, mouse, and microphone connected to the computer 60, output devices 74 such as a display, printer, and speaker, and interfaces between these input and output devices and the computer 60. Furthermore, the I / O 68 may control input and output of data with a device (not shown) for reading or writing data from another recording medium.
[0027] The communication I / F 70 is a network connection interface for communication between the computer 60 and an external device. The communication I / F 70 may be a network interface for connection to a wired line or a network interface for connection to a wireless line. For example, the computer 60 realizing the three-dimensional image generating device 100 may be connected to each measuring device 5 via the communication I / F 70 through the communication network 3.
[0028] Each component of the 3D image generating device 100 of this embodiment shown in Fig. 3, which will be described later, is realized by any combination of hardware and software of the computer 60 shown in Fig. 2. Those skilled in the art will understand that there are various variations in the realization method and device. The functional block diagram showing the 3D image generating device 100 of each embodiment described below shows logical functional unit blocks, rather than a hardware unit configuration.
[0029] The three-dimensional image generating device 100 may be configured with a plurality of computers 60, or may be realized by a virtual server. Alternatively, the device may be in a form in which the use of an application running on a server computer is provided to a user terminal by SaaS (Software as a Service).
[0030] The program 80 of this embodiment is written to cause the computer 60 to execute the following procedures for realizing the three-dimensional image generating device 100. The procedures executed by the computer include a procedure of acquiring a plurality of point cloud data indicating the shapes and colors of different parts of the structure by measuring the structure a plurality of times with the installation position of the measuring device 5 being changed in at least one of the horizontal and vertical directions, and a procedure of generating a three-dimensional image of the structure by processing the plurality of point cloud data.
[0031] The computer program 80 of this embodiment may be recorded on a recording medium readable by the computer 60. The recording medium is not particularly limited and may take various forms. The program 80 may be loaded from the recording medium into the memory 64 of the computer 60, or may be downloaded to the computer 60 via the communication network 3 and then loaded into the memory 64.
[0032] The recording medium for recording the computer program 80 includes a non-transitory tangible medium usable by the computer 60, in which program code readable by the computer 60 is embedded. When the computer program 80 is executed on the computer 60, it causes the computer 60 to realize the three-dimensional image generating device 100.
[0033] 3 is a functional block diagram showing the logical configuration of the 3D image generating device 100 of this embodiment. The 3D image generating device 100 includes a point cloud data acquiring unit 102 and an image generating unit 104. The point cloud data acquisition unit 102 acquires multiple point cloud data indicating the shapes and colors of different parts of the structure, which are obtained as a result of measuring the structure multiple times while varying the installation position of the measuring device 5 in at least one of the horizontal and vertical directions. The image generator 104 processes a plurality of point cloud data to generate a three-dimensional image of the structure. However, the different parts of the structure acquired by the point cloud data acquisition unit 102 may include not only different parts of the structure but also the same parts.
[0034] In the embodiments, "acquisition" includes at least one of the following: the device itself going to retrieve data or information stored in another device or recording medium (active acquisition), and the device itself inputting data or information output from another device (passive acquisition). Examples of active acquisition include making a request or inquiry to another device and receiving a reply, and accessing and reading information from another device or recording medium. Examples of passive acquisition include receiving information that is distributed (or transmitted, push notification, etc.). Furthermore, "acquisition" may also mean selecting and acquiring data or information from received data or information, or selecting and receiving distributed data or information.
[0035] In this embodiment, the structure preferably includes a cultural property, a temple, a shrine, a world heritage site (certified by the World Heritage Committee), an industrial heritage site (certified by the International Committee for the Preservation of Industrial Heritage), a modern industrial heritage site (certified by the Ministry of Economy, Trade and Industry), a civil engineering heritage site (recommended by the Japan Society of Civil Engineers), a scenic spot, a topography, or a historical building and ruins including at least one of a building and a scenic spot that need to be preserved for future generations. In this case, the three-dimensional image generated by the three-dimensional image generating device 100 of this embodiment is intended to convey the texture and color of the structure to future generations. Since the purpose of a general construction site is to survey the structure, it is sufficient if the shape can be grasped by the three-dimensional image. In contrast, in this embodiment, since the purpose is to convey the shape and texture of the structure to future generations, it is preferable that not only the shape but also the texture, color, and scenery are expressed in the three-dimensional image.
[0036] In addition, in historical wooden architecture such as cultural properties, multiple beams and small beams are arranged in a lattice pattern under the roof, eaves, ceiling, etc., and the laser does not directly hit the backs of these beams and small beams. Furthermore, Japanese-style rooms often have complicated shapes such as a tokonoma alcove, a tenbukuro, a transom, a drop-down hanging, and a bookshelf, which creates many blind spots for the laser. In this embodiment, a method for eliminating such blind spots is provided.
[0037] FIG. 4 is a flow chart illustrating the steps of the three-dimensional image generating method of this embodiment. The three-dimensional image generating method of this embodiment includes a point cloud data generating step (step S101) and a three-dimensional image generating step (step S103). In the point cloud data generation process of step S101, the structure is measured multiple times while varying the installation position of the measuring device 5 in at least one of the horizontal and vertical directions, thereby generating multiple point cloud data representing the shapes and colors of different parts of the structure. In the three-dimensional image generating process of step S103, a three-dimensional image of the structure is generated by processing a plurality of point cloud data.
[0038] Fig. 16 is a diagram explaining the laser irradiation direction of the measuring device 5. The measuring device 5 changes the laser irradiation angle in the horizontal direction within a range of 360 degrees (Fig. 16(a)), and in the vertical direction, it scans the measurement object while changing the laser irradiation angle within a range of 90 degrees in the zenith direction and -60 degrees downward (Fig. 16(b)), with the horizontal position being 0 degrees. Fig. 16(c) shows the entire measurement range of the measuring device 5.
[0039] As described above, in historical wooden buildings such as cultural properties, multiple beams and small beams are arranged under the roof and eaves, which creates blind spots where the laser does not directly hit the backs of these beams and small beams. Below, we will explain, with reference to the drawings, an example of how to efficiently reduce these blind spots by using a method for installing the measuring device 5 of the present invention.
[0040] 17 to 21 are vertical cross-sectional views of a roof. In an example where a small beam 10 is present under the roof as shown in Fig. 17, when the measuring device 5a is installed at a position La under the roof, the thick line portion indicates the range where the laser can be irradiated, that is, the measurable range. The rest of the area is a blind spot.
[0041] The example of Fig. 18 shows a case where measuring device 5b is installed at a position Lb that is the same horizontal position as position La of measuring device 5a in Fig. 17, but lower in the vertical direction. The measurement range of measuring device 5b (shown by a thick line in the figure) covers a wider range than the measurement range of measuring device 5a in Fig. 17. However, the point cloud density of measuring device 5b is lower than the point cloud density of measuring device 5a.
[0042] In the example of Fig. 19, a measuring device 5c is installed at a position Lc which is different in both the horizontal and vertical directions from the position of the measuring device 5a in Fig. 17. The measurement range of the measuring device 5c is indicated by a thick line in the figure. In the example of Fig. 19, the point cloud density is approximately the same as that in the example of Fig. 17.
[0043] In the example of Fig. 20, a measuring device 5d is installed at a position Ld that is the same horizontal position as the position Lc of the measuring device 5c in Fig. 19, but lower in the vertical direction and higher than the measuring device 5b in Fig. 18. The measurement range of the measuring device 5d is indicated by a thick line in the figure. The point cloud density of the measuring device 5d in Fig. 20 is an intermediate value between the measuring devices 5a, 5b, and 5c.
[0044] Consider these combinations. When the measuring device 5b at position Lb is combined with the measuring device 5d at position Ld, the joists 10 and the underside of the roof between the joists 10 can be covered. In other combinations, blind spots remain. However, the combination of the measuring device 5b and the measuring device 5d has a lower point cloud density than the other combinations. Therefore, the measuring device 5a at position La and the measuring device 5c at position Lc can be used to perform a scan that complements the low point cloud density areas of the above combinations.
[0045] On the other hand, in a comparative example in which the measuring device 5a is positioned at a position Le slightly lower in the vertical direction as shown in FIG. 21, the measuring device 5a and the measuring device 5d can cover the entire measuring object. However, in this example, the overlapping part of the point cloud is mainly only on the lower surface of the beam 10. In other words, the point cloud density is high only on the lower surface of the beam 10, so the point cloud density difference with other parts becomes clear. Therefore, it is not preferable in the case of historical structures such as cultural properties, which are the measuring object of the present invention, where it is important to express the texture.
[0046] FIG. 5 is a diagram showing an example of an arrangement of a plurality of measuring devices 5. As shown in FIG. The multiple measuring devices 5 are arranged at different installation positions in the horizontal and vertical directions. Here, the number of measuring devices 5 does not necessarily need to be multiple, and at least one measuring device 5 may be moved to multiple installation locations to perform measurements. In other words, multiple measuring devices 5 means measuring devices 5 installed at multiple installation locations, and does not mean the number of measuring devices 5 used for measurement. Scanning may be performed on the multiple measuring devices 5 one by one in sequence, or a predetermined number of measuring devices may be simultaneously performed.
[0047] An example of how to arrange the measuring device 5 is shown below. (1) Multiple measuring devices 5 are arranged at intervals so that the scanning areas (point cloud data) of adjacent measuring devices 5 overlap, at positions that allow measurement from a relatively low viewpoint on one side of the target (hereinafter also referred to as the measurement target), and at a predetermined distance from the one side. (2) In order to eliminate blind spots of (1), place multiple sensors at a specified distance from one side as (1) in a location where measurements can be taken from a higher viewpoint than (1). (3) Furthermore, in order to eliminate the blind spot of (1), it is placed at a position farther away from the first surface than (1) and at a position where it can be measured from an oblique viewpoint. The position may be on both sides of the object, or in a position where the object's accessories can be measured. The height may be between (1) and (2). The distance from the first surface should be such that the scanning area of the measuring device 5 of (1) and the scanning area of the measuring device 5 of (3) at least partially overlap. (4) In order to measure objects around the target object, a plurality of measuring devices 5 are placed at positions further away from the surface than (3). The heights of the plurality of measuring devices 5 may be different. The distance from the surface is preferably such that the scanning area of the measuring device 5 of (3) and the scanning area of the measuring device 5 of (4) overlap at least partially. (5) In order to eliminate the blind spots of (4), a plurality of measuring devices 5 may be placed at positions further away from the one surface than (4). The heights of the plurality of measuring devices 5 may be different. The distance from the one surface should be such that the scanning area of the measuring device 5 of (4) and the scanning area of the measuring device 5 of (5) at least partially overlap. (5) is repeated until the measurement target and its associated objects are measured. Note that the blind spots include not only the areas caused by the shape of the structure to be measured, but also the blind spots of the measuring device 5 itself (the measuring device's own feet, tripods, and the range from -60 degrees to -90 degrees (to the ground) below in Figure 16(b)).
[0048] A specific example will be given using FIG. 5. For example, the four measuring devices 5a are arranged in positions that allow measurement from a relatively low viewpoint, and they measure the shape of the gate, the inside of the pillars, and the underside of the eaves. The number of measuring devices 5a is preferably determined so as to eliminate blind spots of the beams under the eaves and the empty space between the beams. The two measuring devices 5b are arranged in positions that allow measurement from a higher viewpoint than the measuring device 5a in order to compensate for the blind spot of the measuring device 5a. The two measuring devices 5c are also arranged in positions that allow measurement from a lower viewpoint diagonally behind the measuring device 5a in order to compensate for the blind spot of the measuring device 5a, and measure the outside of the gate, the outside of the pillars, and under the tiles of the earthen wall. The four measuring devices 5d are also arranged in positions that allow measurement from a lower viewpoint diagonally behind the measuring devices 5a, 5b, and 5c in order to compensate for the blind spots of the measuring devices 5a, 5b, and 5c, and measure the steps (treads, landings) and risers of the stairs in front of the gate. The four measuring devices 5e are arranged at positions where they can perform measurements from a lower viewpoint diagonally behind the measuring devices 5a, 5b, 5c, and 5d in order to compensate for the blind spots of the measuring devices 5a, 5b, 5c, and 5d.
[0049] In this way, by changing the positions and heights of the multiple measuring devices 5, blind spots due to the back side of the beams of a wooden building or a complex shape can be effectively eliminated. In addition, the measuring direction of the measuring device 5 may be, for example, 240 degrees in the vertical direction as shown in FIG. 16(b), or the measuring direction (in other words, the laser irradiation angle) may be limited to a predetermined range. For example, in the case of outdoor measurement, if it is clear that there are no structures or trees in the zenith direction of the measuring device 5, the zenith direction may be excluded from the measurement range. By limiting the measurement range, the volume of point cloud data can be reduced. However, if the measurement range is partially excluded, it may be difficult to combine point cloud data. Therefore, it is more preferable to limit the measurement range to a range that does not affect the combination of point cloud data.
[0050] In the point cloud data generating step of step S101, among a plurality of point cloud data generated by dividing a measurement object into a plurality of regions and measuring them, the adjacent regions in two pieces of point cloud data obtained by measuring adjacent regions partially overlap with each other. In other words, the measurement device 5 is positioned so that the adjacent regions in the two generated point cloud data partially overlap with each other. As shown in FIG. 6(a), the regions (hereinafter sometimes referred to as ranges) R1 and R2 indicated by the two generated point cloud data respectively include a portion (portion indicated by star mark S) where the same location of the measurement object was measured. In other words, the regions R1 and R2 of the two point cloud data overlap with the portion indicated by star mark S.
[0051] In the 3D image generation process in step S103, the two point cloud data can be combined based on this overlapping portion. As shown in Fig. 6(b), the ranges R1 and R2 of the two point cloud data in Fig. 6(a) can be aligned and combined using the star mark S. The overlapping portion is shown by hatching.
[0052] As a specific example, in the case of a building with a gate that cannot be opened or closed, particularly when visibility is poor between the inside and outside of the gate, scanning is performed from both the inside and outside of the gate. When scanning, the position of the measuring device 5 is selected so that the scanning range includes a common part. The two point cloud data obtained as a result of scanning from the inside and outside of the gate are aligned and combined by overlapping the common part. The common part may be selected as a landmark when overlapping the point cloud data.
[0053] It is preferable to select the position of the measuring device 5 so that there are multiple overlapping parts. Furthermore, when combining the overlapping parts, it is preferable to select from the multiple overlapping parts the parts with the highest combining accuracy and combine them.
[0054] In this way, blind spots can be eliminated by using multiple measuring devices 5, but as a result, a large number of point cloud data are overlapped to generate a three-dimensional image, which generates a lot of noise and further reduces the texture and quality of the object being measured.
[0055] Therefore, in this embodiment, the point cloud data obtained by the measuring device 5 is not used in its entirety, but is used partially. In the three-dimensional image generating process of step S103, when combining point cloud data obtained by multiple measuring devices 5, at least a part of the overlapping parts is deleted. For example, overlapping parts and unnecessary parts of the point cloud data are deleted by image processing, and the data is used partially. This reduces noise and makes it possible to maintain the texture. As explained with reference to FIG. 6(b), for the hatched part where the ranges R1 and R2 of two point cloud data overlap, one of the point cloud data may be deleted. Alternatively, statistical processing such as finding the average value or median value may be performed on the overlapping portion of the two point cloud data.
[0056] A method for removing overlapping parts will be described with reference to Figures 7 to 12. Here, it is assumed that there are three structures to be measured: target A, target B, and target C. Target A is a cultural property, and targets B and C are, for example, accessories such as earthen walls.
[0057] As shown in Fig. 7, six measuring devices 5a are arranged to measure the ranges of regions R11 and R12 in order to measure object A. Next, as shown in Fig. 8, three measuring devices 5b are arranged to measure the ranges of regions R21 and R22 in order to measure object B. Next, as shown in Fig. 9, two measuring devices 5c are arranged to measure object C and regions R31 to R34 are measured.
[0058] When all the point cloud data obtained by such measurements are superimposed, there are many overlapping areas, as shown in Figure 10. In this case, there is a high possibility that the texture will be lost. Therefore, as shown in Figure 11, the overlapping partial point cloud data is deleted. For example, the areas R21, R33, and R34 are deleted.
[0059] 12, the point cloud data within the region R12 measured by the measuring device 5a of the object B may be deleted. In this way, the texture can be maintained.
[0060] In cultural properties and other structures, transoms, nageshi, small beams, etc. located high up cast shadows themselves, creating blind spots for the laser. Also, in long corridors, passages, streets, etc., if the scanning position is low, many blind spots will occur on the tops of chests of drawers, the tops of eaves, etc.
[0061] For these measurements, increasing the height of the scanning position (e.g., 7 meters) allows scanning from a high viewpoint, eliminating blind spots.
[0062] In addition, in a long corridor, passage, street, etc., it is preferable to change the scanning heights of the multiple measuring devices 5 arranged along the longitudinal direction of the passage. A first height, a second height higher than the first height, a third height higher than the second height, etc. may be combined. For example, it is preferable to change the scanning heights of the multiple measuring devices 5 to a third height, a first height, a third height, a first height, a second height, a first height, a third height, etc., and arrange the multiple measuring devices 5 at a predetermined interval. As described above, the predetermined interval between the measuring devices 5 is set so that the scan areas of each measuring device 5 at least partially overlap.
[0063] As shown in FIG. 13(a), the multiple measuring devices 5 in this embodiment are set in a staggered pattern with the heights of the measuring devices 5 alternating between a first height h1 and a second height h2 higher than the first height h1.
[0064] In the point cloud data generation process of step S101, the intervals between the multiple measuring devices 5 arranged at positions higher than the structure are set to be wider than the intervals between the measuring devices 5 arranged at positions lower than the structure. Furthermore, in the point cloud data generation process of step S101, the density of the point cloud data acquired by the measuring devices 5 arranged at positions higher than the structure is set to be lower than the density of the point cloud data acquired by the measuring devices 5 arranged at positions lower than the structure.
[0065] When scanning is performed from the second height h2, the angle of the laser irradiated to the ground is closer to vertical than when scanning is performed from the lower position of the first height h1, resulting in a higher laser irradiation density. The reflected laser intensity is also higher. Therefore, when scanning is performed from the second height h2, the laser irradiation interval can be made coarser than when scanning from the first height h1, and as a result, the scanning time to obtain point cloud data of the same accuracy and range can be shortened. By combining scans from lower viewpoints with scans from higher viewpoints in a staggered arrangement, blind spots can be effectively eliminated.
[0066] For example, as shown in FIG. 13(b), when the heights of multiple measuring devices 5 are set to the first height h1, the installation intervals of the measuring devices 5 are half that of FIG. 13(a), and the number of measuring devices 5 required also increases to five. This is because scanning from a high viewpoint widens the scanning coverage area and makes it easier to combine point clouds, so the scanning intervals can be increased. As a result, the on-site scanning work can be shortened.
[0067] Even when obtaining point cloud data of the same accuracy, the arrangement in FIG. 13(a) allows for a lower scanning density and shorter scan time than the arrangement in FIG. 13(b). Therefore, the data volume of the obtained point cloud data can be reduced with the arrangement in FIG. 13(a). Furthermore, the arrangement in FIG. 13(a) also allows for a shorter work process time, which can reduce labor costs. Furthermore, as will be described later, scanning of structures is often performed outdoors, and in such cases, if the scanning takes a long time, the direction of the sunlight changes, which changes the way shadows are formed and the intensity of the light, which can affect the texture and color of the three-dimensional image, so the shorter the work time, the better.
[0068] In addition, in the point cloud data generation process of step S101, when generating at least a portion of the point cloud data, the measuring device 5 is placed at a position higher than the structure. Furthermore, in the point cloud data generation process of step S101, the measuring device 5 is set so that a position higher than the structure (height h2) and a position lower than the structure (height h1) are alternately repeated, as shown in Fig. 14 .
[0069] 22 to 24 are diagrams for explaining an example of installation of the measuring device 5. Fig. 22(a), Fig. 23(a), and Fig. 24(a) are plan views seen from above, and Fig. 22(b), Fig. 23(b), and Fig. 24(b) are cross-sectional views seen from line II in Fig. 22(a), Fig. 23(a), and Fig. 24(a), respectively. Figure 22 shows an example where the measuring devices 5a are lined up in a row at the same height in the center of the passage, which is an example of an arrangement commonly used in surveying. In this example, the earthen walls on both sides and under the eaves of the buildings are blind spots.
[0070] Fig. 23 shows an example in which a measuring device 5b at the same height is added to eliminate blind spots under the eaves. The total number of measuring devices 5 increases to 12, and the number of scans becomes 12, which is twice as many as the 6 scans in the example of Fig. 22. Therefore, in the example of Fig. 23, the measurement range is wider than in the example of Fig. 22, but noise is generated and the measurement time is longer.
[0071] FIG. 24 shows an example in which measuring devices 5 are placed at different heights. In this example, a measuring device 5c with a higher height is placed in the center of the passage, and a measuring device 5d that scans under the eaves is placed. The measuring device 5c in a higher position widens the scanning area, so the entire area can be measured, including the roof. The measuring device 5d in a lower position can measure under the eaves. In this example, the measuring device 5c in a higher position covers a wider range, so the interval between the measuring devices 5d in a lower position can be made wider than the interval between the measuring devices 5b in the example of FIG. 23. Therefore, in the example of FIG. 24, it is possible to scan without blind spots such as the roof and under the eaves with fewer scans compared to the example of FIG. 23.
[0072] As described above, according to this embodiment, a three-dimensional image of a structure is generated using point cloud data obtained by measuring with a plurality of measuring devices 5 arranged at different heights, thereby eliminating blind spots of the measuring devices 5. In addition, partial overlapping parts of the point cloud data obtained by the plurality of measuring devices 5 are deleted, so that a three-dimensional image closer to the real thing can be generated without losing the texture, color, and scenery of the structure.
[0073] By increasing the height of the measuring device 5, the scanning density can be reduced and the scanning time can be shortened. This allows the data volume of the point cloud data to be reduced. When the point cloud data is transferred, the transfer time is also shortened. This improves the work efficiency and reduces the work cost.
[0074] (Second embodiment) The three-dimensional image generating method of this embodiment is similar to the above embodiment except that measurement conditions are specified in the point cloud data generating step.
[0075] The texture and color of a three-dimensional image of a structure are greatly affected by the scanning environment, such as the weather, time of day, season, the position and angle of the sun, and the presence or absence of sunlight. Scanning for one location takes about 3 to 15 minutes, depending on the density of the point cloud to be scanned. Therefore, especially outdoors, if the sun repeatedly disappears behind clouds during scanning, the sunlight varies, so the way the shadows are formed on the measurement target, the way the light hits the target, and the intensity of the light vary by the second, making it difficult to reproduce the texture and color. In addition, when the number of scans is large, the way the shadows are formed varies depending on the time of day, and even if one building is scanned, the shadows will be unnatural between the morning and afternoon scans, making it difficult to reproduce the texture and color.
[0076] Due to these problems, in this embodiment, the point cloud data generation process in step S101 is preferably performed when the weather is cloudy, and may be performed even in rainy weather if indoors. Furthermore, it is preferable to align the time period for performing the point cloud data generation process in step S101 for each part of the structure. For example, if the target is a cultural property, the cultural property architectural part and its associated parts such as earthen walls are differentiated, and the measurement time period is aligned for each part.
[0077] Furthermore, in the point cloud data generation process of step S101, when the sunlight is oblique, the measuring device 5 is installed in a position where the shadow of the measuring device 5 is not captured. Furthermore, when the wind strength is equal to or lower than a predetermined wind speed, it is preferable to perform scanning of outdoor structures. The predetermined wind speed is preferably, for example, equal to or lower than a value (e.g., 6 m / s) at which the measuring device 5 is not swayed by the wind.
[0078] Depending on the appearance of shadows, it may be better to limit the time period during which scanning is performed. For example, in an example in which each part of a structure consists of object A and object B, object A can be scanned "only in the morning" and object B can be scanned "only in the evening." This will standardize the way shadows are cast for each object, and the intensity of the light will also be standardized, bringing out the texture and color. Also, when the sun is low in the sky (in the case of so-called oblique light), there is a possibility that the shadows of the main body of the measuring device 5 or the tripod will be captured in the image, so the position of the measuring device 5 should be selected so that these will not be captured.
[0079] Indoors, light coming in through windows or openings may affect the texture and color. If there is a possibility of an effect, take the same measures as outdoors. Indoors, it is preferable to keep the lighting constant.
[0080] Furthermore, in the point cloud data generating process of step S101, if the structure includes a reflective surface, the measuring device 5 is placed at a position where the reflective surface is not reflected.
[0081] For example, if a structure includes a reflective surface such as a window glass or a mirror, the image of the object reflected in the reflective surface will be included in the point cloud data. Therefore, when installing the measuring device 5, a position where no reflection is present in the reflective surface is selected.
[0082] As described above, according to this embodiment, it is possible to perform efficient scanning taking into account the weather and time of day, and to prevent the texture and color from being damaged by light intensity and shadows.
[0083] (Third embodiment) This embodiment is the same as at least one of the above-mentioned embodiments, except that in order to execute the method of generating a three-dimensional image of the above-mentioned embodiment, a guidance device 200 is provided that outputs guidance to an operator on the method of generating a three-dimensional image.
[0084] FIG. 15 is a functional block diagram showing a logical configuration of a guidance device 200 of the present embodiment. The guidance device 200 of this embodiment is preferably realized by, for example, a portable terminal device so that a worker can use it on-site. The guidance device 200 is, for example, a smartphone, a tablet terminal, a notebook personal computer, or a PDA (Personal Digital Assistant). These terminal devices are realized by the computer 60 of FIG. 2 described above. Alternatively, in the case of guidance for three-dimensional image processing described later, the guidance device 200 may be included in the three-dimensional image generating device 100.
[0085] When executed on the computer 60, the program 80 for realizing the guidance device 200 causes the computer 60 to realize the guidance device 200. The program 80 causes the computer 60 to execute a procedure for presenting guidance to the operator on a method for generating a three-dimensional image.
[0086] The guidance device 200 of the present embodiment may be realized by installing and executing an application program for realizing the guidance device in the computer 60. Alternatively, the guidance device 200 may be realized by starting a program such as a browser on the computer 60, accessing a predetermined website, and displaying content including the contents of the guidance. It is preferable that the predetermined website can be accessed by logging in by inputting authentication information (such as a user ID and password) previously registered by the user, for example.
[0087] The guidance device 200 includes a presentation unit 202 that presents guidance to an operator to execute the three-dimensional image generating method described in the above embodiment.
[0088] The guidance is presented by content including at least one of sound, image, video, and text. The presentation unit 202 outputs the guidance to an output device 74 including at least one of a display for displaying a screen and a speaker for outputting sound, and also receives operations from an operation unit for receiving an operator's operation, for example, an input device 72 including at least one of a touch panel, an operation switch, a keyboard, and the like. The operation unit also includes a graphical user interface (GUI (Graphical User Interface)) displayed on the display.
[0089] The guidance includes the necessary procedures and precautions when workers perform measurement work on-site, as well as the necessary procedures and precautions when processing three-dimensional images.
[0090] <Guidance for eliminating blind spots> The locations of the measuring devices 5 are announced for each cultural property and its associated objects. Specifically, first, an announcement is made that the measuring devices 5 are to be placed around the cultural property at a predetermined interval and at different heights. Recommended interval and height settings may also be announced. Recommended scanning density and time may also be announced.
[0091] Next, an announcement is made that measuring devices 5 are to be placed around the auxiliary object at predetermined intervals and at different heights. Recommended interval and height settings may be announced. Recommended scanning density and time may be announced. An announcement is made that it is preferable to place measuring devices 5 at both higher and lower positions than the structure.
[0092] It is also announced that it is preferable to alternate between high and low positions. Furthermore, it is announced that the interval between the measuring devices 5 placed at a position higher than the structure should be wider than the interval between the measuring devices 5 placed at a position lower than the structure. Furthermore, it is announced that the density of the point cloud data acquired by the measuring device 5 placed at a position higher than the structure should be set lower than the density of the point cloud data acquired by the measuring device 5 placed at a position lower than the structure.
[0093] A screen for selecting the measurement target (for example, selecting either a cultural property or ancillary objects) may be presented, the selection may be prompted, and after the selection is accepted, guidance for the installation location of the corresponding measuring device 5 may be selected and presented. As described in the above embodiment, the placement method of the measuring device 5 and the recommended values for scanning density and time are changed and presented depending on whether the target is a cultural property or ancillary objects.
[0094] In another example, a selection of a type of structure (gate, staircase, approach to a building, torii gate, main hall, etc.) may be accepted, and guidance may be provided suggesting an installation position of the measuring device 5 according to the accepted type of structure. Also, whether or not the structure has a beam may be accepted, and if a beam is present, the measuring device 5 may be positioned so that the back side of the beam can be measured, and guidance may be provided.
[0095] For example, when measuring a gate of a structure as shown in Fig. 5, first, it is announced that measuring devices 5 will be placed in a row below and in front of the gate. Next, it is announced that measuring devices 5 will be placed at a higher position than the first placed measuring device 5 in order to eliminate blind spots behind the beams on the underside of the gate's roof. Furthermore, it may be announced that measuring devices 5 will be placed in positions where the exterior of the gate can be measured from a position away from the gate. Also, in the case of stairs, it may be announced that measuring devices 5 will be placed at different heights in positions where each step and riser of the stairs can be measured.
[0096] <Guidance for ensuring texture and color> The weather forecast for the measurement date and time is presented, announcing that cloudy weather is most preferable, followed by rainy weather. Also, the cloudy hours on the measurement date and the fact that it is preferable to measure outdoors during those hours are announced. Alternatively, the rainy hours on the measurement date and the fact that it is preferable to measure indoors during those hours are announced.
[0097] Specifically, the presentation unit 202 displays a screen for receiving input of the measurement date and time and the measurement location to the operator, outputs a message prompting the operator to input, and receives the input by the operator operating the screen. Then, the presentation unit 202 accesses a weather forecast website based on the input measurement date and time and measurement location to obtain weather forecast information. Then, the presentation unit 202 presents the obtained weather forecast information and also provides guidance.
[0098] Also, the recommended scanning density and time of the measuring device 5 may be changed depending on the weather, such as sunny or cloudy. Furthermore, wind speed information may be obtained from a weather forecast. If the wind speed at the measurement date and time is equal to or greater than a predetermined value, an announcement may be made that outdoor measurement is not suitable. Alternatively, if the wind speed varies depending on the time of day, a message may be presented recommending that outdoor measurement be performed during a time period when the wind speed is less than a predetermined value.
[0099] If the measurement date and time is during a time period of oblique light, an announcement is made to select a location for installing the measuring device 5 in a position where the shadow of the measuring device 5 body or tripod will not be reflected in the image. If the weather is fine or the measurement is indoors, a selection is accepted as to whether or not the structure has a reflective surface (window glass or mirror), and if there is a reflective surface, an announcement is made to select a location for installing the measuring device 5 in a position where the image will not be reflected in the reflective surface.
[0100] <Guidance on image processing for 3D image generation> 7 to 12 in the above embodiment, the guidance device 200 may provide guidance on a method for deleting overlapping portions of point cloud data acquired from a plurality of measuring devices 5. The guidance device 200 may further include a detection unit (not shown) that detects overlapping portions of point cloud data.
[0101] The guidance for deleting overlapping parts of the point cloud data may be configured as follows: For example, when generating point cloud data from measurement values acquired on-site from the measuring device 5, the presenting unit 202 may obtain overlapping parts from the measurement positions of the measuring device 5, output a message inquiring whether to delete the point cloud data of the overlapping parts, accept an operation as to whether to delete, and perform a process of deleting the overlapping parts when the operation of deleting is accepted.
[0102] According to this configuration, since overlapping portions can be deleted when generating point cloud data, it is possible to reduce the data volume of the point cloud data acquired by the point cloud data acquisition unit 102 of the 3D image generation device 100. Since the data transfer volume from the measuring device 5 to the 3D image generation device 100 can be reduced, it is possible to shorten the transfer time. Alternatively, it is possible to reduce the data volume of the recording medium to which the point cloud data is written from the measuring device 5, thereby shortening the time required to write or read data to or from the recording medium.
[0103] Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various configurations other than those described above can also be adopted. For example, the method for generating a three-dimensional image according to the above embodiment may further include a scanning planning step of planning the measurement conditions, the installation position of the measuring device 5, the scanning density, time, and the like in advance before performing the method on-site. The presentation unit 202 of the guidance device 200 according to the above embodiment may further present guidance for causing the operator to perform the scanning planning step. In other words, the presentation unit 202 may present guidance including the contents required for making a scanning plan in advance.
[0104] In this scanning planning process, the measurement conditions of this embodiment and the installation position of the measuring device 5 of the above embodiment are appropriately combined. It is preferable to consider the time period during which scanning is performed for each target in advance. For example, the constraint conditions of the time period during which scanning is performed for each target are considered. It is preferable to predict the weather in advance using a weather forecast and make a scanning plan. For example, when scanning target A, which is the measurement target of the cultural property building itself, target B such as a mud wall that is an accessory to the cultural property, and target C indoors outdoors, if the weather forecast is cloudy in the morning and sunny in the afternoon, a plan is made to scan target A and target B in the morning and target C in the afternoon.
[0105] In addition, the scanning plans for targets A and B are made by distinguishing between the installation position of the measuring device 5 and the scanning accuracy and time for target A, which is the measurement target itself, and target B, which is an associated object.
[0106] Although the present invention has been described above with reference to the embodiments and examples, the present invention is not limited to the above-mentioned embodiments and examples. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.
[0107] Below, examples of reference forms are given. 1. A point cloud data generation process for generating a plurality of point cloud data representing shapes and colors of different portions of the structure by measuring the structure a plurality of times while varying the installation position of a measuring device in at least one of the horizontal and vertical directions; a three-dimensional image generating step of generating a three-dimensional image of the structure by processing the plurality of point cloud data; A method for generating a three-dimensional image, comprising: 2. In the method for generating a three-dimensional image according to 1., A method for generating a three-dimensional image, wherein in the point cloud data generation step, in two pieces of point cloud data obtained by measuring adjacent parts, the two adjacent parts partially overlap each other. 3. In the method for generating a three-dimensional image according to 2., A three-dimensional image generating method, comprising the steps of: deleting at least a part of the overlapping portion when combining the point cloud data acquired by the plurality of measuring devices in the three-dimensional image generating step. 4. In the method for generating a three-dimensional image according to any one of 1. to 3., A three-dimensional image generating method, comprising: disposing the measuring device at a position higher than the structure when generating at least a portion of the point cloud data in the point cloud data generating step. 5. In the method for generating a three-dimensional image according to 4., A three-dimensional image generating method, wherein in the point cloud data generating step, the installation position of the measuring device is alternately repeated between a position higher than the structure and a position lower than the structure. 6. In the method for generating a three-dimensional image according to any one of 1. to 5., A method for generating a three-dimensional image, wherein, in the point cloud data generation process, the distance between the measuring devices arranged at a position higher than the structure is wider than the distance between the measuring devices arranged at a position lower than the structure. 7. In the method for generating a three-dimensional image according to 6., A method for generating a three-dimensional image, wherein, in the point cloud data generation process, the density of the point cloud data acquired by the measuring device positioned at a position higher than the structure is set to be lower than the density of the point cloud data acquired by the measuring device positioned at a position lower than the structure. 8. In the method for generating a three-dimensional image according to any one of 1. to 7., The point cloud data generating step is performed when the weather is cloudy. 9. In the method for generating a three-dimensional image according to any one of 1. to 8., A method for generating a three-dimensional image, comprising: aligning a time period during which the point cloud data generation process is performed for each part of the structure. 10. In the method for generating a three-dimensional image according to any one of 1. to 9., In the point cloud data generating step, A method for generating a three-dimensional image, comprising the steps of: when the sunlight is oblique, placing the measuring device in a position where the shadow of the measuring device is not captured. 11. In the method for generating a three-dimensional image according to any one of 1. to 10., In the point cloud data generating step, A method for generating a three-dimensional image, in which, when the structure includes a reflective surface, the measuring device is positioned at a position where the reflective surface is not reflected. 12. In the method for generating a three-dimensional image according to any one of 1. to 11., The structure includes at least one of cultural properties, temples and shrines, world heritage sites (certified by the World Heritage Committee), industrial heritage sites (certified by the International Committee for the Conservation of Industrial Heritage), modern industrial heritage sites (certified by the Ministry of Economy, Trade and Industry), civil engineering heritage sites (recommended by the Japan Society of Civil Engineers), scenic spots, topography, or historical buildings and ruins that need to be preserved for future generations, The three-dimensional image generating method is intended to convey the texture and color of the structure to future generations.
[0108] 13. A point cloud data acquisition means for acquiring a plurality of point cloud data representing shapes and colors of different parts of a structure by measuring the structure a plurality of times while varying at least one of the horizontal and vertical directions of a measuring device, the point cloud data being generated by the three-dimensional image generating method described in any one of 1. to 12.; and a three-dimensional image generating means for generating a three-dimensional image of the structure by processing the plurality of point cloud data. 14. A program for causing a computer to realize the three-dimensional image generating device described in 13. 15. A guidance device comprising a presentation means for presenting guidance to an operator on a method for generating a three-dimensional image in order to carry out the three-dimensional image generation method described in any one of 1. to 12. 16. A program for causing a computer to realize the guidance device described in 15. [Explanation of symbols]
[0109] 1. Image Processing System 3. Communication Network 5, 5a, 5b, 5c, 5d, 5e measuring device 10 Small beam 60 Computer 62 CPU 64 Memory 66 Storage 68 I / O 69 Bus 70 Communication I / F 72 Input Devices 74 Output Device 80 Programs 100 Three-dimensional image generation device 102 Point cloud data acquisition section 104 Image Generation Unit 110 Storage device 200 Guidance Device 202 Presentation section A, B, C target h1, h2 height La, Lb, Lc, Ld, Le position R1, R2, R11, R12, R21, R22, R31, R32, R33, R34 area S star mark S101 Point cloud data generation process S103 Three-dimensional image generation process
Claims
1. One or more computers a point cloud data generating step of measuring a structure a plurality of times with the measuring device while varying the installation position of the measuring device in at least one of the horizontal and vertical directions, thereby generating a plurality of point cloud data representing shapes and colors of different portions of the structure; a three-dimensional image generating step of generating a three-dimensional image of the structure by processing the plurality of point cloud data; Run In the point cloud data generating step, A three-dimensional image generating method, in which, when the sunlight is oblique, the measuring device is installed in a position where the shadow of the measuring device is not cast, and the multiple point cloud data are generated by having the measuring device measure the structure multiple times.
2. One or more computers a point cloud data generating step of measuring a structure a plurality of times with the measuring device while varying the installation position of the measuring device in at least one of the horizontal and vertical directions, thereby generating a plurality of point cloud data representing shapes and colors of different portions of the structure; a three-dimensional image generating step of generating a three-dimensional image of the structure by processing the plurality of point cloud data; Run In the point cloud data generating step, A three-dimensional image generating method, in which, when the structure includes a reflective surface, the measuring device is positioned in a position where no objects other than the structure are reflected on the reflective surface, and the multiple point cloud data are generated by having the measuring device measure the structure multiple times.
3. 3. The method for generating a three-dimensional image according to claim 1, A method for generating a three-dimensional image, wherein in the point cloud data generation step, in two pieces of point cloud data obtained by measuring adjacent portions, the two adjacent portions partially overlap each other.
4. The method for generating a three-dimensional image according to claim 3, In the three-dimensional image generating step, A method for generating a three-dimensional image, wherein the one or more computers delete at least a portion of the overlapping portions when combining the point cloud data acquired by the multiple measuring devices.
5. The method for generating a three-dimensional image according to any one of claims 1 to 4, In the point cloud data generating step, A method for generating a three-dimensional image, in which the one or more computers generate at least a portion of the point cloud data by positioning the measuring device at a height higher than the structure and having the measuring device measure the structure multiple times, thereby generating at least a portion of the point cloud data.
6. The method for generating a three-dimensional image according to claim 5, the one or more computers, A three-dimensional image generating method, in which, in the point cloud data generating process, the measuring device is installed at a position that is alternately higher than the structure and lower than the structure, and the measuring device is caused to measure the structure multiple times, thereby generating the multiple point cloud data.
7. The method for generating a three-dimensional image according to any one of claims 1 to 6, the one or more computers, The method for generating a three-dimensional image, wherein the point cloud data generating step is performed when the weather is cloudy.
8. The method for generating a three-dimensional image according to any one of claims 1 to 7, the one or more computers, A three-dimensional image generating method, comprising: performing the point cloud data generating step in a time zone that is aligned for each portion of the structure.
9. The method for generating a three-dimensional image according to any one of claims 1 to 8, The structure includes at least one of cultural properties, temples and shrines, world heritage sites, industrial heritage sites, modern industrial heritage sites, civil engineering heritage sites, scenic spots, topography, or historical buildings and ruins that need to be preserved for future generations, The three-dimensional image generating method is intended to convey the texture and color of the structure to future generations.
10. a point cloud data acquisition means for acquiring a plurality of point cloud data representing shapes and colors of different portions of a structure by measuring the structure a plurality of times while varying at least one of the horizontal and vertical installation positions of a measuring device, the point cloud data being generated by the three-dimensional image generating method according to any one of claims 1 and 3 to 9; a three-dimensional image generating means for generating a three-dimensional image of the structure by processing the plurality of point cloud data, The point cloud data acquired by the point cloud data acquisition means is When sunlight is oblique, the three-dimensional image is acquired by performing measurements using a measuring device installed in a position where the shadow of the measuring device is not cast.
11. a point cloud data acquisition means for acquiring a plurality of point cloud data representing shapes and colors of different portions of a structure by measuring the structure a plurality of times while varying at least one of an installation position of a measuring device in a horizontal direction and a vertical direction, the point cloud data being generated by the three-dimensional image generating method according to any one of claims 2 to 9; a three-dimensional image generating means for generating a three-dimensional image of the structure by processing the plurality of point cloud data, The point cloud data acquired by the point cloud data acquisition means is A three-dimensional image generating device in which, when the structure includes a reflective surface, the image is obtained by measuring the reflective surface using the measuring device positioned in a position where no objects other than the structure are reflected on the reflective surface.
12. A program for causing a computer to realize the three-dimensional image generating device according to claim 10 or 11.
13. A guidance device comprising: a presentation unit that presents guidance of a three-dimensional image generating method to an operator in order to execute the three-dimensional image generating method according to any one of claims 1 to 9.
14. A program for causing a computer to realize the guidance device according to claim 13.
Citation Information
Patent Citations
Power source device for consumable electrode type pulse welding
JP1986003672A
Surveyed two-dimensional figure forming method and system of ruins legacy or the like
JP2004012221A
Automatic generation device and automatic generation method of three-dimensional shape, program and storage medium recording the program
JP2004272459A
Method and device for changing construction plan using three-dimensional laser scanner
JP2007277813A
Finished work confirming system, finished work confirmation program, and finished work confirmation method
JP2010085131A
