Survey information processing method

The method improves the alignment of three-dimensional models on construction site images by using reference point measurement and correction steps, ensuring precise superimposition and accurate construction information sharing.

JP2024163524APending Publication Date: 2024-11-22CONSTR SYST CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023079221
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-12
Publication Date
2024-11-22

Smart Images

  • Figure 2024163524000001_ABST
    Figure 2024163524000001_ABST
Patent Text Reader

Abstract

To provide a survey information processing method in which a three-dimensional model of a construction can be more accurately overlapped on an image of a construction site.SOLUTION: A survey information processing method comprises: an initial image creation step for creating an initial overlapping image; an initial reference point measurement step for determining a prescribed initial reference point on the initial overlapping image and for measuring its public coordinates; an initial correction step for correcting the position and / or direction of a three-dimensional model on the initial overlapping image so that a point on the public coordinates corresponding to the initial reference point overlaps the initial reference point on the initial overlapping image; a reference point measurement step for determining a reference point different from the initial reference point on the overlapping image in which the three-dimensional model of a construction is overlapped on the image of a construction site displayed on a terminal and for measuring its public coordinates; and a correction step for correcting the position and / or direction of the three-dimensional model on the overlapping image on the basis of the reference point with its public coordinates measured. The reference point measurement step and the correction step are performed at least one time.SELECTED DRAWING: Figure 8
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a survey information processing method for processing survey information acquired by surveying. [Background technology]

[0002] Conventionally, there is known an information processing method including the steps of capturing an image of a construction site using an imaging unit of an information processing device, acquiring measurement information indicating the positions of indices placed in the construction site, associating the positions of the indices in the captured image with the positions of the indices indicated by the acquired measurement information, and converting three-dimensional data of a building and generating an image in which the converted three-dimensional data of the building is superimposed on the image captured by the imaging unit. This information processing method makes it easier to increase the accuracy of superimposing data of a three-dimensional model on the captured image while suppressing the processing load of a measuring instrument (for example, see Patent Document 1).

[0003] Also, a measurement processing method including the steps of photographing a real space, superimposing and displaying the photographed real space and a virtual space represented by three-dimensional data, acquiring a measurement point from a position specifying device that measures a three-dimensional position in the real space, photographing the position specifying device, detecting the photographed position specifying device by image recognition, acquiring the position coordinates in the virtual space of the detected position specifying device, associating the acquired position coordinates in the virtual space of the position specifying device with the position coordinates of the measurement point in the acquired real space, and converting the coordinates of the three-dimensional data into position coordinates in the real space by a predetermined conversion formula is also known. The measurement processing method can easily generate three-dimensional data to be surveyed without requiring special surveying technology, and can accurately replace the position coordinates of the virtual space composed of three-dimensional data with latitude, longitude, and altitude information of the real space with a simple operation (for example, see Patent Document 2).

[0004] In recent years, there have been known examples of using the techniques described in Patent Documents 1 and 2 to visualize a public construction after completion by displaying a construction site, such as a road, on a terminal screen, etc., and superimposing a three-dimensional model showing the expected design of the public construction after completion on the display. However, in such examples, in practice, it may be difficult for those involved in the construction site to accurately superimpose the three-dimensional model on the display. Such problems may lead to inconveniences such as those involved being unable to predict the three-dimensional model at each construction stage of the construction, resulting in wasted work, or those involved being unable to fully understand the information related to the construction, resulting in defects in the construction. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent No. 6733127 [Patent Document 2] Patent No. 6928217 Summary of the Invention [Problem to be solved by the invention]

[0006] The technology disclosed herein has been developed in consideration of the above-mentioned circumstances, and its purpose is to provide a surveying information processing method that makes it possible to more accurately superimpose a three-dimensional model of a building on an image of a construction site. [Means for solving the problem]

[0007] The present disclosure for solving the above problems is as follows: A portable terminal displays an image of a construction site for constructing a building, and the an initial image generating step of generating an initial superimposed image on which a three-dimensional model is superimposed; an initial reference point measuring step of determining a predetermined initial reference point in the initial superimposed image generated in the initial image generating step and measuring public coordinates of the initial reference point; an initial correction step of correcting a position and / or an orientation of the three-dimensional model in the initial superimposed image so that a point in the three-dimensional model corresponding to the public coordinates of the initial reference point overlaps with the initial reference point in the initial superimposed image; a reference point measuring process for determining a reference point different from the initial reference point in a superimposed image, which is displayed on the terminal and in which the 3D model of the building is superimposed on an image of the construction site, and measuring the public coordinates of the reference point; a correction step of correcting a position and / or an orientation of the three-dimensional model in the superimposed image based on the reference point whose public coordinates are measured in the reference point measurement step; having The present invention includes a surveying information processing method, characterized in that the reference point measuring step and the correction step are performed at least once.

[0008] That is, in the above-mentioned survey information processing method, in the initial image generation step, an initial superimposed image is generated by superimposing a three-dimensional model of the construction on an image of the construction site. Here, the coordinates in the image of the site are determined as coordinates specific to the terminal, and the coordinates are determined at all positions within the screen of the terminal. In contrast, the coordinates in the three-dimensional model are public coordinates determined in advance in the design stage. Usually, in the initial image generation step, a difference occurs between these coordinates, so that the three-dimensional model is displayed on the terminal superimposed in a state in which its position and direction are shifted from the image of the site. Therefore, in the initial reference point measurement step, the public coordinates of a predetermined initial reference point are measured, and in the initial correction step, a point in the three-dimensional model corresponding to the public coordinates of the initial reference point is superimposed on the initial reference point in the initial superimposed image, thereby correcting the position of the three-dimensional model. At this time, directions (more specifically, the directions of east, west, north and south) are fixed in the 3D model, but directions are not fixed in the image of the construction site (for example, it is unclear which direction is north in the image), so a correction may also be performed to match the direction in the initial overlay image with the direction in the 3D model. This improves the accuracy of overlaying the 3D model on the image of the construction site. Note that construction includes not only architecture, which means erecting a building, but also civil engineering work.

[0009] However, when an image of the construction site at a position other than the initial reference point is acquired, there is a risk that the three-dimensional model is superimposed and displayed on the terminal in a state where the position and direction are shifted from the image. This is because, in the initial superimposed screen, the position and direction of the three-dimensional model are corrected based on the initial reference point, and an error may occur for a point away from the initial reference point. In order to reduce this error, a new reference point is determined in the reference point measurement process, and its public coordinates are measured, and the position and / or direction of the three-dimensional model is corrected in the correction process based on the reference point whose public coordinates are measured in the reference point measurement process. As a result, it is possible to further improve the accuracy of superimposing the three-dimensional model on the image of the construction site. And, by executing the reference point measurement process and the correction process at least once or more, it is possible to further improve the accuracy of superimposing the three-dimensional model on the image of the construction site.

[0010] Since the 3D model is a prediction of the design of the structure to be constructed at the construction site, the accuracy of superimposing the 3D model on the image of the construction site is very important in accurately sharing information about the structure among the related parties. The survey information processing method disclosed herein makes it possible to more accurately superimpose the 3D model of the structure on the image of the construction site, and thus makes it possible to more accurately share information about the structure.

[0011] In the present disclosure, the public coordinates measured in the initial reference point measurement step and / or the reference point measurement step are obtained by disposing a survey prism at the construction site, The measurement may be performed by measuring the position of the survey prism using a total station installed at the known public coordinates at a position away from the survey prism. This makes it possible to obtain measurement information indicating the public coordinates with high accuracy and ease.

[0012] In addition, in the present disclosure, the initial reference point in the initial reference point measurement step and the reference point in the reference point measurement step may be determined by capturing an image of a marker fixed to the survey prism with an imaging device mounted on the terminal. This makes it possible to easily measure public coordinates for terminal-specific coordinates that can be obtained by capturing an image of the marker. Although there may be an offset in the installation locations of the survey prism and the marker, the coordinates of the initial reference point and the reference point in the terminal obtained by capturing an image of the marker are corrected so that the offset is cancelled, thereby preventing a decrease in measurement accuracy due to differences in the installation locations of the survey prism and the marker.

[0013] In the present disclosure, the initial correction step may include correcting the position of the three-dimensional model so that a point in the three-dimensional model corresponding to the public coordinates of the initial reference point overlaps with the initial reference point in the initial superimposed image, and correcting the orientation of the three-dimensional model by rotating the three-dimensional model around the initial reference point after the correction of the position of the three-dimensional model so that a point in the three-dimensional model corresponding to the public coordinates of the point where the total station is installed overlaps with the point where the total station is installed in the initial superimposed image. This makes it possible to more easily and accurately associate the coordinates in the image of the construction site with the public coordinates regarding the orientation of the three-dimensional model.

[0014] Furthermore, in the present disclosure, the surveying prism may be provided with a first index that should be pointed toward the total station during measurement, and the marker may be provided with a second index indicating the same direction as the first index, and in the initial correction process, the position of the three-dimensional model may be corrected so that a point in the three-dimensional model corresponding to the public coordinates of the initial reference point overlaps with the initial reference point in the initial overlay image, and the orientation of the three-dimensional model may be corrected based on the direction indicated by the second index captured by the imaging device of the terminal when the first index in the surveying prism is pointed toward the total station. In addition, in the present disclosure, in the initial correction step, the position of the three-dimensional model may be corrected so that a point in the three-dimensional model corresponding to the public coordinates of the initial reference point overlaps with the initial reference point in the initial superimposed image, and the orientation of the three-dimensional model may be corrected based on the orientation of the carrying pole captured by the imaging device of the terminal when the survey prism and a carrying pole connected to the survey prism are tilted toward the total station at the initial reference point. That is, there are multiple methods for correcting the orientation of a three-dimensional model, and any of the methods makes it possible to associate coordinates in the image of the construction site with public coordinates with high accuracy, as described above, for the orientation of the three-dimensional model.

[0015] Also, in the present disclosure, in the correction process, the position and / or orientation of the three-dimensional model may be corrected based on a calculation to which a predetermined weight is applied to the public coordinates of the reference point and the public coordinates of the reference point determined in the reference point measurement process one step before the reference point measurement process. Also, in the present disclosure, in the correction process, the position and / or orientation of the three-dimensional model may be corrected based on a calculation to which a predetermined weight is applied to the public coordinates of the reference point and the initial reference point determined in the initial reference point measurement process and / or the public coordinates of the reference point determined in the reference point measurement process executed in the past. In either case, the coordinates in the image of the construction site and the public coordinates are accurately superimposed, and the three-dimensional model is fitted to the image of the site. It is possible to further improve the accuracy of superimposing on the image.

[0016] The above means for solving the problems can be used in combination with each other whenever possible. Effect of the Invention

[0017] According to the technology disclosed herein, it is possible to superimpose a three-dimensional model of a building onto an image of a construction site with greater accuracy. [Brief description of the drawings]

[0018] [Figure 1] FIG. 1 is a schematic diagram showing an example of a system configuration of a survey information processing device used in a survey information processing method according to an embodiment, for example, in the case where a total station is used for surveying. [Diagram 2] FIG. 2 is a schematic diagram showing an example of a method for measuring public coordinates of a reference point in a case where a total station and a measurement prism are used according to an embodiment. [Diagram 3] FIG. 3 is a first diagram for explaining the procedure of the survey information processing method according to the embodiment. [Figure 4]FIG. 4 is a second diagram for explaining the procedure of the survey information processing method according to the embodiment. [Diagram 5] FIG. 5 is a third diagram for explaining the procedure of the survey information processing method according to the embodiment. [Figure 6] FIG. 6 is a fourth diagram for explaining the procedure of the survey information processing method according to the embodiment. [Figure 7] FIG. 7 is a fifth diagram for explaining the procedure of the survey information processing method according to the embodiment. [Figure 8] FIG. 8 is a flowchart simply showing the procedure of the survey information processing method described in FIG. 3 to FIG. [Figure 9] FIG. 9 is a schematic diagram showing an example of a method for correcting the position and orientation of a three-dimensional model in a survey information processing method according to a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] [Example] Hereinafter, a survey information processing method according to an embodiment of the present disclosure will be described in detail with reference to the drawings. Note that the survey information processing method according to the embodiment of the present disclosure is not intended to be limited to the following configuration.

[0020] <System configuration> FIG. 1 is a schematic diagram showing an example of a system configuration of a survey information processing device 1 used in a survey information processing method according to an embodiment, for example, when a total station 2 is used for surveying. The survey information processing device 1 is realized by installing an application on, for example, a tablet terminal. Then, at a construction site (hereinafter simply referred to as a "site") where a public construction such as a road is to be constructed, the public coordinates of a predetermined reference point (shown in FIG. 2 described later) that is essential for constructing the public construction are grasped, and a three-dimensional model 4 of the construction (shown in FIG. 3 described later) is superimposed on an image of the construction site for confirmation. Here, the public coordinates are absolute coordinates based on the origin on a coordinate system managed by the country. The survey information processing device 1 is operated by a user such as a person involved in the construction. The device on which the application for realizing the survey information processing device 1 is installed is not limited to a tablet terminal, and may be a smartphone or a PC.

[0021] The surveying information processing device 1 of this embodiment is configured to include a camera 11, an acquisition unit 12, a RAM (Random Access Memory) 13, a storage unit 14, a communication unit 15 that sends and receives data by communicating with external devices such as a total station 2, an operation unit 16 such as a touch panel that accepts user operations, a creation unit 17, and a display 18 that displays information related to the site so that the user can view it.

[0022] The acquisition unit 12 acquires a captured image of the site from the camera 11, and also acquires measurement information indicating the position coordinates of a reference point in the captured image from the communication unit 15. A method for measuring the position coordinates of a reference point will be described later with reference to FIG. 2. The storage unit 14 may include a portable storage medium such as an SD card. The information stored in the storage unit 14 can also be stored in an external database provided on a cloud.

[0023] The creation unit 17 creates a three-dimensional model 4, which is a model of the public construction after completion, from the CAD data stored in the storage unit 14, based on the appearance of the site and the public coordinates of the site measured using the total station 2. The acquisition unit 12 can acquire this three-dimensional model 4 together with the captured image of the site acquired by the camera 11. The display 18 can virtually superimpose an image of the three-dimensional model 4 (hereinafter also simply referred to as the three-dimensional model 4) on the captured image of the site and display it. Also, the display 18 displays the three-dimensional model 4 corrected to match the captured image of the site. Details will be described later with reference to Figs. 3 to 7.

[0024] The total station 2 used in this embodiment is configured by connecting a CPU 21, a RAM 22, a ROM (Read-Only Memory) 23, a storage unit 24, a communication unit 25, an operation unit 26, a display 27, a measurement unit 28, a camera 29, etc., via a bus line. In this embodiment, the total station 2 is configured by electronic reference points, triangulation points, leveling points, etc., whose positions on the earth and heights from sea level are accurately measured, and information on known points that serve as the basis for map creation and various surveys is stored in advance in the storage unit 24. Data on a three-dimensional model 4 related to a public building to be constructed at the site may also be stored in advance in the storage unit 24.

[0025] <Surveying method> 2 is a schematic diagram showing an example of a method for measuring the public coordinates of a reference point when using a total station 2 and a measurement prism 3 according to an embodiment. The measurement prism 3 generally has an optical flat surface such as glass for reflecting light, and has a function of reflecting light irradiated from the total station 2 in the direction of irradiation. A carrying pole 31 is connected to the measurement prism 3 so that the measurement prism 3 can be carried to a reference point other than the reference point shown in FIG. 2 and the public coordinates of the reference point can be measured.

[0026] When measuring the public coordinates of a reference point, first, a total station 2 is installed at a known point (a point whose position coordinates and altitude are known and given by a national surveying agency), and a measurement prism 3 is fixed to a reference point located away from the known point. Next, the origin position of the angle is determined to specify the angle information of the target of the sighting of the telescope (not shown) of the total station 2. Specifically, the state where the target of the telescope is facing true north or the state where the user sights the reference point with the telescope may be set as the origin position of the angle. Then, the angle displayed on the display 27 of the total station 2 is set to 0. This makes it possible to measure the direction of the position of the reference point relative to the position of the known point. In addition, the altitude angle displayed on the display 27 is also set to 0. This makes it possible to measure the difference in elevation between the position of the known point and the position of the reference point.

[0027] Next, a light (e.g., laser light) is emitted from a light receiving / emitting unit (not shown) of the total station 2 to the optical flat surface of the measurement prism 3. The light is reflected from the optical flat surface and receives the reflected light. Based on the time of flight (TOF) from the emission of this irradiated light to the detection of the reflected light, the distance from the known point to the reference point can be measured. By measuring the direction of the reference point relative to the known point, the elevation difference between the known point and the reference point, and the distance from the known point to the reference point T1, it is possible to measure the public coordinates of the reference point. The measurement method shown in Figure 2 will be referred to as prism measurement hereinafter.

[0028] When using the measurement prism 3, the user may also use the surveying information processing device 1 as a tablet terminal. The surveying information processing device 1 may have a GNSS (Global Navigation Satellite System) function, which is a function for operating a global positioning system using artificial satellites (positioning satellites), and may be able to identify the position of the surveying information processing device 1 by positioning using the GNSS.

[0029] <Survey information processing method procedure> Next, the procedure of the survey information processing method according to the embodiment will be described with reference to Fig. 3 to Fig. 7. Each figure shows the display contents of the display 18 of the survey information processing device 1. Fig. 3 to Fig. 7 show a road and its surrounding land as an example of a site, and a case where a new road is to be constructed will be described.

[0030] First, as shown in Fig. 3, an image of the site is displayed on the display 18, and the creation unit 17 creates an initial superimposed image by superimposing a three-dimensional model 4, which is an image of the road after completion, on the image of the site. Here, the coordinates in the image of the site are determined as coordinates specific to the survey information processing device 1, and coordinates are determined for all positions within the display 18. Hereinafter, these coordinates are also referred to as site coordinates. In contrast, the coordinates in the three-dimensional model 4 are public coordinates that are determined in advance at the design stage.

[0031] As described above, the survey information processing device 1 may have a GNSS function, and may also have a gyro sensor capable of detecting a change in the direction of the survey information processing device 1 itself. In this case, the GNSS function and the gyro sensor simply associate the site coordinates with the public coordinates in the three-dimensional model 4, but since there is usually a difference between the site coordinates and the public coordinates, the three-dimensional model 4 is displayed on the display 18 superimposed with its position and direction shifted from the image of the site. Note that, although the image captured by the camera 11 of the survey information processing device 1 is used as the image of the site, point cloud data converted from the captured image may be used instead. The same applies to the following Figs. 4 to 7. By using the point cloud data, the site coordinates can be easily obtained.

[0032] Next, as shown in FIG. 4, preparations are made to correct the position of the three-dimensional model 4 that is displayed superimposed with its position and direction shifted from the image of the site. In FIG. 4, the location where the measurement prism 3 is installed at the site is designated as point A. The measurement prism 3 installed at point A has a simple code 5 installed. The simple code 5 is made recognizable by capturing an image of the center point of the square with a camera 11 by making a divided area at one diagonal corner of the square divided into four parts black and a divided area at the other diagonal corner white or yellow. Note that there may be an offset between the installation locations of the measurement prism 3 and the simple code 5, but the coordinates of the reference point in the image of the site obtained by capturing the simple code 5 are determined so that the offset is cancelled, and the measurement accuracy is prevented from decreasing due to the difference between the installation locations of the measurement prism 3 and the simple code 5. Here, the simple code 5 corresponds to a marker in this disclosure.

[0033] A method for correcting the position of the three-dimensional model 4 will be specifically described. First, the site coordinates of point A can be obtained by recognizing the simplified code 5 using the survey information processing device 1. Next, the public coordinates of the measurement prism 3 are measured by prism measurement. Based on this result, it is possible to obtain the on-site coordinates and public coordinates of point A. Meanwhile, point B is defined as a point in the three-dimensional model 4 that corresponds to the public coordinates of point A. Point B can be defined from the public coordinates previously determined for the three-dimensional model 4 in the design stage. Then, the three-dimensional model 4 is moved on the image so that point B overlaps with point A. This makes it possible to accurately align the image of the on-site with the three-dimensional model 4 at least at point A. Here, this point A corresponds to the initial reference point in this disclosure. Furthermore, the movement of point B is performed based on a calculation using a transformation matrix.

[0034] By overlapping the coordinates of points A and B as described above, it is possible to correct the position of the three-dimensional model 4 as shown in FIG. 5. However, by simply fixing one point, it is difficult to accurately associate the on-site coordinates and the public coordinates with respect to the direction of the three-dimensional model 4. That is, at this point, it is difficult to accurately identify, for example, which direction in the on-site coordinates is north. Therefore, it is necessary to rotate the three-dimensional model 4 around point A to match the directions of the on-site coordinates and the public coordinates.

[0035] A method of correcting the direction of the three-dimensional model 4 so that it coincides with the direction of the site coordinates will be described with reference to FIG. 5. The public coordinates in the three-dimensional model 4, which correspond to the site coordinates of the total station 2, are displayed by star marks on the display 18, for example, as shown in FIG. 5. When correcting the direction in the site coordinates, the three-dimensional model 4 is rotated around a previously fixed point (i.e., an initial reference point obtained by superimposing point B on point A) so that the star mark overlaps with the total station 2 on the image. This corrects the direction of the three-dimensional model 4, making it easy to associate the site coordinates and the public coordinates with high accuracy for the direction of the three-dimensional model 4. Note that the mark indicating the public coordinates corresponding to the site coordinates of the total station 2 is not limited to a star mark.

[0036] The method of correcting the direction of the three-dimensional model 4 is not limited to the above. As another method, for example, as described later with reference to FIG. 6, in addition to the above initial reference point, an image of a location away from the position of this reference point may be acquired, a new reference point may be determined in the same manner, and the direction of the three-dimensional model 4 may be corrected based on these two reference points. Also, by tilting the carrying pole 31 of the measurement prism 3 toward the direction in which the total station 2 is installed, the direction from the reference point to the known point where the total station 2 is installed may be obtained in the on-site coordinates, and the direction of the three-dimensional model 4 may be corrected. Either method makes it easy to associate the on-site coordinates with the public coordinates with high accuracy regarding the direction of the three-dimensional model 4.

[0037] Although the position and direction of the three-dimensional model 4 are corrected by the above procedure, there is a possibility that an error occurs between the site coordinates and the public coordinates of the three-dimensional model 4 at another location away from the initial reference point. In response to this, a method of correcting the deviation between the site coordinates and the public coordinates by using another reference point away from the initial reference point is considered. The display 18 shown in FIG. 6 displays a captured image of a location away from the site displayed on the display 18 shown in FIG. 3 to FIG. 5. The captured image of this location away from the site (hereinafter also referred to as another location) may be acquired by capturing an image after moving the survey information processing device 1, or may be acquired by capturing an image by changing only the orientation of the camera 11 without moving the survey information processing device 1. The total station 2 can track the measurement prism 3 at another location, so that the public coordinates at another location can be measured by prism measurement. Then, in the same manner as described with reference to FIG. 4, the position of the three-dimensional model 4 is corrected by moving a point on the three-dimensional model 4 to the point where the measurement prism 3 is installed and overlapping it. In this way, the point C newly determined to correct the position of the three-dimensional model 4 at another location corresponds to the reference point in this disclosure.

[0038] In addition, in Figure 6, after point C is newly determined, another point is determined as the reference point. Alternatively, point C may be determined as the final reference point. That is, a different reference point may be determined for correcting the position of the three-dimensional model 4 at another location, and the procedure of correcting the position of the three-dimensional model 4 so that a point on the three-dimensional model 4 corresponding to the different reference point overlaps with the different reference point may be performed at least once or any number of times. By repeating this procedure for different reference points, it is possible to improve the accuracy of superimposing the three-dimensional model 4 on the image of the site, for example, as shown in FIG. 7. This makes it easier to predict the public construction after completion.

[0039] Furthermore, when moving the public coordinates of the three-dimensional model 4 to the on-site coordinates corresponding to the public coordinates at a location away from the initial reference point, a predetermined weighting may be applied to the public coordinates of multiple reference points, and then the correction amount for the position and direction of the three-dimensional model 4 may be calculated. In this case, for example, two points, the latest reference point and a reference point determined one time before the latest reference point, may be used to move the points in the public coordinates of the three-dimensional model 4 corresponding to these two points so as to overlap with each point in the on-site coordinates. In this case, a weighting of 1 is applied to the latest reference point and the reference point determined one time before, and a weighting of 0 is applied to other reference points determined in the past.

[0040] Alternatively, the latest reference point and the initial reference point may be used to move the points in the public coordinates of the three-dimensional model 4 corresponding to the two points so that they overlap with the respective points in the site coordinates. In this case, a weight of 1 is assigned to the latest reference point and the initial reference point, and a weight of 0 is assigned to the other reference points determined in the past. Also, a correction amount for the position and direction of the three-dimensional model 4 may be calculated based on a plurality of reference points after assigning a smaller weight to the reference points determined before the latest reference point. In this case, for example, a weight of 1 may be assigned to the latest reference point, and weights may be assigned to the reference points determined in the past in order of decreasing ratios, such as 0.8, 0.6, and 0.4. This makes it possible to accurately overlap the site coordinates and the public coordinates, and further improve the accuracy of superimposing the three-dimensional model 4 on the image of the site. The weights defined above may be reflected in the calculation, for example, as the coefficients of each component of the matrix calculation when moving the three-dimensional model 4.

[0041] <Flowchart> FIG. 8 shows a simplified flowchart of the procedure of the survey information processing method described in FIG. 3 to FIG. 7. In this flowchart, first, in step S10, a total station 2 and a measurement prism 3 are installed at the site, and preparations are made to measure public coordinates at the site. Next, in step S11, the site is captured by the camera 11 of the survey information processing device 1, and the captured image is displayed on the display 18. As described above, point cloud data converted from the captured image may be used instead of the captured image. Next, in step S12, a three-dimensional model 4 created by the creation unit 17 or acquired from another device is superimposed on the captured image of the site to generate an initial superimposed image. Here, step S12 corresponds to the initial image generation step in this disclosure.

[0042] Next, in step S13, by recognizing the simplified code 5 and by prism measurement, the public coordinates are measured in addition to the site coordinates of the first reference point (initial reference point). Here, step S13 corresponds to the initial reference point measurement step in this disclosure. Next, in step S14, the position of the three-dimensional model 4 is corrected by overlapping a point in the public coordinates of the three-dimensional model 4 with the first reference point. This determines a single point that serves as a reference for correction. Next, in step S15, the orientation of the three-dimensional model 4 is corrected by rotating and moving the three-dimensional model 4 around this single point so that the public coordinates in the three-dimensional model 4 that correspond to the position of the total station 2 overlap with the total station 2 on the image. This makes it easy to associate the site coordinates and the public coordinates with high accuracy regarding the orientation of the three-dimensional model 4. Here, steps S14 and S15 correspond to the same in this disclosure. This corresponds to the initial correction step in the

[0043] In step S15, as described above, the orientation of the three-dimensional model 4 may be corrected by other methods. For example, the orientation of the three-dimensional model 4 may be corrected by tilting the carrying pole 31 of the measurement prism 3 in the direction in which the total station 2 is installed and capturing an image with the camera 11.

[0044] Next, another location is imaged by the camera 11, and in step S16, a reference point is determined in the same manner as in step S13, and its public coordinates are measured again. Here, step S16 corresponds to the reference point measurement step in this disclosure. Next, in step S17, the position of the three-dimensional model 4 is corrected again in the same manner as in step S14. This makes it possible to further reduce the error between the site coordinates and the public coordinates of the three-dimensional model 4. Here, step S17 corresponds to the correction step in this disclosure.

[0045] As described above, the procedure of capturing an image of another location with the camera 11, determining a reference point, measuring its public coordinates, and correcting the position and orientation of the three-dimensional model 4 may be performed at least once. That is, in step S18, it is determined whether or not to end the measurement based on whether further correction of the position and orientation of the three-dimensional model 4 is necessary. If it is determined that the measurement is not to be ended (step S18: no), the procedure returns to step S16 again, and the procedures of steps S16 and S17 may be repeated at least once. If it is determined that the measurement is to be ended (step S19: yes), the procedure of the survey information processing method is terminated. Also, in step S17, as described above, when correcting the position of the three-dimensional model 4 again, that is, when moving a point in the public coordinates of the three-dimensional model 4 to a reference point corresponding to the public coordinates, a calculation may be performed in which a predetermined weight is applied to the public coordinates of the multiple reference points.

[0046] [Modifications] Next, a method for correcting the orientation of the three-dimensional model 4 in steps S15 and S18 in Fig. 8, other than the method described in the embodiment, will be described with reference to Fig. 9. Note that the same components as those described in the embodiment are given the same reference numerals, and repeated description will be omitted.

[0047] In comparison with FIG. 4 and FIG. 6 in the embodiment, in this modified example, the measurement prism 3 is provided with a first index 61 that should be directed toward the total station 2 during prism measurement. In addition, in this modified example, instead of the simple code 5 shown in the embodiment, a code 51 is provided at a certain distance from the measurement prism 3. The difference from the simple code 5 is that the code 51 can manage on-site coordinates, and in addition, a second index 62 that indicates the same direction as the first index 61 during prism measurement is provided. The code 51 has a divided area like the simple code 5, and the second index 62 is a part of the divided area. When the first index 61 is directed toward the total station 2, the second index 62 also faces toward the total station 2, and this state is captured by the camera 11. Then, the direction of the three-dimensional model 4 can be corrected based on the direction of the second index 62 in the captured image. The method of correcting the direction of the three-dimensional model 4 in this modified example may be applied to the survey information processing method of the embodiment.

[0048] In the above embodiment, when measuring the initial reference point and the public coordinates of the reference point, prism measurement was performed using the measurement prism 3 and the total station 2. However, the method of measuring the public coordinates of the reference point in the present disclosure is not limited to this. For example, the initial reference point and the public coordinates of the reference point may be measured using a measurement pole with a high-precision GNSS function. Alternatively, the measurement may be performed using the GNSS function of the survey information processing device 1. [Explanation of symbols]

[0049] 1. Survey information processing device (tablet terminal) 11. Camera 12... Acquisition section 13. RAM 14...Storage section 15. Communications Department 16...Operation section 17. Creation Department 18. Display 2. Total Station 21. CPU 22...RAM 23. ROM 24...Storage section 25. Communications Department 26...Operation unit 27. Display 28. Measurement section 29. Camera 3. Measurement prism 31 Carrying pole 4. Three-dimensional model 5. Simplified code 51...Code 61...First indicator 62. Second Index

Claims

1. an initial image generating step of generating an initial superimposed image in which a three-dimensional model of the construction object is superimposed on an image of a construction site for constructing the construction object, the image being displayed on a portable terminal; an initial reference point measuring step of determining a predetermined initial reference point in the initial superimposed image generated in the initial image generating step and measuring public coordinates of the initial reference point; an initial correction step of correcting a position and / or an orientation of the three-dimensional model in the initial superimposed image so that a point in the three-dimensional model corresponding to the public coordinates of the initial reference point overlaps with the initial reference point in the initial superimposed image; a reference point measuring process for determining a reference point different from the initial reference point in a superimposed image, which is displayed on the terminal and in which the 3D model of the building is superimposed on an image of the construction site, and measuring the public coordinates of the reference point; a correction step of correcting a position and / or a direction of the three-dimensional model in the superimposed image based on the reference point whose public coordinates are measured in the reference point measurement step; having A surveying information processing method, comprising executing the reference point measuring step and the correction step at least once.

2. The surveying information processing method according to claim 1, characterized in that the public coordinates measured in the initial reference point measurement process and / or the reference point measurement process are measured by placing a survey prism at the construction site and measuring the position of the survey prism using a total station installed at a known public coordinate located away from the survey prism.

3. The surveying information processing method according to claim 2, characterized in that the initial reference point in the initial reference point measurement process and the reference point in the reference point measurement process are determined by imaging a marker fixed to the surveying prism with an imaging device mounted on the terminal.

4. In the initial correction step, a position of the three-dimensional model is corrected so that a point in the three-dimensional model corresponding to the public coordinates of the initial reference point overlaps with the initial reference point in the initial superimposed image; The surveying information processing method described in claim 2, characterized in that the orientation of the three-dimensional model is corrected by rotating the three-dimensional model around the initial reference point after the position of the three-dimensional model is corrected so that a point in the three-dimensional model corresponding to the public coordinates of the point where the total station is installed overlaps with the point where the total station is installed in the initial overlaid image.

5. The survey prism is provided with a first index that should be oriented toward the total station during measurement; The marker is provided with a second index indicating the same direction as the first index, In the initial correction step, a position of the three-dimensional model is corrected so that a point in the three-dimensional model corresponding to the public coordinates of the initial reference point overlaps with the initial reference point in the initial superimposed image; The surveying information processing method according to claim 3, characterized in that, when the first index in the surveying prism is pointed toward the total station, the orientation of the three-dimensional model is corrected based on the direction indicated by the second index imaged by the imaging device of the terminal.

6. In the initial correction step, a point in the three-dimensional model that corresponds to the public coordinates of the initial reference point is superimposed on the initial superimposed image. The position of the 3D model is corrected, The surveying information processing method according to claim 3, characterized in that, when the surveying prism and a carrying pole connected to the surveying prism are tilted toward the total station at the initial reference point, the orientation of the three-dimensional model is corrected based on the orientation of the carrying pole imaged by the imaging device of the terminal.

7. In the correction step, The surveying information processing method according to claim 1, characterized in that the position and / or orientation of the three-dimensional model is corrected based on a calculation in which a predetermined weighting is applied to the public coordinates of the reference point and the public coordinates of the reference point determined in the reference point measurement process one step before the reference point measurement process.

8. In the correction step, The surveying information processing method described in claim 1, characterized in that the position and / or orientation of the three-dimensional model is corrected based on a calculation to which a predetermined weighting is applied to the public coordinates of the reference point, the initial reference point determined in the initial reference point measurement process, and / or the public coordinates of the reference point determined in a reference point measurement process performed in the past.

Citation Information

Patent Citations

  • Information processing device, information processing method, and program

    JP6733127B2

  • Measurement processing device, method and program

    JP6928217B1