Surveying system, surveying device, surveying method, and surveying program
The surveying system combines laser scanning from the side surface and UAV imaging to enhance precision, addressing the inefficiencies and risks of conventional methods by reducing errors in structure surveys.
Patent Information
- Application Number
- JP2021043996
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-03-17
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2041-03-17
AI Technical Summary
Conventional surveying methods for structures, such as bridge piers, are labor-intensive and risky, especially in high or mountainous locations, and photogrammetry techniques suffer from measurement errors of centimeters, which are inadequate for precision on the order of millimeters.
A surveying system using a laser scanner from the side surface below the top surface and an unmanned aerial vehicle (UAV) with a camera to capture image data, followed by superimposing point cloud data to enhance precision, combining the UAV's image data with the laser scanner's data to reduce errors.
This method reduces surveying errors on the top surface of structures by converting UAV image data with larger errors into laser scanner data with smaller errors, eliminating the need for dangerous and time-consuming high-place measurements, thereby improving work efficiency.
Smart Images

Figure 0007579535000001 
Figure 0007579535000002 
Figure 0007579535000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a technique for surveying structures such as bridge piers. [Background technology]
[0002] Conventionally, the most common surveying method for structures has been to use total stations and laser scanners. In these surveying methods, a total station or similar device is installed in a place where the measurement point can be seen, and measurements are taken. However, with conventional surveying methods, depending on the construction location and size of the structure, a great deal of work may be required or there may be high risk. For example, consider a bridge, which consists of a superstructure and a substructure. In conventional surveying of the substructure before the start of construction of the superstructure, aerial work vehicles are set up and the survey is carried out by climbing up to the piers. In particular, for high piers and mountainous areas, it is necessary to install lifting equipment, and for piers in rivers, it is necessary to use wire bridges or boarding cranes on the piers. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 8-285588 Summary of the Invention [Problem to be solved by the invention]
[0004] One method to solve this problem is photogrammetry, which uses a camera mounted on an unmanned aerial vehicle known as a drone to perform measurements based on image data captured by the camera (see Patent Document 1). However, the measurement error with current photogrammetry technology is on the order of centimeters, making it insufficient for use in measurements that require precision on the order of millimeters.
[0005] The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a surveying system, device, method, and program that are easy to use and have low risk. [Means for solving the problem]
[0006] In order to achieve the above-mentioned object, the present invention is a surveying system for surveying the top surface of a structure, comprising: a laser scanner that performs laser scanning on an area including a boundary between the top surface and side surface of the structure from the side surface and below the top surface to obtain first point cloud data; an unmanned aerial vehicle equipped with a camera that captures an image of the area including the boundary between the top surface and side surface of the structure and the top surface from the air above the top surface to obtain image data; and a superimposition means that superimposes second point cloud data for the area including the boundary between the top surface and side surface of the structure and the top surface, calculated from the image data, onto the first point cloud data based on the first point cloud data and the second point cloud data for the boundary.
[0007] The present invention also provides a surveying method for surveying the top surface of a structure, comprising the steps of: using a laser scanner to laser scan an area including a boundary between the top surface and side surface of the structure from the side surface and below the top surface to obtain first point cloud data; using a camera mounted on an unmanned aerial vehicle to capture an image of the area including the boundary between the top surface and side surface of the structure and the top surface from the air above the top surface to obtain image data; calculating second point cloud data for the area including the boundary between the top surface and side surface of the structure and the top surface from the image data; and superimposing the second point cloud data on the first point cloud data based on the first point cloud data and the second point cloud data at the boundary.
[0008] The present invention also relates to a surveying device for surveying the top surface of a structure, comprising: a point cloud data acquisition means for acquiring first point cloud data acquired by a laser scanner installed below the top surface of the structure and second point cloud data calculated based on image data captured by a camera mounted on an unmanned aerial vehicle flying in the air above the top surface of the structure; and a superposition means for superimposing the second point cloud data on the first point cloud data, wherein the first point cloud data is acquired by laser scanning an area including a boundary between the top surface and side surfaces of the structure, and the second point cloud data is calculated from image data captured of an area including the boundary between the top surface and side surfaces of the structure and the top surface, and the superposition means superimposes the second point cloud data on the first point cloud data based on the first point cloud data and the second point cloud data at the boundary. Effect of the Invention
[0009] According to the present invention, the second point cloud data, which has a relatively large error calculated from image data captured by the camera of the unmanned aerial vehicle, is superimposed on the first point cloud data, which has a relatively small error acquired by the laser scanner, so that it is possible to reduce measurement errors even for the top surface of a structure that cannot be directly observed by the laser scanner. Therefore, it is no longer necessary to perform dangerous and time-consuming work at high altitudes to measure the top surface of a structure, improving workability. [Brief description of the drawings]
[0010] [Figure 1] FIG. 1 is a configuration diagram of a surveying system according to a first embodiment. [Diagram 2] Functional block diagram of a surveying instrument according to a first embodiment. [Diagram 3] Survey procedure using the survey system according to the first embodiment [Figure 4] FIG. 1 is a configuration diagram of a surveying system according to a second embodiment. [Diagram 5] A functional block diagram of a surveying instrument according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] (First embodiment) A surveying system according to a first embodiment of the present invention will be described with reference to the drawings. Figure 1 is a configuration diagram of the surveying system, and Figure 2 is a functional block diagram of a surveying device.
[0012] In this embodiment, the substructure of a bridge (also called the substructure or skeleton) is taken as an example of the structure to be surveyed. This embodiment also describes a case in which, after the substructure is completed and before the superstructure begins, the positions of one or more bearings installed on the top surface of the completed substructure are surveyed, and the distance between corresponding bearings installed on the top surfaces of adjacent substructures is also surveyed. Note that the distance between adjacent substructures is on the order of 10 to 100 meters, while the allowable error in the bearing positions and the distance between the bearings is on the order of millimeters.
[0013] 1, the surveying system according to this embodiment includes a laser scanner 200 that performs laser scanning on each of a plurality of substructures 100 to acquire point cloud data, an unmanned aerial vehicle 300 equipped with a camera 310 that captures an image of each of the plurality of substructures 100 from the air to acquire image data, and a surveying device 400 that performs surveying based on the data acquired from the laser scanner 200 and the camera 310. The operations of acquiring the point cloud data by the laser scanner 200 and acquiring the image data by the unmanned aerial vehicle 300 are performed for each substructure 100 by changing the installation position of the laser scanner 200 and the flight position of the unmanned aerial vehicle 300.
[0014] Each substructure 100 is formed such that its top surface 110 is horizontal and the direction perpendicular to its side surface 120 is vertical. A bearing 111, which is the object of surveying, is formed on the top surface 110. At the boundary 130 between the top surface 110 and the side surface 120, a C-face 131 is formed by chamfering the corner where the top surface 110 and the side surface 120 intersect into a flat surface.
[0015] The laser scanner 200 irradiates a laser beam and receives the light reflected by an object, and measures the distance to the object based on the time from irradiation to reception and the phase of the reflected light. The laser scanner 200 scans a space with the laser beam to measure the distance to each point of the object in the space, and generates point cloud data, which is a collection of three-dimensional spatial coordinates of each point.
[0016] The laser scanner 200 is installed below the top surface 110 on which the survey target bearings 111 are formed. In other words, it should be noted that the laser scanner 200 cannot observe the top surface 110 including the bearings 111, and therefore the laser scanner 200 cannot generate point cloud data for the top surface 110 including the bearings 111.
[0017] In the present invention, the laser scanner 200 is installed on the ground at a predetermined distance away from the side surface 120 of the substructure 100, and performs laser scanning on an area including the boundary portion 130 to generate point cloud data. It is assumed that the installation position of the laser scanner 200 is known. The installation position of the laser scanner 200 can be obtained by measuring a known reference point with the laser scanner 200. In addition, the installation position of the laser scanner 200 can be obtained by measuring the installation position of the laser scanner 200 with another positioning device such as a total station.
[0018] The laser scanner 200 records the generated point cloud data on a predetermined recording medium. In some embodiments, the laser scanner 200 can transmit the generated point cloud data to an external device connected by wire or wirelessly. The coordinates of the point cloud data recorded and transmitted by the laser scanner 200 may be relative to the installation position of the laser scanner 200 as a reference, or may be absolute and corrected based on a known installation position.
[0019] The unmanned aerial vehicle 300 is a flying object known as a drone, and flies according to a user's operation command from a remote location or based on a pre-programmed flight plan. The unmanned aerial vehicle 300 is also called a UAV (Unmanned Aerial Vehicle). The unmanned aerial vehicle 300 is equipped with a power source such as a motor, a propeller attached to the motor, an inertial measurement unit, a wireless transceiver, a power source, the camera 310 for surveying, and a control device for controlling each part. The inertial measurement unit is used to measure and control the behavior and current position of the unmanned aerial vehicle 300. The inertial measurement unit can include various sensors such as a three-axis acceleration sensor, a three-axis angular velocity sensor, an air pressure sensor, an ultrasonic sensor, a magnetic direction sensor, and a GNSS (Global Navigation Satellite System) receiver.
[0020] The camera 310 captures still or video images to generate image data. The camera 310 records the image data on a predetermined recording medium. In some embodiments, the camera 310 can transmit the image data to an external device connected by wire or wirelessly in real time or all at once after capture. The image data includes, as metadata, the capture conditions such as position information at the time of capture. The position information at the time of capture can be acquired from an inertial measurement unit of the unmanned aerial vehicle 300. The camera 310 can control the capture conditions such as the angle of view and capture direction from a control device of the unmanned aerial vehicle 300. The camera 310 is fixed to the unmanned aerial vehicle 300. In some embodiments, the camera 310 includes a drive device for changing the capture direction relative to the unmanned aerial vehicle 300. In some embodiments, the camera 310 includes a shock absorbing device for preventing blurring of the image data due to vibration.
[0021] In the present invention, the unmanned aerial vehicle 300 is flown by remote control or based on a flight plan so that the camera 310 captures an image of an area including the boundary portion 130 and the upper surface 110 of the substructure 100. Here, the upper surface 110, which is a part of the imaged object, does not need to be the entire area of the upper surface 110, but may be an area including the bearing 111, which is the object of the survey. The side surface 120 of the substructure 100 may also be included in the imaged area. In order to enable the camera 310 to capture such an area, the unmanned aerial vehicle 300 flies in the air above at least the upper surface 110 of the substructure 100. In this embodiment, in order to capture an image of at least the area of the side surface 120 of the substructure 100 adjacent to the boundary portion 130, the unmanned aerial vehicle 300 flies in the air diagonally above the side surface 120 on the side where the laser scan 200 is installed, relative to the upper surface 110 of the substructure 100. The camera 310 acquires at least two pieces of image data at different image capturing positions so that point cloud data can be generated from the image data, as described below. The camera 310 can acquire multiple image data by capturing video at a predetermined frame rate while the unmanned aerial vehicle 300 is moving.
[0022] As shown in Fig. 2, the surveying device 400 includes a point cloud data conversion processing unit 410, a point cloud data acquisition unit 420, a superimposition processing unit 430, a measurement point search unit 440, a surveying calculation unit 450, and a storage unit 460. Each unit of the surveying device 400 is configured by installing a program on a computer including a main calculation unit, a main storage unit, an auxiliary storage unit, a display unit, an input device, etc. In some embodiments, the surveying device 400 is configured by dedicated hardware. In some embodiments, the surveying device 400 is configured by distributing it across multiple devices. In some embodiments, the surveying device 400 is implemented in a cloud server.
[0023] The point cloud data conversion processing unit 410 converts multiple image data acquired from the camera 310 into point cloud data. Various algorithms used in photogrammetry can be used for converting image data into point cloud data. In the following description, the point cloud data generated by the laser scanner 200 described above will be referred to as ground-side point cloud data, and the point cloud data generated by the point cloud data conversion processing unit 410 will be referred to as air-side point cloud data.
[0024] In this embodiment, the camera 310 generates video data including position information as image data, and the point cloud data conversion processing unit 410 generates air-side point cloud data, which is a collection of three-dimensional spatial coordinates, from this video data. The point cloud data conversion processing unit 410 also acquires the video data from the camera 310 via a specified storage medium. The position information included in the image data is measured by the inertial measurement unit of the unmanned aerial vehicle 300. For this reason, it should be noted that the coordinate error of the air-side point cloud data is usually on the order of centimeters, which does not satisfy the allowable error of the support position, which is on the order of millimeters.
[0025] The point cloud data acquisition unit 420 acquires ground-side point cloud data and aerial-side point cloud data, and stores them in the storage unit 460. In this embodiment, the point cloud data acquisition unit 420 acquires ground-side point cloud data from the laser scanner 200 via a predetermined storage medium, and acquires aerial-side point cloud data from the point cloud data conversion processing unit 410.
[0026] The superimposition processing unit 430 performs a superimposition process on the ground side point cloud data and the aerial side point cloud data stored in the storage unit 460 to generate superimposed point cloud data, and stores the superimposed point cloud data in the storage unit 460. That is, the aerial side point cloud data is superimposed on the ground side point cloud data based on the ground side point cloud data and the aerial side point cloud data in the boundary unit 130. In other words, the superimposition processing unit 430 performs coordinate conversion so that the coordinate system of the aerial side point cloud data, which has a relatively large error, coincides with the coordinate system of the ground side point cloud data, which has a relatively small error, and combines the aerial side point cloud data and the ground side point cloud data into one superimposed point cloud data. In other words, the superimposition processing unit 430 can also be considered to correct the aerial side point cloud data using the ground side point cloud data.
[0027] Here, the superimposition process is based on the data in the boundary portion 130, which is the superimposition region of the ground side point cloud data and the aerial side point cloud data. That is, coordinate conversion is performed so that the aerial side point cloud data in the boundary portion 130 matches the ground side point cloud data in the boundary portion 130. More specifically, coordinate conversion is performed so that the coordinates of the feature points in the boundary portion 130 of the substructure 100 included in the aerial side point cloud data in the boundary portion 130 match the coordinates of the feature points included in the ground side point cloud data in the boundary portion 130. For this reason, the superimposition processing unit 430 has a feature point extraction function unit that extracts feature points in the boundary portion 130 from each point cloud data. In this embodiment, the ridge line, which is the boundary line between the boundary portion 130 and the side surface 120, is extracted as the feature point. The ridge line is also called the pier top outline or the C-surface bottom outline.
[0028] The measurement point search unit 440 searches for point cloud data related to the survey object from the superimposed point cloud data, calculates the position (coordinate data) of the survey object as a survey result, and stores it in the memory unit 460. Specifically, the measurement point search unit 440 extracts feature points related to the survey object from the superimposed point cloud data, calculates the positions (coordinate data) of these feature points as a survey result, and stores it in the memory unit 460. In this embodiment, the measurement point search unit 440 calculates the position (coordinate data) of a support 111 provided on the upper surface 110 of the substructure 100.
[0029] The above-mentioned processing by the superposition processing unit 430 and the measurement point search unit 440 is performed for each of the acquired ground-side point cloud data. In this embodiment, the positions (coordinate data) of one or more supports 111 provided on the upper surface 110 of each of the multiple substructures 100 are calculated for each of the ground-side point cloud data acquired by the laser scanner 200 for each of the multiple substructures 100.
[0030] The survey calculation unit 450 calculates the distance between any of the survey targets from the positions (coordinate data) of the multiple survey targets surveyed by the measurement point search unit 440. In this embodiment, the distance between corresponding supports 111 provided on the upper surfaces 110 of adjacent substructures 100 is calculated, output as the survey result, and stored in the memory unit 460.
[0031] The procedure of the survey according to this embodiment will be described with reference to the flowchart in Fig. 3. First, the laser scanner 200 is used to perform laser scanning on the area including the boundary portion 130 from the side of the side surface 120 and below the top surface 110 to obtain ground-side point cloud data (step S1).
[0032] In addition, the camera 310 mounted on the unmanned aerial vehicle 300 is used to capture an image of the area including the boundary 130 and the upper surface 110 from the air above the upper surface 110 to obtain image data (step S2-1). Next, aerial side point cloud data of the area including the boundary 130 and the upper surface 110 is generated from the image data (step S2-2).
[0033] The above steps S1 to S2-2 are carried out for each of the structures to be surveyed. In this embodiment, the steps are carried out for each of the substructures 100.
[0034] Next, the surveying device 400 superimposes the flight-side point cloud data on the ground-side point cloud data based on the ground-side point cloud data in the boundary section 130 and the flight-side point cloud data to generate superimposed point cloud data (step S3). Next, the surveying device 400 calculates the positions (coordinate data) of the measurement points from the superimposed point cloud data (step S4). Finally, the surveying device 400 calculates the distance between any measurement points (step S5). In this embodiment, the distance between corresponding supports 111 provided on the upper surfaces 110 of adjacent substructures 100 is calculated.
[0035] The acquisition of image data in step S2-1 may be performed before the acquisition of ground-side point cloud data in step S1.
[0036] According to such a surveying system, aerial point cloud data with a relatively large error is superimposed on ground point cloud data with a relatively small error, so that it is possible to reduce surveying errors even for the upper surface 110 of the substructure 100, which cannot be directly observed by the laser scanner 200. Therefore, it is no longer necessary to perform dangerous and time-consuming work at height to measure the upper surface of the substructure 100, improving workability.
[0037] (Second embodiment) A surveying system according to a second embodiment of the present invention will be described with reference to the drawings. Figure 4 is a configuration diagram of the surveying system, and Figure 5 is a functional block diagram of a surveying device.
[0038] The surveying system according to this embodiment differs from the first embodiment in that it further includes a positioning device 500 that performs laser positioning, as shown in Fig. 4, and in the surveying process in the surveying device 400. Since the other configurations are the same as those in the first embodiment, only the differences will be described here.
[0039] The positioning device 500 measures the position (coordinates) of a predetermined reference point included in the scan area of the substructure 100 by the laser scanner 200 by laser positioning. In this embodiment, a total station is used as the positioning device 500. The installation position of the positioning device 500 is assumed to be known. The installation position of the positioning device 500 can be acquired by positioning another known reference point by the positioning device 500. The predetermined reference point can be any point in the boundary portion 130. Also, the predetermined reference point can be any point other than the boundary portion 130. The measurement result by the positioning device 500 is provided to the surveying device 400. Also, the predetermined reference point may be a component of the substructure 100, or may be one installed in the substructure 100 for surveying. In this embodiment, any corner of the substructure 100 is set as the reference point.
[0040] As shown in Fig. 5, the surveying device 400 includes a reference point position acquisition unit 470 that acquires the reference point positions measured by the positioning device 500 and stores them in the storage unit 460. There is no restriction on the method of acquiring the reference point positions. For example, they may be acquired via a specified storage medium. Furthermore, the positioning device 500 and the surveying device 400 may be connected by wire or wirelessly to transmit and receive the reference point positions. Furthermore, the reference point positions may be manually input into the measuring device 400.
[0041] The superimposition processing unit 430 has a function of correcting the ground side point cloud data or the superimposed point cloud data using the reference point positions. Therefore, the superimposition processing unit 430 has a function of extracting predetermined reference points as feature points from the ground side point cloud data or the superimposed point cloud data.
[0042] According to such a surveying system, as in the first embodiment, aerial point cloud data with a relatively large error is superimposed on ground point cloud data with a relatively small error, so that surveying errors can be reduced even for the upper surface 110 of the substructure 100 that cannot be directly observed by the laser scanner 200. However, in order to further improve the accuracy in the configuration of the first embodiment, a more expensive laser scanner 200 needs to be used. On the other hand, in this embodiment, correction is performed using a positioning device 500 that is generally less expensive than the laser scanner 200, so that accuracy can be improved at a low cost. Other effects are the same as those of the first embodiment.
[0043] Although one embodiment of the present invention has been described in detail above, the present invention is not limited to the above embodiment, and various improvements and modifications may be made without departing from the spirit and scope of the present invention.
[0044] For example, in the above embodiment, a point cloud data conversion processing unit 410 that calculates aerial point cloud data from image data captured by the camera 310 is provided in the surveying device 400, but this processing unit may be implemented in another computer or in the unmanned aerial vehicle 300.
[0045] Furthermore, in the above embodiment, the substructure of a bridge has been described as the structure to be surveyed, but the present invention can also be implemented with other structures. [Explanation of symbols]
[0046] 100...Structure 110…Top surface 120…Side 130…Border 200...Laser scanner 300...Unmanned aerial vehicle 310…Camera 400...Surveying equipment 410: Point cloud data conversion processing unit 420…Point cloud data acquisition section 430... Superimposition processing unit 440...Measuring point search section 450... Measurement calculation unit 450 460... Memory unit 470... Reference point position acquisition unit
Claims
1. A surveying system for surveying a top surface of a structure, comprising: a laser scanner that performs laser scanning on an area including a boundary between an upper surface and a side surface of the structure from a side surface side and below the upper surface to acquire first point cloud data; An unmanned aerial vehicle equipped with a camera that captures an image of a boundary between the upper surface and the side surface of the structure and an area including the upper surface from the air above the upper surface to acquire image data; and a superimposing unit for superimposing second point cloud data in a region including a boundary portion between an upper surface and a side surface of the structure and the upper surface, the second point cloud data being calculated from the image data, on the first point cloud data based on the first point cloud data and the second point cloud data in the boundary portion. A surveying system comprising:
2. a positioning device for performing laser positioning of a predetermined reference point of the structure, The superimposing means corrects at least the first point cloud data based on position information of the reference point measured by the positioning device.
2. The surveying system according to claim 1 .
3. The camera captures an image from the air at an angle above the side of the structure relative to the top surface of the structure so that the side of the structure is captured.
3. The surveying system according to claim 1 or 2.
4. A surveying method for surveying the top surface of a structure, comprising the steps of: a step of acquiring first point cloud data by performing laser scanning on an area including a boundary between an upper surface and a side surface of the structure from a side surface side and below the upper surface using a laser scanner; A step of acquiring image data by capturing an image of a boundary between a top surface and a side surface of the structure and an area including the top surface from above the top surface using a camera provided on the unmanned aerial vehicle; calculating second point cloud data in an area including a boundary between a top surface and a side surface of the structure and the top surface from the image data; and superimposing the second point cloud data on the first point cloud data based on the first point cloud data and the second point cloud data at the boundary portion. A surveying method comprising:
5. A surveying device for surveying the top surface of a structure, a point cloud data acquisition means for acquiring first point cloud data acquired by a laser scanner installed below the top surface of the structure and second point cloud data calculated based on image data captured by a camera mounted on an unmanned aerial vehicle flying in the air above the top surface of the structure; a superimposing means for superimposing the second point cloud data on the first point cloud data, the first point cloud data is acquired by laser scanning an area including a boundary between an upper surface and a side surface of the structure, the second point cloud data is calculated from image data captured of a boundary between a top surface and a side surface of the structure and an area including the top surface, The superimposing means superimposes the second point cloud data on the first point cloud data based on the first point cloud data and the second point cloud data in the boundary portion. A surveying instrument characterized by:
6. A surveying program that causes a computer to function as the surveying instrument according to claim 5.
Citation Information
Patent Citations
Photographing apparatus and flight photographing apparatus using the apparatus
JP1996285588A
Optical information processing device, optical information processing method, optical information processing system and optical information processing program
JP2012088114A
Site sketch plan creation system and laser measuring device
JP2015059812A
Laser measurement system and laser measurement method
JP2017106755A
Inspection method of structure using drone
JP2017116453A
