Ortho-image creating system, ortho-image creating method, aerial marking applied thereto, and road surveying method

The orthoimage creation system using UAVs simplifies road condition surveys by clearly identifying cracks and planar elements, and manhole elevations, overcoming the limitations of conventional methods.

JP2024156891AActive Publication Date: 2024-11-06MR SUPPORT INC
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2024128827
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2019-06-17
Filing Date
2024-08-05
Publication Date
2024-11-06
Estimated Expiration
2039-11-18

AI Technical Summary

Technical Problem

Conventional road condition surveys using dedicated vehicles are complicated due to the inability to navigate narrow roads and require extensive manual surveying of planar elements and manhole elevation adjustments, making the process inefficient.

Method used

An orthoimage creation system using unmanned aerial vehicles (UAVs) to capture images from above, integrating anti-aircraft signs for coordinate acquisition, and creating orthoimages that replace vehicle areas with vehicle-free images, allowing for clear identification of road conditions, planar elements, and manhole elevations.

Benefits of technology

The system enables efficient road condition assessment without the need for dedicated vehicles, clearly identifying cracks, planar elements, and manhole adjustments, simplifying the surveying process and reducing the complexity of road repairs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024156891000001_ABST
    Figure 2024156891000001_ABST
Patent Text Reader

Abstract

To provide an ortho-image creating system, an ortho-image creating method, an aerial marking applied thereto, and a road surveying method that facilitate, when a road maintenance construction is carried out, a survey for a road condition when the maintenance construction begins.SOLUTION: An ortho-image creating method includes: a coordinate obtaining step of obtaining 3D coordinates for multiple aerial markings 6; an image pickup step of picking up multiple picked-up images by a UAV 3 flying at an altitude that is lower than or equal to 20 meter from the ground in such a way that, for the multiple aerial markings 6, each aerial marking 6 is included in at least two picked-up images; an ortho-image creating step of creating an ortho-image based on the 3D coordinate of each feature point obtained through the coordinate obtaining step and on the multiple picked-up images picked up through the image pickup step; and a displaying step of displaying the ortho-image on a display 5.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an orthoimage creation system that creates orthoimages based on images captured from the sky by, for example, an unmanned aerial vehicle, an orthoimage creation method, and an anti-aircraft sign and a road inspection method used therein. [Background technology]

[0002] Conventionally, when damage such as cracks occurs on the surface of the asphalt pavement that constitutes the surface layer of a road, the road needs to be repaired.

[0003] In order to repair a road, various investigations are conducted, such as an investigation of the road condition at the time of starting repair work and the positions of planar elements including road edges and lane markings. For example, an investigation is conducted of the locations where cracks have occurred on the road and the amount of cracks. Conventionally, investigations of crack conditions have been conducted visually by inspectors, but the work of inspectors inspecting the road and detecting cracks is very cumbersome. Therefore, instead of inspectors detecting cracks, a dedicated road surface property measuring vehicle is sometimes used to investigate the road condition (see Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-123510 A Summary of the Invention [Problem to be solved by the invention]

[0005] When inspecting road conditions using a dedicated road surface property measurement vehicle, it is necessary to run the road surface property measurement vehicle, but on narrow roads, the road surface property measurement vehicle cannot run, making it impossible to inspect the road conditions.

[0006] In addition, the positions of planar elements including road edges and lane markings in the repair area where the repair is to be performed are surveyed. Conventionally, a large number of planar positions on the road edges and lane markings are surveyed, and planar elements including road edges and lane markings are plotted based on the respective planar positions. Therefore, in order to plot the planar elements, it is necessary to survey a large number of planar positions, which is very cumbersome.

[0007] In addition, if there is a manhole in the repair area, a survey is conducted to determine the manhole adjustment height. The survey involves surveying the adjustment height (the difference in elevation between the elevation at the time of repair work commencement and the elevation of the repair plan surface) for each position in the longitudinal and transverse directions of the manhole.

[0008] Conventionally, the elevation of each horizontal position around the manhole is detected based on the road longitudinal section and road cross section that pass through each horizontal position, and the adjustment height is derived from the elevation difference between the elevation and the elevation of the repair plan surface. Therefore, it is necessary to detect the elevation of each horizontal position based on the road longitudinal section and road cross section for each manhole, which is very cumbersome.

[0009] The present invention has been made with attention to such problems, and aims to provide an orthoimage creation system, an orthoimage creation method, and an anti-aircraft sign and road survey method used therein that make it possible to easily survey the road condition at the time of starting repair work when repairing a road. [Means for solving the problem]

[0010] In order to solve the above problems, the present invention takes the following measures.

[0011] That is, the present invention The orthoimage creation method includes a coordinate acquisition step of acquiring three-dimensional coordinates for a plurality of feature points, a photographing step of capturing a plurality of images for the plurality of feature points using an unmanned aerial vehicle or a model aerial vehicle flying in the sky so that each of the plurality of feature points is included in at least two photographed images, and an orthoimage creation step of creating an orthoimage based on the three-dimensional coordinates of each feature point acquired by the coordinate acquisition step and the plurality of photographed images captured by the photographing step, wherein the orthoimage creation step creates an orthoimage without vehicles on the road by replacing the area around a vehicle on the road with an image of a road without vehicles in another photographed image.

[0012] The present invention The orthoimage creation system comprises a coordinate storage means for storing three-dimensional coordinates for a plurality of feature points, a captured image storage means for storing a plurality of captured images taken by an unmanned aerial vehicle or a model aircraft flying in the sky so that each of the plurality of feature points is included in at least two captured images, and an orthoimage creation means for creating an orthoimage based on the three-dimensional coordinates of each feature point stored in the coordinate storage means and the plurality of captured images stored in the captured image storage means, wherein the orthoimage creation means creates an orthoimage without vehicles on the road by replacing the area around a vehicle on the road with an image of a road without vehicles in another captured image.

[0013] As a result, Orthoimage creation method and orthoimage creation system So, Above By creating an ortho-image based on multiple images taken by a flying unmanned aerial vehicle or a model aerial vehicle, it is possible to create an ortho-image that clearly identifies the condition of the road surface and the positions of planar elements around the road. In the ortho-image created by the present invention, it is possible to clearly identify the locations of cracks and patching on the road. Therefore, since there is no need to run a dedicated road surface property measurement vehicle to investigate the crack condition on the road surface, it is possible to investigate the road condition regardless of the road width.

[0014] In addition, in the orthoimage created by the present invention, the positions of planar elements including road edges, lane markings, etc. can be clearly identified. Therefore, since it is not necessary to perform surveying of a large number of planar positions in order to plot planar elements including road edges, lane markings, etc., it is possible to easily plot planar elements based on the orthoimage.

[0015] In addition, the ortho-image created by the present invention can detect each planar position in the longitudinal direction and transverse direction of the area surrounding the manhole. Therefore, after identifying each planar position in the longitudinal direction and transverse direction of the area surrounding the manhole, it is possible to extract the elevation of each planar position from the point cloud data acquired by the 3D scanning device. Therefore, in order to detect the elevation of each planar position in the longitudinal direction and transverse direction of the area surrounding the manhole, it is not necessary to create road longitudinal sections and road transverse sections for each manhole. Therefore, it is possible to easily detect the manhole adjustment height.

[0016] The present invention In the orthoimage creation method, the feature points are anti-aircraft markers installed on the ground at the time of photographing by the unmanned aerial vehicle or the model aircraft, and the coordinate storage means stores the three-dimensional coordinates of the anti-aircraft markers obtained by a total station, a satellite-based positioning system, and a three-dimensional scanning device.

[0017] The present invention In the orthoimage creation system, the feature point is an anti-aircraft sign installed on the ground at the time of photographing in the photographing step, and the coordinate acquisition step is characterized in that the three-dimensional coordinates of the anti-aircraft sign are acquired by a total station, a satellite-based positioning system, and a three-dimensional scanning device.

[0018] As a result, Orthoimage creation method and orthoimage creation systemBy creating an orthoimage based on images taken by an unmanned aerial vehicle or a model aircraft, it is possible to create an orthoimage that clearly shows the condition of the road surface and the position of planar elements around the road.

[0019] The present invention In the orthoimage creation method, the feature points are specified points in an image taken by the unmanned aerial vehicle or the model aircraft, and the coordinate storage means stores the three-dimensional coordinates of the specified points extracted from the three-dimensional coordinated point cloud data obtained for each point in the captured image.

[0020] The present invention In the orthoimage creation system, the feature point is a specified point in an image taken by the unmanned aerial vehicle or the model aircraft, and the coordinate acquisition step is characterized in that the three-dimensional coordinates of the specified point are acquired from the three-dimensional coordinated point cloud data acquired for each point in the captured image.

[0021] As a result, Orthoimage creation method and orthoimage creation system By creating an orthoimage based on images taken by an unmanned aerial vehicle or a model aircraft, it is possible to create an orthoimage that clearly shows the condition of the road surface and the position of planar elements around the road.

[0022]

[0023]

[0024] The road survey method according to the present invention includes a coordinate acquisition step of acquiring three-dimensional coordinates of a plurality of feature points; Above A photographing step of photographing a plurality of photographed images by a flying unmanned aerial vehicle or a model aerial vehicle so that each of the plurality of feature points is included in at least two photographed images, and an orthoimage is created based on the three-dimensional coordinates of each feature point acquired by the coordinate acquisition step and the plurality of photographed images taken by the photographing step. At the same time, the area around the vehicle on the road is replaced with an image of the road without vehicles taken in another image, creating an orthoimage without vehicles on the road. The method comprises an orthoimage creation step, a display step for displaying the orthoimage on a display unit, a derivation step for dividing a survey area into a plurality of survey ranges in the orthoimage displayed on the display unit and deriving a crack rate or patching rate for each of the plurality of survey ranges, and a road condition display step for displaying the condition of the road by adding a color corresponding to the magnitude of the crack rate or patching rate of each survey range derived by the derivation step to the orthoimage displayed on the display unit.

[0025] As a result, in the road inspection method according to the present invention, AboveBy creating an orthoimage based on multiple images taken by a flying unmanned aerial vehicle or model aerial vehicle, it is possible to create an orthoimage that clearly identifies the condition of the road surface and the positions of planar elements around the road. The orthoimage created by the present invention makes it possible to clearly identify areas where cracks have occurred on the road and areas where patching has occurred. Therefore, since there is no need to run a dedicated road surface property measurement vehicle to investigate the crack condition on the road surface, it is possible to investigate road conditions regardless of road width.

[0026] The road survey method according to the present invention includes a coordinate acquisition step of acquiring three-dimensional coordinates of a plurality of feature points; Above A photographing step of photographing a plurality of photographed images by a flying unmanned aerial vehicle or a model aerial vehicle so that each of the plurality of feature points is included in at least two photographed images, and an orthoimage is created based on the three-dimensional coordinates of each feature point acquired by the coordinate acquisition step and the plurality of photographed images taken by the photographing step. At the same time, the area around the vehicle on the road is replaced with an image of the road without vehicles taken in another image, creating an orthoimage without vehicles on the road. The method includes an orthoimage creation step, a display step for displaying the orthoimage on a display unit, and a planar element drawing step for tracing planar elements in the orthoimage displayed on the display unit to draw the planar elements.

[0027] As a result, in the road inspection method according to the present invention, Above By creating an ortho-image based on a plurality of photographed images taken by a flying unmanned aerial vehicle or a model aerial vehicle, it is possible to create an ortho-image that can clearly distinguish the state of the road surface and the positions of planar elements around the road. In the ortho-image created by the present invention, the positions of planar elements including road edges and lane markings can be clearly distinguished. Therefore, since it is not necessary to perform surveying of a large number of points in order to plot planar elements including road edges and lane markings, it is possible to easily plot planar elements based on the ortho-image.

[0028] The road survey method according to the present invention includes a coordinate acquisition step of acquiring three-dimensional coordinates of a plurality of feature points; Above A photographing step of photographing a plurality of photographed images by a flying unmanned aerial vehicle or a model aerial vehicle so that each of the plurality of feature points is included in at least two photographed images, and an orthoimage is created based on the three-dimensional coordinates of each feature point acquired by the coordinate acquisition step and the plurality of photographed images taken by the photographing step. At the same time, the area around the vehicle on the road is replaced with an image of the road without vehicles taken in another image, creating an orthoimage without vehicles on the road. The method includes an orthoimage creation step, a point cloud data acquisition step for acquiring point cloud data of an area including the surrounding area of ​​the manhole in the orthoimage, a display step for displaying the orthoimage on a display unit, and an elevation difference derivation step for deriving the elevation difference between the elevation of the surrounding area of ​​the manhole in the orthoimage displayed on the display unit and the elevation of the surrounding area of ​​the manhole on a repair planning screen.

[0029] As a result, in the road inspection method according to the present invention, Above By creating an ortho-image based on a plurality of photographed images taken by a flying unmanned aerial vehicle or a model aerial vehicle, it is possible to create an ortho-image that can clearly distinguish the state of the road surface and the positions of planar elements around the road. The ortho-image created by the present invention can detect each planar position in the longitudinal direction and the transverse direction of the periphery of the manhole. Therefore, after identifying each planar position in the longitudinal direction and the transverse direction of the periphery of the manhole, it is possible to extract the elevation of each planar position from the point cloud data of the area including the periphery of the manhole. Therefore, in order to detect the elevation of each planar position in the longitudinal direction and the transverse direction of the periphery of the manhole, it is not necessary to create a road longitudinal section and a road transverse section for each manhole. Therefore, it is possible to easily detect the manhole adjustment height.

[0030] The road survey method according to the present invention includes a coordinate acquisition step of acquiring three-dimensional coordinates of a plurality of feature points; AboveA photographing step of photographing a plurality of photographed images by a flying unmanned aerial vehicle or a model aerial vehicle so that each of the plurality of feature points is included in at least two photographed images, and an orthoimage is created based on the three-dimensional coordinates of each feature point acquired by the coordinate acquisition step and the plurality of photographed images taken by the photographing step. At the same time, the area around the vehicle on the road is replaced with an image of the road without vehicles taken in another image, creating an orthoimage without vehicles on the road. The method includes an orthoimage creation step, a point cloud data acquisition step for acquiring point cloud data of an area including the plurality of feature points, a display step for displaying the orthoimage on a display unit, a designation step for designating two designated points spaced apart from each other in the orthoimage displayed on the display unit, and a distance display step for displaying the distance between the two designated points when the two designated points are designated by the designation step.

[0031] As a result, in the road inspection method according to the present invention, Above By creating an ortho-image based on multiple images taken by a flying unmanned aerial vehicle or model aircraft and associating the ortho-image with point cloud data of an area in the ortho-image, it is possible to clearly determine the positions of planar elements including road edges and lane markings and other dividing lines, while displaying, for example, the distance between two designated points in the area surrounding the road in the ortho-image. Therefore, even if an inspector does not measure the distance between two designated points in the area surrounding the road, the distance between the two designated points can be easily detected by specifying the two designated points on the display unit displaying the ortho-image.

[0032] The road survey method according to the present invention includes a coordinate acquisition step of acquiring three-dimensional coordinates of a plurality of feature points; Above A photographing step of photographing a plurality of photographed images by a flying unmanned aerial vehicle or a model aerial vehicle so that each of the plurality of feature points is included in at least two photographed images, and an orthoimage is created based on the three-dimensional coordinates of each feature point acquired by the coordinate acquisition step and the plurality of photographed images taken by the photographing step. At the same time, the area around the vehicle on the road is replaced with an image of the road without vehicles taken in another image, creating an orthoimage without vehicles on the road.The method includes an orthoimage creation step, a point cloud data acquisition step for acquiring point cloud data of an area including the plurality of feature points, a display step for displaying the orthoimage on a display unit, a designation step for designating a designated range within the orthoimage displayed on the display unit, and an area display step for displaying the area of ​​the designated range when the designated range is designated by the designation step.

[0033] As a result, in the road inspection method according to the present invention, Above By creating an ortho-image based on multiple images taken by a flying unmanned aerial vehicle or model aircraft and associating the ortho-image with point cloud data of an area in the ortho-image, it is possible to clearly determine the positions of planar elements including road edges and lane markings and other dividing lines, while displaying, for example, the area of ​​a specified range in the area surrounding the road in the ortho-image. Therefore, even if an inspector does not measure the area of ​​the specified range in the area surrounding the road, the area of ​​the specified range can be easily detected by specifying the specified range on the display unit displaying the ortho-image. The orthoimage creation method of the present invention is an orthoimage creation method that creates an orthoimage based on three-dimensional coordinates of a plurality of feature points and a plurality of images taken by an unmanned aerial vehicle or model aircraft flying overhead so that each of the plurality of feature points is included in at least two of the images, and is characterized in that an orthoimage is created in which the vehicle is not on the road by replacing the area around the vehicle on the road with an image of the road without the vehicle in another captured image. The orthoimage of the present invention is an orthoimage created based on three-dimensional coordinates of a plurality of feature points and a plurality of images taken by an unmanned aerial vehicle or model aircraft flying overhead so that each of the plurality of feature points is included in at least two of the images, and is characterized in that the area around a vehicle on a road is replaced with an image of the road without the vehicle in another image, thereby indicating that the vehicle is not on the road. The orthoimage according to the present invention is characterized in that the area around a vehicle on a road is replaced with an image of the road without the vehicle in another captured image, so that the vehicle is not present on the road. Effect of the Invention

[0034] As described above, according to the present invention, AboveBy creating an ortho-image based on a plurality of photographed images taken by a flying unmanned aerial vehicle or a model aerial vehicle, it is possible to create an ortho-image that can clearly distinguish the state of the road surface and the positions of planar elements around the road. In the ortho-image created by the present invention, it is possible to clearly distinguish the positions of planar elements including cracked areas and patched areas on the road, road edges, and lane marking lines, and it is possible to detect each planar position in the longitudinal direction and transverse direction around the manhole. In the road survey method of the present invention, by specifying two specified points on the display unit on which the ortho-image is displayed, it is possible to easily detect the distance between the two specified points. In the road survey method of the present invention, by specifying a specified range on the display unit on which the ortho-image is displayed, it is possible to easily detect the area of ​​the specified range. [Brief description of the drawings]

[0035] [Figure 1] FIG. 1 is a diagram showing a schematic configuration of an orthoimage creation system according to an embodiment of the present invention. [Diagram 2] FIG. 13 is a diagram showing a state in which a number of anti-aircraft signs are installed near both ends of a road when the road is photographed from above. [Diagram 3] FIG. [Figure 4] 13 is a diagram illustrating a state in which an anti-aircraft marker is included in two captured images. FIG. [Diagram 5] FIG. 2 is a diagram for explaining a method for creating an orthoimage in the orthoimage creation device. [Figure 6] FIG. 13 is a diagram showing a state in which an orthoimage is displayed on a display unit. [Figure 7] FIG. 2 is an enlarged view of a road surface on which cracks have formed. [Figure 8] FIG. 2 is an enlarged view of a road surface on which cracks have formed. [Figure 9] This is an enlarged view of the road surface where cracks have formed. [Figure 10] A close-up view of a road surface with a manhole. [Figure 11]FIG. 1 is a diagram illustrating the tape used for the detection and evaluation of cracks formed on the road surface. [Figure 12] FIG. 12 is a diagram showing the state in which the tape of FIG. 11 has been applied to the surface of a road. [Figure 13] FIG. 13 is an ortho-image of the road surface of FIG. 12. [Figure 14] FIG. 1 is a diagram illustrating a method for investigating the crack condition on a road surface. [Figure 15] FIG. 2 is a diagram showing a survey area in an orthoimage displayed on a display unit. [Figure 16] FIG. 16 is an enlarged view of portion A within the survey area shown in FIG. 15. [Figure 17] FIG. 13 is a diagram showing the results of investigating the road surface conditions for each survey area in the entire survey region. [Figure 18] 1A and 1B are diagrams illustrating a method for investigating the positions of planar elements around a road. [Figure 19] FIG. 2 is a diagram showing a survey area in an orthoimage displayed on a display unit. [Figure 20] FIG. 1 is an ortho-CAD plan view of the ortho-image. [Figure 21] FIG. 21 is a diagram showing a case where planar elements around a road are traced on the ortho-CAD plan view of FIG. 20. [Figure 22] This is a diagram illustrating planar elements of the entire survey area. [Figure 23] FIG. 1 is a diagram illustrating an investigation method for repairing the area around a manhole. [Figure 24] FIG. 2 is a diagram showing a survey area in an orthoimage displayed on a display unit. [Diagram 25] FIG. 2 is a schematic diagram illustrating a longitudinal section plan. [Figure 26] FIG. 2 is a schematic diagram illustrating a cross-sectional plan view. [Figure 27] FIG. 13 is a diagram showing the elevation of a specified position around a manhole being displayed. [Figure 28] A diagram showing the adjustment heights of each position around the manhole. [Figure 29]FIG. 13 is a diagram for explaining a method for investigating the distance between specified points on a road surface. [Diagram 30] FIG. 13 is a diagram showing a state in which the distance between specified points on the road surface is displayed. [Diagram 31] FIG. 13 is a diagram for explaining a method for investigating the area of ​​a specified range on a road surface. [Diagram 32] FIG. 13 is a diagram showing a state in which the area of ​​a specified range of a road surface is displayed. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0036] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. An orthoimage creation system 1 according to an embodiment of the present invention includes a total station 2 installed at a known point (e.g., a reference point), a UAV3 (Unmanned Aerial Vehicle) which is an unmanned aerial vehicle serving as an imaging device, a 3D scanner 4 (three-dimensional scanning device) installed at the known point, and an orthoimage creation device 10 to which the total station 2, the UAV3, and the 3D scanner 4 are wirelessly connected.

[0037] The total station 2 emits distance measurement light toward each point on the road surface, receives the light reflected at each point, and obtains the three-dimensional coordinates of each point relative to a known point based on the number of times the light wave oscillates from emission to reception, and supplies the three-dimensional coordinates to the orthoimage creation system 10. In this embodiment, the total station 2 is used to obtain the three-dimensional coordinates of multiple anti-aircraft signs 6.

[0038] The UAV 3 has an imaging device, photographs the road surface from the sky, acquires imaging data, and supplies the imaging data to the orthoimage creation device 10.

[0039] The 3D scanner 4 irradiates laser light to obtain each point on the road surface as three-dimensional coordinated point cloud data (a set of elevations having planar position coordinates), and supplies the point cloud data to the orthoimage creation system 10. The 3D scanner 4 emits line laser light, for example, vertically and horizontally, to the measurement object (road surface), and measures the time it takes for the laser pulse to travel back and forth between the measurement point of the measurement object and the sensor, thereby determining the distance to the measurement point. In this embodiment, the 3D scanner 4 is used to obtain three-dimensional coordinates (point cloud data) of each point in an area including a repair location where road repair is performed at the time of starting repair work. The point cloud data obtained by the 3D scanner 4 is data at positions spaced apart, for example, at intervals of 25 cm or less, and in this embodiment, the 3D scanner 4 obtains point cloud data at positions spaced apart, for example, at intervals of 5 millimeters.

[0040] As shown in FIG. 1, the orthoimage creation device 10 is composed of, for example, a microcomputer, and includes a CPU, a ROM in which a program for controlling the operation of the orthoimage creation device 10 is stored, and a RAM in which data, etc. used when executing the program are temporarily stored.

[0041] The orthoimage creation device 10 includes a coordinate storage unit 11, a captured image storage unit 12, an orthoimage creation unit 13, and a display control unit 14. The orthoimage creation device 10 also includes a display unit 5 such as a display screen.

[0042] The coordinate storage unit 11 separately stores three-dimensional coordinates of characteristic points such as a plurality of anti-aircraft signs 6 acquired by the total station 2.

[0043] The captured image storage unit 12 stores a plurality of images of a road taken from above by a UAV 3 flying at a substantially constant altitude above the road. When taking images, the UAV 3 flies at an altitude of 20 meters or less above the ground, for example, at an altitude of 5 to 20 meters, and preferably at an altitude of 5 to 15 meters.

[0044] When a road is photographed from the sky by a UAV 3, as shown in FIG. 2, a plurality of anti-aircraft signs 6 are installed as a plurality of feature points, for example, near both ends of the road. The plurality of anti-aircraft signs 6 are installed along the ends of the road (longitudinal direction of the road) at intervals of, for example, 5 to 15 meters. The plurality of anti-aircraft signs 6 are installed in consideration of connecting a plurality of photographed images taken from the sky to create an orthoimage. The anti-aircraft signs 6 are feature points to which three-dimensional coordinates are supplied, and are used as evaluation points. Note that, when connecting a plurality of photographed images to create an orthoimage, in addition to the anti-aircraft signs 6, feature points included in the plurality of photographed images and to which three-dimensional coordinates are not supplied may be used.

[0045] The anti-aircraft sign 6 is a square plate-like member as shown in FIG. 3. The anti-aircraft sign 6 has a pattern that clearly identifies its center position. The anti-aircraft sign 6 has an adhesive layer formed on its back surface, and is in the form of a sticker with a backing paper attached to cover the adhesive layer. By removing the backing paper and attaching it to the road, it can be easily fixed to the installation location. Therefore, when using the anti-aircraft sign 6, the backing paper covering the adhesive layer is removed, and the back surface of the anti-aircraft sign 6 is attached to the road surface for use. The anti-aircraft sign 6 of this embodiment is, for example, a square shape of 9 cm x 9 cm, but the type, shape, size, pattern, etc. of the anti-aircraft sign 6 are not limited thereto.

[0046] As shown in Fig. 4, the multiple images captured by the UAV 3 are captured such that each anti-aircraft sign 6 is included in at least two captured images. Therefore, at least one common anti-aircraft sign 6 is captured in two adjacent captured images. Note that Fig. 4 illustrates a case in which the anti-aircraft sign 6 is included in all captured images, but the multiple images captured by the UAV 3 may be captured such that either the anti-aircraft sign 6 or a feature point other than the anti-aircraft sign 6 is included in at least two captured images.

[0047] The orthoimage creation unit 13 creates an orthoimage based on the three-dimensional coordinates of the anti-aircraft sign 6 stored in the coordinate storage unit 11 and the multiple captured images stored in the captured image storage unit 12. Specifically, the orthoimage creation unit 13 performs SfM (Structure from Motion) analysis or the like on the data for the multiple captured images to connect two adjacent captured images based on the common anti-aircraft sign 6 captured in them to create an orthoimage. Note that when there is a vehicle on the road in the captured image for creating the orthoimage, it is possible to create an orthoimage without a vehicle on the road by automatically recognizing the vehicle (by automatic image recognition) and replacing the area around the vehicle on the road with an image of the road without a vehicle in another captured image.

[0048] The display control unit 14 displays the orthoimage created by the orthoimage creation unit 13 on the display unit 5. The user can perform an operation of designating a predetermined position within the image displayed on the display unit 5 by pressing the display surface 5a of the display unit 5. For example, in a state in which the orthoimage created by the orthoimage creation unit 13 is displayed on the display unit 5, the user can perform an operation of designating a predetermined position by pressing a predetermined position within the orthoimage displayed on the display surface 5a of the display unit 5.

[0049] (Creating orthophotos) A method for creating an orthoimage in the orthoimage creation device 10 will be described with reference to FIG.

[0050] In step S1 (coordinate acquisition step), the total station 2 acquires three-dimensional coordinates, i.e., planar positions (latitude, longitude) and altitude (height), for a number of specified positions around the repair area where road repairs are to be performed, i.e., specified positions where a number of anti-aircraft signs 6 are to be installed.

[0051] In step S2 (photographing step), the road is photographed from the sky by the UAV 3 flying at an altitude of 20 meters or less above the ground. When photographing is performed, a plurality of anti-aircraft markers 6 are installed in advance at a plurality of predetermined positions surveyed in step S1. Therefore, a plurality of photographed images are taken of the plurality of anti-aircraft markers 6 so that each anti-aircraft marker 6 is included in at least two photographed images.

[0052] In step S3 (orthoimage creation step), an orthoimage is created based on the three-dimensional coordinates acquired in step S1 and the multiple captured images taken in step S2.

[0053] In step S4 (display step), the orthoimage is displayed on the display unit 5 as shown in Fig. 6. In this embodiment, the ground pixel size of the orthoimage is 5 mm or less.

[0054] 7 to 9 are enlarged views of a road surface on which cracks have been formed. Fig. 10 is an enlarged view of a road surface on which a manhole is located. In this way, in the orthoimage created by the orthoimage creation device 10 of this embodiment, it is possible to clearly identify the cracks formed on the road surface, and also to clearly identify the type of manhole based on the letters and symbols written on the manhole cover.

[0055] In addition, when investigating the crack condition of the road surface, conventionally, when the road condition is investigated using a dedicated road surface property measuring vehicle, it is possible to detect cracks of about 1 mm width formed on the road surface. Therefore, an evaluation was conducted on whether the orthoimage created by the present invention can detect cracks of about 1 mm width formed on the road surface in the same way as a dedicated road surface property measuring vehicle.

[0056] For the above evaluation, 1mm, 2mm, and 3mm wide tapes were attached to the road surface to simulate cracks of 1mm, 2mm, and 3mm wide formed on the road surface, as shown in Figures 11 and 12. After that, the road with the simulated cracks formed was photographed from the sky by UAV3 flying at an altitude of 20 meters or less above the ground, and an orthoimage was created.

[0057] Fig. 13 shows an ortho-image of a road with simulated cracks, and it was found that the ortho-image created by the present invention can detect all of the simulated cracks of 1 mm, 2 mm, and 3 mm widths formed on the road surface. Therefore, the ortho-image created by the present invention can detect cracks of about 1 mm width formed on the road surface.

[0058] (Road survey method using orthophotography) The orthoimages created by the orthoimage creation device 10 as described above are used for various surveys carried out when road repairs are carried out.

[0059] In this embodiment, a road survey method is described in which orthoimages created by an orthoimage creation device 10 are used to (1) investigate the crack condition on the road surface, (2) investigate the location of planar elements around the road including the area where repairs will be performed, (3) investigate the area around a manhole to repair, (4) investigate the distance between two specified points on the road surface, and (5) investigate the area of ​​a specified range on the road surface.

[0060] (Road Survey Method 1) The method for investigating the crack condition on the road surface will be explained with reference to FIG.

[0061] In the investigation of the crack condition of the road surface, the locations where cracks have formed on the road surface, including the repair areas where road repairs will be performed, and the cracking rate and patching rate in those areas are investigated.

[0062] After the orthoimage is displayed in steps S1 to S4 described above, in step S5, the crack condition of the road surface is investigated based on the orthoimage displayed on the display unit 5. Specifically, the investigation area of ​​the road displayed on the display unit 5 is divided into a plurality of investigation ranges, and the crack rate and patching rate of the road surface are investigated for each investigation range.

[0063] 15 illustrates a survey area in an orthoimage displayed on the display unit 5. In this embodiment, the survey area is divided into survey ranges of 50 cm x 50 cm, and for each survey range, a crack rate survey and a patching rate survey are conducted as a survey of the crack condition. In this embodiment, the crack rate survey is conducted by surveying the crack amount (quantity of cracks) for each survey range.

[0064] FIG. 16 is an enlarged view of part A in the survey area shown in FIG. 15, showing the state in which the area is divided into multiple survey ranges. FIG. 16 illustrates, for each survey range, a state in which there are no cracks and a patching rate of 25% or less, a linear crack state (a state in which there is one crack), a planar crack state (a state in which there are two or more cracks), a patching rate of 25 to 75%, and a patching rate of 75% or more. FIG. 16 illustrates the road surface state for each survey range using different patterns, but the road surface state for each survey range may be displayed using different colors.

[0065] In step S6 (road condition display step), as shown in Fig. 17, the results of the survey of the crack condition of the road surface for each survey range in the entire survey area are displayed on the display unit 5. In Fig. 17, the survey ranges of linear crack condition, planar crack condition, patching rate of 25 to 75% and patching rate of 75% or more may be displayed, for example, in different colors. Also, the survey ranges of linear crack condition and planar crack condition, and the survey ranges of patching rate of 25 to 75% and patching rate of 75% or more may be displayed, for example, in different colors.

[0066] (Road Survey Method 2) The method of investigating the positions of planar elements around a road will be described with reference to FIG.

[0067] When investigating the locations of planar elements around a road, the locations of planar elements are investigated, including the edges of the road, including repair areas where road repairs will be performed, road deformations, dividing lines such as white painted areas indicating lanes on the road surface, and lines indicating the locations of manholes, etc.

[0068] After the orthoimage is created by steps S1 to S4 described above, in step S8 (planar element drawing step), a tracing process of planar elements around the road is performed manually or automatically (auto-trace process) based on the orthoimage displayed on the display unit 5. Specifically, in the road displayed on the display unit 5, a tracing process of planar elements is performed including, for example, road edges, road deformations, white painted parts such as lane lines on the road surface, dividing lines, lines indicating the positions of manholes, etc.

[0069] In Fig. 19, the survey area in the orthoimage displayed on the display unit 5 is illustrated. Fig. 20 is an ortho-CAD plan view of the orthoimage shown in Fig. 6, and Fig. 21 shows a diagram in which the planar elements around the road are traced on the ortho-CAD plan view of Fig. 20. An ortho-CAD plan view is a plan view obtained by converting an orthoimage into 2D CAD. Therefore, in Fig. 21, lines indicating the positions of planar elements around the road are added to the ortho-CAD plan view corresponding to the orthoimage of Fig. 20.

[0070] In step S8, as shown in FIG. 22, a tracing process is performed on planar elements around roads in the entire survey range, and the planar elements are plotted and displayed on the display unit 5.

[0071] (Road Survey Method 3) The investigation method for repairing the area around a manhole will be explained with reference to FIG.

[0072] In a survey to repair the area around a manhole, the height (adjustment height) to adjust the elevation of the area around the manhole to match the elevation of the repair plan surface is surveyed. Therefore, the adjustment height of the area around the manhole is the elevation difference between the elevation of the area around the manhole at the time of starting repair work and the elevation of the repair plan surface. The adjustment height of the area around the manhole is surveyed by investigating the elevation difference between two points on the upstream and downstream sides of the manhole in the longitudinal direction, and the elevation difference between two points on the upstream and downstream sides of the manhole in the transverse direction.

[0073] Fig. 24 illustrates a survey area in the orthoimage displayed on the display unit 5. The survey area in Fig. 24 includes one manhole and the surrounding area of ​​the manhole.

[0074] After the orthoimage is displayed in the above-mentioned steps S1 to S4, a longitudinal and transverse planning is carried out in step S9, and planning surface data showing a repair planning surface when repairing a road is obtained.

[0075] The repair plan includes a longitudinal and transverse plan, and after a longitudinal plan is made along the longitudinal direction of the road, transverse plans are made along the transverse direction at a plurality of points on the road to obtain a repair plan surface to be used when carrying out the repair. Therefore, the repair plan surface includes plan surface data showing a longitudinal plan surface and plan surface data showing a plurality of transverse plan surfaces.

[0076] The longitudinal plan includes a plan for the elevation of each point on a line along the longitudinal direction of the road in the center of the road. For example, FIG. 25 shows a longitudinal plan surface for the elevation of each point on a line along the center of the road. In FIG. 25, a repair area that requires a repair plan is between an unrepaired area on the left side and an unrepaired area on the right side. The longitudinal plan surface is shown for the repair area in FIG. 25 along with the elevation change based on the point cloud data.

[0077] The longitudinal section of Figure 25 is obtained by connecting the elevations at each point on a line along the center of the road, after the elevations at each point are planned taking into consideration the flatness of the road, etc. The positions on the line along the center of the road are, for example, every 10 m or every 20 m.

[0078] In the longitudinal plan, the elevation at each position on the line along the center of the road is planned, followed by the cross-sectional plan. The cross-sectional plan is a plan for the elevation of each point on the line along the cross-sectional direction of the road at each position on the line along the center of the road. For example, FIG. 26 shows a cross-sectional plan surface for the elevation of each point on the line along the cross-sectional direction of the road at point a in FIG. 25. In FIG. 26, a repair location that requires a repair plan is located between the left end and the right end of the road. At the repair location, the elevation change based on the point cloud data is illustrated, and the cross-sectional plan surface is also illustrated. In FIG. 26, the slope of the road is illustrated for easy understanding.

[0079] The cross-section planning surface is obtained by planning, taking into consideration the gradient of the slope that slopes downward from the elevation of the road center toward both ends for each position on the line along the center of the road shown in Figure 25. For example, when planning a cross-section of a road, it is generally designed so that the road slopes downward at a predetermined gradient from the center toward the ends.

[0080] For example, in the cross-sectional plan surface of FIG. 26, the elevation of the road center at point a in the longitudinal plan surface of FIG. 25 decreases to point a1 along a slope that slopes downward at a predetermined slope toward both ends of the road, and then the elevation decreases to the left end and right end of the road along a connection surface that connects point a1 with the left end and right end of the road. Therefore, when repair is performed based on the cross-sectional plan surface, the surface layer of the asphalt pavement formed at the repaired location and the concrete parts at the left end and right end of the road are connected without any step. Note that the cross-sectional plan surface of FIG. 26 is an example of a cross-sectional plan surface, and the method of cross-sectional planning is not limited to this. Therefore, the cross-sectional plan surface may be designed so that slopes that slope downward at different slopes from the road center toward the ends of the road are connected, for example.

[0081] A repair planning surface for repairing the road surface is obtained by connecting the cross-sectional planning surfaces at each position on the line along the center of the road obtained as described above in the longitudinal direction.

[0082] In step S10 (point cloud data acquisition step), point cloud data of each point on the road surface is acquired by the 3D scanner 4. The point cloud data acquired by the 3D scanner 4 is converted into a three-dimensional TIN model (irregular triangular network), which is a collection of triangular planes connected at vertices, and data corresponding to the latitude, longitude, and height of each point on the road surface can be derived. Even if point cloud data of each point in the survey area is not acquired by the 3D scanner 4, data corresponding to the latitude, longitude, and height of each point can be derived.

[0083] In step S11 (altitude difference derivation step), by pressing and specifying a predetermined position in the vicinity of the manhole based on the orthoimage displayed on the display surface 5a of the display unit 5, the planar position (latitude, longitude) of the predetermined position is displayed as shown in Fig. 27. Therefore, by changing the position specified in the orthoimage displayed on the display surface 5a of the display unit 5 in the vicinity of the manhole, two planar positions on the upstream and downstream sides in the longitudinal direction of the manhole and two planar positions on the upstream and downstream sides in the transverse direction of the manhole are detected.

[0084] The elevation of each position in the vicinity of the manhole at the time of starting repair work is derived based on the point cloud data acquired by the 3D scanner 4, since the planar position of each position in the vicinity of the manhole is detected. In this embodiment, the elevation of all planar positions in the orthoimage can be derived based on the point cloud data acquired by the 3D scanner 4, using the orthoimage and the point cloud data acquired by the 3D scanner 4. The elevation of each position on the repair plan surface is extracted from the plan surface data indicating the repair plan surface acquired in step S9.

[0085] Then, the elevation difference between the elevation of each position around the manhole at the time of repair work and the elevation of each position on the repair plan is derived as the adjustment height. Therefore, the adjustment heights of two positions on the upstream and downstream sides of the manhole in the longitudinal direction and the adjustment heights of two positions on the upstream and downstream sides of the manhole in the transverse direction are derived. In FIG. 28, the adjustment heights of each position around the manhole are respectively calculated as a 1 cm, a 2 cm, a 3 cm, a 4 cm. Therefore, a 1 cm is the transverse upstream adjustment height of the manhole, a 2 cm is the adjustment height of the manhole on the upstream side in the longitudinal direction, and a 3 cm is the transverse downstream adjustment height of the manhole, a 4 cm is the adjustment height on the downstream side of the manhole in the longitudinal direction.

[0086] (Road Survey Method 4) A method for investigating the distance between two specified points on the road surface will be described with reference to FIG.

[0087] In investigating the distance between two specified points on the road surface, when various distances are required for road repair, the distances are investigated based on the orthoimage displayed on the display unit 5. Distances required for road repair include, for example, the length of the road repair portion, the width of the road, and the length of a specified area on the road surface.

[0088] In step S101 (point cloud data acquisition step), point cloud data of each point on the road surface around the repair location where road repair is performed is acquired by the 3D scanner 4. The point cloud data acquired by the 3D scanner 4 is converted into a three-dimensional TIN model (irregular triangular network) which is a collection of triangular planes connected at vertices, and data corresponding to the latitude, longitude, and height of each point on the road surface can be derived. Even if point cloud data of each point in the survey area is not acquired by the 3D scanner 4, data corresponding to the latitude, longitude, and height of each point can be derived.

[0089] In step S102 (coordinate acquisition step), based on the point cloud data acquired in step S101, three-dimensional coordinates, i.e., planar positions (latitude, longitude) and altitudes (height), are acquired for a plurality of predetermined positions, i.e., predetermined positions where a plurality of anti-aircraft signs 6 are installed, around the repair location where road repair is performed. The three-dimensional coordinates of the plurality of predetermined positions may be acquired by the total station 2.

[0090] In step S103 (photographing step), the road is photographed from the sky by the UAV 3 flying at an altitude of 20 meters or less above the ground. When photographing, a plurality of anti-aircraft markers 6 are installed in advance at a plurality of predetermined positions whose three-dimensional coordinates were acquired in step S102. Therefore, a plurality of photographed images are taken of the plurality of anti-aircraft markers 6 such that each anti-aircraft marker 6 is included in at least two photographed images.

[0091] In step S104 (orthoimage creation step), an orthoimage is created based on the three-dimensional coordinates acquired in step S102 and the multiple captured images captured in step S103. At that time, the orthoimage created in step S104 is associated with the point cloud data acquired in step S101. That is, each point in the orthoimage is associated with the three-dimensional coordinates of the point cloud data, and each point on the orthoimage corresponds to a planar position (latitude, longitude) and an altitude (height).

[0092] In step S105 (display step), the orthoimage is displayed on the display unit 5 as shown in FIG. 6. In step S106 (distance display step), the distance between two designated points on the road surface is displayed by pressing and specifying them on the orthoimage displayed on the display surface 5a of the display unit 5. For example, as shown in FIG. 30, when two designated points A1 and A2 at an intersection are specified, the distance between the designated points A1-A2 is displayed. Therefore, in step S103 (photographing step), when a road is photographed from the sky by a UAV 3 flying at an altitude of 20 meters or less above the ground, even if various distances required for road repair are not measured, the distance between various designated points within the range of the orthoimage is detected by changing the positions of the two designated points on the road surface in the orthoimage displayed on the display surface 5a of the display unit 5.

[0093] (Road Survey Method 5) The method of investigating the area of ​​a specified range on the road surface will be described with reference to FIG.

[0094] In the survey of the area of ​​a specified range of the road surface, when the areas of various areas are required for road repair, the areas of those areas are surveyed based on the orthoimage displayed on the display unit 5. The areas required for road repair include, for example, the area of ​​the road repair portion.

[0095] In step S101 (point cloud data acquisition step), point cloud data of each point on the road surface around the repair location where road repair is performed is acquired by the 3D scanner 4. The point cloud data acquired by the 3D scanner 4 is converted into a three-dimensional TIN model (irregular triangular network) which is a collection of triangular planes connected at vertices, and data corresponding to the latitude, longitude, and height of each point on the road surface can be derived. Even if point cloud data of each point in the survey area is not acquired by the 3D scanner 4, data corresponding to the latitude, longitude, and height of each point can be derived.

[0096] In step S102 (coordinate acquisition step), based on the point cloud data acquired in step S101, three-dimensional coordinates, i.e., planar positions (latitude, longitude) and altitudes (height), are acquired for a plurality of predetermined positions, i.e., predetermined positions where a plurality of anti-aircraft signs 6 are installed, around the repair location where road repair is performed. The three-dimensional coordinates of the plurality of predetermined positions may be acquired by the total station 2.

[0097] In step S103 (photographing step), the road is photographed from the sky by the UAV 3 flying at an altitude of 20 meters or less above the ground. When photographing, a plurality of anti-aircraft markers 6 are installed in advance at a plurality of predetermined positions whose three-dimensional coordinates were acquired in step S102. Therefore, a plurality of photographed images are taken of the plurality of anti-aircraft markers 6 such that each anti-aircraft marker 6 is included in at least two photographed images.

[0098] In step S104 (orthoimage creation step), an orthoimage is created based on the three-dimensional coordinates acquired in step S102 and the multiple captured images captured in step S103. At that time, the orthoimage created in step S104 is associated with the point cloud data acquired in step S101. That is, each point in the orthoimage is associated with the three-dimensional coordinates of the point cloud data, and each point on the orthoimage corresponds to a planar position (latitude, longitude) and an altitude (height).

[0099] In step S105 (display step), the orthoimage is displayed on the display unit 5 as shown in FIG. 6. In step S108 (area display step), a designated range of the road surface is designated on the orthoimage displayed on the display surface 5a of the display unit 5, and the area of ​​the designated range is displayed as shown in FIG. 32. For example, as shown in FIG. 32, when a designated range (shaded portion) indicating the upper part of an intersection is designated, the area of ​​the designated range is displayed. Therefore, in step S103 (photographing step), when a road is photographed from the sky by the UAV 3 flying at an altitude of 20 meters or less above the ground, even if various areas required for road repair are not measured, the areas of various regions within the range of the orthoimage are detected by changing the position of the designated range of the road surface in the orthoimage displayed on the display surface 5a of the display unit 5.

[0100] The orthoimage creation system 1 of this embodiment includes a coordinate memory unit 11 that stores three-dimensional coordinates for multiple anti-aircraft signs 6, a captured image memory unit 12 that stores multiple captured images of multiple anti-aircraft signs 6 taken by a UAV 3 flying at an altitude of 20 meters or less above the ground, so that each anti-aircraft sign 6 is included in at least two captured images, and an orthoimage creation unit 13 that creates an orthoimage based on the three-dimensional coordinates of each anti-aircraft sign 6 stored in the coordinate memory unit 11 and the multiple captured images stored in the captured image memory unit 11.

[0101] The orthoimage creation method of this embodiment includes a coordinate acquisition step of acquiring three-dimensional coordinates for multiple anti-aircraft signs 6, a photographing step of capturing multiple images of the multiple anti-aircraft signs 6 using a UAV 3 flying at an altitude of 20 meters or less above the ground so that each anti-aircraft sign 6 is included in at least two captured images, and an orthoimage creation step of creating an orthoimage based on the three-dimensional coordinates of each feature point acquired by the coordinate acquisition step and the multiple captured images captured by the photographing step.

[0102] As a result, in the orthoimage creation system 1 and the orthoimage creation method of this embodiment, an orthoimage is created based on a plurality of images taken by a UAV 3 flying at an altitude of 20 meters or less above the ground, making it possible to create an orthoimage that can clearly distinguish the state of the road surface and the positions of planar elements around the road. In the orthoimage created in this embodiment, it is possible to clearly distinguish the locations where cracks have occurred on the road and the locations where patching has occurred. Therefore, since there is no need to run a dedicated road surface property measurement vehicle to investigate the crack state of the road surface, it is possible to investigate the road condition regardless of the road width.

[0103] In addition, in the orthoimage created in this embodiment, the positions of planar elements including road edges, lane markings, etc. can be clearly identified. Therefore, since it is not necessary to perform surveying of a large number of planar positions in order to plot planar elements including road edges, lane markings, etc., it is possible to easily plot planar elements based on the orthoimage.

[0104] In addition, the ortho-image created in this embodiment can detect each planar position in the longitudinal direction and transverse direction of the area around the manhole. Therefore, after identifying each planar position in the longitudinal direction and transverse direction of the area around the manhole, it is possible to extract the elevation of each planar position from the point cloud data acquired by the 3D scanning device. Therefore, in order to detect the elevation of each planar position in the longitudinal direction and transverse direction of the area around the manhole, it is not necessary to create road longitudinal sections and road transverse sections for each manhole. Therefore, it is possible to easily detect the manhole adjustment height.

[0105] In the orthoimage creation system 1 of this embodiment, an anti-aircraft marker 6 installed on the ground is used when photographing with the UAV 3, and the coordinate memory unit 11 stores the three-dimensional coordinates of the anti-aircraft marker 6 acquired by the total station 2.

[0106] In the orthoimage creation method of this embodiment, an anti-aircraft sign 6 installed on the ground is used at the time of photographing in the photographing step, and the three-dimensional coordinates of the anti-aircraft sign 6 are acquired by the total station 2 in the coordinate acquisition step.

[0107] As a result, in the orthoimage creation system 1 and orthoimage creation method of this embodiment, it is possible to provide three-dimensional coordinates to the orthoimage based on the three-dimensional coordinates of the anti-aircraft sign 6 contained in the image captured by the UAV 3.

[0108] The road survey method of this embodiment includes a coordinate acquisition step of acquiring three-dimensional coordinates of multiple anti-aircraft signs 6, a photographing step of photographing multiple images of multiple anti-aircraft signs 6 using a UAV 3 flying at an altitude of 20 meters or less above the ground, so that each anti-aircraft sign 6 is included in at least two photographed images, an orthoimage creation step of creating an orthoimage based on the three-dimensional coordinates of each anti-aircraft sign 6 acquired by the coordinate acquisition step and the multiple photographed images taken by the photographing step, a display step of displaying the orthoimage on the display unit 5, a derivation step of dividing the survey area into multiple survey ranges in the orthoimage displayed on the display unit 5 and deriving a crack rate or patching rate for each of the multiple survey ranges, and a road condition display step of displaying the road condition by adding a color corresponding to the magnitude of the crack rate or patching rate of each survey range derived by the derivation step to the orthoimage displayed on the display unit 5.

[0109] As a result, in the road inspection method of this embodiment, an orthoimage is created based on a plurality of images taken by a UAV3 flying at an altitude of 20 meters or less above the ground, making it possible to create an orthoimage that can clearly distinguish the state of the road surface and the positions of planar elements around the road. In the orthoimage created in this embodiment, it is possible to clearly distinguish the locations where cracks have occurred on the road and the locations where patching has occurred. Therefore, since there is no need to run a dedicated road surface property measurement vehicle to investigate the crack state of the road surface, it is possible to investigate the road condition regardless of the road width.

[0110] The road survey method of this embodiment includes a coordinate acquisition step of acquiring three-dimensional coordinates for multiple anti-aircraft signs 6, a photographing step of taking multiple images of multiple anti-aircraft signs 6 using a UAV 3 flying at an altitude of 20 meters or less above the ground so that each anti-aircraft sign 6 is included in at least two photographed images, an orthoimage creation step of creating an orthoimage based on the three-dimensional coordinates of each anti-aircraft sign 6 acquired by the coordinate acquisition step and the multiple photographed images taken by the photographing step, a display step of displaying the orthoimage on the display unit 5, and a planar element mapping step of tracing planar elements in the orthoimage displayed on the display unit 5 to map the planar elements.

[0111] As a result, in the road survey method of this embodiment, an orthoimage is created based on a plurality of images taken by a UAV3 flying at an altitude of 20 meters or less above the ground, making it possible to create an orthoimage that can clearly distinguish the state of the road surface and the positions of planar elements around the road. In the orthoimage created by the present invention, the positions of planar elements including road edges and lane marking lines can be clearly distinguished. Therefore, since it is not necessary to perform surveying of a large number of planar positions in order to plot planar elements including road edges and lane marking lines, it is possible to easily plot planar elements based on the orthoimage.

[0112] The road survey method of this embodiment includes a coordinate acquisition step of acquiring three-dimensional coordinates for multiple anti-aircraft signs 6, a photographing step of taking multiple images of multiple anti-aircraft signs 6 using a UAV 3 flying at an altitude of 20 meters or less above the ground so that each anti-aircraft sign 6 is included in at least two photographed images, an orthoimage creation step of creating an orthoimage based on the three-dimensional coordinates of each anti-aircraft sign 6 acquired by the coordinate acquisition step and the multiple photographed images taken by the photographing step, a display step of displaying the orthoimage on a display unit 5, a point cloud data acquisition step of acquiring point cloud data of an area including the surrounding area of ​​the manhole in the orthoimage, and an elevation difference derivation step of deriving the elevation difference between the elevation of the surrounding area of ​​the manhole in the orthoimage displayed on the display unit 5 and the elevation of the surrounding area of ​​the manhole on the repair plan surface.

[0113] As a result, in the road survey method according to the present embodiment, an ortho-image is created based on a plurality of images taken by a UAV 3 flying at an altitude of 20 meters or less above the ground, making it possible to create an ortho-image that can clearly distinguish the state of the road surface and the positions of planar elements around the road. In the ortho-image created by the present invention, it is possible to detect each planar position in the longitudinal direction and the transverse direction of the periphery of the manhole. Therefore, after identifying each planar position in the longitudinal direction and the transverse direction of the periphery of the manhole, the elevation of each planar position can be derived based on the point cloud data of the area including the periphery of the manhole. Therefore, in order to detect the elevation of each planar position in the longitudinal direction and the transverse direction of the periphery of the manhole, it is not necessary to create a road longitudinal section and a road transverse section for each manhole. Therefore, it is possible to easily detect the manhole adjustment height.

[0114] The road survey method of this embodiment is characterized by including a coordinate acquisition step of acquiring three-dimensional coordinates for multiple anti-aircraft signs 6, a photographing step of photographing multiple images of multiple anti-aircraft signs 6 using a UAV 3 flying at an altitude of 20 meters or less above the ground, such that each anti-aircraft sign 6 is included in at least two photographed images, an orthoimage creation step of creating an orthoimage based on the three-dimensional coordinates of each anti-aircraft sign 6 acquired by the coordinate acquisition step and the multiple photographed images taken by the photographing step, a point cloud data acquisition step of acquiring point cloud data of an area including the multiple anti-aircraft signs 6, a display step of displaying the orthoimage on the display unit 5, a designation step of designating two designated points spaced apart from each other in the orthoimage displayed on the display unit 5, and a distance display step of displaying the distance between the two designated points when two designated points are designated by the designation step.

[0115] As a result, in the road inspection method according to the present invention, an ortho-image is created based on a plurality of images taken by a UAV 3 flying at an altitude of 20 meters or less above the ground, and the ortho-image is associated with point cloud data of an area in the ortho-image, so that it is possible to clearly determine the positions of planar elements including road edges and lane markings and other division lines, and to display, for example, the distance between two designated points in the area surrounding the road in the ortho-image. Therefore, even if an inspector does not measure the distance between the two designated points in the area surrounding the road, the distance between the two designated points can be easily detected by specifying the two designated points on the display unit 5 on which the ortho-image is displayed.

[0116] The road survey method of the present invention is characterized by comprising a coordinate acquisition step of acquiring three-dimensional coordinates for multiple anti-aircraft signs 6, a photographing step of photographing multiple images of multiple anti-aircraft signs 6 using a UAV 3 flying at an altitude of 20 meters or less above the ground so that each anti-aircraft sign 6 is included in at least two photographed images, an orthoimage creation step of creating an orthoimage based on the three-dimensional coordinates of each anti-aircraft sign 6 acquired by the coordinate acquisition step and the multiple photographed images taken by the photographing step, a point cloud data acquisition step of acquiring point cloud data of an area including the multiple anti-aircraft signs 6, a display step of displaying the orthoimage on a display unit 5, a designation step of designating a designated range within the orthoimage displayed on the display unit 5, and an area display step of displaying the area of ​​the designated range when the designated range is designated by the designation step.

[0117] As a result, in the road inspection method according to the present invention, an ortho-image is created based on a plurality of images taken by a UAV 3 flying at an altitude of 20 meters or less above the ground, and the ortho-image is associated with point cloud data of an area in the ortho-image, so that it is possible to clearly determine the positions of planar elements including road edges and lane markings and other dividing lines, while displaying, for example, the area of ​​a designated range in the area surrounding the road in the ortho-image. Therefore, even if an inspector does not measure the area of ​​the designated range in the area surrounding the road, the area of ​​the designated range can be easily detected by specifying the designated range on the display unit 5 on which the ortho-image is displayed.

[0118] Although an embodiment of the present invention has been described above, the specific configuration of each part is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit of the present invention.

[0119] In the above embodiment, an ortho-image is created based on an image taken from above the road by a UAV 3 flying at a substantially constant altitude, but the present invention includes a method of creating an ortho-image based on an image taken from above the road by a UAV 3 flying at a different altitude 20 meters or less above the ground. In the above embodiment, the three-dimensional coordinates of the anti-aircraft sign 6 installed around the road are acquired by the total station 2, but the three-dimensional coordinates of the anti-aircraft sign 6 installed around the road may be acquired by a GNSS (Global Navigation Satellite System), which is a positioning system using satellites such as GPS. The three-dimensional coordinates of the anti-aircraft sign 6 installed around the road may be acquired by scanning with a 3D scanner 4. The anti-aircraft sign 6 in the above embodiment has a pattern that clearly identifies the central position used as the evaluation point, but has a pattern that identifies a position other than the central position of the anti-aircraft sign 6, and the position other than the central position may be used as the evaluation point. In the above embodiment, the anti-aircraft signs 6 are installed at intervals of, for example, 5 to 15 meters along the edge of the road (longitudinal direction of the road), but the arrangement of the anti-aircraft signs 6 is arbitrary. Therefore, the anti-aircraft signs 6 may be installed at intervals of, for example, 1 meter or less along the width direction of the road. In step S1 (coordinate acquisition step), the total station 2 acquires three-dimensional coordinates for the predetermined positions where the anti-aircraft signs 6 are installed. If the three-dimensional coordinates for the predetermined positions have already been acquired, the three-dimensional coordinates may be acquired. In the above embodiment, the plate-shaped anti-aircraft signs 6 are installed on the road surface, but instead of using the plate-shaped anti-aircraft signs 6, a pattern similar to the anti-aircraft signs 6 may be formed on the road surface using any material such as paint. For example, a pattern similar to the anti-aircraft signs 6 may be formed by spraying a paint of a different color from the asphalt surface onto the asphalt surface of the road to form a pattern having the same shape as the white part of the anti-aircraft signs 6 in FIG. 3. When anti-aircraft markings are formed on the road surface using any material such as paint, the type, shape, size, pattern, etc. of the anti-aircraft markings are also arbitrary.

[0120] In the above embodiment, the road was photographed by an unmanned aerial vehicle (including a camera) flying at an altitude of 20 meters or less above the ground, but the road may be photographed by a model aerial vehicle (including a camera) flying at an altitude of 20 meters or less above the ground. In the present invention, an unmanned aerial vehicle is an airplane, rotorcraft, airship, etc. that cannot be ridden by a person and can fly by remote control or automatic pilot, such as a drone (multicopter), a radio-controlled aircraft, etc. Also, a model aerial vehicle is, for example, a multicopter, a radio-controlled aircraft, etc., and has a weight of less than 200 grams, which is the total weight of the aircraft body and the battery weight.

[0121] In the above embodiment, an anti-aircraft sign 6 installed on the ground at the time of shooting is used as a feature point for connecting multiple captured images, and the three-dimensional coordinates of the anti-aircraft sign 6 are each acquired by the total station 2, but a specific point in an image captured by the UAV 3 is used as a feature point for connecting multiple captured images, and if three-dimensional coordinated point cloud data for each point in the captured image including the specific point has already been acquired by scanning with the 3D scanner 4, the three-dimensional coordinates of the specific point may be acquired from the point cloud data.

[0122] In the above embodiment, examples of the method for creating an orthoimage and the method for inspecting a road have been described, but the order of steps S1 and S2 may be reversed in Fig. 5, Fig. 14, Fig. 18, and Fig. 23. Therefore, it is possible to capture an image after acquiring the three-dimensional coordinates of the anti-aircraft sign 6, and it is also possible to acquire the three-dimensional coordinates of the anti-aircraft sign 6 after acquiring the image.

[0123] In the above embodiment, examples of the method for creating an orthoimage and the method for inspecting a road have been described, but in Fig. 29 and Fig. 31, the order of steps S102 and S103 may be reversed. Therefore, it is possible to take a photographed image after acquiring the three-dimensional coordinates of the anti-aircraft sign 6, and it is also possible to acquire the three-dimensional coordinates of the anti-aircraft sign 6 after acquiring the photographed image. Also, in Fig. 29 and Fig. 31, the order of steps S101 and S103 may be reversed. Therefore, after acquiring point cloud data of an area including a plurality of anti-aircraft signs 6, a photographed image of an area including a plurality of anti-aircraft signs 6 is taken, but after acquiring a photographed image of an area including a plurality of anti-aircraft signs 6, point cloud data of an area including a plurality of anti-aircraft signs 6 may be acquired.

[0124] In the above embodiment, the investigations carried out using the orthoimages created by the orthoimage creation device 10 include an investigation into the condition of cracks on the road surface, an investigation into the position of planar elements around the road, an investigation to repair the area around a manhole, an investigation into the distance between two specified points on the road surface, and an investigation into the area of ​​a specified range on the road surface. However, the orthoimages created by the orthoimage creation device 10 may be used for other investigations. [Explanation of symbols]

[0125] 1 Orthoimage creation system 2. Total Station 3 UAV (unmanned aerial vehicle) 4. 3D Scanner (3D Scanning Device) 5 Display section 6 Anti-aircraft markings 10 Ortho-image creation device 11 Photographed image storage unit (photographed image storage means) 12 Orthoimage creation unit (orthoimage creation means) 13 Coordinate storage unit (coordinate storage means) 14 Display control section

Claims

1. A coordinate storage means for storing three-dimensional coordinates of a plurality of feature points; a captured image storage means for storing a plurality of captured images captured by an unmanned aerial vehicle or a model aerial vehicle flying at an altitude of 20 meters or less above the ground such that each of the plurality of feature points is included in at least two of the captured images; and an orthoimage creation means for creating an orthoimage based on the three-dimensional coordinates of each feature point stored in the coordinate storage means and the plurality of photographed images stored in the photographed image storage means.

2. the feature point is an anti-aircraft marker installed on the ground at the time of photographing by the unmanned aerial vehicle or the model aircraft; The orthoimage creation system according to claim 1, characterized in that the coordinate storage means stores three-dimensional coordinates of the anti-aircraft marker obtained by either a total station, a satellite-based positioning system, or a three-dimensional scanning device.

3. the feature points are predetermined points within an image captured by the unmanned aerial vehicle or the model aircraft, The orthoimage creation system according to claim 1, characterized in that the coordinate storage means stores three-dimensional coordinates of a specified point extracted from three-dimensional coordinated point cloud data obtained for each point in the captured image.

4. A coordinate acquisition step of acquiring three-dimensional coordinates of a plurality of feature points; a photographing step of photographing a plurality of images by an unmanned aerial vehicle or a model aerial vehicle flying at an altitude of 20 meters or less above the ground such that each of the plurality of feature points is included in at least two of the photographed images; An orthoimage creation method comprising: an orthoimage creation step of creating an orthoimage based on the three-dimensional coordinates of each feature point acquired in the coordinate acquisition step and the multiple captured images captured in the photographing step.

5. the feature point is an anti-aircraft marker installed on the ground at the time of photographing in the photographing step, The orthoimage creation method according to claim 4, characterized in that in the coordinate acquisition step, the three-dimensional coordinates of the anti-aircraft sign are acquired by any one of a total station, a satellite-based positioning system, and a three-dimensional scanning device.

6. the feature points are predetermined points within an image captured by the unmanned aerial vehicle or the model aircraft, The orthoimage creation method according to claim 4, characterized in that in the coordinate acquisition step, three-dimensional coordinates of a specified point are acquired from three-dimensional coordinated point cloud data acquired for each point in the captured image.

7. An anti-aircraft marker for use in the orthoimage creation system according to claim 2, An anti-aircraft marker characterized in that it is in the form of a sticker with an adhesive layer formed on the back surface.

8. An anti-aircraft marker used in the orthoimage creation method according to claim 5, An anti-aircraft marker characterized in that it is in the form of a sticker with an adhesive layer formed on the back surface.

9. A coordinate acquisition step of acquiring three-dimensional coordinates of a plurality of feature points; a photographing step of photographing a plurality of images by an unmanned aerial vehicle or a model aerial vehicle flying at an altitude of 20 meters or less above the ground such that each of the plurality of feature points is included in at least two of the photographed images; an orthoimage creation step of creating an orthoimage based on the three-dimensional coordinates of each feature point acquired in the coordinate acquisition step and the plurality of photographed images captured in the photographing step; A display step of displaying the orthoimage on a display unit; A derivation step of dividing a survey area in the orthoimage displayed on the display unit into a plurality of survey ranges and deriving a crack rate or a patching rate for each of the plurality of survey ranges; and a road condition display step of displaying the condition of the road by adding a color corresponding to the magnitude of the crack rate or patching rate of each survey area derived in the derivation step to the orthoimage displayed on the display unit.

10. A coordinate acquisition step of acquiring three-dimensional coordinates of a plurality of feature points; a photographing step of photographing a plurality of images by an unmanned aerial vehicle or a model aerial vehicle flying at an altitude of 20 meters or less above the ground such that each of the plurality of feature points is included in at least two of the photographed images; an orthoimage creation step of creating an orthoimage based on the three-dimensional coordinates of each feature point acquired in the coordinate acquisition step and the plurality of photographed images captured in the photographing step; A display step of displaying the orthoimage on a display unit; A road survey method comprising a planar element mapping step of tracing planar elements in the ortho-image displayed on the display unit to map the planar elements.

11. A coordinate acquisition step of acquiring three-dimensional coordinates of a plurality of feature points; a photographing step of photographing a plurality of images by an unmanned aerial vehicle or a model aerial vehicle flying at an altitude of 20 meters or less above the ground such that each of the plurality of feature points is included in at least two of the photographed images; an orthoimage creation step of creating an orthoimage based on the three-dimensional coordinates of each feature point acquired in the coordinate acquisition step and the plurality of photographed images captured in the photographing step; A point cloud data acquisition step of acquiring point cloud data of an area including a periphery of a manhole in the orthoimage; A display step of displaying the orthoimage on a display unit; A road survey method comprising an elevation difference derivation step of deriving the elevation difference between the elevation of the area surrounding the manhole in the ortho-image displayed on the display unit and the elevation of the area surrounding the manhole on the repair planning surface.

12. A coordinate acquisition step of acquiring three-dimensional coordinates of a plurality of feature points; a photographing step of photographing a plurality of images by an unmanned aerial vehicle or a model aerial vehicle flying at an altitude of 20 meters or less above the ground such that each of the plurality of feature points is included in at least two of the photographed images; an orthoimage creation step of creating an orthoimage based on the three-dimensional coordinates of each feature point acquired in the coordinate acquisition step and the plurality of photographed images captured in the photographing step; a point cloud data acquisition step of acquiring point cloud data of an area including the plurality of feature points; A display step of displaying the orthoimage on a display unit; A designation step of designating two designated points spaced apart from each other in the orthoimage displayed on the display unit; a distance display step of displaying the distance between the two designated points when the two designated points are designated in the designation step.

13. A coordinate acquisition step of acquiring three-dimensional coordinates of a plurality of feature points; a photographing step of photographing a plurality of images by an unmanned aerial vehicle or a model aerial vehicle flying at an altitude of 20 meters or less above the ground such that each of the plurality of feature points is included in at least two of the photographed images; an orthoimage creation step of creating an orthoimage based on the three-dimensional coordinates of each feature point acquired in the coordinate acquisition step and the plurality of photographed images captured in the photographing step; a point cloud data acquisition step of acquiring point cloud data of an area including the plurality of feature points; A display step of displaying the orthoimage on a display unit; A designation step of designating a designated range in the orthoimage displayed on the display unit, a step of displaying an area of ​​the designated range when the designated range is designated in the designation step, said step including:

Citation Information

Patent Citations

  • Generation device and generation method for road surface ortho-image

    JP2015090591A

  • Orthoscopic image creation device, orthoscopic image creation method and program

    JP2018072637A

  • Generating georeference information for aerial images

    US20170084037A1

  • Road surface evaluation system and evaluation method

    JP2018123510A