Method and apparatus for determining the azimuth of a target point

The method and apparatus use a calibrated imaging device and sensors to determine target point azimuth and location by analyzing image overlap, addressing the limitations of existing surveying technologies in measuring angles and locations, particularly on uneven surfaces, and enabling remote and cost-effective surveying.

DE112010000812B4Active Publication Date: 2024-11-28TRIMBLE INC
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
DE112010000812
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2009-01-08
Filing Date
2010-01-08
Publication Date
2024-11-28
Estimated Expiration
2030-01-08

AI Technical Summary

Technical Problem

Existing surveying technologies, such as theodolites and total stations, require expensive scales or angle encoders for measuring horizontal angles, and are limited in determining the location of target points both within and outside images, especially on uneven surfaces.

Method used

A method and apparatus using a calibrated imaging device, tilt sensor, and distance measuring device to determine the azimuth and location of target points by analyzing the relative orientation between overlapping images, eliminating the need for expensive scales or angle encoders, and accounting for surface unevenness through calibration and digitization.

Benefits of technology

Enables convenient and cost-effective measurement of angles and locations of target points, both within and outside images, on flat and uneven surfaces, without the need for expensive equipment, and allows for remote measurement of difficult or dangerous locations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A device for determining the azimuth of a target point, comprising: a supporting structure; an imaging device coupled with the support structure and configured to provide a first image of a surface at a first location with the imaging device oriented to a known reference position and to provide a second image of the surface at the first location with the imaging device oriented to the target point, wherein the first image and the second image have overlapping parts; a position measuring device, coupled to the support structure and configured to determine position information of the first location; a processor in electrical communication with the imaging device and the position measuring device, wherein the processor is configured to: Receiving the first and second images from the imaging device; Determining a rotation of the imaging device between the first and second images about a vertical axis using the overlapping portions of the first and second images; and Determining the azimuth of the target point relative to the orientation of the imaging device to the known reference position, using the rotation of the imaging device.
Need to check novelty before this filing date? Find Prior Art

Description

AREA OF INVENTION

[0001] The present invention generally relates to methods and systems for determining angles and locations of target points. By way of example only, embodiments of the present invention provide methods for determining angles and locations of target points using images. Such embodiments can be used, for example, in surveying applications. However, embodiments of the present invention are not limited to this particular application and can be used in a variety of measuring systems. BACKGROUND

[0002] Surveying involves determining unknown points using measurements of angles and distances. For example, some surveying operations measure horizontal and vertical angles and distances between a reference point and a target point. Other surveying operations measure horizontal and vertical angles between a reference point and a target point at more than one location. In both cases, the measured data can be used to calculate the location of the target point.

[0003] A theodolite is a surveying instrument commonly used to measure horizontal and vertical angles. A theodolite typically contains a telescope mounted to rotate around horizontal and vertical axes. A theodolite may include circular scales or displays used to measure the telescope's angular position. The horizontal angle (i.e., yaw angle) and the vertical angle (i.e., pitch angle) are read from the circular display to determine the target's yaw angle relative to a reference position and the target's pitch angle relative to the local gravitational vector. Some modern electronic theodolites use angle encoders or transducers instead of displays to automate angle measurements.

[0004] Theodolites often incorporate electronic distance measurement (EDM) units for measuring the distance from the theodolite to the target. Such integrated systems are commonly referred to as total stations. Total stations generally include a computer or control unit for controlling the measurements and storing measurement data.

[0005] US 2007 / 0008515 A1 describes a device and a method for acquiring geographic data. A distance to a target object is calculated by relating the distance to the target object and the tilt of a distance measuring unit. With regard to Fig. Section 7 of the publication (1) describes how the position of a measuring point P can be determined more accurately based on two images of the measuring point P taken from different directions.

[0006] US 2007 / 01 39262 A1 describes a device for accurately determining the position of target points in locations where precise GPS data is unavailable. The position of the target points is determined using an accelerometer and a distance measuring device.

[0007] WO 2007 / 031248A2 describes a surveying instrument in which a surface onto which image data is projected is determined by a measurement.

[0008] Despite the use of theodolites and total stations, improved methods and systems for determining angles and locations of points are desirable. SUMMARY

[0009] The present invention discloses, in its independent claims, improved methods and devices for determining the azimuth of a target point. Advantageous embodiments are disclosed in the dependent claims. By way of examples only, embodiments of the invention provide methods for determining angles and locations of target points using images. These embodiments can be used, for example, in surveying applications. However, embodiments of the present invention are not limited to these specific applications and can be used in a variety of measuring systems.

[0010] According to an example, a device for determining the azimuth or azimuth angle of a target point includes a support structure and an imaging device coupled to the support structure and configured to provide image data. The device also includes a position sensor coupled to the support structure and configured to determine position information, and a processor in electrical communication with the imaging device and the position sensor. The processor is configured to receive image data from the imaging device, receive position information from the position sensor, determine a baseline between a first position and a second position, determine an orientation between overlapping images, and calculate the azimuth of the target point relative to the baseline.

[0011] According to another example, a method for determining the azimuth of a target point includes positioning an imaging device at a first location, orienting the imaging device with respect to a reference position, obtaining a first image of a surface from the first location, and determining the position of the first location. The method also includes orienting the imaging device with respect to the target point, obtaining a second image of the surface from the first location where part of the first image overlaps or superimposes part of the second image, determining the orientation of the first image relative to the second image, and determining the azimuth of the target point relative to the reference position.

[0012] According to another example, a procedure includes determining the coordinates of a target point in a local coordinate frame, calculating a baseline as a function of a first and a second location, obtaining an image of a surface from the second location using an imaging device, and orienting the first image relative to the baseline. The procedure also includes aligning the imaging device with respect to the target point, obtaining a second image of the surface from the second location with the imaging device, aligned to the target point, and determining the orientation of the second image relative to the first image. The procedure also includes calculating the azimuth of the target point, determining a distance from the second location to the target point, and calculating the coordinates of the target point in the local coordinate frame or local coordinate system.

[0013] According to another example, a method for determining the coordinates of a target point on a substantially flat surface within a local coordinate frame includes obtaining a first image of the surface from a first location using a calibrated imaging device and determining the position of the first location within the local coordinate frame. The method also includes obtaining a second image of the substantially flat surface from a second location using the calibrated imaging device, the second image containing the target point. The first location is distinct from the second location, and part of the first image overlaps part of the second image. The method further includes determining the position of the second location within the local coordinate frame, calculating the azimuth of the second image, and calculating the coordinates of the target point within the local coordinate frame.

[0014] Numerous advantages can be realized using embodiments of the present invention compared to conventional techniques. For example, one embodiment of the present invention provides an inexpensive device for measuring angles and the locations of target points. In one particular embodiment, a relatively small and inexpensive device is provided that does not require expensive scales or displays or angle encoders for measuring horizontal angles. Instead, horizontal angles can be measured using the relative orientation between overlapping images. Furthermore, the location or coordinates of target points can be determined both inside and outside the images. As explained in more detail below, the location of target points within the images, which are on a substantially flat surface to be imaged, can be determined using a calibrated imaging device.The location of target points outside the images can be determined using horizontal angles with the distance and the vertical angle of the distance measuring device.

[0015] Depending on the embodiment, one or more of these advantages may exist. These and other advantages are described throughout the specification and in particular below. BRIEF DESCRIPTION OF THE DRAWINGS Fig. Figure 1 shows a simplified diagram of a device for determining angles and / or locations of target points according to an embodiment of the present invention; Fig. Figures 2A-2C show simplified diagrams of a device for determining angles and / or locations of target points according to other embodiments of the present invention; Fig. Figures 3A-3C show simplified diagrams illustrating measurement methods according to an embodiment of the present invention; Fig. Figure 4 shows a simplified diagram illustrating the measurement error caused by an uneven surface when determining the locations of points within the images; Fig. Figures 5A-5C show simplified diagrams illustrating measurement methods according to another embodiment of the present invention; Fig. Figure 6 shows a simplified flowchart illustrating a method for determining the location of a target point according to an embodiment of the present invention; Fig. Figure 7 shows a simplified flowchart illustrating a method for determining the location of a target point according to another embodiment of the present invention; Fig. Figure 8 shows a simplified side view illustrating measurement methods according to an embodiment of the present invention; Fig. 9 shows a simplified side view illustrating measurement methods according to another embodiment of the present invention; Fig. Figure 10 shows a simplified plane view illustrating measurement methods according to an embodiment of the present invention; Fig. Figure 11 shows a simplified top view of a device for determining angles and / or locations of target points according to another embodiment of the present invention; and Fig. Figure 12 shows a simplified side view illustrating a measuring method according to another embodiment of the invention. DETAILED DESCRIPTION

[0016] Embodiments of the present invention provide methods and systems for determining angles and / or locations of target points. In one particular embodiment, the relative orientation between overlapping images can be used to determine the horizontal angle, or azimuth, of a target point with respect to a reference location. In some embodiments, the images can also be used to determine the locations, or coordinates, of target points situated on substantially flat surfaces within the images. As with conventional theodolites, constraints or boundary conditions can be applied that allow the locations to be referenced to a real-world coordinate system (for example, a local coordinate frame).In other embodiments, the distance between a measuring position and a target point and the vertical angle of the distance measuring device can be used to determine the locations of points outside the images. These and other embodiments of the present invention are described in more detail below.

[0017] Fig. Figure 1 shows a simplified diagram of a device for determining angles and / or locations of target points according to an embodiment of the present invention. As in Fig. As shown in Figure 1, a measuring device 100 includes an imaging device 102. The imaging device 102 can be a digital camera or other suitable device capable of capturing images using an image sensor. The image sensor typically contains a predetermined number of photosensitive elements arranged in an array. For example, the image sensor can be a two-dimensional array of elements capable of generating image information from optical signals incident on the elements. The number of pixels in the image generally corresponds to the number of elements in the array. The array can be a CCD (charge-coupled device) or a CMOS (complementary metal-oxide-semiconductor) image sensor array. Other suitable arrays containing photosensitive elements are also included within the scope of the present invention.

[0018] A two-megapixel array with 1600 × 1200 sensor elements can be used in one embodiment of the invention by way of example. In some embodiments, the imaging device 102 uses a wide-angle lens to increase the field of view (FOV) 112 of the imaging device 102 and the images obtained using the imaging device 102. For example, a particular embodiment can use a catadioptric rectilinear wide-angle lens with a diagonal field of view of 151.8°. Such a lens is available from Nanophotonics Co., Ltd. of South Korea. Those skilled in the art will recognize that there are a variety of wide-angle lenses suitable for use with the imaging device 102 of the present invention.

[0019] Some embodiments of the present invention use a calibrated imaging device. The calibration may include internal and external calibration. The purpose of internal calibration is to determine the angular relationship between each element of the image sensor and the angle of the optical signal entering and striking the elements of the imaging device. Internal calibration can also correct optical distortion. Essentially, the calibration provides a mapping between each of the image sensor elements and the angle of the rays entering and striking the element of the imaging device. The calibration process can be performed according to known techniques. Once the angular relationships have been determined, they can be related to the pixels, or elements, of the images produced by the image sensor.

[0020] The purpose of external calibration is to determine the relationship between the imaging device and the support structure within a support-structure coordinate frame. External calibration can include an offset vector and three rotation angles of the imaging device within the support-structure coordinate frame. Coordinates within the support-structure coordinate frame can be transformed to coordinates within the local coordinate frame using known techniques.

[0021] External calibration can also include the relationship between the tilt sensor and the electronic distance measurement (EDM) unit within the support structure coordinate frame. The tilt sensor and EDM are discussed in more detail below.

[0022] As in Fig. As shown in Figure 1, the imaging device 102 is coupled to a support structure 104. The support structure 104 can be a surveyor's rod, a tripod, or a similar structure suitable for supporting the imaging device 102. In one embodiment of the present invention, the imaging device 102 is coupled to the support structure 104 at a known height 106 above the surface being imaged.

[0023] Some embodiments of the present invention also include an inclination sensor 110 coupled to the support structure 104. The inclination sensor 110 can be a spirit level or bubble level, an electronic inclination sensor, or another suitable device capable of determining the vertical orientation of the support structure 104 and the imaging device 102 relative to the local gravitational vector. The inclination sensor 110 can include a dual-axis tilt sensor and a compass for determining the magnitude and direction of the inclination relative to the local gravitational vector and magnetic north. The magnitude and direction can be used to determine the location of the imaging device 102 and the location of the apex of the support structure 104.

[0024] Some embodiments of the present invention also include a rangefinder 108 coupled to the support structure 104. The rangefinder 108 can be an EDM unit and can include a laser pointer for illuminating the target points. Some embodiments use a visible laser for this application. Other embodiments use an invisible laser with a telephoto camera and a display for aligning the EDM with the target point. Other embodiments use an optical / mechanical aiming device or a graphic display of a crosshair or other symbols for identifying the target points. In some embodiments, the rangefinder 108 includes a vertical angle sensor or other suitable device capable of determining the vertical angle of the rangefinder 108 relative to the support structure 104. The rangefinder, orThe distance measuring device 108 can be used to determine the distance to target points.

[0025] The position of the measuring device in the local coordinate frame can be determined using a reflective target (not shown), coupled with the support structure 104, and a total station (not shown) according to known techniques.

[0026] The components coupled to the support structure 104, such as the imaging device 102, the tilt sensor 110, and the distance measuring device 108, can communicate with a computing device 114. The computing device 114 can communicate directly with each individual component to send and / or receive data, or the communication can take place via an intermediary communication device 116, as shown in Fig. Figure 1 shows that communication can take place via wired or wireless connections. The computing device 114 can be a handheld device, as shown in Figure 1. Fig. 1 shown, or any other calculating device or computational device suitable for sending and / or receiving data and performing calculations to determine the angles and / or locations of target points. The calculating device 114 typically includes a memory for storing data and a processor for performing calculations.

[0027] In Fig. 1 is the field of view (FOV) 112 of the imaging device 102, which is generally directed downwards and includes the area surrounding the base of the support structure 104. However, such an orientation of the imaging device 102 is not required by embodiments of the present invention, and other embodiments incorporate different orientations and therefore different fields of view.

[0028] Fig. Figure 2A is a simplified diagram of a device for determining angles and / or locations of target points according to another embodiment of the present invention. The measuring device 200 is shown in Fig. 2A, uses common components with the measuring device 100, shown in Fig. 1, and the description above in connection with Fig. 1. Once prepared, it can be applied to Fig. 2A. For example, a measuring device 200 may include an imaging device 202, a support structure 204, an inclination sensor 210, and a distance measuring device 208, each of which is similar to the corresponding ones described above in relation to Fig. 1 described components.

[0029] As in Fig. As shown in Figure 2A, some embodiments of the present invention also include a position measuring device 220 coupled to the support structure 204. The position measuring device 220 may include a global navigation satellite system (GNSS), such as a global positioning system (GPS), or another suitable device capable of determining the position of the position measuring device 220 within the local coordinate frame. Additionally, in some embodiments, the measuring device 200, shown in Figure 2A, may also include a position measuring device 220 coupled to the support structure 204. Fig. 2A, communicate with a computing device, such as computing device 114, which is located in Fig. Figure 1 is shown. The person skilled in the art would recognize many variations, modifications and alternatives that are suitable for determining the position of the measuring device 200.

[0030] In some embodiments, the tilt sensor 210 may include a compass or a device capable of determining the magnitude and direction of the tilt relative to the local gravitational vector and magnetic north pole when the support structure is not planar. The tilt angle 210 can be used with the position measuring device 220 to determine the location of the imaging device 202 within the local coordinate frame.

[0031] In Fig. 2A The field of view (FOV) 218 ​​of the imaging device 202 is generally directed forward and downward. Here, forward is defined as away from the support structure 204. However, as explained above, such an orientation of the imaging device 202 is not necessary for embodiments of the present invention. Other embodiments may have different orientations and therefore different fields of view.

[0032] Fig. Figure 2B shows a simplified diagram of a device for determining angles and / or locations of target points according to another embodiment of the present invention. The measuring device 240 is shown in Fig. 2B is similar to the measuring device 200, which is in Fig. 2A is shown. Fig. However, in 2B, the position measuring device 220 is positioned above the imaging device 202. The imaging device 202 and the position measuring device 220 can be arranged such that the optical center of the imaging device 202 and the antenna phase center of the position measuring device 220 are aligned along a vertical axis. Therefore, if the support structure is leveled or aligned with the local gravitational vector, the optical center of the imaging device 202 is offset from the antenna phase center of the position measuring device 220 by a fixed vertical distance.

[0033] Fig. Figure 2C is a simplified diagram of a device for determining angles and / or locations of target points according to another embodiment of the present invention. The measuring device 250, which is described in Figure 2C, is shown in Figure 2C. Fig. The device shown in 2C is similar to the measuring device 200, which is shown in Fig. 2A is shown, and the measuring device 240, which is in Fig. Figure 2B shows the measuring device 250. However, the measuring device 250 includes a position measuring device 252 coupled with an imaging device 254. Alternatively, the position measuring device 252 can be integrated into the imaging device 254. In each of these embodiments, both the position measuring device 252 and the imaging device 254 can be aligned with a vertical axis of the support structure 204. The imaging device 254 and the position measuring device 252 can be arranged such that, when the support structure 204 is leveled, the optical center of the imaging device 252 and the antenna phase center of the position measuring device 254 are aligned with the local gravitational vector and are offset by a fixed vertical distance.

[0034] Fig. Figure 2C also represents an embodiment where the field of view (FOV) 256 of the imaging device 254 is directed downwards and away from the support structure 204. By directing the FOV 256 away from the support structure 204, the distance measuring device 208 and the tilt sensor 210 do not interfere with the surface being imaged. The FOV 256 is not limited to this specific orientation, however, and other embodiments may include different orientations and therefore different FOVs.

[0035] Fig. Figures 3A-3C are simplified diagrams illustrating measurement methods according to one embodiment of the present invention. These measurement methods can be used to determine angles and / or locations of target points.

[0036] Fig. Figure 3A shows a simplified plane view displaying three images, or the FOV of three images, obtained using a measuring device, such as measuring device 100, 200, 240, or 250, described above. In the Fig. In the embodiment shown in Figure 3A, the measuring device is positioned at a first location 330, and a first image with a field of view (FOV) of 334 is obtained. The position of the first location 330 within the local coordinate frame is determined. For example, the position can be determined using a GNSS or total station, as described above. The local coordinate frame can be referenced to a real-world coordinate system, or it can be referenced to a specific object or known point. The tilt sensor can be used, according to known techniques, to determine the position of the imaging device, or the position of the optical center of the imaging device, within the local coordinate frame. The first location 330 can be the contact point between the measuring device and the surface, or the first location 330 can be a point on the surface that is aligned with or below the imaging device.In some embodiments, the position is determined and the image is captured simultaneously.

[0037] The measuring device is positioned at a second location 332, and a second image with a field of view (FOV) of 336 is obtained. The position of the second location 332 within the local coordinate frame is determined as explained above. A baseline 346 is established from the first location 330 to the second location 332. Using common features in the overlapping portion 340 of the first and second images, the images can be oriented relative to the baseline 346 using known feature extraction techniques. For example, well-known computer vision algorithms such as SIFT (Scale-Invariant Feature Transform) or SURF (Speeded Up Robust Features) can be used.As an alternative to using common features in the overlapping part 340 of the images, the images can be oriented to the baseline 346 by orienting the measuring device with a known point when acquiring the first and second images. Alternatively, the second image can be oriented relative to the baseline 346 by orienting the measuring device to the first measurement position 330 when the second image is acquired. Each of these methods provides a zero of the azimuth for angle measurements from the second position 332.

[0038] From the second location 332, the measuring device is rotated and aligned or oriented to the target point 342, and a third image with a field of view (FOV) of 338 is obtained. The measuring device can be aligned using a laser pointer, an optical / mechanical sighting device, a graphic display using a crosshair, or other suitable means. The distance 344 from the second location 332 to the target point 342 is determined. The distance 344 can be determined using a distance measuring device, as previously explained. A tilt sensor and a vertical angle sensor can be used to determine the angle of the distance measuring device relative to the support structure.

[0039] The angle or azimuth of the target point 343 relative to the baseline 346 can be determined using the overlapping portions of images 336 and 338 and known computer vision techniques. For example, the relative orientation of the second and third images can be determined and used with the orientation of the second image relative to the baseline 346 to determine the azimuth.

[0040] The location or coordinates of target point 342 within the local coordinate frame can be determined using known techniques. For example, using the first and second locations 330 and 332, images 334, 336, and 338, and features in the overlapping portion 340 of the first and second images, the azimuth of the EDM beam extending from the second location 332 to target point 342 can be calculated. Using known surveying techniques, the second location 332, the calculated azimuth and vertical angles, the magnitude and direction of the slope, and the distance can be used to calculate the location of target point 342 within the local coordinate frame.

[0041] The location or coordinates of the second target point 360 in the local coordinate frame can also be determined. For example, using the first and second locations 330, 332, the first and second images 334, 336, and at least two features in the overlapping part 340 of the first and second images, the azimuth of the first and second images 334, 336 in the local coordinate frame can be calculated. The location of a target point 360 in the image can be calculated assuming that the target point 342 is on a geometric primitive, such as a plane, and the relationship of the plane to the location 332 is known. The relationship can be expressed as the height of the location 332 above the plane and the inclination and orientation vectors of the plane. For example, if the plane is leveled with respect to gravity, the height can be the distance from the top of the support structure to the origin of the support structure's coordinate frame.The location of target point 360 can be calculated by projecting image 336 onto the plane using the calibration data of the imaging device.

[0042] Fig. Figure 3B shows a simplified perspective view of the measuring device at the second location 332, as shown in Fig. 3A, shows. Fig. 3A and Fig. 3B contains several common features, such as the second location 332, FOV 338, distance 344, and target point 342. As in Fig. As shown in Figure 3B, the measuring device is aligned to target point 342, and FOV 338 corresponds to the area included in the third image, which is referenced above. Fig. 3A is described. Also in Fig. Figure 3B shows the support structure 348 with imaging device 354, position measuring device 358, tilt sensor 356 and distance measuring device 350. As shown in Fig. As shown in Figure 3B, the second location 332 is determined relative to the imaging device 354 in this embodiment. Fig. 3B also represents the vertical angle 362 of the rangefinder 350. The location or coordinates of the target point 342 in the local coordinate frame can be determined as previously explained. Using these methods, the locations of points situated anywhere (both within and away from the images) can be determined using the EDM.

[0043] Fig. Figure 3C shows a simplified perspective view, which also includes the measuring device at the second location 332, shown in Fig. 3A, shows. Fig. Figure 3C shows the second target point 360 within the field of view (FOV) 338 of the imaging device 354. By projecting the FOV 338 onto a substantially flat surface 352, the location of the second target point 360 on the surface can be determined as previously explained. A substantially flat surface 352 can be any flat surface or any surface suitable for the calculations described herein. For example, the substantially flat surface 352 can be a road or a parking lot. Some embodiments of the present invention allow angles and / or locations of points to be measured without having to physically visit a location. This is particularly advantageous when the points are difficult or dangerous to reach (for example, a road or construction site).

[0044] Table 1 below provides an example of how the height of the imaging device above the substantially flat surface and the calibration of the imaging device can be used to determine the positions of points within the images. An image can be determined using the size of the image sensor array in sensor elements or pixels, the field of view (FOV) of the imaging device, and the height of the imaging device above the surface being imaged. The height of the imaging device above the surface can be determined by known techniques, either by aligning the measuring device with the local gravitational vector or by using the tilt sensor to determine the magnitude and direction of the tilt. In this example, the imaging device has a two-megapixel array of sensor elements (1600 × 1200) positioned two meters above the surface being imaged.The two-dimensional array is arbitrarily related to x- and y-coordinates, where the x-direction corresponds to the array's length (1600 sensor elements long) and the y-direction corresponds to the array's width (1200 sensor elements wide). The field of view (FOV) of the imaging device along the x-direction is 145° and the FOV along the y-direction is 135°. Table 1 FOV-Abstand (x-Richtung 12,7 Meter FOV-Abstand (y-Richtung) 9,7 Meter Abbildung (x-Richtung) 0,008 Meter / Bildpixel Abbildung (y-Richtung) 0,008 Meter / Bildpixel

[0045] As shown in Table 1, each image pixel corresponds to an area of ​​the surface approximately 0.008 meters long and 0.008 meters wide. The location and coordinates of points on the surface can be determined using these values, as explained previously. For example, in Fig. 3C The coordinates of the second target point 360 are determined using a mapping, as shown in Table 1 above and explained previously. In other embodiments, a number of overlapping images, such as the first, second, and third images, shown in Fig. 3A, formed by a mosaic or stitched or sewn together using known computer vision techniques to enable the location of the points on the surface to be determined within any of the images.

[0046] Fig. Figure 4 shows a simplified diagram illustrating the measurement error introduced by an uneven surface when determining the locations of points within the image. As explained above, this takes into account the Fig. The example shown in 3C indicates that surface 352 is essentially flat. As in Fig. As shown in Figure 4, an uneven surface can introduce measurement errors when determining the locations of the points within the image. Fig. Figure 4 shows a measuring device 400, positioned on a surface 408. The measuring device 400 has an imaging device with a field of view (FOV) 404. An optical center of the imaging device is positioned at a height 402 above the surface 408, and a target point 414 is located at a distance 410 from the measuring device 400. Due to the uneven surface 408, the target point 414 is below an ideal or flat surface 406, with the image projected an amount 416. From the perspective of the imaging device, the target point 440 appears to be located at a point 412 on the ideal or flat surface 406. As shown in Figure 4, the optical center of the imaging device is positioned at a height 402 above the surface 408, and a target point 414 is located at a distance 410 from the measuring device 400. Fig. As shown in Figure 4, a measurement error 418 is introduced by the uneven surface 408. The magnitude of the measurement error 418 can be determined using known techniques.

[0047] In one embodiment, the measurement error is reduced by dividing or digitizing the surface into a number of sections. For example, a curved surface can be approximated (digitized) by triangular flat surfaces. At each corner or edge, a position measuring device location and an image can be stored. The image can be projected as a skin onto the triangles. Positions within each triangle can be determined as described above.

[0048] Fig. Figures 5A-5C show simplified diagrams illustrating measurement methods according to another embodiment of the present invention. Fig. Figure 5A shows a simplified plane view displaying three images, or the FOV of the three images, obtained using a measuring device as described above. In the embodiment shown in Fig. 5A, the measuring device is positioned at a first location 530, and a first image with FOV 534 is obtained. The position of the first location 530 in the local coordinate system is determined. For example, the position of the first location 530 in the local coordinate system can be determined using a GNSS or total station, as described above. The local coordinate system can refer to a real-world coordinate frame, or it can be a reference to a specific known position or object. The tilt sensor can be used, according to known techniques, to determine the position of the imaging device, or the position of the optical center of the imaging device, in the local coordinate frame. The first location 530 can be the contact point between the measuring device and the surface, or the first location 530 can be a point on the surface that is aligned with or below the imaging device. Fig. 5A is the FOV of the images generally directed forward and downward, and does not include the first location 530.

[0049] The measuring device is positioned at a second location 532, and a second image with a field of view (FOV) of 536 is obtained. The position of the second location 532 in the local coordinate system is determined as explained above. A baseline 546 is established from the first location 530 to the second location 532. The images can be oriented relative to the baseline 546, as explained above. From the second location 532, the measuring device is rotated and aligned, or oriented, to the target point 542, and a third image with a field of view (FOV) of 538 is obtained. The distance 544 from the second location 532 to the target point 542 is determined using a rangefinder, as previously explained. An inclination sensor and a vertical angle sensor can be used to determine the angle of the rangefinder relative to the local gravitational vector.The angle or azimuth of target point 542, as well as the location or coordinates of target point 542 within the local coordinate system, can be determined as previously explained. The location or coordinates of the second target point 560 can also be determined as explained above.

[0050] Fig. Figure 5B shows a simplified perspective view of the measuring device at the second location 532, as shown in Fig. 5A, shows. Fig. 5A and Fig. 5B contains several common features, such as a second location 532, FOV 538, distance 544, and target point 542. As in Fig. As shown in Figure 5B, the measuring device is aligned to target point 542, and FOV 538 corresponds to the area described in the third image above with reference to Fig. 5A, is included. Also in Fig. As shown in Figure 5B, the support structure 548 includes the imaging device 554, the position measuring device 558, the tilt sensor 556, and the distance measuring device 550. As shown in Figure 5B. Fig. As shown in Figure 5B, the second location 532 is aligned with the support structure 548 in this embodiment. Fig. 5B also represents the vertical angle 562 of the rangefinder 550. The location or coordinates of the target point 542 in the local coordinate frame can be determined as previously explained. Using these methods, the locations of points situated anywhere (both within and away from the images) can be determined using the EDM.

[0051] By projecting the FOV onto an essentially flat surface 552, the location of the second target point 560 can be determined as described above. Fig. Figure 5C shows a simplified plane view representing a mapping of the pixels obtained using a field of view similar to FOV 538, shown in Fig. 5A-5B. The mapping can be determined using the size of the image sensor array in sensor elements or pixels, the field of view (FOV) of the mapping device, and the height and orientation of the mapping device above the surface being mapped. The height of the mapping device above the surface can be determined using known techniques by aligning the measuring device with the local gravitational vector or by using the tilt sensor to determine the magnitude and direction of the tilt. In this example, a camera with a two-megapixel array of sensor elements (1600 x 1200) is positioned two meters above the surface being mapped. For this example, the two-dimensional array is arbitrarily related to x- and γ-coordinates, where the x-direction is related to the length of the array (1600 sensor elements long) and the γ-direction is related to the width of the array (1200 sensor elements wide).In this example, the camera is oriented 38° downwards from the horizontal. Using the values ​​above, the width 560 is determined to be nine meters, the length 542 is determined to be eight meters, and the width 566 is determined to be 2.8 meters. The mapping along the width 560 is determined to be approximately 0.0076 meters / pixel, and the mapping along the width 566 is determined to be approximately 0.002 meters / pixel. A professional would recognize many variations, modifications, and alternatives to the examples above.

[0052] Fig. Figure 6 shows a simplified flowchart illustrating a method for determining the azimuth of a target point according to an embodiment of the present invention. The method includes positioning an imaging device at a first location (602). The imaging device is oriented to a reference position (604). The reference position may include a baseline extending from the first location to a second location. The first image may be oriented to the reference position using overlapping portions of the first image obtained from the first location and an image obtained from the second location. Alternatively, the first image may be oriented to the reference position by orienting the measuring device to a known point when the first image is acquired. The known point has coordinates in the local coordinate system that are known or can be determined. For example, the known point may be the second location.

[0053] A first image of a surface is obtained at the first location (606). The first image may contain the area of ​​the surface surrounding the first location, or it may contain an area of ​​the surface that is outside or away from the first location. To determine the azimuth, images of any surface may be used, provided that a rotation between the images can be determined using overlapping portions of the images. Similarly, to determine the locations of points using a distance and vertical orientation of the measuring instrument, images of a surface may be used, provided that a rotation between the images can be determined using overlapping portions of the images. If coordinates of points on the surface are to be determined, the surface may be substantially flat, or it may be digitized, as previously explained, to reduce measurement errors.A position of the first location is determined (608). In some embodiments, the position is determined, for example, using a GNSS or total station, as described above. The position can be determined in the local coordinate frame or another coordinate system defined relative to a specific location or object.

[0054] The imaging device is oriented or aligned to the target point (610). The imaging device can be oriented or aligned to the target point using a laser pointer, an optical / mechanical aiming device, a graphic display with a crosshair, or any other suitable means. A second image of the surface is obtained at the first location (612). A portion of the second image overlaps a portion of the first image. An orientation of the first image relative to the second image is determined (614). The orientation is the rotation of the imaging device about a vertical axis between the first image and the second image. The vertical axis is an axis aligned with the local gravitational vector. In one embodiment, the orientation is determined using the overlapping portions of the images and known computer vision techniques. The azimuth of the target point relative to the reference position is determined (616).The azimuth can be determined using the orientation between the first and second images and the orientation of the first image with respect to the reference position.

[0055] Fig. Figure 7 shows a simplified flowchart illustrating a method for determining the location of a target point according to another embodiment of the present invention. The method includes calculating a baseline (702). The baseline can be calculated as a function of a first location and a second location. In some embodiments, the positions of the first and second locations are determined using a GNSS or a total station, as discussed above. In other embodiments, the baseline can be determined relative to true north in the local coordinate frame using a compass or other suitable instrument. A first image of a surface is obtained from the second location (704). The first image can be oriented to the baseline. An imaging device is aligned with the target point (706). A second image of the surface is obtained with the imaging device aligned with the target point (708).The orientation of the first image relative to the second image is determined (710). The orientation can be determined using overlapping parts of the images. The azimuth of the target point is calculated (712). The azimuth can be based on the orientation of the first image relative to the second image and the orientation of the first image relative to the baseline. A distance from the second location to the target point is determined (714). The distance can be determined using an EDM, as previously explained. The coordinates of the target point in the local coordinate frame are calculated (716). The coordinates can be calculated using the procedures described above.

[0056] It should be recognized that the specific steps involved in Fig. Figures 6-7 illustrate specific methods for determining the azimuth of a target point according to one embodiment of the present invention. Other sequences of steps can also be performed according to alternative embodiments. For example, alternative embodiments of the present invention can perform the steps given above in a different order. Furthermore, the individual steps shown in Fig. Figures 6-7 contain several sub-steps that can be executed in different sequences, as appropriate for the individual step. Furthermore, additional steps can be added or removed, depending on the specific application. A person skilled in the art would recognize many variations, modifications, and alternatives.

[0057] Fig. Figure 8 shows a simplified diagram illustrating a measurement method according to an embodiment of the present invention. Fig. Figure 8 shows a first measuring device comprising an imaging device 802 and a support structure 804 at a first location 822, and a second measuring device comprising an imaging device 812 and a support structure 810 at a second location 820. A single measuring device can be used to obtain images of both the first location 822 and the second location 820. Parts 808 of the images overlap. FOV 806 is projected in its entirety onto a first surface 814, and FOV 824 is projected onto both the first surface 814 and a second surface 816. The elevations of the first surface 814 and the second surface 816 differ by a height 818.

[0058] According to one embodiment of the present invention, the positions of the target points on both the first surface 814 and the second surface 816 can be determined. To determine the positions of target points within the images, a first image is determined using the image pixels that contain the first surface 814. The image can be determined in a manner similar to that described with reference to Fig. 3A, 3C, and 5A-5C were described above. A second image is determined using the image pixels containing the second surface 816, taking into account the difference in height and parallelism between the second surface 816 and the first surface 814. Using these images, the positions of the target points within the images on both the first surface 814 and the second surface 816 can be determined.

[0059] Fig. Figure 9 shows a simplified diagram illustrating a measurement method according to an embodiment of the present invention. Fig. Figure 9 shows a first measuring device, comprising an imaging device 902 and a support structure 904 at a first location 922, and a second measuring device, comprising an imaging device 912 and a support structure 910 at a second location 920. A single measuring device can be used to obtain images of both the first location 922 and the second location 920. Parts 908 of the images overlap. The field of view (FOV) at both locations is projected onto a tilted surface 926.

[0060] According to one embodiment of the present invention, the positions of the target points on the surface 926 can be determined. To determine the positions of the target points within the images, the inclination of the surface 926 is determined using the positions of the first location 922 and the second location 920. If the inclination is not constant across the surface 926, approximately flat portions of the surface 926 can be segmented or digitized, and the positions of the three locations can be determined for each segment. Several images or mappings can be determined depending on the height of the imaging device above each specific segment of the surface 926. To determine the three-dimensional inclination of the surface 926, the position of a third location can be determined. Using the inclination of the surface 926, an image can be determined using known techniques.The positions of the target points within the images can be determined using the illustrations, as previously described.

[0061] Fig. Figure 10 shows a simple plane view illustrating measurement methods according to an embodiment of the present invention. Fig. Figure 10 shows five images, or the FOV of five images, obtained using a measuring device as described above. In the embodiment shown in Fig. Step 10: The measuring device is positioned at a first location 1002, and a first image with a field of view (FOV) of 1008 is obtained. The position of the first location 2002 can be determined using the procedures described above. The measuring device is then positioned at a second location 1004, and a second image with a field of view (FOV) of 1010 is obtained. In the example shown, the position of the second location 1004 is not determined. For example, the second location 1004 may not be able to receive GPS signals due to objects located above it, or the second location 1004 may be outside the line of sight of a total station.

[0062] The measuring device is positioned at a third location 1012, and a third image with a field of view (FOV) of 1014 is obtained. Similar to the second location 1004, the position of the third location 1012 is not determined. The measuring device is positioned at a fourth location 1016, and a fourth image with a FOV of 1014 is obtained. The position of the fourth location 1016 can be determined, and a baseline 1006 can be determined using the positions of the first location 1002 and the fourth location 1016.

[0063] In the Fig. In the embodiment shown in Figure 10, the positions of target points 1028 and 1024 can be determined in the local coordinate frame. The position of target point 1028 is within the second image and lies on the substantially flat surface being imaged. The position of target point 1028 can be determined using an image of the image pixels, as previously described. The overlapping positions of the images can be used to stitch or mosaic the images, so that the position can be determined in the local coordinate system using the known positions of the first location 1002 and / or the fourth location 1016 and the images of each image. In another embodiment, the position of target point 1028 can be determined using distance measurements from the fourth location 1016 and the orientation of the fourth image relative to the baseline 1006.No assumptions regarding the surface are needed if EDM is used.

[0064] The position of the distant target point 1024 can be determined by aligning the measuring device with the target point 1024 and obtaining a fifth image (represented as FOV 1020 in Fig. 10) The distance between the fourth location 1016 and the distant target point 1024 can be determined, for example, using a distance measuring device. The coordinates of the distant target point 1024 in the local coordinate frame can be determined using the relative orientations of the fourth and fifth images, the distance between the fourth location 1016 and the target point 1024, and the orientation of the fourth image relative to the baseline 1006. The person skilled in the art would consider many variations, modifications, and alternatives to the one described in Fig. The 10 illustrated measurement methods can be identified. For example, the baseline can be determined between any two images and is not limited to the first and last images, as shown in this example. Furthermore, the distance between images can be reduced to limit the perspective difference between adjacent images.

[0065] Fig. Figure 11 shows a simplified plane view of a device for determining angles and / or locations of target points according to another embodiment of the present invention. Fig. Figure 11 shows a measuring device 1102 with a plurality of imaging devices, such that a plurality of overlapping images are obtained. In this example, the overlapping images form a 360° horizontal panoramic image. The measuring device 1102 has six imaging devices. More or fewer imaging devices can be used according to embodiments of the invention. A first imaging device has a field of view (FOV) of 1104, a second imaging device has a field of view (FOV) of 1106, a third imaging device has a field of view (FOV) of 1108, a fourth imaging device has a field of view (FOV) of 1110, a fifth imaging device has a field of view (FOV) of 1112, and a sixth imaging device has a field of view (FOV) of 1114. Alternatively, a measuring device with a single imaging device can be used to capture several overlapping images to form the 360° panoramic image. The overlapping images can be stitched together.The images can be stitched or mosaic-like using known computer vision techniques, making it possible to determine a mapping of the 360° panoramic image. This mapping can be used to determine the coordinates of the target points on the surface being mapped using previously described methods. A measuring device 1102 can also be used to determine the azimuths of the target points located inside or outside the images, as previously explained.

[0066] Fig. Figure 12 shows a simplified diagram illustrating a measurement method according to another embodiment of the invention. Fig.Figure 12 includes a measuring device 1202 with an imaging device having a field of view (FOV) 1204. In this example, there are two surfaces within the FOV 1204 of the imaging device: a horizontal surface 1206 and a vertical surface 1208. The horizontal surface 1206 could, for example, be the floor, and the vertical surface could be a side of a building or structure. An image or map of each surface can be determined. The imaging of the horizontal surface 1206 is based on the height of the imaging device above the surface. The imaging of the vertical surface 1208 is based on the distance of the imaging device from the surface. This distance can be determined, for example, using electronic data mapping (EDM). A person skilled in the art would recognize many variations, modifications, and alternatives.

[0067] It is understood that the features of one or more embodiments of the invention can be combined with one or more features of other embodiments of the invention without departing from the scope of the invention. The examples and embodiments described herein are for illustrative purposes only, and various modifications or changes in light of them will be immediately apparent to a person skilled in the art and are intended to be contained within the spirit and scope of this application and the scope of the attached claims.

Claims

[1] An apparatus for determining an azimuth of a target point, comprising: a support structure; an imaging device coupled to the support structure and configured to provide a first image of a surface at a first location orienting the imaging device to a known reference position and provide a second image of the surface at the first location orienting the imaging device to the target point, the first image and the second image having overlapping portions; a position measuring device coupled to the support structure and configured to determine position information of the first location; a processor in electrical communication with the imaging device and the position measuring device, the processor configured to: Receiving the first and second images from the imaging device; Determining a rotation of the imaging device between the first and second images about a vertical axis using the overlapping portions of the first image and the second image; and Determine the azimuth of the target point relative to the orientation of the imaging device to the known reference position, using the rotation of the imaging device. [2] The device of claim 1, further comprising: an inclination sensor configured to determine a vertical orientation of the support structure relative to a local gravity vector. [3] The device of claim 2, further comprising: a distance measuring device coupled to the support structure; and a vertical angle sensor coupled to the support structure and configured to determine a vertical angle of the distance measuring device relative to the support structure, wherein the distance measuring device and the vertical angle sensor are in electrical communication with the processor, and wherein the processor is further configured to: Receiving distance information from the distance measuring device; Receiving angle information from the vertical angle sensor; and Calculating coordinates of the target point in a local coordinate frame. [4] The apparatus of claim 1, wherein the position measuring device includes a reflective target. [5] The apparatus of claim 1, wherein the imaging device is calibrated to provide angular relationships between elements of the image data. [6] The apparatus of claim 1, wherein the position measuring device uses a global navigation satellite system. [7] The apparatus of claim 1, wherein the imaging device comprises a digital camera. [8] The apparatus of claim 1, wherein the support structure comprises a rod having a vertical axis extending along a length of the rod, and wherein an optical center of the imaging device is aligned with the vertical axis of the rod. [9] A method of determining an azimuth of a target point, the method comprising: Positioning an imaging device at a first location; Orienting the imaging device with respect to a known reference position; Obtaining a first image of a surface at the first location; Determining a position of the first location; Orienting the imaging device with respect to the target point; Obtaining a second image of the surface at the first location, wherein the first image and the second image have overlapping portions. Determining a rotation of the imaging device between the first and second images about a vertical axis using the overlapping portions of the first image and the second image; and Determining the azimuth of the target point relative to the orientation of the imaging device with respect to the known reference position, using the rotation of the imaging device. [10] The method of claim 9, further comprising: Determining a distance from the first location to the target point; and Calculating coordinates of the target point in a local coordinate frame. [11] The method of claim 9, wherein a second target point is located within the second image, and the surface is substantially flat, the method further comprising: Calculating coordinates of the second target point in a local coordinate frame using a calibration of the imaging device.

Citation Information

Patent Citations

  • Geographic data collecting system

    US20070008515A1

  • Managed traverse system and method to acquire accurate survey data in absence of precise GPS data

    US20070139262A1

  • Surveying instrument and method of providing survey data using a surveying instrument

    WO2007031248A2