Method and system for locating a vehicle using an image capture device
Through the electronic processor unit combining non-optical and optical devices, selecting landmark triplets, measuring angles and moving vectors, the problem of reduced navigation accuracy when satellite signals are not available is solved, and fast and accurate navigation position acquisition and navigation equipment correction are achieved. , enhances the independence and accuracy of the navigation system.
Patent Information
- Application Number
- CN202080065387.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-09-17
- Filing Date
- 2020-09-11
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2040-09-11
AI Technical Summary
When satellite signals are unavailable or navigation equipment fails, the accuracy of maritime navigation is reduced, making it difficult for the prior art to quickly and accurately correct and reset reference navigation equipment.
Using electronic processor units combined with non-optical positioning equipment and optical equipment, the landmark triple is pre-selected, landmark images are taken, angles are measured, and the second geographical location of the vehicle is determined, reducing human intervention, and improving the speed and accuracy of position acquisition. and improve the accuracy of the navigation system by moving vectors.
It realizes the rapid and accurate acquisition of the geographical location of the vehicle when the satellite signal is unavailable, improves the independence and automation of the navigation system, enhances the correction and reset capabilities of navigation equipment, and ensures navigation accuracy.
Smart Images

Figure CN114424023B_ABST
Abstract
Description
Background of the Invention
[0002] The present invention relates to outdoor navigation, and in particular to marine navigation.
[0003] Traditionally, navigation near the coast relies on taking bearings to landmarks (i.e., identifiable objects located visible at sea and / or on the coast) whose positions are known and from which the vessel's position can be calculated by triangulation. This navigation technique is performed by an operator and is relatively time-consuming. Furthermore, the inaccuracy of this navigation technique increases with increasing vessel speed.
[0004] The invention of satellite positioning, as provided in the GPS, GLONASS, Galileo and BeiDou systems as examples, commonly referred to by the term "Global Navigation Satellite System" (GNSS), has revolutionized navigation to the point where satellite positioning has rapidly become the most widespread method of navigation. Specifically, these positioning systems are designed to automatically determine the position of vehicles provided with satellite signal receivers both near the coast and on the open sea in an efficient and accurate manner.
[0005] However, in the event of a satellite signal receiver failure or in the event that satellite signals are unavailable (eg, due to interference or satellite failure), the accuracy of the navigation system may be reduced.
[0006] There are also navigation devices that include inertial navigation systems that detect the movement of the vehicle and are able to determine the path followed by the vehicle. Thus, knowing the starting point of the vehicle, it is possible to determine the current position of the vehicle and the path followed by the vehicle since its starting point. However, while most navigation systems are accurate in the short term, they need to be reset regularly.
[0007] Purpose of the Invention
[0008] A particular object of the present invention is to provide a device which is self-contained, automatic and easy to use and which is suitable for calibrating and / or resetting a reference navigation device, such as, for example, a satellite navigation or an inertial navigation. Summary of the invention
[0009] To this end, according to the present invention, a method for locating a vehicle is provided, the vehicle being provided with an electronic processor unit connected to both a non-optical locating device and an optical device for capturing external images, the electronic processor unit comprising a landmark database, the landmark database comprising at least the geographical location of each landmark and a descriptive element describing each landmark (such as an image or a reference to one or more of its characteristics). The method comprises the following steps:
[0010] estimating a first geographic location of the vehicle by means of a non-optical positioning device;
[0011] Preselecting from the database a landmark whose geographical location is within a predetermined radius around the first geographical location of the vehicle;
[0012] Select at least one landmark triplet;
[0013] controlling an optical device for capturing an external image to capture an image of a landmark of the at least one selected landmark triplet;
[0014] · selecting images in which landmarks are definitely visible, identifying the landmarks in the images, and measuring the angle of each visible landmark from the images relative to a reference direction (the measured angles are absolute or relative); and
[0015] • Determining a second geographic location of the vehicle based on angles measured with respect to a selected landmark triplet, the landmark triplet having been selected to minimize geometric errors in determining the second geographic location.
[0016] Therefore, by minimizing human intervention as much as possible, pre-selecting landmarks makes it possible to obtain a second geographical location relatively quickly. In addition, as a result of selecting the best landmark triplet, the second geographical location is relatively accurate. The second geographical location can be used to verify the positioning accuracy obtained by (all) non-optical positioning devices.
[0017] In a preferred embodiment, the second geographical position of the vehicle is determined based on the measured angle while taking into account the movement of the vehicle when capturing the image of the landmark of the selected triplet.
[0018] The second geographic location is more accurate.
[0019] Then, advantageously, the movement of the vehicle between the taking of the images associated with the selected landmark triplet is measured and the electronic processor unit determines the movement vector of the movement between the taking of each image and the taking of the last image of the selected landmark triplet, obtains the direction of the landmark corresponding to the measured angle and shifts them along the movement vector in question and calculates the corrected second geographical position at the intersection between the directions of the landmarks when shifted in this way.
[0020] According to particular characteristics, the method comprises, for each selected landmark triplet, the step of determining the distance between the vehicle and each preselected landmark and, when capturing an image of each landmark, controlling the optical device for capturing the external image to adapt its image capture field according to the distance of said landmark from the vehicle.
[0021] Preferably, selecting a landmark triplet for determining the second geographical location comprises the following steps:
[0022] For each landmark triplet, determine three circles, all of which pass through positions estimated from angles measured for the three landmarks in each landmark triplet, and each circle passes through a corresponding pair of landmarks;
[0023] Determine the area of the triangle defined by the center of the circle for each landmark triplet; and
[0024] The quality score of each triplet is calculated based on the area of the triangle, and the triplet selected is the one with the best quality score.
[0025] Preferably, the method comprises the step of comparing the most recent geographical position obtained by means of the non-optical positioning device with the geographical positions obtained by means of the non-optical positioning device.
[0026] The invention also provides a vehicle navigation system arranged to perform the method.
[0027] Other characteristics and advantages of the invention will become apparent upon reading the following description of a particular and non-limiting implementation of the invention.
[0028] BRIEF DESCRIPTION OF THE DRAWINGS
[0029] With reference to the accompanying drawings, in which:
[0030] [ Figure 1 ] Figure 1 is a schematic diagram showing how the present invention is implemented;
[0031] [ Figure 2 ] Figure 2 is a block diagram of a navigation system of the present invention;
[0032] [ Figure 3 ] Figure 3 is a schematic diagram showing how to calculate the second geographical location without considering the movement of the vehicle;
[0033] [ Figure 4 ] Figure 4 is a schematic diagram showing how to calculate the second geographical location while taking into account the movement of the vehicle.
[0034] Detailed description of the invention
[0035] With reference to these figures, the invention is described below as it applies to the navigation of a vessel N having a navigation system giving a global reference 1, the navigation system comprising an electronic processor unit 2 connected to a satellite positioning device 3, to an inertial positioning device 4, and to an optical system for taking external images and giving a global reference 5.
[0036] The satellite positioning device 3 is known per se and comprises a satellite signal receiver and an electronic processor circuit for calculating the geographical position of the satellite receiver based on signals received by the satellite receiver from at least four satellites of a satellite constellation forming part of a satellite navigation system (GNSS) (e.g. systems such as GPS, Galileo, Glonass, BeiDou, etc.).
[0037] The inertial positioning device 4, also known per se, comprises an inertial navigation system having accelerometers on axes of the measurement reference system and gyroscopes arranged to detect rotation of the measurement reference system relative to a reference reference system. The inertial navigation system provides the components of the movement vector of the vessel in the reference reference system.
[0038] The optical device 5 for taking external images comprises a mast 6 on which is mounted at least one optical sensor 7, such as a camera operating in the visible light domain and / or in the infrared domain. The mast 6 is associated with a motor-driven aiming member 8 for pointing the optical sensor 7 along a given orientation. The optical sensor 7 and the aiming member 8 are connected to an electronic processor unit 9 which is programmed to:
[0039] controlling the aiming device 8 to point the optical sensor 7 in the image capturing direction;
[0040] controlling the optical sensor 7 to adjust its image capture parameters (such as its light field) in order to capture one or more images;
[0041] · obtaining the azimuth orientation depending on the direction in which the optical sensor 7 is aimed; and
[0042] The images are processed and time stamped for forwarding to the electronic processor unit 2 .
[0043] The electronic processor unit 2 comprises a memory containing a navigation computer program and a database of landmarks, the database of landmarks comprising the geographical location of each landmark and at least one image thereof. The computer program is arranged in a conventional manner to calculate a reference navigation corresponding to a path followed by the vessel N in a geographical reference system. In this example, the reference navigation is a hybrid navigation calculated based on signals from both a satellite positioning device 3 and an inertial navigation system 4, and provides a first estimated geographical location to the vessel N at a predetermined speed. By way of example, the computer program utilizes a set of Kalman filters for this purpose. The computer program also comprises instructions arranged to perform the method of the invention. The method described below is based on the assumption that the vessel N is at sea close to the coast and in the presence of landmarks (including Figure 1 Navigate in an area of at least four landmarks identified as M1, M2, M3 and M4 in the electronic processor unit 2, which are referenced in the database of the electronic processor unit 2.
[0044] The method of the invention begins with a step of estimating, by means of a reference navigation calculation, a first geographical position P1e of the vessel N. Based on this position P1e, the electronic processor unit 2 preselects from its database landmarks (in this example M1, M2, M3 and M4) the geographical positions of which are located within a predetermined radius around the first estimated geographical position of the vessel N. The radius in question corresponds to the range of the optical image capture device 5.
[0045] The electronic processor unit 2 controls the optical device 5 for capturing external images so as to point the optical sensor 7 approximately at the area around the vessel N in which said landmarks should be found and to capture images of the landmarks. Knowing the geographical location of each landmark and obtaining a first geographical location P1e, the program in this example is advantageously arranged to determine an estimated distance between the landmark and the vessel N and to control the optical device 5 for capturing external images to adjust its field of view for capturing images of each landmark according to the distance of said landmark from the vessel N. It is thus possible to have better quality images of the landmarks in question and, most importantly, to improve the accuracy of the orientation of each landmark in the captured images. Each image is timestamped. In this example, the total number of images is limited to 12 in order to limit the amount of data to be processed and to limit the length of time that the optical device 5 for capturing external images is used so that it can be used for other functions, such as monitoring the nearby surroundings. Figure 1 In the example shown in , four landmarks are visible.
[0046] In this example, the captured landmark images are then presented to the operator (displayed on the screen) together with one or more descriptive elements (name, identifier, image, etc.) obtained from the database for identifying each landmark, so that the operator can ensure that the landmark exists in the database and identifies the landmark in the image shown. The operator selects the image in which the landmark can indeed be identified and points to the landmark in the image (this selection and pointing can be done by using a touch screen or by using a pointing device such as a computer mouse). It is assumed that this pre-selection is based on four visible landmarks M1, M2, M3 and M4.
[0047] The program then accurately acquires (i.e. measures) the azimuth position of each landmark based on the captured image (knowing the aiming position of the optical sensor 7 when the image was captured, it is possible to infer the azimuth position of the landmark from the offset between the landmark and the image center).
[0048] The procedure then combines to determine all possible landmark triplets, specifically in this example:
[0049] M1, M2, M3;
[0050] M1, M2, M4;
[0051] M1, M3, M4;
[0052] M2, M3, M4.
[0053] It should be observed that if one of the landmarks is not visible in any of the images taken, all triplets including that landmark are discarded.
[0054] For each saved landmark triplet, the program determines the original second geographic location by proceeding as follows, as described with reference to triplet M1, M2, M3.
[0055] like Figure 3 As shown in , the program determines that the original second geographical position POraw of the vessel N is at the intersection of the azimuth position AZ1 of the landmark M1, the azimuth position AZ2 of the landmark M2 and the azimuth position AZ3 of the landmark M3, which are obtained by optically measuring the captured images.
[0056] Thereafter, the program determines three circles, all of which pass through the original second geographic location POraw, and each of which passes through the geographic locations of a corresponding pair of landmarks, specifically:
[0057] A circle C12 with center O1 passing through the original second geographic location POraw and the geographic locations of landmarks M1 and M2;
[0058] A circle C13 with center O3 passing through the original second geographic location POraw and the geographic locations of landmarks M1 and M3; and
[0059] A circle C23 with center O2 passes through the original second geographic location POraw and the geographic locations of the landmarks M2 and M3.
[0060] The centers O1, O2, and O3 define a triangle T of area s, and the quality score of the landmark triplet M1, M2, M3 is proportional to 1 / s.
[0061] This calculation is performed for each of the four triplets of the selected landmarks, and the landmark triplet with the best quality score (and hence the triangle T of smallest area) is retained: in this example, the triplet M1, M2, M3.
[0062] The program then calculates a second corrected geographical position POc taking into account the movement of the vessel N when taking the images of the landmarks M1 , M2 and M3 of the triplet that has been retained.
[0063] like Figure 4As shown in and assuming that azimuth bearing AZ1 is acquired at time T1, azimuth bearing AZ2 is acquired at time T2, and azimuth bearing AZ3 is acquired at time T3, the program is arranged to determine a vector U13 representing the movement of the vessel N between times T1 and T3 and a vector U23 representing the movement of the vessel N between times T2 and T3 by using the first geographical positions P2e and P3e calculated by the inertial navigation system in gyrocompass mode at times T2 and T3. The program then offsets the azimuth bearing AZ1 parallel to itself along the vector U13 and offsets the azimuth bearing AZ2 parallel to itself along the vector U23 as if all three azimuth bearings AZ1, AZ2 and AZ3 were acquired simultaneously. The program then calculates a corrected second geographical position POc at the intersection of the offset azimuth bearings AZ1 and AZ2 with the azimuth bearing AZ3. At this point, the program can also determine three other circles that pass through the corrected second geographic location and through the geographic locations of a corresponding pair of landmarks, can calculate the areas of triangles defined by the centers of these circles, and can give a quality score to the landmark triplet.
[0064] The procedure compares the first geographical position P3e with the corrected second geographical position POc in order to detect any anomalies in the hybrid navigation.It is also possible to compare the first geographical position P3e and the raw second geographical position POraw with each other.
[0065] The procedure may also provide for resetting the reference navigation at the corrected second geographic location, for example when it finds that the quality is greater than a threshold value, the threshold value corresponding to a sufficient level of accuracy of the corrected second geographic location.
[0066] Of course, the invention is not limited to the implementation described but covers any variant coming within the ambit of the invention as defined by the appended claims.
[0067] In particular, the navigation system of the present invention may have a structure different from that described.
[0068] The system may include one or more non-optical positioning devices, such as inertial, satellite or other positioning devices.Navigation does not have to be hybrid.
[0069] The device for taking external images may comprise a single optical sensor that may be movable or stationary, or it may comprise a plurality of optical sensors arranged, for example, in a ring. The optical device for taking external images may be dedicated to performing the method of the invention, or it may perform a plurality of functions.
[0070] Adjusting the field or any other image capture parameters when capturing landmark images is optional.
[0071] Optical devices can be positioned in absolute or relative positions.
[0072] The processing may be performed by any type of computing means, such as a processor, a microcontroller, a field programmable gate array (FPGA), ...
[0073] Landmarks may be identified manually and / or selected automatically with the aid of neural networks using deep learning methods.
[0074] It is possible to utilize hybrid navigation for determining the movement of the vessel between T1 , T2 and T3 .
[0075] The number of images captured in a single round can be greater than 12.
[0076] There is no limit to the number of landmark triplets that can be selected. Thus, all landmark triplets can be used to calculate a corresponding number of corrected second geometric positions, the corrected second geometric positions retained for comparison purposes are the positions associated with the best quality scores.
[0077] The method of the present invention is applicable to any type of vehicle traveling on water, air or land.
[0078] The following operations are optional: the movement of the vehicle N is measured between the images associated with the selected landmark triplet, and the electronic processor unit determines the movement vectors U13 and U23 of the movement between the capture of each image and the capture of the last image of the selected landmark triplet, obtains the directions of the landmarks corresponding to the measured angles and shifts them along the movement vectors in question, and calculates the corrected second geographical position POc at the intersection between the directions of the landmarks when shifted in this way. In particular, it is possible not to take into account the movement of the vehicle N when capturing the images of the landmarks in the triplet for the determination of the second geographical position POraw and Poc of the vehicle N. However, taking into account this movement improves the accuracy of the position when the vehicle is very fast and / or the time between taking the optical measurements is long.
[0079] Independently of or in addition to the above operations, it is particularly advantageous to make provision for the selection of landmark triples comprising the following steps:
[0080] For each landmark triplet, determine three circles C12, C13 and C23, all of which pass through the positions estimated from the angles measured for the three landmarks in each landmark triplet, and each circle passes through a corresponding pair of landmarks;
[0081] Determine the area s of the triangle T defined by the centers O1, O2 and O3 of the circles C12, C13 and C23 for each landmark triplet; and
[0082] The quality score of each triplet is calculated based on the area s of the triangle T, and the selected triplet is the one with the best quality score.
[0083] In addition to making this selection, it is particularly advantageous to determine, for each selected landmark triplet, the distance between the vehicle N and each preselected landmark and to control, when taking an image of each landmark, the optical device 5 for taking external images to adapt its image capture field as a function of the distance of said landmark from the vehicle N. However, these operations may be performed in conjunction with landmark triplets selected in a different manner.
Claims
1. A method for locating a vehicle (N), the vehicle being provided with an electronic processor unit (2) connected to both a non-optical positioning device (3, 4) and an optical device (5) for capturing an external image, the electronic processor unit (2) comprising a landmark database (M1, M2, M3, M4), the landmark database comprising at least the geographical location of each landmark and a description element describing each landmark, the method comprising the following steps: estimating a first geographical position (P1e) of the vehicle (N) by means of the non-optical positioning device (3, 4); preselecting from the database landmarks whose geographical locations are within a predetermined radius around a first geographical location of the vehicle (N) and determining the distance between the vehicle (N) and each preselected landmark; Select at least one landmark triplet; pointing the optical device (5) for capturing an external image at each landmark of the at least one selected landmark triplet and controlling the optical device (5) to capture images of the landmarks of the at least one selected landmark triplet while adjusting its image capture field for capturing an image of each landmark according to the determined distance of the landmark from the vehicle (N); selecting an image in which the landmarks are indeed visible, identifying the landmarks in the image, and measuring from the image an angle relative to a reference direction for each visible landmark; and determining a second geographical position of the vehicle (POraw; POc) based on angles measured by a selected landmark triplet, the landmark triplet having been selected to minimize geometric errors in determining the second geographical position, wherein the second geographical position (POraw; POc) of the vehicle (N) is determined based on the measured angle while taking into account the movement of the vehicle (N) when taking the images of the landmark of the triplet, and wherein the movement of the vehicle (N) between the taking of images associated with the selected landmark triplet is measured and the electronic processor unit determines the movement vectors (U13, U23) of the movement between the taking of each image and the taking of the last image of the selected landmark triplet, obtains the directions of the landmarks corresponding to the measured angles and shifts them along the movement vectors in question and calculates the corrected second geographical position (Poc) at the intersection between the directions of the landmarks when shifted in this way, The selection of the landmark triplet comprises the following steps: For each landmark triplet, determine three circles (C12, C13, C23), all of which pass through the positions estimated from the angles measured for the three landmarks in each landmark triplet (POraw), and each circle passes through a corresponding pair of landmarks; Determine the area (s) of the triangle (T) defined by the centers (O1, O2, O3) of the circle (C12, C13, C23) for each landmark triplet; and • Calculate the quality score of each triplet based on the area (s) of the triangle (T), the triplet selected is the one with the best quality score.
2. The method according to claim 1, characterized in that It comprises the step of comparing the most recent geographical position (P3e) obtained by means of the non-optical positioning device with the geographical positions (POraw, POc) obtained by means of the non-optical positioning device.
3. A vehicle navigation system comprising an electronic processor unit (2), the electronic processor unit (2) being connected to a non-optical positioning device (3, 4) and an optical device (5) for capturing external images, the electronic processor unit (2) being programmed to execute a method according to any of the preceding claims, the electronic processor unit (2) comprising a landmark database, the landmark database comprising at least the geographical location of each landmark and a descriptive element describing each landmark.
4. The system according to claim 3, characterized in that The optical device (5) for capturing an external image comprises a motor drive connected to the electronic processor unit (2).
5. The system according to claim 3 or claim 4, characterized in that The non-optical positioning device (3) comprises a receiver for receiving signals from a positioning satellite.
6. The system according to claim 3 or claim 4, characterized in that: The non-optical positioning device (4) comprises an inertial navigation system.
