LIDAR TECHNOLOGY-BASED METHOD AND APPARATUS FOR ADAPTIVELY TRACKING OBJECTS - Patent application
The LIDAR-based method addresses the limitations of existing tracking technologies by using a parametric curve to adaptively track objects over large distances and high speeds, ensuring accurate and efficient object tracking.
Patent Information
- Application Number
- JP2023514837
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-09-02
- Filing Date
- 2021-08-25
- Publication Date
- 2026-01-20
- Estimated Expiration
- 2041-08-25
AI Technical Summary
Existing tracking technologies are inadequate for tracking objects over a large distance range and at high speeds, particularly for applications like drone tracking, due to limitations in distance and angular resolution, and require complex systems like optical zoom or multiple cameras.
A LIDAR-based method using a parametric curve tracking pattern that adjusts to the object's distance and movement, enabling continuous tracking by iteratively determining the object's position, direction, and configuring the tracking pattern based on estimated dimensions and movement parameters.
Enables accurate and high-frequency tracking of objects over a wide range, supporting both passive and active tracking methods, with improved angular resolution and reduced complexity.
Smart Images

Figure 0007802773000008 
Figure 0007802773000009 
Figure 0007802773000010
Abstract
Description
[Technical Field]
[0001] The present invention relates to the field of object tracking. More particularly, the present invention relates to a method for tracking an object and an apparatus for tracking an object. [Background technology]
[0002] For some applications, such as tracking drones, aircraft, satellites, or docking devices for space rendezvous, it is necessary to have object tracking that works over a relatively large distance range (e.g., tens of meters to a kilometer for drone tracking) and is compatible with the high relative velocities of such objects.
[0003] Such tracking is currently based on two principles. (i) Passive imaging, primarily using optical cameras or radio wave sensors, and possibly acoustic sensors depending on the emissivity range and the environment of the tracked object. (ii) Active tracking, which is based on the use of electromagnetic radiation sources internal to the system, such as lidar or radar.
[0004] Tracking, whether based on passive imaging or active tracking, has the advantage of making it possible to detect the object to be tracked when it is within the "field of view" of the tracking device, and is therefore particularly suitable for identifying and detecting the object to be tracked.
[0005] However, this type of tracking has the drawback that it typically tracks over a relatively small distance range directly tied to the focal length used for the optical camera and is configured with low angular resolution relative to radar. To extend this distance range, optical camera or flash lidar systems require the use of an optical zoom system or multiple cameras, which are relatively complex to implement, especially when the tracked object is moving at high speed.
[0006] It should be noted that here, and in the remainder of this specification, "tracking distance range" means the distance range between a tracked object and a tracking device, e.g., a camera or LIDAR device, over which the tracking device is configured to track the object.
[0007] As mentioned above, some active tracking operations can be based on the emissivity of the tracked object. More specifically, certain tracked objects have specific emissivity characteristics, for example, in the radio wave field (e.g., drones communicating with a radio control unit via Wi-Fi or aircraft aviation radio communications). Nevertheless, these tracking methods are based on waves whose wavelengths are similar to those of radar systems and suffer from the same drawbacks, and therefore cannot provide tracking with a sufficiently large angular resolution for certain applications.
[0008] For scanning lidar imaging, despite the greater angular resolution, the scan time for a large field of view proves to be too long to enable tracking of fast moving objects.
[0009] Thus, there are no tracking devices that are suitable for tracking an object that moves at a relatively high speed and that are suitable for tracking over a relatively large distance.
[0010] Active tracking, taught by J.A. Vera Chin and his co-authors in the scientific journal Optical Engineering, Vol. 39, pp. 196–212, 2000, partially solves this problem. This type of active tracking, based on lidar technology, involves passing a lidar laser beam along an angular tracking pattern around the target's (here, a drone) expected position, as shown in Figure 1A. By identifying the target's interception point with the laser beam, the target's actual position can be determined and the tracking pattern can be shifted to center on the target, as shown in Figure 1B. In this way, based on a relatively simple pattern such as a Lissajous curve, the movement of the target can be tracked at a relatively high tracking frequency, limited only by the time it takes for the laser beam probe to pass along the entire tracking pattern.
[0011] Nevertheless, such active tracking is suitable for a relatively small distance range, which depends on the shape of the selected tracking pattern.
[0012] Thus, to our knowledge, there is no tracking method that allows for tracking of objects over a relatively long distance range (i.e., suitable for tracking, for example, from about 10 meters to several kilometers) and is equally suitable for relatively high speed objects (i.e., in the case of, for example, a drone, which may be faster than 80 km / h) as for low speed objects. Summary of the Invention [Problem to be solved by the invention]
[0013] The present invention alleviates these drawbacks and provides an object tracking method capable of tracking objects over a relatively large distance range. [Means for solving the problem]
[0014] The present invention relates to a method for tracking objects based on the use of a LIDAR device, the LIDAR device comprising: a laser source for emitting a probe laser beam; a translation system for moving the probe laser beam to change the direction of the probe laser beam; Equipped with The method includes the following steps. (A) Identify the object to be tracked. (B) Estimating a position of the object, the position of the object including a distance between the object and the LIDAR device. (C) Tracking an object. The step C of tracking the object includes the following sub-steps. (C1) determining a parametric curve tracking pattern through which the probe laser beam passes, and at least one angular parameter of the tracking pattern relative to the lidar device is estimated from the estimated position of the object, including in particular the distance between the object and the lidar device; (C2) Moving the probe laser beam along the tracking pattern determined in step C1, and moving the probe laser beam by the movement system so that the probe laser beam identifies an intercept point on the object during the movement of the probe laser beam. (C3) determining the position of the object from the point of interception of the probe laser beam by the identified object, the determined position constituting the distance between the object and the LIDAR device;
[0015] This method allows for active tracking of an object with a tracking pattern suited to the object's distance and shape due to the dependency of at least one angular parameter of the tracking pattern on the distance between the object and the LIDAR device. In this way, a suitable tracking pattern can be configured regardless of the distance between the object and the LIDAR device, enabling tracking over a wider distance range than prior art methods. Furthermore, the pattern can be relatively simple, and the principles of active tracking allow this method to support high-frequency tracking and therefore be used to track objects at relatively high moving speeds.
[0016] When performing tracking step C, steps C1 to C3 are repeated sequentially, and the estimated position of the object used in step C1 is the estimated position of the object obtained in step B in the first iteration, or the position of the object determined in step C3 of the (n-1)th iteration in the nth iteration, where n is an integer greater than or equal to 2. In this way, continuous tracking of the tracked object can be ensured.
[0017] In sub-step C3 of determining the position of the object, the direction of movement of the object is further determined based on the estimated position used in sub-step C1 and the position determined in sub-step C3.
[0018] When step C is performed, in the nth iteration, where n is an integer greater than or equal to 2, in substep C1 of determining a tracking pattern, at least one other parameter of the tracking pattern is determined based on the estimated movement direction of the object determined in step C3 of the n-1th iteration.
[0019] In step C1, the tracking pattern is of a parametric curve type, and the at least one angle parameter is an angle parameter of the parametric curve.
[0020] By defining a tracking pattern that takes into account the direction of movement of the tracked object, the number of echoes at the object (i.e., the number of interceptions of the object by the probe laser beam) can be maximized as the laser moves along the tracking pattern, taking into account the object's movement, thereby obtaining a better estimate of the object's position.
[0021] In sub-step C3 of determining the position of the object, an estimated speed of movement of the object may further be determined based on the estimated position used in sub-step C1 and the position determined in sub-step C3.
[0022] When step C is performed, in the nth iteration, where n is an integer greater than or equal to 2, in substep C1 of determining a tracking pattern, at least one other parameter of the tracking pattern is further determined based on the estimated speed of movement of the object determined in step C3 of the n-1th iteration.
[0023] By using the velocity of the tracked object as the basis for defining the pattern, the movement of the object can be better taken into account and the number of echoes to the object as the laser moves along the tracking pattern can be further improved.
[0024] In the sub-step C3 of determining the position of the object, an estimated acceleration of the object may also be determined.
[0025] During the execution of step C, in the n-th iteration, where n is an integer greater than or equal to 2, the sub-step C1 of determining the tracking pattern further determines at least one other parameter of the tracking pattern from the estimated acceleration.
[0026] At least one other parameter of the pattern may constitute a pattern type selected from a group of predefined patterns, the pattern type being selected from a group of predefined patterns corresponding to the respective type of parameter curve, and where an estimated direction of movement and / or an estimated speed of movement is available, selected from the group of predefined patterns.
[0027] In this way, a pattern can be selected that is particularly suited to the speed and / or direction of movement of the object to be tracked, thus ensuring optimized tracking.
[0028] In one of step A of identifying the tracked object and step B of estimating the position of the object, at least one estimated dimension of the object may further be determined in a vertical plane that includes the estimated position of the object and is perpendicular to a line passing through the estimated position of the object and the position of the LIDAR device.
[0029] In sub-step C1, a tracking pattern is determined and at least one angular parameter of the tracking pattern is determined from the estimated dimensions.
[0030] In this way, the method can be adapted to suit the size of the object to be tracked: thus, by suitably configuring the device according to the invention, it is possible to track objects of a few tens of centimetres, for example small-sized certain drones, or much larger objects such as airplanes.
[0031] The step B of estimating the position of the object may include the following sub-steps. (B1) Determine a preliminary position of the object, including the distance between the object and the LIDAR device. (B2) determining an identification pattern through which the probe laser beam passes along a vertical plane that includes the estimated preliminary position of the object and is perpendicular to a line passing through the estimated preliminary position of the object and the position of the LIDAR device, and determining at least one angular parameter of the identification pattern from the estimated preliminary distance between the LIDAR device and the object and the estimated preliminary position of the object; (B3) The probe laser beam is moved by the movement system along the identification pattern determined in step B2, and an intersection point between the object and the probe laser beam is identified during the movement of the probe laser beam. (B4) Determine an estimated position of the object from the point of interception of the probe laser beam by the identified object, the determined position constituting a distance between the object and the lidar device, and also determine an estimated dimension of the object in the vertical plane from the point of interception of the probe laser beam by the identified object.
[0032] Such an identification pattern makes it possible to estimate the size of an object and track it in a minimum amount of time, without having to perform a complete image of the object or scene.
[0033] In step B2 of determining the discrimination pattern, this discrimination pattern may correspond to a parametric curve other than the type of tracking pattern determined in step C1.
[0034] The step B of estimating the position of the object may include the following sub-steps. (B'1) The probe laser beam is moved by a movement system, and while the probe laser beam is moving, the spatial region where the tracked object is estimated to be located is scanned, and the intersection point between the object and the probe laser beam is identified. (B'2) Determine an estimated position of the object from the point of interception of the probe laser beam by the identified object, the determined position including the distance between the object and the lidar device, and estimated dimensions of the object in the vertical plane are also determined from the point of interception of the laser beam by the identified object.
[0035] Such scanning can obtain an image of the tracked object, thereby enabling its identification.
[0036] In this way, not only can an estimated size of the object be provided, but information can also be obtained about the type of tracked object and the tracking pattern can be configured appropriately for this type.
[0037] The present invention further relates to a system for tracking an object using a LIDAR device, the system comprising: a laser source configured to emit a probe laser beam; a translation system for moving the probe laser beam, configured to redirect the probe laser beam, the translation system participating in the laser beam source and the LIDAR device configuration; a control unit for controlling a movement system for moving the probe laser beam; Configure The control unit is further configured to perform at least step C of the tracking method according to the invention.
[0038] Such an object tracking system makes it possible to implement the method according to the invention and to obtain the advantages associated with the method according to the invention.
[0039] The system may further comprise at least one imaging device selected from the group comprising an optical camera and a radar device, the imaging device configured to perform at least step A and to provide the control unit with the necessary instructions to perform step B, the control unit configured to perform step B of the tracking method.
[0040] Such an imaging device can continuously detect tracked objects over a relatively wide range. Thus, the method of the present invention can achieve both passive tracking with low resolution and a wide field of view, and improved accuracy in active tracking.
[0041] The system may include a device for communicating with the control unit, by which an observer who has identified the tracked object according to step A can provide the necessary indications to the control unit to perform step B, the control unit being configured to perform step B of the tracking method.
[0042] In this way, when an observer detects a tracked object, the tracking method according to the present invention can be easily configured to track the detected object as described above. [Brief explanation of the drawings]
[0043] The invention will be better understood from reading the description of exemplary embodiments given by way of illustration and in no way limiting, with reference to the accompanying drawings, in which: [Figure 1A] FIG. 1A shows the first and second steps of a prior art active type tracking method. [Figure 1B] FIG. 1B shows the first and second steps of a prior art active type tracking method. [Figure 2] FIG. 2 is a flow chart illustrating the main steps of the tracking method according to the invention. [Figure 3A] FIG. 3A shows a tracking device according to the first LIDAR measurement principle according to the invention. [Figure 3B] FIG. 3B shows the principle of movement of the laser beam by a movement system implemented in the context of the present invention and in the context of LIDAR measurements. [Figure 3C] FIG. 3C shows a tracking device according to the invention and a tracking device according to a second lidar measurement principle. [Figure 4] FIG. 4 is a flow chart illustrating the substeps of the tracking step of the method according to the invention. [Figure 5] FIG. 5 illustrates the principle of determining the angular parameters of the tracking pattern based on the distance and size of the tracked object. [Figure 6]FIG. 6 illustrates the principle of adapting the dimensions of the tracking pattern according to the method according to the invention. [Figure 7] FIG. 7 shows the principle of the estimation pattern used in connection with the estimation step for estimating the dimensions of an object according to a first variant of the method according to the invention. [Figure 8] FIG. 8 is a flowchart showing the substeps within the step of estimating the position of an object of the method according to the first variant based on an estimation pattern such as that shown in FIG. [Figure 9] FIG. 9 shows the lidar imaging substeps carried out in conjunction with the step of estimating the position of an object according to a second variant of the invention. [Figure 10] FIG. 10 is a flowchart showing sub-steps of the estimation step according to a second modified example in which an imaging sub-step is performed. [Figure 11A] FIG. 11A illustrates the adaptation of the tracking pattern according to the second embodiment based on an estimated velocity of the object being substantially zero. [Figure 11B] FIG. 11B shows the adaptation of the tracking pattern according to the second embodiment based on the estimated velocity of the intermediate object. [Figure 11C] FIG. 11C illustrates the adaptation of the tracking pattern according to the second embodiment based on the estimated velocity of a relatively large object. [Figure 12A] FIG. 12A shows the adaptation of the tracking pattern according to a variation of the second embodiment based on an estimated velocity of the object being substantially zero. [Figure 12B] FIG. 12B shows an adaptation of the tracking pattern according to a variation of the second embodiment based on an estimated velocity that is intermediate. [Figure 12C] FIG. 12C illustrates an adaptation of the tracking pattern according to a variation of the second embodiment based on the estimated velocity of a relatively large object.
[0044] To facilitate communication between the figures, identical, similar or equivalent parts in the various figures are provided with the same reference numerals. The various parts shown in the figures are not necessarily shown to a uniform scale in order to make the figures easier to read. The various possibilities (variants and embodiments) should not be understood as being mutually exclusive but may be combined with one another. DETAILED DESCRIPTION OF THE INVENTION
[0045] FIG. 2 is a flow chart illustrating the main steps of a tracking method according to the invention, based on the principle of active tracking using a lidar device 1 as shown in FIG.
[0046] Note that in this embodiment, the tracked object is a drone 50. While the present invention may be particularly suited to tracking drones, it is not limited to this application and may be used to track any type of object that can move relative to the lidar device 1. The method of the present invention may involve tracking a moving object, such as a drone, an aircraft, or a satellite, from the ground, but may also be implemented in the context of tracking an object that moves relative to a lidar device, such as a lidar device mounted on a shuttle in the context of a rendezvous with a space station or satellite. Such a tracking method is based on the lidar device 1 shown in FIG. 3 , which is constituted by a tracking system 1 according to the present invention. The lidar device 1 includes a laser source 10 that emits a probe laser beam 60A, a system 20 configured to redirect the probe laser beam 60A to move the probe laser beam 60A, and a measurement system 30 that detects a portion of the probe laser beam 60A backscattered by the tracked object 50 and determines the distance between the tracked object 50 and the lidar device 1 based on the time offset between the emission of the probe laser beam 60A and the detection of the backscattered portion of the probe laser beam 60A.
[0047] It should be noted that the "distance between the tracked object 50 and the lidar device 1" means the distance between a point on the tracked object, for example, a point on the aforementioned reflective surface from which the laser beam 60 is backscattered, and a reference point on the device, for example, a virtual reference point located on the mobile system 20 or between the mobile system 20 and the measurement system 30.
[0048] 3A and 3B, measurements by the LIDAR device 1 are generally based on measuring the time between the emission of a laser pulse contained in the probe laser beam 60A and the reception by the measurement system 30 of a portion of the laser pulse backscattered by, for example, the surface 50 of the tracked object. By multiplying the measured time by the speed of light and dividing by two, the distance between the surface and the LIDAR device 1 can be directly inferred. Thus, based on the orientation of the probe laser beam by the moving system and its distance, the position of the surface at the origin of the backscattering of the probe laser beam can be determined.
[0049] To enable such time measurements, several LIDAR measurement principles can be implemented. According to the first measurement principle shown in Figure 3A, in addition to the laser source 10 being a pulsed laser source capable of emitting a pulsed laser beam 60, the LIDAR device further includes a beam separator 37 for separating the pulsed laser beam 60 emitted by the laser source 10 into a probe laser beam 60A and a reference laser beam 60B.
[0050] This measurement system 30 a beam separator 37; a first radiation detection device 31, such as a photodetector (e.g., a photomultiplier tube), that detects the reference laser beam 60B after the probe laser beam 60A has been separated and provides a time reference for the emission of the probe laser beam 60A; a second radiation detection device 32, such as a photodetector (e.g., a photomultiplier tube), that detects the backscattered portion 60C of the probe laser beam 60A and provides a time measurement of receipt of the backscattered portion 60C of the probe laser beam 60A; a calculation unit 33 that calculates the distance between the lidar device and a surface based on the time reference provided by the first radiation detection device 31 and the time measurement of reception provided by the second radiation detection device 31, and determines the position of this surface from the orientation provided by the motion system 20 to the probe laser beam 60A; a control unit 35 for controlling the mobile system 20 and the computing unit in order to implement the method according to the invention; Equipped with.
[0051] 3B shows the principle of angular movement of the laser beam by the translation system 20. Based on this principle and on a set of mirrors (shown in particular in FIG. 3C), the translation system 20 allows the laser beam 60 to be angularly moved about two different axes of a horizontal coordinate system: an azimuthal axis corresponding to the coordinate θ in the horizontal plane (θ being comprised between 0° and a maximum of 360°), and a vertical axis corresponding to the coordinate φ (φ being comprised between 0° and 90°). In this way, the laser beam 60 can be moved to follow an object along any path.
[0052] According to a second lidar measurement principle, as shown in FIG. 3C , the measurement system 30 can include a single radiation detector 31 for detecting the backscattered portion 60C of the probe laser beam 60, without the beam separator 37, allowing the entire laser beam 60 to function as the probe laser beam. According to this possibility, the laser beam 60 passes through a perforated parabolic mirror and is transmitted to the moving system 20, which moves the laser beam along a tracking pattern 61 toward the target 50. When the laser beam 60 strikes a surface, such as the surface of the target 50, the aforementioned portion 60C is backscattered toward the moving system. The backscattered portion 60C of the laser beam 60 is then received by the moving system 20 and split by the parabolic mirror toward the radiation detector 31, as shown in FIG. 3C .
[0053] Thus, the first detector 31 detects the backscattered portion 60C of the probe laser beam 60A and measures the time at which it receives said portion 60C of the probe laser beam 60A.
[0054] It should be noted that, according to this second measurement principle, unlike the measurement system 30 according to the first measurement principle, the time reference may be determined from the control signal sent to the laser beam source 10. Thus, the calculation unit 33 is configured to calculate the distance between the surface and the LIDAR device from the control signal sent by the control unit 35 and the measurement of the reception time provided by the first radiation detection device 31, and to determine the position of the surface from the orientation given to the probe laser beam 60A by the mobile system 20. The configuration of the control unit 35 according to this second measurement principle is similar to that according to the first measurement principle.
[0055] Of course, these two exemplary configurations of the measurement system 30 are merely illustrative and in no way limiting. Indeed, those skilled in the art can adapt the present teachings to different distance detection principles that may be implemented in the context of LIDAR measurements. Thus, it can be envisioned that the present invention applies to LIDAR measurement systems that implement homodyne or heterodyne electronic synchronous detection type measurement systems, or LIDAR measurement systems that implement Doppler effect optical heterodyne detection type measurements.
[0056] Regardless of the type of measurement system 30 employed, the method of the present invention includes the steps of: (A) identifying a tracked object 50; (B) estimating the position of the object 50, which constitutes the distance between the object 50 and the LIDAR device 1; (C) tracking the object 50; Includes.
[0057] In step A, the object is identified as follows: (i) Observation by a device external to the LIDAR device, such as an optical camera, radar, radio wave detector, acoustic sensor, or human operator; or (ii) Use the LIDAR device 1 as is; It may be performed by
[0058] According to possibility (i), the tracking system may further comprise an external device (not shown) that monitors the space in which the object 50 may appear. If the external device detects the object, it may transmit the approximate position of the object to the control unit 35 so that step B can be carried out based on the approximate position. Based on this possibility, it may also be envisaged that the control unit comprises an input device that allows an operator, having identified the object 50, to provide the necessary instructions so that the control unit 35 can carry out step B.
[0059] With respect to possibility (ii), the lidar device 1 may have an imaging arrangement configured to scan a space in which the lidar device 1 may see the object 50. If, during this scanning operation, an anomaly is detected that may correspond to the tracked object 50, the control unit 35 may be configured to perform step B to confirm the presence of the object 50 and to estimate the position of the object 50.
[0060] In step B, the control unit 35 makes it possible to estimate the position of the object 50 based on the LIDAR measurement principle. Such an estimation is made possible by directing a probe laser beam by the mobile system to the approximate position of the object obtained in step A and measuring the distance between the object 50 and the LIDAR device 1 based on the detection of the backscattered part of the probe laser beam. Such a step makes it possible to provide an estimate of the object's position, which comprises the distance between the object 50 and the LIDAR device 1.
[0061] The step C of tracking the object 50 includes the following sub-steps, as shown in FIG. (C1) determining a parametric curve tracking pattern 61 through which the probe laser beam 60A passes, wherein at least one angular parameter of the tracking pattern 61 relative to the LIDAR device 1 is determined from an estimated position of the object 50, including in particular the distance D between the object 50 and the LIDAR device 1; (C2) a sub-step of moving the probe laser beam 60A by the movement system 20 along the tracking pattern 61 determined in step C1, and identifying intercept points of the object 50 by the probe laser beam 60A during the movement of the probe laser beam 60A; (C3) A substep of determining the position of the object 50 from the point of interception of the probe laser beam 60A by the identified object 50, the determined position constituting the distance between the object 50 and the LIDAR device 1.
[0062] In this embodiment, a Lissajous curve with parameters p=2 and q=3 is selected near the estimated position of the object 50, as shown in FIG. The Lissajous curve is defined by the following parametric equation:
[0063]
number
[0064] Let x(t), y(t) be the coordinates of the pattern in the vertical plane, A be the amplitude parameter of the Lissajous curve, p, q correspond to the "pulses" of the sinusoidal motion with q>p (here p=2, q=3), f be the reference frequency, and x0, y0 correspond to the displacement of the tracking pattern 61 so that it matches the estimated position of the object 50.
[0065] Of course, the Lissajous curve shown in Figure 5 is only one example of a tracking pattern compatible with the present invention, and other patterns are entirely contemplated without departing from the scope of the present invention, for example, the tracking pattern could be spiral or circular, etc. In any case, however, the tracking pattern is preferably selected for its ability to optimize the number of echoes at the object 50 (the number of interceptions of the object by the probe laser beam) and its ability to "capture" the object by reducing the possibility of leakage.
[0066] Thus, in step C1, angular parameters of the tracking pattern 61 are defined based on the estimated position of the tracked object, including in particular the distance D between the object 50 and the LIDAR device, as shown in FIG.
[0067] In fact, according to the principles of the present invention, the size of the tracking pattern is configured to be the estimated or predicted dimension R of the object, so that the amplitude parameter A is proportional to the estimated or predicted dimension R, and this proportionality may be selected based on the expected maximum movement speed and / or embodied in a factor β so as to maximize the number of echoes at the object 50. Thus, this parameter A may be equal to β·R, where β is a proportionality factor and R is the estimated or predicted dimension of the object 50. In fact, if the type of tracked object is known in advance (in this example, a drone), the expected dimension of this object can be defined, for example, 50 cm or 1 m depending on the type of drone. According to a first possibility of the present invention, in the case of a pattern that is a Lissajous curve, the parameter A may be fixed and predetermined. Alternatively, it may be calculated from the estimated dimension R of the object 50 determined in steps A and B, as will be described below in connection with FIGS. 6 to 8.
[0068] As already explained in relation to FIG. 3B, the motion system 20 can change the orientation of the probe laser beam 60A, i.e., perform angular movement of the probe laser beam 60A along the vertical plane passing through the tracking pattern 61, corresponding to a change in the angular coordinate of the probe laser beam 60A with respect to a reference frame according to a horizontal coordinate system whose origin is the LIDAR device 1.
[0069] Adopting the parametric equations given above, such a change in angular coordinate results in:
[0070]
number
[0071] Let θ(t), φ(t) be the angular coordinates of the probe laser beam 60A of the tracking pattern in the reference frame centered on the radar 1, where θ(t) corresponds to the azimuthal axis, φ(t) corresponds to the vertical axis, and θ0, φ0 correspond to the angular deviation of the tracking pattern 61 such that the tracking pattern matches the estimated position of the target 50.
[0072] In other words, taking into account that the ratio R / 2D is expected to be relatively small, the distance D is typically greater than 10 m, or even greater than 50 m for expected dimensions between 50 cm and 1 m. The angular amplitude θ of the object, which is equal to arctan(R / D), can be approximated by R / D, and therefore the angular amplitude of the pattern can be approximated by α=R / D, as shown in the equation above and in FIG. 5.
[0073] Thus, the above parametric equation may be rewritten as follows:
[0074]
number
[0075] 6 shows the dependence of the pattern's angular amplitude on the distance D between the object and the LIDAR device 1, with two objects 50: the left one is relatively far away and has an angular amplitude χ1, and the right one is relatively close to the LIDAR device and has an angular amplitude χ2. As shown in these two figures, a tracking pattern 61 can be provided that is perfectly configured for the size and position of the object 50 in order to calculate the angular amplitudes α1 and α2, taking into account the angular amplitudes χ1 and χ2 of the object 50, which are determined from the distance D between the object 50 and the LIDAR device. Such a match significantly reduces the risk of the object 50 escaping.
[0076] Of course, such an example of tracking pattern parameterization is illustrative only and in no way limiting. Thus, while the angular amplitude α of tracking pattern 61 may have a direct proportional relationship to the angular amplitude θ of object 50, it is contemplated that this relationship may vary without departing from the scope of the present invention. Thus, for example, the angular amplitude α of tracking pattern 61 may be envisioned to also vary as the square of the angular amplitude θ to provide a tracking pattern 61 with a larger angular amplitude α when object 50 is relatively closer to lidar device 1.
[0077] In the context of the present invention, when performing tracking step C, steps C1 to C3 can be repeated sequentially and iteratively to provide continuous tracking of object 50, and the estimated position of the object used in step C1 will be the estimated position of object 50 obtained in step B in the first iteration, or the position of the object determined in step C3 in the n-1 iteration, where n is an integer greater than or equal to 2, in the nth iteration.
[0078] In this way, in addition to continuously tracking the object 50, this tracking is performed by a tracking pattern that determines an angular parameter, i.e., in this embodiment, an angular amplitude α, based on the updated estimated position of the object 50, in particular the distance D between the object 50 and the LIDAR device 1.
[0079] In order to provide a tracking pattern 61 that is particularly suited to the object 50, according to a particular variant of the invention, in one of steps A of identifying the object to be tracked and B of estimating the position of the object, an estimated dimension R of the object 50 in the vertical plane is further determined.
[0080] According to a first variant, the dimension R of the object 50 may be estimated by moving the laser beam based on the identification pattern 63, as shown in Figure 7. Thus, once at least one estimated dimension of the object 50 has been determined in step B, step B comprises the following substeps based on the flowchart of Figure 8: (B1) obtaining a preliminary position of the object 50, the estimated preliminary position including the distance between the object 50 and the LIDAR device 1; (B2) determining an identification pattern 63 through which the probe laser beam 60A passes along a vertical plane including the estimated preliminary position of the object 50 and perpendicular to a line passing through the estimated preliminary position of the object 50 and the position of the LIDAR device 1, and determining an estimated preliminary distance D between the object 50 and the LIDAR device 1 and at least one angular parameter from the estimated preliminary position of the object; (B3) moving the probe laser beam 60A by the movement system to move the probe laser beam along the identification pattern 63 determined in step B2, and identifying an intersection point between the object and the probe laser beam during the movement of the probe laser beam; (B4) Determine an estimated position of the object 50 from the point of interception of the probe laser beam 60A by the identified object 50, the determined position constituting the distance between the object 50 and the LIDAR device 1, and also determine an estimated dimension of the object 50 in the vertical plane from the point of interception of the probe laser beam 60A by the identified object 50.
[0081] Thus, in the context of substep B1, the control unit 35 obtains a preliminary position of the object 50. To that end, the control unit 35 may be configured to communicate with an external device used in the context of step A or to use information provided by an operator who identified the object in the context of step A to determine an estimated position of the object 50. Note that in this context, the control unit 35 may determine the type of object from this communication or this information collection.
[0082] After obtaining this information about the preliminary position of the object, the control unit 35 is configured, in the context of substep B2, to determine an identification pattern 63 through which the probe laser beam 60A passes in the vertical plane and to determine the dimensions in the vertical plane of the object 50. Such an identification pattern 63 may, for example, be a rose shape with an angular amplitude that is greater than the maximum angular amplitude expected for the object 50, as shown in Figure 7.
[0083] Of course, such a rosette shape is merely exemplary and in no way limiting, and the invention covers any other type of identification pattern 63, such as a star or spiral pattern. Similarly and alternatively, the identification pattern 63 may be identical to the tracking pattern, and thus in this example a Lissajous curve, without departing from the scope of the invention.
[0084] Taking the example of a rose-shaped, i.e., epitrochoidal, pattern 63 as shown in FIG. 7, based on the same principles as described in relation to the Lissajous curve-shaped tracking pattern 61, the identification pattern 63 can follow the following parameter equation:
[0085]
number
[0086] Let β' be a proportionality coefficient, Rmax be the maximum expected dimension of the object 50 in the vertical plane, and θ'0, φ'0 correspond to the angular deviation of the tracking pattern 61 so that the tracking pattern matches the preliminary position of the object 50.
[0087] Considering the distance D, the parametric equation for the tracking pattern can be approximated as follows:
[0088]
number
[0089] Thus, according to this exemplary embodiment of the first variant embodiment, the angular amplitude A' of the identification pattern 63 is a function of the proportionality coefficient β' between the maximum expected dimension Rmax and the preliminary distance D included in the preliminary position of the object 50.
[0090] According to a second variant of the first embodiment, the estimated size of the object 50 may be obtained by imaging a region in the vicinity of a preliminary position of the object 50, the region being larger than the maximum expected size Rmax of the object 50, as shown in Figure 9. This estimated size may be obtained either in step A of identifying the object 50 or in step B of estimating the position of the object 50.
[0091] According to a second variant of the present invention, considering obtaining the estimated dimension by performing step B of estimating the position of the subject 50, estimating step B can include the following substeps, as shown in FIG. 10: (B'1) moving the laser beam by the movement system 20, scanning a spatial region where the object to be tracked is estimated to be located during the movement of the laser beam, and identifying an intersection point between the object 50 and the probe laser beam 60A; (B'2) Determine an estimated position of the object 50 from the point of interception of the laser beam by the identified object 50, the determined position constituting the distance D between the object 50 and the LIDAR device 1, and the estimated dimensions of the object 50 in the vertical plane are also determined from the point of interception of the probe laser beam 60A by the identified object 50.
[0092] According to a third variant of the invention, step A or step B may comprise a sub-step of identifying the type of object 50. Based on this possibility, one or more parameters may be modified based on the identified type of object 50. For example, in the context of this first embodiment, tracking of the drone may be performed by: (1) Micro drones, (2) Unmanned aircraft flying at medium altitudes; or (3) Flying wing type unmanned aircraft, It may be identified as either
[0093] A tracking pattern 61 may then be selected in step C1, which determines the tracking pattern 61 based on the dimensional characteristics and movements expected for the identified drone type.
[0094] Of course, in these first, second and third variants of the invention, the estimated dimensions may be obtained in the context of estimation step B, but a person skilled in the art can modify the methods according to these variants to obtain them in the context of step A of identifying the tracked object without departing from the scope of the invention.
[0095] 11A to 11C show the adaptability of a tracking pattern 61 based on the movement of the object 50 implemented in the method according to the second embodiment.
[0096] The tracking method of this second embodiment differs from the tracking method of the first embodiment in that in sub-step C1 of determining the tracking pattern 61, it is determined based on the movement information of the object 50 determined by executing the previous step C3.
[0097] Thus, according to this second embodiment, in sub-step C3 of determining the position of the object, the direction of movement of the object 50 is determined and, in some cases, the speed of movement is estimated based on the estimated position used in sub-step C1 and the position determined in sub-step C3.
[0098] When step C is performed, n is an integer greater than or equal to 2, and in the case of the nth iteration, in sub-step C1 of determining the tracking pattern, at least one other angular parameter of the tracking pattern is further determined based on the estimated speed of movement of the object 50 determined in step C3 of the n-1th iteration.
[0099] Thus, according to the second embodiment, if the tracking pattern 61 is a Lissajous curve according to the first embodiment, and if the object 50 is considered to be moving along the x-axis, a phase shift φ can be applied between the x-axis and the y-axis of the Lissajous curve as a function of the movement speed. Such a phase shift φ can therefore be an angular correction of the tracking pattern 61 according to the following parametric equation:
[0100]
number
[0101] Let γ be the second proportionality coefficient, V be the estimated moving speed of the object 50, and Vm be the maximum expected speed of the object.
[0102] In addition to the moving speed, the phase shift φ between the x-axis and y-axis of the Lissajous curve may be corrected based on the estimated acceleration of the object 50. For this reason, in the sub-step C3 of determining the position of the object, the estimated acceleration of the object 50 may be further determined.
[0103] 12A-12C, taking into account the velocity estimated by the phase shift, the passing density of the probe laser beam at the desired position of the object 50 can be increased. For a stationary object as shown in FIG. 11A, the tracking pattern 61 does not deform, but for a relatively high speed, as shown in FIG. 11C, the tracking pattern deforms strongly to take into account the expected position of the object.
[0104] Of course, the modifications described below are merely examples, and those skilled in the art may, based on the present disclosure, make different types of modifications to take into account the estimated velocity V of the object 50. In particular, it should be noted that it is fully conceivable that other parameters of the tracking pattern may be determined based only on the estimated direction of movement, or based on an approximate velocity and / or direction of movement, without departing from the scope of the present invention.
[0105] Similarly, according to one possibility of the present invention, it may be envisaged that in the first iteration at least one parameter of the tracking pattern 61 is determined from the estimated movement direction, and in the nth iteration at least one parameter of the tracking pattern 61 is determined from the movement direction and the estimated movement speed, n being an integer greater than or equal to 2.
[0106] According to a modification of this second embodiment shown in Figures 12A-12C, velocity-based adaptation of the tracking pattern 61 may be achieved by changing the pattern type. Thus, in this embodiment and as shown in Figure 12A, the tracking pattern 61 is selected as a Lissajous curve, as described in the first embodiment, for stationary or relatively slow-moving objects. For objects 50 with large movements, as shown in Figures 12B and 12C, the tracking pattern 60 is selected as an epitaxial pattern with an axis of symmetry aligned with the direction of movement of the object 50, with a dot at the center and high beam density at the edges.
[0107] An equation with an example of the deformation based on the axis θ as a function of the velocity V and the proportionality factor δ is expressed as follows:
[0108]
number
[0109] The angular parameters of this epitalocoid curve are determined as a function of the object velocity V so as to maximize the number of echoes.
[0110] Thus, according to a variant of the second embodiment, the parameters of at least one other tracking pattern determined from the estimated direction of movement of the object, being a pattern of one type selected from a predetermined group of patterns and, if a velocity is available, a pattern of one type selected from said predetermined group of patterns based on the estimated direction of movement and / or the estimated velocity of movement V, wherein the group of patterns comprises a Lissajous curve according to the first embodiment and an epitalocoid curve, the axis of symmetry of which is oriented as a function of the direction of movement of the object to be tracked.
[0111] Similarly, in the context of this variant, at least one other parameter of the tracking pattern may be determined from the estimated acceleration of the object 50 .
Claims
1. A method for tracking an object (50) based on the use of a LIDAR device (1), the LIDAR device (1) comprising a laser source (10) for emitting a probe laser beam (60A) and a system (20) for moving the probe laser beam (60A) to redirect the probe laser beam (60A), the method comprising: (A) identifying an object (50) to be tracked; (B) estimating an estimated position of the object (50), the estimated position of the object (50) comprising a distance (D) between the object (50) and the LIDAR device (1); (C) tracking the object (50); Equipped with The step C of tracking the object (50) comprises: (C1) determining a parametric curve tracking pattern (61) through which a probe laser beam (60A) passes, the tracking pattern corresponding to the parametric curve having at least one angular parameter (α) of the parametric curve of the tracking pattern (61) relative to the LIDAR device (1), the at least one angular parameter (α) being determined from the estimated position of the object (50), the tracking pattern having the distance (D) between the object (50) and the LIDAR device (1), the magnitude of the at least one angular parameter (α) of the tracking pattern (61) decreasing as the distance (D) increases and increasing as the distance (D) decreases; (C2) a sub-step of moving the probe laser beam (60A) by a movement system (20), moving the probe laser beam (60A) along the tracking pattern (61) determined in step C1, and identifying an interception point of the object (50) by the probe laser beam (60A) during the movement of the probe laser beam (60A); (C3) determining the estimated position of the object (50) from a point of interception of the probe laser beam (60A) by the identified object (50), the determined estimated position constituting the distance (D) between the object (50) and the LIDAR device (1); Equipped with When the tracking step C is performed, steps C1 to C3 are repeated sequentially and repeatedly, and the estimated position of the object (50) used in step C1 is the estimated position of the object (50) obtained in step B in the first iteration, or the estimated position of the object (50) determined in step C3 in the (n-1)th iteration, where n is an integer greater than or equal to 2, and in the (n-1)th iteration, in sub-step C3 for determining the estimated position of the object (50), a moving direction of the object (50) is further determined based on the estimated position used in sub-step C1 and the estimated position determined in sub-step C3; When step C is executed, in the nth iteration, where n is an integer greater than or equal to 2, in substep C1 of determining the tracking pattern (61), at least one other parameter (φ) of the parametric curve of the tracking pattern (61) is further determined based on the estimated direction of movement of the object (50) determined in step C3 of the n-1th iteration.
2. 2. A method for tracking an object (50) according to claim 1, comprising: In a sub-step C3 of determining the estimated position of the object (50), an estimated velocity (V) of the movement of the object (50) is further determined based on the estimated position used in sub-step C1 and the estimated position determined in sub-step C3, When performing step C, in the nth iteration, where n is an integer greater than or equal to 2, in the substep C1 of determining a tracking pattern (61), at least one other parameter (φ) of the tracking pattern (61) is further determined based on the estimated velocity (V) of the movement of the object (50) determined in step C3 of the n-1th iteration.
3. 3. A method for tracking an object (50) according to claim 2, comprising: Further steps are determined: a sub-step C3 of determining the estimated position of the object (50); and a sub-step C3 of determining an estimated acceleration of the object (50). During execution of step C, in the nth iteration, where n is an integer greater than or equal to 2, at least one other parameter (φ) of the tracking pattern (61) is further determined from the estimated acceleration in the sub-step C1 of determining a tracking pattern (61).
4. A method for tracking an object (50) according to any one of claims 2 to 3, comprising: At least one other parameter of the tracking pattern constitutes a pattern type selected from a group of predefined patterns each corresponding to a type of parametric curve, said pattern type being selected from said group of predefined patterns according to an estimated direction of movement and / or, if available, an estimated velocity of movement (V).
5. A method for tracking an object (50) according to any one of claims 1 to 4, comprising: In one of the steps A of identifying the object (50) and B of estimating the estimated position of the object (50), further determining at least one estimated dimension (R) of the object (50) in a vertical plane that includes the estimated position of the object (50) and is perpendicular to a line passing through the estimated position of the object (50) and the position of the LIDAR device; In a sub-step C1 of determining said tracking pattern (61), at least one angular parameter (α) of said tracking pattern (61) is further determined from said estimated dimension (R).
6. A method for tracking an object (50) according to claim 5, comprising the steps of: The step B of estimating the estimated position of the object (50) comprises: (B1) obtaining an estimated preliminary position of the object (50), the estimated preliminary position including an estimated preliminary distance (D) between the object (50) and a lidar device (1); (B2) determining an identification pattern (63) that includes the estimated preliminary position of the object (50) and that is passed by the probe laser beam (60A) along a vertical plane perpendicular to a line passing through the estimated position of the object (50) and the position of the LIDAR device (1); and determining at least one angular parameter (A') from the estimated preliminary distance (D) between the LIDAR device (1) and the object (50) and the estimated preliminary position of the object (50); (B3) moving the probe laser beam (60A) by the movement system to move the probe laser beam along the identification pattern (63) determined in step B2, and identifying an intersection point between the object (50) and the probe laser beam (60A) during the movement of the probe laser beam; (B4) determining an estimated position of the object (50) from the point of interception of the probe laser beam (60A) by the identified object (50), the estimated position constituting the distance between the object (50) and the LIDAR device (1), and an estimated dimension of the object (50) in the vertical plane is also determined from the point of interception of the probe laser beam (60A) by the identified object (50).
7. A method for tracking an object (50) according to claim 6, comprising the steps of: In step B2 of determining the discrimination pattern (63), the discrimination pattern (63) corresponds to a different type of parametric curve than the tracking pattern determined in step C1.
8. A method for tracking an object (50) according to any one of claims 1 to 6, comprising: The step B of estimating the estimated position of the object (50) comprises: (B'1) moving the probe laser beam (60A) by the movement system (20), scanning a spatial region where the object (50) to be tracked is estimated to be located during the movement of the probe laser beam (60A), and identifying an intersection point between the object (50) and the probe laser beam (60A); (B'2) Determine the estimated position of the object (50) from the point of interception of the probe laser beam (60A) by the identified object (50), the determined estimated position constituting the distance (D) between the object (50) and the LIDAR device (1), and the estimated dimensions of the object (50) in the vertical plane are also determined from the point of interception of the probe laser beam (60A) by the identified object.
9. A system for tracking an object (50) from a lidar device (1), the system comprising: a laser source (10) configured to emit a probe laser beam (60A); a translation system (20) for translating the probe laser beam (60A), configured to redirect the probe laser beam (60A), the laser source (10) and the translation system (20) participating in forming a LIDAR device (1); a control unit (35) for controlling the movement system (20) for moving the probe laser beam (60A); Equipped with The system is characterized in that the control unit (35) is further adapted to carry out at least step C of the tracking method according to any one of claims 1 to 8.
10. 10. A system for tracking an object (50) from a lidar device as recited in claim 9, comprising: the system further comprises at least one imaging device selected from the group consisting of an optical camera and a radar device; The imaging device performs at least step A and provides the necessary instructions to a control unit (35) to enable it to perform step B, the control unit (35) being configured to perform step B of the method.
11. 11. A system for tracking an object (50) from a LIDAR device according to claim 9 or 10, comprising: The system comprises a device for communicating with the control unit (35) that enables an observer who has identified the tracked object according to step A to provide the necessary indications for performing step B, the control unit (35) being configured to perform step B of the method.
Citation Information
Patent Citations
Laser scanning-based object tracking method and device
CN109959939A
Laser radar frequency conversion scanning method based on voice coil motor
CN110865390A
Oscillating two-dimensional scanner
JP2003295102A
Image recognition device, image recognition method, and image recognition program
JP2014048702A
Optical deflection device, light irradiation device, and distance measurement device
JP2016184018A