AUTOMATIC CONTINUOUS ALIGNMENT SYSTEM FOR A PULSE LASER SPOT
The system addresses misalignment issues in pulsed laser alignment by dynamically adjusting laser direction based on detected position, ensuring continuous real-time alignment and live display of laser spots.
Patent Information
- Application Number
- FR2022009429
- Authority / Receiving Office
- FR · FR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-09-19
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2042-09-19
AI Technical Summary
Existing systems fail to provide continuous real-time alignment of pulsed laser signals in infrared wavelengths due to mechanical and opto-mechanical effects, such as thermal stress and dynamic loads, leading to misalignment issues that current alignment methods do not address.
A system comprising a laser source, laser steering unit, laser receiver, camera, image processing unit, and control unit that dynamically aligns the pulsed laser spot by capturing and processing reflected laser signals to maintain alignment in real time, using mechanical and optical elements to adjust the laser direction based on detected position.
The system ensures continuous alignment of pulsed laser spots by dynamically correcting alignment shifts, providing live display of position information, and eliminating the need to reposition aiming marks on different cameras or viewpoints.
Smart Images

Figure 00000014_0000
Abstract
Description
Title of the invention: SYSTEM FOR THE AUTOMATIC CONTINUOUS ALIGNMENT OF A PULSE LASER SPOT
[0001] The invention relates to a system which allows continuous real-time alignment of a pulsed laser signal in the infrared wavelength during the designation period.
[0002] In particular, the invention relates to a system for automatically detecting the position of a pulsed laser signal via a camera which is capable of detecting the wavelength of the laser, and for continuously aligning the laser designation according to the detected position relative to the camera by using a device for aligning the laser.
[0003] Systems comprising both a laser designator and a camera can be used for laser designation of a target that is monitored by a camera. One of the key parameters determining the designation performance in these usage scenarios is the quality of the alignment of the laser signal with the cameras in the same system. It is possible to align the camera and the laser unit in a point alignment process in the factory or in the field. However, mechanical and opto-mechanical effects, such as thermal stresses, static or dynamic loads, pressure difference, etc., can impact the performance of the point laser alignment in the field.
[0004] In the current state of the art, IRCL (short wavelength infrared) or similar infrared cameras are used to display the pulsed or non-pulsed infrared laser mark. However, there is no system for measuring misalignment by capturing the pulsed laser mark in the image.
[0005] When searching the current state of the art, applications US20190215459, CN207752146, CN104780306 and US8400619 were found.
[0006] Application numbered US20190215459 relates to a laser distance measuring system comprising a laser configured to illuminate a target with a laser marker having a specific wavelength. The application mentions that the laser marker is digitally aligned in the field of view of the imaging device having an optical center. Although the application mentions the centering of the laser marker in the image, it does not include any explanation as to the change in the direction of propagation of the beams emitted by the laser.
[0007] Application numbered CN207752146 relates to the automatic adjustment of the propagation path of a coaxial cavity laser. The application does not describe alignment continuous alignment of a laser system, but rather a one-time alignment process. However, the application does not include a system that calculates the misalignment of the laser marker for each laser pulse and performs continuous alignment. In the present invention, the laser is aligned in real time with each shot in the field, but in CN207752146, the alignment is performed once and fixed with an adhesive.
[0008] Application numbered CN104780306 relates to a laser night vision device and a method for aligning light signals at different distances from the center of the field of vision. Although the application mentions centering the laser marker in the image, it does not mention changing the direction of propagation of the beams emitted by the laser and the use of image processing techniques for alignment.
[0009] Application numbered US8400619 relates to systems and methods for target tracking and beam steering. In particular, the application relates to systems and methods for automatically tracking a target by processing a series of video images obtained from the area in which the target is located and automatically guiding the transmission path of the laser beam emitted by the laser rangefinder such that the laser beam falls on the target being tracked. In the application, the laser is assumed to be well aligned and the position of the laser is guided on moving objects using a motorized system. However, the process of receiving feedback on the position of the laser and steering the laser based on this feedback is not performed.
[0010] Therefore, due to the drawbacks described above and the inadequacy of existing solutions on the subject, it has become necessary to make an improvement in the technical field concerned.
[0011] The invention aims to provide continuous alignment of the pulsed laser designation in the infrared wavelength in real time during the designation time. With the invention, instead of printing, on the image, the laser spot detected by the infrared camera, this laser spot is dynamically maintained on the viewfinder without shifting the viewfinder.
[0012] The invention aims to align the position of a pulsed laser spot to be automatically detected by a camera which detects the wavelength of the laser, and to align the laser spot relative to the camera which detects the laser by using a device which directs the laser according to the detected position.
[0013] The invention aims to measure the alignment shift by capturing the pulsed laser signal in the image. Thus, alignment shifts that occur over time can be dynamically corrected.
[0014] The invention aims to eliminate the need to position sighting marks differently on different cameras and different viewpoints, since it directs ac tively the pulsed laser output, unlike the method of shifting the sight according to the laser spot.
[0015] The invention aims to dynamically correct the position of the laser spot and to provide a live display of the position information on the output image.
[0016] The present invention therefore relates to a system for automatically detecting the position of a pulsed laser spot by a camera which is capable of detecting the wavelength of the laser, and for continuously aligning the laser spot with respect to the laser detection camera as a function of the detected position, characterized in that it comprises:
[0017] - a laser source, which is configured to generate the laser spot,
[0018] - a laser steering unit which, by means of mechanical / optical elements contained therein, is configured to angularly modify the direction of the laser spot to form an aligned laser spot,
[0019] - at least one laser receiver, which is configured to capture first and second laser spots reflected from the target,
[0020] - an image processing unit, which is configured to process captured images by the camera to determine the presence and position of the second reflected laser spot in the image,
[0021] - a control unit, which is configured to determine the direction in which the laser spot is to be directed so as to align the second reflected laser spot detected by the image processing unit with the laser spot, and to transmit data on this direction to the laser steering unit.
[0022] According to a particular characteristic of the invention, the laser steering unit is configured to align a laser spot of different wavelengths.
[0023] According to a particular characteristic of the invention, the laser steering unit is configured to mechanically align the laser source, the camera and an optical interface.
[0024] According to a particular characteristic of the invention, the camera is configured to detect a laser spot created by the laser spot aligned on the target.
[0025] According to a particular characteristic of the invention, the system comprises an optical interface configured to form an image, on the camera, of the laser signal information transported by the second reflected laser spot.
[0026] According to a particular feature of the invention, the control unit is configured to provide a connection necessary for the alignment process between the laser steering unit and the image processing unit once the laser spot is captured by the camera and its position is determined by means of the image processing unit.
[0027] According to a particular characteristic of the invention, the system comprises a unit image output configured to transfer images produced by the camera out of the system.
[0028] The detailed description below set forth with reference to the accompanying drawings allows a better understanding of the structural and characteristic properties and all the advantages of the invention; for this reason, the evaluation must be made by taking into consideration these drawings and this detailed description. In these drawings:
[0029] [Fig-1] is a representative view of the system of the invention. Description of reference signs
[0030] 1. Laser source
[0031] 1.1. Laser spot
[0032] 2. Laser steering unit
[0033] 2.1. Aligned laser spot
[0034] 2.2. Propagation medium
[0035] 2.3. Laser spot
[0036] 3. Target
[0037] 3.1. First reflected laser spot (reflected laser spot-1)
[0038] 3.2. Second reflected laser spot (reflected laser spot-2)
[0039] 4. Laser receiver
[0040] 4.1. Optics
[0041] 5. Camera
[0042] 5.1. Optical interface
[0043] 6. Control unit
[0044] 6.1. Laser firing signal
[0045] 6.2. First trigger signal (trigger signal-1)
[0046] 6.3. Timing signal
[0047] 6.4. Second trigger signal (trigger signal-2)
[0048] 6.5. Location determination signal
[0049] 6.6. Alignment signal
[0050] 7. Image processing unit
[0051] 8. Image output unit
[0052] 8.1. Image signal
[0053] In this detailed description, the preferred embodiments of the invention are described solely for the purpose of a better understanding of the subject matter and without any limiting effect.
[0054] The automatic laser alignment system of the invention illustrated in [Fig. 1] generally comprises a laser source 1 which generates a pulsed laser spot, a laser steering unit 2 which guides the direction of the pulsed laser spot using optical and mechanical components, a laser receiver 4 which measures the laser distance, a camera 5 which detects light at the wavelength of the pulsed laser, a control unit 6, an image processing unit 7 and an image output unit 8. With the system in question, the laser designation initiated automatically by the user or by a different machine interface is detected by the camera 5 and the laser spot is continuously aligned with the camera.
[0055] The automatic laser alignment system comprises:
[0056] - a laser source 1 designed to generate the laser spot 1.1,
[0057] - a laser steering unit 2 comprising mechanical / optical elements to direct the laser spot 1.1,
[0058] - at least one laser receiver 4 designed to capture the laser spot-1,2 3.1, 3.2 reflected from target 3,
[0059] - a camera 5 designed to image the target 3 and the reflected laser spot-2 (second reflected laser spot) 3.2,
[0060] - an image processing unit 7 designed to detect the presence and position of the reflected laser spot-2 3.2 in the image by processing images captured by the camera 5,
[0061] - a control unit 6 designed to determine the direction in which the spot laser 1.1 must be directed so as to align the position of the reflected laser spot-2 3.2 detected by the image processing unit 7 with the image acquisition unit and to transmit data on this direction to the laser steering unit 2.
[0062] The laser source 1 generates the laser spot 1.1, which is intended for continuous alignment. Said laser spot 1.1 can be guided by the laser steering unit 2 and aligned to the center or any desired point relative to the center of the laser detection camera 5. The laser spot 1.1 generated by the laser source 1 can be in the form of a continuous or intermittent pulsed laser mark. Said laser spot 1.1 can be in the infrared, visible or ultraviolet band. The laser spot 1.1 can be in the 1064nm or 1540-1570nm band. The laser source 1 can generate the laser spot 1.1 at more than one wavelength. In this case, the laser steering unit 2 can be used to align laser signals of different wavelengths. The laser spot 1.1 can have any divergence value.
[0063] The laser steering unit 2 angularly changes the direction of the laser spot 1.1 generated by the laser source 1. The laser steering unit 2 changes the direction of the laser spot 1.1 at its input into an aligned laser spot 2.1. The laser steering unit 2 is controlled by the control unit 6 for the steering operation. Preferably, the direction change can be achieved by optical, mechanical, opto-mechanical interfaces. The laser steering unit 2 can mechanically align the laser source 1, the camera 5 and the optical interface 5.1. Furthermore, the camera 5, the image processing unit 7 and the image output unit 8 can be aligned by digital conversion operations. The laser steering unit 2 may use one or more prisms to change the direction of the laser spot 1.1. The beam steering operation to be performed by the laser steering unit 2 may be managed by the control unit 6 using similar digital or machine interface instructions, or the mechanical and opto-mechanical units performing the beam steering on the laser steering unit 2 may be directly controlled by the control unit 6. Once the laser steering unit 2 receives the steering instruction from the control unit 6, the alignment information produced by the image processing unit 7 is controlled until the instruction is executed and the aligned laser spot 2.1 reaches the desired output angle.In addition, while the laser steering unit 2 aligns the position of the spot, the phase of the alignment can be controlled by the control unit 6 in real time.
[0064] The aligned laser spot 2.1 is the laser spot 1.1 generated by the laser source 1 and aligned by the laser steering unit 2. The aligned laser spot 2.1 reaches the target 3 by passing through the determined propagation medium 2.2 (atmosphere). The aligned laser spot 2.1 can have any divergence value.
[0065] The propagation medium 2.2 is the medium through which the aligned laser beam 2.1 travels to the target 3 while the reflected laser spot 2.3 travels to the optics 4.1 and the optical interface 5.1. The propagation medium 2.2 has a disturbing effect on the aligned laser spot 2.1, the reflected laser spot-1 (first reflected laser spot) 3.1 and the reflected laser spot-2 (second reflected laser spot) 3.2.
[0066] The laser spot 2.3 is the mark left by the aligned laser spot 2.1 on the target 3 and detected by the camera 5. The size of the laser spot 2.3 increases proportionally to the divergence value of the aligned laser spot 2.1, but its brightness decreases proportionally to the square of the divergence value. The brightness of the laser spot 2.3 decreases with the distance between the laser steering unit 2 and the target 3 due to the distortion effect from the propagation medium 2.2.
[0067] Target 3 is where the aligned laser spot 2.1 creates a laser spot 2.3. The brightness of the laser spot 2.3 varies depending on the response of the target 3 and the propagation medium 2.2 to the wavelength.
[0068] The reflected laser spot-1 3.1 is the part of the reflection coming from the laser spot 2.3 which reaches optics 4.1.
[0069] The reflected laser spot-2 3.2 is the part of the reflection from the laser spot 2.3 that reaches the optical interface 5.1. The amount of energy carried by the reflected laser spot-2 3.2 is a key performance criterion for the operation of the automatic laser alignment system of the invention. The amount of energy carried by the reflected laser spot-2 3.2 is related to the amount of energy of the aligned laser spot-2 2.1, its divergence value, the distance traveled in the medium of propagation 2.2, its transmittance in the propagation medium 2.2, the reflectivity of the target 3 for the aligned laser spot-2 2.1, the size of the optical interface 5.1, the f# value (f-number, also called aperture number), the transmittance for the reflected laser spot-2 3.2, the filtering power of the optical interface 5.1 for the wavelength range outside the propagation medium 2.2.
[0070] The laser receiver 4 uses the link between the laser pulse coming from the laser source 1 and the laser reflection coming from the laser receiver 4 to determine the distance between the system of the invention and the laser receiver 4.
[0071] The optics 4.1 focus the reflected laser spot-1 3.1 which comes from the laser beam 2.3 onto the laser receiver 4.
[0072] The camera 5 is a system that converts the laser signal information, which is reflected from the laser spot 2.3 and reaches the optical interface 5.1 as the reflected laser spot-2 3.2, into an image. The laser detection camera 5 is equipped to detect the wavelength of the laser spot 1.1 produced by the laser source 1. If the laser spot 1.1 is in the infrared band or in the range of 1064 nm or 1540-1570 nm, an IRCL camera 5 can be used. The integration time start point and the integration time interval of the camera 5 are controlled by the control unit 6 separately for each laser pulse. It is important that the integration time of camera 5 is as short as possible to detect the pulsed laser signal without missing it so as to eliminate the background image and improve the signal-to-noise ratio (SNR) value.For this reason, the integration time of the camera 5 can be limited to the entire time of flight of the pulsed laser shot, or the arrival time of the reflected laser spot-2 3.2 can be estimated based on the target distance information obtained from the laser receiver 4 in previous shots, and this estimation can be used to shift or shorten the integration time. By predicting the arrival time of the reflected laser spot-2 3.2, a shorter integration time can be achieved and the dominance of the laser signal in the entire scene can be increased.
[0073] The synchronization between the control unit 6 and the camera 5 may be such that the integration time of each pulse may be offset. The camera 5 may operate at any frames / second (fps) value. The camera 5 may operate with a fixed or variable integration time. The camera 5 may be used such that the normal scene image is taken between the image frames to be generated for the detection of laser pulses.
[0074] The optical interface 5.1 captures the laser signal information carried by the reflected laser spot-2 3.2 to form an image on the camera 5. The optical interface 5.1 may include one or more lenses and may include one or more filters. The filter on the optical interface 5.1 may pass or block the range of wavelengths of the reflected laser spot-2 3.2 or other wavelength ranges at certain rates. The filter on the optical interface 5.1 may be located directly in front of the light detection sensor on the reflected laser spot-2 3.2, between the lenses in the optical component or in front of the optical components. The filter in the optical interface 5.1 may be moved by any electrical mechanism, by a hand-operated lever or by an electrical control, or it may be fixed. The viewing angle is provided by the camera 5 and the optical interface 5.1. One or more polarizing filters, preferably fixed or rotatable, may be used in the optical interface 5.1. Said polarizing filter may be rotated manually, by means of a motorized system or by other means, or its polarization may be controlled by means of an electrical signal.
[0075] The control unit 6 provides logic and control operations as well as synchronization between functional units. The camera 5 provides synchronization between the laser source 1 and the camera 5 so that the image of the camera 5 can be detected in the scene where the laser is present. Once the laser spot 2.3 is captured by the camera 5 and its position is determined by the image processing unit 7, it provides the necessary link between the laser steering unit 2 and the image processing unit 7 for the alignment process.
[0076] The laser firing signal 6.1 is the signal sent to the laser source 1. Preferably, it can be sent via the control unit 6. The delay between the laser firing signal 6.1 and the trigger-1 signal (first trigger signal) 6.2 can be fixed, variable or a function of the signal from the laser receiver 4. The laser firing signal 6.1 can be a serial, parallel or discrete signal for each pulse, or it can be a single instruction that triggers the pulse with a certain frequency.
[0077] Trigger signal-1 6.2 is the signal generated to trigger the integration time of the camera 5 using the laser shot. This signal may be generated by the laser source 1 or by another unit or receiver that detects that the laser source 1 is about to fire or has fired. It may occur before, during, or after the generation of the laser spot 1.1. Trigger signal-1 6.2 may be a discrete signal indicating the laser pulse, or a serial or parallel digital signal that provides the laser pulse information according to another timing. Trigger signal-1 6.2 carries delay information from the laser receiver 4.
[0078] The timing signal 6.3 is the signal from the camera 5 indicating the time at which the laser signal must be received such that the laser signal falls within the integration time. This signal may be generated by the laser source 1 or the control unit 6, or by another unit or receiver which detects that the source laser 1 is about to fire or has fired. The timing of the timing signal 6.3 is shifted based on the laser delay information obtained using the laser receiver 4 during previous laser shots. The timing signal 6.3 may be generated immediately upon receipt of the trigger-1 signal 6.2 or with a delay. The timing signal 6.3 and the trigger-1 signal 6.2 may be the same signal in hardware. The timing signal 6.3 may be a fixed-duration signal or it may contain the integration time of the camera 5. The trigger-1 signal 6.2 may be a discrete signal indicating the laser pulse or a serial or parallel digital signal that provides the laser pulse information based on a different timing. If it is necessary to take more than one image frame to find the laser spot, the timing signal 6.3 can be triggered more than once or camera 5 can be triggered to take more than one image.
[0079] Trigger signal-2 (second trigger signal) 6.4 is the signal used for image processing unit 7 to operate simultaneously with the camera. Trigger signal-2 6.4 informs image processing unit 7 of the presence of a laser signal in the next image frame and triggers image processing unit 7 to perform logic operations to find the laser signal. Trigger signal-2 6.4 may be generated by control unit 6 or laser source 1. Trigger signal-2 6.4 may be generated upon receipt of trigger signal-1 6.2 or with a delay. Trigger signal-2 6.4 may be the same signal as trigger signal-1 6.2 in hardware. If more than one image frame is to be taken to find the laser spot 1.1, trigger signal-2 6.4 can operate more than once or trigger the camera 5 and the image processing unit 7 to take more than one image.
[0080] The location determination signal 6.5 comprises the position information of the laser spot 2.3 from the image processing unit 7 relative to the camera 5. The position information may be given with reference to the line of sight, the center or any other point of the camera 5. The position determination signal 6.5 may be a digital signal representing the whole image frame or a part of the image, or it may be a signal giving only position information.
[0081] The alignment signal 6.6 is the signal transmitted from the position determination signal 6.5 to the laser receiver 4, which aligns the laser spot 1.1 with the laser alignment requirement. From the alignment signal 6.6, the angular correction of the aligned laser spot 2.1 according to the received information is provided and the laser spot 2.3 is brought into the desired alignment with respect to the camera 5. If necessary, a discrete or digital serial or parallel signal can be transmitted from the laser steering unit 2 to the control unit 6 indicating that the instruction alignment has been executed or is in progress. The aforementioned discrete signal may wait for the triggering of the trigger-2 signal 6.4 or the timer signal 6.3. The alignment signal 6.6 may be generated immediately upon receipt of the position determination signal 6.5 or with some delay or filtering. The alignment signal 6.6 may be the same signal as the position determination signal 6.5 in hardware.
[0082] The image processing unit 7, when triggered by the trigger signal-2 6.4, searches for the presence and position of the laser spot 1.1 in the image from the camera 5 and transmits the position information to the control unit 6 for alignment of the laser steering unit 2. The image processing unit 7 uses one or more images from the camera 5 to find the incoming laser spot 1.1. The image processing unit 7 may also use the entire image from the camera 5, or the central part or another part of the image to find the laser spot 1.1.The image processing unit 7 performs digital operations such as panning, zooming in or out, subtracting from another image, adding, multiplying, cropping, sharpening, optimizing, convolving different filters with the image, passing different filters through a window, filtering the results, etc. for the image from the camera 5. The image processing unit 7 may have its own hardware, or it may operate in the same hardware as the laser source 1, the laser steering unit 2, the camera 5, the image processing unit 7, and the image output unit 8. Furthermore, the system of the invention may operate in different hardware inside or outside the system.The image processing unit 7 may print a test pattern or other symbology on the incoming image and, when necessary, it may shift the test pattern printed on the image based on the information produced by the position determination signal 6.5.
[0083] The image output unit 8 is the unit where the images produced by the camera 5 or other receivers are transferred out of the system. The image output unit 8 may be a unit operating on the same hardware as the image processing unit 7. The image output unit 8 may combine the image of the camera 5 from the image processing unit 7 with a different image.
[0084] The image signal 8.1 constitutes the image information originating from the image output unit 8 and sent outside the system of the invention. The output image may be carried by a digital, analog, serial, parallel or any other signal, or it may be transferred outside the system by a monitor, a digital or any other method, a memory recording, a wired or wireless data link, a wireless communication, an optical fiber communication, a radio signal, a projection, a printer, a scanning device, a monocular, binocular, or any other equipment or method.
[0085] The system of the invention may preferably comprise a camera system 5 that detects one or more different wavelengths, and laser designation or pointing units that emit a pulsed or continuous laser at one or more different wavelengths. The automatic laser alignment system may be part of a larger system or used as a ground-mounted system or on a mobile platform. However, it may also be a handheld system, guided by a gimbal or pan-tilt, or controlled by a line-of-sight mirror.
Claims
Claims
1. System for automatically detecting the position of a pulsed laser spot (1.1) by a camera (5) which is capable of detecting the wavelength of the laser, and for continuously aligning the laser spot (1.1) with respect to the laser detection camera (5) as a function of the detected position, characterized in that it comprises: - a laser source (1), which is configured to generate the laser spot (1.1), - a laser steering unit (2) which, by means of mechanical / optical elements contained therein, is configured to angularly change the direction of the laser spot (1.1) to form an aligned laser spot (2.1), - at least one laser receiver (4), which is configured to capture first and second reflected laser spots (3.1, 3.2) from the target (3), - an image processing unit (7), which is configured to process images captured by the camera (5) to determine the presence and position of the second reflected laser spot (3.2) in the image, - a control unit (6), which is configured to determine the direction in which the laser spot (1.1) is to be directed so as to align the second reflected laser spot (3.2) detected by the image processing unit (7) with the laser spot (1.1), and to transmit data on this direction to the laser steering unit (2).
2. System according to claim 1, characterized in that the laser steering unit (2) is configured to align a laser spot (1.1) of different wavelengths.
3. System according to claim 1, characterized in that the laser steering unit (2) is configured to mechanically align the laser source (1), the camera (5) and an optical interface (5.1).
4. System according to claim 1, characterized in that the camera (5) is configured to detect a laser spot (2.3) created by the aligned laser spot (2.1) on the target (3).
5. System according to claim 1, characterized in that it comprises an optical interface (5.1) configured to form an image, on the camera (5), of the laser signal information carried by the second reflected laser spot (3.2).
6. System according to claim 1, characterized in that the unit of
7. control (6) is configured to provide a connection necessary for the alignment process between the laser steering unit (2) and the image processing unit (7) once the laser spot (2.3) is captured by the camera (5) and its position is determined by means of the image processing unit (7). System according to claim 1, characterized in that it comprises an image output unit (8) configured to transfer images produced by the camera (5) out of the system.
