An integrated measurement device and method for image stabilization and flyback measurement of an optoelectronic pod

Abstract

The present invention discloses an integrated measurement device and method for image stabilization and retracement of an optoelectronic pod, and relates to the technical field of optoelectronic pods for aircraft. The method includes: obtaining the rotation angle of the optoelectronic pod within a time interval in a working state, and calculating the rotation angular velocity of the optoelectronic pod within a time interval; establishing an active stabilization control model, and when the rotation angular velocity within the time interval of the optoelectronic pod is less than a set value, adjusting the optical axis position of the binocular camera through the inertial element of the optoelectronic pod to capture the target object. The present invention establishes an active stabilization control model, divides the time interval into multiple intervals, and while the aircraft or optoelectronic pod is rotating, the binocular camera is synchronously rotated in the opposite direction to ensure that the target object can be captured by the binocular camera in each interval, thereby achieving the purpose of quickly capturing the target object, improving the tracking accuracy of the aircraft, and enabling the aircraft to effectively track the target.

Description

Technical Field

[0001] The invention relates to the technical field of aircraft optoelectronic pods, and in particular to an optoelectronic pod image stabilization and retrace integrated measurement device and a measurement method. Background Art

[0002] Image acquisition technology is the most commonly used reconnaissance technology on unmanned reconnaissance aircraft. As the implementation carrier of image acquisition technology for unmanned reconnaissance aircraft, optoelectronic pods have been widely used on drones. Their imaging accuracy directly affects the quality of mission achievement of unmanned reconnaissance aircraft.

[0003] For example, the Chinese invention patent, application announcement number CN108107934A discloses a multi-level image stabilization / return composite control system for an optoelectronic pod, which is composed of a six-degree-of-freedom vibration isolation device, an image stabilization control device, an image stabilization return device and an optoelectronic pod. It can realize vibration isolation / suppression multi-level image stabilization control and large-range return of the optoelectronic pod, effectively improving the imaging accuracy of the optoelectronic pod.

[0004] Another example is the Chinese invention patent, application announcement number CN108088373A discloses an integrated control device and measurement method for an optoelectronic pod image stabilization and retracement, which uses a voice coil motor as a driving device, and the aperture and rotation angle of the reflector are significantly increased; compared with the general two-dimensional electrically adjustable line of sight stabilization system, the device has a simple structure and a light weight, and the rotation angle of the reflector around the X-axis is larger than that of a general symmetrical arrangement.

[0005] The above-mentioned scheme and the prior art solve the problem that the visual axis of the optical instrument in the pod deviates from the expected spatial inertial direction due to wind resistance torque and large-load maneuvers during flight, thereby causing the optical system in the optoelectronic pod to shake, affecting the clarity and visual effect of the imaging. However, in practical applications, the prior art still has some problems.

[0006] For example, when an aircraft is tracking a target, when the aircraft passes through a valley, a bridge, or a gap between adjacent buildings, the aircraft may be affected by crosswinds and produce a large rotation angle and rotation angular velocity deflection. However, adjusting the binocular camera optical axis position through the inertial elements of the optoelectronic pod is not convenient for quickly capturing the target, which will not only reduce the tracking accuracy of the aircraft, but may also make the aircraft unable to accurately reach the designated position or effectively track the target. Summary of the invention

[0007] The object of the present invention is to provide an integrated measurement device and method for image stabilization and retracement of an optoelectronic pod, so as to solve the problems raised in the above-mentioned background technology.

[0008] To achieve the above object, the present invention provides the following technical solution: an integrated measurement method for photoelectric pod image stabilization and retrace, comprising:

[0009] Obtain the rotation angle of the optoelectronic pod within the time interval in the working state, and calculate the rotation angular velocity of the optoelectronic pod within the time interval;

[0010] An active stabilization control model is established. When the angular velocity of the optoelectronic pod is less than the set value within a time interval, the optical axis position of the binocular camera is adjusted through the inertial element of the optoelectronic pod to capture the target object.

[0011] When the angular velocity of the optoelectronic pod during the time interval is greater than the set value, the optical axis position of the binocular camera is adjusted through the active stabilization control model to capture the target object;

[0012] The image information recorded by the binocular camera of the optoelectronic pod is obtained, and the image information taken by the binocular camera at the same time is synthesized to obtain the distance information between the target object and the binocular camera;

[0013] Obtain the angle information between the binocular camera and the target object after each time interval, and adjust the optical axis angle of the binocular camera through the inertial element of the optoelectronic pod so that the extended line of the binocular camera optical axis intersects with the target object;

[0014] The position of the laser beam is measured through the compensation system, and the angle of the laser beam is adjusted to achieve rapid capture of the target object.

[0015] Furthermore, the specific method for obtaining the target object distance information is:

[0016] The first camera is used to capture a visible light image of the target object, and the second camera is used to capture an infrared light image of the target object;

[0017] Extracting a brightness classification image of the visible light image and a gray component image of the infrared light image, and extracting feature points of the visible light image and the infrared light image based on the brightness classification image of the visible light image and the gray component image of the infrared light image;

[0018] Compare the feature points in the two pictures, find the matching feature points that appear in both images, calculate the disparity of the matching feature points in the two images, calculate the coordinates of the matching feature points in three-dimensional space, obtain the depth information of the matching feature points through the depth component of the three-dimensional coordinates, and then obtain the distance between the target object and the binocular camera.

[0019] Furthermore, the specific method of establishing the active stability control model is:

[0020] A two-dimensional coordinate system of the optoelectronic pod is established according to the moving direction of the optoelectronic pod and the direction perpendicular to the moving direction, and the two-dimensional coordinate system is updated in real time according to the moving position of the optoelectronic pod;

[0021] When the rotation angle of the optoelectronic pod within the time interval is greater than the set value, the two-dimensional coordinate system is not updated within the optoelectronic pod rotation time;

[0022] The binocular camera angle is adjusted in the opposite direction, and the adjustment angle of the binocular camera adjusted in the opposite direction is equal to the rotation angle of the optoelectronic pod, wherein the angle adjustment speed of the binocular camera within the time interval is equal to the rotation angular speed of the optoelectronic pod within the time interval;

[0023] After adjusting the binocular camera angle in the opposite direction, the position of the camera is fine-tuned through the inertial element of the optoelectronic pod until the extended line of the binocular camera optical axis is parallel to the original binocular camera optical axis direction in the optoelectronic pod two-dimensional coordinate system.

[0024] Furthermore, the method also includes establishing a regression model;

[0025] The specific method of establishing the regression model is to obtain the test inertial deflection of the optoelectronic pod under different test angular velocities of the binocular camera, and obtain a test angular velocity set and a test inertial deflection set;

[0026] The test angular velocity and the test inertial deflection are marked on the horizontal and vertical axes respectively, and then a linear function is used as the objective function to fit a straight line;

[0027] The rotation angular velocity of the optoelectronic pod in the time interval under the working state is brought into the horizontal coordinate to obtain the actual inertial deflection of the optoelectronic pod;

[0028] The actual angle of the binocular camera is obtained by subtracting the reverse adjustment amount of the binocular camera angle from the actual inertial deflection amount.

[0029] Furthermore, the specific method of establishing the regression model also includes:

[0030] When the angular velocity of the photoelectric pod's rotation within the time interval is greater than the set value, the position of the photoelectric pod is taken as the origin, and the deviation position coordinates of the deflected photoelectric pod are obtained based on the established two-dimensional coordinate system, and the initial moving speed of the photoelectric pod is obtained. According to vector calculation, the rotation angle and speed of the deflected photoelectric pod re-entering the two-dimensional coordinate system within the set time are obtained.

[0031] Furthermore, the method for obtaining the angle information between the binocular camera and the target object after each time interval is:

[0032] The inclination angle between the binocular camera and the target object is measured, and the inclination angle between the binocular camera and the target object just before the optoelectronic pod rotates is saved to obtain a first inclination angle;

[0033] Get the moving speed of the photoelectric pod and calculate the moving distance of the photoelectric pod in each interval.

[0034] Retrieve the distance between the binocular camera and the target object at the moment before the optoelectronic pod rotates. After calculating the first interval time, obtain the distance between the binocular camera and the target object and the second inclination angle, where the second inclination angle is the angle to be adjusted for the optical axis angle of the binocular camera after the first interval time;

[0035] Repeat the calculation to obtain several angles to be adjusted for the optical axis angle of the binocular camera in the order of the interval time.

[0036] Furthermore, the compensation system includes:

[0037] A lens assembly that captures and focuses the light reflected by the target object to form a natural light beam;

[0038] A calibration unit that emits a laser beam through a laser head and adjusts the position of the laser head through an adjustment member of the calibration unit to make the laser beam parallel to the natural light beam;

[0039] A separation unit that captures the natural light beam and reflects the laser beam;

[0040] A detection unit that senses and forms an image of the natural light beam through its photosensitive surface, calculates the deviation distance between the formed image and the center of the photosensitive surface, and controls the adjustment member of the calibration unit to adjust the position of the laser to make the laser beam parallel to the natural light beam;

[0041] An induction unit, where the imaging point of the visual axis is located at the center of the induction unit, and is used to detect the angular deviation between the laser beam and the visual axis;

[0042] A stable image regression unit that adjusts the reflection angle of the laser beam;

[0043] A control unit that is used to receive the information on the angular deviation between the detected laser beam and the visual axis, then converts the angular deviation information into an electrical signal, and is used to control the operation of the stable image regression unit to adjust the reflection angle of the laser beam to make the laser beam parallel to the visual axis.

[0044] An optoelectronic pod stable image and backscanning integrated measurement device is applied to an optoelectronic pod stable image and backscanning integrated measurement method.

[0045] Compared with the prior art, the beneficial effects of the present invention are:

[0046] The optoelectronic pod stable image and backscanning integrated measurement device and measurement method, by establishing an active stability control model, dividing multiple interval times, while the aircraft or the optoelectronic pod is rotating, synchronously rotating the binocular camera in the opposite direction at the same frequency, ensuring that the target object can be captured by the binocular camera within each interval time, achieving the purpose of quickly capturing the target object, improving the tracking accuracy of the aircraft, and enabling the aircraft to effectively track the target.

[0047] Meanwhile, during the flight of the aircraft or optoelectronics, vibrations will occur. When rotating, the natural light beam reflected by the target is not coaxial with the optical axis of the binocular camera, resulting in poor visual axis stability and affecting the system tracking accuracy. In this solution, the compensation system measures the position of the laser beam and adjusts the angle of the laser beam to achieve rapid target acquisition.

[0048] In addition, linear fitting is performed on the measured angular velocity and measured inertial deflection amount, and the actual angular amount of the binocular camera within the time interval is obtained through relevant calculations. This solution takes into account the time interval between the rotation of the aircraft or optoelectronic pod and the reverse rotation of the binocular camera, which causes a certain inertial deflection amount of the aircraft or optoelectronic pod, preventing excessive adjustment of the binocular camera and further improving the tracking accuracy of the aircraft.

[0049] In addition, the initial moving speed of the optoelectronic pod is obtained, and according to vector operations, the rotation angle and speed of the deflected optoelectronic pod re-entering the two-dimensional coordinate system within the set time can be obtained. The aircraft can be readjusted to the x-axis of the two-dimensional coordinate system within the set time, which can prevent the tracking accuracy from being reduced due to route deviation. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1 is a flowchart of the present invention;

[0051] Figure 2 is a schematic diagram of obtaining the angle information between the binocular camera and the target after each time interval according to the present invention;

[0052] Figure 3 is a compensation system diagram of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0053] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0054] Figure 1The flowchart of the present invention provides a technical solution: an integrated photoelectric pod image stabilization and retrace measurement device and a measurement method, comprising: obtaining the rotation angle of the photoelectric pod fixedly connected to the bottom of the aircraft in a working state within a time interval, and then calculating the rotation angular velocity of the photoelectric pod within the time interval. The rotation angle can be obtained by an angle sensor installed inside / outside the aircraft or the photoelectric pod, or by a gyroscope installed inside the aircraft or the photoelectric pod, wherein the interval time is 0.1-0.3s. In this solution, the preferred interval time is 0.2s. For example, within 0.2s, the rotation angle of the photoelectric pod is 1°, then, expressed in degrees, the rotation angular velocity within the time interval is 1° / 0.2s. It can be known that after being affected by crosswind, the aircraft can be stabilized through its own automatic stabilization system or manual operation, so its rotation angular velocity may be different within different time intervals.

[0055] An active stability control model is established. When the rotation angular velocity of the optoelectronic pod within a time interval is less than a set value, the optical axis position of the binocular camera is adjusted through the inertial element of the optoelectronic pod to capture the target object. The set value is a safe rotation angular velocity value set by the technician. That is, under this set value, the binocular camera can slowly adjust the optical axis position of the binocular camera through the inertial element without leaving the target object to lock the specific position of the target object.

[0056] When the angular velocity of the optoelectronic pod during the time interval is greater than the set value, the optical axis position of the binocular camera is adjusted through the active stabilization control model to capture the target object.

[0057] Among them, the specific method of establishing the active stability control model is:

[0058] A two-dimensional coordinate system of the optoelectronic pod is established according to the moving direction of the optoelectronic pod and the direction perpendicular to the moving direction. The two-dimensional coordinate system is updated in real time according to the moving position of the optoelectronic pod. The moving direction of the optoelectronic pod is the flight path of the aircraft, which is set as the x-axis. The path is parallel to the ground, and the direction perpendicular to the moving direction is set as the y-axis. The intersection of the x-axis and the y-axis in the two-dimensional coordinate system is located at the center of the aircraft or the optoelectronic pod. The update time of the two-dimensional coordinate system can be set to 1-5s.

[0059] When the rotation angle of the optoelectronic pod within the time interval is greater than the set value, the two-dimensional coordinate system will not be updated during the rotation time of the optoelectronic pod, that is, if the rotation angle duration of the aircraft or optoelectronic pod is 5s, then the x-axis and y-axis of the two-dimensional coordinate system are constant from before the start of rotation to the 5s of the rotation angle duration. In this way, the position of the aircraft or optoelectronic pod at the beginning of rotation is the coordinate origin. After 5s, a new two-dimensional coordinate system is reset according to the flight path of the aircraft.

[0060] The binocular camera angle is adjusted in the opposite direction, and the adjustment angle of the binocular camera adjusted in the opposite direction is equal to the rotation angle of the optoelectronic pod, wherein the angle adjustment speed of the binocular camera within the time interval is equal to the rotation angular speed of the optoelectronic pod within the time interval;

[0061] After adjusting the binocular camera angle in the opposite direction, the position of the camera is fine-tuned through the inertial element of the optoelectronic pod until the extension line of the binocular camera optical axis is parallel to the original binocular camera optical axis direction in the optoelectronic pod two-dimensional coordinate system. It can be understood that the purpose of fine-tuning is to eliminate the error caused by vibration of the aircraft during flight. The device for fine-tuning can be a brushless motor with fast response speed and capable of completing forward and reverse rotation within 0.02 seconds.

[0062] The image information recorded by the binocular camera of the optoelectronic pod is obtained, and the image information taken by the binocular camera at the same time is synthesized to obtain the distance information between the target object and the binocular camera;

[0063] Specifically, the specific method for obtaining the target object distance information is:

[0064] The first camera is used to capture a visible light image of the target object, and the second camera is used to capture an infrared light image of the target object.

[0065] The brightness classification image of the visible light image is extracted by a color image processor and the grayscale component image of the infrared light image is extracted by a black and white image processor. Based on the brightness classification image of the visible light image and the grayscale component image of the infrared light image, feature points of the visible light image and the infrared light image are extracted.

[0066] Compare the feature points in the two pictures, find the matching feature points that appear in both images, calculate the disparity of the matching feature points in the two images, calculate the coordinates of the matching feature points in three-dimensional space, obtain the depth information of the matching feature points through the depth component of the three-dimensional coordinates, and then obtain the distance between the target object and the binocular camera.

[0067] The angle information between the binocular camera and the target object is obtained after each time interval, and the optical axis angle of the binocular camera is adjusted by the inertial element of the optoelectronic pod so that the extended line of the binocular camera optical axis intersects with the target object.

[0068] Specifically, Figure 2 As shown, the method for obtaining the angle information between the binocular camera and the target object after each time interval is:

[0069] Measure the inclination angle between the binocular camera and the target object, save the inclination angle between the binocular camera and the target object at the moment before the optoelectronic pod rotates to obtain the first inclination angle a1, obtain the moving speed of the optoelectronic pod, calculate the moving distance L1 of the optoelectronic pod within each interval time, retrieve the distance L2 between the binocular camera and the target object at the moment before the optoelectronic pod rotates, and calculate the distance L3 between the binocular camera and the target object and the second inclination angle a2 after the first interval time. Among them, the second inclination angle a2 is the angle to be adjusted for the optical axis angle of the binocular camera after the first interval time;

[0070] Repeat the calculation to obtain several angles to be adjusted for the optical axis angle of the binocular camera in the order of the interval time. It can be seen from Figure 2 that as the interval time increases, the angle to be adjusted for the optical axis of the binocular camera to be adjusted also increases. The staff can set the rotation speed of the servo motor within different interval times in the system, so as to track the target object within the same adjustment time.

[0071] In summary, this device divides multiple interval times. While the aircraft or the optoelectronic pod is rotating, the binocular camera is rotated synchronously at a frequency in the opposite direction to ensure that the target object can be captured by the binocular camera within each interval time, achieving the purpose of quickly capturing the target object, improving the tracking accuracy of the aircraft, and enabling the aircraft to effectively track the target.

[0072] In addition, vibrations will occur during the flight of the aircraft or the optoelectronic device. When rotating, the natural light beam reflected by the target object is not parallel to the optical axis of the binocular camera, resulting in poor visual axis stability and affecting the system tracking and aiming accuracy. This solution measures the position of the laser beam through the compensation system and adjusts the angle of the laser beam to achieve rapid capture of the target object.

[0073] Specifically, as Figure 3 shown, the compensation system includes:

[0074] A lens assembly that captures and focuses the light reflected by the target object to form a natural light beam;

[0075] A calibration unit that emits a laser beam through a laser head and adjusts the position of the laser head through an adjusting member of the calibration unit to make the laser beam parallel to the natural light beam;

[0076] A separation unit that captures the natural light beam and reflects the laser beam;

[0077] A detection unit that senses and images the natural light beam through its photosensitive surface, calculates the deviation distance between the imaged image and the center of the photosensitive surface, and controls the adjusting member of the calibration unit to adjust the position of the laser to make the laser beam parallel to the natural light beam;

[0078] An induction unit, where the imaging point of the line of sight is located at the center of the induction unit, for detecting the angular deviation between the laser beam and the line of sight;

[0079] An image stabilization regression unit for adjusting the reflection angle of the laser beam;

[0080] A control unit for receiving the information on the angular deviation between the detected laser beam and the line of sight, and then converting the angular deviation information into an electrical signal for controlling the operation of the image stabilization regression unit to adjust the reflection angle of the laser beam so that the laser beam is parallel to the line of sight.

[0081] In another specific embodiment of this solution, the method further includes establishing a regression model. The specific method for establishing the regression model is to obtain the test inertial deflection amounts of the optoelectronic pod at different test angular velocities of the binocular camera, obtaining a set of test angular velocities and a set of test inertial deflection amounts;

[0082] Mark the test angular velocity and the test inertial deflection amount on the abscissa and ordinate respectively, and then fit a straight line with a linear function as the objective function. Substitute the rotational angular velocity of the optoelectronic pod within the time interval in the working state into the abscissa to obtain the actual inertial deflection amount of the optoelectronic pod;

[0083] Subtract the reverse adjustment amount of the angle of the binocular camera within the time interval from the actual inertial deflection amount to obtain the actual angle amount of the binocular camera within the corresponding time interval. It can be understood that such a setting takes into account the time interval between the rotation of the aircraft or the optoelectronic pod and the reverse rotation of the binocular camera (after the rotation of the aircraft or the optoelectronic pod stops, the binocular camera is still rotating), resulting in a certain inertial deflection amount of the aircraft or the optoelectronic pod, preventing excessive adjustment of the binocular camera and further improving the tracking accuracy of the aircraft.

[0084] In another specific embodiment of this solution, the specific method for establishing the regression model further includes:

[0085] When the rotational angular velocity of the optoelectronic pod within the time interval is greater than the set value, with the position of the optoelectronic pod as the origin, obtain the deviation position coordinates of the deflected optoelectronic pod based on the established two-dimensional coordinate system, obtain the initial moving speed of the optoelectronic pod, and obtain the rotation angle and speed of the deflected optoelectronic pod re-entering the two-dimensional coordinate system within the set time according to vector operations. It can be understood that such a setting takes into account that the aircraft or the optoelectronic pod deviates from the x-axis (flight direction) of the two-dimensional coordinate system while deflecting. To prevent the tracking accuracy from being reduced due to route deviation, the aircraft can be readjusted to the x-axis (flight direction) of the two-dimensional coordinate system within the set time, such as 2s, 3s, or 4s.

[0086] The photoelectric pod image stabilization and retrace integrated measurement device is applied to the photoelectric pod image stabilization and retrace integrated measurement method, including:

[0087] A data storage module stores the rotation angle of the optoelectronic pod within the time interval under the working state, stores the image information captured by the binocular camera of the optoelectronic pod, and stores the angle information between the binocular camera and the target object after each time interval;

[0088] Active stabilization control model: when the angular velocity of the optoelectronic pod is less than the set value within the time interval, the optical axis position of the binocular camera is adjusted by the inertial element of the optoelectronic pod to capture the target object; when the angular velocity of the optoelectronic pod is greater than the set value within the time interval, the optical axis position of the binocular camera is adjusted by the active stabilization control model to capture the target object;

[0089] The data processing module calculates the rotation angular velocity of the optoelectronic pod within the time interval and synthesizes the image information taken by the binocular camera at the same time to obtain the distance information between the target object and the binocular camera;

[0090] The compensation system measures the position of the laser beam and adjusts the angle of the laser beam to quickly capture the target.

[0091] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is limited by the attached embodiments and their equivalents.

Claims

1. An integrated measurement method for photoelectric pod image stabilization and retrace, characterized in that: include: Obtain the rotation angle of the optoelectronic pod within the time interval in the working state, and calculate the rotation angular velocity of the optoelectronic pod within the time interval; An active stabilization control model is established. When the angular velocity of the optoelectronic pod is less than the set value within a time interval, the optical axis position of the binocular camera is adjusted through the inertial element of the optoelectronic pod to capture the target object. The specific method of establishing the active stability control model is: A two-dimensional coordinate system of the optoelectronic pod is established according to the moving direction of the optoelectronic pod and the direction perpendicular to the moving direction, and the two-dimensional coordinate system is updated in real time according to the moving position of the optoelectronic pod; When the rotation angle of the optoelectronic pod within the time interval is greater than the set value, the two-dimensional coordinate system is not updated within the optoelectronic pod rotation time; The binocular camera angle is adjusted in the opposite direction, and the adjustment angle of the binocular camera adjusted in the opposite direction is equal to the rotation angle of the optoelectronic pod, wherein the angle adjustment speed of the binocular camera within the time interval is equal to the rotation angular speed of the optoelectronic pod within the time interval; After adjusting the binocular camera angle in the opposite direction, the position of the camera is fine-tuned through the inertial element of the optoelectronic pod until the extended line of the binocular camera optical axis is parallel to the original binocular camera optical axis direction in the optoelectronic pod two-dimensional coordinate system; When the angular velocity of the optoelectronic pod during the time interval is greater than the set value, the optical axis position of the binocular camera is adjusted through the active stabilization control model to capture the target object; Obtain the image information recorded by the binocular camera of the optoelectronic pod, synthesize the image information taken by the binocular camera at the same time, and obtain the distance information between the target object and the binocular camera; Obtain the angle information between the binocular camera and the target object after each time interval, and adjust the optical axis angle of the binocular camera through the inertial element of the optoelectronic pod so that the extended line of the binocular camera optical axis intersects with the target object; The position of the laser beam is measured through the compensation system, and the angle of the laser beam is adjusted to achieve rapid capture of the target object.

2. The integrated measurement method of photoelectric pod image stabilization and retrace according to claim 1, characterized in that: The specific method for obtaining the target object distance information is: The first camera is used to capture a visible light image of the target object, and the second camera is used to capture an infrared light image of the target object; Extracting a brightness classification image of the visible light image and a gray component image of the infrared light image, and extracting feature points of the visible light image and the infrared light image based on the brightness classification image of the visible light image and the gray component image of the infrared light image; Compare the feature points in the two pictures, find the matching feature points that appear in both images, calculate the disparity of the matching feature points in the two images, calculate the coordinates of the matching feature points in three-dimensional space, obtain the depth information of the matching feature points through the depth component of the three-dimensional coordinates, and then obtain the distance between the target object and the binocular camera.

3. The integrated measurement method of photoelectric pod image stabilization and retrace according to claim 1, characterized in that: The method also includes establishing a regression model; The specific method of establishing the regression model is to obtain the test inertial deflection of the optoelectronic pod under different test angular velocities of the binocular camera, and obtain a test angular velocity set and a test inertial deflection set; The test angular velocity and the test inertial deflection are marked on the horizontal and vertical axes respectively, and then a linear function is used as the objective function to fit a straight line; The rotation angular velocity of the optoelectronic pod in the time interval under the working state is brought into the horizontal coordinate to obtain the actual inertial deflection of the optoelectronic pod; The actual angle of the binocular camera is obtained by subtracting the reverse adjustment amount of the binocular camera angle from the actual inertial deflection amount.

4. The integrated measurement method of photoelectric pod image stabilization and retrace according to claim 3 is characterized in that: The specific method of establishing the regression model also includes: When the angular velocity of the photoelectric pod's rotation within the time interval is greater than the set value, the position of the photoelectric pod is taken as the origin, and the deviation position coordinates of the deflected photoelectric pod are obtained based on the established two-dimensional coordinate system, and the initial moving speed of the photoelectric pod is obtained. According to vector calculation, the rotation angle and speed of the deflected photoelectric pod re-entering the two-dimensional coordinate system within the set time are obtained.

5. The integrated measurement method of photoelectric pod image stabilization and retrace according to claim 1, characterized in that: The method for obtaining the angle information between the binocular camera and the target object after each time interval is: The inclination angle between the binocular camera and the target object is measured, and the inclination angle between the binocular camera and the target object just before the optoelectronic pod rotates is saved to obtain a first inclination angle; Get the moving speed of the photoelectric pod and calculate the moving distance of the photoelectric pod in each interval. The distance between the binocular camera and the target object just before the optoelectronic pod rotates is retrieved, and the distance between the binocular camera and the target object and the second inclination angle after the first interval time are calculated, wherein the second inclination angle is the angle to be adjusted of the optical axis of the binocular camera after the first interval time; The calculation is repeated to obtain several binocular camera optical axis angles to be adjusted in order of interval time.

6. The integrated measurement method for photoelectric pod image stabilization and retrace according to claim 1, characterized in that: The compensation system comprises: The lens assembly captures and focuses the light reflected from the target object to form a natural light beam; A calibration unit emits a laser beam through a laser head, and adjusts the position of the laser head through an adjusting member of the calibration unit so that the laser beam is parallel to the natural light beam; A separation unit to capture the natural light beam and reflect the laser beam; The detection unit senses and images the natural light beam through its photosensitive surface, calculates the deviation distance between the image and the center of the photosensitive surface, and controls the adjustment element of the calibration unit to adjust the position of the laser so that the laser beam is parallel to the natural light beam; A sensing unit, wherein the imaging point of the visual axis is located at the center of the sensing unit, and is used to detect the angular deviation between the laser beam and the visual axis; Image stabilization regression unit, to adjust the reflection angle of the laser beam; The control unit is used to receive and detect the angular deviation information between the laser beam and the visual axis, and then convert the angular deviation information into an electrical signal for controlling the action of the image stabilization regression unit to adjust the reflection angle of the laser beam so that the laser beam is parallel to the visual axis.

7. An integrated photoelectric pod image stabilization and retrace measurement device, characterized in that: The photoelectric pod image stabilization and retrace integrated measurement method applied to any one of claims 1 to 6 is characterized by comprising: A data storage module stores the rotation angle of the optoelectronic pod within the time interval under the working state, stores the image information captured by the binocular camera of the optoelectronic pod, and stores the angle information between the binocular camera and the target object after each time interval; Active stabilization control model: when the angular velocity of the optoelectronic pod is less than the set value within the time interval, the optical axis position of the binocular camera is adjusted by the inertial element of the optoelectronic pod to capture the target object; when the angular velocity of the optoelectronic pod is greater than the set value within the time interval, the optical axis position of the binocular camera is adjusted by the active stabilization control model to capture the target object; The data processing module calculates the rotation angular velocity of the optoelectronic pod within the time interval and synthesizes the image information taken by the binocular camera at the same time to obtain the distance information between the target object and the binocular camera; The compensation system measures the position of the laser beam and adjusts the angle of the laser beam to quickly capture the target.

Images