Water surface dynamic target position measuring method and system and storage medium

The homogeneous linear transformation scale factor is calculated by calculating the camera and inertial navigation module on the airborne platform, and the dynamic position measurement of the water surface target is achieved, solving the problems of high measurement error and complexity in the existing technology, and improving the measurement accuracy and reliability .

CN118936464APending Publication Date: 2024-11-12KUNMING SHIP EQUIPMENT RESEARCH & TESTING CENTER (CHINA SHIPBUILDING CORP 750 TEST SITE)
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411028075.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-30
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The prior art is difficult to accurately measure the target position over the water surface or in complex backgrounds, and the method of laying the markings is complex, resulting in increased measurement errors and engineering implementation difficulties.

Method used

The camera on the onboard platform is used to obtain the measured image, and combined with the inertial navigation module, the camera and image plane coordinate system are established, the homogeneous linear transformation scale factor is calculated, the target position offset is obtained in real time, and the longitude and sum of the ground plane coordinate system are calculated. latitude, dynamic position measurement to achieve water surface targets.

Benefits of technology

It effectively reduces the complexity of engineering implementation, improves measurement accuracy and reliability, expands the measurement range of the drone optical platform, and reduces the error of laser range radar over the water surface.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118936464A_ABST
    Figure CN118936464A_ABST
Patent Text Reader

Abstract

The invention discloses a water surface dynamic target position measuring method and system and a storage medium, and the method comprises the steps: S1, building a camera coordinate system and an image plane coordinate system; s2, determining a homogeneous linear transformation scale factor k; step S3, acquiring a deviation angle alpha of the measured image and the camera relative to the due north direction, and calculating a deviation amount lx in the longitude direction and a deviation amount ly in the latitude direction under the earth plane coordinate system; and step S4, according to the offset amount lx in the longitude direction, the offset amount ly in the latitude direction, and the longitude measurement value Lonaircraft, the latitude measurement value Lataircraft and the elevation measurement value Heiaircraft of the airborne platform, respectively calculating the longitude Lonobject and the latitude Latobject of the water surface target. The invention also discloses a method for calculating the water surface target based on the offset amount lx in the longitude direction, the offset amount ly in the latitude direction, the longitude measurement value Lonaircraft, the latitude measurement value Lataircraft and the elevation measurement value Heiaircraft of the airborne platform. According to the method, the complexity of implementation of an optical measurement project of the unmanned aerial vehicle is effectively reduced, the complexity of positioning calculation is reduced, and the reliability of a measurement system and the position measurement precision of a water surface target can be effectively improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to the technical field of water-air target stereo positioning and tracking, and in particular to a method, system and storage medium for measuring the position of a dynamic target on a water surface. Background Art

[0002] With the development of UAV technology, small UAVs have been widely used in traffic patrol, land surveying, environmental monitoring, aerial photography and other fields. Most UAV applications include the need for target positioning. By installing laser ranging radar and attitude sensors on the optoelectronic platform of the UAV, the pitch, roll and distance measurement of the optical measuring equipment can be completed to achieve the target positioning function; or by placing four or more markers at the measurement site, the attitude measurement of the optical lenses of two UAVs can be completed, and then the target positioning function can be achieved through binocular vision intersection.

[0003] Both of these methods of target positioning have great limitations and are difficult to implement in engineering. For example, laser ranging radar cannot accurately obtain the distance of the target under test in complex target backgrounds such as above the water surface or in dust, resulting in erroneous position measurement results. The method of calibrating parameters by placing markers at the measurement site requires not only the placement of markers with high-precision positioning information, but also the completion of high-precision measurement time synchronization between each marker and the test equipment, which makes the on-site engineering implementation more complex. Summary of the invention

[0004] In view of the shortcomings of the prior art, the present invention provides a method, system and storage medium for measuring the position of a dynamic target on a water surface, which uses an airborne platform camera to obtain a measurement image, and based on the measurement image, a dynamic target position measurement method, system and storage medium are provided.

[0005] According to a first aspect, the present invention provides a method for measuring the position of a dynamic target on a water surface, comprising a camera and an inertial navigation module located on an airborne platform, the method comprising:

[0006] Step S1: Establish the camera coordinate system and the image plane coordinate system; a is the coordinate origin of the image plane, and the horizontal line is X a Axis, vertical line is Y a Axis, establish image coordinate system O a -X a Y a ; In space, let the projection center be O c is the origin of the camera coordinate system, and the main axis is z c Axis, parallel to X a Axis and passes through point O c The straight line is x c Axis, parallel to Ya Axis and passes through point O c The straight line is y c Axis, establish the camera coordinate system O c -x c y c z c ;O c -x c y c and O a -X a Y a The distance f between the planes is the focal length of the camera;

[0007] Step S2: setting a cooperative target line segment AB on the object to be measured, the length of the cooperative target line segment AB in the camera coordinate system is l, and the length of its projection A′B′ in the image coordinate system is l′; calculating a homogeneous linear transformation scale factor k from a three-dimensional space point to an image plane based on the cooperative target line segment AB and the projection A′B′;

[0008] Step S3: The camera on the airborne platform acquires the measurement image in real time, and obtains the target position in the image coordinate system relative to the image coordinate origin O according to the measurement image. a In X a The offset in the direction l′ x and Y a The offset in the direction l′ y ;

[0009] The inertial navigation module is used to obtain the offset angle α of the camera on the airborne platform relative to the true north direction. According to the offset angle α, the homogeneous linear transformation scale factor k, and the offset l′ x and the offset l′ y , calculate the offset l in the longitude direction in the geodetic plane coordinate system c and the latitude offset l u ;

[0010] Step S4: Based on the offset l in the longitude direction c , the latitude offset l y , the longitude measurement value Lon of the airborne platform aircraft , Latitude measurement value Lat aircraft and the height measurement value Hei aircraft , respectively calculate the longitude Lon of the surface target object and Latitude Lat object .

[0011] Furthermore, in step S4, the longitude Lon of the surface target object for:

[0012]

[0013] Latitude of surface target Lat object for:

[0014]

[0015] Among them, R E R is the radius of curvature of the latitude circle; N is the meridian curvature radius.

[0016] Furthermore, in step S2, the homogeneous linear transformation scale factor k is:

[0017]

[0018] Among them, z is the coordinate origin O of the camera coordinate system c The distance to the cooperative target line segment AB.

[0019] Furthermore, in step S3, the offset in the longitude direction is l x for:

[0020]

[0021] The latitude offset l y for:

[0022]

[0023] According to a second aspect, the present invention further provides a dynamic surface target position measurement system, comprising: an airborne platform and a shore-based platform, the airborne platform and the shore-based platform are data connected, wherein the airborne platform comprises:

[0024] A camera, which is installed on the airborne platform and is used to obtain measurement images in real time;

[0025] GNSS differential module, used to obtain the longitude measurement value Lon of the airborne platform aircraft , Latitude measurement value Lat aircraft and the height measurement value Hei aircraft ;

[0026] The inertial navigation module is used to obtain the offset angle α of the camera relative to the true north direction;

[0027] The shore-based platform includes:

[0028] Coordinate system module, used to establish camera coordinate system and image plane coordinate system;

[0029] Measurement image interpretation and processing module: used to obtain the target position in the image coordinate system relative to the image coordinate origin O according to the measurement image a In X a The offset in the direction l′x and Y a The offset in the direction l′ y ;

[0030] It is also used to obtain the offset angle α of the camera on the airborne platform relative to the true north direction through the inertial navigation module, according to the offset angle α, the homogeneous linear transformation scale factor k, and the offset l′ x and the offset l′ y , calculate the offset l in the longitude direction in the geodetic plane coordinate system x and the latitude offset l y ;

[0031] Also used for the offset l according to the longitude direction x , the latitude offset l y , the longitude measurement value Lon of the airborne platform aircraft , Latitude measurement value Lat aircraft and the height measurement value Hei aircraft , respectively calculate the longitude Lon of the surface target object and Latitude Lat object .

[0032] According to a third aspect, a computer-readable storage medium stores a computer program thereon, wherein the computer program can be executed by a processor to implement the steps of the method described above.

[0033] Compared with the prior art, the present invention has the following beneficial effects:

[0034] (1) Compared with the method of realizing the target positioning function by using the binocular vision intersection method of two UAVs with four or more markers placed at the measurement site, the present invention effectively reduces the complexity of engineering implementation and expands the measurement range of the UAV optical platform.

[0035] (2) Due to the light transmission ability of water medium, there is a large error in the height measurement of the laser ranging radar above the water surface, and the error size also varies accordingly due to different water qualities. Therefore, compared with the existing single-drone measurement method that installs a laser ranging radar and an attitude sensor on an unmanned aerial vehicle optoelectronic platform and uses the measurement value of the laser ranging radar as a dynamic target position solution parameter, the present invention can effectively improve the reliability of the measurement system and the position measurement accuracy of the surface target. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 is a system block diagram of the present invention;

[0037] Figure 2 It is a schematic diagram of the projection model of the camera coordinate system and the image coordinate system;

[0038] Figure 3Schematic diagram of cooperative targets on the target being measured. DETAILED DESCRIPTION

[0039] The present invention is further described in detail below through specific implementation modes.

[0040] Example 1

[0041] like Figure 1 As shown, this embodiment provides a dynamic surface target position measurement system, including: an airborne platform and a shore-based platform, the airborne platform and the shore-based platform are data connected, wherein the airborne platform includes: a camera, an optical axis encoder, a GNSS differential module, an inertial navigation module and a wireless transmission module, the camera is used to obtain the measurement image in real time and the wireless transmission channel encoding; the optical axis encoder is used to adjust the optical axis of the camera; the GNSS differential module is used to obtain the position of the airborne platform, that is, the longitude measurement value Lon aircraft , Latitude measurement value Lat aircraft and the height measurement value Hei aircraft ; The inertial navigation module is used to complete the attitude measurement of the airborne optical camera to obtain the offset angle α of the camera relative to the true north direction.

[0042] The shore-based platform includes: a coordinate system module, a wireless receiving module, a data acquisition module, and a measurement image interpretation and processing module. The coordinate system module is used to establish the camera coordinate system and the image plane coordinate system; the wireless receiving module is connected to the wireless transmitting module and is used to receive the image video code stream sent by the wireless transmitting module; the data acquisition module is used to collect the image video code stream, complete channel decoding, and collect the airborne platform position data provided by the GNSS differential module and the inertial navigation module; the measurement image interpretation and processing module is used to complete the interpretation of the measured target in the image and obtain the position information.

[0043] The specific process is as follows:

[0044] Step S1: Figure 2 As shown, the camera coordinate system and the image plane coordinate system are established; wherein, on the image plane, O a is the coordinate origin of the image plane, and the horizontal line is X a Axis, vertical line is Y a Axis, establish image coordinate system O a -X a Y a ; In space, let the projection center be O c is the origin of the camera coordinate system, and the main axis is z c Axis, parallel to X a Axis and passes through point O c The straight line is x c Axis, parallel to Y a Axis and passes through point Oc The straight line is y c Axis, establish the camera coordinate system O c -x c y c and O a -X a Y a The distance f between the planes is the focal length of the camera.

[0045] Step S2: Set a cooperative target line segment AB on the object to be measured. In this embodiment, the cooperative target adopts a cross-shaped marking pattern with known length and width, and the clear line segment is used as the cooperative target line segment AB to participate in the measurement. The length of the cooperative target line segment AB in the camera coordinate system is l, and the length of its projection A′B′ in the image coordinate system is l′; based on the cooperative target line segment AB and the projection A′B′, calculate the homogeneous linear transformation scale factor k from the three-dimensional space point to the image plane. The homogeneous linear transformation scale factor k is:

[0046]

[0047] Among them, z is the coordinate origin O of the camera coordinate system c The distance to the cooperative target line segment AB.

[0048] Step S3: The camera on the airborne platform acquires the measurement image in real time. During measurement, the airborne platform flies to the top of the target to be measured. According to the attitude measurement results of the inertial navigation module, the camera is adjusted using the photoelectric axis encoder to ensure that the optical axis of the camera is vertically downward, that is, the pitch angle is -90°, and the field of view can cover the target to be measured. The airborne platform records the measurement image in real time. During the movement of the target to be measured, the flight of the airborne platform is controlled in real time according to the moving direction and position of the target to be measured to ensure that the image field of view completely covers the target to be measured. The measurement image collected by the camera and the GNSS differential module obtain the position data of the airborne platform and transmit it to the shore-based platform through the wireless transmission module.

[0049] Then the measurement image interpretation and processing module obtains the target position in the image coordinate system relative to the image coordinate center O according to the measurement image. a In X a The offset in the direction l′ x and Y a The offset in the direction l′ y .

[0050] The inertial navigation module is used to obtain the offset angle α of the camera on the airborne platform relative to the true north direction. According to the offset angle α, the homogeneous linear transformation scale factor k, and the offset l′ x and the offset l′ y , calculate the offset l in the longitude direction in the geodetic plane coordinate systemx and the latitude offset l u .

[0051] The offset in the longitude direction l x for:

[0052]

[0053] The latitude offset l y for:

[0054]

[0055] Step S4: Based on the offset l in the longitude direction x , the latitude offset l y , the longitude measurement value Lon of the airborne platform aircraft , Latitude measurement value Lat aircraft and the height measurement value Hei aircraft , respectively calculate the longitude Lon of the surface target object and Latitude Lat object . Longitude Lon of the surface target object for:

[0056]

[0057] Latitude of surface target Lat object for:

[0058]

[0059] Among them, R E R is the radius of curvature of the latitude circle; N is the meridian curvature radius.

[0060] Example 2

[0061] The drone flies above the water surface with the camera optical axis vertically downward, and the latitude position Lat of the drone is collected by the onboard GNSS differential module and inertial navigation module. aircraft =24.58637805°; longitude position Lon aircraft =102.84632252°; elevation position Hei aircraft =1722m; the inertial navigation module obtains the offset angle of the camera on the airborne platform relative to the true north direction α = 37.85°; in the image coordinate system, the projection length of the cooperative target line segment is l′ = 6pix, and the length of the cooperative target line segment in the camera coordinate system is l = 7m. The position of the surface target in the image coordinate system is relative to the image coordinate center O a In X a The offset in the direction l′ x=2pix,Y a The offset in the direction l′ y =9pix.

[0062] Calculate the homogeneous linear transformation scale factor k:

[0063]

[0064] Calculate the offset l in the longitude direction x for:

[0065]

[0066] The latitude offset l y for:

[0067]

[0068] Longitude Lon of the surface target object for:

[0069]

[0070] Latitude of surface target Lat object for:

[0071]

[0072] The above specific examples are used to illustrate the present invention, which is only used to help understand the present invention and is not intended to limit the present invention. For those skilled in the art, according to the concept of the present invention, some simple deductions, modifications or substitutions can be made.

Claims

1. A method for measuring the position of a dynamic target on a water surface, characterized in that: The invention comprises a camera and an inertial navigation module located on an airborne platform; the method comprises: Step S1: Establishing the camera coordinate system and the target image plane coordinate system; wherein, on the target image plane, O a is the coordinate origin of the image plane, and the horizontal line is X a Axis, vertical line is Y a Axis, establish the target image coordinate system O a -X a Y a ; Note the projection center O c is the origin of the camera coordinate system, and the main axis is z c Axis, parallel to X a Axis and passes through point O c The straight line is x c Axis, parallel to Y a Axis and passes through point O c The straight line is y c Axis, establish the camera coordinate system O c -x c y c z c ;O c -x c y c and O a -X a Y a The distance f between the planes is the focal length of the camera; Step S2: setting a cooperative target line segment AB on the object to be measured, the length of the cooperative target line segment AB in the camera coordinate system is l, and the length of its projection A′B′ in the target image coordinate system is l′; calculating the homogeneous linear transformation scale factor k from the three-dimensional space point to the target image plane based on the cooperative target and the projection A′B′; Step S3: The camera on the airborne platform acquires the measurement target image in real time, and obtains the target position in the target image coordinate system relative to the image coordinate origin O according to the measurement target image. a In X a The offset in the direction l′ x and Y a The offset in the direction l′ y ; The inertial navigation module is used to obtain the offset angle α of the camera on the airborne platform relative to the true north direction. According to the offset angle α, the homogeneous linear transformation scale factor k, and the offset l′ x and the offset l′ y , calculate the offset l in the longitude direction in the geodetic plane coordinate system x and the latitude offset l y ; Step S4: Based on the offset l in the longitude direction x , the latitude offset l y , the longitude measurement value Lon of the airborne platform aircraft , Latitude measurement value Lat aircraft and the height measurement value Hei aircraft , respectively calculate the longitude Lon of the surface target object and Latitude Lat object .

2. The method according to claim 1, characterized in that In step S4, the longitude Lon of the surface target object for: Latitude of surface target Lat object for: Among them, R E R is the radius of curvature of the latitude circle; N is the meridian curvature radius.

3. The method according to claim 1, characterized in that In step S2, the homogeneous linear transformation scale factor k is: Among them, z is the coordinate origin O of the camera coordinate system c The distance to the cooperative target line segment AB.

4. The method according to claim 1, characterized in that In step S3, the offset in the longitude direction is l x for: The latitude offset l y for:

5. A dynamic surface target position measurement system, characterized in that: include: Coordinate system module, used to establish camera coordinate system and image plane coordinate system; A camera, which is installed on the airborne platform and is used to obtain measurement images in real time; The inertial navigation module is used to obtain the offset angle α of the camera relative to the true north direction; GNSS differential module, used to obtain the longitude measurement value Lon of the airborne platform aircraft , Latitude measurement value Lat aircraft and the height measurement value Hei aircraft ; Measurement image interpretation and processing module: used to obtain the target position in the image coordinate system relative to the image coordinate origin O according to the measurement image a In X a The offset in the direction l′ x and Y a The offset in the direction l′ y ; It is also used to obtain the offset angle α of the camera on the airborne platform relative to the true north direction through the inertial navigation module, according to the offset angle α, the homogeneous linear transformation scale factor k, and the offset l′ x and the offset l′ y , calculate the offset l in the longitude direction in the geodetic plane coordinate system x and the latitude offset l y ; Also used for the offset l according to the longitude direction x , the latitude offset l y , the longitude measurement value Lon of the airborne platform aircraft , Latitude measurement value Lat aircraft and the height measurement value Hei aircraft , respectively calculate the longitude Lon of the surface target object and Latitude Lat object .

6. A computer-readable storage medium having a computer program stored thereon, characterized in that: The computer program can be executed by a processor to implement the steps of the method according to any one of claims 1-4.