Real-time image transmission and control method for aerial high-speed camera

Abstract

The invention discloses a real-time image transmission and control method for an aerial high-speed camera, and the method comprises the steps: carrying out the independent output of the image transmission of the high-speed camera at an airborne end of an unmanned plane through an encoder, carrying out the frame extraction and data compression of an image transmission signal, and transmitting the image transmission signal to a ground display end through an airborne data link; and meanwhile, ground control signals are transmitted to the high-speed camera in real time. According to the method, the occupation of a data transmission link by a high-frequency image output by a high-speed camera in the flight process of the unmanned aerial vehicle is effectively reduced, the test data is ensured to be completely and effectively acquired, and the safety, real-time performance and stability of a test system are improved.

Description

Technical Field

[0001] The invention belongs to the technical field of optical testing, and in particular relates to a real-time image transmission and control method for an aerial high-speed camera. Background Art

[0002] In the military field, more and more weapons and equipment shooting range calibration and scientific research tests have put forward requirements for aerial optical testing, pursuing a comprehensive evaluation of the actual combat performance of weapons and ammunition. At present, traditional optical testing equipment is arranged around a certain distance from the target area and is on the same reference level as the target. The measurement results lack overall and three-dimensional dynamic information. In contrast, aerial optical testing is combined with ground optical testing to form a three-dimensional optical testing system, which can fully grasp the image information required for the test process. In addition, aerial optical testing has the characteristics of being less affected by ground dust, clearer images at the same distance, flexible aerial observation angles, and macro and comprehensive effects. The test images can be used to intuitively calculate the various parameters required.

[0003] High-speed images in aerial optical tests are an important indicator for assessing the performance of weapons and ammunition. Since high-speed cameras generally have extremely high frame rates, they can generate huge amounts of data in a short period of time. On the one hand, this will occupy a large amount of the UAV's communication data link, causing the ground control end to be unable to effectively control the UAV in real time. There will also be delays in the feedback of the UAV status information, making it difficult to deal with sudden situations immediately, posing a safety risk. On the other hand, it will also cause delays in the ground end's trigger control of the high-speed camera, resulting in the risk of recording failure in the test. Summary of the invention

[0004] In order to overcome the shortcomings of the prior art, the present invention provides a real-time image transmission and control method for an aerial high-speed camera. The high-speed camera image transmission is output separately through an encoder at the airborne end of the drone, and the image transmission signal is extracted frame by frame, the data volume is compressed, and the image transmission signal is transmitted to the ground display end through the airborne data link, and the ground control signal is transmitted to the high-speed camera in real time. This method effectively reduces the occupation of the data transmission link by the high-frequency image output by the high-speed camera during the flight of the drone, ensures that the test data is completely and effectively obtained, and improves the safety, real-time and stability of the test system.

[0005] The technical solution adopted by the present invention to solve the technical problem is as follows:

[0006] Step 1: Build a real-time image transmission and control system for an aerial high-speed camera, including a high-speed camera, an encoder, an airborne switch, an airborne data link, a ground data link, a ground switch, a high-speed image display device, and a high-speed camera control device;

[0007] Step 2: The high-speed camera control interface is directly connected to the onboard switch via a network cable to receive control signals from the ground high-speed camera control software in real time; the high-speed camera video output interface is connected to the encoder to transmit the collected high-speed images to the encoder in real time;

[0008] Step 3: The encoder extracts frames from the received high-speed image, takes the initial frame as the reference frame, and the next frame as the test frame. When the image difference between the test frame and the reference frame is greater than the set threshold, the test frame is used as the reference frame for a new round of comparison, and the test frame is output to the onboard switch. If the image difference between the test frame and the reference frame is less than the set threshold, the next frame is selected as the test frame according to the time sequence of the high-speed image input;

[0009] Step 4: The airborne switch is directly connected to the airborne data link to complete the exchange of high-speed camera control signals and high-speed frame images. The airborne data link and the ground data link complete the data exchange through air-to-ground data transmission. The ground data link is directly connected to the ground switch to complete the data exchange.

[0010] Step 5: The ground switch is directly connected to the high-speed image display device to transmit and display the frame-drawing image in real time. The ground switch is directly connected to the high-speed camera control device to receive the parameter setting and trigger control signal sent by the high-speed camera control device:;

[0011] Step 6: Set the high-speed image display device and the encoder to the same network segment, and set the high-speed camera control device and the high-speed camera to the same network segment.

[0012] Preferably, in step 1, the image signal output and control signal input of the high-speed camera are divided into two independent channels to ensure that the signal transmissions do not affect each other.

[0013] Preferably, in step 2, the encoder compares the difference between the original frame and the test frame with a set threshold, extracts the changed high-speed image in real time, and completes the compression and extraction of the transmission image.

[0014] Preferably, in step 5, different network segments are assigned to the high-speed camera and the encoder, the high-speed image display device must be set to the same network segment as the encoder, and the high-speed camera control device must be set to the same network segment as the high-speed camera.

[0015] Preferably, the high-speed camera video output interface is connected to the encoder via a BNC video cable.

[0016] The beneficial effects of the present invention are as follows:

[0017] 1. This method significantly reduces the amount of data transmitted from the high-speed camera to the ground display device, reduces the occupancy of the UAV communication data link, ensures that the ground terminal can realize real-time and stable control of the UAV status, and improves the safety of UAV flight testing.

[0018] 2. This method effectively improves the stability of the high-speed camera's aerial image transmission display and control, ensuring that the various parameter settings of the high-speed camera can be completed quickly during the test and enter the ready state. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 This is a schematic diagram of the real-time image transmission and control system of an aerial high-speed camera of the present invention;

[0020] Figure 2 It is a schematic diagram of the high-speed image frame extraction principle of the present invention. DETAILED DESCRIPTION

[0021] The present invention is further described below in conjunction with the accompanying drawings and embodiments.

[0022] The present invention discloses a method for transmitting real-time aerial images and controlling a camera of a high-speed camera mounted on an unmanned aerial vehicle platform, in order to solve the problem that after being triggered, the high-speed camera outputs too much data in a short period of time, which occupies the communication data link, causes delays in image transmission and control, and causes safety and test risks. This method can reliably obtain aerial high-speed images, and can stably control the unmanned aerial vehicle and the high-speed camera in real time, thereby minimizing equipment safety and test risks, and can be applied to image transmission display and control of various high-speed cameras mounted on unmanned aerial vehicles.

[0023] like Figure 1 As shown, the real-time image transmission and control system of the aerial high-speed camera consists of a high-speed camera, an encoder, an airborne switch, an airborne data link, a ground data link, a ground switch, a high-speed image display device and a high-speed camera control device.

[0024] (1) The high-speed camera control interface is directly connected to the onboard switch via a network cable to receive control signals from the ground high-speed camera control software in real time. The high-speed camera video output interface is connected to the encoder via a BNC video cable to transmit the captured high-speed images to the encoder in real time.

[0025] (2) The encoder extracts frames from the received high-speed image, taking the initial frame as the reference frame and the next frame as the test frame. When the image difference between the test frame and the reference frame is greater than the set threshold, the test frame is used as the reference frame for a new round of comparison and is output to the onboard switch. If the image difference between the test frame and the reference frame is less than the set threshold, the next frame is selected as the test frame according to the time sequence of the high-speed image input.

[0026] (3) The airborne switch is directly connected to the airborne data link to complete the exchange of high-speed camera control signals and high-speed frame images. The airborne data link and the ground data link complete data exchange through air-to-ground data transmission. The ground data link is directly connected to the ground switch to complete data exchange.

[0027] (4) The ground switch is directly connected to the high-speed image display device to transmit and display the frame-extracted image in real time. The ground switch is directly connected to the high-speed camera control device to receive the parameter setting and trigger control signals sent by the high-speed camera control device.

[0028] (5) The high-speed image display device and the encoder are set to the same network segment, and the high-speed camera control device and the high-speed camera are set to the same network segment.

[0029] Step (1) requires dividing the image signal output and control signal input of the high-speed camera into two independent channels to ensure that the signal transmissions do not affect each other.

[0030] In step (2), the encoder compares the difference between the original frame and the test frame with a set threshold value, extracts the high-speed image after a certain change in real time, and completes the compression and extraction of the transmission image.

[0031] Step (5) assigns different network segments to the high-speed camera and the encoder. The high-speed image display device must be set to the same network segment as the encoder, and the high-speed camera control device must be set to the same network segment as the high-speed camera.

[0032] Example:

[0033] The present invention comprises the following steps:

[0034] 1. Before the test, connect the video output interface of the high-speed camera on the drone to the encoder through a BNC video cable on the ground, connect the control interface directly to the onboard switch through a network cable, and connect the network port of the encoder directly to the onboard switch through a network cable.

[0035] 2. The encoder realizes the principle of high-speed image frame extraction. Figure 2 As shown. Given the initial input high-speed image as the base frame, and the next frame based on the time sequence as the test frame, the base frame and the test frame are subtracted to obtain the image difference, and the image difference is compared with the set threshold. When the image difference is greater than the set threshold, the current test frame is output as the extraction result, and the test frame is used as the base frame for a new round of comparison, and the next frame of the test frame is added as a new round of test frames for comparison; when the image difference is less than the set threshold, the base frame remains unchanged, and the next frame is added as a new round of test frames for comparison.

[0036] 3. The airborne switch is directly connected to the airborne data link through the network port, the airborne data link and the ground data link maintain line of sight, the ground data link is directly connected to the ground switch through the network port, and the ground switch is directly connected to the high-speed image display device and the high-speed image control device through the network port.

[0037] 4. Query the network segments of the high-speed camera and encoder respectively, set the high-speed image display device to be consistent with the encoder network segment, and set the high-speed image control device to be consistent with the high-speed camera network segment.

[0038] 5. Set the high-speed image display device to be consistent with the encoder network segment, and observe the received high-speed frame image; set the high-speed image control device to be consistent with the high-speed camera network segment, observe whether the high-speed camera model corresponds, adjust the various parameters of the high-speed camera, and observe whether the received image on the high-speed image display device is consistent with the parameter adjustment changes.

[0039] 6. After debugging is completed, control the drone to lift off to the designated hovering point, readjust the high-speed camera field of view and various parameters, and complete the test preparation.

Claims

1. A method for real-time image transmission and control of an aerial high-speed camera, characterized in that: The steps include: Step 1: Build a real-time image transmission and control system for an aerial high-speed camera, including a high-speed camera, an encoder, an airborne switch, an airborne data link, a ground data link, a ground switch, a high-speed image display device, and a high-speed camera control device; Step 2: The high-speed camera control interface is directly connected to the onboard switch via a network cable to receive control signals from the ground high-speed camera control software in real time; the high-speed camera video output interface is connected to the encoder to transmit the collected high-speed images to the encoder in real time; Step 3: The encoder extracts frames from the received high-speed image, takes the initial frame as the reference frame, and the next frame as the test frame. When the image difference between the test frame and the reference frame is greater than the set threshold, the test frame is used as the reference frame for a new round of comparison, and the test frame is output to the onboard switch. If the image difference between the test frame and the reference frame is less than the set threshold, the next frame is selected as the test frame according to the time sequence of the high-speed image input; Step 4: The airborne switch is directly connected to the airborne data link to complete the exchange of high-speed camera control signals and high-speed frame images. The airborne data link and the ground data link complete the data exchange through air-to-ground data transmission. The ground data link is directly connected to the ground switch to complete the data exchange. Step 5: The ground switch is directly connected to the high-speed image display device to transmit and display the frame-drawing image in real time. The ground switch is directly connected to the high-speed camera control device to receive the parameter setting and trigger control signal sent by the high-speed camera control device:; Step 6: Set the high-speed image display device and the encoder to the same network segment, and set the high-speed camera control device and the high-speed camera to the same network segment.

2. The method for real-time image transmission and control of an aerial high-speed camera according to claim 1, characterized in that: The high-speed camera video output interface is connected to the encoder via a BNC video cable.

3. The method for real-time image transmission and control of an aerial high-speed camera according to claim 1, characterized in that: In step 1, the image signal output and control signal input of the high-speed camera are divided into two independent channels to ensure that the signal transmissions do not affect each other.

4. The method for real-time image transmission and control of an aerial high-speed camera according to claim 3, characterized in that: In step 2, the encoder compares the difference between the original frame and the test frame with a set threshold, extracts the changed high-speed image in real time, and completes the compression and extraction of the transmission image.

5. The method for real-time image transmission and control of an aerial high-speed camera according to claim 4, characterized in that: In step 5, different network segments are assigned to the high-speed camera and the encoder, the high-speed image display device must be set to the same network segment as the encoder, and the high-speed camera control device must be set to the same network segment as the high-speed camera.

Images