Method and module for realizing rapid switching of photoelectric imaging modes of different spectrum bands of task load

Abstract

The invention provides a method and module for realizing rapid switching of photoelectric imaging modules in different spectrum segments of task loads, which are used for outputting statistical results in real time and providing instructions for controlling switching of photoelectric imaging channels by the task loads. Specifically, when a task load displays a visible light spectrum section image at present, if the average value of the image information of the region of interest of the visible light spectrum section is lower than the set value of the image information of the region of interest of the visible light spectrum section, and the brightness information and the non-constant value in the region of interest of the infrared spectrum section, that is, infrared works normally; if so, switching a task load photoelectric imaging channel to infrared spectrum imaging; and when the task load displays the infrared spectrum band image, if the image information average value of the visible light spectrum band is higher than the image information set value, the task load photoelectric imaging channel is switched to perform visible light spectrum band imaging. According to the invention, the reliability of photoelectric imaging mode switching of different spectrum segments is improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of video image signal processing, and particularly relates to a method for quickly switching photoelectric imaging modes of different spectral bands of a mission payload. Background Art

[0002] The different spectral band photoelectric imaging technologies in the mission payload of ground special vehicles refer to the technologies that use light waves of different wavelengths to obtain images. These technologies can cover a wide wavelength range from ultraviolet to infrared, and each spectral band has its unique applications and advantages. Most mission payloads are configured with visible light imaging and infrared imaging bands at the same time, giving full play to their respective complementary advantages, and can meet the needs of all-weather detection and reconnaissance missions. The two spectral bands can be used in the ways of alternating processing, simultaneous processing or image fusion. Usually, professional operators are required to switch imaging channels and adjust imaging parameters according to weather conditions to adapt to the changing environmental conditions and mission requirements. Or it is necessary to transform the original system to access ambient light sensors or thermal radiation sensors to achieve automatic identification of which imaging mode is most suitable for the current environment. Summary of the Invention

[0003] In view of this, the present invention provides a method and module for quickly switching photoelectric imaging modules of different spectral bands of a mission payload, which outputs statistical results in real time and provides an instruction for the mission payload to control the switching of photoelectric imaging channels.

[0004] The specific technical solution is as follows:

[0005] A method for quickly switching photoelectric imaging modes of different spectral bands of a mission payload. When the mission payload currently displays an image in the visible light spectral band, if the average value mean of the image information of the region of interest in the visible light spectral band CCD is lower than the set value of the image information of the region of interest in the visible light spectral band and the sum of the brightness information in the region of interest in the infrared spectral band is not a constant value, that is, the infrared is working normally, then switch the photoelectric imaging channel of the mission payload to infrared spectral band imaging; when the mission payload displays an image in the infrared spectral band, if the average value mean of the image information in the visible light spectral band CCD is higher than the set value of the image information then switch the photoelectric imaging channel of the mission payload to visible light spectral band imaging.

[0006] Furthermore, the calculation formula for the average value mean of the image information of the region of interest in the visible light spectral band CCD is:

[0007]

[0008] where α is the chromaticity weight value, is the average value of the brightness information of the region of interest in the visible light spectrum range, is the average value of the blue information of the region of interest in the visible light spectrum range, is the average value of the red information of the region of interest in the visible light spectrum range.

[0009] Furthermore, the set value of the image information of the region of interest in the visible light spectrum range is calculated by the formula:

[0010]

[0011] where Y set , U set and V set are the set value of the brightness information, the set value of the blue chrominance information, and the set value of the red chrominance information respectively.

[0012] Furthermore, it supports visible light and infrared spectrum videos with variable resolution, frame rate, and data bit width, and the video data format is YUV444.

[0013] A module for realizing the fast switching of the optoelectronic imaging modes of different spectral bands of a mission payload, and a method for recording the above switching.

[0014] Furthermore, it runs on the FPGA platform.

[0015] Beneficial effects

[0016] Compared with the prior art, the present invention has the following beneficial effects:

[0017] (1) The present invention improves the reliability of the switching of the optoelectronic imaging modes of different spectral bands by introducing chrominance information statistics and setting the statistical time.

[0018] (2) The present invention comprehensively considers the working conditions of the detectors of different spectral bands of the mission payload itself, and further improves the reliability of the imaging mode switching, especially suitable for the mission payload in the automatic or autonomous working mode.

[0019] (3) The module of the present invention adopts a non-destructive image processing method. Without adding extra hardware, only by integrating the module of the present invention into the original mission payload image processing platform, the fast switching of the mode can be realized, and the module parameters can be adjusted and feedback in real time, which is easy to implement. Description of the drawings

[0020] Figure 1 , Schematic diagram of the principle of the mission payload optical link monitoring system composed of the module of the present invention.

[0021] Figure 2 , Flowchart of the method of the present invention Detailed implementation manners

[0022] To make the objectives, contents, and advantages of the present invention clearer, the following further describes in detail the specific implementation manners of the present invention with reference to the accompanying drawings and embodiments.

[0023] The present invention provides a method for realizing rapid switching of optoelectronic imaging modules in different spectral bands of a mission payload, as Figure 2 shown, the method includes the following steps:

[0024] Step 1: Calculate the brightness information in the visible light spectral band region of interest within a certain time and the brightness information in the infrared spectral band region of interest and the blue chromaticity information in the visible light spectral band and the red chromaticity information in the visible light spectral band and The specific calculation formulas are respectively:

[0025]

[0026]

[0027]

[0028]

[0029] where y j,k is the brightness value at the video image coordinates (j, k) in the region of interest in the visible light spectral band or the infrared spectral band; u j,k is the blue chromaticity value at the video image coordinates (j, k) in the region of interest in the visible light spectral band; v j,k is the red chromaticity value at the video image coordinates (j, k) in the region of interest in the visible light spectral band; X and Y are the starting pixel coordinates in the horizontal and vertical directions of the region of interest respectively; ΔX aoi and ΔY aoi are the horizontal size and the vertical size of the region of interest respectively; T is the statistical time, generally in units of video frame rate.

[0030] Step 2: Calculate the average value of the brightness information in the visible light spectral band region of interest within the statistical time T the average value of the blue information and the average value of the red information The calculation formulas are respectively:

[0031]

[0032]

[0033]

[0034] Step 3: Calculate the average value mean of the image information of the region of interest in the visible light spectrum band within the statistical time T CCD , and the calculation formula is:

[0035]

[0036] where α is the chromaticity weight value, which needs to be set manually. When T is 1, the average value of the image information of the region of interest is calculated based on the average value of the luminance information, the average value of the blue information, and the average value of the red information of a frame of video image. The update speed is fast and it is easily affected by scene changes. It is recommended that T is generally not less than 3.

[0037] Step 4: Calculate the set value of the image information of the region of interest in the visible light spectrum band The calculation formula is:

[0038]

[0039] where Y set , U set and V set are the set values of the luminance information, the set value of the blue chromaticity information, and the set value of the red chromaticity information respectively.

[0040] Step 5: When the task payload currently displays an image in the visible light spectrum band, when the average value mean of the image information in the visible light spectrum band CCD is lower than the set value of the image information , and the sum of the image information in the infrared spectrum band is not a constant value, that is, the infrared is working properly, then switch the optoelectronic imaging channel of the task payload to infrared spectrum band imaging; when the task payload displays an image in the infrared spectrum band, when the average value mean of the image information in the visible light spectrum band CCD is higher than the set value of the image information , then switch the optoelectronic imaging channel of the task payload to visible light spectrum band imaging.

[0041] The present invention proposes a module for realizing the fast switching of the optoelectronic imaging modes of different spectrum bands of a task payload, which is used to implement the above method. By using the module described in the present invention, a typical task payload optical link monitoring system can be quickly realized, such as Figure 1As shown in the figure, it specifically includes a video sending end, a video processing end, and a video display end; the camera monitoring unit of the video sending end collects visible light and infrared spectrum video signals, and transmits them to the video processing end through an electro-optical conversion module; the opto-electronic conversion module of the video processing end completes the opto-electronic signal conversion and output, and the video processing unit completes image enhancement, target recognition, and character superposition processing, and transmits them to the video display end through the electro-optical conversion module; the opto-electronic conversion module of the video display end completes the opto-electronic signal conversion and output, and the display monitoring unit collects two-way video signals and drives the display screen to work after format conversion. An image information statistics module IP (that is, the module for realizing the rapid switching of different spectral band opto-electronic imaging modes of the mission payload described in the present invention) can be integrated in the video processing unit, so that the mission payload system can realize the switching function of different spectral band imaging channels.

[0042] Furthermore, the image information statistics module IP can support visible light and infrared spectrum videos with variable resolution, frame rate, data bit width, etc.

[0043] Furthermore, the video data format input to the image information statistics module IP is YUV444. If the video data is in other formats such as RGB, YUV420, YUV422, etc., it needs to be converted to the YUV444 format.

[0044] Furthermore, the image information statistics module IP mainly runs on the FPGA (Field Programmable Gate Array) platform.

[0045] In summary, integrating the image information statistics module IP into the existing processing platform of the mission payload, and performing real-time processing on the video stream in a non-destructive manner, which is used to reasonably estimate the image information characteristics of the region of interest to dynamically switch the mission payload band, has high reliability, flexible processing, no increase in cost, fast operation speed, and can better adapt to the changing environmental conditions and mission requirements.

[0046] The above are only the preferred embodiments of the present invention. It should be noted that for those of ordinary skill in the art, several improvements can be made without departing from the technical principle of the present invention.

Claims

1. A method for realizing rapid switching of optoelectronic imaging modes in different spectral bands of a mission payload, characterized in that: When the mission payload currently displays an image in the visible light spectrum band, if the average value mean of the image information of the region of interest in the visible light spectrum band CCD is lower than the set value of the image information of the region of interest in the visible light spectrum band and the sum of the brightness information within the region of interest in the infrared spectrum band is not a constant value, that is, the infrared is working properly, then switch the optoelectronic imaging channel of the mission payload to infrared spectrum band imaging; when the mission payload displays an image in the infrared spectrum band, if the average value mean of the image information in the visible light spectrum band CCD is higher than the set value of the image information then switch the optoelectronic imaging channel of the mission payload to visible light spectrum band imaging.

2. A method for quickly switching photoelectric imaging modes in different spectral bands of a mission payload according to claim 1, characterized in that: The average value mean of the image information of the region of interest in the visible light spectrum band CCD The calculation formula is as follows: where α is the chromaticity weight value, is the average value of the luminance information of the region of interest in the visible light spectrum band, is the average value of the blue information of the region of interest in the visible light spectrum band, is the average value of the red information of the region of interest in the visible light spectrum band.

3. A method for quickly switching between optoelectronic imaging modes in different spectral bands of a mission payload according to claim 2, characterized in that: The set value of the image information of the region of interest in the visible light spectrum band The calculation formula is as follows: Among them, Y set , U set and V set are respectively the set value of luminance information, the set value of blue chrominance information, and the set value of red chrominance information.

4. A method for rapidly switching photoelectric imaging modes in different spectral bands of a mission payload according to claims 1-3, characterized in that: Support visible light and infrared spectrum videos with variable resolution, frame rate, and data bit width. The video data format is YUV444.

5. A module for realizing rapid switching of optoelectronic imaging modes in different spectral bands of a mission payload, characterized in that: Record the method of arbitrarily switching between the above-mentioned claims 1-3.

6. A module for rapidly switching the optoelectronic imaging modes of a mission payload in different spectral bands according to claim 5, characterized in that: Run on the FPGA platform.

Images