Multi-source environmental data acquisition system and control method thereof

Abstract

The invention provides a multi-source environmental data acquisition system and a control method thereof, and the system comprises a photoelectric rotary table which is provided with at least two different imaging devices; the control module is used for adjusting on-off states and shooting angles of the at least two different imaging devices according to a user instruction to obtain a to-be-corrected image; wherein the to-be-corrected image is acquired through at least one of at least two different imaging devices: a correction module used for performing target correction on the to-be-corrected image to obtain a correction factor, and performing target analysis on the to-be-corrected image according to the correction factor to obtain multi-source environment data; wherein the target correction comprises at least one of geometric correction, radiation correction, color correction and brightness correction; the target analysis comprises at least one of image color analysis, brightness analysis and temperature analysis. According to the method, the convenience of multi-source data acquisition and the data measurement accuracy are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a multi-source environmental data acquisition system and a control method thereof. Background Art

[0002] The multispectral imaging system has a relatively wider spatial resolution according to the specific radiation characteristics of the object, but has relatively fewer bands and has a better ability to identify ground objects. At the same time, a single-band area array camera has high spatial resolution and is not prone to distortion. It is widely used in aerospace technology fields such as earth remote sensing, earth mapping, planetary mapping, interstellar communications and intercontinental missiles.

[0003] Infrared thermal imaging temperature measurement technology is one of the most active research hotspots. Compared with general temperature measurement technology, infrared temperature measurement technology will not destroy the temperature field of the object being measured; it can distinguish a temperature difference of 0.03°C and has high sensitivity; it can measure the target temperature within a few milliseconds and has a fast response speed; it has a wide temperature measurement range, which can reach -170°C~3200°C, or even larger; it is not limited by the detection distance, and can be used at near and far distances; ⑥ it can realize real-time observation and automatic control, and the operation is safe and easy.

[0004] In the related art, multispectral images and infrared radiation images are obtained by independently operating a multispectral imaging system and an infrared thermal imaging system. This method not only increases the complexity of operation, but also makes the multi-source data integration and analysis process time-consuming and error-prone. It is difficult to ensure the temporal and spatial correspondence of multi-source data, affecting the accuracy and availability of the final data. In addition, due to equipment limitations, it is difficult to simultaneously obtain the color, brightness and temperature data of the environment, resulting in low data collection efficiency, high measurement errors, and inaccurate data measurement, which brings great interference to the collection of environmental data in scenarios such as environmental monitoring, disaster emergency response or reconnaissance missions. Summary of the invention

[0005] The present invention provides a multi-source environmental data acquisition system and a control method thereof, which are used to solve the defects of the prior art in which a multi-spectral imaging system and an infrared thermal imaging system are independently operated to acquire multi-spectral images and infrared radiation images, the data integration and analysis process is time-consuming and error-prone, and it is difficult to ensure the time and space correspondence of the data, thereby improving the convenience of multi-source data acquisition and the accuracy of data measurement.

[0006] The present invention provides a multi-source environmental data acquisition system, comprising: An optoelectronic turntable, which is equipped with at least two different imaging devices; A control module, the control module is used to adjust the switch state and shooting angle of at least two different imaging devices according to user instructions to obtain an image to be corrected; wherein the image to be corrected is collected by at least one of the at least two different imaging devices: A correction module, the correction module is used to perform target correction on the image to be corrected to obtain a correction factor, and perform target analysis on the image to be corrected based on the correction factor to obtain multi-source environmental data; wherein the target correction includes at least one of geometric correction, radiation correction, color correction and brightness correction; the target analysis includes at least one of image color analysis, brightness analysis and temperature analysis.

[0007] According to a multi-source environmental data acquisition system provided by the present invention, at least two different imaging devices include a multi-spectral optical camera and a long-wave infrared thermal imager; The control module is used to control the optoelectronic turntable to perform at least one of the following operations according to user instructions: Control the multispectral optical camera to collect multispectral images of the target scene; Control the long-wave infrared thermal imager to collect infrared radiation images of the target scene.

[0008] According to a multi-source environmental data acquisition system provided by the present invention, the bands acquired by the multispectral camera include visible light, short-wave infrared bands, and the number of spectral channels of the multispectral image is no less than four.

[0009] According to a multi-source environmental data acquisition system provided by the present invention, a multispectral camera is rotatably mounted on a photoelectric turntable, a long-wave infrared thermal imager is rotatably mounted on the photoelectric turntable, and the infrared thermal imager is installed parallel to the optical axis of the multispectral camera.

[0010] The present invention also provides a control method for a multi-source environmental data acquisition system, comprising: According to user instructions, the switch states and shooting angles of at least two different imaging devices installed on the photoelectric turntable are adjusted to obtain an image to be corrected; wherein the image to be corrected is collected by at least one of the at least two different imaging devices; Perform target correction on the image to be corrected to obtain a correction factor, and perform target analysis on the image to be corrected based on the correction factor to obtain multi-source environmental data; wherein the target correction includes at least one of geometric correction, radiation correction, color correction and brightness correction; and the target analysis includes at least one of image color analysis, brightness analysis and temperature analysis.

[0011] According to a control method of a multi-source environmental data acquisition system provided by the present invention, at least two different imaging devices include a multi-spectral optical camera and a long-wave infrared thermal imager; the image to be corrected includes a multi-spectral image acquired by the multi-spectral optical camera and an infrared radiation image acquired by the long-wave infrared thermal imager; the target correction is color correction; Perform target correction on the image to be corrected, and obtain the correction factors including: The image to be corrected is calibrated by a light intensity correction method, and the calibrated image is converted into a relative reflectance image, wherein the relative reflectance image includes a plurality of calibration plate areas; Calculate the pixel mean of multiple calibration plate areas in the relative reflectance image, and perform linear regression between the pixel mean and the true reflectance value corresponding to the relative reflectance image using the following formula to determine the first radiation calibration equation: Ref1=Gain1*DL+Offset1; Wherein, Ref1 is the color correction coefficient, Gain1 and Offset1 are calibration coefficients, and DL is the grayscale value of the image to be corrected.

[0012] According to a control method of a multi-source environmental data acquisition system provided by the present invention, at least two different imaging devices include long-wave infrared thermal imagers; the image to be corrected includes an infrared radiation image collected by the long-wave infrared thermal imager; the target correction is radiation correction; The target correction is performed on the image to be corrected, and the correction factors obtained also include: Performing non-uniform correction on the long-wave infrared thermal imager according to the integration time of the long-wave infrared thermal imager to obtain a corrected long-wave infrared thermal imager; Taking the black body radiation source as the standard, the radiation brightness of the black body is calculated by the black body temperature and the black body emissivity, and the black body is imaged by the calibrated long-wave infrared thermal imager to obtain the gray value of the black body imaged on the thermal imager. The radiation brightness and gray value are linearly fitted to determine the second radiation calibration equation: Ref2=Gain1*DL+Offset1; Wherein, Ref2 is the radiation correction coefficient, Gain2 and Offset2 are calibration coefficients, and DL is the grayscale value of the image to be corrected.

[0013] According to a control method of a multi-source environmental data acquisition system provided by the present invention, at least two different imaging devices include a multi-spectral optical camera and a long-wave infrared thermal imager; the image to be corrected includes a multi-spectral image acquired by the multi-spectral optical camera and an infrared radiation image acquired by the long-wave infrared thermal imager; the target correction is color correction; Perform target correction on the image to be corrected, and obtain the correction factors including: Calibrate the wide-angle cameras corresponding to the multispectral optical camera and the long-wave infrared thermal imager to obtain the radial distortion coefficient; According to the distortion mapping relationship and the radial distortion coefficient, the image to be corrected is mapped to the spatial coordinates of the target corrected image to obtain a mapped image; the distortion mapping relationship is used to represent the association of the radius from the point to the center of the distorted image; The holes in the mapped image are completely filled using the nearest neighbor interpolation algorithm to obtain a geometrically corrected image.

[0014] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, a control method for a multi-source environmental data acquisition system as described in any one of the above is implemented.

[0015] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the control method of the multi-source environmental data acquisition system as described in any one of the above is implemented.

[0016] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the control method of the multi-source environmental data acquisition system as described in any one of the above is implemented.

[0017] The control method and device of the multi-source environmental data acquisition system provided by the present invention are characterized in that at least two different imaging devices are installed on a photoelectric turntable, and the switch states and shooting angles of the at least two different imaging devices are adjusted by a control module according to user instructions to obtain an image to be corrected. Finally, the correction module is used to perform target correction on the image to be corrected to obtain a correction factor, and target analysis is performed on the image to be corrected according to the correction factor to obtain multi-source environmental data, thereby improving the convenience of multi-source data acquisition and the accuracy of data measurement. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1 This is one of the structural schematic diagrams of the multi-source environmental data acquisition system provided by the present invention.

[0020] Figure 2 This is the second structural schematic diagram of the multi-source environmental data acquisition system provided by the present invention.

[0021] Figure 3 It is a flow chart of the control method of the multi-source environmental data acquisition system provided by the present invention.

[0022] Figure 4 It is a schematic flow chart of the radiation correction method provided by the present invention.

[0023] Figure 5 It is a flow chart of the geometric correction method provided by the present invention.

[0024] Figure 6It is a structural schematic diagram of the electronic device provided by the present invention.

[0025] Reference numerals: 110: photoelectric turntable; 120: control module; 130: correction module; 140: Power module. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0027] Combine the following Figure 1-Figure 5 The multi-source environmental data acquisition system and control method thereof of the present invention are described.

[0028] Figure 1 This is one of the structural diagrams of the multi-source environmental data acquisition system provided by the present invention. Figure 1 As shown, the multi-source environmental data acquisition system includes a photoelectric turntable 110 , a control module 120 and a correction module 130 .

[0029] The photoelectric turntable 110 is equipped with at least two different imaging devices.

[0030] In this embodiment, the optoelectronic turntable 110 can be a two-dimensional optoelectronic turntable equipped with two imaging devices, for example, the two-dimensional optoelectronic turntable includes a multi-spectral optical camera and a long-wave infrared thermal imager; the optoelectronic turntable can be a three-dimensional optoelectronic turntable equipped with three different imaging devices, or it can be other multi-dimensional optoelectronic turntable equipped with multiple different imaging devices.

[0031] In this embodiment, the imaging device can be rotatably installed on the photoelectric turntable 110, and images with different visuals can be captured by controlling the rotation angle of the imaging device; the imaging device can also be fixedly installed on the photoelectric turntable 110, and images with different visuals can be captured by controlling the rotation angle of the photoelectric turntable 110.

[0032] In this embodiment, each time an image is captured, at least two different imaging devices installed on the photoelectric turntable 110 may work simultaneously, or any one of the imaging devices may work alone.

[0033] The control module 120 is used to adjust the switch status and shooting angle of at least two different imaging devices according to user instructions to obtain the image to be corrected; wherein the image to be corrected is collected by at least one of the at least two different imaging devices.

[0034] In this embodiment, the control module 120 controls the working state and shooting angle of the imaging device according to the actual acquisition requirements of the user.

[0035] For example, the optoelectronic turntable 110 includes a long-wave infrared thermal imager. When performing radiation correction on an image, the control module 120 controls the long-wave infrared thermal imager to turn on and rotate the camera to a first angle to acquire an infrared radiation image, and then performs radiation correction on the infrared radiation image.

[0036] The correction module 130 is used to perform target correction on the image to be corrected to obtain a correction factor, and perform target analysis on the image to be corrected based on the correction factor to obtain multi-source environmental data; wherein the target correction includes at least one of geometric correction, radiation correction, color correction and brightness correction; the target analysis includes at least one of image color analysis, brightness analysis and temperature analysis.

[0037] In this embodiment, the correction factor may be a radiation calibration equation, a color and brightness calibration equation, etc., which is obtained by linearly fitting the measured data and the predicted data.

[0038] In this embodiment, the background color and brightness analysis of the image to be corrected can be performed by bringing the collected images of different spectral channels into the color and brightness calibration equations to calculate the reflectance of different spectral channels, thereby determining the temperature data corresponding to the corrected image; the temperature analysis of the image to be corrected can be performed by bringing the collected infrared image data into the radiation calibration equation to calculate the image radiation brightness distribution.

[0039] In this embodiment, more accurate multi-source environmental data is acquired through the correction module 130, and the data is applied to environmental monitoring, disaster emergency response or reconnaissance missions to improve the mission success rate.

[0040] The multi-source environmental data acquisition system provided by the embodiment of the present invention has at least two different imaging devices installed on the photoelectric turntable 110, and the control module 120 adjusts the switch status and shooting angle of at least two different imaging devices according to user instructions to obtain the image to be corrected. Finally, the correction module 130 is used to perform target correction on the image to be corrected to obtain the correction factor, and perform target analysis on the image to be corrected according to the correction factor to obtain multi-source environmental data, thereby improving the convenience of multi-source data acquisition and the accuracy of data measurement.

[0041] In some embodiments, the multi-source environmental data acquisition system further includes a power supply module 140 for supplying power to the optoelectronic turntable 110 , the control module 120 , and the correction module 130 to ensure stable operation of the system.

[0042] In some embodiments, at least two different imaging devices include a multispectral optical camera and a long-wave infrared thermal imager; the control module 120 is used to control the optoelectronic turntable 110 to perform at least one of the following operations according to user instructions: control the multispectral optical camera to collect multispectral images of the target scene; control the long-wave infrared thermal imager to collect infrared radiation images of the target scene.

[0043] In this embodiment, the optoelectronic turntable 110 is a two-dimensional optoelectronic turntable, which is equipped with a spectral optical camera and a long-wave infrared thermal imager; correspondingly, the controller can control the two imaging devices to work simultaneously, or can control one of the two imaging devices separately.

[0044] For example, the two-dimensional optoelectronic turntable includes a multi-spectral optical camera and a long-wave infrared thermal imager. When performing radiation correction on an image, the control module 120 controls the long-wave infrared thermal imager to turn on, and collects an infrared radiation image after rotating it by a first angle, and then performs radiation correction on the infrared radiation image.

[0045] For example, the two-dimensional optoelectronic turntable includes a multi-spectral optical camera and a long-wave infrared thermal imager. When color correction is performed on an image, the long-wave infrared thermal imager is controlled to open by the control module 120, and an infrared radiation image is acquired after rotating by a second angle, and then color correction is performed on the infrared radiation image; the multi-spectral optical camera is controlled to open by the control module 120, and a multi-spectral image is acquired after rotating by a third angle, and then color correction is performed on the multi-spectral image.

[0046] Figure 2 This is the second structural diagram of the multi-source environmental data acquisition system provided by the present invention. Figure 2 In the illustrated embodiment, the control module of the main control computer (including a control module and a correction module) controls the multispectral optical camera and / or the long-wave infrared thermal imager on the photoelectric turntable to respectively collect multispectral images (corresponding optical images) and / or infrared radiation images (corresponding infrared images), and transmit them to the correction module of the main control computer through the transmission module (network cable), and correct and analyze the images to obtain corresponding image data; the main control computer is powered by the power module.

[0047] The multi-source environmental data acquisition system provided by the embodiment of the present invention can acquire two different types of images synchronously or asynchronously by setting up imaging devices including a multi-spectral optical camera and a long-wave infrared thermal imager, thereby improving the multi-source data processing efficiency.

[0048] In some embodiments, the wavebands collected by the multispectral camera include visible light and shortwave infrared wavebands, and the number of spectral channels of the multispectral image is no less than four.

[0049] In this embodiment, the multispectral camera configured as above can collect image data of richer wavelength bands, thereby improving the quality of the multispectral image.

[0050] In some embodiments, the multi-spectral camera is rotatably mounted on the optoelectronic turntable 110 , the long-wave infrared thermal imager is rotatably mounted on the optoelectronic turntable 110 , and the infrared thermal imager is mounted parallel to the optical axis of the multi-spectral camera.

[0051] In this embodiment, the optoelectronic turntable 110 of the above structure can realize 360-degree visual data collection without interfering with each other, thereby improving the stability of the operation of the optoelectronic turntable 110 .

[0052] The control method of the multi-source environmental data acquisition system provided by the present invention is described below. The control method of the multi-source environmental data acquisition system described below and the multi-source environmental data acquisition system described above can be referred to each other.

[0053] Figure 3 FIG. 1 is a flow chart of a control method of a multi-source environmental data acquisition system provided by the present invention. Figure 3 As shown, the control method of the multi-source environmental data acquisition system includes the following steps: Step 310: Adjust the switch states and shooting angles of at least two different imaging devices installed on the photoelectric turntable according to user instructions to obtain an image to be corrected; wherein the image to be corrected is collected by at least one of the at least two different imaging devices.

[0054] In this step, the optoelectronic turntable can be a two-dimensional optoelectronic turntable equipped with two imaging devices, for example, the two-dimensional optoelectronic turntable includes a multi-spectral optical camera and a long-wave infrared thermal imager; the optoelectronic turntable can be a three-dimensional optoelectronic turntable equipped with three different imaging devices, or it can be other multi-dimensional optoelectronic turntable equipped with multiple different imaging devices.

[0055] In this step, the imaging device can be rotatably mounted on the photoelectric turntable, and images with different visuals can be captured by controlling the rotation angle of the imaging device; the imaging device can also be fixedly mounted on the photoelectric turntable, and images with different visuals can be captured by controlling the rotation angle of the photoelectric turntable.

[0056] In this embodiment, each time an image is captured, at least two different imaging devices installed on the photoelectric turntable may work simultaneously, or any one of the imaging devices may work alone.

[0057] In this embodiment, the control module controls the working state and shooting angle of the imaging device according to the actual acquisition requirements of the user.

[0058] For example, the optoelectronic turntable includes a long-wave infrared thermal imager. When performing radiation correction on an image, the control module controls the long-wave infrared thermal imager to turn on, rotate the long-wave infrared thermal imager to a first angle, and then collect an infrared radiation image, and then perform radiation correction on the infrared radiation image.

[0059] Step 320, target correction is performed on the image to be corrected to obtain a correction factor, and target analysis is performed on the image to be corrected based on the correction factor to obtain multi-source environmental data; wherein the target correction includes at least one of geometric correction, radiation correction, color correction and brightness correction; and the target analysis includes at least one of image color analysis, brightness analysis and temperature analysis.

[0060] In this step, the correction factor may be a radiation calibration equation, a color and brightness calibration equation, etc., which is obtained by linear fitting of measured data and predicted data.

[0061] In this embodiment, the background color and brightness analysis of the image to be corrected can be performed by bringing the collected images of different spectral channels into the color and brightness calibration equations to calculate the reflectance of different spectral channels, thereby determining the temperature data corresponding to the corrected image; the temperature analysis of the image to be corrected can be performed by bringing the collected infrared image data into the radiation calibration equation to calculate the image radiation brightness distribution.

[0062] In this embodiment, more accurate multi-source environmental data is acquired through the correction module, and the data is applied to environmental monitoring, disaster emergency response or reconnaissance missions to improve the mission success rate.

[0063] The control method of the multi-source environmental data acquisition system provided by the embodiment of the present invention is that at least two different imaging devices are installed on the photoelectric turntable, and the control module adjusts the switch state and shooting angle of at least two different imaging devices according to user instructions to obtain the image to be corrected. Finally, the correction module is used to perform target correction on the image to be corrected to obtain the correction factor, and perform target analysis on the image to be corrected according to the correction factor to obtain multi-source environmental data, thereby improving the convenience of multi-source data acquisition and the accuracy of data measurement.

[0064] In some embodiments, at least two different imaging devices include a multispectral optical camera and a long-wave infrared thermal imager; the image to be corrected includes a multispectral image acquired by the multispectral optical camera and an infrared radiation image acquired by the long-wave infrared thermal imager; the target correction is color correction; performing target correction on the image to be corrected to obtain the correction factor includes: calibrating the image to be corrected by a light intensity correction method, and converting the calibrated image into a relative reflectivity image, the relative reflectivity image includes a plurality of calibration plate areas; calculating the pixel mean of the plurality of calibration plate areas in the relative reflectivity image, and performing linear regression between the pixel mean and the true reflectivity value corresponding to the relative reflectivity image by the following formula to determine the first radiation calibration equation: Ref1=Gain1*DL+Offset1; Wherein, Ref1 is the color correction coefficient, Gain1 and Offset1 are calibration coefficients, and DL is the grayscale value of the image to be corrected.

[0065] The control method of the multi-source environmental data acquisition system provided by the embodiment of the present invention calibrates the image to be corrected by a light intensity correction method, and converts the calibrated image into a relative reflectance image, then calculates the pixel mean of multiple calibration plate areas in the relative reflectance image, and linearly regresses the pixel mean with the true reflectance value corresponding to the relative reflectance image through the following formula, thereby determining the color correction factor, which can improve the image color correction accuracy.

[0066] In some embodiments, at least two different imaging devices include a long-wave infrared thermal imager; the image to be corrected includes an infrared radiation image collected by the long-wave infrared thermal imager; the target correction is radiation correction; performing target correction on the image to be corrected to obtain the correction factor further includes: performing non-uniform correction on the long-wave infrared thermal imager according to the integration time of the long-wave infrared thermal imager to obtain a corrected long-wave infrared thermal imager; taking a black body radiation source as a standard, calculating the radiation brightness of the black body through the black body temperature and the black body emissivity, imaging the black body through the corrected long-wave infrared thermal imager, obtaining the gray value of the black body imaged on the thermal imager, performing linear fitting on the radiation brightness and the gray value, and determining the second radiation calibration equation: Ref2=Gain1*DL+Offset1; Wherein, Ref2 is the radiation correction coefficient, Gain2 and Offset2 are calibration coefficients, and DL is the grayscale value of the image to be corrected.

[0067] Figure 4 is a schematic flow chart of the radiation correction method provided by the present invention. Figure 4 In the illustrated embodiment, radiation correction of the image to be corrected is achieved through the following steps: (1) reading a calibration file; (2) imaging a black body through a thermal imager and recording the grayscale value of the black body imaged on the thermal imager, i.e., obtaining the grayscale value of the image; (3) obtaining the temperature value of the black body; (4) calculating the radiation brightness of the black body through the black body temperature and the black body emissivity; (5) changing the black body temperature, recording the one-to-one correspondence between multiple groups of radiation brightness values ​​L and grayscale values ​​DL, and obtaining the functional relationship between the radiation brightness and the grayscale value through a curve fitting algorithm; (6) calculating the calibration result based on the functional relationship.

[0068] The control method of the multi-source environmental data acquisition system provided by the embodiment of the present invention performs non-uniform correction on the long-wave infrared thermal imager through the integration time of the long-wave infrared thermal imager, and then uses the black body radiation source as the standard, calculates the radiation brightness of the black body through the black body temperature and the black body emissivity, and images the black body through the calibrated long-wave infrared thermal imager to obtain the gray value of the black body imaged on the thermal imager, and finally performs linear fitting on the radiation brightness and gray value, and the functional relationship between the brightness and gray value, and then determines the radiation correction factor, which can improve the accuracy of image radiation correction.

[0069] In some embodiments, at least two different imaging devices include a multispectral optical camera and a long-wave infrared thermal imager; the image to be corrected includes a multispectral image captured by the multispectral optical camera and an infrared radiation image captured by the long-wave infrared thermal imager; the target correction is color correction; target correction is performed on the image to be corrected to obtain the correction factor, including: calibrating the wide-angle cameras corresponding to the multispectral optical camera and the long-wave infrared thermal imager respectively to obtain a radial distortion coefficient; mapping the image to be corrected to the spatial coordinates of the target correction image according to the distortion mapping relationship and the radial distortion coefficient to obtain a mapped image; the distortion mapping relationship is used to represent the association between a point and the radius of the center of the distorted image; and completely filling the holes in the mapped image using a nearest neighbor interpolation algorithm to obtain a geometrically corrected image.

[0070] Figure 5 is a schematic flow chart of the geometric correction method provided by the present invention. Figure 5 In the illustrated embodiment, geometric correction of the image to be corrected is achieved through the following steps: (1) inputting a distorted image; (2) calibrating the input distorted image to obtain a radial distortion coefficient; (3) determining a mapping image of the image to be corrected using a forward mapping relationship of spatial coordinates between a source image and a corrected image; (5) filling holes in the mapping image using a nearest neighbor interpolation method; and (6) outputting a corrected image.

[0071] Figure 6 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 6As shown, the electronic device may include: a processor 610, a communication interface 620, a memory 630 and a communication bus 640, wherein the processor 610, the communication interface 620 and the memory 630 communicate with each other through the communication bus 640. The processor 610 may call the logic instructions in the memory 630 to execute the control method of the multi-source environmental data acquisition system, the method comprising: adjusting the switch state and shooting angle of at least two different imaging devices installed on the photoelectric turntable according to the user instruction to obtain the image to be corrected; wherein the image to be corrected is collected by at least one of the at least two different imaging devices; performing target correction on the image to be corrected to obtain the correction factor, and performing target analysis on the image to be corrected according to the correction factor to obtain the multi-source environmental data; wherein the target correction includes at least one of geometric correction, radiation correction, color correction and brightness correction; and the target analysis includes at least one of image color analysis, brightness analysis and temperature analysis.

[0072] In addition, the logic instructions in the above-mentioned memory 630 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0073] On the other hand, the present invention also provides a computer program product, which includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the control method of the multi-source environmental data acquisition system provided by the above methods, the method including: adjusting the switch state and shooting angle of at least two different imaging devices installed on the photoelectric turntable according to user instructions to obtain an image to be corrected; wherein the image to be corrected is acquired by at least one of at least two different imaging devices; performing target correction on the image to be corrected to obtain a correction factor, and performing target analysis on the image to be corrected based on the correction factor to obtain multi-source environmental data; wherein the target correction includes at least one of geometric correction, radiation correction, color correction and brightness correction; the target analysis includes at least one of image color analysis, brightness analysis and temperature analysis.

[0074] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the control method of the multi-source environmental data acquisition system provided by the above-mentioned methods, the method comprising: adjusting the switch state and shooting angle of at least two different imaging devices installed on the photoelectric turntable according to user instructions to obtain an image to be corrected; wherein, the image to be corrected is acquired by at least one of at least two different imaging devices; performing target correction on the image to be corrected to obtain a correction factor, and performing target analysis on the image to be corrected based on the correction factor to obtain multi-source environmental data; wherein, the target correction includes at least one of geometric correction, radiation correction, color correction and brightness correction; the target analysis includes at least one of image color analysis, brightness analysis and temperature analysis.

[0075] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0076] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0077] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A multi-source environmental data acquisition system, characterized in that: include: An optoelectronic turntable, wherein the optoelectronic turntable is equipped with at least two different imaging devices; A control module, the control module is used to adjust the switch state and shooting angle of the at least two different imaging devices according to user instructions to obtain an image to be corrected; wherein the image to be corrected is collected by at least one of the at least two different imaging devices: A correction module, wherein the correction module is used to perform target correction on the image to be corrected to obtain a correction factor, and perform target analysis on the image to be corrected based on the correction factor to obtain multi-source environmental data; wherein the target correction includes at least one of geometric correction, radiation correction, color correction and brightness correction; and the target analysis includes at least one of image color analysis, brightness analysis and temperature analysis.

2. The multi-source environmental data acquisition system according to claim 1, characterized in that: The at least two different imaging devices include a multi-spectral optical camera and a long-wave infrared thermal imager; The control module is used to control the photoelectric turntable to perform at least one of the following operations according to the user instruction: Controlling the multispectral optical camera to collect a multispectral image of a target scene; The long-wave infrared thermal imager is controlled to collect an infrared radiation image of the target scene.

3. The multi-source environmental data acquisition system according to claim 2, characterized in that: The wavebands collected by the multi-spectral camera include visible light and short-wave infrared wavebands, and the number of spectral channels of the multi-spectral image is no less than four.

4. The multi-source environmental data acquisition system according to claim 2, characterized in that: The multi-spectral camera is rotatably mounted on the photoelectric turntable, the long-wave infrared thermal imager is rotatably mounted on the photoelectric turntable, and the infrared thermal imager is mounted parallel to the optical axis of the multi-spectral camera.

5. A control method for a multi-source environmental data acquisition system, characterized in that: include: According to user instructions, the switch states and shooting angles of at least two different imaging devices installed on the photoelectric turntable are adjusted to obtain an image to be corrected; wherein the image to be corrected is collected by at least one of the at least two different imaging devices; Perform target correction on the image to be corrected to obtain a correction factor, and perform target analysis on the image to be corrected based on the correction factor to obtain multi-source environmental data; wherein the target correction includes at least one of geometric correction, radiation correction, color correction and brightness correction; and the target analysis includes at least one of image color analysis, brightness analysis and temperature analysis.

6. The control method of the multi-source environmental data acquisition system according to claim 5, characterized in that: The at least two different imaging devices include a multispectral optical camera and a long-wave infrared thermal imager; the image to be corrected includes a multispectral image acquired by the multispectral optical camera and an infrared radiation image acquired by the long-wave infrared thermal imager; the target correction is color correction; The performing target correction on the image to be corrected to obtain the correction factor comprises: Calibrate the image to be calibrated by a light intensity calibration method, and convert the calibrated image into a relative reflectivity image, wherein the relative reflectivity image includes a plurality of calibration plate areas; Calculate the pixel mean of multiple calibration plate areas in the relative reflectance image, and perform linear regression between the pixel mean and the true reflectance value corresponding to the relative reflectance image by the following formula to determine the first radiation calibration equation: Ref1=Gain1*DL+Offset1; Wherein, Ref1 is a color correction coefficient, Gain1 and Offset1 are calibration coefficients, and DL is the grayscale value of the image to be corrected.

7. The control method of the multi-source environmental data acquisition system according to claim 5, characterized in that: The at least two different imaging devices include a long-wave infrared thermal imager; the image to be corrected includes an infrared radiation image collected by the long-wave infrared thermal imager; and the target correction is radiation correction; The performing target correction on the image to be corrected to obtain the correction factor further comprises: Performing non-uniform correction on the long-wave infrared thermal imager according to the integration time of the long-wave infrared thermal imager to obtain a corrected long-wave infrared thermal imager; Taking the black body radiation source as the standard, the radiation brightness of the black body is calculated by the black body temperature and the black body emissivity, and the black body is imaged by the calibrated long-wave infrared thermal imager to obtain the gray value of the black body imaged on the thermal imager, and the radiation brightness and the gray value are linearly fitted to determine the second radiation calibration equation: Ref2=Gain1*DL+Offset1; Wherein, Ref2 is the radiation correction coefficient, Gain2 and Offset2 are calibration coefficients, and DL is the grayscale value of the image to be corrected.

8. The control method of the multi-source environmental data acquisition system according to claim 5, characterized in that: The at least two different imaging devices include a multispectral optical camera and a long-wave infrared thermal imager; the image to be corrected includes a multispectral image acquired by the multispectral optical camera and an infrared radiation image acquired by the long-wave infrared thermal imager; the target correction is color correction; The performing target correction on the image to be corrected to obtain the correction factor comprises: Calibrate the wide-angle cameras corresponding to the multispectral optical camera and the long-wave infrared thermal imager to obtain radial distortion coefficients; Mapping the image to be corrected to the spatial coordinates of the target corrected image according to the distortion mapping relationship and the radial distortion coefficient to obtain a mapped image; the distortion mapping relationship is used to represent the association of the radius from a point to the center of the distorted image; Holes in the mapped image are completely filled using a nearest neighbor interpolation algorithm to obtain a geometrically corrected image.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the control method of the multi-source environmental data acquisition system as described in any one of claims 5 to 8 is implemented.

10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the control method of the multi-source environmental data acquisition system as claimed in any one of claims 5 to 8 is implemented.

Images