Image projection determination method and system, storage medium, and electronic device

Abstract

Embodiments of the present application provide a kind of image projection determination method and system, storage medium, electronic equipment, wherein the method comprises: using at least three different wave bands scene generator to the video frame image obtained to be projected is carried out infrared processing, obtain the multiple infrared images of video frame image;At least three kinds of infrared aperture angle matching lens corresponding to at least three kinds of different wave bands scene generator are selected to the multiple infrared images are carried out imaging processing, obtain at least three imaging results, at least three imaging results are imaged in the intermediate image plane of preestablished by determining the beam combination component of reflection wave band interval and transmission wave band interval, obtain the synthesis image of multiple infrared images;The output image aperture of projection component is corresponding to the synthesis image is carried out common aperture adjustment, and the three mirror system existing in projection component is used to carry out wide wave band chromatic aberration correction to common aperture adjustment result, determines the image projection corresponding to video frame image according to chromatic aberration correction result.

Description

Technical Field

[0001] This application relates to the field of infrared imaging, and more specifically, to a method and system for determining image projection, a storage medium, and an electronic device. Background Technology

[0002] With the mature application of infrared imaging technology, in order to reduce the number of field tests and lower testing costs and risks, it is necessary to test and evaluate the performance of infrared imaging seekers and various infrared imaging detectors in the laboratory beforehand. This test scheme is called the infrared imaging guidance hardware-in-the-loop simulation test scheme. Infrared scene generation technology is a key technology of the infrared imaging guidance hardware-in-the-loop simulation test system. It can simulate the infrared radiation characteristics of real targets and backgrounds in a laboratory environment, providing a high-quality infrared image source for the infrared detector under test. Related infrared scene generation devices include resistor arrays, digital micromirror devices, visible light / infrared image conversion chips, etc. Existing infrared scene projection devices mainly operate in the mid-wave infrared (3-5μm), long-wave infrared (8-14μm), or mid-long-wave (3-14μm) dual infrared bands.

[0003] Therefore, it can be seen that the infrared band determination image projection method in the relevant technology has the problem that it cannot achieve wide-band high-resolution composite infrared image simulation due to the limited coverage of the infrared band. Summary of the Invention

[0004] This application provides a method and system for determining image projection, a storage medium, and an electronic device to at least solve the problem in related technologies where infrared band image projection determination methods cannot achieve wide-band high-resolution composite infrared image simulation due to the limited coverage of the infrared band.

[0005] According to one embodiment of this application, a method for determining image projection is provided, comprising: performing infrared processing on an acquired video frame image to be projected using at least three different band scene generators to obtain multiple infrared images of the video frame image; selecting at least three infrared aperture angle-matching lenses corresponding to the at least three different band scene generators to perform imaging processing on the multiple infrared images to obtain at least three imaging results; imaging the at least three imaging results onto a preset intermediate image plane using a beam combiner that determines the reflection band interval and the transmission band interval to obtain a composite image of the multiple infrared images; adjusting the composite image to a common aperture using the output image aperture corresponding to the projection component, and performing wideband chromatic aberration correction on the common aperture adjustment result using a three-reflector system present in the projection component; and determining the image projection corresponding to the video frame image based on the chromatic aberration correction result.

[0006] In an exemplary embodiment, before performing infrared processing on the acquired video frame image to be projected using at least three different scene generators, the method further includes: determining the wavelength range corresponding to each of the at least three different scene generators; determining the band type corresponding to each scene generator based on the wavelength range; obtaining chip parameters and band processing parameters corresponding to the band type, wherein the chip parameters include at least: the chip performance used by each scene generator, and the band processing parameters include at least: the write optical power for converting the video frame image into a corresponding optical image in each scene generator, and the transmission band size of the optical image on different transmission components in each scene generator; and determining the image band after performing infrared processing on the video frame image using the wavelength range of each scene generator based on the wavelength range, the chip parameters, and the band processing parameters.

[0007] In an exemplary embodiment, after determining the band type corresponding to each scene generator based on the wavelength range, the method further includes: when the band type is determined to be a mid-wave and / or long-wave band, verifying each scene generator according to the composition structure of a first type of preset scene generator, wherein the composition structure of the first type of preset scene generator includes at least: a visible light illumination system, an image writing system based on a DMD spatial light modulator, a writing optical relay optical system, an infrared image conversion system based on a conversion chip, a mid-wave and / or long-wave infrared relay optical system, and a bandpass filter system; when the band type is determined to be a short-wave band, verifying each scene generator according to the composition structure of a second type of preset scene generator, wherein the composition structure of the second type of preset scene generator includes at least: a visible light illumination system, an image writing system based on a DMD spatial light modulator, a short-wave infrared relay optical system, and a bandpass filter system.

[0008] In an exemplary embodiment, before performing infrared processing on the acquired video frame image to be projected using scene generators of at least three different bands, the method further includes: determining image feature information corresponding to the video frame image to be projected, wherein the image feature information includes at least: infrared feature information of the image and resolution feature information of the image; comparing the difference between the image feature information and preset standard feature information; and allowing the video frame image to be projected to be written as an image source into the scene generators of the at least three different bands if the difference is less than a preset projection difference.

[0009] In one exemplary embodiment, the scene generator with at least three different bands includes at least: an illumination DMD chip corresponding to a DMD spatial light modulator, and an imaging DMD chip corresponding to a DMD spatial light modulator. The infrared processing of the acquired video frame image to be projected using the scene generator with at least three different bands includes: providing illumination intensity to the illumination DMD chip through the visible light illumination system of the scene generator with at least three different bands; illuminating the video frame image onto the imaging DMD chip according to the illumination intensity; when an illumination image exists on the imaging DMD chip, instructing a first driver corresponding to the imaging DMD chip to control the switching state of each micromirror on the imaging DMD chip according to the grayscale level of each pixel in the illumination image; and transmitting the illumination image through a scene channel to the infrared relay optical system present in the scene generator with at least three different bands according to the switching state of each micromirror, thereby completing the infrared processing of the video frame image.

[0010] In an exemplary embodiment, before transmitting the illumination image through the scene channel to the infrared relay optical system present in the scene generator of at least three different bands according to the on / off state of each micromirror, the method further includes: determining that a conversion chip exists in the scene channel when the band type corresponding to the scene generator is determined to be mid-band and / or long-band; instructing the conversion chip to perform temperature conversion according to the light intensity corresponding to different regions in the illumination image to obtain temperature distribution data corresponding to the illumination image; using the temperature distribution data to determine the infrared converted image corresponding to the video frame image, and using the infrared converted image to replace the illumination image for transmission in the scene channel.

[0011] In an exemplary embodiment, after selecting at least three infrared aperture angle-matching lenses corresponding to the at least three different band scene generators to perform imaging processing on the plurality of infrared images and obtain at least three imaging results, the method further includes: when the at least three infrared aperture angle-matching lenses include at least: a mid-wave infrared aperture angle-matching lens and a long-wave infrared aperture angle-matching lens, acquiring a first imaging result output by the mid-wave infrared aperture angle-matching lens and acquiring a second imaging result output by the long-wave infrared aperture angle-matching lens; and combining the first imaging result and the second imaging result using a first sub-component in the beam combining assembly. The beam combiner is a first composite image, wherein the first sub-component is used to reflect the infrared image from the long-wave infrared aperture angle-matched lens and transmit the infrared image from the mid-wave infrared aperture angle-matched lens; when the at least three infrared aperture angle-matched lenses further include a short-wave infrared aperture angle-matched lens, a third imaging result output by the short-wave infrared aperture angle-matched lens is acquired; the third imaging result and the first composite image are combined into a second composite image using a second sub-component in the beam combiner assembly, wherein the second sub-component is used to reflect the infrared image from the short-wave infrared aperture angle-matched lens and transmit the first composite image.

[0012] According to another embodiment of this application, an image projection determination system is provided, comprising: at least three scene generators for performing infrared processing on a video frame image to be projected to obtain multiple infrared images of the video frame image, wherein the at least three scene generators have a one-to-one relationship with at least three different wavebands; a beam combiner connected to the at least three scene generators respectively, for selecting at least three infrared aperture angle matching lenses corresponding to the at least three different waveband scene generators to perform imaging processing on the multiple infrared images to obtain at least three imaging results; imaging the at least three imaging results onto a preset intermediate image plane to obtain a composite image of the multiple infrared images, wherein the beam combiner has a defined reflection waveband range and a transmission waveband range; a projection component connected to the beam combiner, for performing common aperture adjustment on the composite image through the output image aperture corresponding to the projection component, and performing wide-band chromatic aberration correction on the common aperture adjustment result using a three-reflector system present in the projection component; and determining the image projection corresponding to the video frame image based on the chromatic aberration correction result.

[0013] In one exemplary embodiment, the image projection determination system further includes: a control system for controlling the selection of the video frame image to be projected and the generation progress of the image projection.

[0014] In one exemplary embodiment, the visible light illumination system in the at least three scene generators includes at least: an illumination source connected to an illumination DMD chip corresponding to a DMD spatial light modulator included in the at least three scene generators, for providing uniform illumination light to the illumination DMD chip; a first auxiliary light source connected to the illumination DMD chip, for providing additional illumination light to the illumination DMD chip; a second auxiliary light source connected to an imaging DMD chip corresponding to a DMD spatial light modulator included in the at least three scene generators, for providing additional illumination light to the imaging DMD chip; a first absorption cell connected to the illumination DMD chip, for receiving uniform illumination light reflected by micromirrors in the illumination DMD chip in an off state; and a second absorption cell connected to the imaging DMD chip, for receiving uniform illumination light reflected by micromirrors in the imaging DMD chip in an off state.

[0015] In one exemplary embodiment, the visible light illumination system further includes: an illumination DMD chip, configured to adjust the switching state of each micromirror according to a switching state ratio, wherein the switching state ratio is used to indicate the micromirror switching state information corresponding to the illumination power modulated by the illumination DMD driver for the video frame image to be projected; and an imaging DMD chip, connected to the illumination DMD chip, configured to adjust the switching state of each micromirror according to the grayscale level of each pixel in the image output by the illumination DMD chip.

[0016] According to yet another embodiment of this application, a computer-readable storage medium is also provided, wherein a computer program is stored therein, and the computer program is configured to perform the steps in any of the above method embodiments when it is run.

[0017] According to yet another embodiment of this application, an electronic device is also provided, including a memory and a processor, wherein the memory stores a computer program and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.

[0018] This application addresses the issue that by using scene generators with at least three different bands to generate the video frame image to be projected, the infrared image corresponding to the video frame image to be projected is determined to have at least three bands, thus covering a wider band range. Furthermore, a beam combiner is used to synthesize multiple infrared images, and the synthesized image is preprocessed by a projection component before being projected. The resulting image projection has a wide-band, high-resolution composite infrared image, thereby improving the coverage and accuracy of the image projection in the infrared band. Therefore, this application solves the problem in related technologies where infrared band determination image projection methods cannot achieve wide-band, high-resolution composite infrared image simulation due to the limited coverage of the infrared band, thus improving the simulation efficiency and accuracy of wide-band, high-resolution composite infrared images. Attached Figure Description

[0019] Figure 1 This is a hardware structure block diagram of infrared imaging detection for an image projection determination method according to an embodiment of this application;

[0020] Figure 2 This is a flowchart of a method for determining image projection according to an embodiment of this application;

[0021] Figure 3 This is a block diagram of a broadband composite projection optical system according to an embodiment of this application;

[0022] Figure 4 This is a schematic diagram of the structure of an optional infrared image projection device according to an embodiment of this application;

[0023] Figure 5 This is a schematic diagram of an optional mid / long-wave infrared image generation channel optical path according to an embodiment of this application;

[0024] Figure 6 This is a structural block diagram of an image projection determination system according to an embodiment of this application. Detailed Implementation

[0025] The embodiments of this application will be described in detail below with reference to the accompanying drawings and examples.

[0026] It should be noted that the terms "first," "second," etc., in the specification, claims, and drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.

[0027] The methods and embodiments provided in this application can be executed in infrared imaging detection or similar computing devices. Taking operation on infrared imaging detection as an example, Figure 1 This is a hardware structure block diagram of an infrared imaging detection method for determining image projection according to an embodiment of this application. For example... Figure 1 As shown, infrared imaging detection can include one or more ( Figure 1 Only one is shown in the image. A processor 102 (which may include, but is not limited to, a microprocessor MCU or a programmable logic device FPGA, etc.) and a memory 104 for storing data are also shown. The infrared imaging detection may further include a transmission device 106 for communication functions and an input / output device 108. Those skilled in the art will understand that... Figure 1 The structure shown is for illustrative purposes only and does not limit the structure of the infrared imaging detection described above. For example, infrared imaging detection may also include... Figure 1 The more or fewer components shown, or having the same Figure 1 The different configurations shown.

[0028] The memory 104 can be used to store computer programs, such as application software programs and modules, like the computer program corresponding to the image projection determination method in this embodiment. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, thereby implementing the above-described method. The memory 104 may include high-speed random access memory and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory remotely located relative to the processor 102, and these remote memories can be connected to infrared imaging detection via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0029] The transmission device 106 is used to receive or send data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider for infrared imaging detection. In one example, the transmission device 106 includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device 106 may be a Radio Frequency (RF) module used for wireless communication with the Internet.

[0030] This embodiment provides a method for determining image projection. Figure 2 This is a flowchart of an image projection determination method according to an embodiment of this application, such as... Figure 2 As shown, the process includes the following steps:

[0031] Step S202: Use at least three different band scene generators to perform infrared processing on the acquired video frame image to be projected to obtain multiple infrared images of the video frame image.

[0032] Step S204: Select at least three infrared aperture angle matching lenses corresponding to the scene generators of at least three different bands to perform imaging processing on the multiple infrared images to obtain at least three imaging results; image the at least three imaging results onto a preset intermediate image plane through a beam combining component that determines the reflection band interval and the transmission band interval to obtain a composite image of the multiple infrared images.

[0033] Step S206: Adjust the common aperture of the synthesized image by the output image aperture corresponding to the projection component, and use the three-reflector system in the projection component to perform wideband color difference correction on the common aperture adjustment result, and determine the image projection corresponding to the video frame image based on the color difference correction result.

[0034] Through the above steps, by using scene generators with at least three different bands to generate the video frame images to be projected, the infrared images corresponding to the video frame images to be projected are determined to have at least three bands, thus covering a large band range. In addition, multiple infrared images are imaged and synthesized using a beam combiner, and the synthesized image is projected and preprocessed by a projection component before being output. The resulting image projection has a wide-band, high-resolution composite infrared image, thereby improving the coverage and accuracy of the image projection in the infrared band. Therefore, it can solve the problem in related technologies where infrared band determination image projection methods cannot achieve wide-band, high-resolution composite infrared image simulation due to the limited coverage of the infrared band, thus improving the simulation efficiency and accuracy of wide-band, high-resolution composite infrared images.

[0035] The entities performing the above steps can be infrared imaging detectors, infrared imaging seekers, etc., but are not limited to these.

[0036] In an exemplary embodiment, before performing infrared processing on the acquired video frame image to be projected using at least three different scene generators, the method further includes: determining the wavelength range corresponding to each of the at least three different scene generators; determining the band type corresponding to each scene generator based on the wavelength range; obtaining chip parameters and band processing parameters corresponding to the band type, wherein the chip parameters include at least: the chip performance used by each scene generator, and the band processing parameters include at least: the write optical power for converting the video frame image into a corresponding optical image in each scene generator, and the transmission band size of the optical image on different transmission components in each scene generator; and determining the image band after performing infrared processing on the video frame image using the wavelength range of each scene generator based on the wavelength range, the chip parameters, and the band processing parameters.

[0037] It can be understood that different scene generators correspond to different wavelength ranges. Therefore, when different scene generators are used to process video frame images, the resulting infrared images will also correspond to different image bands.

[0038] For example, when using a 0.9-2.5μm shortwave scene generator to process video frame images, the generated image bands will be approximately between 0.9-2.5μm. However, when using a 3-14μm medium / longwave scene generator, depending on the selection, an infrared image in the 3-5μm image band or an infrared image in the 8-14μm image band can be output.

[0039] It should be noted that the spatial resolution and frame rate of the scene generator are related to the performance of the DMD (Digital Micromirror Device, or spatial light modulator) and the conversion chip. The spectrum simulated by the scene generator is related to the temperature of the conversion chip (written optical power), the transmission band of the infrared image converter cavity window, and the transmission band of the bandpass filter. The short-wave infrared scene generator uses a scheme where a short-wave infrared light source illuminates the DMD spatial light modulator. The spatial resolution and frame rate of the scene generator are directly related to the performance of the DMD. The spectrum simulated by the scene generator is related to the reflection spectrum of the spatial light modulator and the transmission band of the bandpass filter.

[0040] In summary, the above implementation methods significantly increase the coverage area of ​​the generated infrared images, providing a sufficiently wide range of infrared images to choose from when conducting infrared imaging-guided hardware-in-the-loop simulation experiments. This improves the simulation effect of wide-band, high-resolution composite infrared image simulation. Furthermore, by determining the corresponding chip parameters and band processing parameters, the image band corresponding to the infrared image output by the scene generator can be accurately located. This ensures that when more images are needed in the simulation, the appropriate image generator can be selected for rapid image generation.

[0041] In an exemplary embodiment, after determining the band type corresponding to each scene generator based on the wavelength range, the method further includes: when the band type is determined to be a mid-wave band and / or a long-wave band, verifying each scene generator according to the composition structure of a first type of preset scene generator, wherein the composition structure of the first type of preset scene generator includes at least: a visible light illumination system, an image writing system based on a DMD spatial light modulator, a writing optical relay optical system, an infrared image conversion system based on a conversion chip, a mid-wave and / or long-wave infrared relay optical system, and a bandpass filter system.

[0042] Optionally, the mid / long-wave infrared scene channel is based on a visible light / infrared conversion chip solution, which can generate a blackbody-like full radiation spectrum. It consists of a visible light illumination system, an image writing system based on a DMD spatial light modulator, a writing optical relay optical system, an infrared image conversion system based on the conversion chip, a mid / long-wave infrared relay optical system, and a bandpass filtering system.

[0043] In an exemplary embodiment, after determining the band type corresponding to each scene generator according to the wavelength range, the method further includes: when the band type is determined to be a short band, verifying each scene generator according to the composition structure of a second type of preset scene generator, wherein the composition structure of the second type of preset scene generator includes at least: a visible light illumination system, an image writing system based on a DMD spatial light modulator, a short-wave infrared relay optical system, and a bandpass filter system.

[0044] Optionally, the spectrum of the shortwave scene generator is related to the spectrum of the shortwave light source; this application uses a high-temperature blackbody. The DMD chip is a reflective device, and its reflection spectrum directly determines the maximum achievable wavelength range of the shortwave scene generator. This application uses TI's DLP Discovery 4100 chipset, with aluminum micromirrors, 88% visible light reflectivity, and infrared coverage up to 5μm. The reflected light from the micromirrors needs to be output again through the DMD window using original Corning 7056 glass, with a cutoff wavelength of 2.7μm, visible light transmittance >97%, and 0.9-2.5μm transmittance >75%. The commonly used 0.9-2μm transmittance is greater than 95%, meeting the usage requirements.

[0045] It should be noted that the above is merely an example and does not limit the composition of the shortwave scene generator in this application.

[0046] In summary, the above-described design scheme can significantly improve the generation efficiency of the shortwave scene generator and the accuracy of the generated composite infrared images.

[0047] In an exemplary embodiment, before performing infrared processing on the acquired video frame image to be projected using scene generators of at least three different bands, the method further includes: determining image feature information corresponding to the video frame image to be projected, wherein the image feature information includes at least: infrared feature information of the image and resolution feature information of the image; comparing the difference between the image feature information and preset standard feature information; and allowing the video frame image to be projected to be written as an image source into the scene generators of the at least three different bands if the difference is less than a preset projection difference.

[0048] In other words, to avoid using an image generator to process inaccurate video frame images, the video frame images can be verified in advance before infrared processing to ensure that the images in the video frame images meet the requirements of subsequent simulations.

[0049] In summary, the above implementation methods ensure the efficiency of the generated final infrared image in the simulation, improve the generation quality of the infrared image, and enhance the accuracy of the simulation effect.

[0050] In one exemplary embodiment, the scene generator with at least three different bands includes at least: an illumination DMD chip corresponding to a DMD spatial light modulator, and an imaging DMD chip corresponding to a DMD spatial light modulator. The infrared processing of the acquired video frame image to be projected using the scene generator with at least three different bands includes: providing illumination intensity to the illumination DMD chip through the visible light illumination system of the scene generator with at least three different bands; illuminating the video frame image onto the imaging DMD chip according to the illumination intensity; when an illumination image exists on the imaging DMD chip, instructing a first driver corresponding to the imaging DMD chip to control the switching state of each micromirror on the imaging DMD chip according to the grayscale level of each pixel in the illumination image; and transmitting the illumination image through a scene channel to the infrared relay optical system present in the scene generator with at least three different bands according to the switching state of each micromirror, thereby completing the infrared processing of the video frame image.

[0051] Understandably, during imaging, the light source provided by the illumination system displays the corresponding video frame image on the imaging DMD chip, which then transmits it through the corresponding optical path. The imaging DMD chip and the illumination DMD chip control the light to the corresponding image by switching the micromirrors on their respective chips. In other words, the DMD chip can convert different video frame images into illumination images, thereby converting the color differences in the video frame images into corresponding differences in illumination intensity.

[0052] In summary, the above implementation methods can achieve rapid conversion of video frame images, and then perform infrared processing on different wavelengths in the corresponding optical path channels.

[0053] In an exemplary embodiment, before transmitting the illumination image through the scene channel to the infrared relay optical system present in the scene generator of at least three different bands according to the on / off state of each micromirror, the method further includes: determining that a conversion chip exists in the scene channel when the band type corresponding to the scene generator is determined to be mid-band and / or long-band; instructing the conversion chip to perform temperature conversion according to the light intensity corresponding to different regions in the illumination image to obtain temperature distribution data corresponding to the illumination image; using the temperature distribution data to determine the infrared converted image corresponding to the video frame image, and using the infrared converted image to replace the illumination image for transmission in the scene channel.

[0054] It should be noted that the visible light / infrared conversion chip is a multilayer thin-film device with an integrated pixel array. It can absorb visible light energy and generate infrared image radiation through wavelength down-conversion of the material's radiation. The digital image is input to the DMD spatial light modulator, which outputs a light field with a spatially distributed intensity. This light field illuminates the conversion chip, which absorbs the energy of the written light and converts it into a spatially distributed temperature, thereby forming a spatially distributed infrared radiation field.

[0055] It should be noted that when the scene generator is a shortwave scene generator, the temperature displayed by the conversion chip is too high. Therefore, a shortwave light source can be used to directly illuminate the DMD spatial light modulator. Since the spectrum of the shortwave scene generator is related to the spectrum of the shortwave light source, the reflection spectrum directly determines the maximum achievable wavelength range of the shortwave scene generator. Therefore, the infrared image generated by the shortwave scene generator can be directly determined based on the reflection spectrum.

[0056] It is understandable that, given the video frame image to be projected, where different areas on the DMD chip are illuminated by corresponding light intensities, the corresponding areas on the conversion chip are controlled to display different temperatures based on changes in light intensity, thereby converting the illumination image into an infrared image.

[0057] As an optional implementation method, Figure 3 This is a block diagram of a wideband composite projection optical system according to an embodiment of this application; it is assumed that the scene generators for at least three different bands include: a mid-wave scene generator, a short-wave scene generator, and a long-wave scene generator. The mid-wave scene generator and the long-wave scene generator can be combined into a single mid / long-wave scene generator.

[0058] After the scene generator generates the infrared image, the short-wave infrared aperture angle matching optical system images the short-wave infrared image generated by the DMD onto the intermediate image plane, which is then projected to infinity through the main projection optical system. The mid-wave infrared aperture angle matching lens images the mid-wave infrared image generated by the conversion chip onto the intermediate image plane, which is then projected to infinity through the main projection optical system. The long-wave lens works similarly. The beam combiner 1 reflects the infrared image from the long-wave infrared aperture angle matching lens and transmits the infrared image from the mid-wave infrared aperture angle matching lens, thus achieving the combined output of the mid-wave and long-wave infrared images. Based on the optical path requirements, the beam combiner 1 is a 5mm thick flat plate made of silicon, with a transmittance better than 99% in the mid-wave (3-5μm) band and a reflectance better than 97% in the long-wave (8-14μm) band. The function of beam combiner 2 is to reflect the infrared image from the short-wave infrared aperture angle-matched lens and transmit the combined mid-wave and long-wave infrared image from beam combiner 1, ultimately achieving common-aperture synthesis of the short-wave, mid-wave, and long-wave image channels. Based on optical path requirements, beam combiner 2 is made of a 5mm thick plate, with germanium as the material. The transmittance is better than 99% in the mid-wave (3–5μm) band, better than 99% in the long-wave (8–14μm) band, and better than 97% in the short-wave (0.9–1.7μm) band.

[0059] It should be noted that the above selection of materials is merely an example and does not limit this application. The above technical solution of this application can also be achieved by using other materials and parameters.

[0060] Through the above embodiments, comprehensive coverage of at least three different bands—short, medium, and long—can be achieved, effectively realizing wide-band high-resolution composite infrared image simulation with high imaging accuracy. Furthermore, by utilizing the configured optical system, the generated infrared images can be adjusted to a single channel for imaging and display, improving the processing efficiency of subsequent infrared images. Moreover, the aforementioned merging improves the band range of the infrared image application corresponding to the video frame image to be projected, thereby ensuring the effective realization of wide-band high-resolution composite infrared image simulation.

[0061] In one exemplary embodiment, after selecting at least three infrared aperture angle-matching lenses corresponding to the at least three different band scene generators to perform imaging processing on the plurality of infrared images and obtain at least three imaging results, the method further includes: when the at least three infrared aperture angle-matching lenses include at least: a mid-wave infrared aperture angle-matching lens and a long-wave infrared aperture angle-matching lens, acquiring a first imaging result output by the mid-wave infrared aperture angle-matching lens and acquiring a second imaging result output by the long-wave infrared aperture angle-matching lens; using a first sub-component in the beam combiner to combine the first imaging result and the second imaging result. The imaging results are combined into a first composite image, wherein the first sub-component is used to reflect the infrared image from the long-wave infrared aperture angle-matched lens and transmit the infrared image from the mid-wave infrared aperture angle-matched lens; when the at least three infrared aperture angle-matched lenses further include a short-wave infrared aperture angle-matched lens, a third imaging result output by the short-wave infrared aperture angle-matched lens is acquired; the third imaging result and the first composite image are combined into a second composite image using a second sub-component in the beam combining assembly, wherein the second sub-component is used to reflect the infrared image from the short-wave infrared aperture angle-matched lens and transmit the first composite image.

[0062] Optionally, the above Figure 3 The broadband composite projection optical system also includes a main projection optical system, whose function is to composite and output the infrared images of the three bands on the intermediate image plane with a common aperture. A three-mirror system is used to correct chromatic aberration across the broadband.

[0063] Through the above embodiments, in the process of determining the projected image, not only is the infrared image composited and output, but the color difference in the wide band is also corrected through the three-reflector system in the main projection optical system, thereby ensuring the color effect of the composite infrared image.

[0064] As an optional implementation, the above-described method for determining image projection can be applied to, for example... Figure 4 In the infrared image projection device shown, Figure 4 This is a schematic diagram of an optional infrared image projection device according to an embodiment of this application, comprising: generating short-wave, medium-wave, and long-wave infrared scenes sequentially using three scene generators, integrating the wide-band scenes using a beam combiner, and finally outputting the image through a wide-band, common-aperture infrared projection optical system. Specifically, it includes: one 0.9-2.5μm short-wave scene generator, two 3-14μm medium / long-wave scene generators, a beam combiner system, a wide-band projection system, a control system, a vacuum system, and a cooling system.

[0065] Optionally, the mid / long-wave infrared scene channel is based on a visible / infrared conversion chip solution, capable of generating a blackbody-like full radiation spectrum. It consists of a visible light illumination system, an image writing system based on a DMD spatial light modulator, a writing optical relay optical system, an infrared image conversion system based on the conversion chip, a mid / long-wave infrared relay optical system, and a bandpass filter system. The spatial resolution and frame rate of the scene generator are related to the performance of the DMD and conversion chip. The spectrum simulated by the scene generator is related to the temperature of the conversion chip (writing optical power), the transmission band of the infrared image converter cavity window, and the transmission band of the bandpass filter. The short-wave infrared scene generator uses a short-wave infrared light source to illuminate the DMD spatial light modulator. The spatial resolution and frame rate of the scene generator are directly related to the performance of the DMD. The spectrum simulated by the scene generator is related to the reflection spectrum of the spatial light modulator and the transmission band of the bandpass filter. The three channels are combined by a beam combining system into a single image projection output, achieving multispectral infrared image simulation. The control system includes vacuum control, temperature control, synchronization control (including synchronization control between the test system, DMD, and lighting source), light source driver, self-test module, and control cabinet. The vacuum system and cooling system function to provide a high-vacuum and low-temperature operating environment for the infrared image conversion system.

[0066] For the mid / long-wave infrared scene channel, a high-resolution video image signal with infrared characteristics provides the image source for the image writing system, while the illumination system provides a uniform light source. The image writing system then generates a high-resolution, high-frame-rate visible light grayscale image. The generated image is imaged onto the surface of the conversion chip placed within the infrared image conversion system via a relay optical system.

[0067] As an optional implementation method, Figure 5 This is a schematic diagram of an optional mid / long-wave infrared image generation channel optical path according to an embodiment of this application. As shown in the figure, the illumination system includes an illumination source 1, an auxiliary source 1, an auxiliary source 2, an illumination DMD chip and its driver, an illumination source mirror group, an auxiliary source mirror group 1, an auxiliary source mirror group 2, a synchronous Köhler illumination mirror group, and an illumination DMD stray light absorption cell 1. The illumination source 1 provides uniform illumination to the illumination DMD chip. The illumination DMD driver controls the on / off state ratio of the illumination DMD chip to modulate the illumination power. When in the on state, the micromirrors reflect homogenizing light into the synchronous Köhler illumination mirror group to illuminate the imaging DMD chip. When in the off state, the micromirrors reflect homogenizing light into the illumination DMD stray light absorption cell 1. The auxiliary source 1 provides additional illumination light to the illumination DMD chip. The auxiliary source 2 provides additional illumination light to the imaging DMD chip.

[0068] The image writing system includes an imaging DMD chip and its driver, as well as an imaging DMD stray light absorption cell 2. The imaging DMD driver controls the on / off state of each micromirror on the imaging DMD chip according to the grayscale level of each pixel in the input image. Micromirrors in the on state reflect the homogenizing light from the illumination system into the visible light relay optical system, heating the corresponding pixel of the conversion chip. Micromirrors in the off state emit the homogenizing light from the illumination system into the imaging DMD stray light absorption cell 2.

[0069] The visible light / infrared conversion chip is a multilayer thin-film device with an integrated pixel array. It absorbs visible light energy and generates infrared image radiation through wavelength down-conversion of the material's radiation. The digital image is input to a DMD spatial light modulator, which outputs a light field with a spatially distributed intensity. This light field illuminates the conversion chip, which absorbs the energy of the written light and converts it into a spatially distributed temperature, thereby forming a spatially distributed infrared radiation field.

[0070] It should be noted that the conversion chip pixels absorb the written light energy, causing the pixel temperature to rise and radiate infrared energy outward. The conversion chip is a direct radiation device, producing blackbody-like radiation covering a range of 0.9–14 μm. The intensity of the infrared energy radiated by the pixel is proportional to the intensity of the absorbed written light. According to Wien's displacement law (λT ​​= 2897, where λ is the peak wavelength of blackbody radiation and T is the temperature of blackbody radiation), the peak wavelength generated by the conversion chip is temperature-dependent. Spectral conversion is achieved by modulating the temperature of the conversion chip. Specific spectral widths, such as 0.9–1.7 μm, 3–3.7 μm, 3.7–4.8 μm, 3–5 μm, 7.7–9.6 μm, 9.6–12 μm, and 8–14 μm, can be achieved using external filtering devices. However, since it is difficult for current conversion chips to achieve temperatures above 500°C, the intensity is insufficient for shortwave simulation. Therefore, the optional embodiments of this application do not use conversion chips as shortwave scene channel technology, but instead directly adopt a shortwave light source to illuminate the DMD spatial light modulator.

[0071] The spectrum of the shortwave scene generator is related to the spectrum of the shortwave light source. In this optional embodiment, a high-temperature blackbody is used. The DMD chip is a reflective device, and its reflection spectrum directly determines the maximum achievable wavelength range of the shortwave scene generator. This optional embodiment uses TI's DLP Discovery 4100 chipset, with aluminum micromirrors, 88% visible light reflectivity, and infrared coverage up to 5μm. The reflected light from the micromirrors needs to be output again through the DMD window using original Corning 7056 glass, with a cutoff wavelength of 2.7μm, visible light transmittance >97%, and 0.9-2.5μm transmittance >75%. The commonly used 0.9-2μm transmittance is greater than 95%, meeting the usage requirements.

[0072] Optionally, the broadband composite projection optical system comprises a short-wave infrared aperture angle matching lens, a mid-wave infrared aperture angle matching lens, a long-wave infrared aperture angle matching lens, two beam combiners, and a main projection optical system, such as... Figure 3 As shown. The short-wave infrared aperture angle-matching optical system images the short-wave infrared image generated by the DMD onto the intermediate image plane, which is then projected to infinity through the main projection optical system. A conversion screen is placed between the DMD and the intermediate image plane for easier observation. The mid-wave infrared aperture angle-matching lens images the mid-wave infrared image generated by the conversion chip onto the intermediate image plane, which is then projected to infinity through the main projection optical system. The long-wave lens works similarly. The beam combiner 1 reflects the infrared image from the long-wave infrared aperture angle-matching lens and transmits the infrared image from the mid-wave infrared aperture angle-matching lens, thus achieving the combined output of the mid-wave and long-wave infrared images. Based on the optical path requirements, the beam combiner 1 is a 5mm thick flat plate made of silicon, with a transmittance better than 99% in the mid-wave (3-5μm) band and a reflectance better than 97% in the long-wave (8-14μm) band. The function of beam combiner 2 is to reflect the infrared image from the short-wave infrared aperture-matched lens and transmit the combined mid-wave and long-wave infrared image from beam combiner 1, ultimately achieving common-aperture synthesis of the short-wave, mid-wave, and long-wave image channels. Based on optical path requirements, beam combiner 2 is made of a 5mm thick plate, with germanium as the material. The transmittance is better than 99% in the mid-wave (3–5μm) band, better than 99% in the long-wave (8–14μm) band, and better than 97% in the short-wave (0.9–1.7μm) band. The main projection optical system's function is to output the common-aperture composite infrared images of the three bands on the intermediate image plane. To correct chromatic aberration across a wide wavelength range, a three-mirror system is used.

[0073] It should be noted that infrared scene generation technology is a key technology in infrared imaging-guided hardware-in-the-loop simulation experimental systems. It can simulate the infrared radiation characteristics of real targets and backgrounds in a laboratory environment, providing a high-quality infrared image source for the infrared detector under test. Currently, mainstream infrared scene generation devices include resistive arrays, digital micromirror devices, and visible light / infrared image conversion chips. Existing infrared scene projection devices mainly operate in the mid-wave infrared (3-5μm), long-wave infrared (8-14μm), or mid-to-long-wave (3-14μm) dual infrared bands. With the development of imaging detectors, wide-band, high-resolution composite infrared image simulation covering the short (0.9-2.5μm), mid (3-5μm), and long (8-14μm) bands is one of the main development directions in this field.

[0074] By employing the aforementioned infrared image projection device and constructing the aforementioned architecture, the coverage range and accuracy of image projection in the infrared band are improved. Therefore, this addresses the problem in related technologies where infrared band determination image projection methods cannot achieve wide-band high-resolution composite infrared image simulation due to the limited coverage of the infrared band. This improves the simulation efficiency and accuracy of wide-band high-resolution composite infrared images, thereby enhancing the performance and reliability of wide-band high-resolution composite infrared image simulation covering the short (0.9-2.5μm), medium (3-5μm), and long (8-14μm) bands.

[0075] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0076] This embodiment also provides an image projection determination system for implementing the above embodiments and preferred embodiments; details already described will not be repeated. As used below, the term "module" can refer to a combination of software and / or hardware that performs a predetermined function. Although the systems described in the following embodiments are preferably implemented in software, hardware implementations, or a combination of software and hardware, are also possible and contemplated.

[0077] Figure 6 This is a structural block diagram of an image projection determination system according to an embodiment of this application, such as... Figure 6 As shown, the system includes:

[0078] At least three scene generators 62 are used to perform infrared processing on the video frame image to be projected to obtain multiple infrared images of the video frame image, wherein the at least three scene generators have a one-to-one relationship with at least three different wavebands.

[0079] A beam combiner 64 is connected to the at least three scene generators respectively, and is used to select at least three infrared aperture angle matching lenses corresponding to the at least three different band scene generators to perform imaging processing on the multiple infrared images to obtain at least three imaging results; the at least three imaging results are imaged on a preset intermediate image plane to obtain a composite image of the multiple infrared images, wherein the beam combiner has a defined reflection band range and a transmission band range;

[0080] Projection component 66, connected to the beam combining component, is used to adjust the common aperture of the synthesized image through the output image aperture corresponding to the projection component, and to perform broadband color difference correction on the common aperture adjustment result using the three-reflector system present in the projection component; and to determine the image projection corresponding to the video frame image based on the color difference correction result.

[0081] The system described above, by using scene generators with at least three different bands to generate the video frame images to be projected, ensures that the infrared images corresponding to the video frame images to be projected have at least three bands, thus covering a wide band range. Furthermore, a beam combiner is used to synthesize multiple infrared images, and the synthesized image is preprocessed by a projection component before being projected. The resulting image projection is a wide-band, high-resolution composite infrared image, thereby improving the coverage and accuracy of the image projection in the infrared band. Therefore, this system solves the problem in related technologies where infrared band determination image projection methods cannot achieve wide-band, high-resolution composite infrared image simulation due to the limited coverage of the infrared band, thus improving the simulation efficiency and accuracy of wide-band, high-resolution composite infrared images.

[0082] Optionally, the above scene generator includes: a visible light illumination system, an image writing system based on a DMD spatial light modulator, a writing optical relay optical system, an infrared image conversion system based on a conversion chip, a mid / long-wave infrared relay optical system, and a bandpass filtering system.

[0083] In one exemplary embodiment, the image projection determination system further includes: a control system for controlling the selection of the video frame image to be projected and the generation progress of the image projection.

[0084] Optionally, the aforementioned control system includes vacuum control, temperature control, synchronization control (including synchronization control between the test system, DMD, and lighting source), light source driver, self-test module, and control cabinet. The vacuum system and cooling system function to provide a high-vacuum and low-temperature operating environment for the infrared image conversion system.

[0085] In one exemplary embodiment, the visible light illumination system in the at least three scene generators includes at least: an illumination source connected to an illumination DMD chip corresponding to a DMD spatial light modulator included in the at least three scene generators, for providing uniform illumination light to the illumination DMD chip; a first auxiliary light source connected to the illumination DMD chip, for providing additional illumination light to the illumination DMD chip; a second auxiliary light source connected to an imaging DMD chip corresponding to a DMD spatial light modulator included in the at least three scene generators, for providing additional illumination light to the imaging DMD chip; a first absorption cell connected to the illumination DMD chip, for receiving uniform illumination light reflected by micromirrors in the illumination DMD chip in an off state; and a second absorption cell connected to the imaging DMD chip, for receiving uniform illumination light reflected by micromirrors in the imaging DMD chip in an off state.

[0086] Optionally, in practical applications, the lighting system includes a lighting source 1, an auxiliary light source 1, an auxiliary light source 2, a lighting DMD chip and its driver, a lighting source lens group, an auxiliary light source lens group 1, an auxiliary light source lens group 2, a synchronous Köhler lighting lens group, and a lighting DMD stray light absorption cell 1.

[0087] In one exemplary embodiment, the visible light illumination system further includes: an illumination DMD chip, configured to adjust the switching state of each micromirror according to a switching state ratio, wherein the switching state ratio is used to indicate the micromirror switching state information corresponding to the illumination power modulated by the illumination DMD driver for the video frame image to be projected; and an imaging DMD chip, connected to the illumination DMD chip, configured to adjust the switching state of each micromirror according to the grayscale level of each pixel in the image output by the illumination DMD chip.

[0088] It should be noted that the above modules can be implemented by software or hardware. For the latter, they can be implemented in the following ways, but are not limited to: all the above modules are located in the same processor; or, the above modules are located in different processors in any combination.

[0089] Embodiments of this application also provide a computer-readable storage medium storing a computer program, wherein the computer program is configured to execute the steps in any of the above method embodiments when run.

[0090] In one exemplary embodiment, the aforementioned computer-readable storage medium may include, but is not limited to, various media capable of storing computer programs, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard disk, magnetic disk, or optical disk.

[0091] Embodiments of this application also provide an electronic device, including a memory and a processor, wherein the memory stores a computer program and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.

[0092] In one exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor and the input / output device is connected to the processor.

[0093] Specific examples in this embodiment can be found in the examples described in the above embodiments and exemplary implementations, and will not be repeated here.

[0094] Obviously, those skilled in the art should understand that the modules or steps of this application described above can be implemented using general-purpose computing devices. They can be centralized on a single computing device or distributed across a network of multiple computing devices. They can be implemented using computer-executable program code, and thus can be stored in a storage device for execution by a computing device. In some cases, the steps shown or described can be performed in a different order than those presented here, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, this application is not limited to any particular combination of hardware and software.

[0095] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the principles of this application should be included within the protection scope of this application.

Claims

1. A method for determining image projection, characterized in that, include: The acquired video frame image to be projected is processed by an infrared generator using at least three different bands to obtain multiple infrared images of the video frame image. At least three infrared aperture angle matching lenses corresponding to the scene generators of at least three different bands are selected to perform imaging processing on the multiple infrared images to obtain at least three imaging results. The at least three imaging results are then imaged onto a preset intermediate image plane by a beam combining component that determines the reflection band interval and the transmission band interval to obtain a composite image of the multiple infrared images. The composite image is adjusted for common aperture by the output image aperture corresponding to the projection component, and the three-mirror system in the projection component is used to perform wideband color difference correction on the common aperture adjustment result. The image projection corresponding to the video frame image is determined based on the color difference correction result. The method further includes, after selecting at least three infrared aperture angle-matching lenses corresponding to the at least three different band scene generators to perform imaging processing on the multiple infrared images and obtain at least three imaging results, the method further includes: When the at least three infrared aperture angle matching lenses include at least: mid-wave infrared aperture angle matching lens and long-wave infrared aperture angle matching lens, the first imaging result output by the mid-wave infrared aperture angle matching lens and the second imaging result output by the long-wave infrared aperture angle matching lens are obtained. The first imaging result and the second imaging result are combined into a first composite image using the first sub-component in the beam combining assembly, wherein the first sub-component is used to reflect the infrared image from the long-wave infrared aperture angle-matched lens and transmit the infrared image from the mid-wave infrared aperture angle-matched lens. In the case where the at least three infrared aperture angle matching lenses further include a short-wave infrared aperture angle matching lens, a third imaging result output by the short-wave infrared aperture angle matching lens is obtained. The third imaging result and the first composite image are combined into a second composite image using the second sub-component in the beam combining assembly, wherein the second sub-component is used to reflect the infrared image from the short-wave infrared aperture angle-matched lens and transmit the first composite image.

2. The method according to claim 1, characterized in that, Before performing infrared processing on the acquired video frame image to be projected using scene generators of at least three different bands, the method further includes: Determine the wavelength range corresponding to each of the at least three different scene generators; The band type corresponding to each scene generator is determined based on the wavelength range; Obtain the chip parameters and band processing parameters corresponding to the band type, wherein the chip parameters include at least: the chip performance used by each scene generator, and the band processing parameters include at least: the write optical power for converting the video frame image into the corresponding light image in each scene generator, and the transmission band size of the light image on different transmission components in each scene generator; Based on the wavelength range, the chip parameters, and the band processing parameters, the image band after infrared processing of the video frame image using the wavelength range of each scene generator is determined.

3. The method according to claim 2, characterized in that, After determining the band type corresponding to each scene generator based on the wavelength range, the method further includes: When the band type is determined to be medium wave and / or long wave, each scene generator is verified according to the composition structure of the first type of preset scene generator, wherein the composition structure of the first type of preset scene generator includes at least: a visible light illumination system, an image writing system based on a DMD spatial light modulator, a writing optical relay optical system, an infrared image conversion system based on a conversion chip, a medium wave and / or long wave infrared relay optical system, and a bandpass filter system; When the band type is determined to be short band, each scene generator is verified according to the composition structure of the second type of preset scene generator. The composition structure of the second type of preset scene generator includes at least: a visible light illumination system, an image writing system based on a DMD spatial light modulator, a short-wave infrared relay optical system, and a bandpass filter system.

4. The method according to claim 1, characterized in that, Before performing infrared processing on the acquired video frame image to be projected using scene generators of at least three different bands, the method further includes: Determine the image feature information corresponding to the video frame image to be projected, wherein the image feature information includes at least: infrared feature information of the image and resolution feature information of the image; Compare the differences between the image feature information and the preset standard feature information; If the difference is less than a preset projection difference, the video frame image to be projected is allowed to be written as an image source into the scene generator of the at least three different bands.

5. The method according to claim 1, characterized in that, The scene generator, comprising at least three different bands, includes at least: an illumination DMD chip corresponding to the DMD spatial light modulator, and an imaging DMD chip corresponding to the DMD spatial light modulator. The infrared processing of the acquired video frame image to be projected using the scene generator, comprising at least three different bands, includes: The visible light illumination system of the scene generator with at least three different wavelengths provides light intensity to the illumination DMD chip; The video frame image is illuminated onto the imaging DMD chip according to the light intensity; When an illumination image exists on the imaging DMD chip, the first driver corresponding to the imaging DMD chip is instructed to control the on / off state of each micromirror on the imaging DMD chip according to the gray level of each pixel in the illumination image; Based on the on / off state of each micromirror, the illumination image is transmitted through the scene channel to the infrared relay optical system present in the scene generator of at least three different bands to complete the infrared processing of the video frame image.

6. The method according to claim 5, characterized in that, Before transmitting the illumination image through the scene channel to the infrared relay optical system present in the scene generator of at least three different bands according to the on / off state of each micromirror, the method further includes: If the band type corresponding to the scene generator is determined to be medium band and / or long band, it is determined that a conversion chip exists in the scene channel; The conversion chip is instructed to perform temperature conversion based on the light intensity corresponding to different regions in the illumination image, thereby obtaining temperature distribution data corresponding to the illumination image. The temperature distribution data is used to determine the infrared converted image corresponding to the video frame image, and the infrared converted image is used to replace the lighting image during transmission in the scene channel.

7. A system for determining image projection, characterized in that, include: At least three scene generators are used to perform infrared processing on the video frame image to be projected to obtain multiple infrared images of the video frame image, wherein the at least three scene generators have a one-to-one relationship with at least three different wavebands; A beam combiner is connected to the at least three scene generators respectively, and is used to select at least three infrared aperture angle matching lenses corresponding to the at least three different band scene generators to perform imaging processing on the multiple infrared images to obtain at least three imaging results; the at least three imaging results are imaged on a preset intermediate image plane to obtain a composite image of the multiple infrared images, wherein the beam combiner has a defined reflection band range and a transmission band range. A projection component, connected to the beam combining component, is used to perform common aperture adjustment on the synthesized image through the output image aperture corresponding to the projection component, and to perform broadband color difference correction on the common aperture adjustment result using the three-reflector system present in the projection component; and to determine the image projection corresponding to the video frame image based on the color difference correction result. The beam combining component is further configured to select at least three infrared aperture angle-matching lenses corresponding to the at least three different waveband scene generators to perform imaging processing on the multiple infrared images, and after obtaining at least three imaging results, when the at least three infrared aperture angle-matching lenses include at least: a mid-wave infrared aperture angle-matching lens and a long-wave infrared aperture angle-matching lens, to obtain a first imaging result output by the mid-wave infrared aperture angle-matching lens and a second imaging result output by the long-wave infrared aperture angle-matching lens; and to use a first sub-component in the beam combining component to combine the first imaging result and the second imaging result into a first composite image. The image is combined into a second composite image, wherein the first sub-component is used to reflect the infrared image from the long-wave infrared aperture angle-matched lens and transmit the infrared image from the mid-wave infrared aperture angle-matched lens; when the at least three infrared aperture angle-matched lenses further include a short-wave infrared aperture angle-matched lens, a third imaging result output by the short-wave infrared aperture angle-matched lens is acquired; the third imaging result and the first composite image are combined into a second composite image using the second sub-component in the beam combining assembly, wherein the second sub-component is used to reflect the infrared image from the short-wave infrared aperture angle-matched lens and transmit the first composite image.

8. The system according to claim 7, characterized in that, The visible light illumination system in the at least three scene generators includes at least: An illumination source is connected to an illumination DMD chip corresponding to the DMD spatial light modulator included in the at least three scene generators, for providing uniform illumination light to the illumination DMD chip; A first auxiliary light source is connected to the lighting DMD chip and is used to provide additional illumination light to the lighting DMD chip; The second auxiliary light source is connected to the imaging DMD chip corresponding to the DMD spatial light modulator included in the at least three scene generators, and is used to provide additional illumination light for the imaging DMD chip; The first absorption cell is connected to the illumination DMD chip and is used to receive uniform illumination light reflected by the micromirrors in the illumination DMD chip when they are in the off state. The second absorption cell is connected to the imaging DMD chip and is used to receive uniform illumination light reflected by the micromirrors in the imaging DMD chip when they are in the off state.

9. The system according to claim 8, characterized in that, The visible light illumination system further includes: An illumination DMD chip is used to adjust the switching state of each micromirror according to the switching state ratio, wherein the switching state ratio is used to indicate the micromirror switching state information corresponding to the illumination power modulated by the illumination DMD driver for the video frame image to be projected; An imaging DMD chip, connected to the illumination DMD chip, is used to adjust the on / off state of each micromirror according to the grayscale level of each pixel in the image output by the illumination DMD chip.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, wherein the computer program, when executed by a processor, implements the steps of the method described in any one of claims 1 to 6.

11. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the method described in any one of claims 1 to 6.

Images