Infrared-visible light up-conversion display device and method based on single pixel detection

Abstract

The invention discloses an infrared-visible light up-conversion display device and method based on single pixel detection, and belongs to the technical field of photoelectricity. The infrared-visible light up-conversion display device comprises a light beam generation module, a projection module, a detection module, an optimization module and a display screen which are sequentially arranged along a light path; the light beam generation module generates a common-path light beam with the same path of the infrared light beam and the visible light beam; an infrared light beam and a visible light beam are synchronously modulated through a projection module, a modulated pattern light beam is projected to an infrared target, and a detection module collects signal light interacting with the infrared target in real time and converts the signal light into an electric signal as feedback. And after the modulation pattern is optimized by the optimization module, the visualization of an invisible infrared scene is realized on the display screen. The infrared-visible light up-conversion display device and the infrared-visible light up-conversion display method based on single-pixel detection have the characteristics of high sensitivity, low cost and real-time visualization, and can realize efficient conversion under sub-photon-level infrared flux.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of optoelectronic technology, in particular to an infrared-visible light upconversion display device and method based on single-pixel detection. BACKGROUND

[0002] Infrared sensing technology has attracted widespread attention in night vision, biomedical imaging, industrial detection, anti-counterfeiting identification and many other fields. Traditional infrared cameras generally have high cost, large size, complex manufacturing and other problems, which greatly limit their miniaturization and portability. Converting low-energy infrared photons into high-energy visible light so that infrared information can be directly perceived by the human eye or standard silicon-based imaging sensors has become a research hotspot. However, existing infrared-visible light upconversion technology still faces many challenges, such as high cost, high excitation power, complex manufacturing process, and extremely low quantum efficiency.

[0003] Existing infrared-visible light upconversion technology cannot achieve infrared imaging and visualization under low photon flux, which cannot meet the requirements in extremely weak light application scenarios such as quantum sensing, low-light biomedical imaging or autonomous navigation in dark environments. In existing technology, there is an inherent contradiction between image quality and light intensity: enhancing image quality often requires extending the integration time or increasing the irradiance, which in turn reduces the imaging efficiency or is not suitable for low-light environments. How to fundamentally break this shackles and provide a new paradigm that can achieve efficient and high-fidelity upconversion under extremely low photon state has become an urgent need in this field. SUMMARY

[0004] The purpose of the present application is to provide an infrared-visible light upconversion display device and method based on single-pixel detection, which has the characteristics of high sensitivity, low cost and real-time visualization, and can achieve efficient conversion under sub-photon level infrared flux.

[0005] To achieve the above purpose, the present application provides an infrared-visible light upconversion display device based on single-pixel detection, which comprises a light beam generating module, a projection module, a detection module, an optimization module and a display screen arranged in sequence along the light path. The light beam generating module is used to generate a co-channel light beam of infrared light beam and visible light beam; The projection module is used to spatially modulate and project the co-channel light beam, generate a pattern light beam matching the spatial distribution of the infrared target, and decompose the co-pattern light beam into a pattern infrared light beam and a pattern visible light beam, which are respectively injected into the infrared target and the display screen; The detection module is used to collect the signal light after the modulated pattern infrared light beam interacts with the infrared target, and convert it into an electrical signal as a feedback signal into the optimization module; an optimization module configured to run an optimization algorithm according to the feedback signal to control the projection module to generate and update the modulation pattern in real time; a display screen configured to display the visible light pattern of the infrared target.

[0006] Preferably, the light beam generating module comprises an infrared light source, a visible light source and a beam combiner arranged at the intersection of the light beams generated by the infrared light source and the visible light source, the beam combiner emitting a common light beam after receiving the infrared light beam and the visible light beam.

[0007] Preferably, the projection module comprises a digital micromirror device, a projection lens and a beam splitter arranged in sequence along the light path. The digital micromirror device is configured to modulate the common light beam after receiving the common light beam to form a pattern light beam. The projection lens is configured to magnify the pattern light beam and emit the pattern light beam into the beam splitter. The beam splitter is configured to decompose the pattern light beam into a pattern infrared light beam and a pattern visible light beam, the pattern infrared light beam being emitted into the infrared target to interact with the infrared target to generate a signal light, and the pattern visible light beam being reflected to the display screen.

[0008] Preferably, the detection module comprises a collection lens and an infrared single-pixel detector arranged in sequence along the light path. The collection lens is configured to collect the signal light and emit the signal light into the infrared single-pixel detector. The infrared single-pixel detector is configured to convert the signal light into an electrical signal as a feedback signal into the optimization module.

[0009] Preferably, the display screen is configured to generate a naked-eye visible pattern after receiving the pattern visible light beam.

[0010] An infrared-visible light upconversion display method based on single-pixel detection comprises the following steps: S1, initializing a modulation pattern of a digital micromirror device; S2, simultaneously modulating an infrared light beam and a visible light beam by the digital micromirror device to obtain a pattern infrared light beam and a pattern visible light beam; S3, projecting the pattern infrared light beam to an infrared target, and collecting a signal light after the infrared target interacts with the pattern infrared light beam by an infrared single-pixel detector, and converting the signal light into an electrical signal as an intensity feedback signal; S4, calculating a cost function CF for evaluating the quality of the pattern according to the intensity feedback signal and the modulation pattern, when the CF value monotonically increases, it indicates that the modulation pattern is more and more matched with the profile of the infrared target; S5. The optimization module runs a genetic algorithm to optimize the modulation pattern. Iteratively updates the modulation pattern according to the cost function CF so that the cost function CF increases and the modulation pattern gradually converges and matches the spatial distribution of the infrared target. S6. At the same time, the visible beam corresponding to the updated modulation pattern will be projected onto the infrared target surface or display screen to achieve real-time visualization of the invisible infrared scene.

[0011] Preferably, in step S4, the cost function CF is defined as follows: ; in, To modulate the pattern, Infrared target pattern, x and y These are pixel coordinates.

[0012] Preferably, in step S5, the specific steps of the genetic algorithm optimization are as follows: S51. Infrared and visible light sources generate infrared and visible light beams, which are combined by a beam combiner and then modulated by a digital micromirror device to form an initial random pattern population P. ; in, k For population size, This is a modulation pattern in the 0th generation population; S52. The modulated patterned infrared beam illuminates the infrared target, and the cost function CF is calculated based on the measurement value of the infrared single-pixel detector. S53. The feedback optimization module optimizes the lighting pattern based on an optimization algorithm: the population is sorted by CF, a high-ranking parent pattern is randomly selected, crossover and mutation are performed, and a child pattern is generated to replace the low-ranking pattern. The mutation rate is... r Decline by exponential rate: ; in, and These represent the initial and final mutation rates, respectively. m This represents the total number of iterations in the genetic algorithm. This represents the current iteration number; S54. Repeat S52 and S53 until the cost function CF converges.

[0013] Therefore, the present invention employs the above-described infrared-visible upconversion display device and method based on single-pixel detection, which has the following advantages: (1) In this invention, the infrared single-pixel detector can be set according to different needs. When the photon flux is low, the infrared upconversion of low photon flux can be achieved by using an ordinary detector. When the photon flux is single, the high-fidelity infrared upconversion under extremely low infrared irradiance can be achieved by using a single-photon detector.

[0014] (2) In this invention, the light field is encoded by a digital micromirror device and information is collected by a single-photon detector, which avoids the use of expensive and complex infrared array detectors, significantly reducing the manufacturing cost and complexity of the system, and also facilitates further miniaturization and integration of the device.

[0015] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0016] Figure 1 This is a schematic diagram of the structure of an infrared-visible light up-conversion display device based on single-pixel detection according to the present invention; Figure 2 This is an image illustrating the infrared anti-counterfeiting verification effect of Embodiment 1 of the present invention. Figure 3 This is a visualization of an infrared target under low photon flux according to Embodiment 2 of the present invention; Reference numerals: 1. Infrared light source; 2. Visible light source; 3. Beam combiner; 4. Digital micromirror device; 5. Projection lens; 6. Beam splitter; 7. Infrared target; 8. Collecting lens; 9. Infrared single-pixel detector; 10. Reflector; 11. Display screen; 12. Naked eye. Detailed Implementation

[0017] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. The components of the embodiments of the present invention described and shown in the accompanying drawings can generally be arranged and designed in various different configurations. Specific model specifications need to be selected and determined according to the actual specifications of the device, etc. The specific selection calculation method adopts existing technology in the art, and therefore will not be described in detail.

[0018] Example 1 like Figure 1 As shown, an infrared-visible upconversion display device based on single-pixel detection includes a beam generation module, a projection module, a detection module, an optimization module, and a display screen 11 arranged sequentially along the optical path; The beam generation module is used to generate a common beam of infrared beam and visible beam. It includes an infrared light source 1, a visible light source 2, and a beam combiner 3 set at the intersection of the two beams. After the infrared beam generated by the infrared light source 1 and the visible beam generated by the visible light source 2 are both injected into the beam combiner 3, the beam combiner 3 emits the common beam of infrared beam and visible beam. The common beam is injected into the projection module. In this embodiment, the beam combiner 3 is selected as a long-pass dichroic mirror. The projection module is used to spatially modulate and project the common beam to generate a patterned beam that matches the spatial distribution of the infrared target 7. It also decomposes the common patterned beam into a patterned infrared beam and a patterned visible beam, which are then directed into the infrared target 7 and the display screen 11, respectively. The module includes a digital micromirror device 4, a projection lens 5, and a beam splitter 6 arranged sequentially along the optical path. The digital micromirror device 4 receives the common beam and modulates it to form a patterned beam. The projection lens 5 magnifies the patterned beam and directs it into the beam splitter 6. The beam splitter 6 decomposes the patterned beam into a patterned infrared beam and a patterned visible beam. The patterned infrared beam is directed into the infrared target 7 and interacts with it to generate signal light. The patterned visible beam is reflected onto the display screen 11. The detection module is used to collect the signal light after the modulated patterned infrared beam interacts with the infrared target 7, and convert it into an electrical signal as a feedback signal to be transmitted to the optimization module. It includes a collection lens 8 and an infrared single-pixel detector 9 arranged sequentially along the optical path. The collection lens 8 is used to collect the signal light and send it into the infrared single-pixel detector 9. The infrared single-pixel detector 9 is used to convert the signal light into an electrical signal as a feedback signal and input it into the optimization module. The infrared single-pixel detector 9 can be configured according to different needs. When the single photon flux is high, a single photon avalanche diode that supports single photon detection can be used. When the other conventional low photon flux is high, an ordinary detector can be used. The optimization module, which is connected to both the infrared single-pixel detector 9 and the digital micromirror device 4, is used to run an optimization algorithm based on the feedback signal to control the projection module to generate and update the modulation pattern in real time. The display screen 11 is used to receive the pattern visible beam and generate a pattern visible to the naked eye 12. The pattern visible beam can be directly directed to the display screen 11 or the naked eye 12, or a reflector 10 can be set between the beam splitter 6 and the display screen 11 as needed, and the pattern visible beam can be projected onto the display screen 11 through the reflector 10 to generate a pattern visible to the naked eye 12.

[0019] An infrared-visible upconversion display method based on single-pixel detection includes the following steps: S1. Initialize the modulation pattern of the digital micromirror device 4; S2. Spatially modulate the infrared beam and the visible beam simultaneously using the digital micromirror device 4 to obtain a patterned infrared beam and a patterned visible beam. S3. Project the patterned infrared beam onto the infrared target 7, and use the infrared single-pixel detector 9 to collect the signal light after interacting with the infrared target 7, and convert the signal light into an electrical signal as an intensity feedback signal. S4. Based on the intensity feedback signal and the modulation pattern, calculate a cost function CF to evaluate the pattern quality. When the CF value increases monotonically, it indicates that the modulation pattern is increasingly matching the contour of the infrared target 7. The cost function CF is defined as follows: ; in, To modulate the pattern, Infrared target pattern, x and y These are pixel coordinates; S5. The optimization module runs a genetic algorithm to optimize the modulation pattern. It iteratively updates the modulation pattern based on the cost function CF, causing CF to increase and the modulation pattern to gradually converge and match the spatial distribution of the infrared target 7. The specific steps of the genetic algorithm optimization are as follows: S51, infrared light source 1, and visible light source 2 generate infrared and visible light beams, which are combined by beam combiner 3 and then modulated by digital micromirror device 4 to form an initial random pattern population P: ; in, k For population size, This is a modulation pattern in the 0th generation population; S52. The modulated patterned infrared beam illuminates the infrared target 7, and the cost function CF is calculated based on the measurement value of the infrared single-pixel detector 9. S53. The feedback optimization module optimizes the lighting pattern based on the optimization algorithm: The population is sorted by CF (Color, Color, and Fibre) and a high-ranking parent pattern is randomly selected. Crossover (random pixel inheritance) and mutation (flipping some pixels) are performed to generate a sub-pattern that replaces the low-ranking pattern. The mutation rate is... r Decline by exponential rate: ; in, and These represent the initial and final mutation rates, respectively. , , m This represents the total number of iterations in the genetic algorithm. This represents the current iteration number; S54. Repeat S52 and S53 until the cost function CF converges; S6. At the same time, the visible beam corresponding to the updated modulation pattern will be projected onto the surface of the infrared target 7 or the display screen 11 to achieve real-time visualization of the invisible infrared scene.

[0020] like Figure 2 As shown, when used for infrared anti-counterfeiting, infrared-sensitive ink is used to print patterns that are invisible to the naked eye on paper. Under ambient light, the patterns are completely invisible, but through the system and method of this invention, they can be clearly converted into visible light images.

[0021] Example 2 like Figure 3 As shown, this embodiment uses a single-photon avalanche diode with ultra-high photon sensitivity as an infrared single-pixel detector. Even under extremely low photon flux conditions, it can still obtain a resolvable visible light image, demonstrating the usability and robustness of the invention under extremely low illumination conditions.

[0022] Furthermore, this invention not only operates in both transmission and reflection modes, but also achieves dual-mode visualization (positive / negative) by substituting the reciprocal of the valence function CF, corresponding to positive and negative images of object intensity. The positive mode highlights the infrared-sensitive region, while the negative mode minimizes photodegradation of the photosensitive material, providing new possibilities for applications requiring precise illumination control.

[0023] Therefore, the infrared-visible upconversion display device and method based on single-pixel detection described above have the characteristics of high sensitivity, low cost, and real-time visualization, and can achieve efficient conversion at sub-photon level infrared flux.

[0024] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can still be made to the technical solutions of the present invention, and these modifications or equivalent substitutions cannot cause the modified technical solutions to deviate from the spirit and scope of the technical solutions of the present invention.

Claims

1. An infrared-visible upconversion display device based on single-pixel detection, characterized in that: The system comprises, in sequence along an optical path, a light beam generating module, a projection module, a detection module, an optimization module and a display screen. The light beam generating module is configured to generate a common-path light beam of an infrared light beam and a visible light beam. The projection module is configured to spatially modulate and project the common-path light beam, generate a pattern light beam matching the spatial distribution of the infrared target, and decompose the common pattern light beam into a pattern infrared light beam and a pattern visible light beam, which are respectively projected into the infrared target and the display screen. The detection module is configured to collect signal light after the modulated pattern infrared light beam interacts with the infrared target, and convert the signal light into an electrical signal as a feedback signal input into the optimization module. The optimization module is configured to run an optimization algorithm according to the feedback signal to control the projection module to generate and update the modulation pattern in real time. The display screen is configured to display the visible light pattern of the infrared target. 2.The single-pixel detection based infrared-visible upconversion display device of claim 1, wherein: The light beam generating module comprises an infrared light source, a visible light source and a beam combiner arranged at the intersection of the light beams of the two light sources. The infrared light beam generated by the infrared light source and the visible light beam generated by the visible light source are both input into the beam combiner, and the beam combiner outputs a common-path light beam of the infrared light beam and the visible light beam. The common-path light beam is input into the projection module.

3. The single-pixel detection based infrared-visible upconversion display device of claim 2, wherein: The projection module comprises, in sequence along an optical path, a digital micromirror device, a projection lens and a beam splitter. The digital micromirror device is configured to modulate the common-path light beam after receiving the common-path light beam, and form a pattern light beam. The projection lens is configured to magnify the pattern light beam and project it into the beam splitter. The beam splitter is configured to decompose the pattern light beam into a pattern infrared light beam and a pattern visible light beam. The pattern infrared light beam is projected into the infrared target, interacts with the infrared target to generate signal light, and the pattern visible light beam is reflected to the display screen.

4. The single-pixel detection based infrared-visible upconversion display device of claim 3, wherein: The detection module comprises, in sequence along an optical path, a collection lens and an infrared single-pixel detector. The collection lens is configured to collect signal light and project it into the infrared single-pixel detector. The infrared single-pixel detector is configured to convert the signal light into an electrical signal as a feedback signal input into the optimization module.

5. The single-pixel detection based infrared-visible upconversion display device of claim 3, wherein: The display screen is configured to generate a naked-eye visible pattern after receiving the pattern visible light beam.

6. An infrared-visible upconversion display method based on single-pixel detection, using the infrared-visible upconversion display device based on single-pixel detection according to any one of claims 1-5, characterized in that: The method comprises the following steps: S1, initializing a modulation pattern of the digital micromirror device; S2, simultaneously spatially modulating the infrared light beam and the visible light beam by the digital micromirror device to obtain a pattern infrared light beam and a pattern visible light beam; S3, projecting the pattern infrared light beam to the infrared target, and collecting signal light after the infrared target interacts with the pattern infrared light beam by using the infrared single-pixel detector, and converting the signal light into an electrical signal as an intensity feedback signal; S4, calculating a cost function CF for evaluating the quality of the pattern according to the intensity feedback signal and the modulation pattern. When the CF value monotonically increases, it indicates that the modulation pattern is more and more matched with the profile of the infrared target; S5, the optimization module runs a genetic algorithm optimization, iteratively updates the modulation pattern according to the cost function CF, so that the cost function CF increases, and the modulation pattern gradually converges and matches the spatial distribution of the infrared target; S6, at the same time, the pattern visible light beam corresponding to the updated modulation pattern is projected onto the surface of the infrared target or the display screen to realize real-time visualization of the invisible infrared scene.

7. The single-pixel detection based infrared-visible upconversion display method according to claim 6, wherein: In step S4, the cost function CF is defined as: ； wherein, is a modulation pattern, is an infrared target pattern, x and y are pixel coordinates.

8. The single-pixel detection based infrared-visible upconversion display method according to claim 7, wherein: In step S5, the specific steps of genetic algorithm optimization are as follows: S51, the infrared light source and the visible light source generate infrared light beams and visible light beams, which are combined by a beam combiner and then modulated by a digital micromirror device to form an initial random pattern population P: ； wherein, k is the population size, is one modulation pattern in the 0th generation population; S52, the modulated pattern infrared light beam irradiates an infrared target, and a cost function CF is calculated according to the measurement value of the infrared single-pixel detector; S53、The feedback optimization module optimizes the illumination pattern based on the optimization algorithm: sort the population by CF, randomly select a high-ranking parent pattern, perform crossover and mutation to generate a child pattern to replace a low-ranking pattern, where the mutation rate r Exponential decay: ； wherein, and respectively represent the initial and final mutation rates, m is the total number of iterations of the genetic algorithm, is the current iteration number; S54, repeat S52 and S53 until the cost function CF converges.

Images