Infrared-visible light up-conversion display device and method based on single-pixel detection

Abstract

The application discloses an infrared-visible light up-conversion display device and method based on single-pixel detection, and belongs to the field of photoelectric technology, which comprises a light beam generating module, a projection module, a detection module and a display screen arranged in sequence along an optical path, and an optimization module not arranged in the optical path; the light beam generating module generates a common-path light beam of an infrared light beam and a visible light beam; the projection module synchronously modulates the infrared light beam and the visible light beam, and projects the modulated pattern light beam to an infrared target; the detection module collects signal light after interaction with the infrared target in real time, and converts the signal light into an electric signal as feedback; and the optimization module optimizes the modulated pattern to realize visualization of the invisible infrared scene on the display screen. The application has the characteristics of high sensitivity, low cost and real-time visualization, and can realize efficient conversion under the infrared flux at the sub-sub photon level.

Description

Technical Field

[0001] This invention relates to the field of optoelectronic technology, and in particular to an infrared-visible upconversion display device and method based on single-pixel detection. Background Technology

[0002] Infrared sensing technology has attracted widespread attention in many fields such as night vision, biomedical imaging, industrial inspection, and anti-counterfeiting identification. Traditional infrared cameras generally suffer from high cost, large size, and complex manufacturing, which greatly limits their miniaturization and portability. Converting low-energy infrared photons into high-energy visible light, enabling infrared information to be directly perceived by the human eye or standard silicon-based imaging sensors, has become a research hotspot. However, existing infrared-visible upconversion technologies still face many challenges, such as high cost, high excitation power, complex manufacturing processes, and extremely low quantum efficiency.

[0003] Existing infrared-visible upconversion technologies struggle to achieve infrared imaging and visualization under low photon flux conditions, which is insufficient for applications in extremely low light environments, such as quantum sensing, low-light biomedical imaging, or autonomous navigation in darkness. In existing technologies, there is an inherent trade-off between image quality and light intensity: enhancing image quality often requires extending the integration time or increasing irradiance, which in turn reduces imaging efficiency or renders the technology unsuitable for low-light environments. Therefore, fundamentally overcoming this constraint and providing a new paradigm for efficient, high-fidelity upconversion under extremely low photon flux conditions has become an urgent need in this field. Summary of the Invention

[0004] The purpose of this invention is to provide an infrared-visible upconversion display device and method based on single-pixel detection, which features high sensitivity, low cost, and real-time visualization, and can achieve efficient conversion at sub-photon level infrared flux.

[0005] To achieve the above objectives, the present invention provides an infrared-visible upconversion display device based on single-pixel detection, comprising a beam generation module, a projection module, a detection module and a display screen arranged sequentially along the optical path, and an optimization module not disposed in the optical path; A beam generation module is used to generate a common beam that combines infrared and visible beams. The projection module is used to spatially modulate and project the common beam to generate a patterned beam that matches the spatial distribution of the infrared target, and decompose the patterned beam into a patterned infrared beam and a patterned visible beam, which are then directed into the infrared target and the display screen, respectively. The projection module includes a digital micromirror device, a projection lens, and a beam splitter arranged sequentially along the optical path; The digital micromirror device is used to receive a common beam and modulate the common beam to form a patterned beam. The projection lens is used to magnify the patterned beam and then direct it into the beam splitter. The beam splitter is used to decompose the patterned beam into a patterned infrared beam and a patterned visible beam. The patterned infrared beam is incident on the infrared target and generates signal light after interacting with the infrared target. The patterned visible beam is reflected to the display screen. The detection module is used to collect the signal light after the modulated patterned infrared beam interacts with the infrared target, and convert it into an electrical signal as a feedback signal to be transmitted to the optimization module. The detection module includes a collecting lens and an infrared single-pixel detector arranged sequentially along the optical path; The collecting lens is used to collect signal light and direct it into the infrared single-pixel detector; The infrared single-pixel detector is used to convert the signal light into an electrical signal, which is then fed back to the optimization module. The optimization module is connected to the infrared single-pixel detector and the digital micromirror device, and is used to run an optimization algorithm based on the feedback signal to control the projection module to generate and update the modulation pattern in real time. The display screen is used to receive the patterned visible light beam corresponding to the updated modulation pattern, thereby enabling the visualization of infrared targets.

[0006] Preferably, the beam generating module includes an infrared light source, a visible light source, and a beam combiner disposed at the intersection of the two beams. After the infrared beam generated by the infrared light source and the visible beam generated by the visible light source both enter the beam combiner, the beam combiner emits a common beam of the infrared beam and the visible beam, which enters the projection module.

[0007] Preferably, the display screen is used to generate a pattern visible to the naked eye after receiving a pattern-visible light beam.

[0008] An infrared-visible upconversion display method based on single-pixel detection includes the following steps: S1. Initialize the modulation pattern of the digital micromirror device; S2. Spatially modulate the infrared beam and the visible beam simultaneously using a digital micromirror device to obtain a patterned infrared beam and a patterned visible beam. S3. Project the patterned infrared beam onto the infrared target, and use an infrared single-pixel detector to collect the signal light after interacting with the infrared target, and convert the signal light into an electrical signal as an intensity feedback signal. S4. Based on the intensity feedback signal and the modulation pattern, calculate a cost function CF to evaluate the pattern quality. When the CF value increases monotonically, it indicates that the modulation pattern is increasingly matching the outline of the infrared target. S5. The optimization module runs a genetic algorithm to optimize the modulation pattern. Iteratively updates the modulation pattern according to the cost function CF so that the cost function CF increases and the modulation pattern gradually converges and matches the spatial distribution of the infrared target. S6. At the same time, the visible beam corresponding to the updated modulation pattern will be projected onto the infrared target surface or display screen to achieve real-time visualization of the invisible infrared scene.

[0009] Preferably, in step S4, the cost function CF is defined as follows: ; in, To modulate the pattern, Infrared target pattern, x and y These are pixel coordinates.

[0010] Preferably, in step S5, the specific steps of the genetic algorithm optimization are as follows: S51. Infrared and visible light sources generate infrared and visible light beams, which are combined by a beam combiner and then modulated by a digital micromirror device to form an initial random pattern population P. ; in, k For population size, This is a modulation pattern in the 0th generation population; S52. The modulated patterned infrared beam illuminates the infrared target, and the cost function CF is calculated based on the measurement value of the infrared single-pixel detector. S53. The optimization module optimizes the modulation pattern based on an optimization algorithm: the population is sorted by CF, a high-ranking parent pattern is randomly selected, crossover and mutation are performed, and a child pattern is generated to replace the low-ranking pattern, wherein the mutation rate is... r Decline by exponential rate: ; in, and These represent the initial and final mutation rates, respectively. m This represents the total number of iterations in the genetic algorithm. This represents the current iteration number; S54. Repeat S52 and S53 until the cost function CF converges.

[0011] Therefore, the present invention employs the above-described infrared-visible upconversion display device and method based on single-pixel detection, which has the following advantages: (1) In this invention, the infrared single-pixel detector can be set according to different needs. When the photon flux is low, the infrared upconversion of low photon flux can be achieved by using an ordinary detector. When the photon flux is single, the high-fidelity infrared upconversion under extremely low infrared irradiance can be achieved by using a single-photon detector.

[0012] (2) In this invention, the light field is encoded by a digital micromirror device and information is collected by a single-photon detector, which avoids the use of expensive and complex infrared array detectors, significantly reducing the manufacturing cost and complexity of the system, and also facilitates further miniaturization and integration of the device.

[0013] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0014] Figure 1 This is a schematic diagram of the structure of an infrared-visible light up-conversion display device based on single-pixel detection according to the present invention; Figure 2 This is an image illustrating the infrared anti-counterfeiting verification effect of Embodiment 1 of the present invention. Figure 3 This is a visualization of an infrared target under low photon flux according to Embodiment 2 of the present invention; Reference numerals: 1. Infrared light source; 2. Visible light source; 3. Beam combiner; 4. Digital micromirror device; 5. Projection lens; 6. Beam splitter; 7. Infrared target; 8. Collecting lens; 9. Infrared single-pixel detector; 10. Reflector; 11. Display screen; 12. Naked eye. Detailed Implementation

[0015] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. The components of the embodiments of the present invention described and shown in the accompanying drawings can generally be arranged and designed in various different configurations. Specific model specifications need to be selected and determined according to the actual specifications of the device, etc. The specific selection calculation method adopts existing technology in the art, and therefore will not be described in detail.

[0016] Example 1 like Figure 1 As shown, an infrared-visible upconversion display device based on single-pixel detection includes a beam generation module, a projection module, a detection module and a display screen 11 arranged sequentially along the optical path, as well as an optimization module not arranged in the optical path; The beam generation module is used to generate a common beam of infrared beam and visible beam. It includes an infrared light source 1, a visible light source 2, and a beam combiner 3 set at the intersection of the two beams. After the infrared beam generated by the infrared light source 1 and the visible beam generated by the visible light source 2 are both injected into the beam combiner 3, the beam combiner 3 emits the common beam of infrared beam and visible beam. The common beam is injected into the projection module. In this embodiment, the beam combiner 3 is selected as a long-pass dichroic mirror. The projection module is used to spatially modulate and project the common beam to generate a patterned beam that matches the spatial distribution of the infrared target 7. It then decomposes the patterned beam into a patterned infrared beam and a patterned visible beam, which are respectively projected onto the infrared target 7 and the display screen 11. The module includes a digital micromirror device 4, a projection lens 5, and a beam splitter 6 arranged sequentially along the optical path. The digital micromirror device 4 receives the common beam and modulates it to form a patterned beam. The projection lens 5 magnifies the patterned beam and projects it into the beam splitter 6. The beam splitter 6 decomposes the patterned beam into a patterned infrared beam and a patterned visible beam. The patterned infrared beam is projected onto the infrared target 7 and interacts with it to generate signal light. The patterned visible beam is reflected onto the display screen 11. The detection module is used to collect the signal light after the modulated patterned infrared beam interacts with the infrared target 7, and convert it into an electrical signal as a feedback signal to be transmitted to the optimization module. It includes a collection lens 8 and an infrared single-pixel detector 9 arranged sequentially along the optical path. The collection lens 8 is used to collect the signal light and send it into the infrared single-pixel detector 9. The infrared single-pixel detector 9 is used to convert the signal light into an electrical signal as a feedback signal and input it into the optimization module. The infrared single-pixel detector 9 can be configured according to different needs. When the single photon flux is high, a single photon avalanche diode that supports single photon detection can be used. When the other conventional low photon flux is high, an ordinary detector can be used. The optimization module, which is connected to both the infrared single-pixel detector 9 and the digital micromirror device 4, is used to run an optimization algorithm based on the feedback signal to control the projection module to generate and update the modulation pattern in real time. The display screen 11 is used to receive the pattern visible beam and generate a pattern visible to the naked eye 12. The pattern visible beam can be directly directed to the display screen 11 or the naked eye 12, or a reflector 10 can be set between the beam splitter 6 and the display screen 11 as needed, and the pattern visible beam can be projected onto the display screen 11 through the reflector 10 to generate a pattern visible to the naked eye 12.

[0017] An infrared-visible upconversion display method based on single-pixel detection includes the following steps: S1. Initialize the modulation pattern of the digital micromirror device 4; S2. Spatially modulate the infrared beam and the visible beam simultaneously using the digital micromirror device 4 to obtain a patterned infrared beam and a patterned visible beam. S3. Project the patterned infrared beam onto the infrared target 7, and use the infrared single-pixel detector 9 to collect the signal light after interacting with the infrared target 7, and convert the signal light into an electrical signal as an intensity feedback signal. S4. Based on the intensity feedback signal and the modulation pattern, calculate a cost function CF to evaluate the pattern quality. When the CF value increases monotonically, it indicates that the modulation pattern is increasingly matching the contour of the infrared target 7. The cost function CF is defined as follows: ; in, To modulate the pattern, Infrared target pattern, x and y These are pixel coordinates; S5. The optimization module runs a genetic algorithm to optimize the modulation pattern. It iteratively updates the modulation pattern based on the cost function CF, causing CF to increase and the modulation pattern to gradually converge and match the spatial distribution of the infrared target 7. The specific steps of the genetic algorithm optimization are as follows: S51, infrared light source 1, and visible light source 2 generate infrared and visible light beams, which are combined by beam combiner 3 and modulated by digital micromirror device 4 to form an initial random pattern population P. ; in, k For population size, This is a modulation pattern in the 0th generation population; S52. The modulated patterned infrared beam illuminates the infrared target 7, and the cost function CF is calculated based on the measurement value of the infrared single-pixel detector 9. S53. The optimization module optimizes the modulation pattern based on an optimization algorithm: The population is sorted by CF (Color, Color, and Fibre) and a high-ranking parent pattern is randomly selected. Crossover (random pixel inheritance) and mutation (flipping some pixels) are then performed to generate a sub-pattern that replaces the low-ranking pattern. The mutation rate is... r Decline by exponential rate: ; in, and These represent the initial and final mutation rates, respectively. , , m This represents the total number of iterations in the genetic algorithm. This represents the current iteration number; S54. Repeat S52 and S53 until the cost function CF converges; S6. At the same time, the visible beam corresponding to the updated modulation pattern will be projected onto the surface of the infrared target 7 or the display screen 11 to achieve real-time visualization of the invisible infrared scene.

[0018] like Figure 2 As shown, when used for infrared anti-counterfeiting, infrared-sensitive ink is used to print patterns that are invisible to the naked eye on paper. Under ambient light, the patterns are completely invisible, but through the system and method of this invention, they can be clearly converted into visible light images.

[0019] Example 2 like Figure 3 As shown, this embodiment uses a single-photon avalanche diode with ultra-high photon sensitivity as an infrared single-pixel detector. Even under extremely low photon flux conditions, it can still obtain a resolvable visible light image, demonstrating the usability and robustness of the invention under extremely low illumination conditions.

[0020] Furthermore, this invention not only operates in both transmission and reflection modes, but also achieves dual-mode visualization (positive / negative) by substituting the reciprocal of the valence function CF, corresponding to positive and negative images of object intensity. The positive mode highlights the infrared-sensitive region, while the negative mode minimizes photodegradation of the photosensitive material, providing new possibilities for applications requiring precise illumination control.

[0021] Therefore, the infrared-visible upconversion display device and method based on single-pixel detection described above have the characteristics of high sensitivity, low cost, and real-time visualization, and can achieve efficient conversion at sub-photon level infrared flux.

[0022] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can still be made to the technical solutions of the present invention, and these modifications or equivalent substitutions cannot cause the modified technical solutions to deviate from the spirit and scope of the technical solutions of the present invention.

Claims

1. An infrared-visible upconversion display device based on single-pixel detection, characterized in that: It includes a beam generating module, a projection module, a detection module and a display screen arranged sequentially along the optical path, as well as an optimization module not arranged in the optical path; A beam generation module is used to generate a common beam in which infrared and visible beams share the same path. The projection module is used to spatially modulate and project the common beam to generate a patterned beam that matches the spatial distribution of the infrared target, and decompose the patterned beam into a patterned infrared beam and a patterned visible beam, which are then directed into the infrared target and the display screen, respectively. The projection module includes a digital micromirror device, a projection lens, and a beam splitter arranged sequentially along the optical path; The digital micromirror device is used to receive a common beam and modulate the common beam to form a patterned beam. The projection lens is used to magnify the patterned beam and then direct it into the beam splitter. The beam splitter is used to decompose the patterned beam into a patterned infrared beam and a patterned visible beam. The patterned infrared beam is incident on the infrared target and generates signal light after interacting with the infrared target. The patterned visible beam is reflected to the display screen. The detection module is used to collect the signal light after the modulated patterned infrared beam interacts with the infrared target, and convert it into an electrical signal as a feedback signal to be transmitted to the optimization module. The detection module includes a collecting lens and an infrared single-pixel detector arranged sequentially along the optical path; The collecting lens is used to collect signal light and direct it into the infrared single-pixel detector; The infrared single-pixel detector is used to convert the signal light into an electrical signal, which is then fed back to the optimization module. The optimization module is connected to the infrared single-pixel detector and the digital micromirror device, and is used to run an optimization algorithm based on the feedback signal to control the projection module to generate and update the modulation pattern in real time. The display screen is used to receive the patterned visible light beam corresponding to the updated modulation pattern, thereby enabling the visualization of infrared targets.

2. The infrared-visible upconversion display device based on single-pixel detection according to claim 1, characterized in that: The beam generation module includes an infrared light source, a visible light source, and a beam combiner located at the intersection of the two beams. After the infrared beam generated by the infrared light source and the visible beam generated by the visible light source both enter the beam combiner, the beam combiner emits a common beam that shares the same path as the infrared beam and the visible beam, and the common beam enters the projection module.

3. The infrared-visible upconversion display device based on single-pixel detection according to claim 1, characterized in that: The display screen is used to receive a pattern-visible beam of light and generate a pattern that is visible to the naked eye.

4. An infrared-visible upconversion display method based on single-pixel detection, using the infrared-visible upconversion display device based on single-pixel detection as described in any one of claims 1-3, characterized in that: Includes the following steps: S1. Initialize the modulation pattern of the digital micromirror device; S2. Spatially modulate the infrared beam and the visible beam simultaneously using a digital micromirror device to obtain a patterned infrared beam and a patterned visible beam. S3. Project the patterned infrared beam onto the infrared target, and use an infrared single-pixel detector to collect the signal light after interacting with the infrared target, and convert the signal light into an electrical signal as an intensity feedback signal. S4. Based on the intensity feedback signal and the modulation pattern, calculate a cost function CF to evaluate the pattern quality. When the CF value increases monotonically, it indicates that the modulation pattern is increasingly matching the outline of the infrared target. S5. The optimization module runs a genetic algorithm to optimize the modulation pattern. Iteratively updates the modulation pattern according to the cost function CF so that the cost function CF increases and the modulation pattern gradually converges and matches the spatial distribution of the infrared target. S6. At the same time, the visible beam corresponding to the updated modulation pattern will be projected onto the infrared target surface or display screen to achieve real-time visualization of the invisible infrared scene.

5. The infrared-visible upconversion display method based on single-pixel detection according to claim 4, characterized in that: In step S4, the cost function CF is defined as follows: ； in, To modulate the pattern, Infrared target pattern, x and y These are pixel coordinates.

6. The infrared-visible upconversion display method based on single-pixel detection according to claim 5, characterized in that: In step S5, the specific steps of the genetic algorithm optimization are as follows: S51. Infrared and visible light sources generate infrared and visible light beams, which are combined by a beam combiner and then modulated by a digital micromirror device to form an initial random pattern population P. ； in, k For population size, This is a modulation pattern in the 0th generation population; S52. The modulated patterned infrared beam illuminates the infrared target, and the cost function CF is calculated based on the measurement value of the infrared single-pixel detector. S53. The optimization module optimizes the modulation pattern based on an optimization algorithm: the population is sorted by CF, a high-ranking parent pattern is randomly selected, crossover and mutation are performed, and a child pattern is generated to replace the low-ranking pattern, wherein the mutation rate is... r Decline by exponential rate: ； in, and These represent the initial and final mutation rates, respectively. m This represents the total number of iterations in the genetic algorithm. This represents the current iteration number; S54. Repeat S52 and S53 until the cost function CF converges.

Images