Single-pixel imaging method based on lithium niobate electro-optical modulator array

Through a single pixel imaging method based on lithium niobate electro-optical modulator array, the electro-optical effect of lithium niobate film and four-step phase shift Fourier transform is used to solve the problem of insufficient DMD modulation rate, high-speed imaging is achieved, and single Application range of pixel imaging.

CN119087702APending Publication Date: 2024-12-06HEFEI UNIV OF TECH
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411183132.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-27
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

In existing single-pixel imaging technologies, the mechanical motion of digital micromirror arrays (DMDs) limits their modulation rates and is difficult to meet the needs of fast and high-resolution imaging.

Method used

Using a single pixel imaging method based on the lithium niobate electro-optical modulator array, an array electro-optical modulator is made through the electro-optical effect of the lithium niobate film, and a four-step phase shift Fourier transform is used to generate a substrate pattern, and through spatial resolution without space resolution The photodetector receives and processes light intensity information to reconstruct the image.

Benefits of technology

High-speed optical intensity modulation is achieved, and the modulation speed can reach megahertz or even gigahertz levels, which significantly improves the imaging rate, overcomes the speed limitations of traditional mechanical modulators, and expands the application prospects of high resolution and rapid imaging.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119087702A_ABST
    Figure CN119087702A_ABST
Patent Text Reader

Abstract

The invention discloses a single-pixel imaging method based on a lithium niobate electro-optical modulator array. The method comprises the steps that an array type electro-optical modulator is manufactured based on the electro-optical effect of a lithium niobate film; the method comprises the following steps: establishing an optical system for single-pixel imaging, generating a substrate pattern by adopting four-step phase-shift Fourier transform, and projecting the substrate pattern to a target by using an electro-optical modulator array; and receiving light intensity information reflected by the target, and processing the collected light intensity information data to reconstruct a target image. The electro-optical modulator array based on the lithium niobate microcavity is manufactured based on the electro-optical effect of the lithium niobate by utilizing a micro-nano processing technology. Therefore, the performance of the single-pixel imaging technology can be remarkably improved, the problem of low imaging rate in the traditional technology is solved, and a new solution is provided for high-speed and high-resolution imaging.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of single pixel imaging, and in particular to a single pixel imaging method based on a lithium niobate electro-optic modulator array. Background Art

[0002] Single-pixel imaging technology is an imaging method that modulates the object to be measured using a coded pattern. The principle of this technology is that the light intensity signal reflected by the object is received by a bucket detector without spatial resolution, and then the image of the object is reconstructed by measuring the correlation between the coded pattern and the target object. The imaging rate depends to a large extent on the modulation rate of the coded illumination pattern by the spatial light modulation device. At present, the mainstream single-pixel imaging system uses a digital micromirror array (DMD) for light modulation, but the maximum modulation rate of the DMD is only 22kHz, which means that it takes a long time to generate a high-resolution image, which greatly limits the application scope of single-pixel imaging technology, especially in fields that require fast imaging.

[0003] The disadvantage of the existing technology is that when a digital micromirror array (DMD) is used to modulate a target, the working principle of the DMD relies on the mechanical movement of the micromirrors. Each micromirror reflects light by physically tilting to a different position. This mechanical movement has a certain inertia and response time, and even small movements are subject to physical limitations. Therefore, the modulation rate of the target by the DMD has significant limitations, usually only reaching the kilohertz (kHz) level. This greatly limits the feasibility of single-pixel imaging in practical applications, especially in environments that require fast and high-resolution imaging. Although DMD performs well in some low-speed imaging applications, its inherent physical limitations make it difficult to meet the needs of modern high-performance imaging systems. Therefore, finding alternative technologies that can overcome these limitations or improving existing technologies has become an important research direction in the field of single-pixel imaging. Summary of the invention

[0004] The purpose of the present invention is to overcome the shortcomings of the prior art. To achieve the above purpose, a single-pixel imaging method based on a lithium niobate electro-optical modulator array is adopted to solve the problems raised in the above background technology.

[0005] A single-pixel imaging method based on a lithium niobate electro-optic modulator array comprises the following steps:

[0006] Step S1, manufacturing an array electro-optic modulator based on the electro-optic effect of lithium niobate thin film;

[0007] Step S2, constructing an optical system for single-pixel imaging, then using a four-step phase-shift Fourier transform to generate a base pattern, and using an electro-optic modulator array to project the base pattern onto a target;

[0008] Step S3: receiving the light intensity information reflected by the target, and processing the collected light intensity information data to reconstruct the target image.

[0009] As a further solution of the present invention: the specific steps in step S1 include:

[0010] The array electro-optic modulator uses lithium niobate as the electro-optic material, is composed of a plurality of single independently controlled electro-optic modulators, and uses an array design to operate multiple pixels simultaneously;

[0011] The electrodes of each electro-optic modulator are independently controlled, and the switching state of each pixel is regulated by changing the voltage of the electrode to generate a coded lighting pattern;

[0012] At the same time, based on micro-nano processing technology and the electro-optic effect of lithium niobate, electro-optic modulators are densely integrated on the wafer to obtain an array electro-optic modulator.

[0013] As a further solution of the present invention: the specific steps in step S2 include:

[0014] The coded pattern is projected onto the target through an array electro-optic modulator, and a base pattern is generated using a four-step phase-shift Fourier transform;

[0015] The formula for generating the base pattern is:

[0016] P φ (x,y;f x ,f y ,φ)=a+b·cos(2πf x x+2πf y y+φ);

[0017] Where a is the average light intensity, b is the contrast, x and y are the rectangular coordinates in the spatial domain; f x , f y is the rectangular coordinate in the Fourier domain, corresponding to the spatial frequency in the x and y directions, and φ is the initial phase.

[0018] As a further solution of the present invention: the specific steps in step S3 include:

[0019] A photodetector without spatial resolution is used to receive the light intensity information modulated by the target and the coding pattern. A four-step phase-shifted base pattern is used. The initial phase φ in the formula is 0, π / 2, π, and π3 / 2 respectively. At each frequency, the generated base pattern is projected onto the target in turn and then received by the photodetector to obtain four corresponding voltages, which are recorded as D0, D π / 2 , D π , D π3 / 2 ;

[0020] According to the correlation algorithm of four-step phase shift, the Fourier coefficient is obtained by the following formula:

[0021] C(f x ,f y )=[D0(f x ,f y )-D π (f x ,f y )]+j·[D π / 2 (f x ,f y )-D π3 / 2 (f x ,f y )];

[0022] Where f is an imaginary unit and the image I(x,y) is reconstructed by inverse Fourier transform:

[0023] I(x,y)=F -1 (C(f x ,f y ));

[0024] Among them, F -1 () represents the inverse Fourier transform, which obtains the reconstructed image information of the target.

[0025] Compared with the prior art, the present invention has the following technical effects:

[0026] By adopting the above technical solution, the electro-optic modulator array based on micro-rings prepared by micro-nano processing technology can achieve high-speed modulation of light intensity, and the modulation speed can reach the level of megahertz (MHz) or even gigahertz (GHz), which will significantly improve the imaging rate. The electro-optic modulator array not only overcomes the speed limitation of traditional mechanical modulators, but also greatly expands its practical application prospects in high-resolution and fast imaging applications. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The specific embodiments of the present invention are described in detail below in conjunction with the accompanying drawings:

[0028] Figure 1 A schematic diagram of the steps of a single-pixel imaging method according to an embodiment disclosed in the present application;

[0029] Figure 2 A flowchart of a single-pixel imaging method according to an embodiment of the present application;

[0030] Figure 3 A schematic diagram of a single-pixel imaging experimental device according to an embodiment disclosed in the present application;

[0031] Figure 4A schematic diagram of a 32×32 electro-optic modulator array according to an embodiment disclosed in the present application;

[0032] Figure 5 A schematic diagram of a microring resonator according to an embodiment of the present application;

[0033] Figure 6 The structure of a single microring resonant cavity of the embodiment disclosed in this application;

[0034] Figure 7 A schematic diagram of the hierarchical structure of an electro-optic modulator according to an embodiment disclosed in the present application;

[0035] Figure 8 The following are simulation results of the shift of the resonance peak when different voltages are applied according to the embodiments disclosed in this application. DETAILED DESCRIPTION

[0036] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0037] Please refer to Figure 1 and Figure 2 In an embodiment of the present invention, a single pixel imaging method based on a lithium niobate electro-optic modulator array comprises the following steps:

[0038] In this embodiment, Figure 2 As shown in the figure, it is an experimental flow chart. First, the electro-optical effect of lithium niobate film is used to make an electro-optic modulator array, and the process involved includes coating, photolithography and etching. Then, an optical system for single-pixel imaging is built, and the target is modulated using an array electro-optical modulator (EOM). The modulation pattern uses a four-step phase-shift Fourier transform to generate a substrate pattern. Finally, a photodetector without spatial light resolution is used to receive the light intensity information reflected by the target, and the collected data is processed to reconstruct the target image.

[0039] Step S1, manufacturing an array electro-optic modulator based on the electro-optic effect of lithium niobate thin film, the specific steps include:

[0040] The array electro-optic modulator uses lithium niobate as the electro-optic material, is composed of a plurality of single independently controlled electro-optic modulators, and uses an array design to operate multiple pixels simultaneously;

[0041] The electrodes of each electro-optic modulator are independently controlled, and the switching state of each pixel is regulated by changing the voltage of the electrode to generate a coded lighting pattern;

[0042] At the same time, based on micro-nano processing technology and the electro-optic effect of lithium niobate, electro-optic modulators are densely integrated on the wafer to obtain an array electro-optic modulator.

[0043] Step S2, building an optical system for single-pixel imaging, then using a four-step phase-shift Fourier transform to generate a base pattern, and using an electro-optic modulator array to project the base pattern onto a target. The specific steps include:

[0044] like Figure 3 As shown, the figure is a schematic diagram of a single-pixel imaging experimental device. First, the coding pattern is projected onto the target through an array electro-optical modulator. The present invention uses a four-step phase-shift Fourier transform to generate a base pattern to enhance its robustness. Then, a photodetector without spatial resolution is used to receive the light intensity information modulated by the target and the coding pattern. Finally, the collected signal is processed by a computer to reconstruct the target image.

[0045] The coded pattern is projected onto the target through an array electro-optic modulator, and a base pattern is generated using a four-step phase-shift Fourier transform;

[0046] The formula for generating the base pattern is:

[0047] P φ (x,y;f x ,f y ,φ)=a+b·cos(2πf x x+2πf y y+φ); (1)

[0048] Where a is the average light intensity, b is the contrast, x and y are the rectangular coordinates in the spatial domain; f x , f y is the rectangular coordinate in the Fourier domain, corresponding to the spatial frequency in the x and y directions, and φ is the initial phase.

[0049] Step S3, receiving the light intensity information reflected by the target, and processing the collected light intensity information data to reconstruct the target image. The specific steps include:

[0050] A photodetector without spatial resolution is used to receive the light intensity information modulated by the target and the coding pattern. A four-step phase-shifted base pattern is used. The initial phase φ in the formula is 0, π / 2, π, and π3 / 2 respectively. At each frequency, the generated base pattern is projected onto the target in turn and then received by the photodetector to obtain four corresponding voltages, which are recorded as D0, D π / 2 , D π , D π3 / 2 ;

[0051] According to the correlation algorithm of four-step phase shift, the Fourier coefficient is obtained by the following formula:

[0052] C(f x ,f y )=[D0(f x ,f y )-D π (f x ,f y )]+j·[D π / 2 (f x ,f y )-D π3 / 2 (f x ,f y )];(2)

[0053] Where j is an imaginary unit and the image I(x,y) is reconstructed by inverse Fourier transform:

[0054] I(x,y)=F -1 (C(f x ,f y )); (3)

[0055] Among them, F -1 () represents the inverse Fourier transform, which obtains the reconstructed image information of the target.

[0056] It should be noted that when encoding the target image using the projection pattern, it can be based on Fourier transform, cosine transform, Hadamard transform, Radon transform, etc.

[0057] The projection module can use a variety of spatial light modulators such as projectors, LCDs, DMDs, etc. to modulate the projection pattern;

[0058] Photodetectors can be replaced by photoelectric devices such as photocells and photodiodes that respond to light intensity information.

[0059] like Figure 4 As shown, the figure is a schematic diagram of a 32×32 electro-optical modulator array. The array can achieve fast modulation of a target with a coded illumination pattern with a resolution of 32×32.

[0060] Specifically, first, this electro-optic modulator array consists of many individual electro-optic modulators, each of which can be controlled independently. This array design allows us to operate multiple pixels simultaneously, thereby achieving high-resolution coded illumination patterns. The electrodes of each electro-optic modulator can be controlled independently. By changing the voltage of the electrode, the on-off state of each pixel is regulated, thereby generating a 32×32 coded illumination pattern.

[0061] Secondly, by using micro-nano processing technology, these electro-optic modulators are integrated at a high density on a single wafer. This integration method not only saves space but also improves the efficiency of the overall system.

[0062] In addition, lithium niobate responds very quickly to electric fields. Therefore, when the electric field switches, the light intensity at the output port also changes rapidly. This allows us to quickly modulate the coded lighting pattern. Finally, optimization directions include further optimizing the structure of a single electro-optic modulator, such as reducing the volume, increasing the modulation rate, and even exploring the application of other materials to meet the needs of different application scenarios.

[0063] like Figure 5 As shown, the figure shows the schematic diagram of the microring resonator, which consists of a closed waveguide and a straight waveguide. When the optical power is in a resonant state, the optical field intensity can be greatly enhanced.

[0064] The propagation constant β of the optical power in the microring is:

[0065]

[0066] Where ω is the angular frequency, c is the speed of light, and n eff is the effective refractive index of the material, k is the wave vector, and λ is the wavelength. Assuming the radius of the microring is r, the phase difference caused by the light propagating in the microring is:

[0067]

[0068] When the phase difference θ=2πm(m=1,2,3,…), the light satisfies the resonance condition of the microring, and then:

[0069]

[0070] Assuming that there is no loss in the coupling between the straight waveguide and the ring waveguide, and that there is no polarization change, and that the various losses of light propagating in the microring are incorporated into the attenuation factor, the transmission matrix of the above microring resonator can be written as

[0071]

[0072] Among them, E i1 、E i2 、E t1 、E t2 Respectively represent the input and output and the amplitude of the light field at each position in the ring, κ is the amplitude coupling efficiency between the ring and the straight waveguide, τ is the amplitude transmission efficiency, and * represents the complex conjugation. Since the coupling region is lossless, the microring resonator is reciprocal, so κ and τ satisfy the following relationship:

[0073] τ 2 |+|κ 2 |=1 (5)

[0074] In order to simplify the model, let E i1 =1, then the light field amplitude after one cycle of light transmission in the microring is:

[0075] E i2 =α·e jθ E t2 (6)

[0076] Among them, α is the attenuation factor of light transmitted in the microring, which has no dimension and is related to the transmission loss a(m -1 ) satisfies α=e -aπr The relationship between r and a is 1, so α = 1 when there is zero loss. In addition, the transmission loss a (cm -1 ) and a0(dB / cm) have the following relationship:

[0077]

[0078] According to formula (4) and (6), we can get:

[0079]

[0080] In formula (8), let the input terminal E i1 =1, that is, the input light intensity is 1. Since θ is 2πm when the light field is in a resonant state, the light intensity at the output end is:

[0081]

[0082] When α=τ|, that is, the attenuation factor in the ring is equal to the coupling transmission coefficient, the output light intensity in equation (11) is 0, which is called critical coupling. At this time, the light intensity in the ring reaches the maximum:

[0083]

[0084] According to the relationship between the amplitude transmission efficiency τ and the round-trip attenuation factor α, the coupling state of the microring can be divided into under-coupling (τ>α), critical coupling (τ=α) and over-coupling (τ<α).

[0085] like Figure 6 As shown in the figure, a schematic diagram of the structure of a single electro-optic modulator is shown. The modulator uses lithium niobate as the electro-optic material, which is highly favored because of its large electro-optic coefficient.

[0086] At the input port, a grating coupler is used to achieve on-chip coupling of light. According to the principle of the microring resonator, the light energy that meets the resonance conditions will be stored in the resonator, thus presenting a series of resonance peaks on the spectrum of the output port.

[0087] Metal electrodes are arranged on both sides of the straight runway, and an electric field is generated when voltage is applied to the electrodes.

[0088] According to the linear electro-optic effect (Pockels effect) of lithium niobate, the electric field will cause the refractive index of lithium niobate to change, thereby changing the position of the resonance peak. The high-speed change of the electric field causes the position of the resonance peak to change rapidly. The light intensity information near the resonance peak is detected at the output port. The light intensity is 0 when there is no voltage and 1 when there is voltage, thereby realizing the fast optical switching function. This design utilizes the high electro-optic coefficient of lithium niobate material and the resonant characteristics of the microring resonant cavity to achieve efficient light modulation and fast optical switching, providing strong support for single-pixel imaging and other optoelectronic applications.

[0089] like Figure 7 As shown in the figure, the hierarchical structure diagram of the electro-optic modulator is shown; the production process of the electro-optic modulator is as follows:

[0090] First, a layer of silicon dioxide (SiO2) is grown on a silicon (Si) wafer.

[0091] Then, high-quality lithium niobate (LiNbO3) film is prepared through ion slicing and wafer bonding technology. A layer of silicon nitride (Si3N4) is deposited on the lithium niobate film, and the silicon nitride layer is photolithographically and etched using an electron beam lithography machine. Finally, metal electrodes are deposited and formed through electron beam evaporation deposition, laser direct writing and lift-off processes. The high performance and reliability of the electro-optical modulator are ensured, and the superior electro-optical properties of the lithium niobate film are fully utilized, providing a solid foundation for achieving efficient optical modulation.

[0092] like Figure 8 As shown, the figure shows the simulation results of the shift of the resonance peak when different voltages are applied;

[0093] Since the refractive index of lithium niobate will change after applying voltage, the position of the resonance peak at the output port of the electro-optic modulator will shift. The figure shows the position of the resonance peak when 0V, 1V, 4V, and 10V are applied respectively.

[0094] Beneficial effects:

[0095] In traditional single-pixel imaging methods, the modulation of coded illumination patterns usually relies on digital micromirror arrays (DMDs). DMDs are based on the mechanical movement of micromirrors to switch light on and off, so their modulation rate is significantly limited. Single-pixel imaging requires projecting a series of coded illumination patterns, and the flipping rate of the micromirrors in the DMD determines the modulation rate of these patterns. Therefore, obtaining high-resolution images requires a lot of time to project the coded illumination pattern.

[0096] The electro-optic modulator array used in the present invention is based on the electro-optic effect of lithium niobate film. When voltage is applied, the refractive index of the lithium niobate material changes, thereby changing the light passing state. Unlike DMD, the electro-optic modulator array can realize the switching of light without mechanical movement, and its modulation rate can be increased by several orders of magnitude compared to DMD. Therefore, the time required for single-pixel imaging using the electro-optic modulator array is greatly shortened, greatly expanding the application scenarios of single-pixel imaging. In this way, the electro-optic modulator array not only overcomes the limitations of the traditional DMD in modulation rate, but also significantly improves the efficiency and practicality of single-pixel imaging.

[0097] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention. The scope of the present invention is defined by the appended claims and their equivalents, and all should be included within the scope of protection of the present invention.

Claims

1. A single-pixel imaging method based on a lithium niobate electro-optic modulator array, characterized in that: The following steps are involved: Step S1, manufacturing an array electro-optic modulator based on the electro-optic effect of lithium niobate thin film; Step S2, constructing an optical system for single-pixel imaging, then using a four-step phase-shift Fourier transform to generate a base pattern, and using an electro-optic modulator array to project the base pattern onto a target; Step S3: receiving the light intensity information reflected by the target, and processing the collected light intensity information data to reconstruct the target image.

2. A single pixel imaging method based on a lithium niobate electro-optical modulator array according to claim 1, characterized in that: The specific steps in step S1 include: The array electro-optic modulator uses lithium niobate as the electro-optic material, is composed of a plurality of single independently controlled electro-optic modulators, and uses an array design to operate multiple pixels simultaneously; The electrodes of each electro-optic modulator are independently controlled, and the switching state of each pixel is regulated by changing the voltage of the electrode to generate a coded lighting pattern; At the same time, based on micro-nano processing technology and the electro-optic effect of lithium niobate, electro-optic modulators are densely integrated on the wafer to obtain an array electro-optic modulator.

3. The single-pixel imaging method based on a lithium niobate electro-optic modulator array according to claim 1, characterized in that: The specific steps in step S2 include: The coded pattern is projected onto the target through an array electro-optic modulator, and a base pattern is generated using a four-step phase-shift Fourier transform; The formula for generating the base pattern is: P φ (x,y;f x ,f y ,φ)=a+b·cos(2πf x x+2πf y y+φ); Where a is the average light intensity, b is the contrast, x and y are the rectangular coordinates in the spatial domain; f x , f y is the rectangular coordinate in the Fourier domain, corresponding to the spatial frequency in the x and y directions, and φ is the initial phase.

4. The single-pixel imaging method based on a lithium niobate electro-optic modulator array according to claim 3, characterized in that: The specific steps in step S3 include: A photodetector without spatial resolution is used to receive the light intensity information modulated by the target and the coding pattern. A four-step phase-shifted base pattern is used. The initial phase φ in the formula is 0, π / 2, π, and π3 / 2 respectively. At each frequency, the generated base pattern is projected onto the target in turn and then received by the photodetector to obtain four corresponding voltages, which are recorded as D0, D π / 2 , D π , D π3 / 2 ; According to the correlation algorithm of four-step phase shift, the Fourier coefficient is obtained by the following formula: C(f x ,f y )=[D0(f x ,f y )-D π (f x ,f y )]+j·[D π / 2 (f x ,f y )-D π3 / 2 (f x ,f y )]; Where j is an imaginary unit and the image I(x,y) is reconstructed by inverse Fourier transform: I(x,y)=F -1 (C(f x ,f y )); Among them, F -1 () represents the inverse Fourier transform, which obtains the reconstructed image information of the target.

Citation Information

Cited By

  • Photoacoustic microscopic imaging axial resolution improving method based on single-pixel frequency domain acquisition

    CN119804662A